2024-03-16T07:08:01.086 INFO:root:teuthology version: 0.0.1.dev262+ge691533 2024-03-16T07:08:01.087 DEBUG:teuthology.run:Teuthology command: teuthology --name pdonnell-2024-03-15_13:00:41-fs-wip-batrick-testing-20240314.183243-distro-default-smithi --archive /home/teuthworker/archive/pdonnell-2024-03-15_13:00:41-fs-wip-batrick-testing-20240314.183243-distro-default-smithi/7602244 --verbose --description fs/valgrind/{begin/{0-install 1-ceph 2-logrotate} centos_latest debug mirror/{cephfs-mirror/one-per-cluster clients/mirror cluster/1-node mount/fuse overrides/ignorelist_health tasks/mirror}} --owner scheduled_pdonnell@teuthology -- /home/teuthworker/archive/pdonnell-2024-03-15_13:00:41-fs-wip-batrick-testing-20240314.183243-distro-default-smithi/7602244/orig.config.yaml 2024-03-16T07:08:01.121 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-16T07:08:01.195 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2024-03-15_13:00:41-fs-wip-batrick-testing-20240314.183243-distro-default-smithi/7602244 branch: wip-batrick-testing-20240314.183243 description: fs/valgrind/{begin/{0-install 1-ceph 2-logrotate} centos_latest debug mirror/{cephfs-mirror/one-per-cluster clients/mirror cluster/1-node mount/fuse overrides/ignorelist_health tasks/mirror}} email: pdonnell@redhat.com first_in_suite: false job_id: '7602244' kernel: kdb: true sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi meta: - desc: run one cephfs-mirror daemon on primary cluster - desc: configure the permissions for client.mirror - desc: 1 ceph cluster with 1 mon, 1 mgr, 3 osds, 5 mdss name: pdonnell-2024-03-15_13:00:41-fs-wip-batrick-testing-20240314.183243-distro-default-smithi no_nested_subset: false nuke-on-error: true os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-batrick-testing-20240314.183243 ceph: conf: client: debug cephfs_mirror: 20 log to stderr: false client.mirror: admin socket: /var/run/ceph/cephfs-mirror.asok pid file: /var/run/ceph/cephfs-mirror.pid mgr: debug client: 10 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: debug ms: 1 debug osd: 20 flavor: default log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - POOL_APP_NOT_ENABLED - overall HEALTH_ - Replacing daemon - deprecated feature inline_data sha1: 3d78f5ba07bf18880172c07d4d7b4ac00c9d30af ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: debuginfo: true flavor: default sha1: 3d78f5ba07bf18880172c07d4d7b4ac00c9d30af selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 workunit: branch: wip-batrick-testing-20240314.183243 sha1: 3d78f5ba07bf18880172c07d4d7b4ac00c9d30af owner: scheduled_pdonnell@teuthology priority: 75 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - mds.b - mds.c - mds.d - mds.e - osd.0 - osd.1 - osd.2 - client.0 - client.1 - client.mirror - client.mirror_remote seed: 4770 sha1: 3d78f5ba07bf18880172c07d4d7b4ac00c9d30af sleep_before_teardown: 0 subset: 498/512 suite: fs suite_branch: wip-batrick-testing-20240314.183243 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_3d78f5ba07bf18880172c07d4d7b4ac00c9d30af/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 3d78f5ba07bf18880172c07d4d7b4ac00c9d30af syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi049.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNxI8tCqFRhkm7p8GBvWHe8mGn7NFyGFbd0OL/4fy7dDeQDJ1tttKE7pz3Gukl+7Z+lsRx6pd/9kCFKzrn9UVJU= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - cephfs-mirror: client: client.mirror valgrind: - --tool=memcheck - --leak-check=full - --show-reachable=yes - exec: client.mirror: - sudo ceph auth caps client.mirror mon 'profile cephfs-mirror' mds 'allow r' osd 'allow rw tag cephfs metadata=*, allow r tag cephfs data=*' mgr 'allow r' client.mirror_remote: - sudo ceph auth caps client.mirror_remote mon 'allow r' mds 'allow rwps' osd 'allow rw tag cephfs *=*' mgr 'allow r' - ceph-fuse: - client.0 - client.1 - cephfs_test_runner: modules: - tasks.cephfs.test_mirroring.TestMirroring teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: e691533f9cbb33d85b2187bba20d7102f098636d timestamp: 2024-03-15_13:00:41 tube: smithi user: pdonnell verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-03-16T07:08:01.196 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_3d78f5ba07bf18880172c07d4d7b4ac00c9d30af/qa; will attempt to use it 2024-03-16T07:08:01.196 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_3d78f5ba07bf18880172c07d4d7b4ac00c9d30af/qa/tasks 2024-03-16T07:08:01.196 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-03-16T07:08:01.198 INFO:teuthology.task.internal:Checking packages... 2024-03-16T07:08:01.220 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '3d78f5ba07bf18880172c07d4d7b4ac00c9d30af' 2024-03-16T07:08:01.220 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-03-16T07:08:01.220 INFO:teuthology.packaging:ref: None 2024-03-16T07:08:01.220 INFO:teuthology.packaging:tag: None 2024-03-16T07:08:01.220 INFO:teuthology.packaging:branch: wip-batrick-testing-20240314.183243 2024-03-16T07:08:01.220 INFO:teuthology.packaging:sha1: 3d78f5ba07bf18880172c07d4d7b4ac00c9d30af 2024-03-16T07:08:01.221 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-batrick-testing-20240314.183243 2024-03-16T07:08:01.447 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-2162.g3d78f5ba 2024-03-16T07:08:01.449 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-03-16T07:08:01.456 INFO:teuthology.task.internal:no buildpackages task found 2024-03-16T07:08:01.456 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-03-16T07:08:01.474 INFO:teuthology.task.internal:Saving configuration 2024-03-16T07:08:01.487 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-03-16T07:08:01.493 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-16T07:08:01.516 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi049.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-03-15_13:00:41-fs-wip-batrick-testing-20240314.183243-distro-default-smithi/7602244', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-16 07:01:44.948065', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNxI8tCqFRhkm7p8GBvWHe8mGn7NFyGFbd0OL/4fy7dDeQDJ1tttKE7pz3Gukl+7Z+lsRx6pd/9kCFKzrn9UVJU='} 2024-03-16T07:08:01.516 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-03-16T07:08:01.528 INFO:teuthology.task.internal:roles: ubuntu@smithi049.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.b', 'mds.c', 'mds.d', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'client.0', 'client.1', 'client.mirror', 'client.mirror_remote'] 2024-03-16T07:08:01.528 INFO:teuthology.run_tasks:Running task console_log... 2024-03-16T07:08:01.568 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fd8b8574f70>, signals=[15]) 2024-03-16T07:08:01.569 INFO:teuthology.run_tasks:Running task internal.connect... 2024-03-16T07:08:01.575 INFO:teuthology.task.internal:Opening connections... 2024-03-16T07:08:01.575 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi049.front.sepia.ceph.com 2024-03-16T07:08:01.577 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-16T07:08:01.683 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-03-16T07:08:01.690 DEBUG:teuthology.orchestra.run.smithi049:> uname -m 2024-03-16T07:08:01.750 INFO:teuthology.orchestra.run.smithi049.stdout:x86_64 2024-03-16T07:08:01.751 DEBUG:teuthology.orchestra.run.smithi049:> cat /etc/os-release 2024-03-16T07:08:01.807 INFO:teuthology.orchestra.run.smithi049.stdout:NAME="CentOS Stream" 2024-03-16T07:08:01.807 INFO:teuthology.orchestra.run.smithi049.stdout:VERSION="9" 2024-03-16T07:08:01.807 INFO:teuthology.orchestra.run.smithi049.stdout:ID="centos" 2024-03-16T07:08:01.807 INFO:teuthology.orchestra.run.smithi049.stdout:ID_LIKE="rhel fedora" 2024-03-16T07:08:01.807 INFO:teuthology.orchestra.run.smithi049.stdout:VERSION_ID="9" 2024-03-16T07:08:01.807 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM_ID="platform:el9" 2024-03-16T07:08:01.807 INFO:teuthology.orchestra.run.smithi049.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-16T07:08:01.807 INFO:teuthology.orchestra.run.smithi049.stdout:ANSI_COLOR="0;31" 2024-03-16T07:08:01.807 INFO:teuthology.orchestra.run.smithi049.stdout:LOGO="fedora-logo-icon" 2024-03-16T07:08:01.807 INFO:teuthology.orchestra.run.smithi049.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-16T07:08:01.808 INFO:teuthology.orchestra.run.smithi049.stdout:HOME_URL="https://centos.org/" 2024-03-16T07:08:01.808 INFO:teuthology.orchestra.run.smithi049.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-16T07:08:01.808 INFO:teuthology.orchestra.run.smithi049.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-16T07:08:01.808 INFO:teuthology.orchestra.run.smithi049.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-16T07:08:01.808 INFO:teuthology.lock.ops:Updating smithi049.front.sepia.ceph.com on lock server 2024-03-16T07:08:01.831 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-03-16T07:08:01.839 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-03-16T07:08:01.844 INFO:teuthology.task.internal:Checking for old test directory... 2024-03-16T07:08:01.844 DEBUG:teuthology.orchestra.run.smithi049:> test '!' -e /home/ubuntu/cephtest 2024-03-16T07:08:01.862 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-03-16T07:08:01.868 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-03-16T07:08:01.868 DEBUG:teuthology.orchestra.run.smithi049:> test -z $(ls -A /var/lib/ceph) 2024-03-16T07:08:01.927 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-03-16T07:08:01.958 INFO:teuthology.run_tasks:Running task kernel... 2024-03-16T07:08:01.971 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2024-03-16T07:08:01.972 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2024-03-16T07:08:01.972 DEBUG:teuthology.orchestra.run.smithi049:> test -f /run/.containerenv -o -f /.dockerenv 2024-03-16T07:08:01.987 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-16T07:08:01.987 DEBUG:teuthology.orchestra.run.smithi049:> uname -r 2024-03-16T07:08:02.043 INFO:teuthology.orchestra.run.smithi049.stdout:5.14.0-361.el9.x86_64 2024-03-16T07:08:02.043 INFO:teuthology.task.kernel:Running kernel on smithi049: 5.14.0-361.el9.x86_64 2024-03-16T07:08:02.044 DEBUG:teuthology.orchestra.run.smithi049:> sudo yum install -y kernel 2024-03-16T07:08:04.211 INFO:teuthology.orchestra.run.smithi049.stdout:CentOS-9 - AppStream 12 MB/s | 6.7 MB 00:00 2024-03-16T07:08:05.728 INFO:teuthology.orchestra.run.smithi049.stdout:CentOS-9 - BaseOS 6.1 MB/s | 2.0 MB 00:00 2024-03-16T07:08:07.269 INFO:teuthology.orchestra.run.smithi049.stdout:CentOS Stream 9 - BaseOS 6.7 MB/s | 8.0 MB 00:01 2024-03-16T07:08:09.245 INFO:teuthology.orchestra.run.smithi049.stdout:CentOS Stream 9 - AppStream 22 MB/s | 19 MB 00:00 2024-03-16T07:08:13.412 INFO:teuthology.orchestra.run.smithi049.stdout:CentOS Stream 9 - CRB 14 MB/s | 6.1 MB 00:00 2024-03-16T07:08:14.989 INFO:teuthology.orchestra.run.smithi049.stdout:CentOS Stream 9 - Extras packages 40 kB/s | 15 kB 00:00 2024-03-16T07:08:16.658 INFO:teuthology.orchestra.run.smithi049.stdout:Extra Packages for Enterprise Linux 13 MB/s | 21 MB 00:01 2024-03-16T07:08:21.889 INFO:teuthology.orchestra.run.smithi049.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-03-16T07:08:22.082 INFO:teuthology.orchestra.run.smithi049.stdout:Last metadata expiration check: 0:00:01 ago on Sat 16 Mar 2024 07:08:21 AM UTC. 2024-03-16T07:08:24.154 INFO:teuthology.orchestra.run.smithi049.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-03-16T07:08:24.155 INFO:teuthology.orchestra.run.smithi049.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2024-03-16T07:08:24.244 INFO:teuthology.orchestra.run.smithi049.stdout:Dependencies resolved. 2024-03-16T07:08:24.253 INFO:teuthology.orchestra.run.smithi049.stdout:================================================================================ 2024-03-16T07:08:24.253 INFO:teuthology.orchestra.run.smithi049.stdout: Package Architecture Version Repository Size 2024-03-16T07:08:24.253 INFO:teuthology.orchestra.run.smithi049.stdout:================================================================================ 2024-03-16T07:08:24.253 INFO:teuthology.orchestra.run.smithi049.stdout:Installing: 2024-03-16T07:08:24.253 INFO:teuthology.orchestra.run.smithi049.stdout: kernel x86_64 5.14.0-427.el9 baseos 6.0 M 2024-03-16T07:08:24.253 INFO:teuthology.orchestra.run.smithi049.stdout:Installing dependencies: 2024-03-16T07:08:24.254 INFO:teuthology.orchestra.run.smithi049.stdout: kernel-core x86_64 5.14.0-427.el9 baseos 21 M 2024-03-16T07:08:24.254 INFO:teuthology.orchestra.run.smithi049.stdout: kernel-modules x86_64 5.14.0-427.el9 baseos 39 M 2024-03-16T07:08:24.254 INFO:teuthology.orchestra.run.smithi049.stdout: kernel-modules-core x86_64 5.14.0-427.el9 baseos 33 M 2024-03-16T07:08:24.254 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:08:24.254 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction Summary 2024-03-16T07:08:24.254 INFO:teuthology.orchestra.run.smithi049.stdout:================================================================================ 2024-03-16T07:08:24.254 INFO:teuthology.orchestra.run.smithi049.stdout:Install 4 Packages 2024-03-16T07:08:24.254 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:08:24.255 INFO:teuthology.orchestra.run.smithi049.stdout:Total download size: 100 M 2024-03-16T07:08:24.255 INFO:teuthology.orchestra.run.smithi049.stdout:Installed size: 123 M 2024-03-16T07:08:24.255 INFO:teuthology.orchestra.run.smithi049.stdout:Downloading Packages: 2024-03-16T07:08:27.408 INFO:teuthology.orchestra.run.smithi049.stdout:(1/4): kernel-modules-5.14.0-427.el9.x86_64.rpm 13 MB/s | 39 MB 00:03 2024-03-16T07:08:27.857 INFO:teuthology.orchestra.run.smithi049.stdout:(2/4): kernel-5.14.0-427.el9.x86_64.rpm 1.7 MB/s | 6.0 MB 00:03 2024-03-16T07:08:30.899 INFO:teuthology.orchestra.run.smithi049.stdout:(3/4): kernel-core-5.14.0-427.el9.x86_64.rpm 3.2 MB/s | 21 MB 00:06 2024-03-16T07:08:32.641 INFO:teuthology.orchestra.run.smithi049.stdout:(4/4): kernel-modules-core-5.14.0-427.el9.x86_6 6.4 MB/s | 33 MB 00:05 2024-03-16T07:08:32.641 INFO:teuthology.orchestra.run.smithi049.stdout:-------------------------------------------------------------------------------- 2024-03-16T07:08:32.641 INFO:teuthology.orchestra.run.smithi049.stdout:Total 12 MB/s | 100 MB 00:08 2024-03-16T07:08:33.562 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction check 2024-03-16T07:08:34.017 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction check succeeded. 2024-03-16T07:08:34.017 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction test 2024-03-16T07:08:35.412 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction test succeeded. 2024-03-16T07:08:35.412 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction 2024-03-16T07:08:38.275 INFO:teuthology.orchestra.run.smithi049.stdout: Preparing : 1/1 2024-03-16T07:08:38.956 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : kernel-modules-core-5.14.0-427.el9.x86_64 1/4 2024-03-16T07:08:39.100 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : kernel-core-5.14.0-427.el9.x86_64 2/4 2024-03-16T07:08:42.034 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: kernel-core-5.14.0-427.el9.x86_64 2/4 2024-03-16T07:08:42.211 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : kernel-modules-5.14.0-427.el9.x86_64 3/4 2024-03-16T07:08:47.314 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: kernel-modules-5.14.0-427.el9.x86_64 3/4 2024-03-16T07:08:47.431 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : kernel-5.14.0-427.el9.x86_64 4/4 2024-03-16T07:08:52.570 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: kernel-modules-core-5.14.0-427.el9.x86_64 4/4 2024-03-16T07:09:23.099 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: kernel-core-5.14.0-427.el9.x86_64 4/4 2024-03-16T07:09:23.099 INFO:teuthology.orchestra.run.smithi049.stdout:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-03-16T07:09:23.099 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:09:23.187 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: kernel-modules-5.14.0-427.el9.x86_64 4/4 2024-03-16T07:09:23.598 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: kernel-5.14.0-427.el9.x86_64 4/4 2024-03-16T07:09:23.599 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : kernel-5.14.0-427.el9.x86_64 1/4 2024-03-16T07:09:23.599 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : kernel-core-5.14.0-427.el9.x86_64 2/4 2024-03-16T07:09:23.599 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : kernel-modules-5.14.0-427.el9.x86_64 3/4 2024-03-16T07:09:24.059 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : kernel-modules-core-5.14.0-427.el9.x86_64 4/4 2024-03-16T07:09:24.059 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:09:24.059 INFO:teuthology.orchestra.run.smithi049.stdout:Installed: 2024-03-16T07:09:24.059 INFO:teuthology.orchestra.run.smithi049.stdout: kernel-5.14.0-427.el9.x86_64 2024-03-16T07:09:24.059 INFO:teuthology.orchestra.run.smithi049.stdout: kernel-core-5.14.0-427.el9.x86_64 2024-03-16T07:09:24.059 INFO:teuthology.orchestra.run.smithi049.stdout: kernel-modules-5.14.0-427.el9.x86_64 2024-03-16T07:09:24.060 INFO:teuthology.orchestra.run.smithi049.stdout: kernel-modules-core-5.14.0-427.el9.x86_64 2024-03-16T07:09:24.060 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:09:24.060 INFO:teuthology.orchestra.run.smithi049.stdout:Complete! 2024-03-16T07:09:24.574 DEBUG:teuthology.orchestra.run.smithi049:> rpm -q kernel | sort -rV | head -n 1 2024-03-16T07:09:24.722 INFO:teuthology.orchestra.run.smithi049.stdout:kernel-5.14.0-427.el9.x86_64 2024-03-16T07:09:24.722 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-427.el9.x86_64 2024-03-16T07:09:24.723 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-427.el9.x86_64 2024-03-16T07:09:24.723 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-03-16T07:09:24.723 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-03-16T07:09:24.723 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-03-16T07:09:24.723 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi049.front.sepia.ceph.com, path=None, version=distro) 2024-03-16T07:09:24.723 DEBUG:teuthology.orchestra.run.smithi049:> rpm -q kernel | sort -rV | head -n 1 2024-03-16T07:09:24.849 INFO:teuthology.orchestra.run.smithi049.stdout:kernel-5.14.0-427.el9.x86_64 2024-03-16T07:09:24.849 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-427.el9.x86_64 2024-03-16T07:09:24.849 DEBUG:teuthology.orchestra.run.smithi049:> sudo rpm -qi grub2-tools 2024-03-16T07:09:24.895 INFO:teuthology.orchestra.run.smithi049.stdout:Name : grub2-tools 2024-03-16T07:09:24.895 INFO:teuthology.orchestra.run.smithi049.stdout:Epoch : 1 2024-03-16T07:09:24.896 INFO:teuthology.orchestra.run.smithi049.stdout:Version : 2.06 2024-03-16T07:09:24.896 INFO:teuthology.orchestra.run.smithi049.stdout:Release : 68.el9 2024-03-16T07:09:24.896 INFO:teuthology.orchestra.run.smithi049.stdout:Architecture: x86_64 2024-03-16T07:09:24.896 INFO:teuthology.orchestra.run.smithi049.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-03-16T07:09:24.896 INFO:teuthology.orchestra.run.smithi049.stdout:Group : Unspecified 2024-03-16T07:09:24.896 INFO:teuthology.orchestra.run.smithi049.stdout:Size : 8264254 2024-03-16T07:09:24.896 INFO:teuthology.orchestra.run.smithi049.stdout:License : GPLv3+ 2024-03-16T07:09:24.896 INFO:teuthology.orchestra.run.smithi049.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-03-16T07:09:24.896 INFO:teuthology.orchestra.run.smithi049.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-03-16T07:09:24.896 INFO:teuthology.orchestra.run.smithi049.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-03-16T07:09:24.896 INFO:teuthology.orchestra.run.smithi049.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-03-16T07:09:24.896 INFO:teuthology.orchestra.run.smithi049.stdout:Packager : builder@centos.org 2024-03-16T07:09:24.896 INFO:teuthology.orchestra.run.smithi049.stdout:Vendor : CentOS 2024-03-16T07:09:24.896 INFO:teuthology.orchestra.run.smithi049.stdout:URL : http://www.gnu.org/software/grub/ 2024-03-16T07:09:24.896 INFO:teuthology.orchestra.run.smithi049.stdout:Summary : Support tools for GRUB. 2024-03-16T07:09:24.896 INFO:teuthology.orchestra.run.smithi049.stdout:Description : 2024-03-16T07:09:24.897 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:09:24.897 INFO:teuthology.orchestra.run.smithi049.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-03-16T07:09:24.897 INFO:teuthology.orchestra.run.smithi049.stdout:customizable bootloader with modular architecture. It supports a rich 2024-03-16T07:09:24.897 INFO:teuthology.orchestra.run.smithi049.stdout:variety of kernel formats, file systems, computer architectures and 2024-03-16T07:09:24.897 INFO:teuthology.orchestra.run.smithi049.stdout:hardware devices. 2024-03-16T07:09:24.897 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:09:24.897 INFO:teuthology.orchestra.run.smithi049.stdout:This subpackage provides tools for support of all platforms. 2024-03-16T07:09:24.898 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-03-16T07:09:24.898 INFO:teuthology.task.kernel:Updating grub on smithi049 to boot 5.14.0-427.el9.x86_64 2024-03-16T07:09:24.898 DEBUG:teuthology.orchestra.run.smithi049:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-03-16T07:09:25.473 INFO:teuthology.orchestra.run.smithi049.stderr:Generating grub configuration file ... 2024-03-16T07:09:26.811 INFO:teuthology.orchestra.run.smithi049.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-03-16T07:09:26.838 INFO:teuthology.orchestra.run.smithi049.stderr:done 2024-03-16T07:09:26.840 DEBUG:teuthology.orchestra.run.smithi049:> mktemp 2024-03-16T07:09:26.859 INFO:teuthology.orchestra.run.smithi049.stdout:/tmp/tmp.eEE9hRNwou 2024-03-16T07:09:26.859 DEBUG:teuthology.orchestra.run.smithi049:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.eEE9hRNwou 2024-03-16T07:09:26.931 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod 0666 /tmp/tmp.eEE9hRNwou 2024-03-16T07:09:27.075 DEBUG:teuthology.orchestra.remote:smithi049:/tmp/tmp.eEE9hRNwou is 6KB 2024-03-16T07:09:27.124 DEBUG:teuthology.orchestra.run.smithi049:> rm -fr /tmp/tmp.eEE9hRNwou 2024-03-16T07:09:27.138 DEBUG:teuthology.orchestra.run.smithi049:> sudo /bin/ls /boot/loader/entries || true 2024-03-16T07:09:27.210 INFO:teuthology.orchestra.run.smithi049.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-03-16T07:09:27.210 INFO:teuthology.orchestra.run.smithi049.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-03-16T07:09:27.210 INFO:teuthology.orchestra.run.smithi049.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-03-16T07:09:27.210 INFO:teuthology.orchestra.run.smithi049.stdout:15949e3c88704300882482eddfd7baae-5.14.0-427.el9.x86_64.conf 2024-03-16T07:09:27.211 DEBUG:teuthology.orchestra.run.smithi049:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-427.el9.x86_64 2024-03-16T07:09:27.377 DEBUG:teuthology.orchestra.run.smithi049:> sudo shutdown -r now 2024-03-16T07:09:57.398 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-03-16T07:09:57.399 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi049.front.sepia.ceph.com' 2024-03-16T07:09:57.400 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-16T07:10:15.838 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.49 2024-03-16T07:10:24.846 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi049.front.sepia.ceph.com' 2024-03-16T07:10:24.847 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-16T07:10:27.902 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.49 2024-03-16T07:10:39.906 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi049.front.sepia.ceph.com' 2024-03-16T07:10:39.907 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-16T07:10:42.974 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.49 2024-03-16T07:10:57.982 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi049.front.sepia.ceph.com' 2024-03-16T07:10:57.983 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-16T07:11:01.054 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.49 2024-03-16T07:11:19.070 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi049.front.sepia.ceph.com' 2024-03-16T07:11:19.072 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-16T07:11:37.502 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.49 2024-03-16T07:11:58.522 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi049.front.sepia.ceph.com' 2024-03-16T07:11:58.523 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-16T07:11:58.935 DEBUG:teuthology.orchestra.run.smithi049:> true 2024-03-16T07:11:59.339 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi049.front.sepia.ceph.com' 2024-03-16T07:11:59.339 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-427.el9.x86_64"... 2024-03-16T07:11:59.339 DEBUG:teuthology.orchestra.run.smithi049:> uname -r 2024-03-16T07:11:59.354 INFO:teuthology.orchestra.run.smithi049.stdout:5.14.0-427.el9.x86_64 2024-03-16T07:11:59.355 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-427.el9.x86_64 vs 5.14.0-427.el9.x86_64 2024-03-16T07:11:59.355 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-03-16T07:11:59.355 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-03-16T07:12:00.356 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-03-16T07:12:00.356 DEBUG:teuthology.orchestra.run.smithi049:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-03-16T07:12:00.424 INFO:teuthology.orchestra.run.smithi049.stdout:ttyS1 2024-03-16T07:12:00.469 DEBUG:teuthology.parallel:result is None 2024-03-16T07:12:00.470 INFO:teuthology.run_tasks:Running task internal.base... 2024-03-16T07:12:00.477 INFO:teuthology.task.internal:Creating test directory... 2024-03-16T07:12:00.477 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-03-16T07:12:00.495 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-03-16T07:12:00.501 INFO:teuthology.run_tasks:Running task internal.archive... 2024-03-16T07:12:00.513 INFO:teuthology.task.internal:Creating archive directory... 2024-03-16T07:12:00.513 DEBUG:teuthology.orchestra.run.smithi049:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-03-16T07:12:00.584 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-03-16T07:12:00.590 INFO:teuthology.task.internal:Enabling coredump saving... 2024-03-16T07:12:00.591 DEBUG:teuthology.orchestra.run.smithi049:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-03-16T07:12:00.660 INFO:teuthology.orchestra.run.smithi049.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-16T07:12:00.678 INFO:teuthology.orchestra.run.smithi049.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-16T07:12:00.680 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-03-16T07:12:00.687 INFO:teuthology.task.internal:Configuring sudo... 2024-03-16T07:12:00.687 DEBUG:teuthology.orchestra.run.smithi049:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-03-16T07:12:00.754 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-03-16T07:12:00.763 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-03-16T07:12:00.763 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-03-16T07:12:00.811 DEBUG:teuthology.orchestra.run.smithi049:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-16T07:12:00.896 DEBUG:teuthology.orchestra.run.smithi049:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-16T07:12:00.950 DEBUG:teuthology.orchestra.run.smithi049:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-16T07:12:01.029 DEBUG:teuthology.orchestra.run.smithi049:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-16T07:12:01.079 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-03-16T07:12:01.079 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-03-16T07:12:01.150 DEBUG:teuthology.orchestra.run.smithi049:> sudo service rsyslog restart 2024-03-16T07:12:01.235 INFO:teuthology.orchestra.run.smithi049.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-16T07:12:01.528 INFO:teuthology.run_tasks:Running task internal.timer... 2024-03-16T07:12:01.536 INFO:teuthology.task.internal:Starting timer... 2024-03-16T07:12:01.536 INFO:teuthology.run_tasks:Running task pcp... 2024-03-16T07:12:01.548 INFO:teuthology.run_tasks:Running task selinux... 2024-03-16T07:12:01.556 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-03-16T07:12:01.556 DEBUG:teuthology.orchestra.run.smithi049:> sudo service auditd rotate 2024-03-16T07:12:01.633 INFO:teuthology.orchestra.run.smithi049.stdout:Rotating logs: 2024-03-16T07:12:01.636 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-03-16T07:12:01.636 DEBUG:teuthology.orchestra.run.smithi049:> /usr/sbin/getenforce 2024-03-16T07:12:01.668 INFO:teuthology.orchestra.run.smithi049.stdout:Permissive 2024-03-16T07:12:01.668 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi049.front.sepia.ceph.com': 'permissive'} 2024-03-16T07:12:01.668 DEBUG:teuthology.orchestra.run.smithi049:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-03-16T07:12:01.739 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-16T07:12:01.739 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-03-16T07:12:01.739 DEBUG:teuthology.orchestra.run.smithi049:> sudo /usr/sbin/setenforce permissive 2024-03-16T07:12:01.820 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-03-16T07:12:01.830 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-03-16T07:12:01.835 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-03-16T07:12:01.954 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-03-16T07:12:01.970 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-03-16T07:12:01.971 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi049.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-03-16T07:16:21.377 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi049.front.sepia.ceph.com')] 2024-03-16T07:16:21.378 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi049.front.sepia.ceph.com' 2024-03-16T07:16:21.379 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-16T07:16:21.501 DEBUG:teuthology.orchestra.run.smithi049:> true 2024-03-16T07:16:21.582 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi049.front.sepia.ceph.com' 2024-03-16T07:16:21.582 INFO:teuthology.run_tasks:Running task clock... 2024-03-16T07:16:21.593 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-03-16T07:16:21.593 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-03-16T07:16:21.593 DEBUG:teuthology.orchestra.run.smithi049:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-16T07:16:21.658 INFO:teuthology.orchestra.run.smithi049.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-03-16T07:16:21.679 INFO:teuthology.orchestra.run.smithi049.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-03-16T07:16:21.715 INFO:teuthology.orchestra.run.smithi049.stderr:sudo: ntpd: command not found 2024-03-16T07:16:21.732 INFO:teuthology.orchestra.run.smithi049.stdout:506 Cannot talk to daemon 2024-03-16T07:16:21.752 INFO:teuthology.orchestra.run.smithi049.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-03-16T07:16:21.772 INFO:teuthology.orchestra.run.smithi049.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-03-16T07:16:21.831 INFO:teuthology.orchestra.run.smithi049.stderr:bash: line 1: ntpq: command not found 2024-03-16T07:16:21.834 INFO:teuthology.orchestra.run.smithi049.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-16T07:16:21.834 INFO:teuthology.orchestra.run.smithi049.stdout:=============================================================================== 2024-03-16T07:16:21.834 INFO:teuthology.orchestra.run.smithi049.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-16T07:16:21.834 INFO:teuthology.orchestra.run.smithi049.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-16T07:16:21.834 INFO:teuthology.orchestra.run.smithi049.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-16T07:16:21.834 INFO:teuthology.orchestra.run.smithi049.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-16T07:16:21.835 INFO:teuthology.run_tasks:Running task install... 2024-03-16T07:16:21.848 DEBUG:teuthology.task.install:project ceph 2024-03-16T07:16:21.848 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'debuginfo': True, 'flavor': 'default', 'sha1': '3d78f5ba07bf18880172c07d4d7b4ac00c9d30af'}} 2024-03-16T07:16:21.848 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'debuginfo': True, 'flavor': 'default', 'sha1': '3d78f5ba07bf18880172c07d4d7b4ac00c9d30af'} 2024-03-16T07:16:21.848 INFO:teuthology.task.install:Using flavor: default 2024-03-16T07:16:21.854 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse', 'ceph-common-dbg', 'ceph-fuse-dbg', 'ceph-mds-dbg', 'ceph-mgr-dbg', 'ceph-mon-dbg', 'ceph-osd-dbg', 'ceph-test-dbg', 'libcephfs2-dbg', 'librados2-dbg', 'libradosstriper1-dbg', 'librbd1-dbg', 'librgw2-dbg', 'radosgw-dbg', 'rbd-fuse-dbg', 'rbd-mirror-dbg', 'rbd-nbd-dbg'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd', 'ceph-base-debuginfo', 'ceph-common-debuginfo', 'ceph-immutable-object-cache-debuginfo', 'ceph-radosgw-debuginfo', 'ceph-test-debuginfo', 'ceph-base-debuginfo', 'ceph-mgr-debuginfo', 'ceph-mds-debuginfo', 'ceph-mon-debuginfo', 'ceph-osd-debuginfo', 'ceph-fuse-debuginfo', 'librados-devel-debuginfo', 'libcephfs2-debuginfo', 'librados2-debuginfo', 'librbd1-debuginfo', 'python3-cephfs-debuginfo', 'python3-rados-debuginfo', 'python3-rbd-debuginfo', 'python3-rgw-debuginfo', 'rbd-fuse-debuginfo', 'rbd-mirror-debuginfo', 'rbd-nbd-debuginfo']} 2024-03-16T07:16:21.854 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-03-16T07:16:21.854 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': True, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '3d78f5ba07bf18880172c07d4d7b4ac00c9d30af', 'tag': None, 'wait_for_package': False} 2024-03-16T07:16:21.855 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3d78f5ba07bf18880172c07d4d7b4ac00c9d30af 2024-03-16T07:16:22.080 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-batrick-testing-20240314.183243/3d78f5ba07bf18880172c07d4d7b4ac00c9d30af/centos/9/flavors/default/ 2024-03-16T07:16:22.080 INFO:teuthology.task.install.rpm:Package version is 19.0.0-2162.g3d78f5ba 2024-03-16T07:16:22.253 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-batrick-testing-20240314.183243/3d78f5ba07bf18880172c07d4d7b4ac00c9d30af/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-batrick-testing-20240314.183243/3d78f5ba07bf18880172c07d4d7b4ac00c9d30af/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-batrick-testing-20240314.183243/3d78f5ba07bf18880172c07d4d7b4ac00c9d30af/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-03-16T07:16:22.253 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-03-16T07:16:22.253 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-03-16T07:16:22.286 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, ceph-base-debuginfo, ceph-common-debuginfo, ceph-immutable-object-cache-debuginfo, ceph-radosgw-debuginfo, ceph-test-debuginfo, ceph-base-debuginfo, ceph-mgr-debuginfo, ceph-mds-debuginfo, ceph-mon-debuginfo, ceph-osd-debuginfo, ceph-fuse-debuginfo, librados-devel-debuginfo, libcephfs2-debuginfo, librados2-debuginfo, librbd1-debuginfo, python3-cephfs-debuginfo, python3-rados-debuginfo, python3-rbd-debuginfo, python3-rgw-debuginfo, rbd-fuse-debuginfo, rbd-mirror-debuginfo, rbd-nbd-debuginfo, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-03-16T07:16:22.286 DEBUG:teuthology.orchestra.run.smithi049:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/3d78f5ba07bf18880172c07d4d7b4ac00c9d30af/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-03-16T07:16:22.358 DEBUG:teuthology.orchestra.run.smithi049:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-03-16T07:16:22.445 DEBUG:teuthology.orchestra.run.smithi049:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-03-16T07:16:22.474 INFO:teuthology.orchestra.run.smithi049.stdout:check_obsoletes = 1 2024-03-16T07:16:22.476 DEBUG:teuthology.orchestra.run.smithi049:> sudo yum clean all 2024-03-16T07:16:22.734 INFO:teuthology.orchestra.run.smithi049.stdout:74 files removed 2024-03-16T07:16:22.761 DEBUG:teuthology.orchestra.run.smithi049:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd ceph-base-debuginfo ceph-common-debuginfo ceph-immutable-object-cache-debuginfo ceph-radosgw-debuginfo ceph-test-debuginfo ceph-base-debuginfo ceph-mgr-debuginfo ceph-mds-debuginfo ceph-mon-debuginfo ceph-osd-debuginfo ceph-fuse-debuginfo librados-devel-debuginfo libcephfs2-debuginfo librados2-debuginfo librbd1-debuginfo python3-cephfs-debuginfo python3-rados-debuginfo python3-rbd-debuginfo python3-rgw-debuginfo rbd-fuse-debuginfo rbd-mirror-debuginfo rbd-nbd-debuginfo python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-03-16T07:16:23.567 INFO:teuthology.orchestra.run.smithi049.stdout:ceph packages for x86_64 177 kB/s | 83 kB 00:00 2024-03-16T07:16:23.951 INFO:teuthology.orchestra.run.smithi049.stdout:ceph noarch packages 30 kB/s | 10 kB 00:00 2024-03-16T07:16:24.402 INFO:teuthology.orchestra.run.smithi049.stdout:ceph source packages 4.6 kB/s | 1.9 kB 00:00 2024-03-16T07:16:24.854 INFO:teuthology.orchestra.run.smithi049.stdout:CentOS-9 - AppStream 16 MB/s | 6.7 MB 00:00 2024-03-16T07:16:26.388 INFO:teuthology.orchestra.run.smithi049.stdout:CentOS-9 - BaseOS 6.1 MB/s | 2.0 MB 00:00 2024-03-16T07:16:30.303 INFO:teuthology.orchestra.run.smithi049.stdout:CentOS Stream 9 - BaseOS 2.2 MB/s | 8.0 MB 00:03 2024-03-16T07:16:47.319 INFO:teuthology.orchestra.run.smithi049.stdout:CentOS Stream 9 - AppStream 1.2 MB/s | 19 MB 00:15 2024-03-16T07:16:52.545 INFO:teuthology.orchestra.run.smithi049.stdout:CentOS Stream 9 - CRB 4.1 MB/s | 6.1 MB 00:01 2024-03-16T07:16:54.112 INFO:teuthology.orchestra.run.smithi049.stdout:CentOS Stream 9 - Extras packages 55 kB/s | 15 kB 00:00 2024-03-16T07:16:55.566 INFO:teuthology.orchestra.run.smithi049.stdout:Extra Packages for Enterprise Linux 16 MB/s | 21 MB 00:01 2024-03-16T07:17:00.672 INFO:teuthology.orchestra.run.smithi049.stdout:lab-extras 37 kB/s | 1.7 kB 00:00 2024-03-16T07:17:03.329 INFO:teuthology.orchestra.run.smithi049.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-03-16T07:17:03.330 INFO:teuthology.orchestra.run.smithi049.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-03-16T07:17:03.365 INFO:teuthology.orchestra.run.smithi049.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2024-03-16T07:17:03.366 INFO:teuthology.orchestra.run.smithi049.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-03-16T07:17:03.367 INFO:teuthology.orchestra.run.smithi049.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2024-03-16T07:17:03.369 INFO:teuthology.orchestra.run.smithi049.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2024-03-16T07:17:03.371 INFO:teuthology.orchestra.run.smithi049.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-03-16T07:17:03.374 INFO:teuthology.orchestra.run.smithi049.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2024-03-16T07:17:03.375 INFO:teuthology.orchestra.run.smithi049.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2024-03-16T07:17:03.465 INFO:teuthology.orchestra.run.smithi049.stdout:Dependencies resolved. 2024-03-16T07:17:03.487 INFO:teuthology.orchestra.run.smithi049.stdout:==================================================================================================== 2024-03-16T07:17:03.487 INFO:teuthology.orchestra.run.smithi049.stdout: Package Arch Version Repository Size 2024-03-16T07:17:03.488 INFO:teuthology.orchestra.run.smithi049.stdout:==================================================================================================== 2024-03-16T07:17:03.488 INFO:teuthology.orchestra.run.smithi049.stdout:Installing: 2024-03-16T07:17:03.488 INFO:teuthology.orchestra.run.smithi049.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2024-03-16T07:17:03.488 INFO:teuthology.orchestra.run.smithi049.stdout: ceph x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 6.6 k 2024-03-16T07:17:03.488 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-base x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 5.4 M 2024-03-16T07:17:03.488 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-base-debuginfo x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 69 M 2024-03-16T07:17:03.488 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-common-debuginfo x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 443 M 2024-03-16T07:17:03.488 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-fuse x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 890 k 2024-03-16T07:17:03.488 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-fuse-debuginfo x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 6.1 M 2024-03-16T07:17:03.488 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 145 k 2024-03-16T07:17:03.488 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-immutable-object-cache-debuginfo x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 1.5 M 2024-03-16T07:17:03.489 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mds-debuginfo x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 54 M 2024-03-16T07:17:03.489 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mgr x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 1.5 M 2024-03-16T07:17:03.489 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mgr-cephadm noarch 2:19.0.0-2162.g3d78f5ba.el9 ceph-noarch 139 k 2024-03-16T07:17:03.489 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mgr-dashboard noarch 2:19.0.0-2162.g3d78f5ba.el9 ceph-noarch 1.8 M 2024-03-16T07:17:03.489 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mgr-debuginfo x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 20 M 2024-03-16T07:17:03.489 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-2162.g3d78f5ba.el9 ceph-noarch 7.4 M 2024-03-16T07:17:03.489 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mgr-rook noarch 2:19.0.0-2162.g3d78f5ba.el9 ceph-noarch 49 k 2024-03-16T07:17:03.489 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mon-debuginfo x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 99 M 2024-03-16T07:17:03.489 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-osd-debuginfo x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 290 M 2024-03-16T07:17:03.489 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-radosgw x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 9.8 M 2024-03-16T07:17:03.489 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-radosgw-debuginfo x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 178 M 2024-03-16T07:17:03.489 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-test x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 48 M 2024-03-16T07:17:03.489 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-test-debuginfo x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 679 M 2024-03-16T07:17:03.490 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-volume noarch 2:19.0.0-2162.g3d78f5ba.el9 ceph-noarch 264 k 2024-03-16T07:17:03.490 INFO:teuthology.orchestra.run.smithi049.stdout: cephadm noarch 2:19.0.0-2162.g3d78f5ba.el9 ceph-noarch 748 k 2024-03-16T07:17:03.490 INFO:teuthology.orchestra.run.smithi049.stdout: cephfs-mirror x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 221 k 2024-03-16T07:17:03.490 INFO:teuthology.orchestra.run.smithi049.stdout: cephfs-shell x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 27 k 2024-03-16T07:17:03.490 INFO:teuthology.orchestra.run.smithi049.stdout: cephfs-top noarch 2:19.0.0-2162.g3d78f5ba.el9 ceph-noarch 18 k 2024-03-16T07:17:03.493 INFO:teuthology.orchestra.run.smithi049.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-03-16T07:17:03.493 INFO:teuthology.orchestra.run.smithi049.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2024-03-16T07:17:03.493 INFO:teuthology.orchestra.run.smithi049.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2024-03-16T07:17:03.493 INFO:teuthology.orchestra.run.smithi049.stdout: libcephfs-devel x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 32 k 2024-03-16T07:17:03.493 INFO:teuthology.orchestra.run.smithi049.stdout: libcephfs2 x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 747 k 2024-03-16T07:17:03.493 INFO:teuthology.orchestra.run.smithi049.stdout: libcephfs2-debuginfo x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 5.5 M 2024-03-16T07:17:03.493 INFO:teuthology.orchestra.run.smithi049.stdout: librados-devel x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 127 k 2024-03-16T07:17:03.493 INFO:teuthology.orchestra.run.smithi049.stdout: librados-devel-debuginfo x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 109 k 2024-03-16T07:17:03.493 INFO:teuthology.orchestra.run.smithi049.stdout: librados2-debuginfo x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 45 M 2024-03-16T07:17:03.494 INFO:teuthology.orchestra.run.smithi049.stdout: librbd1-debuginfo x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 52 M 2024-03-16T07:17:03.494 INFO:teuthology.orchestra.run.smithi049.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2024-03-16T07:17:03.494 INFO:teuthology.orchestra.run.smithi049.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-03-16T07:17:03.494 INFO:teuthology.orchestra.run.smithi049.stdout: openssl-devel x86_64 1:3.0.7-27.el9 appstream 4.1 M 2024-03-16T07:17:03.494 INFO:teuthology.orchestra.run.smithi049.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2024-03-16T07:17:03.494 INFO:teuthology.orchestra.run.smithi049.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2024-03-16T07:17:03.494 INFO:teuthology.orchestra.run.smithi049.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2024-03-16T07:17:03.494 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cephfs x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 162 k 2024-03-16T07:17:03.494 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cephfs-debuginfo x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 615 k 2024-03-16T07:17:03.494 INFO:teuthology.orchestra.run.smithi049.stdout: python3-rados x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 320 k 2024-03-16T07:17:03.494 INFO:teuthology.orchestra.run.smithi049.stdout: python3-rados-debuginfo x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 770 k 2024-03-16T07:17:03.494 INFO:teuthology.orchestra.run.smithi049.stdout: python3-rbd x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 298 k 2024-03-16T07:17:03.494 INFO:teuthology.orchestra.run.smithi049.stdout: python3-rbd-debuginfo x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 1.1 M 2024-03-16T07:17:03.494 INFO:teuthology.orchestra.run.smithi049.stdout: python3-rgw x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 99 k 2024-03-16T07:17:03.495 INFO:teuthology.orchestra.run.smithi049.stdout: python3-rgw-debuginfo x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 337 k 2024-03-16T07:17:03.495 INFO:teuthology.orchestra.run.smithi049.stdout: rbd-fuse x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 85 k 2024-03-16T07:17:03.495 INFO:teuthology.orchestra.run.smithi049.stdout: rbd-fuse-debuginfo x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 516 k 2024-03-16T07:17:03.495 INFO:teuthology.orchestra.run.smithi049.stdout: rbd-mirror x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 3.1 M 2024-03-16T07:17:03.495 INFO:teuthology.orchestra.run.smithi049.stdout: rbd-mirror-debuginfo x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 52 M 2024-03-16T07:17:03.495 INFO:teuthology.orchestra.run.smithi049.stdout: rbd-nbd x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 170 k 2024-03-16T07:17:03.495 INFO:teuthology.orchestra.run.smithi049.stdout: rbd-nbd-debuginfo x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 1.3 M 2024-03-16T07:17:03.495 INFO:teuthology.orchestra.run.smithi049.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-03-16T07:17:03.495 INFO:teuthology.orchestra.run.smithi049.stdout:Upgrading: 2024-03-16T07:17:03.495 INFO:teuthology.orchestra.run.smithi049.stdout: NetworkManager x86_64 1:1.46.0-1.el9 baseos 2.3 M 2024-03-16T07:17:03.495 INFO:teuthology.orchestra.run.smithi049.stdout: NetworkManager-libnm x86_64 1:1.46.0-1.el9 baseos 1.8 M 2024-03-16T07:17:03.495 INFO:teuthology.orchestra.run.smithi049.stdout: NetworkManager-team x86_64 1:1.46.0-1.el9 baseos 42 k 2024-03-16T07:17:03.495 INFO:teuthology.orchestra.run.smithi049.stdout: NetworkManager-tui x86_64 1:1.46.0-1.el9 baseos 248 k 2024-03-16T07:17:03.496 INFO:teuthology.orchestra.run.smithi049.stdout: acl x86_64 2.3.1-4.el9 baseos 71 k 2024-03-16T07:17:03.496 INFO:teuthology.orchestra.run.smithi049.stdout: elfutils-debuginfod-client x86_64 0.190-2.el9 baseos 36 k 2024-03-16T07:17:03.496 INFO:teuthology.orchestra.run.smithi049.stdout: elfutils-libelf x86_64 0.190-2.el9 baseos 192 k 2024-03-16T07:17:03.496 INFO:teuthology.orchestra.run.smithi049.stdout: elfutils-libs x86_64 0.190-2.el9 baseos 256 k 2024-03-16T07:17:03.496 INFO:teuthology.orchestra.run.smithi049.stdout: libacl x86_64 2.3.1-4.el9 baseos 23 k 2024-03-16T07:17:03.496 INFO:teuthology.orchestra.run.smithi049.stdout: libacl-devel x86_64 2.3.1-4.el9 appstream 74 k 2024-03-16T07:17:03.496 INFO:teuthology.orchestra.run.smithi049.stdout: libblkid x86_64 2.37.4-18.el9 baseos 108 k 2024-03-16T07:17:03.496 INFO:teuthology.orchestra.run.smithi049.stdout: libfdisk x86_64 2.37.4-18.el9 baseos 155 k 2024-03-16T07:17:03.496 INFO:teuthology.orchestra.run.smithi049.stdout: libmount x86_64 2.37.4-18.el9 baseos 136 k 2024-03-16T07:17:03.496 INFO:teuthology.orchestra.run.smithi049.stdout: librados2 x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 3.4 M 2024-03-16T07:17:03.496 INFO:teuthology.orchestra.run.smithi049.stdout: librbd1 x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 3.1 M 2024-03-16T07:17:03.496 INFO:teuthology.orchestra.run.smithi049.stdout: libsmartcols x86_64 2.37.4-18.el9 baseos 64 k 2024-03-16T07:17:03.496 INFO:teuthology.orchestra.run.smithi049.stdout: libuuid x86_64 2.37.4-18.el9 baseos 29 k 2024-03-16T07:17:03.496 INFO:teuthology.orchestra.run.smithi049.stdout: openssl x86_64 1:3.0.7-27.el9 baseos 1.2 M 2024-03-16T07:17:03.497 INFO:teuthology.orchestra.run.smithi049.stdout: openssl-libs x86_64 1:3.0.7-27.el9 baseos 2.2 M 2024-03-16T07:17:03.497 INFO:teuthology.orchestra.run.smithi049.stdout: util-linux x86_64 2.37.4-18.el9 baseos 2.3 M 2024-03-16T07:17:03.497 INFO:teuthology.orchestra.run.smithi049.stdout: util-linux-core x86_64 2.37.4-18.el9 baseos 465 k 2024-03-16T07:17:03.497 INFO:teuthology.orchestra.run.smithi049.stdout: util-linux-user x86_64 2.37.4-18.el9 baseos 31 k 2024-03-16T07:17:03.497 INFO:teuthology.orchestra.run.smithi049.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2024-03-16T07:17:03.497 INFO:teuthology.orchestra.run.smithi049.stdout: xfsprogs x86_64 6.3.0-1.el9 baseos 1.1 M 2024-03-16T07:17:03.497 INFO:teuthology.orchestra.run.smithi049.stdout:Installing dependencies: 2024-03-16T07:17:03.497 INFO:teuthology.orchestra.run.smithi049.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-03-16T07:17:03.497 INFO:teuthology.orchestra.run.smithi049.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2024-03-16T07:17:03.497 INFO:teuthology.orchestra.run.smithi049.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-03-16T07:17:03.497 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-common x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 21 M 2024-03-16T07:17:03.497 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-debuginfo x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 23 M 2024-03-16T07:17:03.498 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-grafana-dashboards noarch 2:19.0.0-2162.g3d78f5ba.el9 ceph-noarch 34 k 2024-03-16T07:17:03.498 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mds x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 2.4 M 2024-03-16T07:17:03.498 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mgr-modules-core noarch 2:19.0.0-2162.g3d78f5ba.el9 ceph-noarch 248 k 2024-03-16T07:17:03.498 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mon x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 4.7 M 2024-03-16T07:17:03.498 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-osd x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 17 M 2024-03-16T07:17:03.498 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-prometheus-alerts noarch 2:19.0.0-2162.g3d78f5ba.el9 ceph-noarch 16 k 2024-03-16T07:17:03.498 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-selinux x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 25 k 2024-03-16T07:17:03.498 INFO:teuthology.orchestra.run.smithi049.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-03-16T07:17:03.498 INFO:teuthology.orchestra.run.smithi049.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-03-16T07:17:03.498 INFO:teuthology.orchestra.run.smithi049.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-03-16T07:17:03.498 INFO:teuthology.orchestra.run.smithi049.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-03-16T07:17:03.498 INFO:teuthology.orchestra.run.smithi049.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-03-16T07:17:03.498 INFO:teuthology.orchestra.run.smithi049.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-03-16T07:17:03.499 INFO:teuthology.orchestra.run.smithi049.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-03-16T07:17:03.499 INFO:teuthology.orchestra.run.smithi049.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-03-16T07:17:03.499 INFO:teuthology.orchestra.run.smithi049.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-03-16T07:17:03.499 INFO:teuthology.orchestra.run.smithi049.stdout: libcephsqlite x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 163 k 2024-03-16T07:17:03.499 INFO:teuthology.orchestra.run.smithi049.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-03-16T07:17:03.499 INFO:teuthology.orchestra.run.smithi049.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-03-16T07:17:03.499 INFO:teuthology.orchestra.run.smithi049.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-03-16T07:17:03.499 INFO:teuthology.orchestra.run.smithi049.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-03-16T07:17:03.499 INFO:teuthology.orchestra.run.smithi049.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-03-16T07:17:03.499 INFO:teuthology.orchestra.run.smithi049.stdout: libradosstriper1 x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 501 k 2024-03-16T07:17:03.499 INFO:teuthology.orchestra.run.smithi049.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-03-16T07:17:03.499 INFO:teuthology.orchestra.run.smithi049.stdout: librgw2 x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 5.1 M 2024-03-16T07:17:03.499 INFO:teuthology.orchestra.run.smithi049.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-03-16T07:17:03.500 INFO:teuthology.orchestra.run.smithi049.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2024-03-16T07:17:03.500 INFO:teuthology.orchestra.run.smithi049.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-03-16T07:17:03.500 INFO:teuthology.orchestra.run.smithi049.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2024-03-16T07:17:03.500 INFO:teuthology.orchestra.run.smithi049.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-03-16T07:17:03.500 INFO:teuthology.orchestra.run.smithi049.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-03-16T07:17:03.500 INFO:teuthology.orchestra.run.smithi049.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2024-03-16T07:17:03.500 INFO:teuthology.orchestra.run.smithi049.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-03-16T07:17:03.500 INFO:teuthology.orchestra.run.smithi049.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-03-16T07:17:03.500 INFO:teuthology.orchestra.run.smithi049.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-03-16T07:17:03.500 INFO:teuthology.orchestra.run.smithi049.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2024-03-16T07:17:03.500 INFO:teuthology.orchestra.run.smithi049.stdout: protobuf x86_64 3.14.0-13.el9 CentOS-AppStream 1.0 M 2024-03-16T07:17:03.500 INFO:teuthology.orchestra.run.smithi049.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-03-16T07:17:03.501 INFO:teuthology.orchestra.run.smithi049.stdout: python3-asyncssh noarch 2.13.2-4.el9 epel 548 k 2024-03-16T07:17:03.501 INFO:teuthology.orchestra.run.smithi049.stdout: python3-attrs noarch 20.3.0-7.el9 CentOS-AppStream 78 k 2024-03-16T07:17:03.501 INFO:teuthology.orchestra.run.smithi049.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-03-16T07:17:03.501 INFO:teuthology.orchestra.run.smithi049.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-03-16T07:17:03.501 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-03-16T07:17:03.501 INFO:teuthology.orchestra.run.smithi049.stdout: python3-ceph-argparse x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 45 k 2024-03-16T07:17:03.501 INFO:teuthology.orchestra.run.smithi049.stdout: python3-ceph-common x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 131 k 2024-03-16T07:17:03.501 INFO:teuthology.orchestra.run.smithi049.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-03-16T07:17:03.501 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-03-16T07:17:03.501 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-03-16T07:17:03.501 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-03-16T07:17:03.501 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-03-16T07:17:03.501 INFO:teuthology.orchestra.run.smithi049.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-03-16T07:17:03.501 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-03-16T07:17:03.501 INFO:teuthology.orchestra.run.smithi049.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-03-16T07:17:03.502 INFO:teuthology.orchestra.run.smithi049.stdout: python3-google-auth noarch 1:2.28.0-1.el9 epel 203 k 2024-03-16T07:17:03.502 INFO:teuthology.orchestra.run.smithi049.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-03-16T07:17:03.502 INFO:teuthology.orchestra.run.smithi049.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-03-16T07:17:03.502 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-03-16T07:17:03.502 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-03-16T07:17:03.502 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-03-16T07:17:03.502 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-03-16T07:17:03.502 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-03-16T07:17:03.502 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-03-16T07:17:03.502 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-03-16T07:17:03.502 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-03-16T07:17:03.502 INFO:teuthology.orchestra.run.smithi049.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-03-16T07:17:03.502 INFO:teuthology.orchestra.run.smithi049.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-03-16T07:17:03.502 INFO:teuthology.orchestra.run.smithi049.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-03-16T07:17:03.503 INFO:teuthology.orchestra.run.smithi049.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-03-16T07:17:03.503 INFO:teuthology.orchestra.run.smithi049.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-03-16T07:17:03.503 INFO:teuthology.orchestra.run.smithi049.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-03-16T07:17:03.503 INFO:teuthology.orchestra.run.smithi049.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-03-16T07:17:03.503 INFO:teuthology.orchestra.run.smithi049.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-03-16T07:17:03.503 INFO:teuthology.orchestra.run.smithi049.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-03-16T07:17:03.503 INFO:teuthology.orchestra.run.smithi049.stdout: python3-packaging noarch 20.9-5.el9 CentOS-AppStream 69 k 2024-03-16T07:17:03.503 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-03-16T07:17:03.503 INFO:teuthology.orchestra.run.smithi049.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-03-16T07:17:03.503 INFO:teuthology.orchestra.run.smithi049.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-03-16T07:17:03.503 INFO:teuthology.orchestra.run.smithi049.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-03-16T07:17:03.503 INFO:teuthology.orchestra.run.smithi049.stdout: python3-protobuf noarch 3.14.0-13.el9 CentOS-AppStream 238 k 2024-03-16T07:17:03.503 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-03-16T07:17:03.503 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-03-16T07:17:03.503 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-03-16T07:17:03.504 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-03-16T07:17:03.504 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-03-16T07:17:03.504 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-03-16T07:17:03.504 INFO:teuthology.orchestra.run.smithi049.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-03-16T07:17:03.504 INFO:teuthology.orchestra.run.smithi049.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-03-16T07:17:03.504 INFO:teuthology.orchestra.run.smithi049.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-03-16T07:17:03.504 INFO:teuthology.orchestra.run.smithi049.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-03-16T07:17:03.504 INFO:teuthology.orchestra.run.smithi049.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-03-16T07:17:03.504 INFO:teuthology.orchestra.run.smithi049.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-03-16T07:17:03.504 INFO:teuthology.orchestra.run.smithi049.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-03-16T07:17:03.504 INFO:teuthology.orchestra.run.smithi049.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-03-16T07:17:03.504 INFO:teuthology.orchestra.run.smithi049.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-03-16T07:17:03.504 INFO:teuthology.orchestra.run.smithi049.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-03-16T07:17:03.504 INFO:teuthology.orchestra.run.smithi049.stdout: python3-wcwidth noarch 0.2.5-8.el9 CentOS-AppStream 41 k 2024-03-16T07:17:03.504 INFO:teuthology.orchestra.run.smithi049.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-03-16T07:17:03.505 INFO:teuthology.orchestra.run.smithi049.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-03-16T07:17:03.505 INFO:teuthology.orchestra.run.smithi049.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-03-16T07:17:03.505 INFO:teuthology.orchestra.run.smithi049.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-03-16T07:17:03.505 INFO:teuthology.orchestra.run.smithi049.stdout: qatlib x86_64 23.11.0-1.el9 appstream 216 k 2024-03-16T07:17:03.505 INFO:teuthology.orchestra.run.smithi049.stdout: qatzip-libs x86_64 1.1.2-2.el9 appstream 44 k 2024-03-16T07:17:03.505 INFO:teuthology.orchestra.run.smithi049.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-03-16T07:17:03.505 INFO:teuthology.orchestra.run.smithi049.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-03-16T07:17:03.505 INFO:teuthology.orchestra.run.smithi049.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-03-16T07:17:03.505 INFO:teuthology.orchestra.run.smithi049.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2024-03-16T07:17:03.505 INFO:teuthology.orchestra.run.smithi049.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-03-16T07:17:03.505 INFO:teuthology.orchestra.run.smithi049.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2024-03-16T07:17:03.505 INFO:teuthology.orchestra.run.smithi049.stdout:Installing weak dependencies: 2024-03-16T07:17:03.505 INFO:teuthology.orchestra.run.smithi049.stdout: qatlib-service x86_64 23.11.0-1.el9 appstream 35 k 2024-03-16T07:17:03.505 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:17:03.506 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction Summary 2024-03-16T07:17:03.506 INFO:teuthology.orchestra.run.smithi049.stdout:==================================================================================================== 2024-03-16T07:17:03.506 INFO:teuthology.orchestra.run.smithi049.stdout:Install 172 Packages 2024-03-16T07:17:03.506 INFO:teuthology.orchestra.run.smithi049.stdout:Upgrade 24 Packages 2024-03-16T07:17:03.506 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:17:03.506 INFO:teuthology.orchestra.run.smithi049.stdout:Total download size: 2.2 G 2024-03-16T07:17:03.506 INFO:teuthology.orchestra.run.smithi049.stdout:Downloading Packages: 2024-03-16T07:17:04.057 INFO:teuthology.orchestra.run.smithi049.stdout:(1/196): ceph-19.0.0-2162.g3d78f5ba.el9.x86_64. 20 kB/s | 6.6 kB 00:00 2024-03-16T07:17:05.023 INFO:teuthology.orchestra.run.smithi049.stdout:(2/196): ceph-base-19.0.0-2162.g3d78f5ba.el9.x8 4.2 MB/s | 5.4 MB 00:01 2024-03-16T07:17:19.458 INFO:teuthology.orchestra.run.smithi049.stdout:(3/196): ceph-common-19.0.0-2162.g3d78f5ba.el9. 1.3 MB/s | 21 MB 00:15 2024-03-16T07:17:21.124 INFO:teuthology.orchestra.run.smithi049.stdout:(4/196): ceph-base-debuginfo-19.0.0-2162.g3d78f 4.0 MB/s | 69 MB 00:17 2024-03-16T07:17:21.341 INFO:teuthology.orchestra.run.smithi049.stdout:(5/196): ceph-fuse-19.0.0-2162.g3d78f5ba.el9.x8 4.0 MB/s | 890 kB 00:00 2024-03-16T07:17:22.758 INFO:teuthology.orchestra.run.smithi049.stdout:(6/196): ceph-fuse-debuginfo-19.0.0-2162.g3d78f 4.3 MB/s | 6.1 MB 00:01 2024-03-16T07:17:23.283 INFO:teuthology.orchestra.run.smithi049.stdout:(7/196): ceph-immutable-object-cache-19.0.0-216 276 kB/s | 145 kB 00:00 2024-03-16T07:17:30.016 INFO:teuthology.orchestra.run.smithi049.stdout:(8/196): ceph-immutable-object-cache-debuginfo- 222 kB/s | 1.5 MB 00:06 2024-03-16T07:17:30.316 INFO:teuthology.orchestra.run.smithi049.stdout:(9/196): ceph-mds-19.0.0-2162.g3d78f5ba.el9.x86 7.9 MB/s | 2.4 MB 00:00 2024-03-16T07:17:32.533 INFO:teuthology.orchestra.run.smithi049.stdout:(10/196): ceph-debuginfo-19.0.0-2162.g3d78f5ba. 1.8 MB/s | 23 MB 00:13 2024-03-16T07:17:32.783 INFO:teuthology.orchestra.run.smithi049.stdout:(11/196): ceph-mgr-19.0.0-2162.g3d78f5ba.el9.x8 6.0 MB/s | 1.5 MB 00:00 2024-03-16T07:17:34.941 INFO:teuthology.orchestra.run.smithi049.stdout:(12/196): ceph-mgr-debuginfo-19.0.0-2162.g3d78f 9.3 MB/s | 20 MB 00:02 2024-03-16T07:17:35.475 INFO:teuthology.orchestra.run.smithi049.stdout:(13/196): ceph-mon-19.0.0-2162.g3d78f5ba.el9.x8 8.8 MB/s | 4.7 MB 00:00 2024-03-16T07:17:37.425 INFO:teuthology.orchestra.run.smithi049.stdout:(14/196): ceph-mds-debuginfo-19.0.0-2162.g3d78f 7.5 MB/s | 54 MB 00:07 2024-03-16T07:17:39.125 INFO:teuthology.orchestra.run.smithi049.stdout:(15/196): ceph-osd-19.0.0-2162.g3d78f5ba.el9.x8 9.9 MB/s | 17 MB 00:01 2024-03-16T07:17:45.783 INFO:teuthology.orchestra.run.smithi049.stdout:(16/196): ceph-mon-debuginfo-19.0.0-2162.g3d78f 9.6 MB/s | 99 MB 00:10 2024-03-16T07:17:46.958 INFO:teuthology.orchestra.run.smithi049.stdout:(17/196): ceph-radosgw-19.0.0-2162.g3d78f5ba.el 8.4 MB/s | 9.8 MB 00:01 2024-03-16T07:18:04.523 INFO:teuthology.orchestra.run.smithi049.stdout:(18/196): ceph-osd-debuginfo-19.0.0-2162.g3d78f 11 MB/s | 290 MB 00:25 2024-03-16T07:18:04.590 INFO:teuthology.orchestra.run.smithi049.stdout:(19/196): ceph-selinux-19.0.0-2162.g3d78f5ba.el 379 kB/s | 25 kB 00:00 2024-03-16T07:18:08.848 INFO:teuthology.orchestra.run.smithi049.stdout:(20/196): ceph-radosgw-debuginfo-19.0.0-2162.g3 8.1 MB/s | 178 MB 00:21 2024-03-16T07:18:10.073 INFO:teuthology.orchestra.run.smithi049.stdout:(21/196): ceph-test-19.0.0-2162.g3d78f5ba.el9.x 8.7 MB/s | 48 MB 00:05 2024-03-16T07:18:10.123 INFO:teuthology.orchestra.run.smithi049.stdout:(22/196): cephfs-mirror-19.0.0-2162.g3d78f5ba.e 4.4 MB/s | 221 kB 00:00 2024-03-16T07:18:10.207 INFO:teuthology.orchestra.run.smithi049.stdout:(23/196): cephfs-shell-19.0.0-2162.g3d78f5ba.el 325 kB/s | 27 kB 00:00 2024-03-16T07:18:10.715 INFO:teuthology.orchestra.run.smithi049.stdout:(24/196): libcephfs-devel-19.0.0-2162.g3d78f5ba 62 kB/s | 32 kB 00:00 2024-03-16T07:18:10.907 INFO:teuthology.orchestra.run.smithi049.stdout:(25/196): libcephfs2-19.0.0-2162.g3d78f5ba.el9. 3.8 MB/s | 747 kB 00:00 2024-03-16T07:18:11.449 INFO:teuthology.orchestra.run.smithi049.stdout:(26/196): libcephfs2-debuginfo-19.0.0-2162.g3d7 10 MB/s | 5.5 MB 00:00 2024-03-16T07:18:11.582 INFO:teuthology.orchestra.run.smithi049.stdout:(27/196): libcephsqlite-19.0.0-2162.g3d78f5ba.e 1.2 MB/s | 163 kB 00:00 2024-03-16T07:18:11.658 INFO:teuthology.orchestra.run.smithi049.stdout:(28/196): librados-devel-19.0.0-2162.g3d78f5ba. 1.7 MB/s | 127 kB 00:00 2024-03-16T07:18:11.750 INFO:teuthology.orchestra.run.smithi049.stdout:(29/196): librados-devel-debuginfo-19.0.0-2162. 1.2 MB/s | 109 kB 00:00 2024-03-16T07:18:15.150 INFO:teuthology.orchestra.run.smithi049.stdout:(30/196): librados2-debuginfo-19.0.0-2162.g3d78 13 MB/s | 45 MB 00:03 2024-03-16T07:18:15.275 INFO:teuthology.orchestra.run.smithi049.stdout:(31/196): libradosstriper1-19.0.0-2162.g3d78f5b 3.9 MB/s | 501 kB 00:00 2024-03-16T07:18:19.716 INFO:teuthology.orchestra.run.smithi049.stdout:(32/196): librbd1-debuginfo-19.0.0-2162.g3d78f5 12 MB/s | 52 MB 00:04 2024-03-16T07:18:20.292 INFO:teuthology.orchestra.run.smithi049.stdout:(33/196): librgw2-19.0.0-2162.g3d78f5ba.el9.x86 8.9 MB/s | 5.1 MB 00:00 2024-03-16T07:18:20.350 INFO:teuthology.orchestra.run.smithi049.stdout:(34/196): python3-ceph-argparse-19.0.0-2162.g3d 778 kB/s | 45 kB 00:00 2024-03-16T07:18:21.942 INFO:teuthology.orchestra.run.smithi049.stdout:(35/196): ceph-common-debuginfo-19.0.0-2162.g3d 5.8 MB/s | 443 MB 01:16 2024-03-16T07:18:21.967 INFO:teuthology.orchestra.run.smithi049.stdout:(36/196): python3-ceph-common-19.0.0-2162.g3d78 81 kB/s | 131 kB 00:01 2024-03-16T07:18:22.051 INFO:teuthology.orchestra.run.smithi049.stdout:(37/196): python3-cephfs-19.0.0-2162.g3d78f5ba. 1.5 MB/s | 162 kB 00:00 2024-03-16T07:18:22.126 INFO:teuthology.orchestra.run.smithi049.stdout:(38/196): python3-rados-19.0.0-2162.g3d78f5ba.e 4.2 MB/s | 320 kB 00:00 2024-03-16T07:18:22.151 INFO:teuthology.orchestra.run.smithi049.stdout:(39/196): python3-cephfs-debuginfo-19.0.0-2162. 3.3 MB/s | 615 kB 00:00 2024-03-16T07:18:22.276 INFO:teuthology.orchestra.run.smithi049.stdout:(40/196): python3-rados-debuginfo-19.0.0-2162.g 5.0 MB/s | 770 kB 00:00 2024-03-16T07:18:22.310 INFO:teuthology.orchestra.run.smithi049.stdout:(41/196): python3-rbd-19.0.0-2162.g3d78f5ba.el9 1.8 MB/s | 298 kB 00:00 2024-03-16T07:18:22.369 INFO:teuthology.orchestra.run.smithi049.stdout:(42/196): python3-rgw-19.0.0-2162.g3d78f5ba.el9 1.7 MB/s | 99 kB 00:00 2024-03-16T07:18:22.402 INFO:teuthology.orchestra.run.smithi049.stdout:(43/196): python3-rbd-debuginfo-19.0.0-2162.g3d 9.0 MB/s | 1.1 MB 00:00 2024-03-16T07:18:22.427 INFO:teuthology.orchestra.run.smithi049.stdout:(44/196): python3-rgw-debuginfo-19.0.0-2162.g3d 5.6 MB/s | 337 kB 00:00 2024-03-16T07:18:22.453 INFO:teuthology.orchestra.run.smithi049.stdout:(45/196): rbd-fuse-19.0.0-2162.g3d78f5ba.el9.x8 1.7 MB/s | 85 kB 00:00 2024-03-16T07:18:22.761 INFO:teuthology.orchestra.run.smithi049.stdout:(46/196): rbd-fuse-debuginfo-19.0.0-2162.g3d78f 1.5 MB/s | 516 kB 00:00 2024-03-16T07:18:22.978 INFO:teuthology.orchestra.run.smithi049.stdout:(47/196): rbd-mirror-19.0.0-2162.g3d78f5ba.el9. 5.9 MB/s | 3.1 MB 00:00 2024-03-16T07:18:23.045 INFO:teuthology.orchestra.run.smithi049.stdout:(48/196): rbd-nbd-19.0.0-2162.g3d78f5ba.el9.x86 2.5 MB/s | 170 kB 00:00 2024-03-16T07:18:23.254 INFO:teuthology.orchestra.run.smithi049.stdout:(49/196): rbd-nbd-debuginfo-19.0.0-2162.g3d78f5 6.2 MB/s | 1.3 MB 00:00 2024-03-16T07:18:23.312 INFO:teuthology.orchestra.run.smithi049.stdout:(50/196): ceph-grafana-dashboards-19.0.0-2162.g 584 kB/s | 34 kB 00:00 2024-03-16T07:18:23.396 INFO:teuthology.orchestra.run.smithi049.stdout:(51/196): ceph-mgr-cephadm-19.0.0-2162.g3d78f5b 1.6 MB/s | 139 kB 00:00 2024-03-16T07:18:23.588 INFO:teuthology.orchestra.run.smithi049.stdout:(52/196): ceph-mgr-dashboard-19.0.0-2162.g3d78f 9.4 MB/s | 1.8 MB 00:00 2024-03-16T07:18:24.297 INFO:teuthology.orchestra.run.smithi049.stdout:(53/196): ceph-mgr-diskprediction-local-19.0.0- 10 MB/s | 7.4 MB 00:00 2024-03-16T07:18:24.872 INFO:teuthology.orchestra.run.smithi049.stdout:(54/196): ceph-mgr-modules-core-19.0.0-2162.g3d 432 kB/s | 248 kB 00:00 2024-03-16T07:18:25.055 INFO:teuthology.orchestra.run.smithi049.stdout:(55/196): ceph-mgr-rook-19.0.0-2162.g3d78f5ba.e 269 kB/s | 49 kB 00:00 2024-03-16T07:18:25.156 INFO:teuthology.orchestra.run.smithi049.stdout:(56/196): ceph-prometheus-alerts-19.0.0-2162.g3 164 kB/s | 16 kB 00:00 2024-03-16T07:18:25.648 INFO:teuthology.orchestra.run.smithi049.stdout:(57/196): ceph-volume-19.0.0-2162.g3d78f5ba.el9 536 kB/s | 264 kB 00:00 2024-03-16T07:18:26.665 INFO:teuthology.orchestra.run.smithi049.stdout:(58/196): rbd-mirror-debuginfo-19.0.0-2162.g3d7 13 MB/s | 52 MB 00:03 2024-03-16T07:18:26.707 INFO:teuthology.orchestra.run.smithi049.stdout:(59/196): cephadm-19.0.0-2162.g3d78f5ba.el9.noa 707 kB/s | 748 kB 00:01 2024-03-16T07:18:26.731 INFO:teuthology.orchestra.run.smithi049.stdout:(60/196): cephfs-top-19.0.0-2162.g3d78f5ba.el9. 274 kB/s | 18 kB 00:00 2024-03-16T07:18:26.890 INFO:teuthology.orchestra.run.smithi049.stdout:(61/196): bison-3.7.4-5.el9.x86_64.rpm 5.7 MB/s | 920 kB 00:00 2024-03-16T07:18:26.916 INFO:teuthology.orchestra.run.smithi049.stdout:(62/196): automake-1.16.2-8.el9.noarch.rpm 3.1 MB/s | 662 kB 00:00 2024-03-16T07:18:26.941 INFO:teuthology.orchestra.run.smithi049.stdout:(63/196): boost-program-options-1.75.0-8.el9.x8 2.1 MB/s | 106 kB 00:00 2024-03-16T07:18:26.966 INFO:teuthology.orchestra.run.smithi049.stdout:(64/196): flex-2.6.4-9.el9.x86_64.rpm 6.0 MB/s | 307 kB 00:00 2024-03-16T07:18:26.991 INFO:teuthology.orchestra.run.smithi049.stdout:(65/196): flexiblas-3.0.4-8.el9.x86_64.rpm 639 kB/s | 32 kB 00:00 2024-03-16T07:18:27.083 INFO:teuthology.orchestra.run.smithi049.stdout:(66/196): flexiblas-netlib-3.0.4-8.el9.x86_64.r 26 MB/s | 3.0 MB 00:00 2024-03-16T07:18:27.125 INFO:teuthology.orchestra.run.smithi049.stdout:(67/196): flexiblas-openblas-openmp-3.0.4-8.el9 129 kB/s | 17 kB 00:00 2024-03-16T07:18:27.150 INFO:teuthology.orchestra.run.smithi049.stdout:(68/196): libaio-devel-0.3.111-13.el9.x86_64.rp 151 kB/s | 10 kB 00:00 2024-03-16T07:18:27.176 INFO:teuthology.orchestra.run.smithi049.stdout:(69/196): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 159 kB 00:00 2024-03-16T07:18:27.201 INFO:teuthology.orchestra.run.smithi049.stdout:(70/196): librabbitmq-0.11.0-7.el9.x86_64.rpm 884 kB/s | 44 kB 00:00 2024-03-16T07:18:27.226 INFO:teuthology.orchestra.run.smithi049.stdout:(71/196): librdkafka-1.6.1-102.el9.x86_64.rpm 13 MB/s | 661 kB 00:00 2024-03-16T07:18:27.251 INFO:teuthology.orchestra.run.smithi049.stdout:(72/196): libtool-2.4.6-45.el9.x86_64.rpm 11 MB/s | 578 kB 00:00 2024-03-16T07:18:27.268 INFO:teuthology.orchestra.run.smithi049.stdout:(73/196): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.1 MB/s | 46 kB 00:00 2024-03-16T07:18:27.294 INFO:teuthology.orchestra.run.smithi049.stdout:(74/196): lttng-ust-2.12.0-6.el9.x86_64.rpm 6.6 MB/s | 282 kB 00:00 2024-03-16T07:18:27.319 INFO:teuthology.orchestra.run.smithi049.stdout:(75/196): lua-5.4.4-4.el9.x86_64.rpm 3.7 MB/s | 187 kB 00:00 2024-03-16T07:18:27.352 INFO:teuthology.orchestra.run.smithi049.stdout:(76/196): oniguruma-6.9.6-1.el9.5.x86_64.rpm 3.6 MB/s | 217 kB 00:00 2024-03-16T07:18:27.378 INFO:teuthology.orchestra.run.smithi049.stdout:(77/196): openblas-0.3.21-2.el9.x86_64.rpm 586 kB/s | 34 kB 00:00 2024-03-16T07:18:27.470 INFO:teuthology.orchestra.run.smithi049.stdout:(78/196): openblas-openmp-0.3.21-2.el9.x86_64.r 41 MB/s | 4.7 MB 00:00 2024-03-16T07:18:27.513 INFO:teuthology.orchestra.run.smithi049.stdout:(79/196): postgresql-13.11-1.el9.x86_64.rpm 12 MB/s | 1.5 MB 00:00 2024-03-16T07:18:27.537 INFO:teuthology.orchestra.run.smithi049.stdout:(80/196): postgresql-contrib-13.11-1.el9.x86_64 12 MB/s | 811 kB 00:00 2024-03-16T07:18:27.562 INFO:teuthology.orchestra.run.smithi049.stdout:(81/196): postgresql-private-libs-13.11-1.el9.x 2.7 MB/s | 134 kB 00:00 2024-03-16T07:18:27.680 INFO:teuthology.orchestra.run.smithi049.stdout:(82/196): postgresql-server-13.11-1.el9.x86_64. 40 MB/s | 5.7 MB 00:00 2024-03-16T07:18:27.713 INFO:teuthology.orchestra.run.smithi049.stdout:(83/196): protobuf-3.14.0-13.el9.x86_64.rpm 6.8 MB/s | 1.0 MB 00:00 2024-03-16T07:18:27.738 INFO:teuthology.orchestra.run.smithi049.stdout:(84/196): python3-attrs-20.3.0-7.el9.noarch.rpm 1.3 MB/s | 78 kB 00:00 2024-03-16T07:18:27.847 INFO:teuthology.orchestra.run.smithi049.stdout:(85/196): python3-babel-2.9.1-2.el9.noarch.rpm 43 MB/s | 5.8 MB 00:00 2024-03-16T07:18:27.872 INFO:teuthology.orchestra.run.smithi049.stdout:(86/196): python3-jsonpatch-1.21-16.el9.noarch. 186 kB/s | 24 kB 00:00 2024-03-16T07:18:27.898 INFO:teuthology.orchestra.run.smithi049.stdout:(87/196): python3-jsonpointer-2.0-4.el9.noarch. 361 kB/s | 18 kB 00:00 2024-03-16T07:18:27.923 INFO:teuthology.orchestra.run.smithi049.stdout:(88/196): python3-mako-1.1.4-6.el9.noarch.rpm 2.8 MB/s | 144 kB 00:00 2024-03-16T07:18:27.965 INFO:teuthology.orchestra.run.smithi049.stdout:(89/196): python3-markupsafe-1.1.1-12.el9.x86_6 475 kB/s | 32 kB 00:00 2024-03-16T07:18:28.049 INFO:teuthology.orchestra.run.smithi049.stdout:(90/196): python3-numpy-1.20.1-5.el9.x86_64.rpm 38 MB/s | 4.8 MB 00:00 2024-03-16T07:18:28.074 INFO:teuthology.orchestra.run.smithi049.stdout:(91/196): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.0 MB/s | 217 kB 00:00 2024-03-16T07:18:28.099 INFO:teuthology.orchestra.run.smithi049.stdout:(92/196): python3-oauthlib-3.1.1-5.el9.noarch.r 3.4 MB/s | 174 kB 00:00 2024-03-16T07:18:28.125 INFO:teuthology.orchestra.run.smithi049.stdout:(93/196): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 69 kB 00:00 2024-03-16T07:18:28.150 INFO:teuthology.orchestra.run.smithi049.stdout:(94/196): python3-prettytable-0.7.2-27.el9.noar 819 kB/s | 41 kB 00:00 2024-03-16T07:18:28.175 INFO:teuthology.orchestra.run.smithi049.stdout:(95/196): python3-protobuf-3.14.0-13.el9.noarch 4.6 MB/s | 238 kB 00:00 2024-03-16T07:18:28.200 INFO:teuthology.orchestra.run.smithi049.stdout:(96/196): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.6 MB/s | 132 kB 00:00 2024-03-16T07:18:28.225 INFO:teuthology.orchestra.run.smithi049.stdout:(97/196): python3-pyasn1-modules-0.4.8-6.el9.no 4.1 MB/s | 211 kB 00:00 2024-03-16T07:18:28.251 INFO:teuthology.orchestra.run.smithi049.stdout:(98/196): python3-pytz-2021.1-5.el9.noarch.rpm 947 kB/s | 47 kB 00:00 2024-03-16T07:18:28.276 INFO:teuthology.orchestra.run.smithi049.stdout:(99/196): python3-requests-oauthlib-1.3.0-12.el 853 kB/s | 43 kB 00:00 2024-03-16T07:18:28.585 INFO:teuthology.orchestra.run.smithi049.stdout:(100/196): python3-scipy-1.6.2-8.el9.x86_64.rpm 47 MB/s | 16 MB 00:00 2024-03-16T07:18:28.610 INFO:teuthology.orchestra.run.smithi049.stdout:(101/196): python3-toml-0.10.2-6.el9.noarch.rpm 116 kB/s | 39 kB 00:00 2024-03-16T07:18:28.635 INFO:teuthology.orchestra.run.smithi049.stdout:(102/196): python3-wcwidth-0.2.5-8.el9.noarch.r 821 kB/s | 41 kB 00:00 2024-03-16T07:18:28.660 INFO:teuthology.orchestra.run.smithi049.stdout:(103/196): socat-1.7.4.1-5.el9.x86_64.rpm 5.8 MB/s | 300 kB 00:00 2024-03-16T07:18:28.686 INFO:teuthology.orchestra.run.smithi049.stdout:(104/196): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 56 kB 00:00 2024-03-16T07:18:28.711 INFO:teuthology.orchestra.run.smithi049.stdout:(105/196): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 63 kB 00:00 2024-03-16T07:18:28.736 INFO:teuthology.orchestra.run.smithi049.stdout:(106/196): zlib-devel-1.2.11-40.el9.x86_64.rpm 879 kB/s | 44 kB 00:00 2024-03-16T07:18:28.761 INFO:teuthology.orchestra.run.smithi049.stdout:(107/196): fuse-2.9.9-15.el9.x86_64.rpm 1.5 MB/s | 79 kB 00:00 2024-03-16T07:18:28.787 INFO:teuthology.orchestra.run.smithi049.stdout:(108/196): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.7 MB/s | 241 kB 00:00 2024-03-16T07:18:28.829 INFO:teuthology.orchestra.run.smithi049.stdout:(109/196): python3-cryptography-36.0.1-4.el9.x8 17 MB/s | 1.1 MB 00:00 2024-03-16T07:18:28.854 INFO:teuthology.orchestra.run.smithi049.stdout:(110/196): python3-ply-3.11-14.el9.noarch.rpm 1.5 MB/s | 103 kB 00:00 2024-03-16T07:18:28.879 INFO:teuthology.orchestra.run.smithi049.stdout:(111/196): python3-pycparser-2.20-6.el9.noarch. 2.4 MB/s | 124 kB 00:00 2024-03-16T07:18:28.913 INFO:teuthology.orchestra.run.smithi049.stdout:(112/196): python3-urllib3-1.26.5-5.el9.noarch. 3.1 MB/s | 187 kB 00:00 2024-03-16T07:18:30.297 INFO:teuthology.orchestra.run.smithi049.stdout:(113/196): jq-1.6-16.el9.x86_64.rpm 132 kB/s | 187 kB 00:01 2024-03-16T07:18:30.363 INFO:teuthology.orchestra.run.smithi049.stdout:(114/196): libgfortran-11.4.1-3.el9.x86_64.rpm 554 kB/s | 803 kB 00:01 2024-03-16T07:18:30.389 INFO:teuthology.orchestra.run.smithi049.stdout:(115/196): libquadmath-11.4.1-3.el9.x86_64.rpm 2.1 MB/s | 195 kB 00:00 2024-03-16T07:18:30.422 INFO:teuthology.orchestra.run.smithi049.stdout:(116/196): python3-requests-2.25.1-8.el9.noarch 2.1 MB/s | 125 kB 00:00 2024-03-16T07:18:30.973 INFO:teuthology.orchestra.run.smithi049.stdout:(117/196): elfutils-libelf-devel-0.190-2.el9.x8 37 kB/s | 21 kB 00:00 2024-03-16T07:18:31.006 INFO:teuthology.orchestra.run.smithi049.stdout:(118/196): libuuid-devel-2.37.4-18.el9.x86_64.r 44 kB/s | 25 kB 00:00 2024-03-16T07:18:31.881 INFO:teuthology.orchestra.run.smithi049.stdout:(119/196): python3-devel-3.9.17-2.el9.x86_64.rp 280 kB/s | 245 kB 00:00 2024-03-16T07:18:32.798 INFO:teuthology.orchestra.run.smithi049.stdout:(120/196): python3-jinja2-2.11.3-5.el9.noarch.r 270 kB/s | 248 kB 00:00 2024-03-16T07:18:33.673 INFO:teuthology.orchestra.run.smithi049.stdout:(121/196): qatlib-23.11.0-1.el9.x86_64.rpm 248 kB/s | 216 kB 00:00 2024-03-16T07:18:34.290 INFO:teuthology.orchestra.run.smithi049.stdout:(122/196): qatlib-service-23.11.0-1.el9.x86_64. 57 kB/s | 35 kB 00:00 2024-03-16T07:18:34.916 INFO:teuthology.orchestra.run.smithi049.stdout:(123/196): qatzip-libs-1.1.2-2.el9.x86_64.rpm 71 kB/s | 44 kB 00:00 2024-03-16T07:18:35.624 INFO:teuthology.orchestra.run.smithi049.stdout:(124/196): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 132 kB/s | 94 kB 00:00 2024-03-16T07:18:35.707 INFO:teuthology.orchestra.run.smithi049.stdout:(125/196): lua-devel-5.4.4-4.el9.x86_64.rpm 267 kB/s | 22 kB 00:00 2024-03-16T07:18:35.858 INFO:teuthology.orchestra.run.smithi049.stdout:(126/196): protobuf-compiler-3.14.0-13.el9.x86_ 5.6 MB/s | 863 kB 00:00 2024-03-16T07:18:36.333 INFO:teuthology.orchestra.run.smithi049.stdout:(127/196): abseil-cpp-20211102.0-3.el9.x86_64.r 1.1 MB/s | 548 kB 00:00 2024-03-16T07:18:36.425 INFO:teuthology.orchestra.run.smithi049.stdout:(128/196): gperftools-libs-2.9.1-2.el9.x86_64.r 3.3 MB/s | 309 kB 00:00 2024-03-16T07:18:36.509 INFO:teuthology.orchestra.run.smithi049.stdout:(129/196): grpc-data-1.46.7-10.el9.noarch.rpm 233 kB/s | 19 kB 00:00 2024-03-16T07:18:36.775 INFO:teuthology.orchestra.run.smithi049.stdout:(130/196): libarrow-9.0.0-10.el9.x86_64.rpm 17 MB/s | 4.4 MB 00:00 2024-03-16T07:18:36.850 INFO:teuthology.orchestra.run.smithi049.stdout:(131/196): libarrow-doc-9.0.0-10.el9.noarch.rpm 347 kB/s | 26 kB 00:00 2024-03-16T07:18:36.959 INFO:teuthology.orchestra.run.smithi049.stdout:(132/196): openssl-devel-3.0.7-27.el9.x86_64.rp 707 kB/s | 4.1 MB 00:05 2024-03-16T07:18:36.984 INFO:teuthology.orchestra.run.smithi049.stdout:(133/196): liboath-2.6.7-2.el9.x86_64.rpm 363 kB/s | 49 kB 00:00 2024-03-16T07:18:37.060 INFO:teuthology.orchestra.run.smithi049.stdout:(134/196): luarocks-3.9.2-1.el9.noarch.rpm 2.0 MB/s | 151 kB 00:00 2024-03-16T07:18:37.144 INFO:teuthology.orchestra.run.smithi049.stdout:(135/196): parquet-libs-9.0.0-10.el9.x86_64.rpm 9.8 MB/s | 838 kB 00:00 2024-03-16T07:18:37.227 INFO:teuthology.orchestra.run.smithi049.stdout:(136/196): python3-asyncssh-2.13.2-4.el9.noarch 6.4 MB/s | 548 kB 00:00 2024-03-16T07:18:37.269 INFO:teuthology.orchestra.run.smithi049.stdout:(137/196): libunwind-1.6.2-1.el9.x86_64.rpm 218 kB/s | 67 kB 00:00 2024-03-16T07:18:37.302 INFO:teuthology.orchestra.run.smithi049.stdout:(138/196): python3-bcrypt-3.2.2-1.el9.x86_64.rp 577 kB/s | 43 kB 00:00 2024-03-16T07:18:37.361 INFO:teuthology.orchestra.run.smithi049.stdout:(139/196): python3-cachetools-4.2.4-1.el9.noarc 350 kB/s | 32 kB 00:00 2024-03-16T07:18:37.378 INFO:teuthology.orchestra.run.smithi049.stdout:(140/196): python3-certifi-2021.10.8-2.el9.noar 199 kB/s | 15 kB 00:00 2024-03-16T07:18:37.437 INFO:teuthology.orchestra.run.smithi049.stdout:(141/196): python3-cheroot-8.6.0-4.el9.noarch.r 2.2 MB/s | 172 kB 00:00 2024-03-16T07:18:37.512 INFO:teuthology.orchestra.run.smithi049.stdout:(142/196): python3-cmd2-2.4.2-2.el9.noarch.rpm 4.0 MB/s | 303 kB 00:00 2024-03-16T07:18:37.588 INFO:teuthology.orchestra.run.smithi049.stdout:(143/196): python3-cherrypy-18.6.1-2.el9.noarch 1.7 MB/s | 358 kB 00:00 2024-03-16T07:18:37.604 INFO:teuthology.orchestra.run.smithi049.stdout:(144/196): python3-colorama-0.4.4-12.el9.noarch 384 kB/s | 35 kB 00:00 2024-03-16T07:18:37.680 INFO:teuthology.orchestra.run.smithi049.stdout:(145/196): python3-google-auth-2.28.0-1.el9.noa 2.2 MB/s | 203 kB 00:00 2024-03-16T07:18:37.730 INFO:teuthology.orchestra.run.smithi049.stdout:(146/196): python3-grpcio-1.46.7-10.el9.x86_64. 16 MB/s | 2.0 MB 00:00 2024-03-16T07:18:37.763 INFO:teuthology.orchestra.run.smithi049.stdout:(147/196): python3-grpcio-tools-1.46.7-10.el9.x 1.7 MB/s | 144 kB 00:00 2024-03-16T07:18:37.806 INFO:teuthology.orchestra.run.smithi049.stdout:(148/196): python3-jaraco-8.2.1-3.el9.noarch.rp 142 kB/s | 11 kB 00:00 2024-03-16T07:18:37.840 INFO:teuthology.orchestra.run.smithi049.stdout:(149/196): python3-jaraco-classes-3.2.1-5.el9.n 234 kB/s | 18 kB 00:00 2024-03-16T07:18:37.898 INFO:teuthology.orchestra.run.smithi049.stdout:(150/196): python3-jaraco-collections-3.0.0-8.e 252 kB/s | 23 kB 00:00 2024-03-16T07:18:37.923 INFO:teuthology.orchestra.run.smithi049.stdout:(151/196): python3-jaraco-functools-3.5.0-2.el9 233 kB/s | 19 kB 00:00 2024-03-16T07:18:38.007 INFO:teuthology.orchestra.run.smithi049.stdout:(152/196): python3-jaraco-text-3.2.0-6.el9.noar 181 kB/s | 20 kB 00:00 2024-03-16T07:18:38.082 INFO:teuthology.orchestra.run.smithi049.stdout:(153/196): python3-logutils-0.3.5-21.el9.noarch 619 kB/s | 46 kB 00:00 2024-03-16T07:18:38.116 INFO:teuthology.orchestra.run.smithi049.stdout:(154/196): python3-kubernetes-26.1.0-2.el9.noar 5.3 MB/s | 1.0 MB 00:00 2024-03-16T07:18:38.157 INFO:teuthology.orchestra.run.smithi049.stdout:(155/196): python3-more-itertools-8.12.0-2.el9. 1.0 MB/s | 79 kB 00:00 2024-03-16T07:18:38.191 INFO:teuthology.orchestra.run.smithi049.stdout:(156/196): python3-natsort-7.1.1-5.el9.noarch.r 766 kB/s | 58 kB 00:00 2024-03-16T07:18:38.233 INFO:teuthology.orchestra.run.smithi049.stdout:(157/196): python3-pecan-1.4.2-3.el9.noarch.rpm 3.5 MB/s | 272 kB 00:00 2024-03-16T07:18:38.267 INFO:teuthology.orchestra.run.smithi049.stdout:(158/196): python3-portend-3.1.0-2.el9.noarch.r 218 kB/s | 16 kB 00:00 2024-03-16T07:18:38.309 INFO:teuthology.orchestra.run.smithi049.stdout:(159/196): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.2 MB/s | 90 kB 00:00 2024-03-16T07:18:38.342 INFO:teuthology.orchestra.run.smithi049.stdout:(160/196): python3-pyperclip-1.8.2-2.el9.noarch 375 kB/s | 28 kB 00:00 2024-03-16T07:18:38.384 INFO:teuthology.orchestra.run.smithi049.stdout:(161/196): python3-repoze-lru-0.7-16.el9.noarch 409 kB/s | 31 kB 00:00 2024-03-16T07:18:38.426 INFO:teuthology.orchestra.run.smithi049.stdout:(162/196): python3-routes-2.5.1-5.el9.noarch.rp 2.2 MB/s | 188 kB 00:00 2024-03-16T07:18:38.459 INFO:teuthology.orchestra.run.smithi049.stdout:(163/196): python3-rsa-4.9-2.el9.noarch.rpm 785 kB/s | 59 kB 00:00 2024-03-16T07:18:38.501 INFO:teuthology.orchestra.run.smithi049.stdout:(164/196): python3-tempora-5.0.0-2.el9.noarch.r 475 kB/s | 36 kB 00:00 2024-03-16T07:18:38.535 INFO:teuthology.orchestra.run.smithi049.stdout:(165/196): python3-typing-extensions-4.4.0-2.el 676 kB/s | 51 kB 00:00 2024-03-16T07:18:38.585 INFO:teuthology.orchestra.run.smithi049.stdout:(166/196): python3-webob-1.8.7-6.el9.noarch.rpm 2.7 MB/s | 230 kB 00:00 2024-03-16T07:18:38.611 INFO:teuthology.orchestra.run.smithi049.stdout:(167/196): python3-websocket-client-1.2.3-2.el9 1.2 MB/s | 90 kB 00:00 2024-03-16T07:18:38.678 INFO:teuthology.orchestra.run.smithi049.stdout:(168/196): python3-werkzeug-2.0.3-3.el9.1.noarc 4.5 MB/s | 427 kB 00:00 2024-03-16T07:18:38.703 INFO:teuthology.orchestra.run.smithi049.stdout:(169/196): python3-zc-lockfile-2.0-10.el9.noarc 217 kB/s | 20 kB 00:00 2024-03-16T07:18:38.761 INFO:teuthology.orchestra.run.smithi049.stdout:(170/196): re2-20211101-3.el9.x86_64.rpm 2.2 MB/s | 192 kB 00:00 2024-03-16T07:18:38.804 INFO:teuthology.orchestra.run.smithi049.stdout:(171/196): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-03-16T07:18:39.404 INFO:teuthology.orchestra.run.smithi049.stdout:(172/196): librados2-19.0.0-2162.g3d78f5ba.el9. 5.3 MB/s | 3.4 MB 00:00 2024-03-16T07:18:39.687 INFO:teuthology.orchestra.run.smithi049.stdout:(173/196): librbd1-19.0.0-2162.g3d78f5ba.el9.x8 3.6 MB/s | 3.1 MB 00:00 2024-03-16T07:18:39.938 INFO:teuthology.orchestra.run.smithi049.stdout:(174/196): xfsdump-3.1.12-4.el9.x86_64.rpm 602 kB/s | 321 kB 00:00 2024-03-16T07:18:40.497 INFO:teuthology.orchestra.run.smithi049.stdout:(175/196): NetworkManager-1.46.0-1.el9.x86_64.r 2.8 MB/s | 2.3 MB 00:00 2024-03-16T07:18:40.747 INFO:teuthology.orchestra.run.smithi049.stdout:(176/196): NetworkManager-libnm-1.46.0-1.el9.x8 2.2 MB/s | 1.8 MB 00:00 2024-03-16T07:18:41.072 INFO:teuthology.orchestra.run.smithi049.stdout:(177/196): NetworkManager-team-1.46.0-1.el9.x86 74 kB/s | 42 kB 00:00 2024-03-16T07:18:41.356 INFO:teuthology.orchestra.run.smithi049.stdout:(178/196): NetworkManager-tui-1.46.0-1.el9.x86_ 408 kB/s | 248 kB 00:00 2024-03-16T07:18:41.381 INFO:teuthology.orchestra.run.smithi049.stdout:(179/196): acl-2.3.1-4.el9.x86_64.rpm 231 kB/s | 71 kB 00:00 2024-03-16T07:18:41.406 INFO:teuthology.orchestra.run.smithi049.stdout:(180/196): elfutils-debuginfod-client-0.190-2.e 726 kB/s | 36 kB 00:00 2024-03-16T07:18:41.507 INFO:teuthology.orchestra.run.smithi049.stdout:(181/196): elfutils-libelf-0.190-2.el9.x86_64.r 1.5 MB/s | 192 kB 00:00 2024-03-16T07:18:41.532 INFO:teuthology.orchestra.run.smithi049.stdout:(182/196): elfutils-libs-0.190-2.el9.x86_64.rpm 2.0 MB/s | 256 kB 00:00 2024-03-16T07:18:41.568 INFO:teuthology.orchestra.run.smithi049.stdout:(183/196): libacl-2.3.1-4.el9.x86_64.rpm 391 kB/s | 23 kB 00:00 2024-03-16T07:18:41.610 INFO:teuthology.orchestra.run.smithi049.stdout:(184/196): libblkid-2.37.4-18.el9.x86_64.rpm 1.4 MB/s | 108 kB 00:00 2024-03-16T07:18:41.643 INFO:teuthology.orchestra.run.smithi049.stdout:(185/196): libfdisk-2.37.4-18.el9.x86_64.rpm 2.0 MB/s | 155 kB 00:00 2024-03-16T07:18:41.669 INFO:teuthology.orchestra.run.smithi049.stdout:(186/196): libmount-2.37.4-18.el9.x86_64.rpm 2.3 MB/s | 136 kB 00:00 2024-03-16T07:18:41.703 INFO:teuthology.orchestra.run.smithi049.stdout:(187/196): libsmartcols-2.37.4-18.el9.x86_64.rp 1.1 MB/s | 64 kB 00:00 2024-03-16T07:18:41.736 INFO:teuthology.orchestra.run.smithi049.stdout:(188/196): libuuid-2.37.4-18.el9.x86_64.rpm 426 kB/s | 29 kB 00:00 2024-03-16T07:18:41.945 INFO:teuthology.orchestra.run.smithi049.stdout:(189/196): openssl-3.0.7-27.el9.x86_64.rpm 5.0 MB/s | 1.2 MB 00:00 2024-03-16T07:18:42.103 INFO:teuthology.orchestra.run.smithi049.stdout:(190/196): openssl-libs-3.0.7-27.el9.x86_64.rpm 5.9 MB/s | 2.2 MB 00:00 2024-03-16T07:18:42.204 INFO:teuthology.orchestra.run.smithi049.stdout:(191/196): util-linux-core-2.37.4-18.el9.x86_64 4.6 MB/s | 465 kB 00:00 2024-03-16T07:18:42.262 INFO:teuthology.orchestra.run.smithi049.stdout:(192/196): util-linux-user-2.37.4-18.el9.x86_64 533 kB/s | 31 kB 00:00 2024-03-16T07:18:42.312 INFO:teuthology.orchestra.run.smithi049.stdout:(193/196): util-linux-2.37.4-18.el9.x86_64.rpm 6.2 MB/s | 2.3 MB 00:00 2024-03-16T07:18:42.438 INFO:teuthology.orchestra.run.smithi049.stdout:(194/196): xfsprogs-6.3.0-1.el9.x86_64.rpm 6.1 MB/s | 1.1 MB 00:00 2024-03-16T07:18:43.024 INFO:teuthology.orchestra.run.smithi049.stdout:(195/196): libacl-devel-2.3.1-4.el9.x86_64.rpm 104 kB/s | 74 kB 00:00 2024-03-16T07:18:59.770 INFO:teuthology.orchestra.run.smithi049.stdout:(196/196): ceph-test-debuginfo-19.0.0-2162.g3d7 13 MB/s | 679 MB 00:50 2024-03-16T07:18:59.775 INFO:teuthology.orchestra.run.smithi049.stdout:-------------------------------------------------------------------------------- 2024-03-16T07:18:59.775 INFO:teuthology.orchestra.run.smithi049.stdout:Total 19 MB/s | 2.2 GB 01:56 2024-03-16T07:19:00.239 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction check 2024-03-16T07:19:00.586 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction check succeeded. 2024-03-16T07:19:00.586 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction test 2024-03-16T07:19:15.111 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction test succeeded. 2024-03-16T07:19:15.111 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction 2024-03-16T07:19:35.271 INFO:teuthology.orchestra.run.smithi049.stdout: Preparing : 1/1 2024-03-16T07:19:37.982 INFO:teuthology.orchestra.run.smithi049.stdout: Upgrading : openssl-libs-1:3.0.7-27.el9.x86_64 1/220 2024-03-16T07:19:38.027 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-debuginfo-2:19.0.0-2162.g3d78f5ba.el9.x86_6 2/220 2024-03-16T07:19:38.054 INFO:teuthology.orchestra.run.smithi049.stdout: Upgrading : libuuid-2.37.4-18.el9.x86_64 3/220 2024-03-16T07:19:38.084 INFO:teuthology.orchestra.run.smithi049.stdout: Upgrading : libblkid-2.37.4-18.el9.x86_64 4/220 2024-03-16T07:19:38.093 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: libblkid-2.37.4-18.el9.x86_64 4/220 2024-03-16T07:19:38.134 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 5/220 2024-03-16T07:19:38.188 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/220 2024-03-16T07:19:38.221 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : thrift-0.15.0-2.el9.x86_64 7/220 2024-03-16T07:19:38.255 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 8/220 2024-03-16T07:19:38.299 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 9/220 2024-03-16T07:19:38.650 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 10/220 2024-03-16T07:19:38.705 INFO:teuthology.orchestra.run.smithi049.stdout: Upgrading : librados2-2:19.0.0-2162.g3d78f5ba.el9.x86_64 11/220 2024-03-16T07:19:38.822 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: librados2-2:19.0.0-2162.g3d78f5ba.el9.x86_64 11/220 2024-03-16T07:19:38.848 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : libcephfs2-2:19.0.0-2162.g3d78f5ba.el9.x86_64 12/220 2024-03-16T07:19:38.933 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: libcephfs2-2:19.0.0-2162.g3d78f5ba.el9.x86_64 12/220 2024-03-16T07:19:38.968 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-rados-2:19.0.0-2162.g3d78f5ba.el9.x86_64 13/220 2024-03-16T07:19:39.011 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 14/220 2024-03-16T07:19:39.190 INFO:teuthology.orchestra.run.smithi049.stdout: Upgrading : elfutils-libelf-0.190-2.el9.x86_64 15/220 2024-03-16T07:19:39.242 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : postgresql-13.11-1.el9.x86_64 16/220 2024-03-16T07:19:39.270 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : libcephsqlite-2:19.0.0-2162.g3d78f5ba.el9.x86_64 17/220 2024-03-16T07:19:39.382 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: libcephsqlite-2:19.0.0-2162.g3d78f5ba.el9.x86_64 17/220 2024-03-16T07:19:39.412 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : libradosstriper1-2:19.0.0-2162.g3d78f5ba.el9.x86 18/220 2024-03-16T07:19:39.478 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: libradosstriper1-2:19.0.0-2162.g3d78f5ba.el9.x86 18/220 2024-03-16T07:19:39.525 INFO:teuthology.orchestra.run.smithi049.stdout: Upgrading : libmount-2.37.4-18.el9.x86_64 19/220 2024-03-16T07:19:39.547 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : qatlib-service-23.11.0-1.el9.x86_64 20/220 2024-03-16T07:19:39.563 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: qatlib-service-23.11.0-1.el9.x86_64 20/220 2024-03-16T07:19:39.760 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: qatlib-23.11.0-1.el9.x86_64 21/220 2024-03-16T07:19:39.804 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : qatlib-23.11.0-1.el9.x86_64 21/220 2024-03-16T07:19:39.835 INFO:teuthology.orchestra.run.smithi049.stdout: Upgrading : libsmartcols-2.37.4-18.el9.x86_64 22/220 2024-03-16T07:19:39.996 INFO:teuthology.orchestra.run.smithi049.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 23/220 2024-03-16T07:19:40.104 INFO:teuthology.orchestra.run.smithi049.stdout: Upgrading : NetworkManager-libnm-1:1.46.0-1.el9.x86_64 24/220 2024-03-16T07:19:40.147 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: NetworkManager-libnm-1:1.46.0-1.el9.x86_64 24/220 2024-03-16T07:19:40.268 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: NetworkManager-1:1.46.0-1.el9.x86_64 25/220 2024-03-16T07:19:40.332 INFO:teuthology.orchestra.run.smithi049.stdout: Upgrading : NetworkManager-1:1.46.0-1.el9.x86_64 25/220 2024-03-16T07:19:40.547 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: NetworkManager-1:1.46.0-1.el9.x86_64 25/220 2024-03-16T07:19:40.656 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : re2-1:20211101-3.el9.x86_64 26/220 2024-03-16T07:19:40.779 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 27/220 2024-03-16T07:19:40.812 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 28/220 2024-03-16T07:19:40.839 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : liboath-2.6.7-2.el9.x86_64 29/220 2024-03-16T07:19:40.883 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 30/220 2024-03-16T07:19:40.959 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 31/220 2024-03-16T07:19:41.012 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 32/220 2024-03-16T07:19:41.050 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 33/220 2024-03-16T07:19:41.125 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 34/220 2024-03-16T07:19:41.156 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 35/220 2024-03-16T07:19:41.200 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 36/220 2024-03-16T07:19:41.233 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 37/220 2024-03-16T07:19:41.268 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : lua-5.4.4-4.el9.x86_64 38/220 2024-03-16T07:19:41.349 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 39/220 2024-03-16T07:19:41.549 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-ceph-common-2:19.0.0-2162.g3d78f5ba.el9. 40/220 2024-03-16T07:19:41.714 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-ceph-argparse-2:19.0.0-2162.g3d78f5ba.el 41/220 2024-03-16T07:19:41.746 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-cephfs-2:19.0.0-2162.g3d78f5ba.el9.x86_6 42/220 2024-03-16T07:19:41.820 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 43/220 2024-03-16T07:19:41.860 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : luarocks-3.9.2-1.el9.noarch 44/220 2024-03-16T07:19:41.937 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 45/220 2024-03-16T07:19:42.082 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 46/220 2024-03-16T07:19:42.147 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 47/220 2024-03-16T07:19:42.706 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-rsa-4.9-2.el9.noarch 48/220 2024-03-16T07:19:42.794 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 49/220 2024-03-16T07:19:42.898 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 50/220 2024-03-16T07:19:42.935 INFO:teuthology.orchestra.run.smithi049.stdout: Upgrading : util-linux-core-2.37.4-18.el9.x86_64 51/220 2024-03-16T07:19:42.944 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: util-linux-core-2.37.4-18.el9.x86_64 51/220 2024-03-16T07:19:42.984 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : qatzip-libs-1.1.2-2.el9.x86_64 52/220 2024-03-16T07:19:43.033 INFO:teuthology.orchestra.run.smithi049.stdout: Upgrading : elfutils-libs-0.190-2.el9.x86_64 53/220 2024-03-16T07:19:43.080 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : librados-devel-2:19.0.0-2162.g3d78f5ba.el9.x86_6 54/220 2024-03-16T07:19:43.102 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 55/220 2024-03-16T07:19:43.379 INFO:teuthology.orchestra.run.smithi049.stdout: Upgrading : libfdisk-2.37.4-18.el9.x86_64 56/220 2024-03-16T07:19:43.572 INFO:teuthology.orchestra.run.smithi049.stdout: Upgrading : util-linux-2.37.4-18.el9.x86_64 57/220 2024-03-16T07:19:43.655 INFO:teuthology.orchestra.run.smithi049.stdout: Upgrading : xfsprogs-6.3.0-1.el9.x86_64 58/220 2024-03-16T07:19:43.699 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 59/220 2024-03-16T07:19:43.848 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 60/220 2024-03-16T07:19:43.911 INFO:teuthology.orchestra.run.smithi049.stdout: Upgrading : openssl-1:3.0.7-27.el9.x86_64 61/220 2024-03-16T07:19:43.968 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 62/220 2024-03-16T07:19:44.041 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 63/220 2024-03-16T07:19:44.078 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 64/220 2024-03-16T07:19:44.114 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 65/220 2024-03-16T07:19:44.154 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 66/220 2024-03-16T07:19:44.189 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 67/220 2024-03-16T07:19:44.232 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 68/220 2024-03-16T07:19:44.275 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 69/220 2024-03-16T07:19:44.415 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 70/220 2024-03-16T07:19:44.454 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 71/220 2024-03-16T07:19:44.493 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 72/220 2024-03-16T07:19:44.535 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 73/220 2024-03-16T07:19:44.634 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 74/220 2024-03-16T07:19:44.676 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-google-auth-1:2.28.0-1.el9.noarch 75/220 2024-03-16T07:19:44.716 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 76/220 2024-03-16T07:19:44.741 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 77/220 2024-03-16T07:19:44.766 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 78/220 2024-03-16T07:19:44.852 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 79/220 2024-03-16T07:19:44.980 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 80/220 2024-03-16T07:19:45.096 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 81/220 2024-03-16T07:19:45.133 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 82/220 2024-03-16T07:19:45.192 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-ply-3.11-14.el9.noarch 83/220 2024-03-16T07:19:45.256 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 84/220 2024-03-16T07:19:45.450 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 85/220 2024-03-16T07:19:45.496 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 86/220 2024-03-16T07:19:45.640 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 87/220 2024-03-16T07:19:45.694 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-asyncssh-2.13.2-4.el9.noarch 88/220 2024-03-16T07:19:45.725 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 89/220 2024-03-16T07:19:45.756 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : fuse-2.9.9-15.el9.x86_64 90/220 2024-03-16T07:19:45.785 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 91/220 2024-03-16T07:19:45.819 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 92/220 2024-03-16T07:19:45.858 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : uuid-1.6.2-55.el9.x86_64 93/220 2024-03-16T07:19:45.889 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 94/220 2024-03-16T07:19:45.919 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 95/220 2024-03-16T07:19:45.998 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 96/220 2024-03-16T07:19:46.029 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 97/220 2024-03-16T07:19:46.062 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 98/220 2024-03-16T07:19:46.104 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 99/220 2024-03-16T07:19:46.139 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 100/220 2024-03-16T07:19:46.240 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 101/220 2024-03-16T07:19:46.350 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 102/220 2024-03-16T07:19:46.396 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 103/220 2024-03-16T07:19:46.426 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 104/220 2024-03-16T07:19:46.475 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 105/220 2024-03-16T07:19:46.592 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-packaging-20.9-5.el9.noarch 106/220 2024-03-16T07:19:46.646 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 107/220 2024-03-16T07:19:47.415 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 108/220 2024-03-16T07:19:47.466 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 109/220 2024-03-16T07:19:47.492 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 110/220 2024-03-16T07:19:47.541 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 111/220 2024-03-16T07:19:47.633 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 112/220 2024-03-16T07:19:47.668 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 113/220 2024-03-16T07:19:47.851 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : openblas-0.3.21-2.el9.x86_64 114/220 2024-03-16T07:19:47.890 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 115/220 2024-03-16T07:19:47.970 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 116/220 2024-03-16T07:19:48.654 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 117/220 2024-03-16T07:19:48.766 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 118/220 2024-03-16T07:19:50.048 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 119/220 2024-03-16T07:19:50.141 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 120/220 2024-03-16T07:19:50.175 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 121/220 2024-03-16T07:19:50.219 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : jq-1.6-16.el9.x86_64 122/220 2024-03-16T07:19:50.247 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 123/220 2024-03-16T07:19:50.575 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 124/220 2024-03-16T07:19:50.602 INFO:teuthology.orchestra.run.smithi049.stdout: Upgrading : librbd1-2:19.0.0-2162.g3d78f5ba.el9.x86_64 125/220 2024-03-16T07:19:50.676 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: librbd1-2:19.0.0-2162.g3d78f5ba.el9.x86_64 125/220 2024-03-16T07:19:50.706 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-rbd-2:19.0.0-2162.g3d78f5ba.el9.x86_64 126/220 2024-03-16T07:19:50.743 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 127/220 2024-03-16T07:19:51.227 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 128/220 2024-03-16T07:19:51.254 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : librgw2-2:19.0.0-2162.g3d78f5ba.el9.x86_64 129/220 2024-03-16T07:19:51.326 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: librgw2-2:19.0.0-2162.g3d78f5ba.el9.x86_64 129/220 2024-03-16T07:19:51.356 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-rgw-2:19.0.0-2162.g3d78f5ba.el9.x86_64 130/220 2024-03-16T07:19:53.640 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-common-2:19.0.0-2162.g3d78f5ba.el9.x86_64 131/220 2024-03-16T07:19:53.677 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-common-2:19.0.0-2162.g3d78f5ba.el9.x86_64 131/220 2024-03-16T07:19:54.244 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-common-2:19.0.0-2162.g3d78f5ba.el9.x86_64 131/220 2024-03-16T07:19:54.281 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-base-2:19.0.0-2162.g3d78f5ba.el9.x86_64 132/220 2024-03-16T07:19:54.373 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-base-2:19.0.0-2162.g3d78f5ba.el9.x86_64 132/220 2024-03-16T07:19:54.374 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-03-16T07:19:54.374 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-03-16T07:19:54.374 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:19:54.415 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-selinux-2:19.0.0-2162.g3d78f5ba.el9.x86_64 133/220 2024-03-16T07:20:08.159 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-selinux-2:19.0.0-2162.g3d78f5ba.el9.x86_64 133/220 2024-03-16T07:20:08.159 INFO:teuthology.orchestra.run.smithi049.stdout:skipping the directory /sys 2024-03-16T07:20:08.159 INFO:teuthology.orchestra.run.smithi049.stdout:skipping the directory /proc 2024-03-16T07:20:08.159 INFO:teuthology.orchestra.run.smithi049.stdout:skipping the directory /mnt 2024-03-16T07:20:08.159 INFO:teuthology.orchestra.run.smithi049.stdout:skipping the directory /var/tmp 2024-03-16T07:20:08.159 INFO:teuthology.orchestra.run.smithi049.stdout:skipping the directory /home 2024-03-16T07:20:08.159 INFO:teuthology.orchestra.run.smithi049.stdout:skipping the directory /root 2024-03-16T07:20:08.159 INFO:teuthology.orchestra.run.smithi049.stdout:skipping the directory /tmp 2024-03-16T07:20:08.159 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:20:08.327 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-volume-2:19.0.0-2162.g3d78f5ba.el9.noarch 134/220 2024-03-16T07:20:08.342 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-volume-2:19.0.0-2162.g3d78f5ba.el9.noarch 134/220 2024-03-16T07:20:08.342 INFO:teuthology.orchestra.run.smithi049.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-16T07:20:08.342 INFO:teuthology.orchestra.run.smithi049.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-03-16T07:20:08.342 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:20:09.871 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-osd-2:19.0.0-2162.g3d78f5ba.el9.x86_64 135/220 2024-03-16T07:20:09.897 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-osd-2:19.0.0-2162.g3d78f5ba.el9.x86_64 135/220 2024-03-16T07:20:09.898 INFO:teuthology.orchestra.run.smithi049.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-16T07:20:09.898 INFO:teuthology.orchestra.run.smithi049.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-03-16T07:20:09.898 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-16T07:20:09.898 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-16T07:20:09.899 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:20:10.131 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-mds-2:19.0.0-2162.g3d78f5ba.el9.x86_64 136/220 2024-03-16T07:20:10.155 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-mds-2:19.0.0-2162.g3d78f5ba.el9.x86_64 136/220 2024-03-16T07:20:10.155 INFO:teuthology.orchestra.run.smithi049.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-16T07:20:10.155 INFO:teuthology.orchestra.run.smithi049.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-03-16T07:20:10.155 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-16T07:20:10.155 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-16T07:20:10.155 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:20:10.624 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-mon-2:19.0.0-2162.g3d78f5ba.el9.x86_64 137/220 2024-03-16T07:20:10.648 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-mon-2:19.0.0-2162.g3d78f5ba.el9.x86_64 137/220 2024-03-16T07:20:10.648 INFO:teuthology.orchestra.run.smithi049.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-16T07:20:10.648 INFO:teuthology.orchestra.run.smithi049.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-03-16T07:20:10.648 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-16T07:20:10.649 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-16T07:20:10.649 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:20:10.751 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : automake-1.16.2-8.el9.noarch 138/220 2024-03-16T07:20:11.179 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: cephadm-2:19.0.0-2162.g3d78f5ba.el9.noarch 139/220 2024-03-16T07:20:11.208 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : cephadm-2:19.0.0-2162.g3d78f5ba.el9.noarch 139/220 2024-03-16T07:20:11.232 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-2162.g3d78f5ba.e 140/220 2024-03-16T07:20:11.295 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-2162.g3d78f5ba. 141/220 2024-03-16T07:20:11.322 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-2162.g3d78f5ba.el9.noa 142/220 2024-03-16T07:20:11.567 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-2162.g3d78f5ba.el9.noa 142/220 2024-03-16T07:20:11.598 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-2162.g3d78f5ba.el9.n 143/220 2024-03-16T07:20:12.610 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-2162.g3d78f5ba.el9.n 143/220 2024-03-16T07:20:12.640 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-2162.g3d7 144/220 2024-03-16T07:20:12.744 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-2162.g3d7 144/220 2024-03-16T07:20:12.910 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-2162.g3d78f5ba.el 145/220 2024-03-16T07:20:12.942 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-mgr-2:19.0.0-2162.g3d78f5ba.el9.x86_64 146/220 2024-03-16T07:20:12.966 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-mgr-2:19.0.0-2162.g3d78f5ba.el9.x86_64 146/220 2024-03-16T07:20:12.967 INFO:teuthology.orchestra.run.smithi049.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-16T07:20:12.967 INFO:teuthology.orchestra.run.smithi049.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-03-16T07:20:12.967 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-16T07:20:12.967 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-16T07:20:12.967 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:20:13.018 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-mgr-rook-2:19.0.0-2162.g3d78f5ba.el9.noarch 147/220 2024-03-16T07:20:13.029 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-2162.g3d78f5ba.el9.noarch 147/220 2024-03-16T07:20:13.070 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-2:19.0.0-2162.g3d78f5ba.el9.x86_64 148/220 2024-03-16T07:20:14.011 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : libtool-2.4.6-45.el9.x86_64 149/220 2024-03-16T07:20:14.045 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-radosgw-2:19.0.0-2162.g3d78f5ba.el9.x86_64 150/220 2024-03-16T07:20:14.068 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-2162.g3d78f5ba.el9.x86_64 150/220 2024-03-16T07:20:14.069 INFO:teuthology.orchestra.run.smithi049.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-16T07:20:14.069 INFO:teuthology.orchestra.run.smithi049.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-03-16T07:20:14.069 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-16T07:20:14.069 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-16T07:20:14.069 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:20:14.112 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-2162.g3d78f 151/220 2024-03-16T07:20:14.135 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-2162.g3d78f 151/220 2024-03-16T07:20:14.136 INFO:teuthology.orchestra.run.smithi049.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-16T07:20:14.136 INFO:teuthology.orchestra.run.smithi049.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-03-16T07:20:14.136 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:20:14.180 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : cephfs-mirror-2:19.0.0-2162.g3d78f5ba.el9.x86_64 152/220 2024-03-16T07:20:14.203 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-2162.g3d78f5ba.el9.x86_64 152/220 2024-03-16T07:20:14.203 INFO:teuthology.orchestra.run.smithi049.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-16T07:20:14.203 INFO:teuthology.orchestra.run.smithi049.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-03-16T07:20:14.203 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-03-16T07:20:14.203 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-03-16T07:20:14.203 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:20:14.530 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : rbd-mirror-2:19.0.0-2162.g3d78f5ba.el9.x86_64 153/220 2024-03-16T07:20:14.554 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: rbd-mirror-2:19.0.0-2162.g3d78f5ba.el9.x86_64 153/220 2024-03-16T07:20:14.554 INFO:teuthology.orchestra.run.smithi049.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-16T07:20:14.554 INFO:teuthology.orchestra.run.smithi049.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-03-16T07:20:14.554 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-16T07:20:14.554 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-16T07:20:14.555 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:20:19.268 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-test-2:19.0.0-2162.g3d78f5ba.el9.x86_64 154/220 2024-03-16T07:20:19.315 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : rbd-fuse-2:19.0.0-2162.g3d78f5ba.el9.x86_64 155/220 2024-03-16T07:20:19.348 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : rbd-nbd-2:19.0.0-2162.g3d78f5ba.el9.x86_64 156/220 2024-03-16T07:20:19.375 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 157/220 2024-03-16T07:20:19.569 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : cephfs-shell-2:19.0.0-2162.g3d78f5ba.el9.x86_64 158/220 2024-03-16T07:20:19.692 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 159/220 2024-03-16T07:20:19.732 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-fuse-2:19.0.0-2162.g3d78f5ba.el9.x86_64 160/220 2024-03-16T07:20:19.792 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 161/220 2024-03-16T07:20:19.849 INFO:teuthology.orchestra.run.smithi049.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 162/220 2024-03-16T07:20:19.883 INFO:teuthology.orchestra.run.smithi049.stdout: Upgrading : util-linux-user-2.37.4-18.el9.x86_64 163/220 2024-03-16T07:20:19.916 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : libcephfs-devel-2:19.0.0-2162.g3d78f5ba.el9.x86_ 164/220 2024-03-16T07:20:19.948 INFO:teuthology.orchestra.run.smithi049.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el9.x86_64 165/220 2024-03-16T07:20:19.978 INFO:teuthology.orchestra.run.smithi049.stdout: Upgrading : NetworkManager-team-1:1.46.0-1.el9.x86_64 166/220 2024-03-16T07:20:20.041 INFO:teuthology.orchestra.run.smithi049.stdout: Upgrading : NetworkManager-tui-1:1.46.0-1.el9.x86_64 167/220 2024-03-16T07:20:20.107 INFO:teuthology.orchestra.run.smithi049.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 168/220 2024-03-16T07:20:20.142 INFO:teuthology.orchestra.run.smithi049.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 169/220 2024-03-16T07:20:20.791 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 170/220 2024-03-16T07:20:20.824 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 170/220 2024-03-16T07:20:20.845 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 170/220 2024-03-16T07:20:28.408 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : cephfs-top-2:19.0.0-2162.g3d78f5ba.el9.noarch 171/220 2024-03-16T07:21:13.252 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-base-debuginfo-2:19.0.0-2162.g3d78f5ba.el9. 172/220 2024-03-16T07:21:13.924 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-common-debuginfo-2:19.0.0-2162.g3d78f5ba.el 173/220 2024-03-16T07:21:14.332 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-fuse-debuginfo-2:19.0.0-2162.g3d78f5ba.el9. 174/220 2024-03-16T07:21:19.861 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-immutable-object-cache-debuginfo-2:19.0.0-2 175/220 2024-03-16T07:21:22.264 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-mds-debuginfo-2:19.0.0-2162.g3d78f5ba.el9.x 176/220 2024-03-16T07:21:32.600 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-mgr-debuginfo-2:19.0.0-2162.g3d78f5ba.el9.x 177/220 2024-03-16T07:22:02.230 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-mon-debuginfo-2:19.0.0-2162.g3d78f5ba.el9.x 178/220 2024-03-16T07:22:20.644 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-osd-debuginfo-2:19.0.0-2162.g3d78f5ba.el9.x 179/220 2024-03-16T07:23:32.400 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-radosgw-debuginfo-2:19.0.0-2162.g3d78f5ba.e 180/220 2024-03-16T07:23:33.126 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-test-debuginfo-2:19.0.0-2162.g3d78f5ba.el9. 181/220 2024-03-16T07:23:33.172 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : libcephfs2-debuginfo-2:19.0.0-2162.g3d78f5ba.el9 182/220 2024-03-16T07:23:38.314 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : librados-devel-debuginfo-2:19.0.0-2162.g3d78f5ba 183/220 2024-03-16T07:23:44.652 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : librados2-debuginfo-2:19.0.0-2162.g3d78f5ba.el9. 184/220 2024-03-16T07:23:44.746 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : librbd1-debuginfo-2:19.0.0-2162.g3d78f5ba.el9.x8 185/220 2024-03-16T07:23:44.853 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-cephfs-debuginfo-2:19.0.0-2162.g3d78f5ba 186/220 2024-03-16T07:23:44.999 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-rados-debuginfo-2:19.0.0-2162.g3d78f5ba. 187/220 2024-03-16T07:23:45.061 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-rbd-debuginfo-2:19.0.0-2162.g3d78f5ba.el 188/220 2024-03-16T07:23:45.143 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-rgw-debuginfo-2:19.0.0-2162.g3d78f5ba.el 189/220 2024-03-16T07:23:51.036 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : rbd-fuse-debuginfo-2:19.0.0-2162.g3d78f5ba.el9.x 190/220 2024-03-16T07:23:51.197 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : rbd-mirror-debuginfo-2:19.0.0-2162.g3d78f5ba.el9 191/220 2024-03-16T07:23:52.076 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : rbd-nbd-debuginfo-2:19.0.0-2162.g3d78f5ba.el9.x8 192/220 2024-03-16T07:23:52.161 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : openssl-devel-1:3.0.7-27.el9.x86_64 193/220 2024-03-16T07:23:52.204 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 194/220 2024-03-16T07:23:52.301 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : flex-2.6.4-9.el9.x86_64 195/220 2024-03-16T07:23:52.345 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : bison-3.7.4-5.el9.x86_64 196/220 2024-03-16T07:23:52.370 INFO:teuthology.orchestra.run.smithi049.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 197/220 2024-03-16T07:23:52.395 INFO:teuthology.orchestra.run.smithi049.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 198/220 2024-03-16T07:23:52.430 INFO:teuthology.orchestra.run.smithi049.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 199/220 2024-03-16T07:23:52.430 INFO:teuthology.orchestra.run.smithi049.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 200/220 2024-03-16T07:23:52.502 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 200/220 2024-03-16T07:23:52.540 INFO:teuthology.orchestra.run.smithi049.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 201/220 2024-03-16T07:23:52.540 INFO:teuthology.orchestra.run.smithi049.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 202/220 2024-03-16T07:23:52.624 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 202/220 2024-03-16T07:23:52.650 INFO:teuthology.orchestra.run.smithi049.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 203/220 2024-03-16T07:23:52.684 INFO:teuthology.orchestra.run.smithi049.stdout: Cleanup : xfsprogs-5.19.0-4.el9.x86_64 204/220 2024-03-16T07:23:52.709 INFO:teuthology.orchestra.run.smithi049.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 205/220 2024-03-16T07:23:52.734 INFO:teuthology.orchestra.run.smithi049.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 206/220 2024-03-16T07:23:52.789 INFO:teuthology.orchestra.run.smithi049.stdout: Cleanup : util-linux-user-2.37.4-15.el9.x86_64 207/220 2024-03-16T07:23:52.832 INFO:teuthology.orchestra.run.smithi049.stdout: Cleanup : util-linux-2.37.4-15.el9.x86_64 208/220 2024-03-16T07:23:52.864 INFO:teuthology.orchestra.run.smithi049.stdout: Cleanup : util-linux-core-2.37.4-15.el9.x86_64 209/220 2024-03-16T07:23:52.889 INFO:teuthology.orchestra.run.smithi049.stdout: Cleanup : libfdisk-2.37.4-15.el9.x86_64 210/220 2024-03-16T07:23:52.914 INFO:teuthology.orchestra.run.smithi049.stdout: Cleanup : libmount-2.37.4-15.el9.x86_64 211/220 2024-03-16T07:23:52.940 INFO:teuthology.orchestra.run.smithi049.stdout: Cleanup : libblkid-2.37.4-15.el9.x86_64 212/220 2024-03-16T07:23:52.965 INFO:teuthology.orchestra.run.smithi049.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 213/220 2024-03-16T07:23:52.971 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 214/220 2024-03-16T07:23:52.971 INFO:teuthology.orchestra.run.smithi049.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 214/220 2024-03-16T07:23:53.160 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 214/220 2024-03-16T07:23:53.160 INFO:teuthology.orchestra.run.smithi049.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 215/220 2024-03-16T07:23:53.242 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 215/220 2024-03-16T07:23:53.267 INFO:teuthology.orchestra.run.smithi049.stdout: Cleanup : libuuid-2.37.4-15.el9.x86_64 216/220 2024-03-16T07:23:53.292 INFO:teuthology.orchestra.run.smithi049.stdout: Cleanup : libsmartcols-2.37.4-15.el9.x86_64 217/220 2024-03-16T07:23:53.326 INFO:teuthology.orchestra.run.smithi049.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 218/220 2024-03-16T07:23:53.352 INFO:teuthology.orchestra.run.smithi049.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 219/220 2024-03-16T07:23:53.421 INFO:teuthology.orchestra.run.smithi049.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 220/220 2024-03-16T07:24:02.918 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: elfutils-libelf-0.189-3.el9.x86_64 220/220 2024-03-16T07:24:02.918 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-2:19.0.0-2162.g3d78f5ba.el9.x86_64 1/220 2024-03-16T07:24:02.918 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-base-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2/220 2024-03-16T07:24:02.919 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-base-debuginfo-2:19.0.0-2162.g3d78f5ba.el9. 3/220 2024-03-16T07:24:02.919 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-common-2:19.0.0-2162.g3d78f5ba.el9.x86_64 4/220 2024-03-16T07:24:02.919 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-common-debuginfo-2:19.0.0-2162.g3d78f5ba.el 5/220 2024-03-16T07:24:02.919 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-debuginfo-2:19.0.0-2162.g3d78f5ba.el9.x86_6 6/220 2024-03-16T07:24:02.919 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-fuse-2:19.0.0-2162.g3d78f5ba.el9.x86_64 7/220 2024-03-16T07:24:02.919 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-fuse-debuginfo-2:19.0.0-2162.g3d78f5ba.el9. 8/220 2024-03-16T07:24:02.919 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-2162.g3d78f 9/220 2024-03-16T07:24:02.919 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-immutable-object-cache-debuginfo-2:19.0.0-2 10/220 2024-03-16T07:24:02.919 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-mds-2:19.0.0-2162.g3d78f5ba.el9.x86_64 11/220 2024-03-16T07:24:02.919 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-mds-debuginfo-2:19.0.0-2162.g3d78f5ba.el9.x 12/220 2024-03-16T07:24:02.919 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-mgr-2:19.0.0-2162.g3d78f5ba.el9.x86_64 13/220 2024-03-16T07:24:02.919 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-mgr-debuginfo-2:19.0.0-2162.g3d78f5ba.el9.x 14/220 2024-03-16T07:24:02.919 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-mon-2:19.0.0-2162.g3d78f5ba.el9.x86_64 15/220 2024-03-16T07:24:02.919 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-mon-debuginfo-2:19.0.0-2162.g3d78f5ba.el9.x 16/220 2024-03-16T07:24:02.919 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-osd-2:19.0.0-2162.g3d78f5ba.el9.x86_64 17/220 2024-03-16T07:24:02.919 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-osd-debuginfo-2:19.0.0-2162.g3d78f5ba.el9.x 18/220 2024-03-16T07:24:02.920 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-radosgw-2:19.0.0-2162.g3d78f5ba.el9.x86_64 19/220 2024-03-16T07:24:02.920 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-radosgw-debuginfo-2:19.0.0-2162.g3d78f5ba.e 20/220 2024-03-16T07:24:02.920 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-selinux-2:19.0.0-2162.g3d78f5ba.el9.x86_64 21/220 2024-03-16T07:24:02.920 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-test-2:19.0.0-2162.g3d78f5ba.el9.x86_64 22/220 2024-03-16T07:24:02.920 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-test-debuginfo-2:19.0.0-2162.g3d78f5ba.el9. 23/220 2024-03-16T07:24:02.920 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : cephfs-mirror-2:19.0.0-2162.g3d78f5ba.el9.x86_64 24/220 2024-03-16T07:24:02.920 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : cephfs-shell-2:19.0.0-2162.g3d78f5ba.el9.x86_64 25/220 2024-03-16T07:24:02.920 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libcephfs-devel-2:19.0.0-2162.g3d78f5ba.el9.x86_ 26/220 2024-03-16T07:24:02.920 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libcephfs2-2:19.0.0-2162.g3d78f5ba.el9.x86_64 27/220 2024-03-16T07:24:02.920 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libcephfs2-debuginfo-2:19.0.0-2162.g3d78f5ba.el9 28/220 2024-03-16T07:24:02.920 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libcephsqlite-2:19.0.0-2162.g3d78f5ba.el9.x86_64 29/220 2024-03-16T07:24:02.920 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : librados-devel-2:19.0.0-2162.g3d78f5ba.el9.x86_6 30/220 2024-03-16T07:24:02.920 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : librados-devel-debuginfo-2:19.0.0-2162.g3d78f5ba 31/220 2024-03-16T07:24:02.920 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : librados2-debuginfo-2:19.0.0-2162.g3d78f5ba.el9. 32/220 2024-03-16T07:24:02.920 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libradosstriper1-2:19.0.0-2162.g3d78f5ba.el9.x86 33/220 2024-03-16T07:24:02.920 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : librbd1-debuginfo-2:19.0.0-2162.g3d78f5ba.el9.x8 34/220 2024-03-16T07:24:02.920 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : librgw2-2:19.0.0-2162.g3d78f5ba.el9.x86_64 35/220 2024-03-16T07:24:02.921 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-ceph-argparse-2:19.0.0-2162.g3d78f5ba.el 36/220 2024-03-16T07:24:02.921 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-ceph-common-2:19.0.0-2162.g3d78f5ba.el9. 37/220 2024-03-16T07:24:02.921 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-cephfs-2:19.0.0-2162.g3d78f5ba.el9.x86_6 38/220 2024-03-16T07:24:02.921 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-cephfs-debuginfo-2:19.0.0-2162.g3d78f5ba 39/220 2024-03-16T07:24:02.921 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-rados-2:19.0.0-2162.g3d78f5ba.el9.x86_64 40/220 2024-03-16T07:24:02.921 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-rados-debuginfo-2:19.0.0-2162.g3d78f5ba. 41/220 2024-03-16T07:24:02.921 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-rbd-2:19.0.0-2162.g3d78f5ba.el9.x86_64 42/220 2024-03-16T07:24:02.921 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-rbd-debuginfo-2:19.0.0-2162.g3d78f5ba.el 43/220 2024-03-16T07:24:02.921 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-rgw-2:19.0.0-2162.g3d78f5ba.el9.x86_64 44/220 2024-03-16T07:24:02.921 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-rgw-debuginfo-2:19.0.0-2162.g3d78f5ba.el 45/220 2024-03-16T07:24:02.921 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : rbd-fuse-2:19.0.0-2162.g3d78f5ba.el9.x86_64 46/220 2024-03-16T07:24:02.921 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : rbd-fuse-debuginfo-2:19.0.0-2162.g3d78f5ba.el9.x 47/220 2024-03-16T07:24:02.921 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : rbd-mirror-2:19.0.0-2162.g3d78f5ba.el9.x86_64 48/220 2024-03-16T07:24:02.921 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : rbd-mirror-debuginfo-2:19.0.0-2162.g3d78f5ba.el9 49/220 2024-03-16T07:24:02.921 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : rbd-nbd-2:19.0.0-2162.g3d78f5ba.el9.x86_64 50/220 2024-03-16T07:24:02.922 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : rbd-nbd-debuginfo-2:19.0.0-2162.g3d78f5ba.el9.x8 51/220 2024-03-16T07:24:02.922 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-2162.g3d78f5ba. 52/220 2024-03-16T07:24:02.922 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-2162.g3d78f5ba.el9.noa 53/220 2024-03-16T07:24:02.922 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-2162.g3d78f5ba.el9.n 54/220 2024-03-16T07:24:02.922 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-2162.g3d7 55/220 2024-03-16T07:24:02.922 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-2162.g3d78f5ba.el 56/220 2024-03-16T07:24:02.922 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-mgr-rook-2:19.0.0-2162.g3d78f5ba.el9.noarch 57/220 2024-03-16T07:24:02.922 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-2162.g3d78f5ba.e 58/220 2024-03-16T07:24:02.922 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-volume-2:19.0.0-2162.g3d78f5ba.el9.noarch 59/220 2024-03-16T07:24:02.922 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : cephadm-2:19.0.0-2162.g3d78f5ba.el9.noarch 60/220 2024-03-16T07:24:02.922 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : cephfs-top-2:19.0.0-2162.g3d78f5ba.el9.noarch 61/220 2024-03-16T07:24:02.922 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : automake-1.16.2-8.el9.noarch 62/220 2024-03-16T07:24:02.922 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : bison-3.7.4-5.el9.x86_64 63/220 2024-03-16T07:24:02.922 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 64/220 2024-03-16T07:24:02.923 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : flex-2.6.4-9.el9.x86_64 65/220 2024-03-16T07:24:02.923 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 66/220 2024-03-16T07:24:02.923 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 67/220 2024-03-16T07:24:02.923 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 68/220 2024-03-16T07:24:02.923 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 69/220 2024-03-16T07:24:02.923 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 70/220 2024-03-16T07:24:02.923 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 71/220 2024-03-16T07:24:02.923 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 72/220 2024-03-16T07:24:02.923 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 73/220 2024-03-16T07:24:02.923 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 74/220 2024-03-16T07:24:02.923 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 75/220 2024-03-16T07:24:02.923 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : lua-5.4.4-4.el9.x86_64 76/220 2024-03-16T07:24:02.923 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 77/220 2024-03-16T07:24:02.923 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 78/220 2024-03-16T07:24:02.923 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 79/220 2024-03-16T07:24:02.923 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : postgresql-13.11-1.el9.x86_64 80/220 2024-03-16T07:24:02.924 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 81/220 2024-03-16T07:24:02.924 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 82/220 2024-03-16T07:24:02.924 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 83/220 2024-03-16T07:24:02.924 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 84/220 2024-03-16T07:24:02.924 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 85/220 2024-03-16T07:24:02.924 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 86/220 2024-03-16T07:24:02.924 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 87/220 2024-03-16T07:24:02.924 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 88/220 2024-03-16T07:24:02.924 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 89/220 2024-03-16T07:24:02.924 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 90/220 2024-03-16T07:24:02.924 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 91/220 2024-03-16T07:24:02.924 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 92/220 2024-03-16T07:24:02.924 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 93/220 2024-03-16T07:24:02.924 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 94/220 2024-03-16T07:24:02.924 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 95/220 2024-03-16T07:24:02.924 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 96/220 2024-03-16T07:24:02.925 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 97/220 2024-03-16T07:24:02.925 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 98/220 2024-03-16T07:24:02.925 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 99/220 2024-03-16T07:24:02.925 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 100/220 2024-03-16T07:24:02.925 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 101/220 2024-03-16T07:24:02.925 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 102/220 2024-03-16T07:24:02.925 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 103/220 2024-03-16T07:24:02.925 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 104/220 2024-03-16T07:24:02.925 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 105/220 2024-03-16T07:24:02.925 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 106/220 2024-03-16T07:24:02.925 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 107/220 2024-03-16T07:24:02.925 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 108/220 2024-03-16T07:24:02.925 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 109/220 2024-03-16T07:24:02.925 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 110/220 2024-03-16T07:24:02.925 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-ply-3.11-14.el9.noarch 111/220 2024-03-16T07:24:02.926 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 112/220 2024-03-16T07:24:02.926 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 113/220 2024-03-16T07:24:02.926 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : jq-1.6-16.el9.x86_64 114/220 2024-03-16T07:24:02.926 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 115/220 2024-03-16T07:24:02.926 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 116/220 2024-03-16T07:24:02.926 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 117/220 2024-03-16T07:24:02.926 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 118/220 2024-03-16T07:24:02.926 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 119/220 2024-03-16T07:24:02.926 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : openssl-devel-1:3.0.7-27.el9.x86_64 120/220 2024-03-16T07:24:02.926 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 121/220 2024-03-16T07:24:02.926 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 122/220 2024-03-16T07:24:02.926 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : qatlib-23.11.0-1.el9.x86_64 123/220 2024-03-16T07:24:02.926 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : qatlib-service-23.11.0-1.el9.x86_64 124/220 2024-03-16T07:24:02.926 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : qatzip-libs-1.1.2-2.el9.x86_64 125/220 2024-03-16T07:24:02.926 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 126/220 2024-03-16T07:24:02.926 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 127/220 2024-03-16T07:24:02.927 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 128/220 2024-03-16T07:24:02.927 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 129/220 2024-03-16T07:24:02.927 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 130/220 2024-03-16T07:24:02.927 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 131/220 2024-03-16T07:24:02.927 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 132/220 2024-03-16T07:24:02.927 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 133/220 2024-03-16T07:24:02.927 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 134/220 2024-03-16T07:24:02.927 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 135/220 2024-03-16T07:24:02.927 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 136/220 2024-03-16T07:24:02.927 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 137/220 2024-03-16T07:24:02.927 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-asyncssh-2.13.2-4.el9.noarch 138/220 2024-03-16T07:24:02.927 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 139/220 2024-03-16T07:24:02.927 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 140/220 2024-03-16T07:24:02.927 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 141/220 2024-03-16T07:24:02.927 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 142/220 2024-03-16T07:24:02.927 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 143/220 2024-03-16T07:24:02.927 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 144/220 2024-03-16T07:24:02.928 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 145/220 2024-03-16T07:24:02.928 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-google-auth-1:2.28.0-1.el9.noarch 146/220 2024-03-16T07:24:02.928 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 147/220 2024-03-16T07:24:02.928 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 148/220 2024-03-16T07:24:02.928 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 149/220 2024-03-16T07:24:02.928 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 150/220 2024-03-16T07:24:02.928 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 151/220 2024-03-16T07:24:02.928 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 152/220 2024-03-16T07:24:02.928 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 153/220 2024-03-16T07:24:02.928 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 154/220 2024-03-16T07:24:02.928 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 155/220 2024-03-16T07:24:02.928 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 156/220 2024-03-16T07:24:02.928 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 157/220 2024-03-16T07:24:02.928 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 158/220 2024-03-16T07:24:02.928 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 159/220 2024-03-16T07:24:02.929 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 160/220 2024-03-16T07:24:02.929 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 161/220 2024-03-16T07:24:02.929 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 162/220 2024-03-16T07:24:02.929 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 163/220 2024-03-16T07:24:02.929 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 164/220 2024-03-16T07:24:02.929 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 165/220 2024-03-16T07:24:02.929 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 166/220 2024-03-16T07:24:02.929 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 167/220 2024-03-16T07:24:02.929 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 168/220 2024-03-16T07:24:02.929 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 169/220 2024-03-16T07:24:02.929 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 170/220 2024-03-16T07:24:02.929 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : re2-1:20211101-3.el9.x86_64 171/220 2024-03-16T07:24:02.929 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 172/220 2024-03-16T07:24:02.929 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : librados2-2:19.0.0-2162.g3d78f5ba.el9.x86_64 173/220 2024-03-16T07:24:02.929 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 174/220 2024-03-16T07:24:02.929 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : librbd1-2:19.0.0-2162.g3d78f5ba.el9.x86_64 175/220 2024-03-16T07:24:02.929 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 176/220 2024-03-16T07:24:02.930 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 177/220 2024-03-16T07:24:02.930 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 178/220 2024-03-16T07:24:02.930 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : NetworkManager-1:1.46.0-1.el9.x86_64 179/220 2024-03-16T07:24:02.930 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 180/220 2024-03-16T07:24:02.930 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : NetworkManager-libnm-1:1.46.0-1.el9.x86_64 181/220 2024-03-16T07:24:02.930 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 182/220 2024-03-16T07:24:02.930 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : NetworkManager-team-1:1.46.0-1.el9.x86_64 183/220 2024-03-16T07:24:02.930 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 184/220 2024-03-16T07:24:02.930 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : NetworkManager-tui-1:1.46.0-1.el9.x86_64 185/220 2024-03-16T07:24:02.930 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 186/220 2024-03-16T07:24:02.930 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : acl-2.3.1-4.el9.x86_64 187/220 2024-03-16T07:24:02.930 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : acl-2.3.1-3.el9.x86_64 188/220 2024-03-16T07:24:02.930 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 189/220 2024-03-16T07:24:02.930 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 190/220 2024-03-16T07:24:02.930 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 191/220 2024-03-16T07:24:02.931 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 192/220 2024-03-16T07:24:02.931 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 193/220 2024-03-16T07:24:02.931 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 194/220 2024-03-16T07:24:02.931 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 195/220 2024-03-16T07:24:02.931 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 196/220 2024-03-16T07:24:02.931 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libblkid-2.37.4-18.el9.x86_64 197/220 2024-03-16T07:24:02.931 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libblkid-2.37.4-15.el9.x86_64 198/220 2024-03-16T07:24:02.931 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libfdisk-2.37.4-18.el9.x86_64 199/220 2024-03-16T07:24:02.931 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libfdisk-2.37.4-15.el9.x86_64 200/220 2024-03-16T07:24:02.931 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libmount-2.37.4-18.el9.x86_64 201/220 2024-03-16T07:24:02.931 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libmount-2.37.4-15.el9.x86_64 202/220 2024-03-16T07:24:02.931 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libsmartcols-2.37.4-18.el9.x86_64 203/220 2024-03-16T07:24:02.931 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libsmartcols-2.37.4-15.el9.x86_64 204/220 2024-03-16T07:24:02.931 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libuuid-2.37.4-18.el9.x86_64 205/220 2024-03-16T07:24:02.931 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libuuid-2.37.4-15.el9.x86_64 206/220 2024-03-16T07:24:02.931 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 207/220 2024-03-16T07:24:02.932 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 208/220 2024-03-16T07:24:02.932 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 209/220 2024-03-16T07:24:02.932 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 210/220 2024-03-16T07:24:02.932 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : util-linux-2.37.4-18.el9.x86_64 211/220 2024-03-16T07:24:02.932 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : util-linux-2.37.4-15.el9.x86_64 212/220 2024-03-16T07:24:02.932 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : util-linux-core-2.37.4-18.el9.x86_64 213/220 2024-03-16T07:24:02.932 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : util-linux-core-2.37.4-15.el9.x86_64 214/220 2024-03-16T07:24:02.932 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : util-linux-user-2.37.4-18.el9.x86_64 215/220 2024-03-16T07:24:02.932 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : util-linux-user-2.37.4-15.el9.x86_64 216/220 2024-03-16T07:24:02.932 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 217/220 2024-03-16T07:24:02.932 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 218/220 2024-03-16T07:24:02.932 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 219/220 2024-03-16T07:24:06.099 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 220/220 2024-03-16T07:24:06.099 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:24:06.099 INFO:teuthology.orchestra.run.smithi049.stdout:Upgraded: 2024-03-16T07:24:06.099 INFO:teuthology.orchestra.run.smithi049.stdout: NetworkManager-1:1.46.0-1.el9.x86_64 2024-03-16T07:24:06.099 INFO:teuthology.orchestra.run.smithi049.stdout: NetworkManager-libnm-1:1.46.0-1.el9.x86_64 2024-03-16T07:24:06.100 INFO:teuthology.orchestra.run.smithi049.stdout: NetworkManager-team-1:1.46.0-1.el9.x86_64 2024-03-16T07:24:06.100 INFO:teuthology.orchestra.run.smithi049.stdout: NetworkManager-tui-1:1.46.0-1.el9.x86_64 2024-03-16T07:24:06.100 INFO:teuthology.orchestra.run.smithi049.stdout: acl-2.3.1-4.el9.x86_64 2024-03-16T07:24:06.100 INFO:teuthology.orchestra.run.smithi049.stdout: elfutils-debuginfod-client-0.190-2.el9.x86_64 2024-03-16T07:24:06.100 INFO:teuthology.orchestra.run.smithi049.stdout: elfutils-libelf-0.190-2.el9.x86_64 2024-03-16T07:24:06.100 INFO:teuthology.orchestra.run.smithi049.stdout: elfutils-libs-0.190-2.el9.x86_64 2024-03-16T07:24:06.100 INFO:teuthology.orchestra.run.smithi049.stdout: libacl-2.3.1-4.el9.x86_64 2024-03-16T07:24:06.100 INFO:teuthology.orchestra.run.smithi049.stdout: libacl-devel-2.3.1-4.el9.x86_64 2024-03-16T07:24:06.100 INFO:teuthology.orchestra.run.smithi049.stdout: libblkid-2.37.4-18.el9.x86_64 2024-03-16T07:24:06.100 INFO:teuthology.orchestra.run.smithi049.stdout: libfdisk-2.37.4-18.el9.x86_64 2024-03-16T07:24:06.100 INFO:teuthology.orchestra.run.smithi049.stdout: libmount-2.37.4-18.el9.x86_64 2024-03-16T07:24:06.100 INFO:teuthology.orchestra.run.smithi049.stdout: librados2-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-16T07:24:06.100 INFO:teuthology.orchestra.run.smithi049.stdout: librbd1-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-16T07:24:06.100 INFO:teuthology.orchestra.run.smithi049.stdout: libsmartcols-2.37.4-18.el9.x86_64 2024-03-16T07:24:06.100 INFO:teuthology.orchestra.run.smithi049.stdout: libuuid-2.37.4-18.el9.x86_64 2024-03-16T07:24:06.101 INFO:teuthology.orchestra.run.smithi049.stdout: openssl-1:3.0.7-27.el9.x86_64 2024-03-16T07:24:06.101 INFO:teuthology.orchestra.run.smithi049.stdout: openssl-libs-1:3.0.7-27.el9.x86_64 2024-03-16T07:24:06.101 INFO:teuthology.orchestra.run.smithi049.stdout: util-linux-2.37.4-18.el9.x86_64 2024-03-16T07:24:06.101 INFO:teuthology.orchestra.run.smithi049.stdout: util-linux-core-2.37.4-18.el9.x86_64 2024-03-16T07:24:06.101 INFO:teuthology.orchestra.run.smithi049.stdout: util-linux-user-2.37.4-18.el9.x86_64 2024-03-16T07:24:06.101 INFO:teuthology.orchestra.run.smithi049.stdout: xfsdump-3.1.12-4.el9.x86_64 2024-03-16T07:24:06.101 INFO:teuthology.orchestra.run.smithi049.stdout: xfsprogs-6.3.0-1.el9.x86_64 2024-03-16T07:24:06.101 INFO:teuthology.orchestra.run.smithi049.stdout:Installed: 2024-03-16T07:24:06.101 INFO:teuthology.orchestra.run.smithi049.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-03-16T07:24:06.101 INFO:teuthology.orchestra.run.smithi049.stdout: automake-1.16.2-8.el9.noarch 2024-03-16T07:24:06.101 INFO:teuthology.orchestra.run.smithi049.stdout: bison-3.7.4-5.el9.x86_64 2024-03-16T07:24:06.101 INFO:teuthology.orchestra.run.smithi049.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-03-16T07:24:06.101 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-16T07:24:06.101 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-base-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-16T07:24:06.102 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-base-debuginfo-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-16T07:24:06.102 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-common-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-16T07:24:06.102 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-common-debuginfo-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-16T07:24:06.102 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-debuginfo-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-16T07:24:06.102 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-fuse-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-16T07:24:06.102 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-fuse-debuginfo-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-16T07:24:06.102 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-grafana-dashboards-2:19.0.0-2162.g3d78f5ba.el9.noarch 2024-03-16T07:24:06.102 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-immutable-object-cache-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-16T07:24:06.102 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-immutable-object-cache-debuginfo-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-16T07:24:06.102 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mds-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-16T07:24:06.102 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mds-debuginfo-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-16T07:24:06.102 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mgr-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-16T07:24:06.102 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mgr-cephadm-2:19.0.0-2162.g3d78f5ba.el9.noarch 2024-03-16T07:24:06.102 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mgr-dashboard-2:19.0.0-2162.g3d78f5ba.el9.noarch 2024-03-16T07:24:06.103 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mgr-debuginfo-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-16T07:24:06.103 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mgr-diskprediction-local-2:19.0.0-2162.g3d78f5ba.el9.noarch 2024-03-16T07:24:06.103 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mgr-modules-core-2:19.0.0-2162.g3d78f5ba.el9.noarch 2024-03-16T07:24:06.103 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mgr-rook-2:19.0.0-2162.g3d78f5ba.el9.noarch 2024-03-16T07:24:06.103 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mon-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-16T07:24:06.103 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mon-debuginfo-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-16T07:24:06.103 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-osd-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-16T07:24:06.103 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-osd-debuginfo-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-16T07:24:06.103 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-prometheus-alerts-2:19.0.0-2162.g3d78f5ba.el9.noarch 2024-03-16T07:24:06.103 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-radosgw-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-16T07:24:06.103 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-radosgw-debuginfo-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-16T07:24:06.103 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-selinux-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-16T07:24:06.103 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-test-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-16T07:24:06.104 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-test-debuginfo-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-16T07:24:06.104 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-volume-2:19.0.0-2162.g3d78f5ba.el9.noarch 2024-03-16T07:24:06.104 INFO:teuthology.orchestra.run.smithi049.stdout: cephadm-2:19.0.0-2162.g3d78f5ba.el9.noarch 2024-03-16T07:24:06.104 INFO:teuthology.orchestra.run.smithi049.stdout: cephfs-mirror-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-16T07:24:06.104 INFO:teuthology.orchestra.run.smithi049.stdout: cephfs-shell-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-16T07:24:06.104 INFO:teuthology.orchestra.run.smithi049.stdout: cephfs-top-2:19.0.0-2162.g3d78f5ba.el9.noarch 2024-03-16T07:24:06.104 INFO:teuthology.orchestra.run.smithi049.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-03-16T07:24:06.104 INFO:teuthology.orchestra.run.smithi049.stdout: flex-2.6.4-9.el9.x86_64 2024-03-16T07:24:06.104 INFO:teuthology.orchestra.run.smithi049.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-03-16T07:24:06.104 INFO:teuthology.orchestra.run.smithi049.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-03-16T07:24:06.104 INFO:teuthology.orchestra.run.smithi049.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-03-16T07:24:06.104 INFO:teuthology.orchestra.run.smithi049.stdout: fuse-2.9.9-15.el9.x86_64 2024-03-16T07:24:06.104 INFO:teuthology.orchestra.run.smithi049.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-03-16T07:24:06.104 INFO:teuthology.orchestra.run.smithi049.stdout: grpc-data-1.46.7-10.el9.noarch 2024-03-16T07:24:06.104 INFO:teuthology.orchestra.run.smithi049.stdout: jq-1.6-16.el9.x86_64 2024-03-16T07:24:06.105 INFO:teuthology.orchestra.run.smithi049.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-03-16T07:24:06.105 INFO:teuthology.orchestra.run.smithi049.stdout: libarrow-9.0.0-10.el9.x86_64 2024-03-16T07:24:06.105 INFO:teuthology.orchestra.run.smithi049.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-03-16T07:24:06.105 INFO:teuthology.orchestra.run.smithi049.stdout: libcephfs-devel-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-16T07:24:06.105 INFO:teuthology.orchestra.run.smithi049.stdout: libcephfs2-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-16T07:24:06.105 INFO:teuthology.orchestra.run.smithi049.stdout: libcephfs2-debuginfo-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-16T07:24:06.105 INFO:teuthology.orchestra.run.smithi049.stdout: libcephsqlite-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-16T07:24:06.105 INFO:teuthology.orchestra.run.smithi049.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-03-16T07:24:06.105 INFO:teuthology.orchestra.run.smithi049.stdout: liboath-2.6.7-2.el9.x86_64 2024-03-16T07:24:06.105 INFO:teuthology.orchestra.run.smithi049.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-03-16T07:24:06.105 INFO:teuthology.orchestra.run.smithi049.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-03-16T07:24:06.105 INFO:teuthology.orchestra.run.smithi049.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-03-16T07:24:06.105 INFO:teuthology.orchestra.run.smithi049.stdout: librados-devel-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-16T07:24:06.105 INFO:teuthology.orchestra.run.smithi049.stdout: librados-devel-debuginfo-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-16T07:24:06.105 INFO:teuthology.orchestra.run.smithi049.stdout: librados2-debuginfo-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-16T07:24:06.106 INFO:teuthology.orchestra.run.smithi049.stdout: libradosstriper1-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-16T07:24:06.106 INFO:teuthology.orchestra.run.smithi049.stdout: librbd1-debuginfo-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-16T07:24:06.106 INFO:teuthology.orchestra.run.smithi049.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-03-16T07:24:06.106 INFO:teuthology.orchestra.run.smithi049.stdout: librgw2-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-16T07:24:06.106 INFO:teuthology.orchestra.run.smithi049.stdout: libtool-2.4.6-45.el9.x86_64 2024-03-16T07:24:06.106 INFO:teuthology.orchestra.run.smithi049.stdout: libunwind-1.6.2-1.el9.x86_64 2024-03-16T07:24:06.106 INFO:teuthology.orchestra.run.smithi049.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-03-16T07:24:06.106 INFO:teuthology.orchestra.run.smithi049.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-03-16T07:24:06.106 INFO:teuthology.orchestra.run.smithi049.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-03-16T07:24:06.106 INFO:teuthology.orchestra.run.smithi049.stdout: lua-5.4.4-4.el9.x86_64 2024-03-16T07:24:06.106 INFO:teuthology.orchestra.run.smithi049.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-03-16T07:24:06.106 INFO:teuthology.orchestra.run.smithi049.stdout: luarocks-3.9.2-1.el9.noarch 2024-03-16T07:24:06.106 INFO:teuthology.orchestra.run.smithi049.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-03-16T07:24:06.106 INFO:teuthology.orchestra.run.smithi049.stdout: openblas-0.3.21-2.el9.x86_64 2024-03-16T07:24:06.107 INFO:teuthology.orchestra.run.smithi049.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-03-16T07:24:06.107 INFO:teuthology.orchestra.run.smithi049.stdout: openssl-devel-1:3.0.7-27.el9.x86_64 2024-03-16T07:24:06.107 INFO:teuthology.orchestra.run.smithi049.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-03-16T07:24:06.107 INFO:teuthology.orchestra.run.smithi049.stdout: postgresql-13.11-1.el9.x86_64 2024-03-16T07:24:06.107 INFO:teuthology.orchestra.run.smithi049.stdout: postgresql-contrib-13.11-1.el9.x86_64 2024-03-16T07:24:06.107 INFO:teuthology.orchestra.run.smithi049.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2024-03-16T07:24:06.107 INFO:teuthology.orchestra.run.smithi049.stdout: postgresql-server-13.11-1.el9.x86_64 2024-03-16T07:24:06.107 INFO:teuthology.orchestra.run.smithi049.stdout: protobuf-3.14.0-13.el9.x86_64 2024-03-16T07:24:06.107 INFO:teuthology.orchestra.run.smithi049.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-03-16T07:24:06.107 INFO:teuthology.orchestra.run.smithi049.stdout: python3-asyncssh-2.13.2-4.el9.noarch 2024-03-16T07:24:06.107 INFO:teuthology.orchestra.run.smithi049.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-03-16T07:24:06.107 INFO:teuthology.orchestra.run.smithi049.stdout: python3-babel-2.9.1-2.el9.noarch 2024-03-16T07:24:06.107 INFO:teuthology.orchestra.run.smithi049.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-03-16T07:24:06.107 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-03-16T07:24:06.108 INFO:teuthology.orchestra.run.smithi049.stdout: python3-ceph-argparse-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-16T07:24:06.108 INFO:teuthology.orchestra.run.smithi049.stdout: python3-ceph-common-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-16T07:24:06.108 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cephfs-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-16T07:24:06.108 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cephfs-debuginfo-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-16T07:24:06.108 INFO:teuthology.orchestra.run.smithi049.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-03-16T07:24:06.108 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-03-16T07:24:06.108 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-03-16T07:24:06.108 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-03-16T07:24:06.108 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-03-16T07:24:06.108 INFO:teuthology.orchestra.run.smithi049.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-03-16T07:24:06.108 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-03-16T07:24:06.108 INFO:teuthology.orchestra.run.smithi049.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-03-16T07:24:06.108 INFO:teuthology.orchestra.run.smithi049.stdout: python3-google-auth-1:2.28.0-1.el9.noarch 2024-03-16T07:24:06.108 INFO:teuthology.orchestra.run.smithi049.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-03-16T07:24:06.108 INFO:teuthology.orchestra.run.smithi049.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-03-16T07:24:06.109 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-03-16T07:24:06.109 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-03-16T07:24:06.109 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-03-16T07:24:06.109 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-03-16T07:24:06.109 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-03-16T07:24:06.109 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-03-16T07:24:06.109 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-03-16T07:24:06.109 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-03-16T07:24:06.109 INFO:teuthology.orchestra.run.smithi049.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-03-16T07:24:06.109 INFO:teuthology.orchestra.run.smithi049.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-03-16T07:24:06.109 INFO:teuthology.orchestra.run.smithi049.stdout: python3-mako-1.1.4-6.el9.noarch 2024-03-16T07:24:06.109 INFO:teuthology.orchestra.run.smithi049.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-03-16T07:24:06.109 INFO:teuthology.orchestra.run.smithi049.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-03-16T07:24:06.109 INFO:teuthology.orchestra.run.smithi049.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-03-16T07:24:06.109 INFO:teuthology.orchestra.run.smithi049.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-03-16T07:24:06.110 INFO:teuthology.orchestra.run.smithi049.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-03-16T07:24:06.110 INFO:teuthology.orchestra.run.smithi049.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-03-16T07:24:06.110 INFO:teuthology.orchestra.run.smithi049.stdout: python3-packaging-20.9-5.el9.noarch 2024-03-16T07:24:06.110 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-03-16T07:24:06.110 INFO:teuthology.orchestra.run.smithi049.stdout: python3-ply-3.11-14.el9.noarch 2024-03-16T07:24:06.110 INFO:teuthology.orchestra.run.smithi049.stdout: python3-portend-3.1.0-2.el9.noarch 2024-03-16T07:24:06.110 INFO:teuthology.orchestra.run.smithi049.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-03-16T07:24:06.110 INFO:teuthology.orchestra.run.smithi049.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-03-16T07:24:06.110 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-03-16T07:24:06.110 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-03-16T07:24:06.110 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-03-16T07:24:06.110 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pycparser-2.20-6.el9.noarch 2024-03-16T07:24:06.110 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-03-16T07:24:06.110 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pytz-2021.1-5.el9.noarch 2024-03-16T07:24:06.111 INFO:teuthology.orchestra.run.smithi049.stdout: python3-rados-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-16T07:24:06.111 INFO:teuthology.orchestra.run.smithi049.stdout: python3-rados-debuginfo-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-16T07:24:06.111 INFO:teuthology.orchestra.run.smithi049.stdout: python3-rbd-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-16T07:24:06.111 INFO:teuthology.orchestra.run.smithi049.stdout: python3-rbd-debuginfo-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-16T07:24:06.111 INFO:teuthology.orchestra.run.smithi049.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-03-16T07:24:06.111 INFO:teuthology.orchestra.run.smithi049.stdout: python3-requests-2.25.1-8.el9.noarch 2024-03-16T07:24:06.111 INFO:teuthology.orchestra.run.smithi049.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-03-16T07:24:06.111 INFO:teuthology.orchestra.run.smithi049.stdout: python3-rgw-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-16T07:24:06.111 INFO:teuthology.orchestra.run.smithi049.stdout: python3-rgw-debuginfo-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-16T07:24:06.111 INFO:teuthology.orchestra.run.smithi049.stdout: python3-routes-2.5.1-5.el9.noarch 2024-03-16T07:24:06.111 INFO:teuthology.orchestra.run.smithi049.stdout: python3-rsa-4.9-2.el9.noarch 2024-03-16T07:24:06.111 INFO:teuthology.orchestra.run.smithi049.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-03-16T07:24:06.111 INFO:teuthology.orchestra.run.smithi049.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-03-16T07:24:06.111 INFO:teuthology.orchestra.run.smithi049.stdout: python3-toml-0.10.2-6.el9.noarch 2024-03-16T07:24:06.112 INFO:teuthology.orchestra.run.smithi049.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-03-16T07:24:06.112 INFO:teuthology.orchestra.run.smithi049.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-03-16T07:24:06.112 INFO:teuthology.orchestra.run.smithi049.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-03-16T07:24:06.112 INFO:teuthology.orchestra.run.smithi049.stdout: python3-webob-1.8.7-6.el9.noarch 2024-03-16T07:24:06.112 INFO:teuthology.orchestra.run.smithi049.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-03-16T07:24:06.112 INFO:teuthology.orchestra.run.smithi049.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-03-16T07:24:06.112 INFO:teuthology.orchestra.run.smithi049.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-03-16T07:24:06.112 INFO:teuthology.orchestra.run.smithi049.stdout: qatlib-23.11.0-1.el9.x86_64 2024-03-16T07:24:06.112 INFO:teuthology.orchestra.run.smithi049.stdout: qatlib-service-23.11.0-1.el9.x86_64 2024-03-16T07:24:06.112 INFO:teuthology.orchestra.run.smithi049.stdout: qatzip-libs-1.1.2-2.el9.x86_64 2024-03-16T07:24:06.112 INFO:teuthology.orchestra.run.smithi049.stdout: rbd-fuse-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-16T07:24:06.112 INFO:teuthology.orchestra.run.smithi049.stdout: rbd-fuse-debuginfo-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-16T07:24:06.112 INFO:teuthology.orchestra.run.smithi049.stdout: rbd-mirror-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-16T07:24:06.112 INFO:teuthology.orchestra.run.smithi049.stdout: rbd-mirror-debuginfo-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-16T07:24:06.113 INFO:teuthology.orchestra.run.smithi049.stdout: rbd-nbd-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-16T07:24:06.113 INFO:teuthology.orchestra.run.smithi049.stdout: rbd-nbd-debuginfo-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-16T07:24:06.113 INFO:teuthology.orchestra.run.smithi049.stdout: re2-1:20211101-3.el9.x86_64 2024-03-16T07:24:06.113 INFO:teuthology.orchestra.run.smithi049.stdout: socat-1.7.4.1-5.el9.x86_64 2024-03-16T07:24:06.113 INFO:teuthology.orchestra.run.smithi049.stdout: thrift-0.15.0-2.el9.x86_64 2024-03-16T07:24:06.113 INFO:teuthology.orchestra.run.smithi049.stdout: uuid-1.6.2-55.el9.x86_64 2024-03-16T07:24:06.113 INFO:teuthology.orchestra.run.smithi049.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-03-16T07:24:06.113 INFO:teuthology.orchestra.run.smithi049.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-03-16T07:24:06.113 INFO:teuthology.orchestra.run.smithi049.stdout: zlib-devel-1.2.11-40.el9.x86_64 2024-03-16T07:24:06.113 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:24:06.113 INFO:teuthology.orchestra.run.smithi049.stdout:Complete! 2024-03-16T07:24:06.790 DEBUG:teuthology.parallel:result is None 2024-03-16T07:24:06.790 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3d78f5ba07bf18880172c07d4d7b4ac00c9d30af 2024-03-16T07:24:06.939 DEBUG:teuthology.orchestra.run.smithi049:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-03-16T07:24:06.961 INFO:teuthology.orchestra.run.smithi049.stdout:19.0.0-2162.g3d78f5ba.el9 2024-03-16T07:24:06.962 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2162.g3d78f5ba.el9 2024-03-16T07:24:06.962 INFO:teuthology.task.install:The correct ceph version 19.0.0-2162.g3d78f5ba is installed. 2024-03-16T07:24:06.964 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-03-16T07:24:06.964 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-03-16T07:24:06.964 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-03-16T07:24:07.034 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-03-16T07:24:07.034 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-03-16T07:24:07.034 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd of=/usr/bin/daemon-helper 2024-03-16T07:24:07.104 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-03-16T07:24:07.175 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-03-16T07:24:07.175 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-03-16T07:24:07.175 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd of=/usr/bin/adjust-ulimits 2024-03-16T07:24:07.246 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-03-16T07:24:07.318 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-03-16T07:24:07.318 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-03-16T07:24:07.318 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd of=/usr/bin/stdin-killer 2024-03-16T07:24:07.389 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-03-16T07:24:07.459 INFO:teuthology.run_tasks:Running task ceph... 2024-03-16T07:24:07.551 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-03-16T07:24:07.551 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod 777 /var/log/ceph 2024-03-16T07:24:07.581 INFO:tasks.ceph:Disabling ceph logrotate... 2024-03-16T07:24:07.582 DEBUG:teuthology.orchestra.run.smithi049:> sudo rm -f -- /etc/logrotate.d/ceph 2024-03-16T07:24:07.652 INFO:tasks.ceph:Creating extra log directories... 2024-03-16T07:24:07.653 DEBUG:teuthology.orchestra.run.smithi049:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-03-16T07:24:07.728 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-03-16T07:24:07.728 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-03-16T07:24:07.728 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-03-16T07:24:07.729 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-03-16T07:24:07.729 DEBUG:teuthology.orchestra.run.smithi049:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-03-16T07:24:07.779 DEBUG:teuthology.orchestra.run.smithi049:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-03-16T07:24:07.909 DEBUG:teuthology.orchestra.run.smithi049:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-03-16T07:24:07.944 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-03-16T07:24:07.944 INFO:tasks.ceph:config {'conf': {'client': {'debug cephfs_mirror': 20, 'log to stderr': False}, 'client.mirror': {'admin socket': '/var/run/ceph/cephfs-mirror.asok', 'pid file': '/var/run/ceph/cephfs-mirror.pid'}, 'mgr': {'debug client': 10, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'debug ms': 1, 'debug osd': 20}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-03-16T07:24:07.944 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/pdonnell-2024-03-15_13:00:41-fs-wip-batrick-testing-20240314.183243-distro-default-smithi/7602244', 'branch': 'wip-batrick-testing-20240314.183243', 'description': 'fs/valgrind/{begin/{0-install 1-ceph 2-logrotate} centos_latest debug mirror/{cephfs-mirror/one-per-cluster clients/mirror cluster/1-node mount/fuse overrides/ignorelist_health tasks/mirror}}', 'email': 'pdonnell@redhat.com', 'first_in_suite': False, 'job_id': '7602244', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'meta': [{'desc': 'run one cephfs-mirror daemon on primary cluster'}, {'desc': 'configure the permissions for client.mirror'}, {'desc': '1 ceph cluster with 1 mon, 1 mgr, 3 osds, 5 mdss'}], 'name': 'pdonnell-2024-03-15_13:00:41-fs-wip-batrick-testing-20240314.183243-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-batrick-testing-20240314.183243'}, 'ceph': {'conf': {'client': {'debug cephfs_mirror': 20, 'log to stderr': False}, 'client.mirror': {'admin socket': '/var/run/ceph/cephfs-mirror.asok', 'pid file': '/var/run/ceph/cephfs-mirror.pid'}, 'mgr': {'debug client': 10, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'debug ms': 1, 'debug osd': 20}}, 'flavor': 'default', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data'], 'sha1': '3d78f5ba07bf18880172c07d4d7b4ac00c9d30af'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'debuginfo': True, 'flavor': 'default', 'sha1': '3d78f5ba07bf18880172c07d4d7b4ac00c9d30af'}}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'workunit': {'branch': 'wip-batrick-testing-20240314.183243', 'sha1': '3d78f5ba07bf18880172c07d4d7b4ac00c9d30af'}}, 'owner': 'scheduled_pdonnell@teuthology', 'priority': 75, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.x', 'mds.a', 'mds.b', 'mds.c', 'mds.d', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'client.0', 'client.1', 'client.mirror', 'client.mirror_remote']], 'seed': 4770, 'sha1': '3d78f5ba07bf18880172c07d4d7b4ac00c9d30af', 'sleep_before_teardown': 0, 'subset': '498/512', 'suite': 'fs', 'suite_branch': 'wip-batrick-testing-20240314.183243', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_3d78f5ba07bf18880172c07d4d7b4ac00c9d30af/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '3d78f5ba07bf18880172c07d4d7b4ac00c9d30af', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi049.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNxI8tCqFRhkm7p8GBvWHe8mGn7NFyGFbd0OL/4fy7dDeQDJ1tttKE7pz3Gukl+7Z+lsRx6pd/9kCFKzrn9UVJU='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'debuginfo': True, 'flavor': 'default', 'sha1': '3d78f5ba07bf18880172c07d4d7b4ac00c9d30af'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'debug cephfs_mirror': 20, 'log to stderr': False}, 'client.mirror': {'admin socket': '/var/run/ceph/cephfs-mirror.asok', 'pid file': '/var/run/ceph/cephfs-mirror.pid'}, 'mgr': {'debug client': 10, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'debug ms': 1, 'debug osd': 20}}, 'flavor': 'default', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data'], 'sha1': '3d78f5ba07bf18880172c07d4d7b4ac00c9d30af', 'cluster': 'ceph'}}, {'cephfs-mirror': {'client': 'client.mirror', 'valgrind': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes']}}, {'exec': {'client.mirror': ["sudo ceph auth caps client.mirror mon 'profile cephfs-mirror' mds 'allow r' osd 'allow rw tag cephfs metadata=*, allow r tag cephfs data=*' mgr 'allow r'"], 'client.mirror_remote': ["sudo ceph auth caps client.mirror_remote mon 'allow r' mds 'allow rwps' osd 'allow rw tag cephfs *=*' mgr 'allow r'"]}}, {'ceph-fuse': ['client.0', 'client.1']}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_mirroring.TestMirroring']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': 'e691533f9cbb33d85b2187bba20d7102f098636d', 'timestamp': '2024-03-15_13:00:41', 'tube': 'smithi', 'user': 'pdonnell', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-03-16T07:24:07.945 DEBUG:teuthology.orchestra.run.smithi049:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-03-16T07:24:07.995 DEBUG:teuthology.orchestra.run.smithi049:> sudo install -d -m0777 -- /var/run/ceph 2024-03-16T07:24:08.065 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-03-16T07:24:08.065 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/scratch_devs of=/dev/stdout 2024-03-16T07:24:08.121 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-03-16T07:24:08.121 DEBUG:teuthology.orchestra.run.smithi049:> stat /dev/vg_nvme/lv_1 2024-03-16T07:24:08.176 INFO:teuthology.orchestra.run.smithi049.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-03-16T07:24:08.176 INFO:teuthology.orchestra.run.smithi049.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-16T07:24:08.176 INFO:teuthology.orchestra.run.smithi049.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-03-16T07:24:08.176 INFO:teuthology.orchestra.run.smithi049.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-16T07:24:08.176 INFO:teuthology.orchestra.run.smithi049.stdout:Context: system_u:object_r:device_t:s0 2024-03-16T07:24:08.176 INFO:teuthology.orchestra.run.smithi049.stdout:Access: 2024-03-16 07:23:53.783072624 +0000 2024-03-16T07:24:08.176 INFO:teuthology.orchestra.run.smithi049.stdout:Modify: 2024-03-16 07:15:58.780475512 +0000 2024-03-16T07:24:08.176 INFO:teuthology.orchestra.run.smithi049.stdout:Change: 2024-03-16 07:15:58.780475512 +0000 2024-03-16T07:24:08.176 INFO:teuthology.orchestra.run.smithi049.stdout: Birth: 2024-03-16 07:15:58.780475512 +0000 2024-03-16T07:24:08.176 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-03-16T07:24:08.245 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-03-16T07:24:08.245 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-03-16T07:24:08.245 INFO:teuthology.orchestra.run.smithi049.stderr:512 bytes copied, 8.5689e-05 s, 6.0 MB/s 2024-03-16T07:24:08.246 DEBUG:teuthology.orchestra.run.smithi049:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-03-16T07:24:08.302 DEBUG:teuthology.orchestra.run.smithi049:> stat /dev/vg_nvme/lv_2 2024-03-16T07:24:08.357 INFO:teuthology.orchestra.run.smithi049.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-03-16T07:24:08.357 INFO:teuthology.orchestra.run.smithi049.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-16T07:24:08.357 INFO:teuthology.orchestra.run.smithi049.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-03-16T07:24:08.357 INFO:teuthology.orchestra.run.smithi049.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-16T07:24:08.357 INFO:teuthology.orchestra.run.smithi049.stdout:Context: system_u:object_r:device_t:s0 2024-03-16T07:24:08.357 INFO:teuthology.orchestra.run.smithi049.stdout:Access: 2024-03-16 07:23:53.783072624 +0000 2024-03-16T07:24:08.357 INFO:teuthology.orchestra.run.smithi049.stdout:Modify: 2024-03-16 07:15:59.122466077 +0000 2024-03-16T07:24:08.357 INFO:teuthology.orchestra.run.smithi049.stdout:Change: 2024-03-16 07:15:59.122466077 +0000 2024-03-16T07:24:08.357 INFO:teuthology.orchestra.run.smithi049.stdout: Birth: 2024-03-16 07:15:59.122466077 +0000 2024-03-16T07:24:08.358 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-03-16T07:24:08.426 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-03-16T07:24:08.426 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-03-16T07:24:08.426 INFO:teuthology.orchestra.run.smithi049.stderr:512 bytes copied, 8.2544e-05 s, 6.2 MB/s 2024-03-16T07:24:08.428 DEBUG:teuthology.orchestra.run.smithi049:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-03-16T07:24:08.483 DEBUG:teuthology.orchestra.run.smithi049:> stat /dev/vg_nvme/lv_3 2024-03-16T07:24:08.539 INFO:teuthology.orchestra.run.smithi049.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-03-16T07:24:08.539 INFO:teuthology.orchestra.run.smithi049.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-16T07:24:08.539 INFO:teuthology.orchestra.run.smithi049.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-03-16T07:24:08.539 INFO:teuthology.orchestra.run.smithi049.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-16T07:24:08.539 INFO:teuthology.orchestra.run.smithi049.stdout:Context: system_u:object_r:device_t:s0 2024-03-16T07:24:08.539 INFO:teuthology.orchestra.run.smithi049.stdout:Access: 2024-03-16 07:23:53.783072624 +0000 2024-03-16T07:24:08.539 INFO:teuthology.orchestra.run.smithi049.stdout:Modify: 2024-03-16 07:15:59.461456725 +0000 2024-03-16T07:24:08.540 INFO:teuthology.orchestra.run.smithi049.stdout:Change: 2024-03-16 07:15:59.461456725 +0000 2024-03-16T07:24:08.540 INFO:teuthology.orchestra.run.smithi049.stdout: Birth: 2024-03-16 07:15:59.461456725 +0000 2024-03-16T07:24:08.540 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-03-16T07:24:08.608 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-03-16T07:24:08.608 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-03-16T07:24:08.608 INFO:teuthology.orchestra.run.smithi049.stderr:512 bytes copied, 7.8718e-05 s, 6.5 MB/s 2024-03-16T07:24:08.609 DEBUG:teuthology.orchestra.run.smithi049:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-03-16T07:24:08.665 DEBUG:teuthology.orchestra.run.smithi049:> stat /dev/vg_nvme/lv_4 2024-03-16T07:24:08.720 INFO:teuthology.orchestra.run.smithi049.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-03-16T07:24:08.720 INFO:teuthology.orchestra.run.smithi049.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-16T07:24:08.720 INFO:teuthology.orchestra.run.smithi049.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-03-16T07:24:08.720 INFO:teuthology.orchestra.run.smithi049.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-16T07:24:08.720 INFO:teuthology.orchestra.run.smithi049.stdout:Context: system_u:object_r:device_t:s0 2024-03-16T07:24:08.720 INFO:teuthology.orchestra.run.smithi049.stdout:Access: 2024-03-16 07:23:53.784072597 +0000 2024-03-16T07:24:08.720 INFO:teuthology.orchestra.run.smithi049.stdout:Modify: 2024-03-16 07:15:59.810447097 +0000 2024-03-16T07:24:08.720 INFO:teuthology.orchestra.run.smithi049.stdout:Change: 2024-03-16 07:15:59.810447097 +0000 2024-03-16T07:24:08.720 INFO:teuthology.orchestra.run.smithi049.stdout: Birth: 2024-03-16 07:15:59.810447097 +0000 2024-03-16T07:24:08.721 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-03-16T07:24:08.788 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-03-16T07:24:08.789 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-03-16T07:24:08.789 INFO:teuthology.orchestra.run.smithi049.stderr:512 bytes copied, 9.8677e-05 s, 5.2 MB/s 2024-03-16T07:24:08.790 DEBUG:teuthology.orchestra.run.smithi049:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-03-16T07:24:08.846 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2024-03-16T07:24:08.846 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi049.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'}} 2024-03-16T07:24:08.846 INFO:tasks.ceph:Generating config... 2024-03-16T07:24:08.847 INFO:tasks.ceph:[client] debug cephfs_mirror = 20 2024-03-16T07:24:08.847 INFO:tasks.ceph:[client] log to stderr = False 2024-03-16T07:24:08.847 INFO:tasks.ceph:[client.mirror] admin socket = /var/run/ceph/cephfs-mirror.asok 2024-03-16T07:24:08.847 INFO:tasks.ceph:[client.mirror] pid file = /var/run/ceph/cephfs-mirror.pid 2024-03-16T07:24:08.847 INFO:tasks.ceph:[mgr] debug client = 10 2024-03-16T07:24:08.847 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-03-16T07:24:08.847 INFO:tasks.ceph:[mgr] debug ms = 1 2024-03-16T07:24:08.847 INFO:tasks.ceph:[mon] debug mon = 20 2024-03-16T07:24:08.848 INFO:tasks.ceph:[mon] debug ms = 1 2024-03-16T07:24:08.848 INFO:tasks.ceph:[mon] debug paxos = 20 2024-03-16T07:24:08.848 INFO:tasks.ceph:[osd] debug ms = 1 2024-03-16T07:24:08.848 INFO:tasks.ceph:[osd] debug osd = 20 2024-03-16T07:24:08.848 INFO:tasks.ceph:Setting up mon.a... 2024-03-16T07:24:08.848 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-03-16T07:24:08.944 INFO:teuthology.orchestra.run.smithi049.stdout:creating /etc/ceph/ceph.keyring 2024-03-16T07:24:08.947 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-03-16T07:24:08.994 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-03-16T07:24:09.024 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.49')] 2024-03-16T07:24:09.024 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.49'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'debug ms': 1, 'debug osd': 20}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 10}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug cephfs_mirror': 20, 'log to stderr': False}, 'mon.a': {}, 'mds.a': {}, 'mds.b': {}, 'mds.c': {}, 'mds.d': {}, 'mds.e': {}, 'client.mirror': {'admin socket': '/var/run/ceph/cephfs-mirror.asok', 'pid file': '/var/run/ceph/cephfs-mirror.pid'}} 2024-03-16T07:24:09.025 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-03-16T07:24:09.025 DEBUG:teuthology.orchestra.run.smithi049:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-03-16T07:24:09.079 DEBUG:teuthology.orchestra.run.smithi049:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.49 --print /home/ubuntu/cephtest/ceph.monmap 2024-03-16T07:24:09.158 INFO:teuthology.orchestra.run.smithi049.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-03-16T07:24:09.158 INFO:teuthology.orchestra.run.smithi049.stdout:monmaptool: generated fsid f91af061-9eac-4793-87fa-8d27ae3d242f 2024-03-16T07:24:09.158 INFO:teuthology.orchestra.run.smithi049.stdout:setting min_mon_release = quincy 2024-03-16T07:24:09.159 INFO:teuthology.orchestra.run.smithi049.stdout:epoch 0 2024-03-16T07:24:09.159 INFO:teuthology.orchestra.run.smithi049.stdout:fsid f91af061-9eac-4793-87fa-8d27ae3d242f 2024-03-16T07:24:09.159 INFO:teuthology.orchestra.run.smithi049.stdout:last_changed 2024-03-16T07:24:09.160937+0000 2024-03-16T07:24:09.159 INFO:teuthology.orchestra.run.smithi049.stdout:created 2024-03-16T07:24:09.160937+0000 2024-03-16T07:24:09.159 INFO:teuthology.orchestra.run.smithi049.stdout:min_mon_release 17 (quincy) 2024-03-16T07:24:09.159 INFO:teuthology.orchestra.run.smithi049.stdout:election_strategy: 1 2024-03-16T07:24:09.159 INFO:teuthology.orchestra.run.smithi049.stdout:0: [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] mon.a 2024-03-16T07:24:09.159 INFO:teuthology.orchestra.run.smithi049.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (1 monitors) 2024-03-16T07:24:09.160 DEBUG:teuthology.orchestra.run.smithi049:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-03-16T07:24:09.215 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID f91af061-9eac-4793-87fa-8d27ae3d242f... 2024-03-16T07:24:09.215 DEBUG:teuthology.orchestra.run.smithi049:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-03-16T07:24:09.315 INFO:teuthology.orchestra.run.smithi049.stdout:[global] 2024-03-16T07:24:09.315 INFO:teuthology.orchestra.run.smithi049.stdout: chdir = "" 2024-03-16T07:24:09.315 INFO:teuthology.orchestra.run.smithi049.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-03-16T07:24:09.316 INFO:teuthology.orchestra.run.smithi049.stdout: auth supported = cephx 2024-03-16T07:24:09.316 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:24:09.316 INFO:teuthology.orchestra.run.smithi049.stdout: filestore xattr use omap = true 2024-03-16T07:24:09.316 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:24:09.316 INFO:teuthology.orchestra.run.smithi049.stdout: mon clock drift allowed = 1.000 2024-03-16T07:24:09.316 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:24:09.316 INFO:teuthology.orchestra.run.smithi049.stdout: osd crush chooseleaf type = 0 2024-03-16T07:24:09.316 INFO:teuthology.orchestra.run.smithi049.stdout: auth debug = true 2024-03-16T07:24:09.316 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:24:09.316 INFO:teuthology.orchestra.run.smithi049.stdout: ms die on old message = true 2024-03-16T07:24:09.316 INFO:teuthology.orchestra.run.smithi049.stdout: ms die on bug = true 2024-03-16T07:24:09.316 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:24:09.316 INFO:teuthology.orchestra.run.smithi049.stdout: mon max pg per osd = 10000 # >= luminous 2024-03-16T07:24:09.316 INFO:teuthology.orchestra.run.smithi049.stdout: mon pg warn max object skew = 0 2024-03-16T07:24:09.316 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:24:09.316 INFO:teuthology.orchestra.run.smithi049.stdout: # disable pg_autoscaler by default for new pools 2024-03-16T07:24:09.317 INFO:teuthology.orchestra.run.smithi049.stdout: osd_pool_default_pg_autoscale_mode = off 2024-03-16T07:24:09.317 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:24:09.317 INFO:teuthology.orchestra.run.smithi049.stdout: osd pool default size = 2 2024-03-16T07:24:09.317 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:24:09.317 INFO:teuthology.orchestra.run.smithi049.stdout: mon osd allow primary affinity = true 2024-03-16T07:24:09.317 INFO:teuthology.orchestra.run.smithi049.stdout: mon osd allow pg remap = true 2024-03-16T07:24:09.317 INFO:teuthology.orchestra.run.smithi049.stdout: mon warn on legacy crush tunables = false 2024-03-16T07:24:09.317 INFO:teuthology.orchestra.run.smithi049.stdout: mon warn on crush straw calc version zero = false 2024-03-16T07:24:09.317 INFO:teuthology.orchestra.run.smithi049.stdout: mon warn on no sortbitwise = false 2024-03-16T07:24:09.317 INFO:teuthology.orchestra.run.smithi049.stdout: mon warn on osd down out interval zero = false 2024-03-16T07:24:09.317 INFO:teuthology.orchestra.run.smithi049.stdout: mon warn on too few osds = false 2024-03-16T07:24:09.317 INFO:teuthology.orchestra.run.smithi049.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-03-16T07:24:09.317 INFO:teuthology.orchestra.run.smithi049.stdout: mon_warn_on_pool_no_redundancy = false 2024-03-16T07:24:09.317 INFO:teuthology.orchestra.run.smithi049.stdout: mon_allow_pool_size_one = true 2024-03-16T07:24:09.317 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:24:09.317 INFO:teuthology.orchestra.run.smithi049.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-03-16T07:24:09.318 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:24:09.318 INFO:teuthology.orchestra.run.smithi049.stdout: osd default data pool replay window = 5 2024-03-16T07:24:09.318 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:24:09.318 INFO:teuthology.orchestra.run.smithi049.stdout: mon allow pool delete = true 2024-03-16T07:24:09.318 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:24:09.318 INFO:teuthology.orchestra.run.smithi049.stdout: mon cluster log file level = debug 2024-03-16T07:24:09.318 INFO:teuthology.orchestra.run.smithi049.stdout: debug asserts on shutdown = true 2024-03-16T07:24:09.318 INFO:teuthology.orchestra.run.smithi049.stdout: mon health detail to clog = false 2024-03-16T07:24:09.318 INFO:teuthology.orchestra.run.smithi049.stdout: mon host = 172.21.15.49 2024-03-16T07:24:09.318 INFO:teuthology.orchestra.run.smithi049.stdout: fsid = f91af061-9eac-4793-87fa-8d27ae3d242f 2024-03-16T07:24:09.318 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:24:09.318 INFO:teuthology.orchestra.run.smithi049.stdout:[osd] 2024-03-16T07:24:09.318 INFO:teuthology.orchestra.run.smithi049.stdout: osd journal size = 100 2024-03-16T07:24:09.318 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:24:09.319 INFO:teuthology.orchestra.run.smithi049.stdout: osd scrub load threshold = 5.0 2024-03-16T07:24:09.319 INFO:teuthology.orchestra.run.smithi049.stdout: osd scrub max interval = 600 2024-03-16T07:24:09.319 INFO:teuthology.orchestra.run.smithi049.stdout: osd mclock profile = high_recovery_ops 2024-03-16T07:24:09.319 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:24:09.319 INFO:teuthology.orchestra.run.smithi049.stdout: osd recover clone overlap = true 2024-03-16T07:24:09.319 INFO:teuthology.orchestra.run.smithi049.stdout: osd recovery max chunk = 1048576 2024-03-16T07:24:09.319 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:24:09.319 INFO:teuthology.orchestra.run.smithi049.stdout: osd debug shutdown = true 2024-03-16T07:24:09.319 INFO:teuthology.orchestra.run.smithi049.stdout: osd debug op order = true 2024-03-16T07:24:09.319 INFO:teuthology.orchestra.run.smithi049.stdout: osd debug verify stray on activate = true 2024-03-16T07:24:09.319 INFO:teuthology.orchestra.run.smithi049.stdout: osd debug trim objects = true 2024-03-16T07:24:09.319 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:24:09.319 INFO:teuthology.orchestra.run.smithi049.stdout: osd open classes on start = true 2024-03-16T07:24:09.319 INFO:teuthology.orchestra.run.smithi049.stdout: osd debug pg log writeout = true 2024-03-16T07:24:09.319 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:24:09.319 INFO:teuthology.orchestra.run.smithi049.stdout: osd deep scrub update digest min age = 30 2024-03-16T07:24:09.319 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:24:09.320 INFO:teuthology.orchestra.run.smithi049.stdout: osd map max advance = 10 2024-03-16T07:24:09.320 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:24:09.320 INFO:teuthology.orchestra.run.smithi049.stdout: journal zero on create = true 2024-03-16T07:24:09.320 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:24:09.320 INFO:teuthology.orchestra.run.smithi049.stdout: filestore ondisk finisher threads = 3 2024-03-16T07:24:09.320 INFO:teuthology.orchestra.run.smithi049.stdout: filestore apply finisher threads = 3 2024-03-16T07:24:09.320 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:24:09.320 INFO:teuthology.orchestra.run.smithi049.stdout: bdev debug aio = true 2024-03-16T07:24:09.320 INFO:teuthology.orchestra.run.smithi049.stdout: osd debug misdirected ops = true 2024-03-16T07:24:09.320 INFO:teuthology.orchestra.run.smithi049.stdout: debug ms = 1 2024-03-16T07:24:09.320 INFO:teuthology.orchestra.run.smithi049.stdout: debug osd = 20 2024-03-16T07:24:09.320 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:24:09.320 INFO:teuthology.orchestra.run.smithi049.stdout:[mgr] 2024-03-16T07:24:09.320 INFO:teuthology.orchestra.run.smithi049.stdout: debug ms = 1 2024-03-16T07:24:09.320 INFO:teuthology.orchestra.run.smithi049.stdout: debug mgr = 20 2024-03-16T07:24:09.321 INFO:teuthology.orchestra.run.smithi049.stdout: debug mon = 20 2024-03-16T07:24:09.321 INFO:teuthology.orchestra.run.smithi049.stdout: debug auth = 20 2024-03-16T07:24:09.321 INFO:teuthology.orchestra.run.smithi049.stdout: mon reweight min pgs per osd = 4 2024-03-16T07:24:09.321 INFO:teuthology.orchestra.run.smithi049.stdout: mon reweight min bytes per osd = 10 2024-03-16T07:24:09.321 INFO:teuthology.orchestra.run.smithi049.stdout: mgr/telemetry/nag = false 2024-03-16T07:24:09.321 INFO:teuthology.orchestra.run.smithi049.stdout: debug client = 10 2024-03-16T07:24:09.321 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:24:09.321 INFO:teuthology.orchestra.run.smithi049.stdout:[mon] 2024-03-16T07:24:09.321 INFO:teuthology.orchestra.run.smithi049.stdout: debug ms = 1 2024-03-16T07:24:09.321 INFO:teuthology.orchestra.run.smithi049.stdout: debug mon = 20 2024-03-16T07:24:09.321 INFO:teuthology.orchestra.run.smithi049.stdout: debug paxos = 20 2024-03-16T07:24:09.321 INFO:teuthology.orchestra.run.smithi049.stdout: debug auth = 20 2024-03-16T07:24:09.321 INFO:teuthology.orchestra.run.smithi049.stdout: mon data avail warn = 5 2024-03-16T07:24:09.321 INFO:teuthology.orchestra.run.smithi049.stdout: mon mgr mkfs grace = 240 2024-03-16T07:24:09.321 INFO:teuthology.orchestra.run.smithi049.stdout: mon reweight min pgs per osd = 4 2024-03-16T07:24:09.321 INFO:teuthology.orchestra.run.smithi049.stdout: mon osd reporter subtree level = osd 2024-03-16T07:24:09.322 INFO:teuthology.orchestra.run.smithi049.stdout: mon osd prime pg temp = true 2024-03-16T07:24:09.322 INFO:teuthology.orchestra.run.smithi049.stdout: mon reweight min bytes per osd = 10 2024-03-16T07:24:09.322 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:24:09.322 INFO:teuthology.orchestra.run.smithi049.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-03-16T07:24:09.322 INFO:teuthology.orchestra.run.smithi049.stdout: auth mon ticket ttl = 660 # 11m 2024-03-16T07:24:09.322 INFO:teuthology.orchestra.run.smithi049.stdout: auth service ticket ttl = 240 # 4m 2024-03-16T07:24:09.322 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:24:09.322 INFO:teuthology.orchestra.run.smithi049.stdout: # don't complain about insecure global_id in the test suite 2024-03-16T07:24:09.322 INFO:teuthology.orchestra.run.smithi049.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-03-16T07:24:09.322 INFO:teuthology.orchestra.run.smithi049.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-03-16T07:24:09.322 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:24:09.322 INFO:teuthology.orchestra.run.smithi049.stdout: # 1m isn't quite enough 2024-03-16T07:24:09.322 INFO:teuthology.orchestra.run.smithi049.stdout: mon_down_mkfs_grace = 2m 2024-03-16T07:24:09.322 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:24:09.322 INFO:teuthology.orchestra.run.smithi049.stdout: mon_warn_on_filestore_osds = false 2024-03-16T07:24:09.322 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:24:09.322 INFO:teuthology.orchestra.run.smithi049.stdout:[client] 2024-03-16T07:24:09.323 INFO:teuthology.orchestra.run.smithi049.stdout: rgw cache enabled = true 2024-03-16T07:24:09.323 INFO:teuthology.orchestra.run.smithi049.stdout: rgw enable ops log = true 2024-03-16T07:24:09.323 INFO:teuthology.orchestra.run.smithi049.stdout: rgw enable usage log = true 2024-03-16T07:24:09.323 INFO:teuthology.orchestra.run.smithi049.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-03-16T07:24:09.323 INFO:teuthology.orchestra.run.smithi049.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-03-16T07:24:09.323 INFO:teuthology.orchestra.run.smithi049.stdout: debug cephfs_mirror = 20 2024-03-16T07:24:09.323 INFO:teuthology.orchestra.run.smithi049.stdout: log to stderr = False 2024-03-16T07:24:09.323 INFO:teuthology.orchestra.run.smithi049.stdout:[mon.a] 2024-03-16T07:24:09.323 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.a] 2024-03-16T07:24:09.323 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.b] 2024-03-16T07:24:09.323 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.c] 2024-03-16T07:24:09.323 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.d] 2024-03-16T07:24:09.323 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.e] 2024-03-16T07:24:09.323 INFO:teuthology.orchestra.run.smithi049.stdout:[client.mirror] 2024-03-16T07:24:09.323 INFO:teuthology.orchestra.run.smithi049.stdout: admin socket = /var/run/ceph/cephfs-mirror.asok 2024-03-16T07:24:09.323 INFO:teuthology.orchestra.run.smithi049.stdout: pid file = /var/run/ceph/cephfs-mirror.pid 2024-03-16T07:24:09.332 INFO:tasks.ceph:Creating admin key on mon.a... 2024-03-16T07:24:09.333 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-03-16T07:24:09.392 INFO:tasks.ceph:Copying monmap to all nodes... 2024-03-16T07:24:09.392 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-03-16T07:24:09.392 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-03-16T07:24:09.407 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-03-16T07:24:09.407 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-03-16T07:24:09.462 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi049.front.sepia.ceph.com 2024-03-16T07:24:09.462 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-03-16T07:24:09.462 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd of=/etc/ceph/ceph.keyring 2024-03-16T07:24:09.462 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-03-16T07:24:09.549 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-03-16T07:24:09.549 DEBUG:teuthology.orchestra.run.smithi049:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-03-16T07:24:09.604 INFO:tasks.ceph:Setting up mon nodes... 2024-03-16T07:24:09.604 INFO:tasks.ceph:Setting up mgr nodes... 2024-03-16T07:24:09.604 DEBUG:teuthology.orchestra.run.smithi049:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-03-16T07:24:09.706 INFO:teuthology.orchestra.run.smithi049.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-03-16T07:24:09.709 INFO:tasks.ceph:Setting up mds nodes... 2024-03-16T07:24:09.709 DEBUG:teuthology.orchestra.run.smithi049:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-03-16T07:24:09.770 INFO:teuthology.orchestra.run.smithi049.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-03-16T07:24:09.773 DEBUG:teuthology.orchestra.run.smithi049:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-03-16T07:24:09.803 DEBUG:teuthology.orchestra.run.smithi049:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-03-16T07:24:09.905 INFO:teuthology.orchestra.run.smithi049.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-03-16T07:24:09.907 DEBUG:teuthology.orchestra.run.smithi049:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-03-16T07:24:09.937 DEBUG:teuthology.orchestra.run.smithi049:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-03-16T07:24:10.039 INFO:teuthology.orchestra.run.smithi049.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-03-16T07:24:10.041 DEBUG:teuthology.orchestra.run.smithi049:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-03-16T07:24:10.072 DEBUG:teuthology.orchestra.run.smithi049:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-03-16T07:24:10.174 INFO:teuthology.orchestra.run.smithi049.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-03-16T07:24:10.176 DEBUG:teuthology.orchestra.run.smithi049:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-03-16T07:24:10.207 DEBUG:teuthology.orchestra.run.smithi049:> sudo mkdir -p /var/lib/ceph/mds/ceph-e && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.e /var/lib/ceph/mds/ceph-e/keyring 2024-03-16T07:24:10.309 INFO:teuthology.orchestra.run.smithi049.stdout:creating /var/lib/ceph/mds/ceph-e/keyring 2024-03-16T07:24:10.311 DEBUG:teuthology.orchestra.run.smithi049:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-e 2024-03-16T07:24:10.342 INFO:tasks.ceph_client:Setting up client nodes... 2024-03-16T07:24:10.342 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-03-16T07:24:10.428 INFO:teuthology.orchestra.run.smithi049.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-03-16T07:24:10.447 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-03-16T07:24:10.492 INFO:teuthology.orchestra.run.smithi049.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-03-16T07:24:10.511 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.mirror /etc/ceph/ceph.client.mirror.keyring && sudo chmod 0644 /etc/ceph/ceph.client.mirror.keyring 2024-03-16T07:24:10.556 INFO:teuthology.orchestra.run.smithi049.stdout:creating /etc/ceph/ceph.client.mirror.keyring 2024-03-16T07:24:10.575 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.mirror_remote /etc/ceph/ceph.client.mirror_remote.keyring && sudo chmod 0644 /etc/ceph/ceph.client.mirror_remote.keyring 2024-03-16T07:24:10.621 INFO:teuthology.orchestra.run.smithi049.stdout:creating /etc/ceph/ceph.client.mirror_remote.keyring 2024-03-16T07:24:10.640 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-03-16T07:24:10.640 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi049.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'}} 2024-03-16T07:24:10.640 DEBUG:teuthology.orchestra.run.smithi049:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-03-16T07:24:10.670 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2024-03-16T07:24:10.670 INFO:tasks.ceph:role: osd.0 2024-03-16T07:24:10.670 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi049.front.sepia.ceph.com 2024-03-16T07:24:10.671 DEBUG:teuthology.orchestra.run.smithi049:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-03-16T07:24:10.740 INFO:teuthology.orchestra.run.smithi049.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-03-16T07:24:10.740 INFO:teuthology.orchestra.run.smithi049.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-16T07:24:10.740 INFO:teuthology.orchestra.run.smithi049.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-16T07:24:10.740 INFO:teuthology.orchestra.run.smithi049.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-16T07:24:10.740 INFO:teuthology.orchestra.run.smithi049.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-16T07:24:10.740 INFO:teuthology.orchestra.run.smithi049.stdout: = sunit=0 swidth=0 blks 2024-03-16T07:24:10.740 INFO:teuthology.orchestra.run.smithi049.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-16T07:24:10.740 INFO:teuthology.orchestra.run.smithi049.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-16T07:24:10.740 INFO:teuthology.orchestra.run.smithi049.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-16T07:24:10.740 INFO:teuthology.orchestra.run.smithi049.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-16T07:24:10.773 INFO:teuthology.orchestra.run.smithi049.stdout:Discarding blocks...Done. 2024-03-16T07:24:10.775 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi049.front.sepia.ceph.com -o noatime 2024-03-16T07:24:10.775 DEBUG:teuthology.orchestra.run.smithi049:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-03-16T07:24:10.849 DEBUG:teuthology.orchestra.run.smithi049:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-03-16T07:24:10.925 DEBUG:teuthology.orchestra.run.smithi049:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-03-16T07:24:10.998 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2024-03-16T07:24:10.998 INFO:tasks.ceph:role: osd.1 2024-03-16T07:24:10.998 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi049.front.sepia.ceph.com 2024-03-16T07:24:10.998 DEBUG:teuthology.orchestra.run.smithi049:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-03-16T07:24:11.068 INFO:teuthology.orchestra.run.smithi049.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-03-16T07:24:11.068 INFO:teuthology.orchestra.run.smithi049.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-16T07:24:11.068 INFO:teuthology.orchestra.run.smithi049.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-16T07:24:11.068 INFO:teuthology.orchestra.run.smithi049.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-16T07:24:11.068 INFO:teuthology.orchestra.run.smithi049.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-16T07:24:11.068 INFO:teuthology.orchestra.run.smithi049.stdout: = sunit=0 swidth=0 blks 2024-03-16T07:24:11.068 INFO:teuthology.orchestra.run.smithi049.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-16T07:24:11.069 INFO:teuthology.orchestra.run.smithi049.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-16T07:24:11.069 INFO:teuthology.orchestra.run.smithi049.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-16T07:24:11.069 INFO:teuthology.orchestra.run.smithi049.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-16T07:24:11.101 INFO:teuthology.orchestra.run.smithi049.stdout:Discarding blocks...Done. 2024-03-16T07:24:11.103 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi049.front.sepia.ceph.com -o noatime 2024-03-16T07:24:11.103 DEBUG:teuthology.orchestra.run.smithi049:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-03-16T07:24:11.178 DEBUG:teuthology.orchestra.run.smithi049:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-03-16T07:24:11.253 DEBUG:teuthology.orchestra.run.smithi049:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-03-16T07:24:11.324 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2024-03-16T07:24:11.324 INFO:tasks.ceph:role: osd.2 2024-03-16T07:24:11.324 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi049.front.sepia.ceph.com 2024-03-16T07:24:11.324 DEBUG:teuthology.orchestra.run.smithi049:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-03-16T07:24:11.394 INFO:teuthology.orchestra.run.smithi049.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-03-16T07:24:11.394 INFO:teuthology.orchestra.run.smithi049.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-16T07:24:11.394 INFO:teuthology.orchestra.run.smithi049.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-16T07:24:11.395 INFO:teuthology.orchestra.run.smithi049.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-16T07:24:11.395 INFO:teuthology.orchestra.run.smithi049.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-16T07:24:11.395 INFO:teuthology.orchestra.run.smithi049.stdout: = sunit=0 swidth=0 blks 2024-03-16T07:24:11.395 INFO:teuthology.orchestra.run.smithi049.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-16T07:24:11.395 INFO:teuthology.orchestra.run.smithi049.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-16T07:24:11.395 INFO:teuthology.orchestra.run.smithi049.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-16T07:24:11.395 INFO:teuthology.orchestra.run.smithi049.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-16T07:24:11.427 INFO:teuthology.orchestra.run.smithi049.stdout:Discarding blocks...Done. 2024-03-16T07:24:11.428 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi049.front.sepia.ceph.com -o noatime 2024-03-16T07:24:11.429 DEBUG:teuthology.orchestra.run.smithi049:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-03-16T07:24:11.503 DEBUG:teuthology.orchestra.run.smithi049:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-03-16T07:24:11.577 DEBUG:teuthology.orchestra.run.smithi049:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-16T07:24:11.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-16T07:24:11.680+0000 7fdca040f640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-03-16T07:24:11.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-16T07:24:11.681+0000 7fdca040f640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-03-16T07:24:11.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-16T07:24:11.681+0000 7fdca040f640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-03-16T07:24:11.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-16T07:24:11.681+0000 7fdca040f640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-03-16T07:24:11.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-16T07:24:11.681+0000 7fdca040f640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-03-16T07:24:11.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-16T07:24:11.681+0000 7fdca040f640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-03-16T07:24:13.778 DEBUG:teuthology.orchestra.run.smithi049:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-03-16T07:24:13.814 DEBUG:teuthology.orchestra.run.smithi049:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-16T07:24:13.910 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-16T07:24:13.911+0000 7fef4f610640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-03-16T07:24:13.910 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-16T07:24:13.912+0000 7fef4f610640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-03-16T07:24:13.910 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-16T07:24:13.912+0000 7fef4f610640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-03-16T07:24:13.910 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-16T07:24:13.912+0000 7fef4f610640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-03-16T07:24:13.911 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-16T07:24:13.912+0000 7fef4f610640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-03-16T07:24:13.911 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-16T07:24:13.912+0000 7fef4f610640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-03-16T07:24:15.991 DEBUG:teuthology.orchestra.run.smithi049:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-03-16T07:24:16.027 DEBUG:teuthology.orchestra.run.smithi049:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-16T07:24:16.123 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-16T07:24:16.124+0000 7feacc70f640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-03-16T07:24:16.123 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-16T07:24:16.124+0000 7feacc70f640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-03-16T07:24:16.123 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-16T07:24:16.124+0000 7feacc70f640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-03-16T07:24:16.123 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-16T07:24:16.124+0000 7feacc70f640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-03-16T07:24:16.123 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-16T07:24:16.124+0000 7feacc70f640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-03-16T07:24:16.123 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-16T07:24:16.125+0000 7feacc70f640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-03-16T07:24:18.211 DEBUG:teuthology.orchestra.run.smithi049:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-03-16T07:24:18.246 INFO:tasks.ceph:Reading keys from all nodes... 2024-03-16T07:24:18.246 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-03-16T07:24:18.246 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-03-16T07:24:18.320 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-03-16T07:24:18.320 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-03-16T07:24:18.392 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-03-16T07:24:18.392 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-03-16T07:24:18.463 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-03-16T07:24:18.464 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-03-16T07:24:18.535 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-03-16T07:24:18.536 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-03-16T07:24:18.606 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-03-16T07:24:18.607 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/var/lib/ceph/mds/ceph-e/keyring of=/dev/stdout 2024-03-16T07:24:18.677 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-03-16T07:24:18.677 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-03-16T07:24:18.747 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-03-16T07:24:18.748 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-03-16T07:24:18.818 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-03-16T07:24:18.818 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-03-16T07:24:18.889 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-03-16T07:24:18.889 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-03-16T07:24:18.944 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-03-16T07:24:18.944 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-03-16T07:24:18.999 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-03-16T07:24:18.999 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/etc/ceph/ceph.client.mirror.keyring of=/dev/stdout 2024-03-16T07:24:19.054 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-03-16T07:24:19.054 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/etc/ceph/ceph.client.mirror_remote.keyring of=/dev/stdout 2024-03-16T07:24:19.109 INFO:tasks.ceph:Adding keys to all mons... 2024-03-16T07:24:19.109 DEBUG:teuthology.orchestra.run.smithi049:> sudo tee -a /etc/ceph/ceph.keyring 2024-03-16T07:24:19.178 INFO:teuthology.orchestra.run.smithi049.stdout:[mgr.x] 2024-03-16T07:24:19.178 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQAZSfVlX9BEKhAAftDfT7+IPsQFhrTPl2h0SQ== 2024-03-16T07:24:19.178 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.a] 2024-03-16T07:24:19.178 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQAZSfVlKDkWLhAAVo2ZJMZSwTGLhocUPcHaUw== 2024-03-16T07:24:19.178 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.b] 2024-03-16T07:24:19.178 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQAZSfVl53IaNhAATOLh8Lzad03tyKQph1oowQ== 2024-03-16T07:24:19.178 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.c] 2024-03-16T07:24:19.178 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQAaSfVlI3p/AhAAZEetRkGlMLMEI7hMN7pS5w== 2024-03-16T07:24:19.178 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.d] 2024-03-16T07:24:19.178 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQAaSfVl3ueIChAA640lcZj8yUgH9jq7r7B+bA== 2024-03-16T07:24:19.178 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.e] 2024-03-16T07:24:19.178 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQAaSfVl8OySEhAAyF3ScxdSuQ0jhZhRbJ2gEg== 2024-03-16T07:24:19.179 INFO:teuthology.orchestra.run.smithi049.stdout:[osd.0] 2024-03-16T07:24:19.179 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQAbSfVlNhmeKBAAVnxZbeNKU/kVViG2vb2+tQ== 2024-03-16T07:24:19.179 INFO:teuthology.orchestra.run.smithi049.stdout:[osd.1] 2024-03-16T07:24:19.179 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQAdSfVlNNNkNhAAKhYH9tWxFT8HH6ZLMnaK7A== 2024-03-16T07:24:19.179 INFO:teuthology.orchestra.run.smithi049.stdout:[osd.2] 2024-03-16T07:24:19.179 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQAgSfVlXJh1BxAAEOX+brDLOLTkp0thYQgMrw== 2024-03-16T07:24:19.179 INFO:teuthology.orchestra.run.smithi049.stdout:[client.0] 2024-03-16T07:24:19.179 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQAaSfVlmBmvGRAAaxdhkajaioVlq23dyv/g4g== 2024-03-16T07:24:19.179 INFO:teuthology.orchestra.run.smithi049.stdout:[client.1] 2024-03-16T07:24:19.179 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQAaSfVlCp2DHRAAdVsc+jh/QA74EBwffEqP5g== 2024-03-16T07:24:19.179 INFO:teuthology.orchestra.run.smithi049.stdout:[client.mirror] 2024-03-16T07:24:19.179 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQAaSfVldspUIRAAa1kAy23ZdMBfbhy+7HMVqA== 2024-03-16T07:24:19.179 INFO:teuthology.orchestra.run.smithi049.stdout:[client.mirror_remote] 2024-03-16T07:24:19.179 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQAaSfVlaygzJRAAJVP9XACdC2Wikb4ZtKci9g== 2024-03-16T07:24:19.180 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-03-16T07:24:19.277 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-16T07:24:19.337 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-16T07:24:19.396 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-16T07:24:19.456 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-16T07:24:19.514 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-16T07:24:19.573 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-16T07:24:19.629 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-16T07:24:19.685 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-16T07:24:19.741 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-16T07:24:19.799 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-16T07:24:19.860 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.mirror --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-16T07:24:19.919 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.mirror_remote --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-16T07:24:19.979 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-03-16T07:24:19.979 DEBUG:teuthology.orchestra.run.smithi049:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-03-16T07:24:20.009 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-03-16T07:24:20.112 DEBUG:teuthology.orchestra.run.smithi049:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-03-16T07:24:20.142 DEBUG:teuthology.orchestra.run.smithi049:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-03-16T07:24:20.198 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-03-16T07:24:20.198 INFO:tasks.ceph.mon.a:Restarting daemon 2024-03-16T07:24:20.198 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-03-16T07:24:20.240 INFO:tasks.ceph.mon.a:Started 2024-03-16T07:24:20.240 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-03-16T07:24:20.240 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-03-16T07:24:20.241 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-03-16T07:24:20.242 INFO:tasks.ceph.mgr.x:Started 2024-03-16T07:24:20.242 INFO:tasks.ceph:Setting crush tunables to default 2024-03-16T07:24:20.243 DEBUG:teuthology.orchestra.run.smithi049:> sudo ceph --cluster ceph osd crush tunables default 2024-03-16T07:24:20.437 INFO:teuthology.orchestra.run.smithi049.stderr:adjusted tunables profile to default 2024-03-16T07:24:20.447 INFO:tasks.ceph:check_enable_crimson: False 2024-03-16T07:24:20.448 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-03-16T07:24:20.448 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-03-16T07:24:20.448 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-03-16T07:24:20.478 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-03-16T07:24:20.478 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-03-16T07:24:20.549 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-03-16T07:24:20.549 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-03-16T07:24:20.620 DEBUG:teuthology.orchestra.run.smithi049:> sudo ceph --cluster ceph osd new 2df14aac-98dc-4e3c-ae7e-9eb677aa30be 0 2024-03-16T07:24:20.849 INFO:teuthology.orchestra.run.smithi049.stdout:0 2024-03-16T07:24:20.860 DEBUG:teuthology.orchestra.run.smithi049:> sudo ceph --cluster ceph osd new 80461bd9-59ef-46df-9eea-bad92d960c57 1 2024-03-16T07:24:21.030 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:24:21.032+0000 7fefcdc11040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-16T07:24:21.051 INFO:teuthology.orchestra.run.smithi049.stdout:1 2024-03-16T07:24:21.062 DEBUG:teuthology.orchestra.run.smithi049:> sudo ceph --cluster ceph osd new d6bf40eb-6e42-4ec9-8b3d-0b6c5a6def79 2 2024-03-16T07:24:21.087 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:24:21.089+0000 7fefcdc11040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-16T07:24:21.252 INFO:teuthology.orchestra.run.smithi049.stdout:2 2024-03-16T07:24:21.263 INFO:tasks.ceph.osd.0:Restarting daemon 2024-03-16T07:24:21.263 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-03-16T07:24:21.305 INFO:tasks.ceph.osd.0:Started 2024-03-16T07:24:21.306 INFO:tasks.ceph.osd.1:Restarting daemon 2024-03-16T07:24:21.306 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-03-16T07:24:21.308 INFO:tasks.ceph.osd.1:Started 2024-03-16T07:24:21.308 INFO:tasks.ceph.osd.2:Restarting daemon 2024-03-16T07:24:21.308 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-03-16T07:24:21.310 INFO:tasks.ceph.osd.2:Started 2024-03-16T07:24:21.310 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T07:24:21.498 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:24:21.498 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":5,"fsid":"f91af061-9eac-4793-87fa-8d27ae3d242f","created":"2024-03-16T07:24:20.357868+0000","modified":"2024-03-16T07:24:21.254179+0000","last_up_change":"0.000000","last_in_change":"2024-03-16T07:24:21.254179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"2df14aac-98dc-4e3c-ae7e-9eb677aa30be","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"80461bd9-59ef-46df-9eea-bad92d960c57","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"d6bf40eb-6e42-4ec9-8b3d-0b6c5a6def79","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T07:24:21.509 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-03-16T07:24:21.509 INFO:tasks.ceph:Waiting for OSDs to come up 2024-03-16T07:24:21.697 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:24:21.698+0000 7fefcdc11040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-16T07:24:21.754 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:24:21.755+0000 7fefcdc11040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-16T07:24:21.800 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:24:21.802+0000 7fefcdc11040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-16T07:24:21.810 DEBUG:teuthology.orchestra.run.smithi049:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-03-16T07:24:21.857 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:24:21.858+0000 7fefcdc11040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-16T07:24:21.902 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:24:21.904+0000 7fefcdc11040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-16T07:24:21.925 INFO:tasks.ceph.osd.0.smithi049.stderr:2024-03-16T07:24:21.926+0000 7f381df71640 -1 Falling back to public interface 2024-03-16T07:24:21.930 INFO:tasks.ceph.osd.2.smithi049.stderr:2024-03-16T07:24:21.931+0000 7f71f5f93640 -1 Falling back to public interface 2024-03-16T07:24:21.930 INFO:tasks.ceph.osd.1.smithi049.stderr:2024-03-16T07:24:21.932+0000 7fc115f85640 -1 Falling back to public interface 2024-03-16T07:24:21.977 INFO:teuthology.misc.health.smithi049.stdout: 2024-03-16T07:24:21.977 INFO:teuthology.misc.health.smithi049.stdout:{"epoch":5,"fsid":"f91af061-9eac-4793-87fa-8d27ae3d242f","created":"2024-03-16T07:24:20.357868+0000","modified":"2024-03-16T07:24:21.254179+0000","last_up_change":"0.000000","last_in_change":"2024-03-16T07:24:21.254179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"2df14aac-98dc-4e3c-ae7e-9eb677aa30be","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"80461bd9-59ef-46df-9eea-bad92d960c57","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"d6bf40eb-6e42-4ec9-8b3d-0b6c5a6def79","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T07:24:21.987 DEBUG:teuthology.misc:0 of 3 OSDs are up 2024-03-16T07:24:22.025 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:24:22.027+0000 7fefcdc11040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-16T07:24:22.098 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:24:22.100+0000 7fefcdc11040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-16T07:24:22.146 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:24:22.148+0000 7fefcdc11040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-16T07:24:22.202 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:24:22.204+0000 7fefcdc11040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-16T07:24:22.254 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:24:22.256+0000 7fefcdc11040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-16T07:24:22.650 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:24:22.651+0000 7fefcdc11040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-16T07:24:22.791 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:24:22.793+0000 7fefcdc11040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-16T07:24:22.903 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:24:22.905+0000 7fefcdc11040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-16T07:24:22.951 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:24:22.952+0000 7fefcdc11040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-16T07:24:23.068 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:24:23.069+0000 7fefcdc11040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-16T07:24:23.167 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:24:23.168+0000 7fefcdc11040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-16T07:24:23.328 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:24:23.330+0000 7fefcdc11040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-16T07:24:23.372 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:24:23.374+0000 7fefcdc11040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-16T07:24:23.535 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:24:23.537+0000 7fefcdc11040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-16T07:24:24.403 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:24:24.405+0000 7fefcdc11040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-16T07:24:24.643 INFO:tasks.ceph.osd.1.smithi049.stderr:2024-03-16T07:24:24.644+0000 7fc115f85640 -1 osd.1 0 log_to_monitors true 2024-03-16T07:24:24.643 INFO:tasks.ceph.osd.0.smithi049.stderr:2024-03-16T07:24:24.644+0000 7f381df71640 -1 osd.0 0 log_to_monitors true 2024-03-16T07:24:24.645 INFO:tasks.ceph.osd.2.smithi049.stderr:2024-03-16T07:24:24.647+0000 7f71f5f93640 -1 osd.2 0 log_to_monitors true 2024-03-16T07:24:24.704 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:24:24.705+0000 7fefcdc11040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-16T07:24:24.757 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:24:24.759+0000 7fefcdc11040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-16T07:24:24.877 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:24:24.879+0000 7fefcdc11040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-16T07:24:25.906 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:24:25.908+0000 7fef6e591640 -1 mgr.server handle_report got status from non-daemon mon.a 2024-03-16T07:24:26.468 INFO:tasks.ceph.osd.0.smithi049.stderr:2024-03-16T07:24:26.470+0000 7f3819f07640 -1 osd.0 0 waiting for initial osdmap 2024-03-16T07:24:26.469 INFO:tasks.ceph.osd.1.smithi049.stderr:2024-03-16T07:24:26.470+0000 7fc11272f640 -1 osd.1 0 waiting for initial osdmap 2024-03-16T07:24:26.483 INFO:tasks.ceph.osd.0.smithi049.stderr:2024-03-16T07:24:26.485+0000 7f3811d27640 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-16T07:24:26.483 INFO:tasks.ceph.osd.1.smithi049.stderr:2024-03-16T07:24:26.485+0000 7fc109d3b640 -1 osd.1 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-16T07:24:26.488 INFO:tasks.ceph.osd.2.smithi049.stderr:2024-03-16T07:24:26.489+0000 7f71f1f29640 -1 osd.2 0 waiting for initial osdmap 2024-03-16T07:24:26.503 INFO:tasks.ceph.osd.2.smithi049.stderr:2024-03-16T07:24:26.505+0000 7f71e9d49640 -1 osd.2 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-16T07:24:28.290 DEBUG:teuthology.orchestra.run.smithi049:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-03-16T07:24:28.588 INFO:teuthology.misc.health.smithi049.stdout: 2024-03-16T07:24:28.588 INFO:teuthology.misc.health.smithi049.stdout:{"epoch":9,"fsid":"f91af061-9eac-4793-87fa-8d27ae3d242f","created":"2024-03-16T07:24:20.357868+0000","modified":"2024-03-16T07:24:28.475660+0000","last_up_change":"2024-03-16T07:24:27.474980+0000","last_in_change":"2024-03-16T07:24:21.254179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"2df14aac-98dc-4e3c-ae7e-9eb677aa30be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6801","nonce":2744935777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6803","nonce":2744935777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6807","nonce":2744935777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6805","nonce":2744935777}]},"public_addr":"172.21.15.49:6801/2744935777","cluster_addr":"172.21.15.49:6803/2744935777","heartbeat_back_addr":"172.21.15.49:6807/2744935777","heartbeat_front_addr":"172.21.15.49:6805/2744935777","state":["exists","up"]},{"osd":1,"uuid":"80461bd9-59ef-46df-9eea-bad92d960c57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6811","nonce":1655120118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6815","nonce":1655120118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6821","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6823","nonce":1655120118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6817","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6819","nonce":1655120118}]},"public_addr":"172.21.15.49:6811/1655120118","cluster_addr":"172.21.15.49:6815/1655120118","heartbeat_back_addr":"172.21.15.49:6823/1655120118","heartbeat_front_addr":"172.21.15.49:6819/1655120118","state":["exists","up"]},{"osd":2,"uuid":"d6bf40eb-6e42-4ec9-8b3d-0b6c5a6def79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6810","nonce":3815472376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6814","nonce":3815472376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6822","nonce":3815472376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6818","nonce":3815472376}]},"public_addr":"172.21.15.49:6810/3815472376","cluster_addr":"172.21.15.49:6814/3815472376","heartbeat_back_addr":"172.21.15.49:6822/3815472376","heartbeat_front_addr":"172.21.15.49:6818/3815472376","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.641492+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.668598+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.614940+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T07:24:28.599 DEBUG:teuthology.misc:3 of 3 OSDs are up 2024-03-16T07:24:28.599 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-03-16T07:24:28.599 INFO:tasks.ceph.mds.a:Restarting daemon 2024-03-16T07:24:28.600 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-03-16T07:24:28.602 INFO:tasks.ceph.mds.a:Started 2024-03-16T07:24:28.602 INFO:tasks.ceph.mds.b:Restarting daemon 2024-03-16T07:24:28.602 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-03-16T07:24:28.604 INFO:tasks.ceph.mds.b:Started 2024-03-16T07:24:28.604 INFO:tasks.ceph.mds.c:Restarting daemon 2024-03-16T07:24:28.604 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-03-16T07:24:28.606 INFO:tasks.ceph.mds.c:Started 2024-03-16T07:24:28.606 INFO:tasks.ceph.mds.d:Restarting daemon 2024-03-16T07:24:28.606 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-03-16T07:24:28.608 INFO:tasks.ceph.mds.d:Started 2024-03-16T07:24:28.608 INFO:tasks.ceph.mds.e:Restarting daemon 2024-03-16T07:24:28.608 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i e 2024-03-16T07:24:28.610 INFO:tasks.ceph.mds.e:Started 2024-03-16T07:24:28.610 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-03-16T07:24:28.611 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T07:24:28.702 INFO:tasks.ceph.mds.b.smithi049.stdout:starting mds.b at 2024-03-16T07:24:28.711 INFO:tasks.ceph.mds.e.smithi049.stdout:starting mds.e at 2024-03-16T07:24:28.715 INFO:tasks.ceph.mds.c.smithi049.stdout:starting mds.c at 2024-03-16T07:24:28.716 INFO:tasks.ceph.mds.a.smithi049.stdout:starting mds.a at 2024-03-16T07:24:28.725 INFO:tasks.ceph.mds.d.smithi049.stdout:starting mds.d at 2024-03-16T07:24:28.945 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:24:28.945 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":9,"fsid":"f91af061-9eac-4793-87fa-8d27ae3d242f","created":"2024-03-16T07:24:20.357868+0000","modified":"2024-03-16T07:24:28.475660+0000","last_up_change":"2024-03-16T07:24:27.474980+0000","last_in_change":"2024-03-16T07:24:21.254179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"2df14aac-98dc-4e3c-ae7e-9eb677aa30be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6801","nonce":2744935777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6803","nonce":2744935777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6807","nonce":2744935777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6805","nonce":2744935777}]},"public_addr":"172.21.15.49:6801/2744935777","cluster_addr":"172.21.15.49:6803/2744935777","heartbeat_back_addr":"172.21.15.49:6807/2744935777","heartbeat_front_addr":"172.21.15.49:6805/2744935777","state":["exists","up"]},{"osd":1,"uuid":"80461bd9-59ef-46df-9eea-bad92d960c57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6811","nonce":1655120118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6815","nonce":1655120118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6821","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6823","nonce":1655120118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6817","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6819","nonce":1655120118}]},"public_addr":"172.21.15.49:6811/1655120118","cluster_addr":"172.21.15.49:6815/1655120118","heartbeat_back_addr":"172.21.15.49:6823/1655120118","heartbeat_front_addr":"172.21.15.49:6819/1655120118","state":["exists","up"]},{"osd":2,"uuid":"d6bf40eb-6e42-4ec9-8b3d-0b6c5a6def79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6810","nonce":3815472376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6814","nonce":3815472376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6822","nonce":3815472376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6818","nonce":3815472376}]},"public_addr":"172.21.15.49:6810/3815472376","cluster_addr":"172.21.15.49:6814/3815472376","heartbeat_back_addr":"172.21.15.49:6822/3815472376","heartbeat_front_addr":"172.21.15.49:6818/3815472376","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.641492+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.668598+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.614940+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T07:24:28.958 INFO:tasks.cephfs.filesystem.ceph_manager:[] 2024-03-16T07:24:28.958 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T07:24:29.298 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:24:29.298 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4144,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6829/2575941527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":2575941527},{"type":"v1","addr":"172.21.15.49:6829","nonce":2575941527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-03-16T07:24:29.298 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 2 2024-03-16T07:24:31.311 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T07:24:31.666 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:24:31.666 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4137,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6827/874710529","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":874710529},{"type":"v1","addr":"172.21.15.49:6827","nonce":874710529}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4144,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6829/2575941527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":2575941527},{"type":"v1","addr":"172.21.15.49:6829","nonce":2575941527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4145,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6832/3158244217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":3158244217},{"type":"v1","addr":"172.21.15.49:6832","nonce":3158244217}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4146,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6833/3138521926","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6831","nonce":3138521926},{"type":"v1","addr":"172.21.15.49:6833","nonce":3138521926}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4149,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/2474486057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":2474486057},{"type":"v1","addr":"172.21.15.49:6835","nonce":2474486057}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-03-16T07:24:31.666 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 3 2024-03-16T07:24:31.682 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T07:24:31.998 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:24:31.998 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":12,"fsid":"f91af061-9eac-4793-87fa-8d27ae3d242f","created":"2024-03-16T07:24:20.357868+0000","modified":"2024-03-16T07:24:31.725592+0000","last_up_change":"2024-03-16T07:24:27.474980+0000","last_in_change":"2024-03-16T07:24:21.254179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T07:24:28.947521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2df14aac-98dc-4e3c-ae7e-9eb677aa30be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6801","nonce":2744935777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6803","nonce":2744935777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6807","nonce":2744935777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6805","nonce":2744935777}]},"public_addr":"172.21.15.49:6801/2744935777","cluster_addr":"172.21.15.49:6803/2744935777","heartbeat_back_addr":"172.21.15.49:6807/2744935777","heartbeat_front_addr":"172.21.15.49:6805/2744935777","state":["exists","up"]},{"osd":1,"uuid":"80461bd9-59ef-46df-9eea-bad92d960c57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6811","nonce":1655120118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6815","nonce":1655120118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6821","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6823","nonce":1655120118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6817","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6819","nonce":1655120118}]},"public_addr":"172.21.15.49:6811/1655120118","cluster_addr":"172.21.15.49:6815/1655120118","heartbeat_back_addr":"172.21.15.49:6823/1655120118","heartbeat_front_addr":"172.21.15.49:6819/1655120118","state":["exists","up"]},{"osd":2,"uuid":"d6bf40eb-6e42-4ec9-8b3d-0b6c5a6def79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6810","nonce":3815472376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6814","nonce":3815472376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6822","nonce":3815472376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6818","nonce":3815472376}]},"public_addr":"172.21.15.49:6810/3815472376","cluster_addr":"172.21.15.49:6814/3815472376","heartbeat_back_addr":"172.21.15.49:6822/3815472376","heartbeat_front_addr":"172.21.15.49:6818/3815472376","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.641492+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.668598+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.614940+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T07:24:32.011 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-16T07:24:28.947521+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-16T07:24:32.011 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-16T07:24:32.327 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2024-03-16T07:24:32.343 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-03-16T07:24:32.645 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:24:32.645 INFO:teuthology.orchestra.run.smithi049.stdout:[ 2024-03-16T07:24:32.645 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:24:32.645 INFO:teuthology.orchestra.run.smithi049.stdout: "poolnum": 1, 2024-03-16T07:24:32.645 INFO:teuthology.orchestra.run.smithi049.stdout: "poolname": ".mgr" 2024-03-16T07:24:32.645 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:24:32.645 INFO:teuthology.orchestra.run.smithi049.stdout:] 2024-03-16T07:24:32.657 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-03-16T07:24:32.658 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-03-16T07:24:33.731 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_metadata' created 2024-03-16T07:24:33.753 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-03-16T07:24:34.735 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_data' created 2024-03-16T07:24:34.766 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-03-16T07:24:35.736 INFO:teuthology.orchestra.run.smithi049.stderr:new fs with metadata pool 2 and data pool 3 2024-03-16T07:24:35.784 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T07:24:36.087 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:24:36.087 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":15,"fsid":"f91af061-9eac-4793-87fa-8d27ae3d242f","created":"2024-03-16T07:24:20.357868+0000","modified":"2024-03-16T07:24:35.122984+0000","last_up_change":"2024-03-16T07:24:27.474980+0000","last_in_change":"2024-03-16T07:24:21.254179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T07:24:28.947521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-16T07:24:32.994128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-16T07:24:34.097577+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3600000143051147,"score_stable":1.3600000143051147,"optimal_score":1,"raw_score_acting":1.3600000143051147,"raw_score_stable":1.3600000143051147,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2df14aac-98dc-4e3c-ae7e-9eb677aa30be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6801","nonce":2744935777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6803","nonce":2744935777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6807","nonce":2744935777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6805","nonce":2744935777}]},"public_addr":"172.21.15.49:6801/2744935777","cluster_addr":"172.21.15.49:6803/2744935777","heartbeat_back_addr":"172.21.15.49:6807/2744935777","heartbeat_front_addr":"172.21.15.49:6805/2744935777","state":["exists","up"]},{"osd":1,"uuid":"80461bd9-59ef-46df-9eea-bad92d960c57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6811","nonce":1655120118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6815","nonce":1655120118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6821","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6823","nonce":1655120118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6817","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6819","nonce":1655120118}]},"public_addr":"172.21.15.49:6811/1655120118","cluster_addr":"172.21.15.49:6815/1655120118","heartbeat_back_addr":"172.21.15.49:6823/1655120118","heartbeat_front_addr":"172.21.15.49:6819/1655120118","state":["exists","up"]},{"osd":2,"uuid":"d6bf40eb-6e42-4ec9-8b3d-0b6c5a6def79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6810","nonce":3815472376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6814","nonce":3815472376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6822","nonce":3815472376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6818","nonce":3815472376}]},"public_addr":"172.21.15.49:6810/3815472376","cluster_addr":"172.21.15.49:6814/3815472376","heartbeat_back_addr":"172.21.15.49:6822/3815472376","heartbeat_front_addr":"172.21.15.49:6818/3815472376","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.641492+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.668598+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.614940+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T07:24:36.099 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T07:24:36.403 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:24:36.403 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":15,"fsid":"f91af061-9eac-4793-87fa-8d27ae3d242f","created":"2024-03-16T07:24:20.357868+0000","modified":"2024-03-16T07:24:35.122984+0000","last_up_change":"2024-03-16T07:24:27.474980+0000","last_in_change":"2024-03-16T07:24:21.254179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T07:24:28.947521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-16T07:24:32.994128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-16T07:24:34.097577+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3600000143051147,"score_stable":1.3600000143051147,"optimal_score":1,"raw_score_acting":1.3600000143051147,"raw_score_stable":1.3600000143051147,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2df14aac-98dc-4e3c-ae7e-9eb677aa30be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6801","nonce":2744935777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6803","nonce":2744935777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6807","nonce":2744935777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6805","nonce":2744935777}]},"public_addr":"172.21.15.49:6801/2744935777","cluster_addr":"172.21.15.49:6803/2744935777","heartbeat_back_addr":"172.21.15.49:6807/2744935777","heartbeat_front_addr":"172.21.15.49:6805/2744935777","state":["exists","up"]},{"osd":1,"uuid":"80461bd9-59ef-46df-9eea-bad92d960c57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6811","nonce":1655120118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6815","nonce":1655120118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6821","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6823","nonce":1655120118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6817","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6819","nonce":1655120118}]},"public_addr":"172.21.15.49:6811/1655120118","cluster_addr":"172.21.15.49:6815/1655120118","heartbeat_back_addr":"172.21.15.49:6823/1655120118","heartbeat_front_addr":"172.21.15.49:6819/1655120118","state":["exists","up"]},{"osd":2,"uuid":"d6bf40eb-6e42-4ec9-8b3d-0b6c5a6def79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6810","nonce":3815472376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6814","nonce":3815472376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6822","nonce":3815472376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6818","nonce":3815472376}]},"public_addr":"172.21.15.49:6810/3815472376","cluster_addr":"172.21.15.49:6814/3815472376","heartbeat_back_addr":"172.21.15.49:6822/3815472376","heartbeat_front_addr":"172.21.15.49:6818/3815472376","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.641492+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.668598+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.614940+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T07:24:36.415 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-03-16T07:24:37.771 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-03-16T07:24:37.772 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-03-16T07:24:37.946 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T07:24:38.769 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-03-16T07:24:38.769 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T07:24:39.108 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:24:39.108 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4137,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6827/874710529","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":874710529},{"type":"v1","addr":"172.21.15.49:6827","nonce":874710529}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4144,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6829/2575941527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":2575941527},{"type":"v1","addr":"172.21.15.49:6829","nonce":2575941527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4145,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6832/3158244217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":3158244217},{"type":"v1","addr":"172.21.15.49:6832","nonce":3158244217}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4146,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6833/3138521926","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6831","nonce":3138521926},{"type":"v1","addr":"172.21.15.49:6833","nonce":3138521926}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-16T07:24:35.123262+0000","modified":"2024-03-16T07:24:38.246781+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4149},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4149":{"gid":4149,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6835/2474486057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":2474486057},{"type":"v1","addr":"172.21.15.49:6835","nonce":2474486057}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4149,"qdb_cluster":[4149]},"id":1}]} 2024-03-16T07:24:39.109 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 8 2024-03-16T07:24:39.121 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T07:24:39.493 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:24:39.493 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":16,"fsid":"f91af061-9eac-4793-87fa-8d27ae3d242f","created":"2024-03-16T07:24:20.357868+0000","modified":"2024-03-16T07:24:36.750684+0000","last_up_change":"2024-03-16T07:24:27.474980+0000","last_in_change":"2024-03-16T07:24:21.254179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T07:24:28.947521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-16T07:24:32.994128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-16T07:24:34.097577+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3600000143051147,"score_stable":1.3600000143051147,"optimal_score":1,"raw_score_acting":1.3600000143051147,"raw_score_stable":1.3600000143051147,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2df14aac-98dc-4e3c-ae7e-9eb677aa30be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6801","nonce":2744935777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6803","nonce":2744935777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6807","nonce":2744935777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6805","nonce":2744935777}]},"public_addr":"172.21.15.49:6801/2744935777","cluster_addr":"172.21.15.49:6803/2744935777","heartbeat_back_addr":"172.21.15.49:6807/2744935777","heartbeat_front_addr":"172.21.15.49:6805/2744935777","state":["exists","up"]},{"osd":1,"uuid":"80461bd9-59ef-46df-9eea-bad92d960c57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6811","nonce":1655120118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6815","nonce":1655120118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6821","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6823","nonce":1655120118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6817","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6819","nonce":1655120118}]},"public_addr":"172.21.15.49:6811/1655120118","cluster_addr":"172.21.15.49:6815/1655120118","heartbeat_back_addr":"172.21.15.49:6823/1655120118","heartbeat_front_addr":"172.21.15.49:6819/1655120118","state":["exists","up"]},{"osd":2,"uuid":"d6bf40eb-6e42-4ec9-8b3d-0b6c5a6def79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6810","nonce":3815472376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6814","nonce":3815472376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6822","nonce":3815472376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6818","nonce":3815472376}]},"public_addr":"172.21.15.49:6810/3815472376","cluster_addr":"172.21.15.49:6814/3815472376","heartbeat_back_addr":"172.21.15.49:6822/3815472376","heartbeat_front_addr":"172.21.15.49:6818/3815472376","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.641492+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.668598+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.614940+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T07:24:39.506 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-03-16T07:24:39.506 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-16T07:24:39.726 INFO:tasks.ceph.mds.d.smithi049.stderr:2024-03-16T07:24:39.726+0000 7f75aac95640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-03-16T07:24:39.861 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:24:39.862 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2024-03-16T07:24:39.871 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":19,"stamp":"2024-03-16T07:24:38.898402+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":182,"num_write_kb":1908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":136,"ondisk_log_size":136,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":174,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":314572800,"kb_used":82692,"kb_used_data":1624,"kb_used_omap":4,"kb_used_meta":81019,"kb_avail":314490108,"statfs":{"total":322122547200,"available":322037870592,"internally_reserved":0,"allocated":1662976,"data_stored":1309836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":82963791},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.164224"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.756601+0000","last_change":"2024-03-16T07:24:35.778195+0000","last_active":"2024-03-16T07:24:36.756601+0000","last_peered":"2024-03-16T07:24:36.756601+0000","last_clean":"2024-03-16T07:24:36.756601+0000","last_became_active":"2024-03-16T07:24:35.777228+0000","last_became_peered":"2024-03-16T07:24:35.777228+0000","last_unstale":"2024-03-16T07:24:36.756601+0000","last_undegraded":"2024-03-16T07:24:36.756601+0000","last_fullsized":"2024-03-16T07:24:36.756601+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:06:55.141496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.850057+0000","last_change":"2024-03-16T07:24:35.782627+0000","last_active":"2024-03-16T07:24:36.850057+0000","last_peered":"2024-03-16T07:24:36.850057+0000","last_clean":"2024-03-16T07:24:36.850057+0000","last_became_active":"2024-03-16T07:24:35.782357+0000","last_became_peered":"2024-03-16T07:24:35.782357+0000","last_unstale":"2024-03-16T07:24:36.850057+0000","last_undegraded":"2024-03-16T07:24:36.850057+0000","last_fullsized":"2024-03-16T07:24:36.850057+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:28:16.855057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.756432+0000","last_change":"2024-03-16T07:24:35.763326+0000","last_active":"2024-03-16T07:24:36.756432+0000","last_peered":"2024-03-16T07:24:36.756432+0000","last_clean":"2024-03-16T07:24:36.756432+0000","last_became_active":"2024-03-16T07:24:35.763103+0000","last_became_peered":"2024-03-16T07:24:35.763103+0000","last_unstale":"2024-03-16T07:24:36.756432+0000","last_undegraded":"2024-03-16T07:24:36.756432+0000","last_fullsized":"2024-03-16T07:24:36.756432+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:27:51.581736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-03-16T07:24:35.766545+0000","last_change":"2024-03-16T07:24:35.762619+0000","last_active":"2024-03-16T07:24:35.766545+0000","last_peered":"2024-03-16T07:24:35.766545+0000","last_clean":"2024-03-16T07:24:35.766545+0000","last_became_active":"2024-03-16T07:24:35.761493+0000","last_became_peered":"2024-03-16T07:24:35.761493+0000","last_unstale":"2024-03-16T07:24:35.766545+0000","last_undegraded":"2024-03-16T07:24:35.766545+0000","last_fullsized":"2024-03-16T07:24:35.766545+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:50:22.463742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.755923+0000","last_change":"2024-03-16T07:24:35.767433+0000","last_active":"2024-03-16T07:24:36.755923+0000","last_peered":"2024-03-16T07:24:36.755923+0000","last_clean":"2024-03-16T07:24:36.755923+0000","last_became_active":"2024-03-16T07:24:35.764667+0000","last_became_peered":"2024-03-16T07:24:35.764667+0000","last_unstale":"2024-03-16T07:24:36.755923+0000","last_undegraded":"2024-03-16T07:24:36.755923+0000","last_fullsized":"2024-03-16T07:24:36.755923+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:18:18.873930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-03-16T07:24:35.766433+0000","last_change":"2024-03-16T07:24:35.762404+0000","last_active":"2024-03-16T07:24:35.766433+0000","last_peered":"2024-03-16T07:24:35.766433+0000","last_clean":"2024-03-16T07:24:35.766433+0000","last_became_active":"2024-03-16T07:24:35.760824+0000","last_became_peered":"2024-03-16T07:24:35.760824+0000","last_unstale":"2024-03-16T07:24:35.766433+0000","last_undegraded":"2024-03-16T07:24:35.766433+0000","last_fullsized":"2024-03-16T07:24:35.766433+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:03:07.826660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.756044+0000","last_change":"2024-03-16T07:24:35.775068+0000","last_active":"2024-03-16T07:24:36.756044+0000","last_peered":"2024-03-16T07:24:36.756044+0000","last_clean":"2024-03-16T07:24:36.756044+0000","last_became_active":"2024-03-16T07:24:35.774830+0000","last_became_peered":"2024-03-16T07:24:35.774830+0000","last_unstale":"2024-03-16T07:24:36.756044+0000","last_undegraded":"2024-03-16T07:24:36.756044+0000","last_fullsized":"2024-03-16T07:24:36.756044+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:55:12.697679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-03-16T07:24:35.766691+0000","last_change":"2024-03-16T07:24:35.763436+0000","last_active":"2024-03-16T07:24:35.766691+0000","last_peered":"2024-03-16T07:24:35.766691+0000","last_clean":"2024-03-16T07:24:35.766691+0000","last_became_active":"2024-03-16T07:24:35.763190+0000","last_became_peered":"2024-03-16T07:24:35.763190+0000","last_unstale":"2024-03-16T07:24:35.766691+0000","last_undegraded":"2024-03-16T07:24:35.766691+0000","last_fullsized":"2024-03-16T07:24:35.766691+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:49:05.751767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.850174+0000","last_change":"2024-03-16T07:24:35.783289+0000","last_active":"2024-03-16T07:24:36.850174+0000","last_peered":"2024-03-16T07:24:36.850174+0000","last_clean":"2024-03-16T07:24:36.850174+0000","last_became_active":"2024-03-16T07:24:35.782803+0000","last_became_peered":"2024-03-16T07:24:35.782803+0000","last_unstale":"2024-03-16T07:24:36.850174+0000","last_undegraded":"2024-03-16T07:24:36.850174+0000","last_fullsized":"2024-03-16T07:24:36.850174+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:14:25.797393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.756381+0000","last_change":"2024-03-16T07:24:35.767189+0000","last_active":"2024-03-16T07:24:36.756381+0000","last_peered":"2024-03-16T07:24:36.756381+0000","last_clean":"2024-03-16T07:24:36.756381+0000","last_became_active":"2024-03-16T07:24:35.766948+0000","last_became_peered":"2024-03-16T07:24:35.766948+0000","last_unstale":"2024-03-16T07:24:36.756381+0000","last_undegraded":"2024-03-16T07:24:36.756381+0000","last_fullsized":"2024-03-16T07:24:36.756381+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:39:05.051025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.755497+0000","last_change":"2024-03-16T07:24:35.778348+0000","last_active":"2024-03-16T07:24:36.755497+0000","last_peered":"2024-03-16T07:24:36.755497+0000","last_clean":"2024-03-16T07:24:36.755497+0000","last_became_active":"2024-03-16T07:24:35.777733+0000","last_became_peered":"2024-03-16T07:24:35.777733+0000","last_unstale":"2024-03-16T07:24:36.755497+0000","last_undegraded":"2024-03-16T07:24:36.755497+0000","last_fullsized":"2024-03-16T07:24:36.755497+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:00:23.312298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.756312+0000","last_change":"2024-03-16T07:24:35.776673+0000","last_active":"2024-03-16T07:24:36.756312+0000","last_peered":"2024-03-16T07:24:36.756312+0000","last_clean":"2024-03-16T07:24:36.756312+0000","last_became_active":"2024-03-16T07:24:35.776273+0000","last_became_peered":"2024-03-16T07:24:35.776273+0000","last_unstale":"2024-03-16T07:24:36.756312+0000","last_undegraded":"2024-03-16T07:24:36.756312+0000","last_fullsized":"2024-03-16T07:24:36.756312+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:21:36.876625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.756012+0000","last_change":"2024-03-16T07:24:35.776794+0000","last_active":"2024-03-16T07:24:36.756012+0000","last_peered":"2024-03-16T07:24:36.756012+0000","last_clean":"2024-03-16T07:24:36.756012+0000","last_became_active":"2024-03-16T07:24:35.775472+0000","last_became_peered":"2024-03-16T07:24:35.775472+0000","last_unstale":"2024-03-16T07:24:36.756012+0000","last_undegraded":"2024-03-16T07:24:36.756012+0000","last_fullsized":"2024-03-16T07:24:36.756012+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:47:00.624947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.755298+0000","last_change":"2024-03-16T07:24:35.777171+0000","last_active":"2024-03-16T07:24:36.755298+0000","last_peered":"2024-03-16T07:24:36.755298+0000","last_clean":"2024-03-16T07:24:36.755298+0000","last_became_active":"2024-03-16T07:24:35.776959+0000","last_became_peered":"2024-03-16T07:24:35.776959+0000","last_unstale":"2024-03-16T07:24:36.755298+0000","last_undegraded":"2024-03-16T07:24:36.755298+0000","last_fullsized":"2024-03-16T07:24:36.755298+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:15:02.699193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.848996+0000","last_change":"2024-03-16T07:24:35.779625+0000","last_active":"2024-03-16T07:24:36.848996+0000","last_peered":"2024-03-16T07:24:36.848996+0000","last_clean":"2024-03-16T07:24:36.848996+0000","last_became_active":"2024-03-16T07:24:35.779369+0000","last_became_peered":"2024-03-16T07:24:35.779369+0000","last_unstale":"2024-03-16T07:24:36.848996+0000","last_undegraded":"2024-03-16T07:24:36.848996+0000","last_fullsized":"2024-03-16T07:24:36.848996+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:31:08.610234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-03-16T07:24:35.772559+0000","last_change":"2024-03-16T07:24:35.771934+0000","last_active":"2024-03-16T07:24:35.772559+0000","last_peered":"2024-03-16T07:24:35.772559+0000","last_clean":"2024-03-16T07:24:35.772559+0000","last_became_active":"2024-03-16T07:24:35.771550+0000","last_became_peered":"2024-03-16T07:24:35.771550+0000","last_unstale":"2024-03-16T07:24:35.772559+0000","last_undegraded":"2024-03-16T07:24:35.772559+0000","last_fullsized":"2024-03-16T07:24:35.772559+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:10:34.983006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.850325+0000","last_change":"2024-03-16T07:24:35.778996+0000","last_active":"2024-03-16T07:24:36.850325+0000","last_peered":"2024-03-16T07:24:36.850325+0000","last_clean":"2024-03-16T07:24:36.850325+0000","last_became_active":"2024-03-16T07:24:35.778760+0000","last_became_peered":"2024-03-16T07:24:35.778760+0000","last_unstale":"2024-03-16T07:24:36.850325+0000","last_undegraded":"2024-03-16T07:24:36.850325+0000","last_fullsized":"2024-03-16T07:24:36.850325+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:15:02.699193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-03-16T07:24:35.772231+0000","last_change":"2024-03-16T07:24:35.770074+0000","last_active":"2024-03-16T07:24:35.772231+0000","last_peered":"2024-03-16T07:24:35.772231+0000","last_clean":"2024-03-16T07:24:35.772231+0000","last_became_active":"2024-03-16T07:24:35.769797+0000","last_became_peered":"2024-03-16T07:24:35.769797+0000","last_unstale":"2024-03-16T07:24:35.772231+0000","last_undegraded":"2024-03-16T07:24:35.772231+0000","last_fullsized":"2024-03-16T07:24:35.772231+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:21:06.519040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.756228+0000","last_change":"2024-03-16T07:24:35.755806+0000","last_active":"2024-03-16T07:24:36.756228+0000","last_peered":"2024-03-16T07:24:36.756228+0000","last_clean":"2024-03-16T07:24:36.756228+0000","last_became_active":"2024-03-16T07:24:35.755548+0000","last_became_peered":"2024-03-16T07:24:35.755548+0000","last_unstale":"2024-03-16T07:24:36.756228+0000","last_undegraded":"2024-03-16T07:24:36.756228+0000","last_fullsized":"2024-03-16T07:24:36.756228+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:58:56.672206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.756631+0000","last_change":"2024-03-16T07:24:35.776892+0000","last_active":"2024-03-16T07:24:36.756631+0000","last_peered":"2024-03-16T07:24:36.756631+0000","last_clean":"2024-03-16T07:24:36.756631+0000","last_became_active":"2024-03-16T07:24:35.776396+0000","last_became_peered":"2024-03-16T07:24:35.776396+0000","last_unstale":"2024-03-16T07:24:36.756631+0000","last_undegraded":"2024-03-16T07:24:36.756631+0000","last_fullsized":"2024-03-16T07:24:36.756631+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:20:25.574088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.755333+0000","last_change":"2024-03-16T07:24:35.766783+0000","last_active":"2024-03-16T07:24:36.755333+0000","last_peered":"2024-03-16T07:24:36.755333+0000","last_clean":"2024-03-16T07:24:36.755333+0000","last_became_active":"2024-03-16T07:24:35.764320+0000","last_became_peered":"2024-03-16T07:24:35.764320+0000","last_unstale":"2024-03-16T07:24:36.755333+0000","last_undegraded":"2024-03-16T07:24:36.755333+0000","last_fullsized":"2024-03-16T07:24:36.755333+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:52:47.872518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.849137+0000","last_change":"2024-03-16T07:24:35.781061+0000","last_active":"2024-03-16T07:24:36.849137+0000","last_peered":"2024-03-16T07:24:36.849137+0000","last_clean":"2024-03-16T07:24:36.849137+0000","last_became_active":"2024-03-16T07:24:35.780821+0000","last_became_peered":"2024-03-16T07:24:35.780821+0000","last_unstale":"2024-03-16T07:24:36.849137+0000","last_undegraded":"2024-03-16T07:24:36.849137+0000","last_fullsized":"2024-03-16T07:24:36.849137+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:13:21.265017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.754999+0000","last_change":"2024-03-16T07:24:35.763299+0000","last_active":"2024-03-16T07:24:36.754999+0000","last_peered":"2024-03-16T07:24:36.754999+0000","last_clean":"2024-03-16T07:24:36.754999+0000","last_became_active":"2024-03-16T07:24:35.760540+0000","last_became_peered":"2024-03-16T07:24:35.760540+0000","last_unstale":"2024-03-16T07:24:36.754999+0000","last_undegraded":"2024-03-16T07:24:36.754999+0000","last_fullsized":"2024-03-16T07:24:36.754999+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:28:16.855057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.755114+0000","last_change":"2024-03-16T07:24:35.768963+0000","last_active":"2024-03-16T07:24:36.755114+0000","last_peered":"2024-03-16T07:24:36.755114+0000","last_clean":"2024-03-16T07:24:36.755114+0000","last_became_active":"2024-03-16T07:24:35.768551+0000","last_became_peered":"2024-03-16T07:24:35.768551+0000","last_unstale":"2024-03-16T07:24:36.755114+0000","last_undegraded":"2024-03-16T07:24:36.755114+0000","last_fullsized":"2024-03-16T07:24:36.755114+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:14:25.797393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-03-16T07:24:35.762666+0000","last_change":"2024-03-16T07:24:35.758470+0000","last_active":"2024-03-16T07:24:35.762666+0000","last_peered":"2024-03-16T07:24:35.762666+0000","last_clean":"2024-03-16T07:24:35.762666+0000","last_became_active":"2024-03-16T07:24:35.757833+0000","last_became_peered":"2024-03-16T07:24:35.757833+0000","last_unstale":"2024-03-16T07:24:35.762666+0000","last_undegraded":"2024-03-16T07:24:35.762666+0000","last_fullsized":"2024-03-16T07:24:35.762666+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:09:13.537986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-03-16T07:24:35.772252+0000","last_change":"2024-03-16T07:24:35.770744+0000","last_active":"2024-03-16T07:24:35.772252+0000","last_peered":"2024-03-16T07:24:35.772252+0000","last_clean":"2024-03-16T07:24:35.772252+0000","last_became_active":"2024-03-16T07:24:35.770319+0000","last_became_peered":"2024-03-16T07:24:35.770319+0000","last_unstale":"2024-03-16T07:24:35.772252+0000","last_undegraded":"2024-03-16T07:24:35.772252+0000","last_fullsized":"2024-03-16T07:24:35.772252+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:56:19.429648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.849752+0000","last_change":"2024-03-16T07:24:35.761508+0000","last_active":"2024-03-16T07:24:36.849752+0000","last_peered":"2024-03-16T07:24:36.849752+0000","last_clean":"2024-03-16T07:24:36.849752+0000","last_became_active":"2024-03-16T07:24:35.761166+0000","last_became_peered":"2024-03-16T07:24:35.761166+0000","last_unstale":"2024-03-16T07:24:36.849752+0000","last_undegraded":"2024-03-16T07:24:36.849752+0000","last_fullsized":"2024-03-16T07:24:36.849752+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:25:46.129511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.756457+0000","last_change":"2024-03-16T07:24:35.766187+0000","last_active":"2024-03-16T07:24:36.756457+0000","last_peered":"2024-03-16T07:24:36.756457+0000","last_clean":"2024-03-16T07:24:36.756457+0000","last_became_active":"2024-03-16T07:24:35.765816+0000","last_became_peered":"2024-03-16T07:24:35.765816+0000","last_unstale":"2024-03-16T07:24:36.756457+0000","last_undegraded":"2024-03-16T07:24:36.756457+0000","last_fullsized":"2024-03-16T07:24:36.756457+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:35:01.521441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.755518+0000","last_change":"2024-03-16T07:24:35.767649+0000","last_active":"2024-03-16T07:24:36.755518+0000","last_peered":"2024-03-16T07:24:36.755518+0000","last_clean":"2024-03-16T07:24:36.755518+0000","last_became_active":"2024-03-16T07:24:35.766516+0000","last_became_peered":"2024-03-16T07:24:35.766516+0000","last_unstale":"2024-03-16T07:24:36.755518+0000","last_undegraded":"2024-03-16T07:24:36.755518+0000","last_fullsized":"2024-03-16T07:24:36.755518+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:59:52.437341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.755379+0000","last_change":"2024-03-16T07:24:35.764368+0000","last_active":"2024-03-16T07:24:36.755379+0000","last_peered":"2024-03-16T07:24:36.755379+0000","last_clean":"2024-03-16T07:24:36.755379+0000","last_became_active":"2024-03-16T07:24:35.764090+0000","last_became_peered":"2024-03-16T07:24:35.764090+0000","last_unstale":"2024-03-16T07:24:36.755379+0000","last_undegraded":"2024-03-16T07:24:36.755379+0000","last_fullsized":"2024-03-16T07:24:36.755379+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:03:51.527543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-03-16T07:24:35.766579+0000","last_change":"2024-03-16T07:24:35.762614+0000","last_active":"2024-03-16T07:24:35.766579+0000","last_peered":"2024-03-16T07:24:35.766579+0000","last_clean":"2024-03-16T07:24:35.766579+0000","last_became_active":"2024-03-16T07:24:35.759299+0000","last_became_peered":"2024-03-16T07:24:35.759299+0000","last_unstale":"2024-03-16T07:24:35.766579+0000","last_undegraded":"2024-03-16T07:24:35.766579+0000","last_fullsized":"2024-03-16T07:24:35.766579+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:13:14.402188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-03-16T07:24:35.774060+0000","last_change":"2024-03-16T07:24:35.772411+0000","last_active":"2024-03-16T07:24:35.774060+0000","last_peered":"2024-03-16T07:24:35.774060+0000","last_clean":"2024-03-16T07:24:35.774060+0000","last_became_active":"2024-03-16T07:24:35.771681+0000","last_became_peered":"2024-03-16T07:24:35.771681+0000","last_unstale":"2024-03-16T07:24:35.774060+0000","last_undegraded":"2024-03-16T07:24:35.774060+0000","last_fullsized":"2024-03-16T07:24:35.774060+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:34:12.369966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.849198+0000","last_change":"2024-03-16T07:24:35.762199+0000","last_active":"2024-03-16T07:24:36.849198+0000","last_peered":"2024-03-16T07:24:36.849198+0000","last_clean":"2024-03-16T07:24:36.849198+0000","last_became_active":"2024-03-16T07:24:35.761593+0000","last_became_peered":"2024-03-16T07:24:35.761593+0000","last_unstale":"2024-03-16T07:24:36.849198+0000","last_undegraded":"2024-03-16T07:24:36.849198+0000","last_fullsized":"2024-03-16T07:24:36.849198+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:37:59.379102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"15'1","reported_seq":15,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.849354+0000","last_change":"2024-03-16T07:24:34.766133+0000","last_active":"2024-03-16T07:24:36.849354+0000","last_peered":"2024-03-16T07:24:36.849354+0000","last_clean":"2024-03-16T07:24:36.849354+0000","last_became_active":"2024-03-16T07:24:34.765818+0000","last_became_peered":"2024-03-16T07:24:34.765818+0000","last_unstale":"2024-03-16T07:24:36.849354+0000","last_undegraded":"2024-03-16T07:24:36.849354+0000","last_fullsized":"2024-03-16T07:24:36.849354+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_clean_scrub_stamp":"2024-03-16T07:24:33.730276+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:56:51.770184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.755679+0000","last_change":"2024-03-16T07:24:35.775697+0000","last_active":"2024-03-16T07:24:36.755679+0000","last_peered":"2024-03-16T07:24:36.755679+0000","last_clean":"2024-03-16T07:24:36.755679+0000","last_became_active":"2024-03-16T07:24:35.775430+0000","last_became_peered":"2024-03-16T07:24:35.775430+0000","last_unstale":"2024-03-16T07:24:36.755679+0000","last_undegraded":"2024-03-16T07:24:36.755679+0000","last_fullsized":"2024-03-16T07:24:36.755679+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:10:53.245012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"15'1","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-03-16T07:24:35.771349+0000","last_change":"2024-03-16T07:24:34.762997+0000","last_active":"2024-03-16T07:24:35.771349+0000","last_peered":"2024-03-16T07:24:35.771349+0000","last_clean":"2024-03-16T07:24:35.771349+0000","last_became_active":"2024-03-16T07:24:34.762707+0000","last_became_peered":"2024-03-16T07:24:34.762707+0000","last_unstale":"2024-03-16T07:24:35.771349+0000","last_undegraded":"2024-03-16T07:24:35.771349+0000","last_fullsized":"2024-03-16T07:24:35.771349+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_clean_scrub_stamp":"2024-03-16T07:24:33.730276+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:20:10.353781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.755881+0000","last_change":"2024-03-16T07:24:34.756141+0000","last_active":"2024-03-16T07:24:36.755881+0000","last_peered":"2024-03-16T07:24:36.755881+0000","last_clean":"2024-03-16T07:24:36.755881+0000","last_became_active":"2024-03-16T07:24:34.755881+0000","last_became_peered":"2024-03-16T07:24:34.755881+0000","last_unstale":"2024-03-16T07:24:36.755881+0000","last_undegraded":"2024-03-16T07:24:36.755881+0000","last_fullsized":"2024-03-16T07:24:36.755881+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_clean_scrub_stamp":"2024-03-16T07:24:33.730276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:29:27.907682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-03-16T07:24:35.773471+0000","last_change":"2024-03-16T07:24:35.772150+0000","last_active":"2024-03-16T07:24:35.773471+0000","last_peered":"2024-03-16T07:24:35.773471+0000","last_clean":"2024-03-16T07:24:35.773471+0000","last_became_active":"2024-03-16T07:24:35.771896+0000","last_became_peered":"2024-03-16T07:24:35.771896+0000","last_unstale":"2024-03-16T07:24:35.773471+0000","last_undegraded":"2024-03-16T07:24:35.773471+0000","last_fullsized":"2024-03-16T07:24:35.773471+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:54:14.723121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.755045+0000","last_change":"2024-03-16T07:24:34.769281+0000","last_active":"2024-03-16T07:24:36.755045+0000","last_peered":"2024-03-16T07:24:36.755045+0000","last_clean":"2024-03-16T07:24:36.755045+0000","last_became_active":"2024-03-16T07:24:34.769017+0000","last_became_peered":"2024-03-16T07:24:34.769017+0000","last_unstale":"2024-03-16T07:24:36.755045+0000","last_undegraded":"2024-03-16T07:24:36.755045+0000","last_fullsized":"2024-03-16T07:24:36.755045+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_clean_scrub_stamp":"2024-03-16T07:24:33.730276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:56:51.770184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.848978+0000","last_change":"2024-03-16T07:24:35.762407+0000","last_active":"2024-03-16T07:24:36.848978+0000","last_peered":"2024-03-16T07:24:36.848978+0000","last_clean":"2024-03-16T07:24:36.848978+0000","last_became_active":"2024-03-16T07:24:35.762037+0000","last_became_peered":"2024-03-16T07:24:35.762037+0000","last_unstale":"2024-03-16T07:24:36.848978+0000","last_undegraded":"2024-03-16T07:24:36.848978+0000","last_fullsized":"2024-03-16T07:24:36.848978+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:42:22.755597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.850223+0000","last_change":"2024-03-16T07:24:34.754520+0000","last_active":"2024-03-16T07:24:36.850223+0000","last_peered":"2024-03-16T07:24:36.850223+0000","last_clean":"2024-03-16T07:24:36.850223+0000","last_became_active":"2024-03-16T07:24:34.754209+0000","last_became_peered":"2024-03-16T07:24:34.754209+0000","last_unstale":"2024-03-16T07:24:36.850223+0000","last_undegraded":"2024-03-16T07:24:36.850223+0000","last_fullsized":"2024-03-16T07:24:36.850223+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_clean_scrub_stamp":"2024-03-16T07:24:33.730276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:09:12.533977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-03-16T07:24:35.767824+0000","last_change":"2024-03-16T07:24:35.764475+0000","last_active":"2024-03-16T07:24:35.767824+0000","last_peered":"2024-03-16T07:24:35.767824+0000","last_clean":"2024-03-16T07:24:35.767824+0000","last_became_active":"2024-03-16T07:24:35.764205+0000","last_became_peered":"2024-03-16T07:24:35.764205+0000","last_unstale":"2024-03-16T07:24:35.767824+0000","last_undegraded":"2024-03-16T07:24:35.767824+0000","last_fullsized":"2024-03-16T07:24:35.767824+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:09:24.472433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.756351+0000","last_change":"2024-03-16T07:24:34.770637+0000","last_active":"2024-03-16T07:24:36.756351+0000","last_peered":"2024-03-16T07:24:36.756351+0000","last_clean":"2024-03-16T07:24:36.756351+0000","last_became_active":"2024-03-16T07:24:34.770366+0000","last_became_peered":"2024-03-16T07:24:34.770366+0000","last_unstale":"2024-03-16T07:24:36.756351+0000","last_undegraded":"2024-03-16T07:24:36.756351+0000","last_fullsized":"2024-03-16T07:24:36.756351+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_clean_scrub_stamp":"2024-03-16T07:24:33.730276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:01:11.366672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.756755+0000","last_change":"2024-03-16T07:24:35.779355+0000","last_active":"2024-03-16T07:24:36.756755+0000","last_peered":"2024-03-16T07:24:36.756755+0000","last_clean":"2024-03-16T07:24:36.756755+0000","last_became_active":"2024-03-16T07:24:35.777923+0000","last_became_peered":"2024-03-16T07:24:35.777923+0000","last_unstale":"2024-03-16T07:24:36.756755+0000","last_undegraded":"2024-03-16T07:24:36.756755+0000","last_fullsized":"2024-03-16T07:24:36.756755+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:30:37.504916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"15'3","reported_seq":17,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.849963+0000","last_change":"2024-03-16T07:24:34.765980+0000","last_active":"2024-03-16T07:24:36.849963+0000","last_peered":"2024-03-16T07:24:36.849963+0000","last_clean":"2024-03-16T07:24:36.849963+0000","last_became_active":"2024-03-16T07:24:34.765733+0000","last_became_peered":"2024-03-16T07:24:34.765733+0000","last_unstale":"2024-03-16T07:24:36.849963+0000","last_undegraded":"2024-03-16T07:24:36.849963+0000","last_fullsized":"2024-03-16T07:24:36.849963+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_clean_scrub_stamp":"2024-03-16T07:24:33.730276+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:14:50.759285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.849454+0000","last_change":"2024-03-16T07:24:35.764253+0000","last_active":"2024-03-16T07:24:36.849454+0000","last_peered":"2024-03-16T07:24:36.849454+0000","last_clean":"2024-03-16T07:24:36.849454+0000","last_became_active":"2024-03-16T07:24:35.763793+0000","last_became_peered":"2024-03-16T07:24:35.763793+0000","last_unstale":"2024-03-16T07:24:36.849454+0000","last_undegraded":"2024-03-16T07:24:36.849454+0000","last_fullsized":"2024-03-16T07:24:36.849454+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:56:18.247956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"15'6","reported_seq":18,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-03-16T07:24:35.784980+0000","last_change":"2024-03-16T07:24:34.758585+0000","last_active":"2024-03-16T07:24:35.784980+0000","last_peered":"2024-03-16T07:24:35.784980+0000","last_clean":"2024-03-16T07:24:35.784980+0000","last_became_active":"2024-03-16T07:24:34.758296+0000","last_became_peered":"2024-03-16T07:24:34.758296+0000","last_unstale":"2024-03-16T07:24:35.784980+0000","last_undegraded":"2024-03-16T07:24:35.784980+0000","last_fullsized":"2024-03-16T07:24:35.784980+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_clean_scrub_stamp":"2024-03-16T07:24:33.730276+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:50:46.274106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.755819+0000","last_change":"2024-03-16T07:24:35.777232+0000","last_active":"2024-03-16T07:24:36.755819+0000","last_peered":"2024-03-16T07:24:36.755819+0000","last_clean":"2024-03-16T07:24:36.755819+0000","last_became_active":"2024-03-16T07:24:35.776810+0000","last_became_peered":"2024-03-16T07:24:35.776810+0000","last_unstale":"2024-03-16T07:24:36.755819+0000","last_undegraded":"2024-03-16T07:24:36.755819+0000","last_fullsized":"2024-03-16T07:24:36.755819+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:20:30.880693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"15'2","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.755871+0000","last_change":"2024-03-16T07:24:34.759219+0000","last_active":"2024-03-16T07:24:36.755871+0000","last_peered":"2024-03-16T07:24:36.755871+0000","last_clean":"2024-03-16T07:24:36.755871+0000","last_became_active":"2024-03-16T07:24:34.758368+0000","last_became_peered":"2024-03-16T07:24:34.758368+0000","last_unstale":"2024-03-16T07:24:36.755871+0000","last_undegraded":"2024-03-16T07:24:36.755871+0000","last_fullsized":"2024-03-16T07:24:36.755871+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_clean_scrub_stamp":"2024-03-16T07:24:33.730276+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:01:34.459245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.755815+0000","last_change":"2024-03-16T07:24:35.776831+0000","last_active":"2024-03-16T07:24:36.755815+0000","last_peered":"2024-03-16T07:24:36.755815+0000","last_clean":"2024-03-16T07:24:36.755815+0000","last_became_active":"2024-03-16T07:24:35.776251+0000","last_became_peered":"2024-03-16T07:24:35.776251+0000","last_unstale":"2024-03-16T07:24:36.755815+0000","last_undegraded":"2024-03-16T07:24:36.755815+0000","last_fullsized":"2024-03-16T07:24:36.755815+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:01:17.121539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-03-16T07:24:35.752583+0000","last_change":"2024-03-16T07:24:34.758214+0000","last_active":"2024-03-16T07:24:35.752583+0000","last_peered":"2024-03-16T07:24:35.752583+0000","last_clean":"2024-03-16T07:24:35.752583+0000","last_became_active":"2024-03-16T07:24:34.757941+0000","last_became_peered":"2024-03-16T07:24:34.757941+0000","last_unstale":"2024-03-16T07:24:35.752583+0000","last_undegraded":"2024-03-16T07:24:35.752583+0000","last_fullsized":"2024-03-16T07:24:35.752583+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_clean_scrub_stamp":"2024-03-16T07:24:33.730276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:01:11.366672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.849240+0000","last_change":"2024-03-16T07:24:35.780117+0000","last_active":"2024-03-16T07:24:36.849240+0000","last_peered":"2024-03-16T07:24:36.849240+0000","last_clean":"2024-03-16T07:24:36.849240+0000","last_became_active":"2024-03-16T07:24:35.779858+0000","last_became_peered":"2024-03-16T07:24:35.779858+0000","last_unstale":"2024-03-16T07:24:36.849240+0000","last_undegraded":"2024-03-16T07:24:36.849240+0000","last_fullsized":"2024-03-16T07:24:36.849240+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:07:46.246610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.756171+0000","last_change":"2024-03-16T07:24:34.769682+0000","last_active":"2024-03-16T07:24:36.756171+0000","last_peered":"2024-03-16T07:24:36.756171+0000","last_clean":"2024-03-16T07:24:36.756171+0000","last_became_active":"2024-03-16T07:24:34.769389+0000","last_became_peered":"2024-03-16T07:24:34.769389+0000","last_unstale":"2024-03-16T07:24:36.756171+0000","last_undegraded":"2024-03-16T07:24:36.756171+0000","last_fullsized":"2024-03-16T07:24:36.756171+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_clean_scrub_stamp":"2024-03-16T07:24:33.730276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:20:10.353781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.848838+0000","last_change":"2024-03-16T07:24:35.780346+0000","last_active":"2024-03-16T07:24:36.848838+0000","last_peered":"2024-03-16T07:24:36.848838+0000","last_clean":"2024-03-16T07:24:36.848838+0000","last_became_active":"2024-03-16T07:24:35.779994+0000","last_became_peered":"2024-03-16T07:24:35.779994+0000","last_unstale":"2024-03-16T07:24:36.848838+0000","last_undegraded":"2024-03-16T07:24:36.848838+0000","last_fullsized":"2024-03-16T07:24:36.848838+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:36:30.781523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"15'8","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-03-16T07:24:35.769164+0000","last_change":"2024-03-16T07:24:34.759546+0000","last_active":"2024-03-16T07:24:35.769164+0000","last_peered":"2024-03-16T07:24:35.769164+0000","last_clean":"2024-03-16T07:24:35.769164+0000","last_became_active":"2024-03-16T07:24:34.759268+0000","last_became_peered":"2024-03-16T07:24:34.759268+0000","last_unstale":"2024-03-16T07:24:35.769164+0000","last_undegraded":"2024-03-16T07:24:35.769164+0000","last_fullsized":"2024-03-16T07:24:35.769164+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_clean_scrub_stamp":"2024-03-16T07:24:33.730276+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:19:11.558967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-03-16T07:24:35.762746+0000","last_change":"2024-03-16T07:24:35.760480+0000","last_active":"2024-03-16T07:24:35.762746+0000","last_peered":"2024-03-16T07:24:35.762746+0000","last_clean":"2024-03-16T07:24:35.762746+0000","last_became_active":"2024-03-16T07:24:35.759591+0000","last_became_peered":"2024-03-16T07:24:35.759591+0000","last_unstale":"2024-03-16T07:24:35.762746+0000","last_undegraded":"2024-03-16T07:24:35.762746+0000","last_fullsized":"2024-03-16T07:24:35.762746+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:25:32.606316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"15'1","reported_seq":15,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.756998+0000","last_change":"2024-03-16T07:24:34.769491+0000","last_active":"2024-03-16T07:24:36.756998+0000","last_peered":"2024-03-16T07:24:36.756998+0000","last_clean":"2024-03-16T07:24:36.756998+0000","last_became_active":"2024-03-16T07:24:34.769251+0000","last_became_peered":"2024-03-16T07:24:34.769251+0000","last_unstale":"2024-03-16T07:24:36.756998+0000","last_undegraded":"2024-03-16T07:24:36.756998+0000","last_fullsized":"2024-03-16T07:24:36.756998+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_clean_scrub_stamp":"2024-03-16T07:24:33.730276+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:54:01.611832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-03-16T07:24:35.772271+0000","last_change":"2024-03-16T07:24:35.770765+0000","last_active":"2024-03-16T07:24:35.772271+0000","last_peered":"2024-03-16T07:24:35.772271+0000","last_clean":"2024-03-16T07:24:35.772271+0000","last_became_active":"2024-03-16T07:24:35.770379+0000","last_became_peered":"2024-03-16T07:24:35.770379+0000","last_unstale":"2024-03-16T07:24:35.772271+0000","last_undegraded":"2024-03-16T07:24:35.772271+0000","last_fullsized":"2024-03-16T07:24:35.772271+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:48:47.301592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"15'2","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-03-16T07:24:35.772115+0000","last_change":"2024-03-16T07:24:34.762323+0000","last_active":"2024-03-16T07:24:35.772115+0000","last_peered":"2024-03-16T07:24:35.772115+0000","last_clean":"2024-03-16T07:24:35.772115+0000","last_became_active":"2024-03-16T07:24:34.761642+0000","last_became_peered":"2024-03-16T07:24:34.761642+0000","last_unstale":"2024-03-16T07:24:35.772115+0000","last_undegraded":"2024-03-16T07:24:35.772115+0000","last_fullsized":"2024-03-16T07:24:35.772115+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_clean_scrub_stamp":"2024-03-16T07:24:33.730276+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:13:05.731622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.756778+0000","last_change":"2024-03-16T07:24:35.779728+0000","last_active":"2024-03-16T07:24:36.756778+0000","last_peered":"2024-03-16T07:24:36.756778+0000","last_clean":"2024-03-16T07:24:36.756778+0000","last_became_active":"2024-03-16T07:24:35.778072+0000","last_became_peered":"2024-03-16T07:24:35.778072+0000","last_unstale":"2024-03-16T07:24:36.756778+0000","last_undegraded":"2024-03-16T07:24:36.756778+0000","last_fullsized":"2024-03-16T07:24:36.756778+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:50:35.923622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"15'1","reported_seq":15,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.850098+0000","last_change":"2024-03-16T07:24:34.753180+0000","last_active":"2024-03-16T07:24:36.850098+0000","last_peered":"2024-03-16T07:24:36.850098+0000","last_clean":"2024-03-16T07:24:36.850098+0000","last_became_active":"2024-03-16T07:24:34.752884+0000","last_became_peered":"2024-03-16T07:24:34.752884+0000","last_unstale":"2024-03-16T07:24:36.850098+0000","last_undegraded":"2024-03-16T07:24:36.850098+0000","last_fullsized":"2024-03-16T07:24:36.850098+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_clean_scrub_stamp":"2024-03-16T07:24:33.730276+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:01:34.459245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.756599+0000","last_change":"2024-03-16T07:24:35.776993+0000","last_active":"2024-03-16T07:24:36.756599+0000","last_peered":"2024-03-16T07:24:36.756599+0000","last_clean":"2024-03-16T07:24:36.756599+0000","last_became_active":"2024-03-16T07:24:35.776661+0000","last_became_peered":"2024-03-16T07:24:35.776661+0000","last_unstale":"2024-03-16T07:24:36.756599+0000","last_undegraded":"2024-03-16T07:24:36.756599+0000","last_fullsized":"2024-03-16T07:24:36.756599+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:48:42.060438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-03-16T07:24:35.749945+0000","last_change":"2024-03-16T07:24:34.763099+0000","last_active":"2024-03-16T07:24:35.749945+0000","last_peered":"2024-03-16T07:24:35.749945+0000","last_clean":"2024-03-16T07:24:35.749945+0000","last_became_active":"2024-03-16T07:24:34.762791+0000","last_became_peered":"2024-03-16T07:24:34.762791+0000","last_unstale":"2024-03-16T07:24:35.749945+0000","last_undegraded":"2024-03-16T07:24:35.749945+0000","last_fullsized":"2024-03-16T07:24:35.749945+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_clean_scrub_stamp":"2024-03-16T07:24:33.730276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:33:44.266615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.849820+0000","last_change":"2024-03-16T07:24:35.780874+0000","last_active":"2024-03-16T07:24:36.849820+0000","last_peered":"2024-03-16T07:24:36.849820+0000","last_clean":"2024-03-16T07:24:36.849820+0000","last_became_active":"2024-03-16T07:24:35.780663+0000","last_became_peered":"2024-03-16T07:24:35.780663+0000","last_unstale":"2024-03-16T07:24:36.849820+0000","last_undegraded":"2024-03-16T07:24:36.849820+0000","last_fullsized":"2024-03-16T07:24:36.849820+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:49:14.969756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'97","reported_seq":147,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.848896+0000","last_change":"2024-03-16T07:24:31.650537+0000","last_active":"2024-03-16T07:24:36.848896+0000","last_peered":"2024-03-16T07:24:36.848896+0000","last_clean":"2024-03-16T07:24:36.848896+0000","last_became_active":"2024-03-16T07:24:31.649574+0000","last_became_peered":"2024-03-16T07:24:31.649574+0000","last_unstale":"2024-03-16T07:24:36.848896+0000","last_undegraded":"2024-03-16T07:24:36.848896+0000","last_fullsized":"2024-03-16T07:24:36.848896+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:29.719970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:29.719970+0000","last_clean_scrub_stamp":"2024-03-16T07:24:29.719970+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:31:35.774554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.849379+0000","last_change":"2024-03-16T07:24:34.754912+0000","last_active":"2024-03-16T07:24:36.849379+0000","last_peered":"2024-03-16T07:24:36.849379+0000","last_clean":"2024-03-16T07:24:36.849379+0000","last_became_active":"2024-03-16T07:24:34.754625+0000","last_became_peered":"2024-03-16T07:24:34.754625+0000","last_unstale":"2024-03-16T07:24:36.849379+0000","last_undegraded":"2024-03-16T07:24:36.849379+0000","last_fullsized":"2024-03-16T07:24:36.849379+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_clean_scrub_stamp":"2024-03-16T07:24:33.730276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:19:11.558967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.849472+0000","last_change":"2024-03-16T07:24:35.762745+0000","last_active":"2024-03-16T07:24:36.849472+0000","last_peered":"2024-03-16T07:24:36.849472+0000","last_clean":"2024-03-16T07:24:36.849472+0000","last_became_active":"2024-03-16T07:24:35.761427+0000","last_became_peered":"2024-03-16T07:24:35.761427+0000","last_unstale":"2024-03-16T07:24:36.849472+0000","last_undegraded":"2024-03-16T07:24:36.849472+0000","last_fullsized":"2024-03-16T07:24:36.849472+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:48:17.097726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-03-16T07:24:35.752197+0000","last_change":"2024-03-16T07:24:34.760770+0000","last_active":"2024-03-16T07:24:35.752197+0000","last_peered":"2024-03-16T07:24:35.752197+0000","last_clean":"2024-03-16T07:24:35.752197+0000","last_became_active":"2024-03-16T07:24:34.759648+0000","last_became_peered":"2024-03-16T07:24:34.759648+0000","last_unstale":"2024-03-16T07:24:35.752197+0000","last_undegraded":"2024-03-16T07:24:35.752197+0000","last_fullsized":"2024-03-16T07:24:35.752197+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_clean_scrub_stamp":"2024-03-16T07:24:33.730276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:29:27.907682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.755501+0000","last_change":"2024-03-16T07:24:35.763497+0000","last_active":"2024-03-16T07:24:36.755501+0000","last_peered":"2024-03-16T07:24:36.755501+0000","last_clean":"2024-03-16T07:24:36.755501+0000","last_became_active":"2024-03-16T07:24:35.762740+0000","last_became_peered":"2024-03-16T07:24:35.762740+0000","last_unstale":"2024-03-16T07:24:36.755501+0000","last_undegraded":"2024-03-16T07:24:36.755501+0000","last_fullsized":"2024-03-16T07:24:36.755501+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:46:40.677706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-03-16T07:24:35.751059+0000","last_change":"2024-03-16T07:24:34.759060+0000","last_active":"2024-03-16T07:24:35.751059+0000","last_peered":"2024-03-16T07:24:35.751059+0000","last_clean":"2024-03-16T07:24:35.751059+0000","last_became_active":"2024-03-16T07:24:34.758804+0000","last_became_peered":"2024-03-16T07:24:34.758804+0000","last_unstale":"2024-03-16T07:24:35.751059+0000","last_undegraded":"2024-03-16T07:24:35.751059+0000","last_fullsized":"2024-03-16T07:24:35.751059+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_clean_scrub_stamp":"2024-03-16T07:24:33.730276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:56:51.770184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.848935+0000","last_change":"2024-03-16T07:24:35.765622+0000","last_active":"2024-03-16T07:24:36.848935+0000","last_peered":"2024-03-16T07:24:36.848935+0000","last_clean":"2024-03-16T07:24:36.848935+0000","last_became_active":"2024-03-16T07:24:35.765293+0000","last_became_peered":"2024-03-16T07:24:35.765293+0000","last_unstale":"2024-03-16T07:24:36.848935+0000","last_undegraded":"2024-03-16T07:24:36.848935+0000","last_fullsized":"2024-03-16T07:24:36.848935+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:08:27.087631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.755676+0000","last_change":"2024-03-16T07:24:34.769001+0000","last_active":"2024-03-16T07:24:36.755676+0000","last_peered":"2024-03-16T07:24:36.755676+0000","last_clean":"2024-03-16T07:24:36.755676+0000","last_became_active":"2024-03-16T07:24:34.768514+0000","last_became_peered":"2024-03-16T07:24:34.768514+0000","last_unstale":"2024-03-16T07:24:36.755676+0000","last_undegraded":"2024-03-16T07:24:36.755676+0000","last_fullsized":"2024-03-16T07:24:36.755676+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_clean_scrub_stamp":"2024-03-16T07:24:33.730276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:14:50.759285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.755766+0000","last_change":"2024-03-16T07:24:35.764911+0000","last_active":"2024-03-16T07:24:36.755766+0000","last_peered":"2024-03-16T07:24:36.755766+0000","last_clean":"2024-03-16T07:24:36.755766+0000","last_became_active":"2024-03-16T07:24:35.763991+0000","last_became_peered":"2024-03-16T07:24:35.763991+0000","last_unstale":"2024-03-16T07:24:36.755766+0000","last_undegraded":"2024-03-16T07:24:36.755766+0000","last_fullsized":"2024-03-16T07:24:36.755766+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:46:23.561018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.849543+0000","last_change":"2024-03-16T07:24:34.766776+0000","last_active":"2024-03-16T07:24:36.849543+0000","last_peered":"2024-03-16T07:24:36.849543+0000","last_clean":"2024-03-16T07:24:36.849543+0000","last_became_active":"2024-03-16T07:24:34.766401+0000","last_became_peered":"2024-03-16T07:24:34.766401+0000","last_unstale":"2024-03-16T07:24:36.849543+0000","last_undegraded":"2024-03-16T07:24:36.849543+0000","last_fullsized":"2024-03-16T07:24:36.849543+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_clean_scrub_stamp":"2024-03-16T07:24:33.730276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:54:01.611832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-03-16T07:24:35.762564+0000","last_change":"2024-03-16T07:24:35.758786+0000","last_active":"2024-03-16T07:24:35.762564+0000","last_peered":"2024-03-16T07:24:35.762564+0000","last_clean":"2024-03-16T07:24:35.762564+0000","last_became_active":"2024-03-16T07:24:35.758510+0000","last_became_peered":"2024-03-16T07:24:35.758510+0000","last_unstale":"2024-03-16T07:24:35.762564+0000","last_undegraded":"2024-03-16T07:24:35.762564+0000","last_fullsized":"2024-03-16T07:24:35.762564+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:54:02.615841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.850100+0000","last_change":"2024-03-16T07:24:34.767386+0000","last_active":"2024-03-16T07:24:36.850100+0000","last_peered":"2024-03-16T07:24:36.850100+0000","last_clean":"2024-03-16T07:24:36.850100+0000","last_became_active":"2024-03-16T07:24:34.766950+0000","last_became_peered":"2024-03-16T07:24:34.766950+0000","last_unstale":"2024-03-16T07:24:36.850100+0000","last_undegraded":"2024-03-16T07:24:36.850100+0000","last_fullsized":"2024-03-16T07:24:36.850100+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_clean_scrub_stamp":"2024-03-16T07:24:33.730276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:13:05.731622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.849568+0000","last_change":"2024-03-16T07:24:35.764512+0000","last_active":"2024-03-16T07:24:36.849568+0000","last_peered":"2024-03-16T07:24:36.849568+0000","last_clean":"2024-03-16T07:24:36.849568+0000","last_became_active":"2024-03-16T07:24:35.764264+0000","last_became_peered":"2024-03-16T07:24:35.764264+0000","last_unstale":"2024-03-16T07:24:36.849568+0000","last_undegraded":"2024-03-16T07:24:36.849568+0000","last_fullsized":"2024-03-16T07:24:36.849568+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:49:43.762702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"16'1","reported_seq":15,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:37.743513+0000","last_change":"2024-03-16T07:24:34.767319+0000","last_active":"2024-03-16T07:24:37.743513+0000","last_peered":"2024-03-16T07:24:37.743513+0000","last_clean":"2024-03-16T07:24:37.743513+0000","last_became_active":"2024-03-16T07:24:34.767028+0000","last_became_peered":"2024-03-16T07:24:34.767028+0000","last_unstale":"2024-03-16T07:24:37.743513+0000","last_undegraded":"2024-03-16T07:24:37.743513+0000","last_fullsized":"2024-03-16T07:24:37.743513+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_clean_scrub_stamp":"2024-03-16T07:24:33.730276+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:29:27.907682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-03-16T07:24:35.762690+0000","last_change":"2024-03-16T07:24:35.758709+0000","last_active":"2024-03-16T07:24:35.762690+0000","last_peered":"2024-03-16T07:24:35.762690+0000","last_clean":"2024-03-16T07:24:35.762690+0000","last_became_active":"2024-03-16T07:24:35.758160+0000","last_became_peered":"2024-03-16T07:24:35.758160+0000","last_unstale":"2024-03-16T07:24:35.762690+0000","last_undegraded":"2024-03-16T07:24:35.762690+0000","last_fullsized":"2024-03-16T07:24:35.762690+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:59:18.388937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"15'2","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.850272+0000","last_change":"2024-03-16T07:24:34.767310+0000","last_active":"2024-03-16T07:24:36.850272+0000","last_peered":"2024-03-16T07:24:36.850272+0000","last_clean":"2024-03-16T07:24:36.850272+0000","last_became_active":"2024-03-16T07:24:34.767009+0000","last_became_peered":"2024-03-16T07:24:34.767009+0000","last_unstale":"2024-03-16T07:24:36.850272+0000","last_undegraded":"2024-03-16T07:24:36.850272+0000","last_fullsized":"2024-03-16T07:24:36.850272+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_clean_scrub_stamp":"2024-03-16T07:24:33.730276+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:59:17.384928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.756195+0000","last_change":"2024-03-16T07:24:35.775915+0000","last_active":"2024-03-16T07:24:36.756195+0000","last_peered":"2024-03-16T07:24:36.756195+0000","last_clean":"2024-03-16T07:24:36.756195+0000","last_became_active":"2024-03-16T07:24:35.775655+0000","last_became_peered":"2024-03-16T07:24:35.775655+0000","last_unstale":"2024-03-16T07:24:36.756195+0000","last_undegraded":"2024-03-16T07:24:36.756195+0000","last_fullsized":"2024-03-16T07:24:36.756195+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:03:48.855314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.755137+0000","last_change":"2024-03-16T07:24:34.756852+0000","last_active":"2024-03-16T07:24:36.755137+0000","last_peered":"2024-03-16T07:24:36.755137+0000","last_clean":"2024-03-16T07:24:36.755137+0000","last_became_active":"2024-03-16T07:24:34.756442+0000","last_became_peered":"2024-03-16T07:24:34.756442+0000","last_unstale":"2024-03-16T07:24:36.755137+0000","last_undegraded":"2024-03-16T07:24:36.755137+0000","last_fullsized":"2024-03-16T07:24:36.755137+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_clean_scrub_stamp":"2024-03-16T07:24:33.730276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:19:11.558967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.756355+0000","last_change":"2024-03-16T07:24:35.763701+0000","last_active":"2024-03-16T07:24:36.756355+0000","last_peered":"2024-03-16T07:24:36.756355+0000","last_clean":"2024-03-16T07:24:36.756355+0000","last_became_active":"2024-03-16T07:24:35.763057+0000","last_became_peered":"2024-03-16T07:24:35.763057+0000","last_unstale":"2024-03-16T07:24:36.756355+0000","last_undegraded":"2024-03-16T07:24:36.756355+0000","last_fullsized":"2024-03-16T07:24:36.756355+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:05:30.548134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.849075+0000","last_change":"2024-03-16T07:24:34.764391+0000","last_active":"2024-03-16T07:24:36.849075+0000","last_peered":"2024-03-16T07:24:36.849075+0000","last_clean":"2024-03-16T07:24:36.849075+0000","last_became_active":"2024-03-16T07:24:34.764118+0000","last_became_peered":"2024-03-16T07:24:34.764118+0000","last_unstale":"2024-03-16T07:24:36.849075+0000","last_undegraded":"2024-03-16T07:24:36.849075+0000","last_fullsized":"2024-03-16T07:24:36.849075+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_clean_scrub_stamp":"2024-03-16T07:24:33.730276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:01:11.366672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-03-16T07:24:35.766725+0000","last_change":"2024-03-16T07:24:35.765029+0000","last_active":"2024-03-16T07:24:35.766725+0000","last_peered":"2024-03-16T07:24:35.766725+0000","last_clean":"2024-03-16T07:24:35.766725+0000","last_became_active":"2024-03-16T07:24:35.763997+0000","last_became_peered":"2024-03-16T07:24:35.763997+0000","last_unstale":"2024-03-16T07:24:35.766725+0000","last_undegraded":"2024-03-16T07:24:35.766725+0000","last_fullsized":"2024-03-16T07:24:35.766725+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:18:27.539454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.849280+0000","last_change":"2024-03-16T07:24:34.767533+0000","last_active":"2024-03-16T07:24:36.849280+0000","last_peered":"2024-03-16T07:24:36.849280+0000","last_clean":"2024-03-16T07:24:36.849280+0000","last_became_active":"2024-03-16T07:24:34.767181+0000","last_became_peered":"2024-03-16T07:24:34.767181+0000","last_unstale":"2024-03-16T07:24:36.849280+0000","last_undegraded":"2024-03-16T07:24:36.849280+0000","last_fullsized":"2024-03-16T07:24:36.849280+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_clean_scrub_stamp":"2024-03-16T07:24:33.730276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:20:10.353781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.849281+0000","last_change":"2024-03-16T07:24:35.761697+0000","last_active":"2024-03-16T07:24:36.849281+0000","last_peered":"2024-03-16T07:24:36.849281+0000","last_clean":"2024-03-16T07:24:36.849281+0000","last_became_active":"2024-03-16T07:24:35.760988+0000","last_became_peered":"2024-03-16T07:24:35.760988+0000","last_unstale":"2024-03-16T07:24:36.849281+0000","last_undegraded":"2024-03-16T07:24:36.849281+0000","last_fullsized":"2024-03-16T07:24:36.849281+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:03:38.294045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"15'2","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.756043+0000","last_change":"2024-03-16T07:24:34.758088+0000","last_active":"2024-03-16T07:24:36.756043+0000","last_peered":"2024-03-16T07:24:36.756043+0000","last_clean":"2024-03-16T07:24:36.756043+0000","last_became_active":"2024-03-16T07:24:34.757786+0000","last_became_peered":"2024-03-16T07:24:34.757786+0000","last_unstale":"2024-03-16T07:24:36.756043+0000","last_undegraded":"2024-03-16T07:24:36.756043+0000","last_fullsized":"2024-03-16T07:24:36.756043+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_clean_scrub_stamp":"2024-03-16T07:24:33.730276+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:13:05.731622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.755517+0000","last_change":"2024-03-16T07:24:35.776598+0000","last_active":"2024-03-16T07:24:36.755517+0000","last_peered":"2024-03-16T07:24:36.755517+0000","last_clean":"2024-03-16T07:24:36.755517+0000","last_became_active":"2024-03-16T07:24:35.775720+0000","last_became_peered":"2024-03-16T07:24:35.775720+0000","last_unstale":"2024-03-16T07:24:36.755517+0000","last_undegraded":"2024-03-16T07:24:36.755517+0000","last_fullsized":"2024-03-16T07:24:36.755517+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:31:37.132704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-03-16T07:24:35.759454+0000","last_change":"2024-03-16T07:24:35.755090+0000","last_active":"2024-03-16T07:24:35.759454+0000","last_peered":"2024-03-16T07:24:35.759454+0000","last_clean":"2024-03-16T07:24:35.759454+0000","last_became_active":"2024-03-16T07:24:35.754826+0000","last_became_peered":"2024-03-16T07:24:35.754826+0000","last_unstale":"2024-03-16T07:24:35.759454+0000","last_undegraded":"2024-03-16T07:24:35.759454+0000","last_fullsized":"2024-03-16T07:24:35.759454+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:14:51.763294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"15'2","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.756725+0000","last_change":"2024-03-16T07:24:34.768833+0000","last_active":"2024-03-16T07:24:36.756725+0000","last_peered":"2024-03-16T07:24:36.756725+0000","last_clean":"2024-03-16T07:24:36.756725+0000","last_became_active":"2024-03-16T07:24:34.768533+0000","last_became_peered":"2024-03-16T07:24:34.768533+0000","last_unstale":"2024-03-16T07:24:36.756725+0000","last_undegraded":"2024-03-16T07:24:36.756725+0000","last_fullsized":"2024-03-16T07:24:36.756725+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_clean_scrub_stamp":"2024-03-16T07:24:33.730276+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:59:17.384928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.849426+0000","last_change":"2024-03-16T07:24:35.782627+0000","last_active":"2024-03-16T07:24:36.849426+0000","last_peered":"2024-03-16T07:24:36.849426+0000","last_clean":"2024-03-16T07:24:36.849426+0000","last_became_active":"2024-03-16T07:24:35.782339+0000","last_became_peered":"2024-03-16T07:24:35.782339+0000","last_unstale":"2024-03-16T07:24:36.849426+0000","last_undegraded":"2024-03-16T07:24:36.849426+0000","last_fullsized":"2024-03-16T07:24:36.849426+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:15:00.108070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"15'2","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.756518+0000","last_change":"2024-03-16T07:24:34.768858+0000","last_active":"2024-03-16T07:24:36.756518+0000","last_peered":"2024-03-16T07:24:36.756518+0000","last_clean":"2024-03-16T07:24:36.756518+0000","last_became_active":"2024-03-16T07:24:34.768558+0000","last_became_peered":"2024-03-16T07:24:34.768558+0000","last_unstale":"2024-03-16T07:24:36.756518+0000","last_undegraded":"2024-03-16T07:24:36.756518+0000","last_fullsized":"2024-03-16T07:24:36.756518+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_clean_scrub_stamp":"2024-03-16T07:24:33.730276+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:25:31.602307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.756628+0000","last_change":"2024-03-16T07:24:35.778556+0000","last_active":"2024-03-16T07:24:36.756628+0000","last_peered":"2024-03-16T07:24:36.756628+0000","last_clean":"2024-03-16T07:24:36.756628+0000","last_became_active":"2024-03-16T07:24:35.777574+0000","last_became_peered":"2024-03-16T07:24:35.777574+0000","last_unstale":"2024-03-16T07:24:36.756628+0000","last_undegraded":"2024-03-16T07:24:36.756628+0000","last_fullsized":"2024-03-16T07:24:36.756628+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:25:26.895206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"15'1","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-03-16T07:24:35.772214+0000","last_change":"2024-03-16T07:24:34.762078+0000","last_active":"2024-03-16T07:24:35.772214+0000","last_peered":"2024-03-16T07:24:35.772214+0000","last_clean":"2024-03-16T07:24:35.772214+0000","last_became_active":"2024-03-16T07:24:34.761242+0000","last_became_peered":"2024-03-16T07:24:34.761242+0000","last_unstale":"2024-03-16T07:24:35.772214+0000","last_undegraded":"2024-03-16T07:24:35.772214+0000","last_fullsized":"2024-03-16T07:24:35.772214+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_clean_scrub_stamp":"2024-03-16T07:24:33.730276+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:01:34.459245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-03-16T07:24:35.767802+0000","last_change":"2024-03-16T07:24:35.763919+0000","last_active":"2024-03-16T07:24:35.767802+0000","last_peered":"2024-03-16T07:24:35.767802+0000","last_clean":"2024-03-16T07:24:35.767802+0000","last_became_active":"2024-03-16T07:24:35.763643+0000","last_became_peered":"2024-03-16T07:24:35.763643+0000","last_unstale":"2024-03-16T07:24:35.767802+0000","last_undegraded":"2024-03-16T07:24:35.767802+0000","last_fullsized":"2024-03-16T07:24:35.767802+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:14:00.464456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"15'4","reported_seq":18,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.756909+0000","last_change":"2024-03-16T07:24:34.770349+0000","last_active":"2024-03-16T07:24:36.756909+0000","last_peered":"2024-03-16T07:24:36.756909+0000","last_clean":"2024-03-16T07:24:36.756909+0000","last_became_active":"2024-03-16T07:24:34.770054+0000","last_became_peered":"2024-03-16T07:24:34.770054+0000","last_unstale":"2024-03-16T07:24:36.756909+0000","last_undegraded":"2024-03-16T07:24:36.756909+0000","last_fullsized":"2024-03-16T07:24:36.756909+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_clean_scrub_stamp":"2024-03-16T07:24:33.730276+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:09:12.533977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738372,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27168,"kb_used_data":148,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":104830432,"statfs":{"total":107374182400,"available":107346362368,"internally_reserved":0,"allocated":151552,"data_stored":40456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738372,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27768,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":104829832,"statfs":{"total":107374182400,"available":107345747968,"internally_reserved":0,"allocated":761856,"data_stored":635514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738372,"num_pgs":74,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27756,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":104829844,"statfs":{"total":107374182400,"available":107345760256,"internally_reserved":0,"allocated":749568,"data_stored":633866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-16T07:24:39.876 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-16T07:24:40.217 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:24:40.218 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2024-03-16T07:24:40.228 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":19,"stamp":"2024-03-16T07:24:38.898402+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":182,"num_write_kb":1908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":136,"ondisk_log_size":136,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":174,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":314572800,"kb_used":82692,"kb_used_data":1624,"kb_used_omap":4,"kb_used_meta":81019,"kb_avail":314490108,"statfs":{"total":322122547200,"available":322037870592,"internally_reserved":0,"allocated":1662976,"data_stored":1309836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":82963791},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.164224"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.756601+0000","last_change":"2024-03-16T07:24:35.778195+0000","last_active":"2024-03-16T07:24:36.756601+0000","last_peered":"2024-03-16T07:24:36.756601+0000","last_clean":"2024-03-16T07:24:36.756601+0000","last_became_active":"2024-03-16T07:24:35.777228+0000","last_became_peered":"2024-03-16T07:24:35.777228+0000","last_unstale":"2024-03-16T07:24:36.756601+0000","last_undegraded":"2024-03-16T07:24:36.756601+0000","last_fullsized":"2024-03-16T07:24:36.756601+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:06:55.141496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.850057+0000","last_change":"2024-03-16T07:24:35.782627+0000","last_active":"2024-03-16T07:24:36.850057+0000","last_peered":"2024-03-16T07:24:36.850057+0000","last_clean":"2024-03-16T07:24:36.850057+0000","last_became_active":"2024-03-16T07:24:35.782357+0000","last_became_peered":"2024-03-16T07:24:35.782357+0000","last_unstale":"2024-03-16T07:24:36.850057+0000","last_undegraded":"2024-03-16T07:24:36.850057+0000","last_fullsized":"2024-03-16T07:24:36.850057+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:28:16.855057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.756432+0000","last_change":"2024-03-16T07:24:35.763326+0000","last_active":"2024-03-16T07:24:36.756432+0000","last_peered":"2024-03-16T07:24:36.756432+0000","last_clean":"2024-03-16T07:24:36.756432+0000","last_became_active":"2024-03-16T07:24:35.763103+0000","last_became_peered":"2024-03-16T07:24:35.763103+0000","last_unstale":"2024-03-16T07:24:36.756432+0000","last_undegraded":"2024-03-16T07:24:36.756432+0000","last_fullsized":"2024-03-16T07:24:36.756432+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:27:51.581736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-03-16T07:24:35.766545+0000","last_change":"2024-03-16T07:24:35.762619+0000","last_active":"2024-03-16T07:24:35.766545+0000","last_peered":"2024-03-16T07:24:35.766545+0000","last_clean":"2024-03-16T07:24:35.766545+0000","last_became_active":"2024-03-16T07:24:35.761493+0000","last_became_peered":"2024-03-16T07:24:35.761493+0000","last_unstale":"2024-03-16T07:24:35.766545+0000","last_undegraded":"2024-03-16T07:24:35.766545+0000","last_fullsized":"2024-03-16T07:24:35.766545+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:50:22.463742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.755923+0000","last_change":"2024-03-16T07:24:35.767433+0000","last_active":"2024-03-16T07:24:36.755923+0000","last_peered":"2024-03-16T07:24:36.755923+0000","last_clean":"2024-03-16T07:24:36.755923+0000","last_became_active":"2024-03-16T07:24:35.764667+0000","last_became_peered":"2024-03-16T07:24:35.764667+0000","last_unstale":"2024-03-16T07:24:36.755923+0000","last_undegraded":"2024-03-16T07:24:36.755923+0000","last_fullsized":"2024-03-16T07:24:36.755923+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:18:18.873930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-03-16T07:24:35.766433+0000","last_change":"2024-03-16T07:24:35.762404+0000","last_active":"2024-03-16T07:24:35.766433+0000","last_peered":"2024-03-16T07:24:35.766433+0000","last_clean":"2024-03-16T07:24:35.766433+0000","last_became_active":"2024-03-16T07:24:35.760824+0000","last_became_peered":"2024-03-16T07:24:35.760824+0000","last_unstale":"2024-03-16T07:24:35.766433+0000","last_undegraded":"2024-03-16T07:24:35.766433+0000","last_fullsized":"2024-03-16T07:24:35.766433+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:03:07.826660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.756044+0000","last_change":"2024-03-16T07:24:35.775068+0000","last_active":"2024-03-16T07:24:36.756044+0000","last_peered":"2024-03-16T07:24:36.756044+0000","last_clean":"2024-03-16T07:24:36.756044+0000","last_became_active":"2024-03-16T07:24:35.774830+0000","last_became_peered":"2024-03-16T07:24:35.774830+0000","last_unstale":"2024-03-16T07:24:36.756044+0000","last_undegraded":"2024-03-16T07:24:36.756044+0000","last_fullsized":"2024-03-16T07:24:36.756044+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:55:12.697679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-03-16T07:24:35.766691+0000","last_change":"2024-03-16T07:24:35.763436+0000","last_active":"2024-03-16T07:24:35.766691+0000","last_peered":"2024-03-16T07:24:35.766691+0000","last_clean":"2024-03-16T07:24:35.766691+0000","last_became_active":"2024-03-16T07:24:35.763190+0000","last_became_peered":"2024-03-16T07:24:35.763190+0000","last_unstale":"2024-03-16T07:24:35.766691+0000","last_undegraded":"2024-03-16T07:24:35.766691+0000","last_fullsized":"2024-03-16T07:24:35.766691+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:49:05.751767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.850174+0000","last_change":"2024-03-16T07:24:35.783289+0000","last_active":"2024-03-16T07:24:36.850174+0000","last_peered":"2024-03-16T07:24:36.850174+0000","last_clean":"2024-03-16T07:24:36.850174+0000","last_became_active":"2024-03-16T07:24:35.782803+0000","last_became_peered":"2024-03-16T07:24:35.782803+0000","last_unstale":"2024-03-16T07:24:36.850174+0000","last_undegraded":"2024-03-16T07:24:36.850174+0000","last_fullsized":"2024-03-16T07:24:36.850174+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:14:25.797393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.756381+0000","last_change":"2024-03-16T07:24:35.767189+0000","last_active":"2024-03-16T07:24:36.756381+0000","last_peered":"2024-03-16T07:24:36.756381+0000","last_clean":"2024-03-16T07:24:36.756381+0000","last_became_active":"2024-03-16T07:24:35.766948+0000","last_became_peered":"2024-03-16T07:24:35.766948+0000","last_unstale":"2024-03-16T07:24:36.756381+0000","last_undegraded":"2024-03-16T07:24:36.756381+0000","last_fullsized":"2024-03-16T07:24:36.756381+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:39:05.051025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.755497+0000","last_change":"2024-03-16T07:24:35.778348+0000","last_active":"2024-03-16T07:24:36.755497+0000","last_peered":"2024-03-16T07:24:36.755497+0000","last_clean":"2024-03-16T07:24:36.755497+0000","last_became_active":"2024-03-16T07:24:35.777733+0000","last_became_peered":"2024-03-16T07:24:35.777733+0000","last_unstale":"2024-03-16T07:24:36.755497+0000","last_undegraded":"2024-03-16T07:24:36.755497+0000","last_fullsized":"2024-03-16T07:24:36.755497+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:00:23.312298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.756312+0000","last_change":"2024-03-16T07:24:35.776673+0000","last_active":"2024-03-16T07:24:36.756312+0000","last_peered":"2024-03-16T07:24:36.756312+0000","last_clean":"2024-03-16T07:24:36.756312+0000","last_became_active":"2024-03-16T07:24:35.776273+0000","last_became_peered":"2024-03-16T07:24:35.776273+0000","last_unstale":"2024-03-16T07:24:36.756312+0000","last_undegraded":"2024-03-16T07:24:36.756312+0000","last_fullsized":"2024-03-16T07:24:36.756312+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:21:36.876625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.756012+0000","last_change":"2024-03-16T07:24:35.776794+0000","last_active":"2024-03-16T07:24:36.756012+0000","last_peered":"2024-03-16T07:24:36.756012+0000","last_clean":"2024-03-16T07:24:36.756012+0000","last_became_active":"2024-03-16T07:24:35.775472+0000","last_became_peered":"2024-03-16T07:24:35.775472+0000","last_unstale":"2024-03-16T07:24:36.756012+0000","last_undegraded":"2024-03-16T07:24:36.756012+0000","last_fullsized":"2024-03-16T07:24:36.756012+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:47:00.624947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.755298+0000","last_change":"2024-03-16T07:24:35.777171+0000","last_active":"2024-03-16T07:24:36.755298+0000","last_peered":"2024-03-16T07:24:36.755298+0000","last_clean":"2024-03-16T07:24:36.755298+0000","last_became_active":"2024-03-16T07:24:35.776959+0000","last_became_peered":"2024-03-16T07:24:35.776959+0000","last_unstale":"2024-03-16T07:24:36.755298+0000","last_undegraded":"2024-03-16T07:24:36.755298+0000","last_fullsized":"2024-03-16T07:24:36.755298+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:15:02.699193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.848996+0000","last_change":"2024-03-16T07:24:35.779625+0000","last_active":"2024-03-16T07:24:36.848996+0000","last_peered":"2024-03-16T07:24:36.848996+0000","last_clean":"2024-03-16T07:24:36.848996+0000","last_became_active":"2024-03-16T07:24:35.779369+0000","last_became_peered":"2024-03-16T07:24:35.779369+0000","last_unstale":"2024-03-16T07:24:36.848996+0000","last_undegraded":"2024-03-16T07:24:36.848996+0000","last_fullsized":"2024-03-16T07:24:36.848996+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:31:08.610234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-03-16T07:24:35.772559+0000","last_change":"2024-03-16T07:24:35.771934+0000","last_active":"2024-03-16T07:24:35.772559+0000","last_peered":"2024-03-16T07:24:35.772559+0000","last_clean":"2024-03-16T07:24:35.772559+0000","last_became_active":"2024-03-16T07:24:35.771550+0000","last_became_peered":"2024-03-16T07:24:35.771550+0000","last_unstale":"2024-03-16T07:24:35.772559+0000","last_undegraded":"2024-03-16T07:24:35.772559+0000","last_fullsized":"2024-03-16T07:24:35.772559+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:10:34.983006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.850325+0000","last_change":"2024-03-16T07:24:35.778996+0000","last_active":"2024-03-16T07:24:36.850325+0000","last_peered":"2024-03-16T07:24:36.850325+0000","last_clean":"2024-03-16T07:24:36.850325+0000","last_became_active":"2024-03-16T07:24:35.778760+0000","last_became_peered":"2024-03-16T07:24:35.778760+0000","last_unstale":"2024-03-16T07:24:36.850325+0000","last_undegraded":"2024-03-16T07:24:36.850325+0000","last_fullsized":"2024-03-16T07:24:36.850325+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:15:02.699193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-03-16T07:24:35.772231+0000","last_change":"2024-03-16T07:24:35.770074+0000","last_active":"2024-03-16T07:24:35.772231+0000","last_peered":"2024-03-16T07:24:35.772231+0000","last_clean":"2024-03-16T07:24:35.772231+0000","last_became_active":"2024-03-16T07:24:35.769797+0000","last_became_peered":"2024-03-16T07:24:35.769797+0000","last_unstale":"2024-03-16T07:24:35.772231+0000","last_undegraded":"2024-03-16T07:24:35.772231+0000","last_fullsized":"2024-03-16T07:24:35.772231+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:21:06.519040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.756228+0000","last_change":"2024-03-16T07:24:35.755806+0000","last_active":"2024-03-16T07:24:36.756228+0000","last_peered":"2024-03-16T07:24:36.756228+0000","last_clean":"2024-03-16T07:24:36.756228+0000","last_became_active":"2024-03-16T07:24:35.755548+0000","last_became_peered":"2024-03-16T07:24:35.755548+0000","last_unstale":"2024-03-16T07:24:36.756228+0000","last_undegraded":"2024-03-16T07:24:36.756228+0000","last_fullsized":"2024-03-16T07:24:36.756228+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:58:56.672206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.756631+0000","last_change":"2024-03-16T07:24:35.776892+0000","last_active":"2024-03-16T07:24:36.756631+0000","last_peered":"2024-03-16T07:24:36.756631+0000","last_clean":"2024-03-16T07:24:36.756631+0000","last_became_active":"2024-03-16T07:24:35.776396+0000","last_became_peered":"2024-03-16T07:24:35.776396+0000","last_unstale":"2024-03-16T07:24:36.756631+0000","last_undegraded":"2024-03-16T07:24:36.756631+0000","last_fullsized":"2024-03-16T07:24:36.756631+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:20:25.574088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.755333+0000","last_change":"2024-03-16T07:24:35.766783+0000","last_active":"2024-03-16T07:24:36.755333+0000","last_peered":"2024-03-16T07:24:36.755333+0000","last_clean":"2024-03-16T07:24:36.755333+0000","last_became_active":"2024-03-16T07:24:35.764320+0000","last_became_peered":"2024-03-16T07:24:35.764320+0000","last_unstale":"2024-03-16T07:24:36.755333+0000","last_undegraded":"2024-03-16T07:24:36.755333+0000","last_fullsized":"2024-03-16T07:24:36.755333+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:52:47.872518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.849137+0000","last_change":"2024-03-16T07:24:35.781061+0000","last_active":"2024-03-16T07:24:36.849137+0000","last_peered":"2024-03-16T07:24:36.849137+0000","last_clean":"2024-03-16T07:24:36.849137+0000","last_became_active":"2024-03-16T07:24:35.780821+0000","last_became_peered":"2024-03-16T07:24:35.780821+0000","last_unstale":"2024-03-16T07:24:36.849137+0000","last_undegraded":"2024-03-16T07:24:36.849137+0000","last_fullsized":"2024-03-16T07:24:36.849137+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:13:21.265017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.754999+0000","last_change":"2024-03-16T07:24:35.763299+0000","last_active":"2024-03-16T07:24:36.754999+0000","last_peered":"2024-03-16T07:24:36.754999+0000","last_clean":"2024-03-16T07:24:36.754999+0000","last_became_active":"2024-03-16T07:24:35.760540+0000","last_became_peered":"2024-03-16T07:24:35.760540+0000","last_unstale":"2024-03-16T07:24:36.754999+0000","last_undegraded":"2024-03-16T07:24:36.754999+0000","last_fullsized":"2024-03-16T07:24:36.754999+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:28:16.855057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.755114+0000","last_change":"2024-03-16T07:24:35.768963+0000","last_active":"2024-03-16T07:24:36.755114+0000","last_peered":"2024-03-16T07:24:36.755114+0000","last_clean":"2024-03-16T07:24:36.755114+0000","last_became_active":"2024-03-16T07:24:35.768551+0000","last_became_peered":"2024-03-16T07:24:35.768551+0000","last_unstale":"2024-03-16T07:24:36.755114+0000","last_undegraded":"2024-03-16T07:24:36.755114+0000","last_fullsized":"2024-03-16T07:24:36.755114+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:14:25.797393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-03-16T07:24:35.762666+0000","last_change":"2024-03-16T07:24:35.758470+0000","last_active":"2024-03-16T07:24:35.762666+0000","last_peered":"2024-03-16T07:24:35.762666+0000","last_clean":"2024-03-16T07:24:35.762666+0000","last_became_active":"2024-03-16T07:24:35.757833+0000","last_became_peered":"2024-03-16T07:24:35.757833+0000","last_unstale":"2024-03-16T07:24:35.762666+0000","last_undegraded":"2024-03-16T07:24:35.762666+0000","last_fullsized":"2024-03-16T07:24:35.762666+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:09:13.537986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-03-16T07:24:35.772252+0000","last_change":"2024-03-16T07:24:35.770744+0000","last_active":"2024-03-16T07:24:35.772252+0000","last_peered":"2024-03-16T07:24:35.772252+0000","last_clean":"2024-03-16T07:24:35.772252+0000","last_became_active":"2024-03-16T07:24:35.770319+0000","last_became_peered":"2024-03-16T07:24:35.770319+0000","last_unstale":"2024-03-16T07:24:35.772252+0000","last_undegraded":"2024-03-16T07:24:35.772252+0000","last_fullsized":"2024-03-16T07:24:35.772252+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:56:19.429648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.849752+0000","last_change":"2024-03-16T07:24:35.761508+0000","last_active":"2024-03-16T07:24:36.849752+0000","last_peered":"2024-03-16T07:24:36.849752+0000","last_clean":"2024-03-16T07:24:36.849752+0000","last_became_active":"2024-03-16T07:24:35.761166+0000","last_became_peered":"2024-03-16T07:24:35.761166+0000","last_unstale":"2024-03-16T07:24:36.849752+0000","last_undegraded":"2024-03-16T07:24:36.849752+0000","last_fullsized":"2024-03-16T07:24:36.849752+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:25:46.129511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.756457+0000","last_change":"2024-03-16T07:24:35.766187+0000","last_active":"2024-03-16T07:24:36.756457+0000","last_peered":"2024-03-16T07:24:36.756457+0000","last_clean":"2024-03-16T07:24:36.756457+0000","last_became_active":"2024-03-16T07:24:35.765816+0000","last_became_peered":"2024-03-16T07:24:35.765816+0000","last_unstale":"2024-03-16T07:24:36.756457+0000","last_undegraded":"2024-03-16T07:24:36.756457+0000","last_fullsized":"2024-03-16T07:24:36.756457+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:35:01.521441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.755518+0000","last_change":"2024-03-16T07:24:35.767649+0000","last_active":"2024-03-16T07:24:36.755518+0000","last_peered":"2024-03-16T07:24:36.755518+0000","last_clean":"2024-03-16T07:24:36.755518+0000","last_became_active":"2024-03-16T07:24:35.766516+0000","last_became_peered":"2024-03-16T07:24:35.766516+0000","last_unstale":"2024-03-16T07:24:36.755518+0000","last_undegraded":"2024-03-16T07:24:36.755518+0000","last_fullsized":"2024-03-16T07:24:36.755518+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:59:52.437341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.755379+0000","last_change":"2024-03-16T07:24:35.764368+0000","last_active":"2024-03-16T07:24:36.755379+0000","last_peered":"2024-03-16T07:24:36.755379+0000","last_clean":"2024-03-16T07:24:36.755379+0000","last_became_active":"2024-03-16T07:24:35.764090+0000","last_became_peered":"2024-03-16T07:24:35.764090+0000","last_unstale":"2024-03-16T07:24:36.755379+0000","last_undegraded":"2024-03-16T07:24:36.755379+0000","last_fullsized":"2024-03-16T07:24:36.755379+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:03:51.527543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-03-16T07:24:35.766579+0000","last_change":"2024-03-16T07:24:35.762614+0000","last_active":"2024-03-16T07:24:35.766579+0000","last_peered":"2024-03-16T07:24:35.766579+0000","last_clean":"2024-03-16T07:24:35.766579+0000","last_became_active":"2024-03-16T07:24:35.759299+0000","last_became_peered":"2024-03-16T07:24:35.759299+0000","last_unstale":"2024-03-16T07:24:35.766579+0000","last_undegraded":"2024-03-16T07:24:35.766579+0000","last_fullsized":"2024-03-16T07:24:35.766579+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:13:14.402188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-03-16T07:24:35.774060+0000","last_change":"2024-03-16T07:24:35.772411+0000","last_active":"2024-03-16T07:24:35.774060+0000","last_peered":"2024-03-16T07:24:35.774060+0000","last_clean":"2024-03-16T07:24:35.774060+0000","last_became_active":"2024-03-16T07:24:35.771681+0000","last_became_peered":"2024-03-16T07:24:35.771681+0000","last_unstale":"2024-03-16T07:24:35.774060+0000","last_undegraded":"2024-03-16T07:24:35.774060+0000","last_fullsized":"2024-03-16T07:24:35.774060+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:34:12.369966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.849198+0000","last_change":"2024-03-16T07:24:35.762199+0000","last_active":"2024-03-16T07:24:36.849198+0000","last_peered":"2024-03-16T07:24:36.849198+0000","last_clean":"2024-03-16T07:24:36.849198+0000","last_became_active":"2024-03-16T07:24:35.761593+0000","last_became_peered":"2024-03-16T07:24:35.761593+0000","last_unstale":"2024-03-16T07:24:36.849198+0000","last_undegraded":"2024-03-16T07:24:36.849198+0000","last_fullsized":"2024-03-16T07:24:36.849198+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:37:59.379102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"15'1","reported_seq":15,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.849354+0000","last_change":"2024-03-16T07:24:34.766133+0000","last_active":"2024-03-16T07:24:36.849354+0000","last_peered":"2024-03-16T07:24:36.849354+0000","last_clean":"2024-03-16T07:24:36.849354+0000","last_became_active":"2024-03-16T07:24:34.765818+0000","last_became_peered":"2024-03-16T07:24:34.765818+0000","last_unstale":"2024-03-16T07:24:36.849354+0000","last_undegraded":"2024-03-16T07:24:36.849354+0000","last_fullsized":"2024-03-16T07:24:36.849354+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_clean_scrub_stamp":"2024-03-16T07:24:33.730276+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:56:51.770184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.755679+0000","last_change":"2024-03-16T07:24:35.775697+0000","last_active":"2024-03-16T07:24:36.755679+0000","last_peered":"2024-03-16T07:24:36.755679+0000","last_clean":"2024-03-16T07:24:36.755679+0000","last_became_active":"2024-03-16T07:24:35.775430+0000","last_became_peered":"2024-03-16T07:24:35.775430+0000","last_unstale":"2024-03-16T07:24:36.755679+0000","last_undegraded":"2024-03-16T07:24:36.755679+0000","last_fullsized":"2024-03-16T07:24:36.755679+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:10:53.245012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"15'1","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-03-16T07:24:35.771349+0000","last_change":"2024-03-16T07:24:34.762997+0000","last_active":"2024-03-16T07:24:35.771349+0000","last_peered":"2024-03-16T07:24:35.771349+0000","last_clean":"2024-03-16T07:24:35.771349+0000","last_became_active":"2024-03-16T07:24:34.762707+0000","last_became_peered":"2024-03-16T07:24:34.762707+0000","last_unstale":"2024-03-16T07:24:35.771349+0000","last_undegraded":"2024-03-16T07:24:35.771349+0000","last_fullsized":"2024-03-16T07:24:35.771349+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_clean_scrub_stamp":"2024-03-16T07:24:33.730276+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:20:10.353781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.755881+0000","last_change":"2024-03-16T07:24:34.756141+0000","last_active":"2024-03-16T07:24:36.755881+0000","last_peered":"2024-03-16T07:24:36.755881+0000","last_clean":"2024-03-16T07:24:36.755881+0000","last_became_active":"2024-03-16T07:24:34.755881+0000","last_became_peered":"2024-03-16T07:24:34.755881+0000","last_unstale":"2024-03-16T07:24:36.755881+0000","last_undegraded":"2024-03-16T07:24:36.755881+0000","last_fullsized":"2024-03-16T07:24:36.755881+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_clean_scrub_stamp":"2024-03-16T07:24:33.730276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:29:27.907682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-03-16T07:24:35.773471+0000","last_change":"2024-03-16T07:24:35.772150+0000","last_active":"2024-03-16T07:24:35.773471+0000","last_peered":"2024-03-16T07:24:35.773471+0000","last_clean":"2024-03-16T07:24:35.773471+0000","last_became_active":"2024-03-16T07:24:35.771896+0000","last_became_peered":"2024-03-16T07:24:35.771896+0000","last_unstale":"2024-03-16T07:24:35.773471+0000","last_undegraded":"2024-03-16T07:24:35.773471+0000","last_fullsized":"2024-03-16T07:24:35.773471+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:54:14.723121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.755045+0000","last_change":"2024-03-16T07:24:34.769281+0000","last_active":"2024-03-16T07:24:36.755045+0000","last_peered":"2024-03-16T07:24:36.755045+0000","last_clean":"2024-03-16T07:24:36.755045+0000","last_became_active":"2024-03-16T07:24:34.769017+0000","last_became_peered":"2024-03-16T07:24:34.769017+0000","last_unstale":"2024-03-16T07:24:36.755045+0000","last_undegraded":"2024-03-16T07:24:36.755045+0000","last_fullsized":"2024-03-16T07:24:36.755045+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_clean_scrub_stamp":"2024-03-16T07:24:33.730276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:56:51.770184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.848978+0000","last_change":"2024-03-16T07:24:35.762407+0000","last_active":"2024-03-16T07:24:36.848978+0000","last_peered":"2024-03-16T07:24:36.848978+0000","last_clean":"2024-03-16T07:24:36.848978+0000","last_became_active":"2024-03-16T07:24:35.762037+0000","last_became_peered":"2024-03-16T07:24:35.762037+0000","last_unstale":"2024-03-16T07:24:36.848978+0000","last_undegraded":"2024-03-16T07:24:36.848978+0000","last_fullsized":"2024-03-16T07:24:36.848978+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:42:22.755597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.850223+0000","last_change":"2024-03-16T07:24:34.754520+0000","last_active":"2024-03-16T07:24:36.850223+0000","last_peered":"2024-03-16T07:24:36.850223+0000","last_clean":"2024-03-16T07:24:36.850223+0000","last_became_active":"2024-03-16T07:24:34.754209+0000","last_became_peered":"2024-03-16T07:24:34.754209+0000","last_unstale":"2024-03-16T07:24:36.850223+0000","last_undegraded":"2024-03-16T07:24:36.850223+0000","last_fullsized":"2024-03-16T07:24:36.850223+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_clean_scrub_stamp":"2024-03-16T07:24:33.730276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:09:12.533977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-03-16T07:24:35.767824+0000","last_change":"2024-03-16T07:24:35.764475+0000","last_active":"2024-03-16T07:24:35.767824+0000","last_peered":"2024-03-16T07:24:35.767824+0000","last_clean":"2024-03-16T07:24:35.767824+0000","last_became_active":"2024-03-16T07:24:35.764205+0000","last_became_peered":"2024-03-16T07:24:35.764205+0000","last_unstale":"2024-03-16T07:24:35.767824+0000","last_undegraded":"2024-03-16T07:24:35.767824+0000","last_fullsized":"2024-03-16T07:24:35.767824+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:09:24.472433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.756351+0000","last_change":"2024-03-16T07:24:34.770637+0000","last_active":"2024-03-16T07:24:36.756351+0000","last_peered":"2024-03-16T07:24:36.756351+0000","last_clean":"2024-03-16T07:24:36.756351+0000","last_became_active":"2024-03-16T07:24:34.770366+0000","last_became_peered":"2024-03-16T07:24:34.770366+0000","last_unstale":"2024-03-16T07:24:36.756351+0000","last_undegraded":"2024-03-16T07:24:36.756351+0000","last_fullsized":"2024-03-16T07:24:36.756351+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_clean_scrub_stamp":"2024-03-16T07:24:33.730276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:01:11.366672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.756755+0000","last_change":"2024-03-16T07:24:35.779355+0000","last_active":"2024-03-16T07:24:36.756755+0000","last_peered":"2024-03-16T07:24:36.756755+0000","last_clean":"2024-03-16T07:24:36.756755+0000","last_became_active":"2024-03-16T07:24:35.777923+0000","last_became_peered":"2024-03-16T07:24:35.777923+0000","last_unstale":"2024-03-16T07:24:36.756755+0000","last_undegraded":"2024-03-16T07:24:36.756755+0000","last_fullsized":"2024-03-16T07:24:36.756755+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:30:37.504916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"15'3","reported_seq":17,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.849963+0000","last_change":"2024-03-16T07:24:34.765980+0000","last_active":"2024-03-16T07:24:36.849963+0000","last_peered":"2024-03-16T07:24:36.849963+0000","last_clean":"2024-03-16T07:24:36.849963+0000","last_became_active":"2024-03-16T07:24:34.765733+0000","last_became_peered":"2024-03-16T07:24:34.765733+0000","last_unstale":"2024-03-16T07:24:36.849963+0000","last_undegraded":"2024-03-16T07:24:36.849963+0000","last_fullsized":"2024-03-16T07:24:36.849963+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_clean_scrub_stamp":"2024-03-16T07:24:33.730276+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:14:50.759285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.849454+0000","last_change":"2024-03-16T07:24:35.764253+0000","last_active":"2024-03-16T07:24:36.849454+0000","last_peered":"2024-03-16T07:24:36.849454+0000","last_clean":"2024-03-16T07:24:36.849454+0000","last_became_active":"2024-03-16T07:24:35.763793+0000","last_became_peered":"2024-03-16T07:24:35.763793+0000","last_unstale":"2024-03-16T07:24:36.849454+0000","last_undegraded":"2024-03-16T07:24:36.849454+0000","last_fullsized":"2024-03-16T07:24:36.849454+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:56:18.247956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"15'6","reported_seq":18,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-03-16T07:24:35.784980+0000","last_change":"2024-03-16T07:24:34.758585+0000","last_active":"2024-03-16T07:24:35.784980+0000","last_peered":"2024-03-16T07:24:35.784980+0000","last_clean":"2024-03-16T07:24:35.784980+0000","last_became_active":"2024-03-16T07:24:34.758296+0000","last_became_peered":"2024-03-16T07:24:34.758296+0000","last_unstale":"2024-03-16T07:24:35.784980+0000","last_undegraded":"2024-03-16T07:24:35.784980+0000","last_fullsized":"2024-03-16T07:24:35.784980+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_clean_scrub_stamp":"2024-03-16T07:24:33.730276+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:50:46.274106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.755819+0000","last_change":"2024-03-16T07:24:35.777232+0000","last_active":"2024-03-16T07:24:36.755819+0000","last_peered":"2024-03-16T07:24:36.755819+0000","last_clean":"2024-03-16T07:24:36.755819+0000","last_became_active":"2024-03-16T07:24:35.776810+0000","last_became_peered":"2024-03-16T07:24:35.776810+0000","last_unstale":"2024-03-16T07:24:36.755819+0000","last_undegraded":"2024-03-16T07:24:36.755819+0000","last_fullsized":"2024-03-16T07:24:36.755819+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:20:30.880693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"15'2","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.755871+0000","last_change":"2024-03-16T07:24:34.759219+0000","last_active":"2024-03-16T07:24:36.755871+0000","last_peered":"2024-03-16T07:24:36.755871+0000","last_clean":"2024-03-16T07:24:36.755871+0000","last_became_active":"2024-03-16T07:24:34.758368+0000","last_became_peered":"2024-03-16T07:24:34.758368+0000","last_unstale":"2024-03-16T07:24:36.755871+0000","last_undegraded":"2024-03-16T07:24:36.755871+0000","last_fullsized":"2024-03-16T07:24:36.755871+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_clean_scrub_stamp":"2024-03-16T07:24:33.730276+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:01:34.459245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.755815+0000","last_change":"2024-03-16T07:24:35.776831+0000","last_active":"2024-03-16T07:24:36.755815+0000","last_peered":"2024-03-16T07:24:36.755815+0000","last_clean":"2024-03-16T07:24:36.755815+0000","last_became_active":"2024-03-16T07:24:35.776251+0000","last_became_peered":"2024-03-16T07:24:35.776251+0000","last_unstale":"2024-03-16T07:24:36.755815+0000","last_undegraded":"2024-03-16T07:24:36.755815+0000","last_fullsized":"2024-03-16T07:24:36.755815+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:01:17.121539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-03-16T07:24:35.752583+0000","last_change":"2024-03-16T07:24:34.758214+0000","last_active":"2024-03-16T07:24:35.752583+0000","last_peered":"2024-03-16T07:24:35.752583+0000","last_clean":"2024-03-16T07:24:35.752583+0000","last_became_active":"2024-03-16T07:24:34.757941+0000","last_became_peered":"2024-03-16T07:24:34.757941+0000","last_unstale":"2024-03-16T07:24:35.752583+0000","last_undegraded":"2024-03-16T07:24:35.752583+0000","last_fullsized":"2024-03-16T07:24:35.752583+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_clean_scrub_stamp":"2024-03-16T07:24:33.730276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:01:11.366672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.849240+0000","last_change":"2024-03-16T07:24:35.780117+0000","last_active":"2024-03-16T07:24:36.849240+0000","last_peered":"2024-03-16T07:24:36.849240+0000","last_clean":"2024-03-16T07:24:36.849240+0000","last_became_active":"2024-03-16T07:24:35.779858+0000","last_became_peered":"2024-03-16T07:24:35.779858+0000","last_unstale":"2024-03-16T07:24:36.849240+0000","last_undegraded":"2024-03-16T07:24:36.849240+0000","last_fullsized":"2024-03-16T07:24:36.849240+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:07:46.246610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.756171+0000","last_change":"2024-03-16T07:24:34.769682+0000","last_active":"2024-03-16T07:24:36.756171+0000","last_peered":"2024-03-16T07:24:36.756171+0000","last_clean":"2024-03-16T07:24:36.756171+0000","last_became_active":"2024-03-16T07:24:34.769389+0000","last_became_peered":"2024-03-16T07:24:34.769389+0000","last_unstale":"2024-03-16T07:24:36.756171+0000","last_undegraded":"2024-03-16T07:24:36.756171+0000","last_fullsized":"2024-03-16T07:24:36.756171+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_clean_scrub_stamp":"2024-03-16T07:24:33.730276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:20:10.353781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.848838+0000","last_change":"2024-03-16T07:24:35.780346+0000","last_active":"2024-03-16T07:24:36.848838+0000","last_peered":"2024-03-16T07:24:36.848838+0000","last_clean":"2024-03-16T07:24:36.848838+0000","last_became_active":"2024-03-16T07:24:35.779994+0000","last_became_peered":"2024-03-16T07:24:35.779994+0000","last_unstale":"2024-03-16T07:24:36.848838+0000","last_undegraded":"2024-03-16T07:24:36.848838+0000","last_fullsized":"2024-03-16T07:24:36.848838+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:36:30.781523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"15'8","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-03-16T07:24:35.769164+0000","last_change":"2024-03-16T07:24:34.759546+0000","last_active":"2024-03-16T07:24:35.769164+0000","last_peered":"2024-03-16T07:24:35.769164+0000","last_clean":"2024-03-16T07:24:35.769164+0000","last_became_active":"2024-03-16T07:24:34.759268+0000","last_became_peered":"2024-03-16T07:24:34.759268+0000","last_unstale":"2024-03-16T07:24:35.769164+0000","last_undegraded":"2024-03-16T07:24:35.769164+0000","last_fullsized":"2024-03-16T07:24:35.769164+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_clean_scrub_stamp":"2024-03-16T07:24:33.730276+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:19:11.558967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-03-16T07:24:35.762746+0000","last_change":"2024-03-16T07:24:35.760480+0000","last_active":"2024-03-16T07:24:35.762746+0000","last_peered":"2024-03-16T07:24:35.762746+0000","last_clean":"2024-03-16T07:24:35.762746+0000","last_became_active":"2024-03-16T07:24:35.759591+0000","last_became_peered":"2024-03-16T07:24:35.759591+0000","last_unstale":"2024-03-16T07:24:35.762746+0000","last_undegraded":"2024-03-16T07:24:35.762746+0000","last_fullsized":"2024-03-16T07:24:35.762746+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:25:32.606316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"15'1","reported_seq":15,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.756998+0000","last_change":"2024-03-16T07:24:34.769491+0000","last_active":"2024-03-16T07:24:36.756998+0000","last_peered":"2024-03-16T07:24:36.756998+0000","last_clean":"2024-03-16T07:24:36.756998+0000","last_became_active":"2024-03-16T07:24:34.769251+0000","last_became_peered":"2024-03-16T07:24:34.769251+0000","last_unstale":"2024-03-16T07:24:36.756998+0000","last_undegraded":"2024-03-16T07:24:36.756998+0000","last_fullsized":"2024-03-16T07:24:36.756998+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_clean_scrub_stamp":"2024-03-16T07:24:33.730276+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:54:01.611832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-03-16T07:24:35.772271+0000","last_change":"2024-03-16T07:24:35.770765+0000","last_active":"2024-03-16T07:24:35.772271+0000","last_peered":"2024-03-16T07:24:35.772271+0000","last_clean":"2024-03-16T07:24:35.772271+0000","last_became_active":"2024-03-16T07:24:35.770379+0000","last_became_peered":"2024-03-16T07:24:35.770379+0000","last_unstale":"2024-03-16T07:24:35.772271+0000","last_undegraded":"2024-03-16T07:24:35.772271+0000","last_fullsized":"2024-03-16T07:24:35.772271+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:48:47.301592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"15'2","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-03-16T07:24:35.772115+0000","last_change":"2024-03-16T07:24:34.762323+0000","last_active":"2024-03-16T07:24:35.772115+0000","last_peered":"2024-03-16T07:24:35.772115+0000","last_clean":"2024-03-16T07:24:35.772115+0000","last_became_active":"2024-03-16T07:24:34.761642+0000","last_became_peered":"2024-03-16T07:24:34.761642+0000","last_unstale":"2024-03-16T07:24:35.772115+0000","last_undegraded":"2024-03-16T07:24:35.772115+0000","last_fullsized":"2024-03-16T07:24:35.772115+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_clean_scrub_stamp":"2024-03-16T07:24:33.730276+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:13:05.731622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.756778+0000","last_change":"2024-03-16T07:24:35.779728+0000","last_active":"2024-03-16T07:24:36.756778+0000","last_peered":"2024-03-16T07:24:36.756778+0000","last_clean":"2024-03-16T07:24:36.756778+0000","last_became_active":"2024-03-16T07:24:35.778072+0000","last_became_peered":"2024-03-16T07:24:35.778072+0000","last_unstale":"2024-03-16T07:24:36.756778+0000","last_undegraded":"2024-03-16T07:24:36.756778+0000","last_fullsized":"2024-03-16T07:24:36.756778+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:50:35.923622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"15'1","reported_seq":15,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.850098+0000","last_change":"2024-03-16T07:24:34.753180+0000","last_active":"2024-03-16T07:24:36.850098+0000","last_peered":"2024-03-16T07:24:36.850098+0000","last_clean":"2024-03-16T07:24:36.850098+0000","last_became_active":"2024-03-16T07:24:34.752884+0000","last_became_peered":"2024-03-16T07:24:34.752884+0000","last_unstale":"2024-03-16T07:24:36.850098+0000","last_undegraded":"2024-03-16T07:24:36.850098+0000","last_fullsized":"2024-03-16T07:24:36.850098+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_clean_scrub_stamp":"2024-03-16T07:24:33.730276+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:01:34.459245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.756599+0000","last_change":"2024-03-16T07:24:35.776993+0000","last_active":"2024-03-16T07:24:36.756599+0000","last_peered":"2024-03-16T07:24:36.756599+0000","last_clean":"2024-03-16T07:24:36.756599+0000","last_became_active":"2024-03-16T07:24:35.776661+0000","last_became_peered":"2024-03-16T07:24:35.776661+0000","last_unstale":"2024-03-16T07:24:36.756599+0000","last_undegraded":"2024-03-16T07:24:36.756599+0000","last_fullsized":"2024-03-16T07:24:36.756599+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:48:42.060438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-03-16T07:24:35.749945+0000","last_change":"2024-03-16T07:24:34.763099+0000","last_active":"2024-03-16T07:24:35.749945+0000","last_peered":"2024-03-16T07:24:35.749945+0000","last_clean":"2024-03-16T07:24:35.749945+0000","last_became_active":"2024-03-16T07:24:34.762791+0000","last_became_peered":"2024-03-16T07:24:34.762791+0000","last_unstale":"2024-03-16T07:24:35.749945+0000","last_undegraded":"2024-03-16T07:24:35.749945+0000","last_fullsized":"2024-03-16T07:24:35.749945+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_clean_scrub_stamp":"2024-03-16T07:24:33.730276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:33:44.266615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.849820+0000","last_change":"2024-03-16T07:24:35.780874+0000","last_active":"2024-03-16T07:24:36.849820+0000","last_peered":"2024-03-16T07:24:36.849820+0000","last_clean":"2024-03-16T07:24:36.849820+0000","last_became_active":"2024-03-16T07:24:35.780663+0000","last_became_peered":"2024-03-16T07:24:35.780663+0000","last_unstale":"2024-03-16T07:24:36.849820+0000","last_undegraded":"2024-03-16T07:24:36.849820+0000","last_fullsized":"2024-03-16T07:24:36.849820+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:49:14.969756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'97","reported_seq":147,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.848896+0000","last_change":"2024-03-16T07:24:31.650537+0000","last_active":"2024-03-16T07:24:36.848896+0000","last_peered":"2024-03-16T07:24:36.848896+0000","last_clean":"2024-03-16T07:24:36.848896+0000","last_became_active":"2024-03-16T07:24:31.649574+0000","last_became_peered":"2024-03-16T07:24:31.649574+0000","last_unstale":"2024-03-16T07:24:36.848896+0000","last_undegraded":"2024-03-16T07:24:36.848896+0000","last_fullsized":"2024-03-16T07:24:36.848896+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:29.719970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:29.719970+0000","last_clean_scrub_stamp":"2024-03-16T07:24:29.719970+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:31:35.774554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.849379+0000","last_change":"2024-03-16T07:24:34.754912+0000","last_active":"2024-03-16T07:24:36.849379+0000","last_peered":"2024-03-16T07:24:36.849379+0000","last_clean":"2024-03-16T07:24:36.849379+0000","last_became_active":"2024-03-16T07:24:34.754625+0000","last_became_peered":"2024-03-16T07:24:34.754625+0000","last_unstale":"2024-03-16T07:24:36.849379+0000","last_undegraded":"2024-03-16T07:24:36.849379+0000","last_fullsized":"2024-03-16T07:24:36.849379+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_clean_scrub_stamp":"2024-03-16T07:24:33.730276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:19:11.558967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.849472+0000","last_change":"2024-03-16T07:24:35.762745+0000","last_active":"2024-03-16T07:24:36.849472+0000","last_peered":"2024-03-16T07:24:36.849472+0000","last_clean":"2024-03-16T07:24:36.849472+0000","last_became_active":"2024-03-16T07:24:35.761427+0000","last_became_peered":"2024-03-16T07:24:35.761427+0000","last_unstale":"2024-03-16T07:24:36.849472+0000","last_undegraded":"2024-03-16T07:24:36.849472+0000","last_fullsized":"2024-03-16T07:24:36.849472+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:48:17.097726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-03-16T07:24:35.752197+0000","last_change":"2024-03-16T07:24:34.760770+0000","last_active":"2024-03-16T07:24:35.752197+0000","last_peered":"2024-03-16T07:24:35.752197+0000","last_clean":"2024-03-16T07:24:35.752197+0000","last_became_active":"2024-03-16T07:24:34.759648+0000","last_became_peered":"2024-03-16T07:24:34.759648+0000","last_unstale":"2024-03-16T07:24:35.752197+0000","last_undegraded":"2024-03-16T07:24:35.752197+0000","last_fullsized":"2024-03-16T07:24:35.752197+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_clean_scrub_stamp":"2024-03-16T07:24:33.730276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:29:27.907682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.755501+0000","last_change":"2024-03-16T07:24:35.763497+0000","last_active":"2024-03-16T07:24:36.755501+0000","last_peered":"2024-03-16T07:24:36.755501+0000","last_clean":"2024-03-16T07:24:36.755501+0000","last_became_active":"2024-03-16T07:24:35.762740+0000","last_became_peered":"2024-03-16T07:24:35.762740+0000","last_unstale":"2024-03-16T07:24:36.755501+0000","last_undegraded":"2024-03-16T07:24:36.755501+0000","last_fullsized":"2024-03-16T07:24:36.755501+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:46:40.677706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-03-16T07:24:35.751059+0000","last_change":"2024-03-16T07:24:34.759060+0000","last_active":"2024-03-16T07:24:35.751059+0000","last_peered":"2024-03-16T07:24:35.751059+0000","last_clean":"2024-03-16T07:24:35.751059+0000","last_became_active":"2024-03-16T07:24:34.758804+0000","last_became_peered":"2024-03-16T07:24:34.758804+0000","last_unstale":"2024-03-16T07:24:35.751059+0000","last_undegraded":"2024-03-16T07:24:35.751059+0000","last_fullsized":"2024-03-16T07:24:35.751059+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_clean_scrub_stamp":"2024-03-16T07:24:33.730276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:56:51.770184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.848935+0000","last_change":"2024-03-16T07:24:35.765622+0000","last_active":"2024-03-16T07:24:36.848935+0000","last_peered":"2024-03-16T07:24:36.848935+0000","last_clean":"2024-03-16T07:24:36.848935+0000","last_became_active":"2024-03-16T07:24:35.765293+0000","last_became_peered":"2024-03-16T07:24:35.765293+0000","last_unstale":"2024-03-16T07:24:36.848935+0000","last_undegraded":"2024-03-16T07:24:36.848935+0000","last_fullsized":"2024-03-16T07:24:36.848935+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:08:27.087631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.755676+0000","last_change":"2024-03-16T07:24:34.769001+0000","last_active":"2024-03-16T07:24:36.755676+0000","last_peered":"2024-03-16T07:24:36.755676+0000","last_clean":"2024-03-16T07:24:36.755676+0000","last_became_active":"2024-03-16T07:24:34.768514+0000","last_became_peered":"2024-03-16T07:24:34.768514+0000","last_unstale":"2024-03-16T07:24:36.755676+0000","last_undegraded":"2024-03-16T07:24:36.755676+0000","last_fullsized":"2024-03-16T07:24:36.755676+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_clean_scrub_stamp":"2024-03-16T07:24:33.730276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:14:50.759285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.755766+0000","last_change":"2024-03-16T07:24:35.764911+0000","last_active":"2024-03-16T07:24:36.755766+0000","last_peered":"2024-03-16T07:24:36.755766+0000","last_clean":"2024-03-16T07:24:36.755766+0000","last_became_active":"2024-03-16T07:24:35.763991+0000","last_became_peered":"2024-03-16T07:24:35.763991+0000","last_unstale":"2024-03-16T07:24:36.755766+0000","last_undegraded":"2024-03-16T07:24:36.755766+0000","last_fullsized":"2024-03-16T07:24:36.755766+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:46:23.561018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.849543+0000","last_change":"2024-03-16T07:24:34.766776+0000","last_active":"2024-03-16T07:24:36.849543+0000","last_peered":"2024-03-16T07:24:36.849543+0000","last_clean":"2024-03-16T07:24:36.849543+0000","last_became_active":"2024-03-16T07:24:34.766401+0000","last_became_peered":"2024-03-16T07:24:34.766401+0000","last_unstale":"2024-03-16T07:24:36.849543+0000","last_undegraded":"2024-03-16T07:24:36.849543+0000","last_fullsized":"2024-03-16T07:24:36.849543+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_clean_scrub_stamp":"2024-03-16T07:24:33.730276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:54:01.611832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-03-16T07:24:35.762564+0000","last_change":"2024-03-16T07:24:35.758786+0000","last_active":"2024-03-16T07:24:35.762564+0000","last_peered":"2024-03-16T07:24:35.762564+0000","last_clean":"2024-03-16T07:24:35.762564+0000","last_became_active":"2024-03-16T07:24:35.758510+0000","last_became_peered":"2024-03-16T07:24:35.758510+0000","last_unstale":"2024-03-16T07:24:35.762564+0000","last_undegraded":"2024-03-16T07:24:35.762564+0000","last_fullsized":"2024-03-16T07:24:35.762564+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:54:02.615841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.850100+0000","last_change":"2024-03-16T07:24:34.767386+0000","last_active":"2024-03-16T07:24:36.850100+0000","last_peered":"2024-03-16T07:24:36.850100+0000","last_clean":"2024-03-16T07:24:36.850100+0000","last_became_active":"2024-03-16T07:24:34.766950+0000","last_became_peered":"2024-03-16T07:24:34.766950+0000","last_unstale":"2024-03-16T07:24:36.850100+0000","last_undegraded":"2024-03-16T07:24:36.850100+0000","last_fullsized":"2024-03-16T07:24:36.850100+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_clean_scrub_stamp":"2024-03-16T07:24:33.730276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:13:05.731622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.849568+0000","last_change":"2024-03-16T07:24:35.764512+0000","last_active":"2024-03-16T07:24:36.849568+0000","last_peered":"2024-03-16T07:24:36.849568+0000","last_clean":"2024-03-16T07:24:36.849568+0000","last_became_active":"2024-03-16T07:24:35.764264+0000","last_became_peered":"2024-03-16T07:24:35.764264+0000","last_unstale":"2024-03-16T07:24:36.849568+0000","last_undegraded":"2024-03-16T07:24:36.849568+0000","last_fullsized":"2024-03-16T07:24:36.849568+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:49:43.762702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"16'1","reported_seq":15,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:37.743513+0000","last_change":"2024-03-16T07:24:34.767319+0000","last_active":"2024-03-16T07:24:37.743513+0000","last_peered":"2024-03-16T07:24:37.743513+0000","last_clean":"2024-03-16T07:24:37.743513+0000","last_became_active":"2024-03-16T07:24:34.767028+0000","last_became_peered":"2024-03-16T07:24:34.767028+0000","last_unstale":"2024-03-16T07:24:37.743513+0000","last_undegraded":"2024-03-16T07:24:37.743513+0000","last_fullsized":"2024-03-16T07:24:37.743513+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_clean_scrub_stamp":"2024-03-16T07:24:33.730276+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:29:27.907682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-03-16T07:24:35.762690+0000","last_change":"2024-03-16T07:24:35.758709+0000","last_active":"2024-03-16T07:24:35.762690+0000","last_peered":"2024-03-16T07:24:35.762690+0000","last_clean":"2024-03-16T07:24:35.762690+0000","last_became_active":"2024-03-16T07:24:35.758160+0000","last_became_peered":"2024-03-16T07:24:35.758160+0000","last_unstale":"2024-03-16T07:24:35.762690+0000","last_undegraded":"2024-03-16T07:24:35.762690+0000","last_fullsized":"2024-03-16T07:24:35.762690+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:59:18.388937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"15'2","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.850272+0000","last_change":"2024-03-16T07:24:34.767310+0000","last_active":"2024-03-16T07:24:36.850272+0000","last_peered":"2024-03-16T07:24:36.850272+0000","last_clean":"2024-03-16T07:24:36.850272+0000","last_became_active":"2024-03-16T07:24:34.767009+0000","last_became_peered":"2024-03-16T07:24:34.767009+0000","last_unstale":"2024-03-16T07:24:36.850272+0000","last_undegraded":"2024-03-16T07:24:36.850272+0000","last_fullsized":"2024-03-16T07:24:36.850272+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_clean_scrub_stamp":"2024-03-16T07:24:33.730276+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:59:17.384928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.756195+0000","last_change":"2024-03-16T07:24:35.775915+0000","last_active":"2024-03-16T07:24:36.756195+0000","last_peered":"2024-03-16T07:24:36.756195+0000","last_clean":"2024-03-16T07:24:36.756195+0000","last_became_active":"2024-03-16T07:24:35.775655+0000","last_became_peered":"2024-03-16T07:24:35.775655+0000","last_unstale":"2024-03-16T07:24:36.756195+0000","last_undegraded":"2024-03-16T07:24:36.756195+0000","last_fullsized":"2024-03-16T07:24:36.756195+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:03:48.855314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.755137+0000","last_change":"2024-03-16T07:24:34.756852+0000","last_active":"2024-03-16T07:24:36.755137+0000","last_peered":"2024-03-16T07:24:36.755137+0000","last_clean":"2024-03-16T07:24:36.755137+0000","last_became_active":"2024-03-16T07:24:34.756442+0000","last_became_peered":"2024-03-16T07:24:34.756442+0000","last_unstale":"2024-03-16T07:24:36.755137+0000","last_undegraded":"2024-03-16T07:24:36.755137+0000","last_fullsized":"2024-03-16T07:24:36.755137+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_clean_scrub_stamp":"2024-03-16T07:24:33.730276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:19:11.558967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.756355+0000","last_change":"2024-03-16T07:24:35.763701+0000","last_active":"2024-03-16T07:24:36.756355+0000","last_peered":"2024-03-16T07:24:36.756355+0000","last_clean":"2024-03-16T07:24:36.756355+0000","last_became_active":"2024-03-16T07:24:35.763057+0000","last_became_peered":"2024-03-16T07:24:35.763057+0000","last_unstale":"2024-03-16T07:24:36.756355+0000","last_undegraded":"2024-03-16T07:24:36.756355+0000","last_fullsized":"2024-03-16T07:24:36.756355+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:05:30.548134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.849075+0000","last_change":"2024-03-16T07:24:34.764391+0000","last_active":"2024-03-16T07:24:36.849075+0000","last_peered":"2024-03-16T07:24:36.849075+0000","last_clean":"2024-03-16T07:24:36.849075+0000","last_became_active":"2024-03-16T07:24:34.764118+0000","last_became_peered":"2024-03-16T07:24:34.764118+0000","last_unstale":"2024-03-16T07:24:36.849075+0000","last_undegraded":"2024-03-16T07:24:36.849075+0000","last_fullsized":"2024-03-16T07:24:36.849075+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_clean_scrub_stamp":"2024-03-16T07:24:33.730276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:01:11.366672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-03-16T07:24:35.766725+0000","last_change":"2024-03-16T07:24:35.765029+0000","last_active":"2024-03-16T07:24:35.766725+0000","last_peered":"2024-03-16T07:24:35.766725+0000","last_clean":"2024-03-16T07:24:35.766725+0000","last_became_active":"2024-03-16T07:24:35.763997+0000","last_became_peered":"2024-03-16T07:24:35.763997+0000","last_unstale":"2024-03-16T07:24:35.766725+0000","last_undegraded":"2024-03-16T07:24:35.766725+0000","last_fullsized":"2024-03-16T07:24:35.766725+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:18:27.539454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.849280+0000","last_change":"2024-03-16T07:24:34.767533+0000","last_active":"2024-03-16T07:24:36.849280+0000","last_peered":"2024-03-16T07:24:36.849280+0000","last_clean":"2024-03-16T07:24:36.849280+0000","last_became_active":"2024-03-16T07:24:34.767181+0000","last_became_peered":"2024-03-16T07:24:34.767181+0000","last_unstale":"2024-03-16T07:24:36.849280+0000","last_undegraded":"2024-03-16T07:24:36.849280+0000","last_fullsized":"2024-03-16T07:24:36.849280+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_clean_scrub_stamp":"2024-03-16T07:24:33.730276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:20:10.353781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.849281+0000","last_change":"2024-03-16T07:24:35.761697+0000","last_active":"2024-03-16T07:24:36.849281+0000","last_peered":"2024-03-16T07:24:36.849281+0000","last_clean":"2024-03-16T07:24:36.849281+0000","last_became_active":"2024-03-16T07:24:35.760988+0000","last_became_peered":"2024-03-16T07:24:35.760988+0000","last_unstale":"2024-03-16T07:24:36.849281+0000","last_undegraded":"2024-03-16T07:24:36.849281+0000","last_fullsized":"2024-03-16T07:24:36.849281+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:03:38.294045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"15'2","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.756043+0000","last_change":"2024-03-16T07:24:34.758088+0000","last_active":"2024-03-16T07:24:36.756043+0000","last_peered":"2024-03-16T07:24:36.756043+0000","last_clean":"2024-03-16T07:24:36.756043+0000","last_became_active":"2024-03-16T07:24:34.757786+0000","last_became_peered":"2024-03-16T07:24:34.757786+0000","last_unstale":"2024-03-16T07:24:36.756043+0000","last_undegraded":"2024-03-16T07:24:36.756043+0000","last_fullsized":"2024-03-16T07:24:36.756043+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_clean_scrub_stamp":"2024-03-16T07:24:33.730276+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:13:05.731622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.755517+0000","last_change":"2024-03-16T07:24:35.776598+0000","last_active":"2024-03-16T07:24:36.755517+0000","last_peered":"2024-03-16T07:24:36.755517+0000","last_clean":"2024-03-16T07:24:36.755517+0000","last_became_active":"2024-03-16T07:24:35.775720+0000","last_became_peered":"2024-03-16T07:24:35.775720+0000","last_unstale":"2024-03-16T07:24:36.755517+0000","last_undegraded":"2024-03-16T07:24:36.755517+0000","last_fullsized":"2024-03-16T07:24:36.755517+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:31:37.132704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-03-16T07:24:35.759454+0000","last_change":"2024-03-16T07:24:35.755090+0000","last_active":"2024-03-16T07:24:35.759454+0000","last_peered":"2024-03-16T07:24:35.759454+0000","last_clean":"2024-03-16T07:24:35.759454+0000","last_became_active":"2024-03-16T07:24:35.754826+0000","last_became_peered":"2024-03-16T07:24:35.754826+0000","last_unstale":"2024-03-16T07:24:35.759454+0000","last_undegraded":"2024-03-16T07:24:35.759454+0000","last_fullsized":"2024-03-16T07:24:35.759454+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:14:51.763294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"15'2","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.756725+0000","last_change":"2024-03-16T07:24:34.768833+0000","last_active":"2024-03-16T07:24:36.756725+0000","last_peered":"2024-03-16T07:24:36.756725+0000","last_clean":"2024-03-16T07:24:36.756725+0000","last_became_active":"2024-03-16T07:24:34.768533+0000","last_became_peered":"2024-03-16T07:24:34.768533+0000","last_unstale":"2024-03-16T07:24:36.756725+0000","last_undegraded":"2024-03-16T07:24:36.756725+0000","last_fullsized":"2024-03-16T07:24:36.756725+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_clean_scrub_stamp":"2024-03-16T07:24:33.730276+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:59:17.384928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.849426+0000","last_change":"2024-03-16T07:24:35.782627+0000","last_active":"2024-03-16T07:24:36.849426+0000","last_peered":"2024-03-16T07:24:36.849426+0000","last_clean":"2024-03-16T07:24:36.849426+0000","last_became_active":"2024-03-16T07:24:35.782339+0000","last_became_peered":"2024-03-16T07:24:35.782339+0000","last_unstale":"2024-03-16T07:24:36.849426+0000","last_undegraded":"2024-03-16T07:24:36.849426+0000","last_fullsized":"2024-03-16T07:24:36.849426+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:15:00.108070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"15'2","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.756518+0000","last_change":"2024-03-16T07:24:34.768858+0000","last_active":"2024-03-16T07:24:36.756518+0000","last_peered":"2024-03-16T07:24:36.756518+0000","last_clean":"2024-03-16T07:24:36.756518+0000","last_became_active":"2024-03-16T07:24:34.768558+0000","last_became_peered":"2024-03-16T07:24:34.768558+0000","last_unstale":"2024-03-16T07:24:36.756518+0000","last_undegraded":"2024-03-16T07:24:36.756518+0000","last_fullsized":"2024-03-16T07:24:36.756518+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_clean_scrub_stamp":"2024-03-16T07:24:33.730276+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:25:31.602307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.756628+0000","last_change":"2024-03-16T07:24:35.778556+0000","last_active":"2024-03-16T07:24:36.756628+0000","last_peered":"2024-03-16T07:24:36.756628+0000","last_clean":"2024-03-16T07:24:36.756628+0000","last_became_active":"2024-03-16T07:24:35.777574+0000","last_became_peered":"2024-03-16T07:24:35.777574+0000","last_unstale":"2024-03-16T07:24:36.756628+0000","last_undegraded":"2024-03-16T07:24:36.756628+0000","last_fullsized":"2024-03-16T07:24:36.756628+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:25:26.895206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"15'1","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-03-16T07:24:35.772214+0000","last_change":"2024-03-16T07:24:34.762078+0000","last_active":"2024-03-16T07:24:35.772214+0000","last_peered":"2024-03-16T07:24:35.772214+0000","last_clean":"2024-03-16T07:24:35.772214+0000","last_became_active":"2024-03-16T07:24:34.761242+0000","last_became_peered":"2024-03-16T07:24:34.761242+0000","last_unstale":"2024-03-16T07:24:35.772214+0000","last_undegraded":"2024-03-16T07:24:35.772214+0000","last_fullsized":"2024-03-16T07:24:35.772214+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_clean_scrub_stamp":"2024-03-16T07:24:33.730276+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:01:34.459245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-03-16T07:24:35.767802+0000","last_change":"2024-03-16T07:24:35.763919+0000","last_active":"2024-03-16T07:24:35.767802+0000","last_peered":"2024-03-16T07:24:35.767802+0000","last_clean":"2024-03-16T07:24:35.767802+0000","last_became_active":"2024-03-16T07:24:35.763643+0000","last_became_peered":"2024-03-16T07:24:35.763643+0000","last_unstale":"2024-03-16T07:24:35.767802+0000","last_undegraded":"2024-03-16T07:24:35.767802+0000","last_fullsized":"2024-03-16T07:24:35.767802+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:14:00.464456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"15'4","reported_seq":18,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.756909+0000","last_change":"2024-03-16T07:24:34.770349+0000","last_active":"2024-03-16T07:24:36.756909+0000","last_peered":"2024-03-16T07:24:36.756909+0000","last_clean":"2024-03-16T07:24:36.756909+0000","last_became_active":"2024-03-16T07:24:34.770054+0000","last_became_peered":"2024-03-16T07:24:34.770054+0000","last_unstale":"2024-03-16T07:24:36.756909+0000","last_undegraded":"2024-03-16T07:24:36.756909+0000","last_fullsized":"2024-03-16T07:24:36.756909+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_clean_scrub_stamp":"2024-03-16T07:24:33.730276+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:09:12.533977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738372,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27168,"kb_used_data":148,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":104830432,"statfs":{"total":107374182400,"available":107346362368,"internally_reserved":0,"allocated":151552,"data_stored":40456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738372,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27768,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":104829832,"statfs":{"total":107374182400,"available":107345747968,"internally_reserved":0,"allocated":761856,"data_stored":635514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738372,"num_pgs":74,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27756,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":104829844,"statfs":{"total":107374182400,"available":107345760256,"internally_reserved":0,"allocated":749568,"data_stored":633866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-16T07:24:40.231 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-03-16T07:24:40.232 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-03-16T07:24:40.232 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-03-16T07:24:40.232 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-03-16T07:24:40.232 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-03-16T07:24:40.693 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:24:40.705 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":5,"flags":0,"active_gid":4101,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":3723994962},{"type":"v1","addr":"172.21.15.49:6825","nonce":3723994962}]},"active_addr":"172.21.15.49:6825/3723994962","active_change":"2024-03-16T07:24:24.892502+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.49:0","nonce":2278133012}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.49:0","nonce":1600139833}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.49:0","nonce":1380123362}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.49:0","nonce":2280956996}]}]} 2024-03-16T07:24:40.706 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-03-16T07:24:40.706 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-03-16T07:24:40.707 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T07:24:41.216 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:24:41.216 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":16,"fsid":"f91af061-9eac-4793-87fa-8d27ae3d242f","created":"2024-03-16T07:24:20.357868+0000","modified":"2024-03-16T07:24:36.750684+0000","last_up_change":"2024-03-16T07:24:27.474980+0000","last_in_change":"2024-03-16T07:24:21.254179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T07:24:28.947521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-16T07:24:32.994128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-16T07:24:34.097577+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3600000143051147,"score_stable":1.3600000143051147,"optimal_score":1,"raw_score_acting":1.3600000143051147,"raw_score_stable":1.3600000143051147,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2df14aac-98dc-4e3c-ae7e-9eb677aa30be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6801","nonce":2744935777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6803","nonce":2744935777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6807","nonce":2744935777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6805","nonce":2744935777}]},"public_addr":"172.21.15.49:6801/2744935777","cluster_addr":"172.21.15.49:6803/2744935777","heartbeat_back_addr":"172.21.15.49:6807/2744935777","heartbeat_front_addr":"172.21.15.49:6805/2744935777","state":["exists","up"]},{"osd":1,"uuid":"80461bd9-59ef-46df-9eea-bad92d960c57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6811","nonce":1655120118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6815","nonce":1655120118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6821","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6823","nonce":1655120118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6817","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6819","nonce":1655120118}]},"public_addr":"172.21.15.49:6811/1655120118","cluster_addr":"172.21.15.49:6815/1655120118","heartbeat_back_addr":"172.21.15.49:6823/1655120118","heartbeat_front_addr":"172.21.15.49:6819/1655120118","state":["exists","up"]},{"osd":2,"uuid":"d6bf40eb-6e42-4ec9-8b3d-0b6c5a6def79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6810","nonce":3815472376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6814","nonce":3815472376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6822","nonce":3815472376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6818","nonce":3815472376}]},"public_addr":"172.21.15.49:6810/3815472376","cluster_addr":"172.21.15.49:6814/3815472376","heartbeat_back_addr":"172.21.15.49:6822/3815472376","heartbeat_front_addr":"172.21.15.49:6818/3815472376","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.641492+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.668598+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.614940+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T07:24:41.230 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-03-16T07:24:41.230 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T07:24:41.532 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:24:41.533 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":16,"fsid":"f91af061-9eac-4793-87fa-8d27ae3d242f","created":"2024-03-16T07:24:20.357868+0000","modified":"2024-03-16T07:24:36.750684+0000","last_up_change":"2024-03-16T07:24:27.474980+0000","last_in_change":"2024-03-16T07:24:21.254179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T07:24:28.947521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-16T07:24:32.994128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-16T07:24:34.097577+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3600000143051147,"score_stable":1.3600000143051147,"optimal_score":1,"raw_score_acting":1.3600000143051147,"raw_score_stable":1.3600000143051147,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2df14aac-98dc-4e3c-ae7e-9eb677aa30be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6801","nonce":2744935777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6803","nonce":2744935777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6807","nonce":2744935777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6805","nonce":2744935777}]},"public_addr":"172.21.15.49:6801/2744935777","cluster_addr":"172.21.15.49:6803/2744935777","heartbeat_back_addr":"172.21.15.49:6807/2744935777","heartbeat_front_addr":"172.21.15.49:6805/2744935777","state":["exists","up"]},{"osd":1,"uuid":"80461bd9-59ef-46df-9eea-bad92d960c57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6811","nonce":1655120118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6815","nonce":1655120118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6821","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6823","nonce":1655120118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6817","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6819","nonce":1655120118}]},"public_addr":"172.21.15.49:6811/1655120118","cluster_addr":"172.21.15.49:6815/1655120118","heartbeat_back_addr":"172.21.15.49:6823/1655120118","heartbeat_front_addr":"172.21.15.49:6819/1655120118","state":["exists","up"]},{"osd":2,"uuid":"d6bf40eb-6e42-4ec9-8b3d-0b6c5a6def79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6810","nonce":3815472376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6814","nonce":3815472376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6822","nonce":3815472376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6818","nonce":3815472376}]},"public_addr":"172.21.15.49:6810/3815472376","cluster_addr":"172.21.15.49:6814/3815472376","heartbeat_back_addr":"172.21.15.49:6822/3815472376","heartbeat_front_addr":"172.21.15.49:6818/3815472376","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.641492+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.668598+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.614940+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T07:24:41.547 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-03-16T07:24:41.547 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-03-16T07:24:41.547 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-03-16T07:24:41.711 INFO:teuthology.orchestra.run.smithi049.stdout:34359738373 2024-03-16T07:24:41.712 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-03-16T07:24:41.712 INFO:teuthology.orchestra.run.smithi049.stdout:34359738373 2024-03-16T07:24:41.713 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-03-16T07:24:41.716 INFO:teuthology.orchestra.run.smithi049.stdout:34359738373 2024-03-16T07:24:41.716 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-03-16T07:24:42.087 INFO:teuthology.orchestra.run.smithi049.stdout:34359738372 2024-03-16T07:24:42.104 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738373 got 34359738372 for osd.1 2024-03-16T07:24:42.110 INFO:teuthology.orchestra.run.smithi049.stdout:34359738372 2024-03-16T07:24:42.124 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738373 got 34359738372 for osd.0 2024-03-16T07:24:42.141 INFO:teuthology.orchestra.run.smithi049.stdout:34359738372 2024-03-16T07:24:42.154 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738373 got 34359738372 for osd.2 2024-03-16T07:24:43.106 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-03-16T07:24:43.124 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-03-16T07:24:43.155 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-03-16T07:24:43.473 INFO:teuthology.orchestra.run.smithi049.stdout:34359738372 2024-03-16T07:24:43.486 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738373 got 34359738372 for osd.1 2024-03-16T07:24:43.505 INFO:teuthology.orchestra.run.smithi049.stdout:34359738372 2024-03-16T07:24:43.518 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738373 got 34359738372 for osd.0 2024-03-16T07:24:43.532 INFO:teuthology.orchestra.run.smithi049.stdout:34359738372 2024-03-16T07:24:43.544 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738373 got 34359738372 for osd.2 2024-03-16T07:24:44.487 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-03-16T07:24:44.518 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-03-16T07:24:44.545 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-03-16T07:24:44.857 INFO:teuthology.orchestra.run.smithi049.stdout:34359738373 2024-03-16T07:24:44.870 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738373 got 34359738373 for osd.1 2024-03-16T07:24:44.871 DEBUG:teuthology.parallel:result is None 2024-03-16T07:24:44.888 INFO:teuthology.orchestra.run.smithi049.stdout:34359738373 2024-03-16T07:24:44.901 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738373 got 34359738373 for osd.2 2024-03-16T07:24:44.902 DEBUG:teuthology.parallel:result is None 2024-03-16T07:24:44.945 INFO:teuthology.orchestra.run.smithi049.stdout:34359738373 2024-03-16T07:24:44.958 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738373 got 34359738373 for osd.0 2024-03-16T07:24:44.958 DEBUG:teuthology.parallel:result is None 2024-03-16T07:24:44.958 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-03-16T07:24:44.958 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-16T07:24:45.262 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:24:45.263 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2024-03-16T07:24:45.272 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-03-16T07:24:44.899644+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":182,"num_write_kb":1908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":136,"ondisk_log_size":136,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":314572800,"kb_used":82704,"kb_used_data":1632,"kb_used_omap":4,"kb_used_meta":81019,"kb_avail":314490096,"statfs":{"total":322122547200,"available":322037858304,"internally_reserved":0,"allocated":1671168,"data_stored":1313866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":82963791},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.160136"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.756601+0000","last_change":"2024-03-16T07:24:35.778195+0000","last_active":"2024-03-16T07:24:36.756601+0000","last_peered":"2024-03-16T07:24:36.756601+0000","last_clean":"2024-03-16T07:24:36.756601+0000","last_became_active":"2024-03-16T07:24:35.777228+0000","last_became_peered":"2024-03-16T07:24:35.777228+0000","last_unstale":"2024-03-16T07:24:36.756601+0000","last_undegraded":"2024-03-16T07:24:36.756601+0000","last_fullsized":"2024-03-16T07:24:36.756601+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:06:55.141496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.850057+0000","last_change":"2024-03-16T07:24:35.782627+0000","last_active":"2024-03-16T07:24:36.850057+0000","last_peered":"2024-03-16T07:24:36.850057+0000","last_clean":"2024-03-16T07:24:36.850057+0000","last_became_active":"2024-03-16T07:24:35.782357+0000","last_became_peered":"2024-03-16T07:24:35.782357+0000","last_unstale":"2024-03-16T07:24:36.850057+0000","last_undegraded":"2024-03-16T07:24:36.850057+0000","last_fullsized":"2024-03-16T07:24:36.850057+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:28:16.855057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.756432+0000","last_change":"2024-03-16T07:24:35.763326+0000","last_active":"2024-03-16T07:24:36.756432+0000","last_peered":"2024-03-16T07:24:36.756432+0000","last_clean":"2024-03-16T07:24:36.756432+0000","last_became_active":"2024-03-16T07:24:35.763103+0000","last_became_peered":"2024-03-16T07:24:35.763103+0000","last_unstale":"2024-03-16T07:24:36.756432+0000","last_undegraded":"2024-03-16T07:24:36.756432+0000","last_fullsized":"2024-03-16T07:24:36.756432+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:27:51.581736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:38.551428+0000","last_change":"2024-03-16T07:24:35.762619+0000","last_active":"2024-03-16T07:24:38.551428+0000","last_peered":"2024-03-16T07:24:38.551428+0000","last_clean":"2024-03-16T07:24:38.551428+0000","last_became_active":"2024-03-16T07:24:35.761493+0000","last_became_peered":"2024-03-16T07:24:35.761493+0000","last_unstale":"2024-03-16T07:24:38.551428+0000","last_undegraded":"2024-03-16T07:24:38.551428+0000","last_fullsized":"2024-03-16T07:24:38.551428+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:31:08.610234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.755923+0000","last_change":"2024-03-16T07:24:35.767433+0000","last_active":"2024-03-16T07:24:36.755923+0000","last_peered":"2024-03-16T07:24:36.755923+0000","last_clean":"2024-03-16T07:24:36.755923+0000","last_became_active":"2024-03-16T07:24:35.764667+0000","last_became_peered":"2024-03-16T07:24:35.764667+0000","last_unstale":"2024-03-16T07:24:36.755923+0000","last_undegraded":"2024-03-16T07:24:36.755923+0000","last_fullsized":"2024-03-16T07:24:36.755923+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:18:18.873930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:38.551220+0000","last_change":"2024-03-16T07:24:35.762404+0000","last_active":"2024-03-16T07:24:38.551220+0000","last_peered":"2024-03-16T07:24:38.551220+0000","last_clean":"2024-03-16T07:24:38.551220+0000","last_became_active":"2024-03-16T07:24:35.760824+0000","last_became_peered":"2024-03-16T07:24:35.760824+0000","last_unstale":"2024-03-16T07:24:38.551220+0000","last_undegraded":"2024-03-16T07:24:38.551220+0000","last_fullsized":"2024-03-16T07:24:38.551220+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:36:30.781523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.756044+0000","last_change":"2024-03-16T07:24:35.775068+0000","last_active":"2024-03-16T07:24:36.756044+0000","last_peered":"2024-03-16T07:24:36.756044+0000","last_clean":"2024-03-16T07:24:36.756044+0000","last_became_active":"2024-03-16T07:24:35.774830+0000","last_became_peered":"2024-03-16T07:24:35.774830+0000","last_unstale":"2024-03-16T07:24:36.756044+0000","last_undegraded":"2024-03-16T07:24:36.756044+0000","last_fullsized":"2024-03-16T07:24:36.756044+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:55:12.697679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:38.551005+0000","last_change":"2024-03-16T07:24:35.763436+0000","last_active":"2024-03-16T07:24:38.551005+0000","last_peered":"2024-03-16T07:24:38.551005+0000","last_clean":"2024-03-16T07:24:38.551005+0000","last_became_active":"2024-03-16T07:24:35.763190+0000","last_became_peered":"2024-03-16T07:24:35.763190+0000","last_unstale":"2024-03-16T07:24:38.551005+0000","last_undegraded":"2024-03-16T07:24:38.551005+0000","last_fullsized":"2024-03-16T07:24:38.551005+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:10:18.237714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.850174+0000","last_change":"2024-03-16T07:24:35.783289+0000","last_active":"2024-03-16T07:24:36.850174+0000","last_peered":"2024-03-16T07:24:36.850174+0000","last_clean":"2024-03-16T07:24:36.850174+0000","last_became_active":"2024-03-16T07:24:35.782803+0000","last_became_peered":"2024-03-16T07:24:35.782803+0000","last_unstale":"2024-03-16T07:24:36.850174+0000","last_undegraded":"2024-03-16T07:24:36.850174+0000","last_fullsized":"2024-03-16T07:24:36.850174+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:14:25.797393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.756381+0000","last_change":"2024-03-16T07:24:35.767189+0000","last_active":"2024-03-16T07:24:36.756381+0000","last_peered":"2024-03-16T07:24:36.756381+0000","last_clean":"2024-03-16T07:24:36.756381+0000","last_became_active":"2024-03-16T07:24:35.766948+0000","last_became_peered":"2024-03-16T07:24:35.766948+0000","last_unstale":"2024-03-16T07:24:36.756381+0000","last_undegraded":"2024-03-16T07:24:36.756381+0000","last_fullsized":"2024-03-16T07:24:36.756381+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:39:05.051025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.755497+0000","last_change":"2024-03-16T07:24:35.778348+0000","last_active":"2024-03-16T07:24:36.755497+0000","last_peered":"2024-03-16T07:24:36.755497+0000","last_clean":"2024-03-16T07:24:36.755497+0000","last_became_active":"2024-03-16T07:24:35.777733+0000","last_became_peered":"2024-03-16T07:24:35.777733+0000","last_unstale":"2024-03-16T07:24:36.755497+0000","last_undegraded":"2024-03-16T07:24:36.755497+0000","last_fullsized":"2024-03-16T07:24:36.755497+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:00:23.312298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.756312+0000","last_change":"2024-03-16T07:24:35.776673+0000","last_active":"2024-03-16T07:24:36.756312+0000","last_peered":"2024-03-16T07:24:36.756312+0000","last_clean":"2024-03-16T07:24:36.756312+0000","last_became_active":"2024-03-16T07:24:35.776273+0000","last_became_peered":"2024-03-16T07:24:35.776273+0000","last_unstale":"2024-03-16T07:24:36.756312+0000","last_undegraded":"2024-03-16T07:24:36.756312+0000","last_fullsized":"2024-03-16T07:24:36.756312+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:21:36.876625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.756012+0000","last_change":"2024-03-16T07:24:35.776794+0000","last_active":"2024-03-16T07:24:36.756012+0000","last_peered":"2024-03-16T07:24:36.756012+0000","last_clean":"2024-03-16T07:24:36.756012+0000","last_became_active":"2024-03-16T07:24:35.775472+0000","last_became_peered":"2024-03-16T07:24:35.775472+0000","last_unstale":"2024-03-16T07:24:36.756012+0000","last_undegraded":"2024-03-16T07:24:36.756012+0000","last_fullsized":"2024-03-16T07:24:36.756012+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:47:00.624947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.755298+0000","last_change":"2024-03-16T07:24:35.777171+0000","last_active":"2024-03-16T07:24:36.755298+0000","last_peered":"2024-03-16T07:24:36.755298+0000","last_clean":"2024-03-16T07:24:36.755298+0000","last_became_active":"2024-03-16T07:24:35.776959+0000","last_became_peered":"2024-03-16T07:24:35.776959+0000","last_unstale":"2024-03-16T07:24:36.755298+0000","last_undegraded":"2024-03-16T07:24:36.755298+0000","last_fullsized":"2024-03-16T07:24:36.755298+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:15:02.699193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.848996+0000","last_change":"2024-03-16T07:24:35.779625+0000","last_active":"2024-03-16T07:24:36.848996+0000","last_peered":"2024-03-16T07:24:36.848996+0000","last_clean":"2024-03-16T07:24:36.848996+0000","last_became_active":"2024-03-16T07:24:35.779369+0000","last_became_peered":"2024-03-16T07:24:35.779369+0000","last_unstale":"2024-03-16T07:24:36.848996+0000","last_undegraded":"2024-03-16T07:24:36.848996+0000","last_fullsized":"2024-03-16T07:24:36.848996+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:31:08.610234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:38.551193+0000","last_change":"2024-03-16T07:24:35.771934+0000","last_active":"2024-03-16T07:24:38.551193+0000","last_peered":"2024-03-16T07:24:38.551193+0000","last_clean":"2024-03-16T07:24:38.551193+0000","last_became_active":"2024-03-16T07:24:35.771550+0000","last_became_peered":"2024-03-16T07:24:35.771550+0000","last_unstale":"2024-03-16T07:24:38.551193+0000","last_undegraded":"2024-03-16T07:24:38.551193+0000","last_fullsized":"2024-03-16T07:24:38.551193+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:07:46.246610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.850325+0000","last_change":"2024-03-16T07:24:35.778996+0000","last_active":"2024-03-16T07:24:36.850325+0000","last_peered":"2024-03-16T07:24:36.850325+0000","last_clean":"2024-03-16T07:24:36.850325+0000","last_became_active":"2024-03-16T07:24:35.778760+0000","last_became_peered":"2024-03-16T07:24:35.778760+0000","last_unstale":"2024-03-16T07:24:36.850325+0000","last_undegraded":"2024-03-16T07:24:36.850325+0000","last_fullsized":"2024-03-16T07:24:36.850325+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:15:02.699193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:38.551452+0000","last_change":"2024-03-16T07:24:35.770074+0000","last_active":"2024-03-16T07:24:38.551452+0000","last_peered":"2024-03-16T07:24:38.551452+0000","last_clean":"2024-03-16T07:24:38.551452+0000","last_became_active":"2024-03-16T07:24:35.769797+0000","last_became_peered":"2024-03-16T07:24:35.769797+0000","last_unstale":"2024-03-16T07:24:38.551452+0000","last_undegraded":"2024-03-16T07:24:38.551452+0000","last_fullsized":"2024-03-16T07:24:38.551452+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:13:21.265017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.756228+0000","last_change":"2024-03-16T07:24:35.755806+0000","last_active":"2024-03-16T07:24:36.756228+0000","last_peered":"2024-03-16T07:24:36.756228+0000","last_clean":"2024-03-16T07:24:36.756228+0000","last_became_active":"2024-03-16T07:24:35.755548+0000","last_became_peered":"2024-03-16T07:24:35.755548+0000","last_unstale":"2024-03-16T07:24:36.756228+0000","last_undegraded":"2024-03-16T07:24:36.756228+0000","last_fullsized":"2024-03-16T07:24:36.756228+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:58:56.672206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.756631+0000","last_change":"2024-03-16T07:24:35.776892+0000","last_active":"2024-03-16T07:24:36.756631+0000","last_peered":"2024-03-16T07:24:36.756631+0000","last_clean":"2024-03-16T07:24:36.756631+0000","last_became_active":"2024-03-16T07:24:35.776396+0000","last_became_peered":"2024-03-16T07:24:35.776396+0000","last_unstale":"2024-03-16T07:24:36.756631+0000","last_undegraded":"2024-03-16T07:24:36.756631+0000","last_fullsized":"2024-03-16T07:24:36.756631+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:20:25.574088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.755333+0000","last_change":"2024-03-16T07:24:35.766783+0000","last_active":"2024-03-16T07:24:36.755333+0000","last_peered":"2024-03-16T07:24:36.755333+0000","last_clean":"2024-03-16T07:24:36.755333+0000","last_became_active":"2024-03-16T07:24:35.764320+0000","last_became_peered":"2024-03-16T07:24:35.764320+0000","last_unstale":"2024-03-16T07:24:36.755333+0000","last_undegraded":"2024-03-16T07:24:36.755333+0000","last_fullsized":"2024-03-16T07:24:36.755333+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:52:47.872518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.849137+0000","last_change":"2024-03-16T07:24:35.781061+0000","last_active":"2024-03-16T07:24:36.849137+0000","last_peered":"2024-03-16T07:24:36.849137+0000","last_clean":"2024-03-16T07:24:36.849137+0000","last_became_active":"2024-03-16T07:24:35.780821+0000","last_became_peered":"2024-03-16T07:24:35.780821+0000","last_unstale":"2024-03-16T07:24:36.849137+0000","last_undegraded":"2024-03-16T07:24:36.849137+0000","last_fullsized":"2024-03-16T07:24:36.849137+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:13:21.265017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.754999+0000","last_change":"2024-03-16T07:24:35.763299+0000","last_active":"2024-03-16T07:24:36.754999+0000","last_peered":"2024-03-16T07:24:36.754999+0000","last_clean":"2024-03-16T07:24:36.754999+0000","last_became_active":"2024-03-16T07:24:35.760540+0000","last_became_peered":"2024-03-16T07:24:35.760540+0000","last_unstale":"2024-03-16T07:24:36.754999+0000","last_undegraded":"2024-03-16T07:24:36.754999+0000","last_fullsized":"2024-03-16T07:24:36.754999+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:28:16.855057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.755114+0000","last_change":"2024-03-16T07:24:35.768963+0000","last_active":"2024-03-16T07:24:36.755114+0000","last_peered":"2024-03-16T07:24:36.755114+0000","last_clean":"2024-03-16T07:24:36.755114+0000","last_became_active":"2024-03-16T07:24:35.768551+0000","last_became_peered":"2024-03-16T07:24:35.768551+0000","last_unstale":"2024-03-16T07:24:36.755114+0000","last_undegraded":"2024-03-16T07:24:36.755114+0000","last_fullsized":"2024-03-16T07:24:36.755114+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:14:25.797393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:38.552082+0000","last_change":"2024-03-16T07:24:35.758470+0000","last_active":"2024-03-16T07:24:38.552082+0000","last_peered":"2024-03-16T07:24:38.552082+0000","last_clean":"2024-03-16T07:24:38.552082+0000","last_became_active":"2024-03-16T07:24:35.757833+0000","last_became_peered":"2024-03-16T07:24:35.757833+0000","last_unstale":"2024-03-16T07:24:38.552082+0000","last_undegraded":"2024-03-16T07:24:38.552082+0000","last_fullsized":"2024-03-16T07:24:38.552082+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:49:43.762702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:38.551943+0000","last_change":"2024-03-16T07:24:35.770744+0000","last_active":"2024-03-16T07:24:38.551943+0000","last_peered":"2024-03-16T07:24:38.551943+0000","last_clean":"2024-03-16T07:24:38.551943+0000","last_became_active":"2024-03-16T07:24:35.770319+0000","last_became_peered":"2024-03-16T07:24:35.770319+0000","last_unstale":"2024-03-16T07:24:38.551943+0000","last_undegraded":"2024-03-16T07:24:38.551943+0000","last_fullsized":"2024-03-16T07:24:38.551943+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:15:00.108070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.849752+0000","last_change":"2024-03-16T07:24:35.761508+0000","last_active":"2024-03-16T07:24:36.849752+0000","last_peered":"2024-03-16T07:24:36.849752+0000","last_clean":"2024-03-16T07:24:36.849752+0000","last_became_active":"2024-03-16T07:24:35.761166+0000","last_became_peered":"2024-03-16T07:24:35.761166+0000","last_unstale":"2024-03-16T07:24:36.849752+0000","last_undegraded":"2024-03-16T07:24:36.849752+0000","last_fullsized":"2024-03-16T07:24:36.849752+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:25:46.129511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.756457+0000","last_change":"2024-03-16T07:24:35.766187+0000","last_active":"2024-03-16T07:24:36.756457+0000","last_peered":"2024-03-16T07:24:36.756457+0000","last_clean":"2024-03-16T07:24:36.756457+0000","last_became_active":"2024-03-16T07:24:35.765816+0000","last_became_peered":"2024-03-16T07:24:35.765816+0000","last_unstale":"2024-03-16T07:24:36.756457+0000","last_undegraded":"2024-03-16T07:24:36.756457+0000","last_fullsized":"2024-03-16T07:24:36.756457+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:35:01.521441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.755518+0000","last_change":"2024-03-16T07:24:35.767649+0000","last_active":"2024-03-16T07:24:36.755518+0000","last_peered":"2024-03-16T07:24:36.755518+0000","last_clean":"2024-03-16T07:24:36.755518+0000","last_became_active":"2024-03-16T07:24:35.766516+0000","last_became_peered":"2024-03-16T07:24:35.766516+0000","last_unstale":"2024-03-16T07:24:36.755518+0000","last_undegraded":"2024-03-16T07:24:36.755518+0000","last_fullsized":"2024-03-16T07:24:36.755518+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:59:52.437341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.755379+0000","last_change":"2024-03-16T07:24:35.764368+0000","last_active":"2024-03-16T07:24:36.755379+0000","last_peered":"2024-03-16T07:24:36.755379+0000","last_clean":"2024-03-16T07:24:36.755379+0000","last_became_active":"2024-03-16T07:24:35.764090+0000","last_became_peered":"2024-03-16T07:24:35.764090+0000","last_unstale":"2024-03-16T07:24:36.755379+0000","last_undegraded":"2024-03-16T07:24:36.755379+0000","last_fullsized":"2024-03-16T07:24:36.755379+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:03:51.527543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:38.551115+0000","last_change":"2024-03-16T07:24:35.762614+0000","last_active":"2024-03-16T07:24:38.551115+0000","last_peered":"2024-03-16T07:24:38.551115+0000","last_clean":"2024-03-16T07:24:38.551115+0000","last_became_active":"2024-03-16T07:24:35.759299+0000","last_became_peered":"2024-03-16T07:24:35.759299+0000","last_unstale":"2024-03-16T07:24:38.551115+0000","last_undegraded":"2024-03-16T07:24:38.551115+0000","last_fullsized":"2024-03-16T07:24:38.551115+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:59:16.551272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:38.551149+0000","last_change":"2024-03-16T07:24:35.772411+0000","last_active":"2024-03-16T07:24:38.551149+0000","last_peered":"2024-03-16T07:24:38.551149+0000","last_clean":"2024-03-16T07:24:38.551149+0000","last_became_active":"2024-03-16T07:24:35.771681+0000","last_became_peered":"2024-03-16T07:24:35.771681+0000","last_unstale":"2024-03-16T07:24:38.551149+0000","last_undegraded":"2024-03-16T07:24:38.551149+0000","last_fullsized":"2024-03-16T07:24:38.551149+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:10:04.715689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.849198+0000","last_change":"2024-03-16T07:24:35.762199+0000","last_active":"2024-03-16T07:24:36.849198+0000","last_peered":"2024-03-16T07:24:36.849198+0000","last_clean":"2024-03-16T07:24:36.849198+0000","last_became_active":"2024-03-16T07:24:35.761593+0000","last_became_peered":"2024-03-16T07:24:35.761593+0000","last_unstale":"2024-03-16T07:24:36.849198+0000","last_undegraded":"2024-03-16T07:24:36.849198+0000","last_fullsized":"2024-03-16T07:24:36.849198+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:37:59.379102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"15'1","reported_seq":15,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.849354+0000","last_change":"2024-03-16T07:24:34.766133+0000","last_active":"2024-03-16T07:24:36.849354+0000","last_peered":"2024-03-16T07:24:36.849354+0000","last_clean":"2024-03-16T07:24:36.849354+0000","last_became_active":"2024-03-16T07:24:34.765818+0000","last_became_peered":"2024-03-16T07:24:34.765818+0000","last_unstale":"2024-03-16T07:24:36.849354+0000","last_undegraded":"2024-03-16T07:24:36.849354+0000","last_fullsized":"2024-03-16T07:24:36.849354+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_clean_scrub_stamp":"2024-03-16T07:24:33.730276+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:56:51.770184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.755679+0000","last_change":"2024-03-16T07:24:35.775697+0000","last_active":"2024-03-16T07:24:36.755679+0000","last_peered":"2024-03-16T07:24:36.755679+0000","last_clean":"2024-03-16T07:24:36.755679+0000","last_became_active":"2024-03-16T07:24:35.775430+0000","last_became_peered":"2024-03-16T07:24:35.775430+0000","last_unstale":"2024-03-16T07:24:36.755679+0000","last_undegraded":"2024-03-16T07:24:36.755679+0000","last_fullsized":"2024-03-16T07:24:36.755679+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:10:53.245012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"15'1","reported_seq":15,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:38.551216+0000","last_change":"2024-03-16T07:24:34.762997+0000","last_active":"2024-03-16T07:24:38.551216+0000","last_peered":"2024-03-16T07:24:38.551216+0000","last_clean":"2024-03-16T07:24:38.551216+0000","last_became_active":"2024-03-16T07:24:34.762707+0000","last_became_peered":"2024-03-16T07:24:34.762707+0000","last_unstale":"2024-03-16T07:24:38.551216+0000","last_undegraded":"2024-03-16T07:24:38.551216+0000","last_fullsized":"2024-03-16T07:24:38.551216+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_clean_scrub_stamp":"2024-03-16T07:24:33.730276+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:20:10.353781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.755881+0000","last_change":"2024-03-16T07:24:34.756141+0000","last_active":"2024-03-16T07:24:36.755881+0000","last_peered":"2024-03-16T07:24:36.755881+0000","last_clean":"2024-03-16T07:24:36.755881+0000","last_became_active":"2024-03-16T07:24:34.755881+0000","last_became_peered":"2024-03-16T07:24:34.755881+0000","last_unstale":"2024-03-16T07:24:36.755881+0000","last_undegraded":"2024-03-16T07:24:36.755881+0000","last_fullsized":"2024-03-16T07:24:36.755881+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_clean_scrub_stamp":"2024-03-16T07:24:33.730276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:29:27.907682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:38.551324+0000","last_change":"2024-03-16T07:24:35.772150+0000","last_active":"2024-03-16T07:24:38.551324+0000","last_peered":"2024-03-16T07:24:38.551324+0000","last_clean":"2024-03-16T07:24:38.551324+0000","last_became_active":"2024-03-16T07:24:35.771896+0000","last_became_peered":"2024-03-16T07:24:35.771896+0000","last_unstale":"2024-03-16T07:24:38.551324+0000","last_undegraded":"2024-03-16T07:24:38.551324+0000","last_fullsized":"2024-03-16T07:24:38.551324+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:42:22.755597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.755045+0000","last_change":"2024-03-16T07:24:34.769281+0000","last_active":"2024-03-16T07:24:36.755045+0000","last_peered":"2024-03-16T07:24:36.755045+0000","last_clean":"2024-03-16T07:24:36.755045+0000","last_became_active":"2024-03-16T07:24:34.769017+0000","last_became_peered":"2024-03-16T07:24:34.769017+0000","last_unstale":"2024-03-16T07:24:36.755045+0000","last_undegraded":"2024-03-16T07:24:36.755045+0000","last_fullsized":"2024-03-16T07:24:36.755045+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_clean_scrub_stamp":"2024-03-16T07:24:33.730276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:56:51.770184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.848978+0000","last_change":"2024-03-16T07:24:35.762407+0000","last_active":"2024-03-16T07:24:36.848978+0000","last_peered":"2024-03-16T07:24:36.848978+0000","last_clean":"2024-03-16T07:24:36.848978+0000","last_became_active":"2024-03-16T07:24:35.762037+0000","last_became_peered":"2024-03-16T07:24:35.762037+0000","last_unstale":"2024-03-16T07:24:36.848978+0000","last_undegraded":"2024-03-16T07:24:36.848978+0000","last_fullsized":"2024-03-16T07:24:36.848978+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:42:22.755597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.850223+0000","last_change":"2024-03-16T07:24:34.754520+0000","last_active":"2024-03-16T07:24:36.850223+0000","last_peered":"2024-03-16T07:24:36.850223+0000","last_clean":"2024-03-16T07:24:36.850223+0000","last_became_active":"2024-03-16T07:24:34.754209+0000","last_became_peered":"2024-03-16T07:24:34.754209+0000","last_unstale":"2024-03-16T07:24:36.850223+0000","last_undegraded":"2024-03-16T07:24:36.850223+0000","last_fullsized":"2024-03-16T07:24:36.850223+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_clean_scrub_stamp":"2024-03-16T07:24:33.730276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:09:12.533977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:38.552166+0000","last_change":"2024-03-16T07:24:35.764475+0000","last_active":"2024-03-16T07:24:38.552166+0000","last_peered":"2024-03-16T07:24:38.552166+0000","last_clean":"2024-03-16T07:24:38.552166+0000","last_became_active":"2024-03-16T07:24:35.764205+0000","last_became_peered":"2024-03-16T07:24:35.764205+0000","last_unstale":"2024-03-16T07:24:38.552166+0000","last_undegraded":"2024-03-16T07:24:38.552166+0000","last_fullsized":"2024-03-16T07:24:38.552166+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:49:14.969756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.756351+0000","last_change":"2024-03-16T07:24:34.770637+0000","last_active":"2024-03-16T07:24:36.756351+0000","last_peered":"2024-03-16T07:24:36.756351+0000","last_clean":"2024-03-16T07:24:36.756351+0000","last_became_active":"2024-03-16T07:24:34.770366+0000","last_became_peered":"2024-03-16T07:24:34.770366+0000","last_unstale":"2024-03-16T07:24:36.756351+0000","last_undegraded":"2024-03-16T07:24:36.756351+0000","last_fullsized":"2024-03-16T07:24:36.756351+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_clean_scrub_stamp":"2024-03-16T07:24:33.730276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:01:11.366672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.756755+0000","last_change":"2024-03-16T07:24:35.779355+0000","last_active":"2024-03-16T07:24:36.756755+0000","last_peered":"2024-03-16T07:24:36.756755+0000","last_clean":"2024-03-16T07:24:36.756755+0000","last_became_active":"2024-03-16T07:24:35.777923+0000","last_became_peered":"2024-03-16T07:24:35.777923+0000","last_unstale":"2024-03-16T07:24:36.756755+0000","last_undegraded":"2024-03-16T07:24:36.756755+0000","last_fullsized":"2024-03-16T07:24:36.756755+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:30:37.504916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"15'3","reported_seq":17,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.849963+0000","last_change":"2024-03-16T07:24:34.765980+0000","last_active":"2024-03-16T07:24:36.849963+0000","last_peered":"2024-03-16T07:24:36.849963+0000","last_clean":"2024-03-16T07:24:36.849963+0000","last_became_active":"2024-03-16T07:24:34.765733+0000","last_became_peered":"2024-03-16T07:24:34.765733+0000","last_unstale":"2024-03-16T07:24:36.849963+0000","last_undegraded":"2024-03-16T07:24:36.849963+0000","last_fullsized":"2024-03-16T07:24:36.849963+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_clean_scrub_stamp":"2024-03-16T07:24:33.730276+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:14:50.759285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.849454+0000","last_change":"2024-03-16T07:24:35.764253+0000","last_active":"2024-03-16T07:24:36.849454+0000","last_peered":"2024-03-16T07:24:36.849454+0000","last_clean":"2024-03-16T07:24:36.849454+0000","last_became_active":"2024-03-16T07:24:35.763793+0000","last_became_peered":"2024-03-16T07:24:35.763793+0000","last_unstale":"2024-03-16T07:24:36.849454+0000","last_undegraded":"2024-03-16T07:24:36.849454+0000","last_fullsized":"2024-03-16T07:24:36.849454+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:56:18.247956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"15'6","reported_seq":20,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:38.551500+0000","last_change":"2024-03-16T07:24:34.758585+0000","last_active":"2024-03-16T07:24:38.551500+0000","last_peered":"2024-03-16T07:24:38.551500+0000","last_clean":"2024-03-16T07:24:38.551500+0000","last_became_active":"2024-03-16T07:24:34.758296+0000","last_became_peered":"2024-03-16T07:24:34.758296+0000","last_unstale":"2024-03-16T07:24:38.551500+0000","last_undegraded":"2024-03-16T07:24:38.551500+0000","last_fullsized":"2024-03-16T07:24:38.551500+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_clean_scrub_stamp":"2024-03-16T07:24:33.730276+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:50:46.274106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.755819+0000","last_change":"2024-03-16T07:24:35.777232+0000","last_active":"2024-03-16T07:24:36.755819+0000","last_peered":"2024-03-16T07:24:36.755819+0000","last_clean":"2024-03-16T07:24:36.755819+0000","last_became_active":"2024-03-16T07:24:35.776810+0000","last_became_peered":"2024-03-16T07:24:35.776810+0000","last_unstale":"2024-03-16T07:24:36.755819+0000","last_undegraded":"2024-03-16T07:24:36.755819+0000","last_fullsized":"2024-03-16T07:24:36.755819+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:20:30.880693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"15'2","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.755871+0000","last_change":"2024-03-16T07:24:34.759219+0000","last_active":"2024-03-16T07:24:36.755871+0000","last_peered":"2024-03-16T07:24:36.755871+0000","last_clean":"2024-03-16T07:24:36.755871+0000","last_became_active":"2024-03-16T07:24:34.758368+0000","last_became_peered":"2024-03-16T07:24:34.758368+0000","last_unstale":"2024-03-16T07:24:36.755871+0000","last_undegraded":"2024-03-16T07:24:36.755871+0000","last_fullsized":"2024-03-16T07:24:36.755871+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_clean_scrub_stamp":"2024-03-16T07:24:33.730276+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:01:34.459245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.755815+0000","last_change":"2024-03-16T07:24:35.776831+0000","last_active":"2024-03-16T07:24:36.755815+0000","last_peered":"2024-03-16T07:24:36.755815+0000","last_clean":"2024-03-16T07:24:36.755815+0000","last_became_active":"2024-03-16T07:24:35.776251+0000","last_became_peered":"2024-03-16T07:24:35.776251+0000","last_unstale":"2024-03-16T07:24:36.755815+0000","last_undegraded":"2024-03-16T07:24:36.755815+0000","last_fullsized":"2024-03-16T07:24:36.755815+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:01:17.121539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:38.551320+0000","last_change":"2024-03-16T07:24:34.758214+0000","last_active":"2024-03-16T07:24:38.551320+0000","last_peered":"2024-03-16T07:24:38.551320+0000","last_clean":"2024-03-16T07:24:38.551320+0000","last_became_active":"2024-03-16T07:24:34.757941+0000","last_became_peered":"2024-03-16T07:24:34.757941+0000","last_unstale":"2024-03-16T07:24:38.551320+0000","last_undegraded":"2024-03-16T07:24:38.551320+0000","last_fullsized":"2024-03-16T07:24:38.551320+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_clean_scrub_stamp":"2024-03-16T07:24:33.730276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:01:11.366672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.849240+0000","last_change":"2024-03-16T07:24:35.780117+0000","last_active":"2024-03-16T07:24:36.849240+0000","last_peered":"2024-03-16T07:24:36.849240+0000","last_clean":"2024-03-16T07:24:36.849240+0000","last_became_active":"2024-03-16T07:24:35.779858+0000","last_became_peered":"2024-03-16T07:24:35.779858+0000","last_unstale":"2024-03-16T07:24:36.849240+0000","last_undegraded":"2024-03-16T07:24:36.849240+0000","last_fullsized":"2024-03-16T07:24:36.849240+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:07:46.246610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.756171+0000","last_change":"2024-03-16T07:24:34.769682+0000","last_active":"2024-03-16T07:24:36.756171+0000","last_peered":"2024-03-16T07:24:36.756171+0000","last_clean":"2024-03-16T07:24:36.756171+0000","last_became_active":"2024-03-16T07:24:34.769389+0000","last_became_peered":"2024-03-16T07:24:34.769389+0000","last_unstale":"2024-03-16T07:24:36.756171+0000","last_undegraded":"2024-03-16T07:24:36.756171+0000","last_fullsized":"2024-03-16T07:24:36.756171+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_clean_scrub_stamp":"2024-03-16T07:24:33.730276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:20:10.353781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.848838+0000","last_change":"2024-03-16T07:24:35.780346+0000","last_active":"2024-03-16T07:24:36.848838+0000","last_peered":"2024-03-16T07:24:36.848838+0000","last_clean":"2024-03-16T07:24:36.848838+0000","last_became_active":"2024-03-16T07:24:35.779994+0000","last_became_peered":"2024-03-16T07:24:35.779994+0000","last_unstale":"2024-03-16T07:24:36.848838+0000","last_undegraded":"2024-03-16T07:24:36.848838+0000","last_fullsized":"2024-03-16T07:24:36.848838+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:36:30.781523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"15'8","reported_seq":22,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:38.551875+0000","last_change":"2024-03-16T07:24:34.759546+0000","last_active":"2024-03-16T07:24:38.551875+0000","last_peered":"2024-03-16T07:24:38.551875+0000","last_clean":"2024-03-16T07:24:38.551875+0000","last_became_active":"2024-03-16T07:24:34.759268+0000","last_became_peered":"2024-03-16T07:24:34.759268+0000","last_unstale":"2024-03-16T07:24:38.551875+0000","last_undegraded":"2024-03-16T07:24:38.551875+0000","last_fullsized":"2024-03-16T07:24:38.551875+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_clean_scrub_stamp":"2024-03-16T07:24:33.730276+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:19:11.558967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:38.551329+0000","last_change":"2024-03-16T07:24:35.760480+0000","last_active":"2024-03-16T07:24:38.551329+0000","last_peered":"2024-03-16T07:24:38.551329+0000","last_clean":"2024-03-16T07:24:38.551329+0000","last_became_active":"2024-03-16T07:24:35.759591+0000","last_became_peered":"2024-03-16T07:24:35.759591+0000","last_unstale":"2024-03-16T07:24:38.551329+0000","last_undegraded":"2024-03-16T07:24:38.551329+0000","last_fullsized":"2024-03-16T07:24:38.551329+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:08:27.087631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"15'1","reported_seq":15,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.756998+0000","last_change":"2024-03-16T07:24:34.769491+0000","last_active":"2024-03-16T07:24:36.756998+0000","last_peered":"2024-03-16T07:24:36.756998+0000","last_clean":"2024-03-16T07:24:36.756998+0000","last_became_active":"2024-03-16T07:24:34.769251+0000","last_became_peered":"2024-03-16T07:24:34.769251+0000","last_unstale":"2024-03-16T07:24:36.756998+0000","last_undegraded":"2024-03-16T07:24:36.756998+0000","last_fullsized":"2024-03-16T07:24:36.756998+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_clean_scrub_stamp":"2024-03-16T07:24:33.730276+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:54:01.611832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:38.552215+0000","last_change":"2024-03-16T07:24:35.770765+0000","last_active":"2024-03-16T07:24:38.552215+0000","last_peered":"2024-03-16T07:24:38.552215+0000","last_clean":"2024-03-16T07:24:38.552215+0000","last_became_active":"2024-03-16T07:24:35.770379+0000","last_became_peered":"2024-03-16T07:24:35.770379+0000","last_unstale":"2024-03-16T07:24:38.552215+0000","last_undegraded":"2024-03-16T07:24:38.552215+0000","last_fullsized":"2024-03-16T07:24:38.552215+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:28:16.855057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"15'2","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:38.552279+0000","last_change":"2024-03-16T07:24:34.762323+0000","last_active":"2024-03-16T07:24:38.552279+0000","last_peered":"2024-03-16T07:24:38.552279+0000","last_clean":"2024-03-16T07:24:38.552279+0000","last_became_active":"2024-03-16T07:24:34.761642+0000","last_became_peered":"2024-03-16T07:24:34.761642+0000","last_unstale":"2024-03-16T07:24:38.552279+0000","last_undegraded":"2024-03-16T07:24:38.552279+0000","last_fullsized":"2024-03-16T07:24:38.552279+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_clean_scrub_stamp":"2024-03-16T07:24:33.730276+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:13:05.731622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.756778+0000","last_change":"2024-03-16T07:24:35.779728+0000","last_active":"2024-03-16T07:24:36.756778+0000","last_peered":"2024-03-16T07:24:36.756778+0000","last_clean":"2024-03-16T07:24:36.756778+0000","last_became_active":"2024-03-16T07:24:35.778072+0000","last_became_peered":"2024-03-16T07:24:35.778072+0000","last_unstale":"2024-03-16T07:24:36.756778+0000","last_undegraded":"2024-03-16T07:24:36.756778+0000","last_fullsized":"2024-03-16T07:24:36.756778+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:50:35.923622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"15'1","reported_seq":15,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.850098+0000","last_change":"2024-03-16T07:24:34.753180+0000","last_active":"2024-03-16T07:24:36.850098+0000","last_peered":"2024-03-16T07:24:36.850098+0000","last_clean":"2024-03-16T07:24:36.850098+0000","last_became_active":"2024-03-16T07:24:34.752884+0000","last_became_peered":"2024-03-16T07:24:34.752884+0000","last_unstale":"2024-03-16T07:24:36.850098+0000","last_undegraded":"2024-03-16T07:24:36.850098+0000","last_fullsized":"2024-03-16T07:24:36.850098+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_clean_scrub_stamp":"2024-03-16T07:24:33.730276+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:01:34.459245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.756599+0000","last_change":"2024-03-16T07:24:35.776993+0000","last_active":"2024-03-16T07:24:36.756599+0000","last_peered":"2024-03-16T07:24:36.756599+0000","last_clean":"2024-03-16T07:24:36.756599+0000","last_became_active":"2024-03-16T07:24:35.776661+0000","last_became_peered":"2024-03-16T07:24:35.776661+0000","last_unstale":"2024-03-16T07:24:36.756599+0000","last_undegraded":"2024-03-16T07:24:36.756599+0000","last_fullsized":"2024-03-16T07:24:36.756599+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:48:42.060438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:38.551539+0000","last_change":"2024-03-16T07:24:34.763099+0000","last_active":"2024-03-16T07:24:38.551539+0000","last_peered":"2024-03-16T07:24:38.551539+0000","last_clean":"2024-03-16T07:24:38.551539+0000","last_became_active":"2024-03-16T07:24:34.762791+0000","last_became_peered":"2024-03-16T07:24:34.762791+0000","last_unstale":"2024-03-16T07:24:38.551539+0000","last_undegraded":"2024-03-16T07:24:38.551539+0000","last_fullsized":"2024-03-16T07:24:38.551539+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_clean_scrub_stamp":"2024-03-16T07:24:33.730276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:33:44.266615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.849820+0000","last_change":"2024-03-16T07:24:35.780874+0000","last_active":"2024-03-16T07:24:36.849820+0000","last_peered":"2024-03-16T07:24:36.849820+0000","last_clean":"2024-03-16T07:24:36.849820+0000","last_became_active":"2024-03-16T07:24:35.780663+0000","last_became_peered":"2024-03-16T07:24:35.780663+0000","last_unstale":"2024-03-16T07:24:36.849820+0000","last_undegraded":"2024-03-16T07:24:36.849820+0000","last_fullsized":"2024-03-16T07:24:36.849820+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:49:14.969756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'97","reported_seq":147,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.848896+0000","last_change":"2024-03-16T07:24:31.650537+0000","last_active":"2024-03-16T07:24:36.848896+0000","last_peered":"2024-03-16T07:24:36.848896+0000","last_clean":"2024-03-16T07:24:36.848896+0000","last_became_active":"2024-03-16T07:24:31.649574+0000","last_became_peered":"2024-03-16T07:24:31.649574+0000","last_unstale":"2024-03-16T07:24:36.848896+0000","last_undegraded":"2024-03-16T07:24:36.848896+0000","last_fullsized":"2024-03-16T07:24:36.848896+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:29.719970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:29.719970+0000","last_clean_scrub_stamp":"2024-03-16T07:24:29.719970+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:31:35.774554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.849379+0000","last_change":"2024-03-16T07:24:34.754912+0000","last_active":"2024-03-16T07:24:36.849379+0000","last_peered":"2024-03-16T07:24:36.849379+0000","last_clean":"2024-03-16T07:24:36.849379+0000","last_became_active":"2024-03-16T07:24:34.754625+0000","last_became_peered":"2024-03-16T07:24:34.754625+0000","last_unstale":"2024-03-16T07:24:36.849379+0000","last_undegraded":"2024-03-16T07:24:36.849379+0000","last_fullsized":"2024-03-16T07:24:36.849379+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_clean_scrub_stamp":"2024-03-16T07:24:33.730276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:19:11.558967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.849472+0000","last_change":"2024-03-16T07:24:35.762745+0000","last_active":"2024-03-16T07:24:36.849472+0000","last_peered":"2024-03-16T07:24:36.849472+0000","last_clean":"2024-03-16T07:24:36.849472+0000","last_became_active":"2024-03-16T07:24:35.761427+0000","last_became_peered":"2024-03-16T07:24:35.761427+0000","last_unstale":"2024-03-16T07:24:36.849472+0000","last_undegraded":"2024-03-16T07:24:36.849472+0000","last_fullsized":"2024-03-16T07:24:36.849472+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:48:17.097726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:38.552036+0000","last_change":"2024-03-16T07:24:34.760770+0000","last_active":"2024-03-16T07:24:38.552036+0000","last_peered":"2024-03-16T07:24:38.552036+0000","last_clean":"2024-03-16T07:24:38.552036+0000","last_became_active":"2024-03-16T07:24:34.759648+0000","last_became_peered":"2024-03-16T07:24:34.759648+0000","last_unstale":"2024-03-16T07:24:38.552036+0000","last_undegraded":"2024-03-16T07:24:38.552036+0000","last_fullsized":"2024-03-16T07:24:38.552036+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_clean_scrub_stamp":"2024-03-16T07:24:33.730276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:29:27.907682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.755501+0000","last_change":"2024-03-16T07:24:35.763497+0000","last_active":"2024-03-16T07:24:36.755501+0000","last_peered":"2024-03-16T07:24:36.755501+0000","last_clean":"2024-03-16T07:24:36.755501+0000","last_became_active":"2024-03-16T07:24:35.762740+0000","last_became_peered":"2024-03-16T07:24:35.762740+0000","last_unstale":"2024-03-16T07:24:36.755501+0000","last_undegraded":"2024-03-16T07:24:36.755501+0000","last_fullsized":"2024-03-16T07:24:36.755501+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:46:40.677706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:38.551565+0000","last_change":"2024-03-16T07:24:34.759060+0000","last_active":"2024-03-16T07:24:38.551565+0000","last_peered":"2024-03-16T07:24:38.551565+0000","last_clean":"2024-03-16T07:24:38.551565+0000","last_became_active":"2024-03-16T07:24:34.758804+0000","last_became_peered":"2024-03-16T07:24:34.758804+0000","last_unstale":"2024-03-16T07:24:38.551565+0000","last_undegraded":"2024-03-16T07:24:38.551565+0000","last_fullsized":"2024-03-16T07:24:38.551565+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_clean_scrub_stamp":"2024-03-16T07:24:33.730276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:56:51.770184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.848935+0000","last_change":"2024-03-16T07:24:35.765622+0000","last_active":"2024-03-16T07:24:36.848935+0000","last_peered":"2024-03-16T07:24:36.848935+0000","last_clean":"2024-03-16T07:24:36.848935+0000","last_became_active":"2024-03-16T07:24:35.765293+0000","last_became_peered":"2024-03-16T07:24:35.765293+0000","last_unstale":"2024-03-16T07:24:36.848935+0000","last_undegraded":"2024-03-16T07:24:36.848935+0000","last_fullsized":"2024-03-16T07:24:36.848935+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:08:27.087631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.755676+0000","last_change":"2024-03-16T07:24:34.769001+0000","last_active":"2024-03-16T07:24:36.755676+0000","last_peered":"2024-03-16T07:24:36.755676+0000","last_clean":"2024-03-16T07:24:36.755676+0000","last_became_active":"2024-03-16T07:24:34.768514+0000","last_became_peered":"2024-03-16T07:24:34.768514+0000","last_unstale":"2024-03-16T07:24:36.755676+0000","last_undegraded":"2024-03-16T07:24:36.755676+0000","last_fullsized":"2024-03-16T07:24:36.755676+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_clean_scrub_stamp":"2024-03-16T07:24:33.730276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:14:50.759285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.755766+0000","last_change":"2024-03-16T07:24:35.764911+0000","last_active":"2024-03-16T07:24:36.755766+0000","last_peered":"2024-03-16T07:24:36.755766+0000","last_clean":"2024-03-16T07:24:36.755766+0000","last_became_active":"2024-03-16T07:24:35.763991+0000","last_became_peered":"2024-03-16T07:24:35.763991+0000","last_unstale":"2024-03-16T07:24:36.755766+0000","last_undegraded":"2024-03-16T07:24:36.755766+0000","last_fullsized":"2024-03-16T07:24:36.755766+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:46:23.561018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.849543+0000","last_change":"2024-03-16T07:24:34.766776+0000","last_active":"2024-03-16T07:24:36.849543+0000","last_peered":"2024-03-16T07:24:36.849543+0000","last_clean":"2024-03-16T07:24:36.849543+0000","last_became_active":"2024-03-16T07:24:34.766401+0000","last_became_peered":"2024-03-16T07:24:34.766401+0000","last_unstale":"2024-03-16T07:24:36.849543+0000","last_undegraded":"2024-03-16T07:24:36.849543+0000","last_fullsized":"2024-03-16T07:24:36.849543+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_clean_scrub_stamp":"2024-03-16T07:24:33.730276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:54:01.611832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:38.552054+0000","last_change":"2024-03-16T07:24:35.758786+0000","last_active":"2024-03-16T07:24:38.552054+0000","last_peered":"2024-03-16T07:24:38.552054+0000","last_clean":"2024-03-16T07:24:38.552054+0000","last_became_active":"2024-03-16T07:24:35.758510+0000","last_became_peered":"2024-03-16T07:24:35.758510+0000","last_unstale":"2024-03-16T07:24:38.552054+0000","last_undegraded":"2024-03-16T07:24:38.552054+0000","last_fullsized":"2024-03-16T07:24:38.552054+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:56:18.247956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.850100+0000","last_change":"2024-03-16T07:24:34.767386+0000","last_active":"2024-03-16T07:24:36.850100+0000","last_peered":"2024-03-16T07:24:36.850100+0000","last_clean":"2024-03-16T07:24:36.850100+0000","last_became_active":"2024-03-16T07:24:34.766950+0000","last_became_peered":"2024-03-16T07:24:34.766950+0000","last_unstale":"2024-03-16T07:24:36.850100+0000","last_undegraded":"2024-03-16T07:24:36.850100+0000","last_fullsized":"2024-03-16T07:24:36.850100+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_clean_scrub_stamp":"2024-03-16T07:24:33.730276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:13:05.731622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.849568+0000","last_change":"2024-03-16T07:24:35.764512+0000","last_active":"2024-03-16T07:24:36.849568+0000","last_peered":"2024-03-16T07:24:36.849568+0000","last_clean":"2024-03-16T07:24:36.849568+0000","last_became_active":"2024-03-16T07:24:35.764264+0000","last_became_peered":"2024-03-16T07:24:35.764264+0000","last_unstale":"2024-03-16T07:24:36.849568+0000","last_undegraded":"2024-03-16T07:24:36.849568+0000","last_fullsized":"2024-03-16T07:24:36.849568+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:49:43.762702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"16'1","reported_seq":15,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:37.743513+0000","last_change":"2024-03-16T07:24:34.767319+0000","last_active":"2024-03-16T07:24:37.743513+0000","last_peered":"2024-03-16T07:24:37.743513+0000","last_clean":"2024-03-16T07:24:37.743513+0000","last_became_active":"2024-03-16T07:24:34.767028+0000","last_became_peered":"2024-03-16T07:24:34.767028+0000","last_unstale":"2024-03-16T07:24:37.743513+0000","last_undegraded":"2024-03-16T07:24:37.743513+0000","last_fullsized":"2024-03-16T07:24:37.743513+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_clean_scrub_stamp":"2024-03-16T07:24:33.730276+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:29:27.907682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:38.552082+0000","last_change":"2024-03-16T07:24:35.758709+0000","last_active":"2024-03-16T07:24:38.552082+0000","last_peered":"2024-03-16T07:24:38.552082+0000","last_clean":"2024-03-16T07:24:38.552082+0000","last_became_active":"2024-03-16T07:24:35.758160+0000","last_became_peered":"2024-03-16T07:24:35.758160+0000","last_unstale":"2024-03-16T07:24:38.552082+0000","last_undegraded":"2024-03-16T07:24:38.552082+0000","last_fullsized":"2024-03-16T07:24:38.552082+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:48:17.097726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"15'2","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.850272+0000","last_change":"2024-03-16T07:24:34.767310+0000","last_active":"2024-03-16T07:24:36.850272+0000","last_peered":"2024-03-16T07:24:36.850272+0000","last_clean":"2024-03-16T07:24:36.850272+0000","last_became_active":"2024-03-16T07:24:34.767009+0000","last_became_peered":"2024-03-16T07:24:34.767009+0000","last_unstale":"2024-03-16T07:24:36.850272+0000","last_undegraded":"2024-03-16T07:24:36.850272+0000","last_fullsized":"2024-03-16T07:24:36.850272+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_clean_scrub_stamp":"2024-03-16T07:24:33.730276+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:59:17.384928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.756195+0000","last_change":"2024-03-16T07:24:35.775915+0000","last_active":"2024-03-16T07:24:36.756195+0000","last_peered":"2024-03-16T07:24:36.756195+0000","last_clean":"2024-03-16T07:24:36.756195+0000","last_became_active":"2024-03-16T07:24:35.775655+0000","last_became_peered":"2024-03-16T07:24:35.775655+0000","last_unstale":"2024-03-16T07:24:36.756195+0000","last_undegraded":"2024-03-16T07:24:36.756195+0000","last_fullsized":"2024-03-16T07:24:36.756195+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:03:48.855314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.755137+0000","last_change":"2024-03-16T07:24:34.756852+0000","last_active":"2024-03-16T07:24:36.755137+0000","last_peered":"2024-03-16T07:24:36.755137+0000","last_clean":"2024-03-16T07:24:36.755137+0000","last_became_active":"2024-03-16T07:24:34.756442+0000","last_became_peered":"2024-03-16T07:24:34.756442+0000","last_unstale":"2024-03-16T07:24:36.755137+0000","last_undegraded":"2024-03-16T07:24:36.755137+0000","last_fullsized":"2024-03-16T07:24:36.755137+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_clean_scrub_stamp":"2024-03-16T07:24:33.730276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:19:11.558967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.756355+0000","last_change":"2024-03-16T07:24:35.763701+0000","last_active":"2024-03-16T07:24:36.756355+0000","last_peered":"2024-03-16T07:24:36.756355+0000","last_clean":"2024-03-16T07:24:36.756355+0000","last_became_active":"2024-03-16T07:24:35.763057+0000","last_became_peered":"2024-03-16T07:24:35.763057+0000","last_unstale":"2024-03-16T07:24:36.756355+0000","last_undegraded":"2024-03-16T07:24:36.756355+0000","last_fullsized":"2024-03-16T07:24:36.756355+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:05:30.548134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.849075+0000","last_change":"2024-03-16T07:24:34.764391+0000","last_active":"2024-03-16T07:24:36.849075+0000","last_peered":"2024-03-16T07:24:36.849075+0000","last_clean":"2024-03-16T07:24:36.849075+0000","last_became_active":"2024-03-16T07:24:34.764118+0000","last_became_peered":"2024-03-16T07:24:34.764118+0000","last_unstale":"2024-03-16T07:24:36.849075+0000","last_undegraded":"2024-03-16T07:24:36.849075+0000","last_fullsized":"2024-03-16T07:24:36.849075+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_clean_scrub_stamp":"2024-03-16T07:24:33.730276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:01:11.366672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:38.551494+0000","last_change":"2024-03-16T07:24:35.765029+0000","last_active":"2024-03-16T07:24:38.551494+0000","last_peered":"2024-03-16T07:24:38.551494+0000","last_clean":"2024-03-16T07:24:38.551494+0000","last_became_active":"2024-03-16T07:24:35.763997+0000","last_became_peered":"2024-03-16T07:24:35.763997+0000","last_unstale":"2024-03-16T07:24:38.551494+0000","last_undegraded":"2024-03-16T07:24:38.551494+0000","last_fullsized":"2024-03-16T07:24:38.551494+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:37:59.379102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.849280+0000","last_change":"2024-03-16T07:24:34.767533+0000","last_active":"2024-03-16T07:24:36.849280+0000","last_peered":"2024-03-16T07:24:36.849280+0000","last_clean":"2024-03-16T07:24:36.849280+0000","last_became_active":"2024-03-16T07:24:34.767181+0000","last_became_peered":"2024-03-16T07:24:34.767181+0000","last_unstale":"2024-03-16T07:24:36.849280+0000","last_undegraded":"2024-03-16T07:24:36.849280+0000","last_fullsized":"2024-03-16T07:24:36.849280+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_clean_scrub_stamp":"2024-03-16T07:24:33.730276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:20:10.353781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.849281+0000","last_change":"2024-03-16T07:24:35.761697+0000","last_active":"2024-03-16T07:24:36.849281+0000","last_peered":"2024-03-16T07:24:36.849281+0000","last_clean":"2024-03-16T07:24:36.849281+0000","last_became_active":"2024-03-16T07:24:35.760988+0000","last_became_peered":"2024-03-16T07:24:35.760988+0000","last_unstale":"2024-03-16T07:24:36.849281+0000","last_undegraded":"2024-03-16T07:24:36.849281+0000","last_fullsized":"2024-03-16T07:24:36.849281+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:03:38.294045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"15'2","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.756043+0000","last_change":"2024-03-16T07:24:34.758088+0000","last_active":"2024-03-16T07:24:36.756043+0000","last_peered":"2024-03-16T07:24:36.756043+0000","last_clean":"2024-03-16T07:24:36.756043+0000","last_became_active":"2024-03-16T07:24:34.757786+0000","last_became_peered":"2024-03-16T07:24:34.757786+0000","last_unstale":"2024-03-16T07:24:36.756043+0000","last_undegraded":"2024-03-16T07:24:36.756043+0000","last_fullsized":"2024-03-16T07:24:36.756043+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_clean_scrub_stamp":"2024-03-16T07:24:33.730276+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:13:05.731622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.755517+0000","last_change":"2024-03-16T07:24:35.776598+0000","last_active":"2024-03-16T07:24:36.755517+0000","last_peered":"2024-03-16T07:24:36.755517+0000","last_clean":"2024-03-16T07:24:36.755517+0000","last_became_active":"2024-03-16T07:24:35.775720+0000","last_became_peered":"2024-03-16T07:24:35.775720+0000","last_unstale":"2024-03-16T07:24:36.755517+0000","last_undegraded":"2024-03-16T07:24:36.755517+0000","last_fullsized":"2024-03-16T07:24:36.755517+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:31:37.132704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:38.551668+0000","last_change":"2024-03-16T07:24:35.755090+0000","last_active":"2024-03-16T07:24:38.551668+0000","last_peered":"2024-03-16T07:24:38.551668+0000","last_clean":"2024-03-16T07:24:38.551668+0000","last_became_active":"2024-03-16T07:24:35.754826+0000","last_became_peered":"2024-03-16T07:24:35.754826+0000","last_unstale":"2024-03-16T07:24:38.551668+0000","last_undegraded":"2024-03-16T07:24:38.551668+0000","last_fullsized":"2024-03-16T07:24:38.551668+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:03:38.294045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"15'2","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.756725+0000","last_change":"2024-03-16T07:24:34.768833+0000","last_active":"2024-03-16T07:24:36.756725+0000","last_peered":"2024-03-16T07:24:36.756725+0000","last_clean":"2024-03-16T07:24:36.756725+0000","last_became_active":"2024-03-16T07:24:34.768533+0000","last_became_peered":"2024-03-16T07:24:34.768533+0000","last_unstale":"2024-03-16T07:24:36.756725+0000","last_undegraded":"2024-03-16T07:24:36.756725+0000","last_fullsized":"2024-03-16T07:24:36.756725+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_clean_scrub_stamp":"2024-03-16T07:24:33.730276+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:59:17.384928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.849426+0000","last_change":"2024-03-16T07:24:35.782627+0000","last_active":"2024-03-16T07:24:36.849426+0000","last_peered":"2024-03-16T07:24:36.849426+0000","last_clean":"2024-03-16T07:24:36.849426+0000","last_became_active":"2024-03-16T07:24:35.782339+0000","last_became_peered":"2024-03-16T07:24:35.782339+0000","last_unstale":"2024-03-16T07:24:36.849426+0000","last_undegraded":"2024-03-16T07:24:36.849426+0000","last_fullsized":"2024-03-16T07:24:36.849426+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:15:00.108070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"15'2","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.756518+0000","last_change":"2024-03-16T07:24:34.768858+0000","last_active":"2024-03-16T07:24:36.756518+0000","last_peered":"2024-03-16T07:24:36.756518+0000","last_clean":"2024-03-16T07:24:36.756518+0000","last_became_active":"2024-03-16T07:24:34.768558+0000","last_became_peered":"2024-03-16T07:24:34.768558+0000","last_unstale":"2024-03-16T07:24:36.756518+0000","last_undegraded":"2024-03-16T07:24:36.756518+0000","last_fullsized":"2024-03-16T07:24:36.756518+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_clean_scrub_stamp":"2024-03-16T07:24:33.730276+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:25:31.602307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.756628+0000","last_change":"2024-03-16T07:24:35.778556+0000","last_active":"2024-03-16T07:24:36.756628+0000","last_peered":"2024-03-16T07:24:36.756628+0000","last_clean":"2024-03-16T07:24:36.756628+0000","last_became_active":"2024-03-16T07:24:35.777574+0000","last_became_peered":"2024-03-16T07:24:35.777574+0000","last_unstale":"2024-03-16T07:24:36.756628+0000","last_undegraded":"2024-03-16T07:24:36.756628+0000","last_fullsized":"2024-03-16T07:24:36.756628+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:25:26.895206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"15'1","reported_seq":15,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:38.552279+0000","last_change":"2024-03-16T07:24:34.762078+0000","last_active":"2024-03-16T07:24:38.552279+0000","last_peered":"2024-03-16T07:24:38.552279+0000","last_clean":"2024-03-16T07:24:38.552279+0000","last_became_active":"2024-03-16T07:24:34.761242+0000","last_became_peered":"2024-03-16T07:24:34.761242+0000","last_unstale":"2024-03-16T07:24:38.552279+0000","last_undegraded":"2024-03-16T07:24:38.552279+0000","last_fullsized":"2024-03-16T07:24:38.552279+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_clean_scrub_stamp":"2024-03-16T07:24:33.730276+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:01:34.459245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:38.552135+0000","last_change":"2024-03-16T07:24:35.763919+0000","last_active":"2024-03-16T07:24:38.552135+0000","last_peered":"2024-03-16T07:24:38.552135+0000","last_clean":"2024-03-16T07:24:38.552135+0000","last_became_active":"2024-03-16T07:24:35.763643+0000","last_became_peered":"2024-03-16T07:24:35.763643+0000","last_unstale":"2024-03-16T07:24:38.552135+0000","last_undegraded":"2024-03-16T07:24:38.552135+0000","last_fullsized":"2024-03-16T07:24:38.552135+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:25:46.129511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"15'4","reported_seq":18,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.756909+0000","last_change":"2024-03-16T07:24:34.770349+0000","last_active":"2024-03-16T07:24:36.756909+0000","last_peered":"2024-03-16T07:24:36.756909+0000","last_clean":"2024-03-16T07:24:36.756909+0000","last_became_active":"2024-03-16T07:24:34.770054+0000","last_became_peered":"2024-03-16T07:24:34.770054+0000","last_unstale":"2024-03-16T07:24:36.756909+0000","last_undegraded":"2024-03-16T07:24:36.756909+0000","last_fullsized":"2024-03-16T07:24:36.756909+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_clean_scrub_stamp":"2024-03-16T07:24:33.730276+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:09:12.533977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738374,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27180,"kb_used_data":156,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":104830420,"statfs":{"total":107374182400,"available":107346350080,"internally_reserved":0,"allocated":159744,"data_stored":44486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738374,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27768,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":104829832,"statfs":{"total":107374182400,"available":107345747968,"internally_reserved":0,"allocated":761856,"data_stored":635514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738374,"num_pgs":74,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27756,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":104829844,"statfs":{"total":107374182400,"available":107345760256,"internally_reserved":0,"allocated":749568,"data_stored":633866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-16T07:24:45.276 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-16T07:24:45.682 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:24:45.684 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2024-03-16T07:24:45.693 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-03-16T07:24:44.899644+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":182,"num_write_kb":1908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":136,"ondisk_log_size":136,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":314572800,"kb_used":82704,"kb_used_data":1632,"kb_used_omap":4,"kb_used_meta":81019,"kb_avail":314490096,"statfs":{"total":322122547200,"available":322037858304,"internally_reserved":0,"allocated":1671168,"data_stored":1313866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":82963791},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.160136"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.756601+0000","last_change":"2024-03-16T07:24:35.778195+0000","last_active":"2024-03-16T07:24:36.756601+0000","last_peered":"2024-03-16T07:24:36.756601+0000","last_clean":"2024-03-16T07:24:36.756601+0000","last_became_active":"2024-03-16T07:24:35.777228+0000","last_became_peered":"2024-03-16T07:24:35.777228+0000","last_unstale":"2024-03-16T07:24:36.756601+0000","last_undegraded":"2024-03-16T07:24:36.756601+0000","last_fullsized":"2024-03-16T07:24:36.756601+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:06:55.141496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.850057+0000","last_change":"2024-03-16T07:24:35.782627+0000","last_active":"2024-03-16T07:24:36.850057+0000","last_peered":"2024-03-16T07:24:36.850057+0000","last_clean":"2024-03-16T07:24:36.850057+0000","last_became_active":"2024-03-16T07:24:35.782357+0000","last_became_peered":"2024-03-16T07:24:35.782357+0000","last_unstale":"2024-03-16T07:24:36.850057+0000","last_undegraded":"2024-03-16T07:24:36.850057+0000","last_fullsized":"2024-03-16T07:24:36.850057+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:28:16.855057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.756432+0000","last_change":"2024-03-16T07:24:35.763326+0000","last_active":"2024-03-16T07:24:36.756432+0000","last_peered":"2024-03-16T07:24:36.756432+0000","last_clean":"2024-03-16T07:24:36.756432+0000","last_became_active":"2024-03-16T07:24:35.763103+0000","last_became_peered":"2024-03-16T07:24:35.763103+0000","last_unstale":"2024-03-16T07:24:36.756432+0000","last_undegraded":"2024-03-16T07:24:36.756432+0000","last_fullsized":"2024-03-16T07:24:36.756432+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:27:51.581736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:38.551428+0000","last_change":"2024-03-16T07:24:35.762619+0000","last_active":"2024-03-16T07:24:38.551428+0000","last_peered":"2024-03-16T07:24:38.551428+0000","last_clean":"2024-03-16T07:24:38.551428+0000","last_became_active":"2024-03-16T07:24:35.761493+0000","last_became_peered":"2024-03-16T07:24:35.761493+0000","last_unstale":"2024-03-16T07:24:38.551428+0000","last_undegraded":"2024-03-16T07:24:38.551428+0000","last_fullsized":"2024-03-16T07:24:38.551428+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:31:08.610234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.755923+0000","last_change":"2024-03-16T07:24:35.767433+0000","last_active":"2024-03-16T07:24:36.755923+0000","last_peered":"2024-03-16T07:24:36.755923+0000","last_clean":"2024-03-16T07:24:36.755923+0000","last_became_active":"2024-03-16T07:24:35.764667+0000","last_became_peered":"2024-03-16T07:24:35.764667+0000","last_unstale":"2024-03-16T07:24:36.755923+0000","last_undegraded":"2024-03-16T07:24:36.755923+0000","last_fullsized":"2024-03-16T07:24:36.755923+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:18:18.873930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:38.551220+0000","last_change":"2024-03-16T07:24:35.762404+0000","last_active":"2024-03-16T07:24:38.551220+0000","last_peered":"2024-03-16T07:24:38.551220+0000","last_clean":"2024-03-16T07:24:38.551220+0000","last_became_active":"2024-03-16T07:24:35.760824+0000","last_became_peered":"2024-03-16T07:24:35.760824+0000","last_unstale":"2024-03-16T07:24:38.551220+0000","last_undegraded":"2024-03-16T07:24:38.551220+0000","last_fullsized":"2024-03-16T07:24:38.551220+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:36:30.781523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.756044+0000","last_change":"2024-03-16T07:24:35.775068+0000","last_active":"2024-03-16T07:24:36.756044+0000","last_peered":"2024-03-16T07:24:36.756044+0000","last_clean":"2024-03-16T07:24:36.756044+0000","last_became_active":"2024-03-16T07:24:35.774830+0000","last_became_peered":"2024-03-16T07:24:35.774830+0000","last_unstale":"2024-03-16T07:24:36.756044+0000","last_undegraded":"2024-03-16T07:24:36.756044+0000","last_fullsized":"2024-03-16T07:24:36.756044+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:55:12.697679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:38.551005+0000","last_change":"2024-03-16T07:24:35.763436+0000","last_active":"2024-03-16T07:24:38.551005+0000","last_peered":"2024-03-16T07:24:38.551005+0000","last_clean":"2024-03-16T07:24:38.551005+0000","last_became_active":"2024-03-16T07:24:35.763190+0000","last_became_peered":"2024-03-16T07:24:35.763190+0000","last_unstale":"2024-03-16T07:24:38.551005+0000","last_undegraded":"2024-03-16T07:24:38.551005+0000","last_fullsized":"2024-03-16T07:24:38.551005+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:10:18.237714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.850174+0000","last_change":"2024-03-16T07:24:35.783289+0000","last_active":"2024-03-16T07:24:36.850174+0000","last_peered":"2024-03-16T07:24:36.850174+0000","last_clean":"2024-03-16T07:24:36.850174+0000","last_became_active":"2024-03-16T07:24:35.782803+0000","last_became_peered":"2024-03-16T07:24:35.782803+0000","last_unstale":"2024-03-16T07:24:36.850174+0000","last_undegraded":"2024-03-16T07:24:36.850174+0000","last_fullsized":"2024-03-16T07:24:36.850174+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:14:25.797393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.756381+0000","last_change":"2024-03-16T07:24:35.767189+0000","last_active":"2024-03-16T07:24:36.756381+0000","last_peered":"2024-03-16T07:24:36.756381+0000","last_clean":"2024-03-16T07:24:36.756381+0000","last_became_active":"2024-03-16T07:24:35.766948+0000","last_became_peered":"2024-03-16T07:24:35.766948+0000","last_unstale":"2024-03-16T07:24:36.756381+0000","last_undegraded":"2024-03-16T07:24:36.756381+0000","last_fullsized":"2024-03-16T07:24:36.756381+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:39:05.051025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.755497+0000","last_change":"2024-03-16T07:24:35.778348+0000","last_active":"2024-03-16T07:24:36.755497+0000","last_peered":"2024-03-16T07:24:36.755497+0000","last_clean":"2024-03-16T07:24:36.755497+0000","last_became_active":"2024-03-16T07:24:35.777733+0000","last_became_peered":"2024-03-16T07:24:35.777733+0000","last_unstale":"2024-03-16T07:24:36.755497+0000","last_undegraded":"2024-03-16T07:24:36.755497+0000","last_fullsized":"2024-03-16T07:24:36.755497+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:00:23.312298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.756312+0000","last_change":"2024-03-16T07:24:35.776673+0000","last_active":"2024-03-16T07:24:36.756312+0000","last_peered":"2024-03-16T07:24:36.756312+0000","last_clean":"2024-03-16T07:24:36.756312+0000","last_became_active":"2024-03-16T07:24:35.776273+0000","last_became_peered":"2024-03-16T07:24:35.776273+0000","last_unstale":"2024-03-16T07:24:36.756312+0000","last_undegraded":"2024-03-16T07:24:36.756312+0000","last_fullsized":"2024-03-16T07:24:36.756312+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:21:36.876625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.756012+0000","last_change":"2024-03-16T07:24:35.776794+0000","last_active":"2024-03-16T07:24:36.756012+0000","last_peered":"2024-03-16T07:24:36.756012+0000","last_clean":"2024-03-16T07:24:36.756012+0000","last_became_active":"2024-03-16T07:24:35.775472+0000","last_became_peered":"2024-03-16T07:24:35.775472+0000","last_unstale":"2024-03-16T07:24:36.756012+0000","last_undegraded":"2024-03-16T07:24:36.756012+0000","last_fullsized":"2024-03-16T07:24:36.756012+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:47:00.624947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.755298+0000","last_change":"2024-03-16T07:24:35.777171+0000","last_active":"2024-03-16T07:24:36.755298+0000","last_peered":"2024-03-16T07:24:36.755298+0000","last_clean":"2024-03-16T07:24:36.755298+0000","last_became_active":"2024-03-16T07:24:35.776959+0000","last_became_peered":"2024-03-16T07:24:35.776959+0000","last_unstale":"2024-03-16T07:24:36.755298+0000","last_undegraded":"2024-03-16T07:24:36.755298+0000","last_fullsized":"2024-03-16T07:24:36.755298+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:15:02.699193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.848996+0000","last_change":"2024-03-16T07:24:35.779625+0000","last_active":"2024-03-16T07:24:36.848996+0000","last_peered":"2024-03-16T07:24:36.848996+0000","last_clean":"2024-03-16T07:24:36.848996+0000","last_became_active":"2024-03-16T07:24:35.779369+0000","last_became_peered":"2024-03-16T07:24:35.779369+0000","last_unstale":"2024-03-16T07:24:36.848996+0000","last_undegraded":"2024-03-16T07:24:36.848996+0000","last_fullsized":"2024-03-16T07:24:36.848996+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:31:08.610234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:38.551193+0000","last_change":"2024-03-16T07:24:35.771934+0000","last_active":"2024-03-16T07:24:38.551193+0000","last_peered":"2024-03-16T07:24:38.551193+0000","last_clean":"2024-03-16T07:24:38.551193+0000","last_became_active":"2024-03-16T07:24:35.771550+0000","last_became_peered":"2024-03-16T07:24:35.771550+0000","last_unstale":"2024-03-16T07:24:38.551193+0000","last_undegraded":"2024-03-16T07:24:38.551193+0000","last_fullsized":"2024-03-16T07:24:38.551193+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:07:46.246610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.850325+0000","last_change":"2024-03-16T07:24:35.778996+0000","last_active":"2024-03-16T07:24:36.850325+0000","last_peered":"2024-03-16T07:24:36.850325+0000","last_clean":"2024-03-16T07:24:36.850325+0000","last_became_active":"2024-03-16T07:24:35.778760+0000","last_became_peered":"2024-03-16T07:24:35.778760+0000","last_unstale":"2024-03-16T07:24:36.850325+0000","last_undegraded":"2024-03-16T07:24:36.850325+0000","last_fullsized":"2024-03-16T07:24:36.850325+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:15:02.699193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:38.551452+0000","last_change":"2024-03-16T07:24:35.770074+0000","last_active":"2024-03-16T07:24:38.551452+0000","last_peered":"2024-03-16T07:24:38.551452+0000","last_clean":"2024-03-16T07:24:38.551452+0000","last_became_active":"2024-03-16T07:24:35.769797+0000","last_became_peered":"2024-03-16T07:24:35.769797+0000","last_unstale":"2024-03-16T07:24:38.551452+0000","last_undegraded":"2024-03-16T07:24:38.551452+0000","last_fullsized":"2024-03-16T07:24:38.551452+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:13:21.265017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.756228+0000","last_change":"2024-03-16T07:24:35.755806+0000","last_active":"2024-03-16T07:24:36.756228+0000","last_peered":"2024-03-16T07:24:36.756228+0000","last_clean":"2024-03-16T07:24:36.756228+0000","last_became_active":"2024-03-16T07:24:35.755548+0000","last_became_peered":"2024-03-16T07:24:35.755548+0000","last_unstale":"2024-03-16T07:24:36.756228+0000","last_undegraded":"2024-03-16T07:24:36.756228+0000","last_fullsized":"2024-03-16T07:24:36.756228+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:58:56.672206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.756631+0000","last_change":"2024-03-16T07:24:35.776892+0000","last_active":"2024-03-16T07:24:36.756631+0000","last_peered":"2024-03-16T07:24:36.756631+0000","last_clean":"2024-03-16T07:24:36.756631+0000","last_became_active":"2024-03-16T07:24:35.776396+0000","last_became_peered":"2024-03-16T07:24:35.776396+0000","last_unstale":"2024-03-16T07:24:36.756631+0000","last_undegraded":"2024-03-16T07:24:36.756631+0000","last_fullsized":"2024-03-16T07:24:36.756631+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:20:25.574088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.755333+0000","last_change":"2024-03-16T07:24:35.766783+0000","last_active":"2024-03-16T07:24:36.755333+0000","last_peered":"2024-03-16T07:24:36.755333+0000","last_clean":"2024-03-16T07:24:36.755333+0000","last_became_active":"2024-03-16T07:24:35.764320+0000","last_became_peered":"2024-03-16T07:24:35.764320+0000","last_unstale":"2024-03-16T07:24:36.755333+0000","last_undegraded":"2024-03-16T07:24:36.755333+0000","last_fullsized":"2024-03-16T07:24:36.755333+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:52:47.872518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.849137+0000","last_change":"2024-03-16T07:24:35.781061+0000","last_active":"2024-03-16T07:24:36.849137+0000","last_peered":"2024-03-16T07:24:36.849137+0000","last_clean":"2024-03-16T07:24:36.849137+0000","last_became_active":"2024-03-16T07:24:35.780821+0000","last_became_peered":"2024-03-16T07:24:35.780821+0000","last_unstale":"2024-03-16T07:24:36.849137+0000","last_undegraded":"2024-03-16T07:24:36.849137+0000","last_fullsized":"2024-03-16T07:24:36.849137+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:13:21.265017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.754999+0000","last_change":"2024-03-16T07:24:35.763299+0000","last_active":"2024-03-16T07:24:36.754999+0000","last_peered":"2024-03-16T07:24:36.754999+0000","last_clean":"2024-03-16T07:24:36.754999+0000","last_became_active":"2024-03-16T07:24:35.760540+0000","last_became_peered":"2024-03-16T07:24:35.760540+0000","last_unstale":"2024-03-16T07:24:36.754999+0000","last_undegraded":"2024-03-16T07:24:36.754999+0000","last_fullsized":"2024-03-16T07:24:36.754999+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:28:16.855057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.755114+0000","last_change":"2024-03-16T07:24:35.768963+0000","last_active":"2024-03-16T07:24:36.755114+0000","last_peered":"2024-03-16T07:24:36.755114+0000","last_clean":"2024-03-16T07:24:36.755114+0000","last_became_active":"2024-03-16T07:24:35.768551+0000","last_became_peered":"2024-03-16T07:24:35.768551+0000","last_unstale":"2024-03-16T07:24:36.755114+0000","last_undegraded":"2024-03-16T07:24:36.755114+0000","last_fullsized":"2024-03-16T07:24:36.755114+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:14:25.797393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:38.552082+0000","last_change":"2024-03-16T07:24:35.758470+0000","last_active":"2024-03-16T07:24:38.552082+0000","last_peered":"2024-03-16T07:24:38.552082+0000","last_clean":"2024-03-16T07:24:38.552082+0000","last_became_active":"2024-03-16T07:24:35.757833+0000","last_became_peered":"2024-03-16T07:24:35.757833+0000","last_unstale":"2024-03-16T07:24:38.552082+0000","last_undegraded":"2024-03-16T07:24:38.552082+0000","last_fullsized":"2024-03-16T07:24:38.552082+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:49:43.762702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:38.551943+0000","last_change":"2024-03-16T07:24:35.770744+0000","last_active":"2024-03-16T07:24:38.551943+0000","last_peered":"2024-03-16T07:24:38.551943+0000","last_clean":"2024-03-16T07:24:38.551943+0000","last_became_active":"2024-03-16T07:24:35.770319+0000","last_became_peered":"2024-03-16T07:24:35.770319+0000","last_unstale":"2024-03-16T07:24:38.551943+0000","last_undegraded":"2024-03-16T07:24:38.551943+0000","last_fullsized":"2024-03-16T07:24:38.551943+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:15:00.108070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.849752+0000","last_change":"2024-03-16T07:24:35.761508+0000","last_active":"2024-03-16T07:24:36.849752+0000","last_peered":"2024-03-16T07:24:36.849752+0000","last_clean":"2024-03-16T07:24:36.849752+0000","last_became_active":"2024-03-16T07:24:35.761166+0000","last_became_peered":"2024-03-16T07:24:35.761166+0000","last_unstale":"2024-03-16T07:24:36.849752+0000","last_undegraded":"2024-03-16T07:24:36.849752+0000","last_fullsized":"2024-03-16T07:24:36.849752+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:25:46.129511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.756457+0000","last_change":"2024-03-16T07:24:35.766187+0000","last_active":"2024-03-16T07:24:36.756457+0000","last_peered":"2024-03-16T07:24:36.756457+0000","last_clean":"2024-03-16T07:24:36.756457+0000","last_became_active":"2024-03-16T07:24:35.765816+0000","last_became_peered":"2024-03-16T07:24:35.765816+0000","last_unstale":"2024-03-16T07:24:36.756457+0000","last_undegraded":"2024-03-16T07:24:36.756457+0000","last_fullsized":"2024-03-16T07:24:36.756457+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:35:01.521441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.755518+0000","last_change":"2024-03-16T07:24:35.767649+0000","last_active":"2024-03-16T07:24:36.755518+0000","last_peered":"2024-03-16T07:24:36.755518+0000","last_clean":"2024-03-16T07:24:36.755518+0000","last_became_active":"2024-03-16T07:24:35.766516+0000","last_became_peered":"2024-03-16T07:24:35.766516+0000","last_unstale":"2024-03-16T07:24:36.755518+0000","last_undegraded":"2024-03-16T07:24:36.755518+0000","last_fullsized":"2024-03-16T07:24:36.755518+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:59:52.437341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.755379+0000","last_change":"2024-03-16T07:24:35.764368+0000","last_active":"2024-03-16T07:24:36.755379+0000","last_peered":"2024-03-16T07:24:36.755379+0000","last_clean":"2024-03-16T07:24:36.755379+0000","last_became_active":"2024-03-16T07:24:35.764090+0000","last_became_peered":"2024-03-16T07:24:35.764090+0000","last_unstale":"2024-03-16T07:24:36.755379+0000","last_undegraded":"2024-03-16T07:24:36.755379+0000","last_fullsized":"2024-03-16T07:24:36.755379+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:03:51.527543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:38.551115+0000","last_change":"2024-03-16T07:24:35.762614+0000","last_active":"2024-03-16T07:24:38.551115+0000","last_peered":"2024-03-16T07:24:38.551115+0000","last_clean":"2024-03-16T07:24:38.551115+0000","last_became_active":"2024-03-16T07:24:35.759299+0000","last_became_peered":"2024-03-16T07:24:35.759299+0000","last_unstale":"2024-03-16T07:24:38.551115+0000","last_undegraded":"2024-03-16T07:24:38.551115+0000","last_fullsized":"2024-03-16T07:24:38.551115+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:59:16.551272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:38.551149+0000","last_change":"2024-03-16T07:24:35.772411+0000","last_active":"2024-03-16T07:24:38.551149+0000","last_peered":"2024-03-16T07:24:38.551149+0000","last_clean":"2024-03-16T07:24:38.551149+0000","last_became_active":"2024-03-16T07:24:35.771681+0000","last_became_peered":"2024-03-16T07:24:35.771681+0000","last_unstale":"2024-03-16T07:24:38.551149+0000","last_undegraded":"2024-03-16T07:24:38.551149+0000","last_fullsized":"2024-03-16T07:24:38.551149+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:10:04.715689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.849198+0000","last_change":"2024-03-16T07:24:35.762199+0000","last_active":"2024-03-16T07:24:36.849198+0000","last_peered":"2024-03-16T07:24:36.849198+0000","last_clean":"2024-03-16T07:24:36.849198+0000","last_became_active":"2024-03-16T07:24:35.761593+0000","last_became_peered":"2024-03-16T07:24:35.761593+0000","last_unstale":"2024-03-16T07:24:36.849198+0000","last_undegraded":"2024-03-16T07:24:36.849198+0000","last_fullsized":"2024-03-16T07:24:36.849198+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:37:59.379102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"15'1","reported_seq":15,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.849354+0000","last_change":"2024-03-16T07:24:34.766133+0000","last_active":"2024-03-16T07:24:36.849354+0000","last_peered":"2024-03-16T07:24:36.849354+0000","last_clean":"2024-03-16T07:24:36.849354+0000","last_became_active":"2024-03-16T07:24:34.765818+0000","last_became_peered":"2024-03-16T07:24:34.765818+0000","last_unstale":"2024-03-16T07:24:36.849354+0000","last_undegraded":"2024-03-16T07:24:36.849354+0000","last_fullsized":"2024-03-16T07:24:36.849354+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_clean_scrub_stamp":"2024-03-16T07:24:33.730276+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:56:51.770184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.755679+0000","last_change":"2024-03-16T07:24:35.775697+0000","last_active":"2024-03-16T07:24:36.755679+0000","last_peered":"2024-03-16T07:24:36.755679+0000","last_clean":"2024-03-16T07:24:36.755679+0000","last_became_active":"2024-03-16T07:24:35.775430+0000","last_became_peered":"2024-03-16T07:24:35.775430+0000","last_unstale":"2024-03-16T07:24:36.755679+0000","last_undegraded":"2024-03-16T07:24:36.755679+0000","last_fullsized":"2024-03-16T07:24:36.755679+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:10:53.245012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"15'1","reported_seq":15,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:38.551216+0000","last_change":"2024-03-16T07:24:34.762997+0000","last_active":"2024-03-16T07:24:38.551216+0000","last_peered":"2024-03-16T07:24:38.551216+0000","last_clean":"2024-03-16T07:24:38.551216+0000","last_became_active":"2024-03-16T07:24:34.762707+0000","last_became_peered":"2024-03-16T07:24:34.762707+0000","last_unstale":"2024-03-16T07:24:38.551216+0000","last_undegraded":"2024-03-16T07:24:38.551216+0000","last_fullsized":"2024-03-16T07:24:38.551216+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_clean_scrub_stamp":"2024-03-16T07:24:33.730276+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:20:10.353781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.755881+0000","last_change":"2024-03-16T07:24:34.756141+0000","last_active":"2024-03-16T07:24:36.755881+0000","last_peered":"2024-03-16T07:24:36.755881+0000","last_clean":"2024-03-16T07:24:36.755881+0000","last_became_active":"2024-03-16T07:24:34.755881+0000","last_became_peered":"2024-03-16T07:24:34.755881+0000","last_unstale":"2024-03-16T07:24:36.755881+0000","last_undegraded":"2024-03-16T07:24:36.755881+0000","last_fullsized":"2024-03-16T07:24:36.755881+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_clean_scrub_stamp":"2024-03-16T07:24:33.730276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:29:27.907682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:38.551324+0000","last_change":"2024-03-16T07:24:35.772150+0000","last_active":"2024-03-16T07:24:38.551324+0000","last_peered":"2024-03-16T07:24:38.551324+0000","last_clean":"2024-03-16T07:24:38.551324+0000","last_became_active":"2024-03-16T07:24:35.771896+0000","last_became_peered":"2024-03-16T07:24:35.771896+0000","last_unstale":"2024-03-16T07:24:38.551324+0000","last_undegraded":"2024-03-16T07:24:38.551324+0000","last_fullsized":"2024-03-16T07:24:38.551324+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:42:22.755597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.755045+0000","last_change":"2024-03-16T07:24:34.769281+0000","last_active":"2024-03-16T07:24:36.755045+0000","last_peered":"2024-03-16T07:24:36.755045+0000","last_clean":"2024-03-16T07:24:36.755045+0000","last_became_active":"2024-03-16T07:24:34.769017+0000","last_became_peered":"2024-03-16T07:24:34.769017+0000","last_unstale":"2024-03-16T07:24:36.755045+0000","last_undegraded":"2024-03-16T07:24:36.755045+0000","last_fullsized":"2024-03-16T07:24:36.755045+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_clean_scrub_stamp":"2024-03-16T07:24:33.730276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:56:51.770184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.848978+0000","last_change":"2024-03-16T07:24:35.762407+0000","last_active":"2024-03-16T07:24:36.848978+0000","last_peered":"2024-03-16T07:24:36.848978+0000","last_clean":"2024-03-16T07:24:36.848978+0000","last_became_active":"2024-03-16T07:24:35.762037+0000","last_became_peered":"2024-03-16T07:24:35.762037+0000","last_unstale":"2024-03-16T07:24:36.848978+0000","last_undegraded":"2024-03-16T07:24:36.848978+0000","last_fullsized":"2024-03-16T07:24:36.848978+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:42:22.755597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.850223+0000","last_change":"2024-03-16T07:24:34.754520+0000","last_active":"2024-03-16T07:24:36.850223+0000","last_peered":"2024-03-16T07:24:36.850223+0000","last_clean":"2024-03-16T07:24:36.850223+0000","last_became_active":"2024-03-16T07:24:34.754209+0000","last_became_peered":"2024-03-16T07:24:34.754209+0000","last_unstale":"2024-03-16T07:24:36.850223+0000","last_undegraded":"2024-03-16T07:24:36.850223+0000","last_fullsized":"2024-03-16T07:24:36.850223+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_clean_scrub_stamp":"2024-03-16T07:24:33.730276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:09:12.533977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:38.552166+0000","last_change":"2024-03-16T07:24:35.764475+0000","last_active":"2024-03-16T07:24:38.552166+0000","last_peered":"2024-03-16T07:24:38.552166+0000","last_clean":"2024-03-16T07:24:38.552166+0000","last_became_active":"2024-03-16T07:24:35.764205+0000","last_became_peered":"2024-03-16T07:24:35.764205+0000","last_unstale":"2024-03-16T07:24:38.552166+0000","last_undegraded":"2024-03-16T07:24:38.552166+0000","last_fullsized":"2024-03-16T07:24:38.552166+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:49:14.969756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.756351+0000","last_change":"2024-03-16T07:24:34.770637+0000","last_active":"2024-03-16T07:24:36.756351+0000","last_peered":"2024-03-16T07:24:36.756351+0000","last_clean":"2024-03-16T07:24:36.756351+0000","last_became_active":"2024-03-16T07:24:34.770366+0000","last_became_peered":"2024-03-16T07:24:34.770366+0000","last_unstale":"2024-03-16T07:24:36.756351+0000","last_undegraded":"2024-03-16T07:24:36.756351+0000","last_fullsized":"2024-03-16T07:24:36.756351+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_clean_scrub_stamp":"2024-03-16T07:24:33.730276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:01:11.366672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.756755+0000","last_change":"2024-03-16T07:24:35.779355+0000","last_active":"2024-03-16T07:24:36.756755+0000","last_peered":"2024-03-16T07:24:36.756755+0000","last_clean":"2024-03-16T07:24:36.756755+0000","last_became_active":"2024-03-16T07:24:35.777923+0000","last_became_peered":"2024-03-16T07:24:35.777923+0000","last_unstale":"2024-03-16T07:24:36.756755+0000","last_undegraded":"2024-03-16T07:24:36.756755+0000","last_fullsized":"2024-03-16T07:24:36.756755+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:30:37.504916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"15'3","reported_seq":17,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.849963+0000","last_change":"2024-03-16T07:24:34.765980+0000","last_active":"2024-03-16T07:24:36.849963+0000","last_peered":"2024-03-16T07:24:36.849963+0000","last_clean":"2024-03-16T07:24:36.849963+0000","last_became_active":"2024-03-16T07:24:34.765733+0000","last_became_peered":"2024-03-16T07:24:34.765733+0000","last_unstale":"2024-03-16T07:24:36.849963+0000","last_undegraded":"2024-03-16T07:24:36.849963+0000","last_fullsized":"2024-03-16T07:24:36.849963+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_clean_scrub_stamp":"2024-03-16T07:24:33.730276+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:14:50.759285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.849454+0000","last_change":"2024-03-16T07:24:35.764253+0000","last_active":"2024-03-16T07:24:36.849454+0000","last_peered":"2024-03-16T07:24:36.849454+0000","last_clean":"2024-03-16T07:24:36.849454+0000","last_became_active":"2024-03-16T07:24:35.763793+0000","last_became_peered":"2024-03-16T07:24:35.763793+0000","last_unstale":"2024-03-16T07:24:36.849454+0000","last_undegraded":"2024-03-16T07:24:36.849454+0000","last_fullsized":"2024-03-16T07:24:36.849454+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:56:18.247956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"15'6","reported_seq":20,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:38.551500+0000","last_change":"2024-03-16T07:24:34.758585+0000","last_active":"2024-03-16T07:24:38.551500+0000","last_peered":"2024-03-16T07:24:38.551500+0000","last_clean":"2024-03-16T07:24:38.551500+0000","last_became_active":"2024-03-16T07:24:34.758296+0000","last_became_peered":"2024-03-16T07:24:34.758296+0000","last_unstale":"2024-03-16T07:24:38.551500+0000","last_undegraded":"2024-03-16T07:24:38.551500+0000","last_fullsized":"2024-03-16T07:24:38.551500+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_clean_scrub_stamp":"2024-03-16T07:24:33.730276+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:50:46.274106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.755819+0000","last_change":"2024-03-16T07:24:35.777232+0000","last_active":"2024-03-16T07:24:36.755819+0000","last_peered":"2024-03-16T07:24:36.755819+0000","last_clean":"2024-03-16T07:24:36.755819+0000","last_became_active":"2024-03-16T07:24:35.776810+0000","last_became_peered":"2024-03-16T07:24:35.776810+0000","last_unstale":"2024-03-16T07:24:36.755819+0000","last_undegraded":"2024-03-16T07:24:36.755819+0000","last_fullsized":"2024-03-16T07:24:36.755819+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:20:30.880693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"15'2","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.755871+0000","last_change":"2024-03-16T07:24:34.759219+0000","last_active":"2024-03-16T07:24:36.755871+0000","last_peered":"2024-03-16T07:24:36.755871+0000","last_clean":"2024-03-16T07:24:36.755871+0000","last_became_active":"2024-03-16T07:24:34.758368+0000","last_became_peered":"2024-03-16T07:24:34.758368+0000","last_unstale":"2024-03-16T07:24:36.755871+0000","last_undegraded":"2024-03-16T07:24:36.755871+0000","last_fullsized":"2024-03-16T07:24:36.755871+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_clean_scrub_stamp":"2024-03-16T07:24:33.730276+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:01:34.459245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.755815+0000","last_change":"2024-03-16T07:24:35.776831+0000","last_active":"2024-03-16T07:24:36.755815+0000","last_peered":"2024-03-16T07:24:36.755815+0000","last_clean":"2024-03-16T07:24:36.755815+0000","last_became_active":"2024-03-16T07:24:35.776251+0000","last_became_peered":"2024-03-16T07:24:35.776251+0000","last_unstale":"2024-03-16T07:24:36.755815+0000","last_undegraded":"2024-03-16T07:24:36.755815+0000","last_fullsized":"2024-03-16T07:24:36.755815+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:01:17.121539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:38.551320+0000","last_change":"2024-03-16T07:24:34.758214+0000","last_active":"2024-03-16T07:24:38.551320+0000","last_peered":"2024-03-16T07:24:38.551320+0000","last_clean":"2024-03-16T07:24:38.551320+0000","last_became_active":"2024-03-16T07:24:34.757941+0000","last_became_peered":"2024-03-16T07:24:34.757941+0000","last_unstale":"2024-03-16T07:24:38.551320+0000","last_undegraded":"2024-03-16T07:24:38.551320+0000","last_fullsized":"2024-03-16T07:24:38.551320+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_clean_scrub_stamp":"2024-03-16T07:24:33.730276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:01:11.366672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.849240+0000","last_change":"2024-03-16T07:24:35.780117+0000","last_active":"2024-03-16T07:24:36.849240+0000","last_peered":"2024-03-16T07:24:36.849240+0000","last_clean":"2024-03-16T07:24:36.849240+0000","last_became_active":"2024-03-16T07:24:35.779858+0000","last_became_peered":"2024-03-16T07:24:35.779858+0000","last_unstale":"2024-03-16T07:24:36.849240+0000","last_undegraded":"2024-03-16T07:24:36.849240+0000","last_fullsized":"2024-03-16T07:24:36.849240+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:07:46.246610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.756171+0000","last_change":"2024-03-16T07:24:34.769682+0000","last_active":"2024-03-16T07:24:36.756171+0000","last_peered":"2024-03-16T07:24:36.756171+0000","last_clean":"2024-03-16T07:24:36.756171+0000","last_became_active":"2024-03-16T07:24:34.769389+0000","last_became_peered":"2024-03-16T07:24:34.769389+0000","last_unstale":"2024-03-16T07:24:36.756171+0000","last_undegraded":"2024-03-16T07:24:36.756171+0000","last_fullsized":"2024-03-16T07:24:36.756171+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_clean_scrub_stamp":"2024-03-16T07:24:33.730276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:20:10.353781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.848838+0000","last_change":"2024-03-16T07:24:35.780346+0000","last_active":"2024-03-16T07:24:36.848838+0000","last_peered":"2024-03-16T07:24:36.848838+0000","last_clean":"2024-03-16T07:24:36.848838+0000","last_became_active":"2024-03-16T07:24:35.779994+0000","last_became_peered":"2024-03-16T07:24:35.779994+0000","last_unstale":"2024-03-16T07:24:36.848838+0000","last_undegraded":"2024-03-16T07:24:36.848838+0000","last_fullsized":"2024-03-16T07:24:36.848838+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:36:30.781523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"15'8","reported_seq":22,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:38.551875+0000","last_change":"2024-03-16T07:24:34.759546+0000","last_active":"2024-03-16T07:24:38.551875+0000","last_peered":"2024-03-16T07:24:38.551875+0000","last_clean":"2024-03-16T07:24:38.551875+0000","last_became_active":"2024-03-16T07:24:34.759268+0000","last_became_peered":"2024-03-16T07:24:34.759268+0000","last_unstale":"2024-03-16T07:24:38.551875+0000","last_undegraded":"2024-03-16T07:24:38.551875+0000","last_fullsized":"2024-03-16T07:24:38.551875+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_clean_scrub_stamp":"2024-03-16T07:24:33.730276+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:19:11.558967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:38.551329+0000","last_change":"2024-03-16T07:24:35.760480+0000","last_active":"2024-03-16T07:24:38.551329+0000","last_peered":"2024-03-16T07:24:38.551329+0000","last_clean":"2024-03-16T07:24:38.551329+0000","last_became_active":"2024-03-16T07:24:35.759591+0000","last_became_peered":"2024-03-16T07:24:35.759591+0000","last_unstale":"2024-03-16T07:24:38.551329+0000","last_undegraded":"2024-03-16T07:24:38.551329+0000","last_fullsized":"2024-03-16T07:24:38.551329+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:08:27.087631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"15'1","reported_seq":15,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.756998+0000","last_change":"2024-03-16T07:24:34.769491+0000","last_active":"2024-03-16T07:24:36.756998+0000","last_peered":"2024-03-16T07:24:36.756998+0000","last_clean":"2024-03-16T07:24:36.756998+0000","last_became_active":"2024-03-16T07:24:34.769251+0000","last_became_peered":"2024-03-16T07:24:34.769251+0000","last_unstale":"2024-03-16T07:24:36.756998+0000","last_undegraded":"2024-03-16T07:24:36.756998+0000","last_fullsized":"2024-03-16T07:24:36.756998+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_clean_scrub_stamp":"2024-03-16T07:24:33.730276+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:54:01.611832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:38.552215+0000","last_change":"2024-03-16T07:24:35.770765+0000","last_active":"2024-03-16T07:24:38.552215+0000","last_peered":"2024-03-16T07:24:38.552215+0000","last_clean":"2024-03-16T07:24:38.552215+0000","last_became_active":"2024-03-16T07:24:35.770379+0000","last_became_peered":"2024-03-16T07:24:35.770379+0000","last_unstale":"2024-03-16T07:24:38.552215+0000","last_undegraded":"2024-03-16T07:24:38.552215+0000","last_fullsized":"2024-03-16T07:24:38.552215+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:28:16.855057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"15'2","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:38.552279+0000","last_change":"2024-03-16T07:24:34.762323+0000","last_active":"2024-03-16T07:24:38.552279+0000","last_peered":"2024-03-16T07:24:38.552279+0000","last_clean":"2024-03-16T07:24:38.552279+0000","last_became_active":"2024-03-16T07:24:34.761642+0000","last_became_peered":"2024-03-16T07:24:34.761642+0000","last_unstale":"2024-03-16T07:24:38.552279+0000","last_undegraded":"2024-03-16T07:24:38.552279+0000","last_fullsized":"2024-03-16T07:24:38.552279+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_clean_scrub_stamp":"2024-03-16T07:24:33.730276+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:13:05.731622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.756778+0000","last_change":"2024-03-16T07:24:35.779728+0000","last_active":"2024-03-16T07:24:36.756778+0000","last_peered":"2024-03-16T07:24:36.756778+0000","last_clean":"2024-03-16T07:24:36.756778+0000","last_became_active":"2024-03-16T07:24:35.778072+0000","last_became_peered":"2024-03-16T07:24:35.778072+0000","last_unstale":"2024-03-16T07:24:36.756778+0000","last_undegraded":"2024-03-16T07:24:36.756778+0000","last_fullsized":"2024-03-16T07:24:36.756778+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:50:35.923622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"15'1","reported_seq":15,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.850098+0000","last_change":"2024-03-16T07:24:34.753180+0000","last_active":"2024-03-16T07:24:36.850098+0000","last_peered":"2024-03-16T07:24:36.850098+0000","last_clean":"2024-03-16T07:24:36.850098+0000","last_became_active":"2024-03-16T07:24:34.752884+0000","last_became_peered":"2024-03-16T07:24:34.752884+0000","last_unstale":"2024-03-16T07:24:36.850098+0000","last_undegraded":"2024-03-16T07:24:36.850098+0000","last_fullsized":"2024-03-16T07:24:36.850098+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_clean_scrub_stamp":"2024-03-16T07:24:33.730276+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:01:34.459245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.756599+0000","last_change":"2024-03-16T07:24:35.776993+0000","last_active":"2024-03-16T07:24:36.756599+0000","last_peered":"2024-03-16T07:24:36.756599+0000","last_clean":"2024-03-16T07:24:36.756599+0000","last_became_active":"2024-03-16T07:24:35.776661+0000","last_became_peered":"2024-03-16T07:24:35.776661+0000","last_unstale":"2024-03-16T07:24:36.756599+0000","last_undegraded":"2024-03-16T07:24:36.756599+0000","last_fullsized":"2024-03-16T07:24:36.756599+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:48:42.060438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:38.551539+0000","last_change":"2024-03-16T07:24:34.763099+0000","last_active":"2024-03-16T07:24:38.551539+0000","last_peered":"2024-03-16T07:24:38.551539+0000","last_clean":"2024-03-16T07:24:38.551539+0000","last_became_active":"2024-03-16T07:24:34.762791+0000","last_became_peered":"2024-03-16T07:24:34.762791+0000","last_unstale":"2024-03-16T07:24:38.551539+0000","last_undegraded":"2024-03-16T07:24:38.551539+0000","last_fullsized":"2024-03-16T07:24:38.551539+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_clean_scrub_stamp":"2024-03-16T07:24:33.730276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:33:44.266615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.849820+0000","last_change":"2024-03-16T07:24:35.780874+0000","last_active":"2024-03-16T07:24:36.849820+0000","last_peered":"2024-03-16T07:24:36.849820+0000","last_clean":"2024-03-16T07:24:36.849820+0000","last_became_active":"2024-03-16T07:24:35.780663+0000","last_became_peered":"2024-03-16T07:24:35.780663+0000","last_unstale":"2024-03-16T07:24:36.849820+0000","last_undegraded":"2024-03-16T07:24:36.849820+0000","last_fullsized":"2024-03-16T07:24:36.849820+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:49:14.969756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'97","reported_seq":147,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.848896+0000","last_change":"2024-03-16T07:24:31.650537+0000","last_active":"2024-03-16T07:24:36.848896+0000","last_peered":"2024-03-16T07:24:36.848896+0000","last_clean":"2024-03-16T07:24:36.848896+0000","last_became_active":"2024-03-16T07:24:31.649574+0000","last_became_peered":"2024-03-16T07:24:31.649574+0000","last_unstale":"2024-03-16T07:24:36.848896+0000","last_undegraded":"2024-03-16T07:24:36.848896+0000","last_fullsized":"2024-03-16T07:24:36.848896+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:29.719970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:29.719970+0000","last_clean_scrub_stamp":"2024-03-16T07:24:29.719970+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:31:35.774554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.849379+0000","last_change":"2024-03-16T07:24:34.754912+0000","last_active":"2024-03-16T07:24:36.849379+0000","last_peered":"2024-03-16T07:24:36.849379+0000","last_clean":"2024-03-16T07:24:36.849379+0000","last_became_active":"2024-03-16T07:24:34.754625+0000","last_became_peered":"2024-03-16T07:24:34.754625+0000","last_unstale":"2024-03-16T07:24:36.849379+0000","last_undegraded":"2024-03-16T07:24:36.849379+0000","last_fullsized":"2024-03-16T07:24:36.849379+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_clean_scrub_stamp":"2024-03-16T07:24:33.730276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:19:11.558967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.849472+0000","last_change":"2024-03-16T07:24:35.762745+0000","last_active":"2024-03-16T07:24:36.849472+0000","last_peered":"2024-03-16T07:24:36.849472+0000","last_clean":"2024-03-16T07:24:36.849472+0000","last_became_active":"2024-03-16T07:24:35.761427+0000","last_became_peered":"2024-03-16T07:24:35.761427+0000","last_unstale":"2024-03-16T07:24:36.849472+0000","last_undegraded":"2024-03-16T07:24:36.849472+0000","last_fullsized":"2024-03-16T07:24:36.849472+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:48:17.097726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:38.552036+0000","last_change":"2024-03-16T07:24:34.760770+0000","last_active":"2024-03-16T07:24:38.552036+0000","last_peered":"2024-03-16T07:24:38.552036+0000","last_clean":"2024-03-16T07:24:38.552036+0000","last_became_active":"2024-03-16T07:24:34.759648+0000","last_became_peered":"2024-03-16T07:24:34.759648+0000","last_unstale":"2024-03-16T07:24:38.552036+0000","last_undegraded":"2024-03-16T07:24:38.552036+0000","last_fullsized":"2024-03-16T07:24:38.552036+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_clean_scrub_stamp":"2024-03-16T07:24:33.730276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:29:27.907682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.755501+0000","last_change":"2024-03-16T07:24:35.763497+0000","last_active":"2024-03-16T07:24:36.755501+0000","last_peered":"2024-03-16T07:24:36.755501+0000","last_clean":"2024-03-16T07:24:36.755501+0000","last_became_active":"2024-03-16T07:24:35.762740+0000","last_became_peered":"2024-03-16T07:24:35.762740+0000","last_unstale":"2024-03-16T07:24:36.755501+0000","last_undegraded":"2024-03-16T07:24:36.755501+0000","last_fullsized":"2024-03-16T07:24:36.755501+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:46:40.677706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:38.551565+0000","last_change":"2024-03-16T07:24:34.759060+0000","last_active":"2024-03-16T07:24:38.551565+0000","last_peered":"2024-03-16T07:24:38.551565+0000","last_clean":"2024-03-16T07:24:38.551565+0000","last_became_active":"2024-03-16T07:24:34.758804+0000","last_became_peered":"2024-03-16T07:24:34.758804+0000","last_unstale":"2024-03-16T07:24:38.551565+0000","last_undegraded":"2024-03-16T07:24:38.551565+0000","last_fullsized":"2024-03-16T07:24:38.551565+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_clean_scrub_stamp":"2024-03-16T07:24:33.730276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:56:51.770184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.848935+0000","last_change":"2024-03-16T07:24:35.765622+0000","last_active":"2024-03-16T07:24:36.848935+0000","last_peered":"2024-03-16T07:24:36.848935+0000","last_clean":"2024-03-16T07:24:36.848935+0000","last_became_active":"2024-03-16T07:24:35.765293+0000","last_became_peered":"2024-03-16T07:24:35.765293+0000","last_unstale":"2024-03-16T07:24:36.848935+0000","last_undegraded":"2024-03-16T07:24:36.848935+0000","last_fullsized":"2024-03-16T07:24:36.848935+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:08:27.087631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.755676+0000","last_change":"2024-03-16T07:24:34.769001+0000","last_active":"2024-03-16T07:24:36.755676+0000","last_peered":"2024-03-16T07:24:36.755676+0000","last_clean":"2024-03-16T07:24:36.755676+0000","last_became_active":"2024-03-16T07:24:34.768514+0000","last_became_peered":"2024-03-16T07:24:34.768514+0000","last_unstale":"2024-03-16T07:24:36.755676+0000","last_undegraded":"2024-03-16T07:24:36.755676+0000","last_fullsized":"2024-03-16T07:24:36.755676+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_clean_scrub_stamp":"2024-03-16T07:24:33.730276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:14:50.759285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.755766+0000","last_change":"2024-03-16T07:24:35.764911+0000","last_active":"2024-03-16T07:24:36.755766+0000","last_peered":"2024-03-16T07:24:36.755766+0000","last_clean":"2024-03-16T07:24:36.755766+0000","last_became_active":"2024-03-16T07:24:35.763991+0000","last_became_peered":"2024-03-16T07:24:35.763991+0000","last_unstale":"2024-03-16T07:24:36.755766+0000","last_undegraded":"2024-03-16T07:24:36.755766+0000","last_fullsized":"2024-03-16T07:24:36.755766+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:46:23.561018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.849543+0000","last_change":"2024-03-16T07:24:34.766776+0000","last_active":"2024-03-16T07:24:36.849543+0000","last_peered":"2024-03-16T07:24:36.849543+0000","last_clean":"2024-03-16T07:24:36.849543+0000","last_became_active":"2024-03-16T07:24:34.766401+0000","last_became_peered":"2024-03-16T07:24:34.766401+0000","last_unstale":"2024-03-16T07:24:36.849543+0000","last_undegraded":"2024-03-16T07:24:36.849543+0000","last_fullsized":"2024-03-16T07:24:36.849543+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_clean_scrub_stamp":"2024-03-16T07:24:33.730276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:54:01.611832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:38.552054+0000","last_change":"2024-03-16T07:24:35.758786+0000","last_active":"2024-03-16T07:24:38.552054+0000","last_peered":"2024-03-16T07:24:38.552054+0000","last_clean":"2024-03-16T07:24:38.552054+0000","last_became_active":"2024-03-16T07:24:35.758510+0000","last_became_peered":"2024-03-16T07:24:35.758510+0000","last_unstale":"2024-03-16T07:24:38.552054+0000","last_undegraded":"2024-03-16T07:24:38.552054+0000","last_fullsized":"2024-03-16T07:24:38.552054+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:56:18.247956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.850100+0000","last_change":"2024-03-16T07:24:34.767386+0000","last_active":"2024-03-16T07:24:36.850100+0000","last_peered":"2024-03-16T07:24:36.850100+0000","last_clean":"2024-03-16T07:24:36.850100+0000","last_became_active":"2024-03-16T07:24:34.766950+0000","last_became_peered":"2024-03-16T07:24:34.766950+0000","last_unstale":"2024-03-16T07:24:36.850100+0000","last_undegraded":"2024-03-16T07:24:36.850100+0000","last_fullsized":"2024-03-16T07:24:36.850100+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_clean_scrub_stamp":"2024-03-16T07:24:33.730276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:13:05.731622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.849568+0000","last_change":"2024-03-16T07:24:35.764512+0000","last_active":"2024-03-16T07:24:36.849568+0000","last_peered":"2024-03-16T07:24:36.849568+0000","last_clean":"2024-03-16T07:24:36.849568+0000","last_became_active":"2024-03-16T07:24:35.764264+0000","last_became_peered":"2024-03-16T07:24:35.764264+0000","last_unstale":"2024-03-16T07:24:36.849568+0000","last_undegraded":"2024-03-16T07:24:36.849568+0000","last_fullsized":"2024-03-16T07:24:36.849568+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:49:43.762702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"16'1","reported_seq":15,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:37.743513+0000","last_change":"2024-03-16T07:24:34.767319+0000","last_active":"2024-03-16T07:24:37.743513+0000","last_peered":"2024-03-16T07:24:37.743513+0000","last_clean":"2024-03-16T07:24:37.743513+0000","last_became_active":"2024-03-16T07:24:34.767028+0000","last_became_peered":"2024-03-16T07:24:34.767028+0000","last_unstale":"2024-03-16T07:24:37.743513+0000","last_undegraded":"2024-03-16T07:24:37.743513+0000","last_fullsized":"2024-03-16T07:24:37.743513+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_clean_scrub_stamp":"2024-03-16T07:24:33.730276+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:29:27.907682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:38.552082+0000","last_change":"2024-03-16T07:24:35.758709+0000","last_active":"2024-03-16T07:24:38.552082+0000","last_peered":"2024-03-16T07:24:38.552082+0000","last_clean":"2024-03-16T07:24:38.552082+0000","last_became_active":"2024-03-16T07:24:35.758160+0000","last_became_peered":"2024-03-16T07:24:35.758160+0000","last_unstale":"2024-03-16T07:24:38.552082+0000","last_undegraded":"2024-03-16T07:24:38.552082+0000","last_fullsized":"2024-03-16T07:24:38.552082+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:48:17.097726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"15'2","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.850272+0000","last_change":"2024-03-16T07:24:34.767310+0000","last_active":"2024-03-16T07:24:36.850272+0000","last_peered":"2024-03-16T07:24:36.850272+0000","last_clean":"2024-03-16T07:24:36.850272+0000","last_became_active":"2024-03-16T07:24:34.767009+0000","last_became_peered":"2024-03-16T07:24:34.767009+0000","last_unstale":"2024-03-16T07:24:36.850272+0000","last_undegraded":"2024-03-16T07:24:36.850272+0000","last_fullsized":"2024-03-16T07:24:36.850272+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_clean_scrub_stamp":"2024-03-16T07:24:33.730276+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:59:17.384928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.756195+0000","last_change":"2024-03-16T07:24:35.775915+0000","last_active":"2024-03-16T07:24:36.756195+0000","last_peered":"2024-03-16T07:24:36.756195+0000","last_clean":"2024-03-16T07:24:36.756195+0000","last_became_active":"2024-03-16T07:24:35.775655+0000","last_became_peered":"2024-03-16T07:24:35.775655+0000","last_unstale":"2024-03-16T07:24:36.756195+0000","last_undegraded":"2024-03-16T07:24:36.756195+0000","last_fullsized":"2024-03-16T07:24:36.756195+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:03:48.855314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.755137+0000","last_change":"2024-03-16T07:24:34.756852+0000","last_active":"2024-03-16T07:24:36.755137+0000","last_peered":"2024-03-16T07:24:36.755137+0000","last_clean":"2024-03-16T07:24:36.755137+0000","last_became_active":"2024-03-16T07:24:34.756442+0000","last_became_peered":"2024-03-16T07:24:34.756442+0000","last_unstale":"2024-03-16T07:24:36.755137+0000","last_undegraded":"2024-03-16T07:24:36.755137+0000","last_fullsized":"2024-03-16T07:24:36.755137+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_clean_scrub_stamp":"2024-03-16T07:24:33.730276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:19:11.558967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.756355+0000","last_change":"2024-03-16T07:24:35.763701+0000","last_active":"2024-03-16T07:24:36.756355+0000","last_peered":"2024-03-16T07:24:36.756355+0000","last_clean":"2024-03-16T07:24:36.756355+0000","last_became_active":"2024-03-16T07:24:35.763057+0000","last_became_peered":"2024-03-16T07:24:35.763057+0000","last_unstale":"2024-03-16T07:24:36.756355+0000","last_undegraded":"2024-03-16T07:24:36.756355+0000","last_fullsized":"2024-03-16T07:24:36.756355+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:05:30.548134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.849075+0000","last_change":"2024-03-16T07:24:34.764391+0000","last_active":"2024-03-16T07:24:36.849075+0000","last_peered":"2024-03-16T07:24:36.849075+0000","last_clean":"2024-03-16T07:24:36.849075+0000","last_became_active":"2024-03-16T07:24:34.764118+0000","last_became_peered":"2024-03-16T07:24:34.764118+0000","last_unstale":"2024-03-16T07:24:36.849075+0000","last_undegraded":"2024-03-16T07:24:36.849075+0000","last_fullsized":"2024-03-16T07:24:36.849075+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_clean_scrub_stamp":"2024-03-16T07:24:33.730276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:01:11.366672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:38.551494+0000","last_change":"2024-03-16T07:24:35.765029+0000","last_active":"2024-03-16T07:24:38.551494+0000","last_peered":"2024-03-16T07:24:38.551494+0000","last_clean":"2024-03-16T07:24:38.551494+0000","last_became_active":"2024-03-16T07:24:35.763997+0000","last_became_peered":"2024-03-16T07:24:35.763997+0000","last_unstale":"2024-03-16T07:24:38.551494+0000","last_undegraded":"2024-03-16T07:24:38.551494+0000","last_fullsized":"2024-03-16T07:24:38.551494+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:37:59.379102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.849280+0000","last_change":"2024-03-16T07:24:34.767533+0000","last_active":"2024-03-16T07:24:36.849280+0000","last_peered":"2024-03-16T07:24:36.849280+0000","last_clean":"2024-03-16T07:24:36.849280+0000","last_became_active":"2024-03-16T07:24:34.767181+0000","last_became_peered":"2024-03-16T07:24:34.767181+0000","last_unstale":"2024-03-16T07:24:36.849280+0000","last_undegraded":"2024-03-16T07:24:36.849280+0000","last_fullsized":"2024-03-16T07:24:36.849280+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_clean_scrub_stamp":"2024-03-16T07:24:33.730276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:20:10.353781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.849281+0000","last_change":"2024-03-16T07:24:35.761697+0000","last_active":"2024-03-16T07:24:36.849281+0000","last_peered":"2024-03-16T07:24:36.849281+0000","last_clean":"2024-03-16T07:24:36.849281+0000","last_became_active":"2024-03-16T07:24:35.760988+0000","last_became_peered":"2024-03-16T07:24:35.760988+0000","last_unstale":"2024-03-16T07:24:36.849281+0000","last_undegraded":"2024-03-16T07:24:36.849281+0000","last_fullsized":"2024-03-16T07:24:36.849281+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:03:38.294045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"15'2","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.756043+0000","last_change":"2024-03-16T07:24:34.758088+0000","last_active":"2024-03-16T07:24:36.756043+0000","last_peered":"2024-03-16T07:24:36.756043+0000","last_clean":"2024-03-16T07:24:36.756043+0000","last_became_active":"2024-03-16T07:24:34.757786+0000","last_became_peered":"2024-03-16T07:24:34.757786+0000","last_unstale":"2024-03-16T07:24:36.756043+0000","last_undegraded":"2024-03-16T07:24:36.756043+0000","last_fullsized":"2024-03-16T07:24:36.756043+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_clean_scrub_stamp":"2024-03-16T07:24:33.730276+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:13:05.731622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.755517+0000","last_change":"2024-03-16T07:24:35.776598+0000","last_active":"2024-03-16T07:24:36.755517+0000","last_peered":"2024-03-16T07:24:36.755517+0000","last_clean":"2024-03-16T07:24:36.755517+0000","last_became_active":"2024-03-16T07:24:35.775720+0000","last_became_peered":"2024-03-16T07:24:35.775720+0000","last_unstale":"2024-03-16T07:24:36.755517+0000","last_undegraded":"2024-03-16T07:24:36.755517+0000","last_fullsized":"2024-03-16T07:24:36.755517+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:31:37.132704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:38.551668+0000","last_change":"2024-03-16T07:24:35.755090+0000","last_active":"2024-03-16T07:24:38.551668+0000","last_peered":"2024-03-16T07:24:38.551668+0000","last_clean":"2024-03-16T07:24:38.551668+0000","last_became_active":"2024-03-16T07:24:35.754826+0000","last_became_peered":"2024-03-16T07:24:35.754826+0000","last_unstale":"2024-03-16T07:24:38.551668+0000","last_undegraded":"2024-03-16T07:24:38.551668+0000","last_fullsized":"2024-03-16T07:24:38.551668+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:03:38.294045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"15'2","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.756725+0000","last_change":"2024-03-16T07:24:34.768833+0000","last_active":"2024-03-16T07:24:36.756725+0000","last_peered":"2024-03-16T07:24:36.756725+0000","last_clean":"2024-03-16T07:24:36.756725+0000","last_became_active":"2024-03-16T07:24:34.768533+0000","last_became_peered":"2024-03-16T07:24:34.768533+0000","last_unstale":"2024-03-16T07:24:36.756725+0000","last_undegraded":"2024-03-16T07:24:36.756725+0000","last_fullsized":"2024-03-16T07:24:36.756725+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_clean_scrub_stamp":"2024-03-16T07:24:33.730276+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:59:17.384928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.849426+0000","last_change":"2024-03-16T07:24:35.782627+0000","last_active":"2024-03-16T07:24:36.849426+0000","last_peered":"2024-03-16T07:24:36.849426+0000","last_clean":"2024-03-16T07:24:36.849426+0000","last_became_active":"2024-03-16T07:24:35.782339+0000","last_became_peered":"2024-03-16T07:24:35.782339+0000","last_unstale":"2024-03-16T07:24:36.849426+0000","last_undegraded":"2024-03-16T07:24:36.849426+0000","last_fullsized":"2024-03-16T07:24:36.849426+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:15:00.108070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"15'2","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.756518+0000","last_change":"2024-03-16T07:24:34.768858+0000","last_active":"2024-03-16T07:24:36.756518+0000","last_peered":"2024-03-16T07:24:36.756518+0000","last_clean":"2024-03-16T07:24:36.756518+0000","last_became_active":"2024-03-16T07:24:34.768558+0000","last_became_peered":"2024-03-16T07:24:34.768558+0000","last_unstale":"2024-03-16T07:24:36.756518+0000","last_undegraded":"2024-03-16T07:24:36.756518+0000","last_fullsized":"2024-03-16T07:24:36.756518+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_clean_scrub_stamp":"2024-03-16T07:24:33.730276+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:25:31.602307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.756628+0000","last_change":"2024-03-16T07:24:35.778556+0000","last_active":"2024-03-16T07:24:36.756628+0000","last_peered":"2024-03-16T07:24:36.756628+0000","last_clean":"2024-03-16T07:24:36.756628+0000","last_became_active":"2024-03-16T07:24:35.777574+0000","last_became_peered":"2024-03-16T07:24:35.777574+0000","last_unstale":"2024-03-16T07:24:36.756628+0000","last_undegraded":"2024-03-16T07:24:36.756628+0000","last_fullsized":"2024-03-16T07:24:36.756628+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:25:26.895206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"15'1","reported_seq":15,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:38.552279+0000","last_change":"2024-03-16T07:24:34.762078+0000","last_active":"2024-03-16T07:24:38.552279+0000","last_peered":"2024-03-16T07:24:38.552279+0000","last_clean":"2024-03-16T07:24:38.552279+0000","last_became_active":"2024-03-16T07:24:34.761242+0000","last_became_peered":"2024-03-16T07:24:34.761242+0000","last_unstale":"2024-03-16T07:24:38.552279+0000","last_undegraded":"2024-03-16T07:24:38.552279+0000","last_fullsized":"2024-03-16T07:24:38.552279+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_clean_scrub_stamp":"2024-03-16T07:24:33.730276+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:01:34.459245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:38.552135+0000","last_change":"2024-03-16T07:24:35.763919+0000","last_active":"2024-03-16T07:24:38.552135+0000","last_peered":"2024-03-16T07:24:38.552135+0000","last_clean":"2024-03-16T07:24:38.552135+0000","last_became_active":"2024-03-16T07:24:35.763643+0000","last_became_peered":"2024-03-16T07:24:35.763643+0000","last_unstale":"2024-03-16T07:24:38.552135+0000","last_undegraded":"2024-03-16T07:24:38.552135+0000","last_fullsized":"2024-03-16T07:24:38.552135+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:34.734285+0000","last_clean_scrub_stamp":"2024-03-16T07:24:34.734285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:25:46.129511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"15'4","reported_seq":18,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T07:24:36.756909+0000","last_change":"2024-03-16T07:24:34.770349+0000","last_active":"2024-03-16T07:24:36.756909+0000","last_peered":"2024-03-16T07:24:36.756909+0000","last_clean":"2024-03-16T07:24:36.756909+0000","last_became_active":"2024-03-16T07:24:34.770054+0000","last_became_peered":"2024-03-16T07:24:34.770054+0000","last_unstale":"2024-03-16T07:24:36.756909+0000","last_undegraded":"2024-03-16T07:24:36.756909+0000","last_fullsized":"2024-03-16T07:24:36.756909+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:33.730276+0000","last_clean_scrub_stamp":"2024-03-16T07:24:33.730276+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:09:12.533977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738374,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27180,"kb_used_data":156,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":104830420,"statfs":{"total":107374182400,"available":107346350080,"internally_reserved":0,"allocated":159744,"data_stored":44486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738374,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27768,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":104829832,"statfs":{"total":107374182400,"available":107345747968,"internally_reserved":0,"allocated":761856,"data_stored":635514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738374,"num_pgs":74,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27756,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":104829844,"statfs":{"total":107374182400,"available":107345760256,"internally_reserved":0,"allocated":749568,"data_stored":633866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-16T07:24:45.697 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-03-16T07:24:45.697 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-03-16T07:24:45.697 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-03-16T07:24:45.697 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-03-16T07:24:46.070 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:24:46.071 INFO:teuthology.orchestra.run.smithi049.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-03-16T07:24:46.083 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-03-16T07:24:46.084 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T07:24:46.387 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:24:46.387 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":16,"fsid":"f91af061-9eac-4793-87fa-8d27ae3d242f","created":"2024-03-16T07:24:20.357868+0000","modified":"2024-03-16T07:24:36.750684+0000","last_up_change":"2024-03-16T07:24:27.474980+0000","last_in_change":"2024-03-16T07:24:21.254179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T07:24:28.947521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-16T07:24:32.994128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-16T07:24:34.097577+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3600000143051147,"score_stable":1.3600000143051147,"optimal_score":1,"raw_score_acting":1.3600000143051147,"raw_score_stable":1.3600000143051147,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2df14aac-98dc-4e3c-ae7e-9eb677aa30be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6801","nonce":2744935777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6803","nonce":2744935777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6807","nonce":2744935777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6805","nonce":2744935777}]},"public_addr":"172.21.15.49:6801/2744935777","cluster_addr":"172.21.15.49:6803/2744935777","heartbeat_back_addr":"172.21.15.49:6807/2744935777","heartbeat_front_addr":"172.21.15.49:6805/2744935777","state":["exists","up"]},{"osd":1,"uuid":"80461bd9-59ef-46df-9eea-bad92d960c57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6811","nonce":1655120118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6815","nonce":1655120118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6821","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6823","nonce":1655120118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6817","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6819","nonce":1655120118}]},"public_addr":"172.21.15.49:6811/1655120118","cluster_addr":"172.21.15.49:6815/1655120118","heartbeat_back_addr":"172.21.15.49:6823/1655120118","heartbeat_front_addr":"172.21.15.49:6819/1655120118","state":["exists","up"]},{"osd":2,"uuid":"d6bf40eb-6e42-4ec9-8b3d-0b6c5a6def79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6810","nonce":3815472376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6814","nonce":3815472376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6822","nonce":3815472376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6818","nonce":3815472376}]},"public_addr":"172.21.15.49:6810/3815472376","cluster_addr":"172.21.15.49:6814/3815472376","heartbeat_back_addr":"172.21.15.49:6822/3815472376","heartbeat_front_addr":"172.21.15.49:6818/3815472376","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.641492+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.668598+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.614940+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T07:24:46.404 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-16T07:24:28.947521+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-16T07:24:32.994128+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-16T07:24:34.097577+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3600000143051147, 'score_stable': 1.3600000143051147, 'optimal_score': 1, 'raw_score_acting': 1.3600000143051147, 'raw_score_stable': 1.3600000143051147, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-16T07:24:46.404 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-16T07:24:46.704 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2024-03-16T07:24:46.717 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-16T07:24:47.027 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2024-03-16T07:24:47.040 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-16T07:24:47.348 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2024-03-16T07:24:47.360 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T07:24:47.699 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:24:47.699 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4137,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6827/874710529","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":874710529},{"type":"v1","addr":"172.21.15.49:6827","nonce":874710529}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4144,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6829/2575941527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":2575941527},{"type":"v1","addr":"172.21.15.49:6829","nonce":2575941527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4145,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6832/3158244217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":3158244217},{"type":"v1","addr":"172.21.15.49:6832","nonce":3158244217}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4146,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6833/3138521926","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6831","nonce":3138521926},{"type":"v1","addr":"172.21.15.49:6833","nonce":3138521926}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-16T07:24:35.123262+0000","modified":"2024-03-16T07:24:38.246781+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4149},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4149":{"gid":4149,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6835/2474486057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":2474486057},{"type":"v1","addr":"172.21.15.49:6835","nonce":2474486057}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4149,"qdb_cluster":[4149]},"id":1}]} 2024-03-16T07:24:47.700 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 8 2024-03-16T07:24:47.712 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T07:24:48.083 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:24:48.083 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":16,"fsid":"f91af061-9eac-4793-87fa-8d27ae3d242f","created":"2024-03-16T07:24:20.357868+0000","modified":"2024-03-16T07:24:36.750684+0000","last_up_change":"2024-03-16T07:24:27.474980+0000","last_in_change":"2024-03-16T07:24:21.254179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T07:24:28.947521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-16T07:24:32.994128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-16T07:24:34.097577+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3600000143051147,"score_stable":1.3600000143051147,"optimal_score":1,"raw_score_acting":1.3600000143051147,"raw_score_stable":1.3600000143051147,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2df14aac-98dc-4e3c-ae7e-9eb677aa30be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6801","nonce":2744935777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6803","nonce":2744935777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6807","nonce":2744935777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6805","nonce":2744935777}]},"public_addr":"172.21.15.49:6801/2744935777","cluster_addr":"172.21.15.49:6803/2744935777","heartbeat_back_addr":"172.21.15.49:6807/2744935777","heartbeat_front_addr":"172.21.15.49:6805/2744935777","state":["exists","up"]},{"osd":1,"uuid":"80461bd9-59ef-46df-9eea-bad92d960c57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6811","nonce":1655120118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6815","nonce":1655120118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6821","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6823","nonce":1655120118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6817","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6819","nonce":1655120118}]},"public_addr":"172.21.15.49:6811/1655120118","cluster_addr":"172.21.15.49:6815/1655120118","heartbeat_back_addr":"172.21.15.49:6823/1655120118","heartbeat_front_addr":"172.21.15.49:6819/1655120118","state":["exists","up"]},{"osd":2,"uuid":"d6bf40eb-6e42-4ec9-8b3d-0b6c5a6def79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6810","nonce":3815472376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6814","nonce":3815472376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6822","nonce":3815472376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6818","nonce":3815472376}]},"public_addr":"172.21.15.49:6810/3815472376","cluster_addr":"172.21.15.49:6814/3815472376","heartbeat_back_addr":"172.21.15.49:6822/3815472376","heartbeat_front_addr":"172.21.15.49:6818/3815472376","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.641492+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.668598+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.614940+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T07:24:48.100 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-16T07:24:28.947521+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-16T07:24:32.994128+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-16T07:24:34.097577+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3600000143051147, 'score_stable': 1.3600000143051147, 'optimal_score': 1, 'raw_score_acting': 1.3600000143051147, 'raw_score_stable': 1.3600000143051147, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-16T07:24:48.100 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-16T07:24:48.401 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2024-03-16T07:24:48.414 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-16T07:24:48.728 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2024-03-16T07:24:48.741 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-16T07:24:49.045 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2024-03-16T07:24:49.057 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T07:24:49.396 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:24:49.396 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4137,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6827/874710529","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":874710529},{"type":"v1","addr":"172.21.15.49:6827","nonce":874710529}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4144,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6829/2575941527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":2575941527},{"type":"v1","addr":"172.21.15.49:6829","nonce":2575941527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4145,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6832/3158244217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":3158244217},{"type":"v1","addr":"172.21.15.49:6832","nonce":3158244217}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4146,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6833/3138521926","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6831","nonce":3138521926},{"type":"v1","addr":"172.21.15.49:6833","nonce":3138521926}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-16T07:24:35.123262+0000","modified":"2024-03-16T07:24:38.246781+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4149},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4149":{"gid":4149,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6835/2474486057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":2474486057},{"type":"v1","addr":"172.21.15.49:6835","nonce":2474486057}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4149,"qdb_cluster":[4149]},"id":1}]} 2024-03-16T07:24:49.396 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 8 2024-03-16T07:24:49.408 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T07:24:49.710 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:24:49.710 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":16,"fsid":"f91af061-9eac-4793-87fa-8d27ae3d242f","created":"2024-03-16T07:24:20.357868+0000","modified":"2024-03-16T07:24:36.750684+0000","last_up_change":"2024-03-16T07:24:27.474980+0000","last_in_change":"2024-03-16T07:24:21.254179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T07:24:28.947521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-16T07:24:32.994128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-16T07:24:34.097577+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3600000143051147,"score_stable":1.3600000143051147,"optimal_score":1,"raw_score_acting":1.3600000143051147,"raw_score_stable":1.3600000143051147,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2df14aac-98dc-4e3c-ae7e-9eb677aa30be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6801","nonce":2744935777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6803","nonce":2744935777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6807","nonce":2744935777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6805","nonce":2744935777}]},"public_addr":"172.21.15.49:6801/2744935777","cluster_addr":"172.21.15.49:6803/2744935777","heartbeat_back_addr":"172.21.15.49:6807/2744935777","heartbeat_front_addr":"172.21.15.49:6805/2744935777","state":["exists","up"]},{"osd":1,"uuid":"80461bd9-59ef-46df-9eea-bad92d960c57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6811","nonce":1655120118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6815","nonce":1655120118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6821","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6823","nonce":1655120118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6817","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6819","nonce":1655120118}]},"public_addr":"172.21.15.49:6811/1655120118","cluster_addr":"172.21.15.49:6815/1655120118","heartbeat_back_addr":"172.21.15.49:6823/1655120118","heartbeat_front_addr":"172.21.15.49:6819/1655120118","state":["exists","up"]},{"osd":2,"uuid":"d6bf40eb-6e42-4ec9-8b3d-0b6c5a6def79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6810","nonce":3815472376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6814","nonce":3815472376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6822","nonce":3815472376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6818","nonce":3815472376}]},"public_addr":"172.21.15.49:6810/3815472376","cluster_addr":"172.21.15.49:6814/3815472376","heartbeat_back_addr":"172.21.15.49:6822/3815472376","heartbeat_front_addr":"172.21.15.49:6818/3815472376","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.641492+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.668598+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.614940+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T07:24:49.723 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T07:24:50.064 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:24:50.065 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4137,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6827/874710529","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":874710529},{"type":"v1","addr":"172.21.15.49:6827","nonce":874710529}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4144,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6829/2575941527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":2575941527},{"type":"v1","addr":"172.21.15.49:6829","nonce":2575941527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4145,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6832/3158244217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":3158244217},{"type":"v1","addr":"172.21.15.49:6832","nonce":3158244217}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4146,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6833/3138521926","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6831","nonce":3138521926},{"type":"v1","addr":"172.21.15.49:6833","nonce":3138521926}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-16T07:24:35.123262+0000","modified":"2024-03-16T07:24:38.246781+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4149},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4149":{"gid":4149,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6835/2474486057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":2474486057},{"type":"v1","addr":"172.21.15.49:6835","nonce":2474486057}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4149,"qdb_cluster":[4149]},"id":1}]} 2024-03-16T07:24:50.065 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 8 2024-03-16T07:24:50.579 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-03-16T07:24:35.123262+0000', 'modified': '2024-03-16T07:24:38.246781+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4149}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4149': {'gid': 4149, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.49:6835/2474486057', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.49:6834', 'nonce': 2474486057}, {'type': 'v1', 'addr': '172.21.15.49:6835', 'nonce': 2474486057}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4149, 'qdb_cluster': [4149]} 2024-03-16T07:24:50.579 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-03-16T07:24:50.580 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-03-16T07:24:50.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-16T07:24:50.706+0000 7f63f97fa640 0 client.4298 ms_handle_reset on v2:172.21.15.49:6834/2474486057 2024-03-16T07:24:50.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-16T07:24:50.736+0000 7f63f97fa640 0 client.4300 ms_handle_reset on v2:172.21.15.49:6834/2474486057 2024-03-16T07:24:50.734 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-03-16T07:24:50.735 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_fsid": "f91af061-9eac-4793-87fa-8d27ae3d242f", 2024-03-16T07:24:50.735 INFO:teuthology.orchestra.run.smithi049.stdout: "whoami": 0, 2024-03-16T07:24:50.735 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 4149, 2024-03-16T07:24:50.735 INFO:teuthology.orchestra.run.smithi049.stdout: "want_state": "up:active", 2024-03-16T07:24:50.735 INFO:teuthology.orchestra.run.smithi049.stdout: "state": "up:active", 2024-03-16T07:24:50.735 INFO:teuthology.orchestra.run.smithi049.stdout: "fs_name": "cephfs", 2024-03-16T07:24:50.735 INFO:teuthology.orchestra.run.smithi049.stdout: "rank_uptime": 14.997306756, 2024-03-16T07:24:50.735 INFO:teuthology.orchestra.run.smithi049.stdout: "mdsmap_epoch": 8, 2024-03-16T07:24:50.735 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch": 16, 2024-03-16T07:24:50.735 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch_barrier": 16, 2024-03-16T07:24:50.735 INFO:teuthology.orchestra.run.smithi049.stdout: "uptime": 22.007665730999999 2024-03-16T07:24:50.735 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-03-16T07:24:50.750 INFO:teuthology.run_tasks:Running task cephfs-mirror... 2024-03-16T07:24:50.761 DEBUG:tasks.ceph_manager:running cephfs-mirror-client.mirror under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/cephfs-mirror-client.mirror.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2024-03-16T07:24:50.761 INFO:tasks.cephfs_mirror.client.mirror:Restarting daemon 2024-03-16T07:24:50.761 DEBUG:teuthology.orchestra.run.smithi049:> cd /home/ubuntu/cephtest && adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/cephfs-mirror-client.mirror.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes cephfs-mirror --cluster ceph --id mirror 2024-03-16T07:24:50.763 INFO:tasks.cephfs_mirror.client.mirror:Started 2024-03-16T07:24:50.763 INFO:teuthology.run_tasks:Running task exec... 2024-03-16T07:24:50.771 INFO:teuthology.task.exec:Executing custom commands... 2024-03-16T07:24:50.772 INFO:teuthology.task.exec:Running commands on role client.mirror host ubuntu@smithi049.front.sepia.ceph.com 2024-03-16T07:24:50.772 DEBUG:teuthology.orchestra.run.smithi049:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph auth caps client.mirror mon '"'"'profile cephfs-mirror'"'"' mds '"'"'allow r'"'"' osd '"'"'allow rw tag cephfs metadata=*, allow r tag cephfs data=*'"'"' mgr '"'"'allow r'"'"'' 2024-03-16T07:24:51.194 INFO:teuthology.orchestra.run.smithi049.stdout:[client.mirror] 2024-03-16T07:24:51.194 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQAaSfVldspUIRAAa1kAy23ZdMBfbhy+7HMVqA== 2024-03-16T07:24:51.195 INFO:teuthology.orchestra.run.smithi049.stdout: caps mds = "allow r" 2024-03-16T07:24:51.195 INFO:teuthology.orchestra.run.smithi049.stdout: caps mgr = "allow r" 2024-03-16T07:24:51.195 INFO:teuthology.orchestra.run.smithi049.stdout: caps mon = "profile cephfs-mirror" 2024-03-16T07:24:51.195 INFO:teuthology.orchestra.run.smithi049.stdout: caps osd = "allow rw tag cephfs metadata=*, allow r tag cephfs data=*" 2024-03-16T07:24:51.195 INFO:teuthology.orchestra.run.smithi049.stderr:updated caps for client.mirror 2024-03-16T07:24:51.208 INFO:teuthology.task.exec:Running commands on role client.mirror_remote host ubuntu@smithi049.front.sepia.ceph.com 2024-03-16T07:24:51.208 DEBUG:teuthology.orchestra.run.smithi049:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph auth caps client.mirror_remote mon '"'"'allow r'"'"' mds '"'"'allow rwps'"'"' osd '"'"'allow rw tag cephfs *=*'"'"' mgr '"'"'allow r'"'"'' 2024-03-16T07:24:51.600 INFO:teuthology.orchestra.run.smithi049.stdout:[client.mirror_remote] 2024-03-16T07:24:51.600 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQAaSfVlaygzJRAAJVP9XACdC2Wikb4ZtKci9g== 2024-03-16T07:24:51.600 INFO:teuthology.orchestra.run.smithi049.stdout: caps mds = "allow rwps" 2024-03-16T07:24:51.600 INFO:teuthology.orchestra.run.smithi049.stdout: caps mgr = "allow r" 2024-03-16T07:24:51.600 INFO:teuthology.orchestra.run.smithi049.stdout: caps mon = "allow r" 2024-03-16T07:24:51.600 INFO:teuthology.orchestra.run.smithi049.stdout: caps osd = "allow rw tag cephfs *=*" 2024-03-16T07:24:51.600 INFO:teuthology.orchestra.run.smithi049.stderr:updated caps for client.mirror_remote 2024-03-16T07:24:51.618 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-03-16T07:24:51.642 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-03-16T07:24:51.643 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.1': {}} 2024-03-16T07:24:51.643 INFO:tasks.ceph_fuse:client.0 config is {} 2024-03-16T07:24:51.643 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-03-16T07:24:51.643 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-03-16T07:24:51.643 INFO:tasks.ceph_fuse:client.1 config is {} 2024-03-16T07:24:51.643 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-03-16T07:24:51.643 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-03-16T07:24:51.643 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:24:51.643 DEBUG:teuthology.orchestra.run.smithi049:> ip netns list 2024-03-16T07:24:51.659 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:24:51.659 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link delete ceph-brx 2024-03-16T07:24:51.732 INFO:teuthology.orchestra.run.smithi049.stderr:Cannot find device "ceph-brx" 2024-03-16T07:24:51.734 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-16T07:24:51.734 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-03-16T07:24:51.734 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-03-16T07:24:52.130 INFO:teuthology.orchestra.run.smithi049.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-03-16T07:24:52.143 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-03-16T07:24:52.143 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-03-16T07:24:52.143 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi049.front.sepia.ceph.com 2024-03-16T07:24:52.143 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-03-16T07:24:52.143 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-03-16T07:24:52.143 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-03-16T07:24:52.143 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-03-16T07:24:52.143 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-03-16T07:24:52.143 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-03-16T07:24:52.143 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:24:52.144 DEBUG:teuthology.orchestra.run.smithi049:> ip addr 2024-03-16T07:24:52.159 INFO:teuthology.orchestra.run.smithi049.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-16T07:24:52.159 INFO:teuthology.orchestra.run.smithi049.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-16T07:24:52.159 INFO:teuthology.orchestra.run.smithi049.stdout: inet 127.0.0.1/8 scope host lo 2024-03-16T07:24:52.159 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-03-16T07:24:52.159 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 ::1/128 scope host 2024-03-16T07:24:52.159 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-03-16T07:24:52.159 INFO:teuthology.orchestra.run.smithi049.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-16T07:24:52.159 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:6b:ff:84 brd ff:ff:ff:ff:ff:ff 2024-03-16T07:24:52.159 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp7s0f0 2024-03-16T07:24:52.159 INFO:teuthology.orchestra.run.smithi049.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-16T07:24:52.159 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:6b:ff:85 brd ff:ff:ff:ff:ff:ff 2024-03-16T07:24:52.159 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp7s0f1 2024-03-16T07:24:52.159 INFO:teuthology.orchestra.run.smithi049.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-03-16T07:24:52.160 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:bd:15:66 brd ff:ff:ff:ff:ff:ff 2024-03-16T07:24:52.160 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp1s0f0 2024-03-16T07:24:52.160 INFO:teuthology.orchestra.run.smithi049.stdout: inet 172.21.15.49/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-03-16T07:24:52.160 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft 42415sec preferred_lft 42415sec 2024-03-16T07:24:52.160 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::ec4:7aff:febd:1566/64 scope link noprefixroute 2024-03-16T07:24:52.160 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-03-16T07:24:52.160 INFO:teuthology.orchestra.run.smithi049.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-16T07:24:52.160 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:bd:15:67 brd ff:ff:ff:ff:ff:ff 2024-03-16T07:24:52.160 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp1s0f1 2024-03-16T07:24:52.160 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-03-16T07:24:52.161 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-16T07:24:52.161 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-03-16T07:24:52.161 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link add name ceph-brx type bridge 2024-03-16T07:24:52.161 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip addr flush dev ceph-brx 2024-03-16T07:24:52.161 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link set ceph-brx up 2024-03-16T07:24:52.161 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-03-16T07:24:52.161 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-03-16T07:24:52.248 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-16T07:24:52 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-16T07:24:52.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-16T07:24:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-16T07:24:52.387 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:24:52.387 DEBUG:teuthology.orchestra.run.smithi049:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-03-16T07:24:52.418 INFO:teuthology.orchestra.run.smithi049.stdout:1 2024-03-16T07:24:52.420 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:24:52.420 DEBUG:teuthology.orchestra.run.smithi049:> route 2024-03-16T07:24:52.509 INFO:teuthology.orchestra.run.smithi049.stdout:Kernel IP routing table 2024-03-16T07:24:52.509 INFO:teuthology.orchestra.run.smithi049.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-03-16T07:24:52.509 INFO:teuthology.orchestra.run.smithi049.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-03-16T07:24:52.509 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-03-16T07:24:52.509 INFO:teuthology.orchestra.run.smithi049.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-03-16T07:24:52.509 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-16T07:24:52.509 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-03-16T07:24:52.510 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-03-16T07:24:52.510 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-03-16T07:24:52.510 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-03-16T07:24:52.510 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-03-16T07:24:52.560 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-16T07:24:52 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-16T07:24:52.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-16T07:24:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-16T07:24:52.784 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:24:52.784 DEBUG:teuthology.orchestra.run.smithi049:> ip netns list 2024-03-16T07:24:52.799 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:24:52.800 DEBUG:teuthology.orchestra.run.smithi049:> ip netns list-id 2024-03-16T07:24:52.854 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-16T07:24:52.854 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-03-16T07:24:52.854 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-16T07:24:52.854 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-03-16T07:24:52.854 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-03-16T07:24:52.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-16T07:24:52 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-16T07:24:52.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-16T07:24:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-16T07:24:52.987 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-03-16T07:24:52.987 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-16T07:24:52.987 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-03-16T07:24:52.987 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-03-16T07:24:52.987 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-03-16T07:24:52.987 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-03-16T07:24:52.987 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-03-16T07:24:52.988 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-03-16T07:24:52.988 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-03-16T07:24:53.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-16T07:24:53 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-16T07:24:53.146 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-16T07:24:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-16T07:24:53.152 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-16T07:24:53.152 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-03-16T07:24:53.152 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link set brx.0 up 2024-03-16T07:24:53.152 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link set dev brx.0 master ceph-brx 2024-03-16T07:24:53.152 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-03-16T07:24:53.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-16T07:24:53 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-16T07:24:53.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-16T07:24:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-16T07:24:53.245 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-03-16T07:24:53.246 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-16T07:24:53.246 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-03-16T07:24:53.276 INFO:teuthology.orchestra.run.smithi049.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-03-16T07:24:53.276 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-16T07:24:53.277 DEBUG:teuthology.orchestra.run.smithi049:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-03-16T07:24:53.331 DEBUG:teuthology.orchestra.run.smithi049:> sudo modprobe fuse 2024-03-16T07:24:53.402 DEBUG:teuthology.orchestra.run.smithi049:> cat /proc/self/mounts | awk '{print $2}' 2024-03-16T07:24:53.459 INFO:teuthology.orchestra.run.smithi049.stdout:/proc 2024-03-16T07:24:53.459 INFO:teuthology.orchestra.run.smithi049.stdout:/sys 2024-03-16T07:24:53.459 INFO:teuthology.orchestra.run.smithi049.stdout:/dev 2024-03-16T07:24:53.459 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/security 2024-03-16T07:24:53.459 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/shm 2024-03-16T07:24:53.459 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/pts 2024-03-16T07:24:53.459 INFO:teuthology.orchestra.run.smithi049.stdout:/run 2024-03-16T07:24:53.459 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/cgroup 2024-03-16T07:24:53.459 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/pstore 2024-03-16T07:24:53.459 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/bpf 2024-03-16T07:24:53.459 INFO:teuthology.orchestra.run.smithi049.stdout:/ 2024-03-16T07:24:53.460 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/selinux 2024-03-16T07:24:53.460 INFO:teuthology.orchestra.run.smithi049.stdout:/proc/sys/fs/binfmt_misc 2024-03-16T07:24:53.460 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/mqueue 2024-03-16T07:24:53.460 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/hugepages 2024-03-16T07:24:53.460 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/debug 2024-03-16T07:24:53.460 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/tracing 2024-03-16T07:24:53.460 INFO:teuthology.orchestra.run.smithi049.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-03-16T07:24:53.460 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/fuse/connections 2024-03-16T07:24:53.460 INFO:teuthology.orchestra.run.smithi049.stdout:/run/credentials/systemd-sysctl.service 2024-03-16T07:24:53.460 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/config 2024-03-16T07:24:53.460 INFO:teuthology.orchestra.run.smithi049.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-03-16T07:24:53.460 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/nfs/rpc_pipefs 2024-03-16T07:24:53.460 INFO:teuthology.orchestra.run.smithi049.stdout:/run/user/1000 2024-03-16T07:24:53.460 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph 2024-03-16T07:24:53.460 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-0 2024-03-16T07:24:53.461 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-1 2024-03-16T07:24:53.461 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-2 2024-03-16T07:24:53.461 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns 2024-03-16T07:24:53.461 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-16T07:24:53.461 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-16T07:24:53.461 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:24:53.461 DEBUG:teuthology.orchestra.run.smithi049:> ls /sys/fs/fuse/connections 2024-03-16T07:24:53.514 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-03-16T07:24:53.514 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-03-16T07:24:53.556 DEBUG:teuthology.orchestra.run.smithi049:> sudo modprobe fuse 2024-03-16T07:24:53.591 DEBUG:teuthology.orchestra.run.smithi049:> cat /proc/self/mounts | awk '{print $2}' 2024-03-16T07:24:53.648 INFO:teuthology.orchestra.run.smithi049.stdout:/proc 2024-03-16T07:24:53.648 INFO:teuthology.orchestra.run.smithi049.stdout:/sys 2024-03-16T07:24:53.648 INFO:teuthology.orchestra.run.smithi049.stdout:/dev 2024-03-16T07:24:53.648 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/security 2024-03-16T07:24:53.649 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/shm 2024-03-16T07:24:53.649 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/pts 2024-03-16T07:24:53.649 INFO:teuthology.orchestra.run.smithi049.stdout:/run 2024-03-16T07:24:53.649 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/cgroup 2024-03-16T07:24:53.649 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/pstore 2024-03-16T07:24:53.649 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/bpf 2024-03-16T07:24:53.649 INFO:teuthology.orchestra.run.smithi049.stdout:/ 2024-03-16T07:24:53.649 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/selinux 2024-03-16T07:24:53.649 INFO:teuthology.orchestra.run.smithi049.stdout:/proc/sys/fs/binfmt_misc 2024-03-16T07:24:53.649 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/mqueue 2024-03-16T07:24:53.649 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/hugepages 2024-03-16T07:24:53.649 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/debug 2024-03-16T07:24:53.649 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/tracing 2024-03-16T07:24:53.649 INFO:teuthology.orchestra.run.smithi049.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-03-16T07:24:53.649 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/fuse/connections 2024-03-16T07:24:53.649 INFO:teuthology.orchestra.run.smithi049.stdout:/run/credentials/systemd-sysctl.service 2024-03-16T07:24:53.650 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/config 2024-03-16T07:24:53.650 INFO:teuthology.orchestra.run.smithi049.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-03-16T07:24:53.650 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/nfs/rpc_pipefs 2024-03-16T07:24:53.650 INFO:teuthology.orchestra.run.smithi049.stdout:/run/user/1000 2024-03-16T07:24:53.650 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph 2024-03-16T07:24:53.650 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-0 2024-03-16T07:24:53.650 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-1 2024-03-16T07:24:53.650 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-2 2024-03-16T07:24:53.650 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns 2024-03-16T07:24:53.650 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-16T07:24:53.650 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-16T07:24:53.651 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:24:53.651 DEBUG:teuthology.orchestra.run.smithi049:> ls /sys/fs/fuse/connections 2024-03-16T07:24:53.657 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi049.stderr:2024-03-16T07:24:53.658+0000 7f4163a36480 -1 init, newargv = 0x55f371c81000 newargc=15 2024-03-16T07:24:53.657 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi049.stderr:ceph-fuse[41469]: starting ceph client 2024-03-16T07:24:53.663 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi049.stderr:ceph-fuse[41469]: starting fuse 2024-03-16T07:24:53.674 INFO:teuthology.orchestra.run.smithi049.stdout:41 2024-03-16T07:24:53.674 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2024-03-16T07:24:53.674 DEBUG:teuthology.orchestra.run.smithi049:> sudo stdin-killer -- python3 -c ' 2024-03-16T07:24:53.674 DEBUG:teuthology.orchestra.run.smithi049:> import glob 2024-03-16T07:24:53.674 DEBUG:teuthology.orchestra.run.smithi049:> import re 2024-03-16T07:24:53.674 DEBUG:teuthology.orchestra.run.smithi049:> import os 2024-03-16T07:24:53.674 DEBUG:teuthology.orchestra.run.smithi049:> import subprocess 2024-03-16T07:24:53.675 DEBUG:teuthology.orchestra.run.smithi049:> 2024-03-16T07:24:53.675 DEBUG:teuthology.orchestra.run.smithi049:> def _find_admin_socket(client_name): 2024-03-16T07:24:53.675 DEBUG:teuthology.orchestra.run.smithi049:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-03-16T07:24:53.675 DEBUG:teuthology.orchestra.run.smithi049:> files = glob.glob(asok_path) 2024-03-16T07:24:53.675 DEBUG:teuthology.orchestra.run.smithi049:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-03-16T07:24:53.675 DEBUG:teuthology.orchestra.run.smithi049:> 2024-03-16T07:24:53.675 DEBUG:teuthology.orchestra.run.smithi049:> # Given a non-glob path, it better be there 2024-03-16T07:24:53.675 DEBUG:teuthology.orchestra.run.smithi049:> if "*" not in asok_path: 2024-03-16T07:24:53.675 DEBUG:teuthology.orchestra.run.smithi049:> assert(len(files) == 1) 2024-03-16T07:24:53.675 DEBUG:teuthology.orchestra.run.smithi049:> return files[0] 2024-03-16T07:24:53.675 DEBUG:teuthology.orchestra.run.smithi049:> 2024-03-16T07:24:53.675 DEBUG:teuthology.orchestra.run.smithi049:> for f in files: 2024-03-16T07:24:53.675 DEBUG:teuthology.orchestra.run.smithi049:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-03-16T07:24:53.675 DEBUG:teuthology.orchestra.run.smithi049:> if os.path.exists("/proc/{0}".format(pid)): 2024-03-16T07:24:53.675 DEBUG:teuthology.orchestra.run.smithi049:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-03-16T07:24:53.675 DEBUG:teuthology.orchestra.run.smithi049:> contents = proc_f.read() 2024-03-16T07:24:53.675 DEBUG:teuthology.orchestra.run.smithi049:> if mountpoint in contents: 2024-03-16T07:24:53.675 DEBUG:teuthology.orchestra.run.smithi049:> return f 2024-03-16T07:24:53.676 DEBUG:teuthology.orchestra.run.smithi049:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-03-16T07:24:53.676 DEBUG:teuthology.orchestra.run.smithi049:> 2024-03-16T07:24:53.676 DEBUG:teuthology.orchestra.run.smithi049:> print(_find_admin_socket("client.0")) 2024-03-16T07:24:53.676 DEBUG:teuthology.orchestra.run.smithi049:> ' 2024-03-16T07:24:53.825 INFO:teuthology.orchestra.run.smithi049.stdout:/var/run/ceph/ceph-client.0.41469.asok 2024-03-16T07:24:53.828 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-16T07:24:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-16T07:24:53.837 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.41469.asok 2024-03-16T07:24:53.837 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:24:53.837 DEBUG:teuthology.orchestra.run.smithi049:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.41469.asok status 2024-03-16T07:24:53.992 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-03-16T07:24:53.992 INFO:teuthology.orchestra.run.smithi049.stdout: "metadata": { 2024-03-16T07:24:53.992 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph_sha1": "3d78f5ba07bf18880172c07d4d7b4ac00c9d30af", 2024-03-16T07:24:53.992 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph_version": "ceph version 19.0.0-2162-g3d78f5ba (3d78f5ba07bf18880172c07d4d7b4ac00c9d30af) squid (dev)", 2024-03-16T07:24:53.992 INFO:teuthology.orchestra.run.smithi049.stdout: "entity_id": "0", 2024-03-16T07:24:53.992 INFO:teuthology.orchestra.run.smithi049.stdout: "hostname": "smithi049", 2024-03-16T07:24:53.992 INFO:teuthology.orchestra.run.smithi049.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-03-16T07:24:53.992 INFO:teuthology.orchestra.run.smithi049.stdout: "pid": "41469", 2024-03-16T07:24:53.992 INFO:teuthology.orchestra.run.smithi049.stdout: "root": "/" 2024-03-16T07:24:53.992 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:24:53.992 INFO:teuthology.orchestra.run.smithi049.stdout: "dentry_count": 0, 2024-03-16T07:24:53.992 INFO:teuthology.orchestra.run.smithi049.stdout: "dentry_pinned_count": 0, 2024-03-16T07:24:53.992 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 4312, 2024-03-16T07:24:53.993 INFO:teuthology.orchestra.run.smithi049.stdout: "inst": { 2024-03-16T07:24:53.993 INFO:teuthology.orchestra.run.smithi049.stdout: "name": { 2024-03-16T07:24:53.993 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "client", 2024-03-16T07:24:53.993 INFO:teuthology.orchestra.run.smithi049.stdout: "num": 4312 2024-03-16T07:24:53.993 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:24:53.993 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": { 2024-03-16T07:24:53.993 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2024-03-16T07:24:53.993 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "192.168.0.1:0", 2024-03-16T07:24:53.993 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 3054848905 2024-03-16T07:24:53.993 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:24:53.993 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:24:53.993 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": { 2024-03-16T07:24:53.993 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2024-03-16T07:24:53.993 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "192.168.0.1:0", 2024-03-16T07:24:53.994 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 3054848905 2024-03-16T07:24:53.994 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:24:53.994 INFO:teuthology.orchestra.run.smithi049.stdout: "inst_str": "client.4312 192.168.0.1:0/3054848905", 2024-03-16T07:24:53.994 INFO:teuthology.orchestra.run.smithi049.stdout: "addr_str": "192.168.0.1:0/3054848905", 2024-03-16T07:24:53.994 INFO:teuthology.orchestra.run.smithi049.stdout: "inode_count": 1, 2024-03-16T07:24:53.994 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_epoch": 8, 2024-03-16T07:24:53.994 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_epoch": 16, 2024-03-16T07:24:53.994 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_epoch_barrier": 0, 2024-03-16T07:24:53.994 INFO:teuthology.orchestra.run.smithi049.stdout: "blocklisted": false, 2024-03-16T07:24:53.994 INFO:teuthology.orchestra.run.smithi049.stdout: "fs_name": "cephfs" 2024-03-16T07:24:53.994 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-03-16T07:24:54.001 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-03-16T07:24:54.408 INFO:teuthology.orchestra.run.smithi049.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-03-16T07:24:54.421 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-03-16T07:24:54.421 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-03-16T07:24:54.421 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi049.front.sepia.ceph.com 2024-03-16T07:24:54.422 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-03-16T07:24:54.422 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-03-16T07:24:54.422 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-03-16T07:24:54.422 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-03-16T07:24:54.422 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-03-16T07:24:54.422 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-03-16T07:24:54.422 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:24:54.422 DEBUG:teuthology.orchestra.run.smithi049:> ip addr 2024-03-16T07:24:54.437 INFO:teuthology.orchestra.run.smithi049.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-16T07:24:54.438 INFO:teuthology.orchestra.run.smithi049.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-16T07:24:54.438 INFO:teuthology.orchestra.run.smithi049.stdout: inet 127.0.0.1/8 scope host lo 2024-03-16T07:24:54.438 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-03-16T07:24:54.438 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 ::1/128 scope host 2024-03-16T07:24:54.438 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-03-16T07:24:54.438 INFO:teuthology.orchestra.run.smithi049.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-16T07:24:54.438 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:6b:ff:84 brd ff:ff:ff:ff:ff:ff 2024-03-16T07:24:54.438 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp7s0f0 2024-03-16T07:24:54.438 INFO:teuthology.orchestra.run.smithi049.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-16T07:24:54.438 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:6b:ff:85 brd ff:ff:ff:ff:ff:ff 2024-03-16T07:24:54.438 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp7s0f1 2024-03-16T07:24:54.438 INFO:teuthology.orchestra.run.smithi049.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-03-16T07:24:54.438 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:bd:15:66 brd ff:ff:ff:ff:ff:ff 2024-03-16T07:24:54.439 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp1s0f0 2024-03-16T07:24:54.439 INFO:teuthology.orchestra.run.smithi049.stdout: inet 172.21.15.49/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-03-16T07:24:54.439 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft 42413sec preferred_lft 42413sec 2024-03-16T07:24:54.439 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::ec4:7aff:febd:1566/64 scope link noprefixroute 2024-03-16T07:24:54.439 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-03-16T07:24:54.439 INFO:teuthology.orchestra.run.smithi049.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-16T07:24:54.439 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:bd:15:67 brd ff:ff:ff:ff:ff:ff 2024-03-16T07:24:54.439 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp1s0f1 2024-03-16T07:24:54.439 INFO:teuthology.orchestra.run.smithi049.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-03-16T07:24:54.439 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether ee:10:71:d7:68:c4 brd ff:ff:ff:ff:ff:ff 2024-03-16T07:24:54.439 INFO:teuthology.orchestra.run.smithi049.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-03-16T07:24:54.439 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-03-16T07:24:54.439 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::e0e6:55ff:fe4d:1d68/64 scope link 2024-03-16T07:24:54.439 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-03-16T07:24:54.439 INFO:teuthology.orchestra.run.smithi049.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-03-16T07:24:54.439 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether ee:10:71:d7:68:c4 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-16T07:24:54.440 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::ec10:71ff:fed7:68c4/64 scope link 2024-03-16T07:24:54.440 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-03-16T07:24:54.440 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:24:54.440 DEBUG:teuthology.orchestra.run.smithi049:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-03-16T07:24:54.508 INFO:teuthology.orchestra.run.smithi049.stdout:1 2024-03-16T07:24:54.509 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:24:54.509 DEBUG:teuthology.orchestra.run.smithi049:> route 2024-03-16T07:24:54.565 INFO:teuthology.orchestra.run.smithi049.stdout:Kernel IP routing table 2024-03-16T07:24:54.565 INFO:teuthology.orchestra.run.smithi049.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-03-16T07:24:54.565 INFO:teuthology.orchestra.run.smithi049.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-03-16T07:24:54.565 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-03-16T07:24:54.565 INFO:teuthology.orchestra.run.smithi049.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-03-16T07:24:54.565 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-16T07:24:54.565 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-03-16T07:24:54.565 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-03-16T07:24:54.565 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-03-16T07:24:54.566 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-03-16T07:24:54.566 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-03-16T07:24:54.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-16T07:24:54 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-16T07:24:54.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-16T07:24:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-16T07:24:54.717 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:24:54.717 DEBUG:teuthology.orchestra.run.smithi049:> ip netns list 2024-03-16T07:24:54.733 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-03-16T07:24:54.733 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:24:54.734 DEBUG:teuthology.orchestra.run.smithi049:> ip netns list-id 2024-03-16T07:24:54.789 INFO:teuthology.orchestra.run.smithi049.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-03-16T07:24:54.789 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-16T07:24:54.789 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-03-16T07:24:54.789 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-16T07:24:54.789 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 1 2024-03-16T07:24:54.789 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-03-16T07:24:54.878 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-16T07:24:54 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-16T07:24:54.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-16T07:24:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-16T07:24:54.920 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:24:54.920 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-03-16T07:24:54.951 INFO:teuthology.orchestra.run.smithi049.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-16T07:24:54.951 INFO:teuthology.orchestra.run.smithi049.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-16T07:24:54.951 INFO:teuthology.orchestra.run.smithi049.stdout: inet 127.0.0.1/8 scope host lo 2024-03-16T07:24:54.951 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-03-16T07:24:54.951 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 ::1/128 scope host 2024-03-16T07:24:54.952 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-03-16T07:24:54.952 INFO:teuthology.orchestra.run.smithi049.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-03-16T07:24:54.952 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 76:a4:0d:3b:76:85 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-03-16T07:24:54.952 INFO:teuthology.orchestra.run.smithi049.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-03-16T07:24:54.952 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-03-16T07:24:54.952 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::74a4:dff:fe3b:7685/64 scope link 2024-03-16T07:24:54.952 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-03-16T07:24:54.953 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:24:54.953 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-03-16T07:24:55.023 INFO:teuthology.orchestra.run.smithi049.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-16T07:24:55.023 INFO:teuthology.orchestra.run.smithi049.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-16T07:24:55.023 INFO:teuthology.orchestra.run.smithi049.stdout: inet 127.0.0.1/8 scope host lo 2024-03-16T07:24:55.023 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-03-16T07:24:55.024 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 ::1/128 scope host 2024-03-16T07:24:55.024 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-03-16T07:24:55.024 INFO:teuthology.orchestra.run.smithi049.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-03-16T07:24:55.024 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 76:a4:0d:3b:76:85 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-03-16T07:24:55.024 INFO:teuthology.orchestra.run.smithi049.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-03-16T07:24:55.024 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-03-16T07:24:55.024 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::74a4:dff:fe3b:7685/64 scope link 2024-03-16T07:24:55.024 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-03-16T07:24:55.025 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.2/16 2024-03-16T07:24:55.025 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-16T07:24:55.025 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-03-16T07:24:55.025 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.1 2024-03-16T07:24:55.025 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-03-16T07:24:55.025 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-03-16T07:24:55.025 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-03-16T07:24:55.026 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-03-16T07:24:55.026 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-03-16T07:24:55.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-16T07:24:55 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-16T07:24:55.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-16T07:24:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-16T07:24:55.213 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-16T07:24:55.213 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-03-16T07:24:55.213 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link set brx.1 up 2024-03-16T07:24:55.213 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link set dev brx.1 master ceph-brx 2024-03-16T07:24:55.213 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-03-16T07:24:55.262 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-16T07:24:55 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-16T07:24:55.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-16T07:24:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-16T07:24:55.302 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-03-16T07:24:55.303 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-16T07:24:55.303 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-03-16T07:24:55.317 INFO:teuthology.orchestra.run.smithi049.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-03-16T07:24:55.317 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-16T07:24:55.318 DEBUG:teuthology.orchestra.run.smithi049:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-03-16T07:24:55.371 DEBUG:teuthology.orchestra.run.smithi049:> sudo modprobe fuse 2024-03-16T07:24:55.443 DEBUG:teuthology.orchestra.run.smithi049:> cat /proc/self/mounts | awk '{print $2}' 2024-03-16T07:24:55.500 INFO:teuthology.orchestra.run.smithi049.stdout:/proc 2024-03-16T07:24:55.500 INFO:teuthology.orchestra.run.smithi049.stdout:/sys 2024-03-16T07:24:55.500 INFO:teuthology.orchestra.run.smithi049.stdout:/dev 2024-03-16T07:24:55.500 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/security 2024-03-16T07:24:55.500 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/shm 2024-03-16T07:24:55.500 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/pts 2024-03-16T07:24:55.500 INFO:teuthology.orchestra.run.smithi049.stdout:/run 2024-03-16T07:24:55.500 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/cgroup 2024-03-16T07:24:55.500 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/pstore 2024-03-16T07:24:55.500 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/bpf 2024-03-16T07:24:55.500 INFO:teuthology.orchestra.run.smithi049.stdout:/ 2024-03-16T07:24:55.501 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/selinux 2024-03-16T07:24:55.501 INFO:teuthology.orchestra.run.smithi049.stdout:/proc/sys/fs/binfmt_misc 2024-03-16T07:24:55.501 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/mqueue 2024-03-16T07:24:55.501 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/hugepages 2024-03-16T07:24:55.501 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/debug 2024-03-16T07:24:55.501 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/tracing 2024-03-16T07:24:55.501 INFO:teuthology.orchestra.run.smithi049.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-03-16T07:24:55.501 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/fuse/connections 2024-03-16T07:24:55.501 INFO:teuthology.orchestra.run.smithi049.stdout:/run/credentials/systemd-sysctl.service 2024-03-16T07:24:55.501 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/config 2024-03-16T07:24:55.501 INFO:teuthology.orchestra.run.smithi049.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-03-16T07:24:55.501 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/nfs/rpc_pipefs 2024-03-16T07:24:55.501 INFO:teuthology.orchestra.run.smithi049.stdout:/run/user/1000 2024-03-16T07:24:55.501 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph 2024-03-16T07:24:55.501 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-0 2024-03-16T07:24:55.501 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-1 2024-03-16T07:24:55.501 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-2 2024-03-16T07:24:55.502 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns 2024-03-16T07:24:55.502 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-16T07:24:55.502 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-16T07:24:55.502 INFO:teuthology.orchestra.run.smithi049.stdout:/home/ubuntu/cephtest/mnt.0 2024-03-16T07:24:55.502 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-16T07:24:55.502 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-16T07:24:55.502 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:24:55.502 DEBUG:teuthology.orchestra.run.smithi049:> ls /sys/fs/fuse/connections 2024-03-16T07:24:55.557 INFO:teuthology.orchestra.run.smithi049.stdout:41 2024-03-16T07:24:55.557 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [41] 2024-03-16T07:24:55.557 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-03-16T07:24:55.599 DEBUG:teuthology.orchestra.run.smithi049:> sudo modprobe fuse 2024-03-16T07:24:55.630 DEBUG:teuthology.orchestra.run.smithi049:> cat /proc/self/mounts | awk '{print $2}' 2024-03-16T07:24:55.687 INFO:teuthology.orchestra.run.smithi049.stdout:/proc 2024-03-16T07:24:55.687 INFO:teuthology.orchestra.run.smithi049.stdout:/sys 2024-03-16T07:24:55.687 INFO:teuthology.orchestra.run.smithi049.stdout:/dev 2024-03-16T07:24:55.688 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/security 2024-03-16T07:24:55.688 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/shm 2024-03-16T07:24:55.688 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/pts 2024-03-16T07:24:55.688 INFO:teuthology.orchestra.run.smithi049.stdout:/run 2024-03-16T07:24:55.688 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/cgroup 2024-03-16T07:24:55.688 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/pstore 2024-03-16T07:24:55.688 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/bpf 2024-03-16T07:24:55.688 INFO:teuthology.orchestra.run.smithi049.stdout:/ 2024-03-16T07:24:55.688 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/selinux 2024-03-16T07:24:55.688 INFO:teuthology.orchestra.run.smithi049.stdout:/proc/sys/fs/binfmt_misc 2024-03-16T07:24:55.688 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/mqueue 2024-03-16T07:24:55.688 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/hugepages 2024-03-16T07:24:55.688 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/debug 2024-03-16T07:24:55.688 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/tracing 2024-03-16T07:24:55.689 INFO:teuthology.orchestra.run.smithi049.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-03-16T07:24:55.689 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/fuse/connections 2024-03-16T07:24:55.689 INFO:teuthology.orchestra.run.smithi049.stdout:/run/credentials/systemd-sysctl.service 2024-03-16T07:24:55.689 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/config 2024-03-16T07:24:55.689 INFO:teuthology.orchestra.run.smithi049.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-03-16T07:24:55.689 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/nfs/rpc_pipefs 2024-03-16T07:24:55.689 INFO:teuthology.orchestra.run.smithi049.stdout:/run/user/1000 2024-03-16T07:24:55.689 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph 2024-03-16T07:24:55.689 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-0 2024-03-16T07:24:55.689 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-1 2024-03-16T07:24:55.689 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-2 2024-03-16T07:24:55.689 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns 2024-03-16T07:24:55.690 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-16T07:24:55.690 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-16T07:24:55.690 INFO:teuthology.orchestra.run.smithi049.stdout:/home/ubuntu/cephtest/mnt.0 2024-03-16T07:24:55.690 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-16T07:24:55.690 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-16T07:24:55.690 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:24:55.690 DEBUG:teuthology.orchestra.run.smithi049:> ls /sys/fs/fuse/connections 2024-03-16T07:24:55.693 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi049.stderr:2024-03-16T07:24:55.695+0000 7fcc1f837480 -1 init, newargv = 0x55f28eb39000 newargc=15 2024-03-16T07:24:55.694 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi049.stderr:ceph-fuse[41969]: starting ceph client 2024-03-16T07:24:55.697 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi049.stderr:ceph-fuse[41969]: starting fuse 2024-03-16T07:24:55.710 INFO:teuthology.orchestra.run.smithi049.stdout:41 2024-03-16T07:24:55.710 INFO:teuthology.orchestra.run.smithi049.stdout:44 2024-03-16T07:24:55.710 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41, 44] 2024-03-16T07:24:55.710 DEBUG:teuthology.orchestra.run.smithi049:> sudo stdin-killer -- python3 -c ' 2024-03-16T07:24:55.710 DEBUG:teuthology.orchestra.run.smithi049:> import glob 2024-03-16T07:24:55.710 DEBUG:teuthology.orchestra.run.smithi049:> import re 2024-03-16T07:24:55.710 DEBUG:teuthology.orchestra.run.smithi049:> import os 2024-03-16T07:24:55.711 DEBUG:teuthology.orchestra.run.smithi049:> import subprocess 2024-03-16T07:24:55.711 DEBUG:teuthology.orchestra.run.smithi049:> 2024-03-16T07:24:55.711 DEBUG:teuthology.orchestra.run.smithi049:> def _find_admin_socket(client_name): 2024-03-16T07:24:55.711 DEBUG:teuthology.orchestra.run.smithi049:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-03-16T07:24:55.711 DEBUG:teuthology.orchestra.run.smithi049:> files = glob.glob(asok_path) 2024-03-16T07:24:55.711 DEBUG:teuthology.orchestra.run.smithi049:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-03-16T07:24:55.711 DEBUG:teuthology.orchestra.run.smithi049:> 2024-03-16T07:24:55.711 DEBUG:teuthology.orchestra.run.smithi049:> # Given a non-glob path, it better be there 2024-03-16T07:24:55.711 DEBUG:teuthology.orchestra.run.smithi049:> if "*" not in asok_path: 2024-03-16T07:24:55.711 DEBUG:teuthology.orchestra.run.smithi049:> assert(len(files) == 1) 2024-03-16T07:24:55.711 DEBUG:teuthology.orchestra.run.smithi049:> return files[0] 2024-03-16T07:24:55.711 DEBUG:teuthology.orchestra.run.smithi049:> 2024-03-16T07:24:55.711 DEBUG:teuthology.orchestra.run.smithi049:> for f in files: 2024-03-16T07:24:55.711 DEBUG:teuthology.orchestra.run.smithi049:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-03-16T07:24:55.711 DEBUG:teuthology.orchestra.run.smithi049:> if os.path.exists("/proc/{0}".format(pid)): 2024-03-16T07:24:55.711 DEBUG:teuthology.orchestra.run.smithi049:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-03-16T07:24:55.711 DEBUG:teuthology.orchestra.run.smithi049:> contents = proc_f.read() 2024-03-16T07:24:55.712 DEBUG:teuthology.orchestra.run.smithi049:> if mountpoint in contents: 2024-03-16T07:24:55.712 DEBUG:teuthology.orchestra.run.smithi049:> return f 2024-03-16T07:24:55.712 DEBUG:teuthology.orchestra.run.smithi049:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-03-16T07:24:55.712 DEBUG:teuthology.orchestra.run.smithi049:> 2024-03-16T07:24:55.712 DEBUG:teuthology.orchestra.run.smithi049:> print(_find_admin_socket("client.1")) 2024-03-16T07:24:55.712 DEBUG:teuthology.orchestra.run.smithi049:> ' 2024-03-16T07:24:55.841 INFO:teuthology.orchestra.run.smithi049.stdout:/var/run/ceph/ceph-client.1.41969.asok 2024-03-16T07:24:55.844 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-16T07:24:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-16T07:24:55.851 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.41969.asok 2024-03-16T07:24:55.851 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:24:55.852 DEBUG:teuthology.orchestra.run.smithi049:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.41969.asok status 2024-03-16T07:24:55.993 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-03-16T07:24:55.994 INFO:teuthology.orchestra.run.smithi049.stdout: "metadata": { 2024-03-16T07:24:55.994 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph_sha1": "3d78f5ba07bf18880172c07d4d7b4ac00c9d30af", 2024-03-16T07:24:55.994 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph_version": "ceph version 19.0.0-2162-g3d78f5ba (3d78f5ba07bf18880172c07d4d7b4ac00c9d30af) squid (dev)", 2024-03-16T07:24:55.994 INFO:teuthology.orchestra.run.smithi049.stdout: "entity_id": "1", 2024-03-16T07:24:55.994 INFO:teuthology.orchestra.run.smithi049.stdout: "hostname": "smithi049", 2024-03-16T07:24:55.994 INFO:teuthology.orchestra.run.smithi049.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-03-16T07:24:55.994 INFO:teuthology.orchestra.run.smithi049.stdout: "pid": "41969", 2024-03-16T07:24:55.994 INFO:teuthology.orchestra.run.smithi049.stdout: "root": "/" 2024-03-16T07:24:55.994 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:24:55.994 INFO:teuthology.orchestra.run.smithi049.stdout: "dentry_count": 0, 2024-03-16T07:24:55.994 INFO:teuthology.orchestra.run.smithi049.stdout: "dentry_pinned_count": 0, 2024-03-16T07:24:55.994 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 4318, 2024-03-16T07:24:55.994 INFO:teuthology.orchestra.run.smithi049.stdout: "inst": { 2024-03-16T07:24:55.995 INFO:teuthology.orchestra.run.smithi049.stdout: "name": { 2024-03-16T07:24:55.995 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "client", 2024-03-16T07:24:55.995 INFO:teuthology.orchestra.run.smithi049.stdout: "num": 4318 2024-03-16T07:24:55.995 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:24:55.995 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": { 2024-03-16T07:24:55.995 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2024-03-16T07:24:55.995 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "192.168.0.2:0", 2024-03-16T07:24:55.995 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 499944925 2024-03-16T07:24:55.995 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:24:55.995 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:24:55.995 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": { 2024-03-16T07:24:55.995 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2024-03-16T07:24:55.996 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "192.168.0.2:0", 2024-03-16T07:24:55.996 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 499944925 2024-03-16T07:24:55.996 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:24:55.996 INFO:teuthology.orchestra.run.smithi049.stdout: "inst_str": "client.4318 192.168.0.2:0/499944925", 2024-03-16T07:24:55.996 INFO:teuthology.orchestra.run.smithi049.stdout: "addr_str": "192.168.0.2:0/499944925", 2024-03-16T07:24:55.996 INFO:teuthology.orchestra.run.smithi049.stdout: "inode_count": 1, 2024-03-16T07:24:55.996 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_epoch": 8, 2024-03-16T07:24:55.996 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_epoch": 16, 2024-03-16T07:24:55.996 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_epoch_barrier": 0, 2024-03-16T07:24:55.996 INFO:teuthology.orchestra.run.smithi049.stdout: "blocklisted": false, 2024-03-16T07:24:55.996 INFO:teuthology.orchestra.run.smithi049.stdout: "fs_name": "cephfs" 2024-03-16T07:24:55.996 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-03-16T07:24:56.002 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:24:56.002 DEBUG:teuthology.orchestra.run.smithi049:> stat --file-system '--printf=%T 2024-03-16T07:24:56.002 DEBUG:teuthology.orchestra.run.smithi049:> ' -- /home/ubuntu/cephtest/mnt.0 2024-03-16T07:24:56.018 INFO:teuthology.orchestra.run.smithi049.stdout:fuseblk 2024-03-16T07:24:56.018 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-03-16T07:24:56.018 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:24:56.018 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-03-16T07:24:56.089 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:24:56.089 DEBUG:teuthology.orchestra.run.smithi049:> stat --file-system '--printf=%T 2024-03-16T07:24:56.089 DEBUG:teuthology.orchestra.run.smithi049:> ' -- /home/ubuntu/cephtest/mnt.1 2024-03-16T07:24:56.145 INFO:teuthology.orchestra.run.smithi049.stdout:fuseblk 2024-03-16T07:24:56.145 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-03-16T07:24:56.145 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:24:56.145 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-03-16T07:24:56.222 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-03-16T07:24:56.237 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T07:24:56.587 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:24:56.587 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":16,"fsid":"f91af061-9eac-4793-87fa-8d27ae3d242f","created":"2024-03-16T07:24:20.357868+0000","modified":"2024-03-16T07:24:36.750684+0000","last_up_change":"2024-03-16T07:24:27.474980+0000","last_in_change":"2024-03-16T07:24:21.254179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T07:24:28.947521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-16T07:24:32.994128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-16T07:24:34.097577+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3600000143051147,"score_stable":1.3600000143051147,"optimal_score":1,"raw_score_acting":1.3600000143051147,"raw_score_stable":1.3600000143051147,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2df14aac-98dc-4e3c-ae7e-9eb677aa30be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6801","nonce":2744935777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6803","nonce":2744935777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6807","nonce":2744935777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6805","nonce":2744935777}]},"public_addr":"172.21.15.49:6801/2744935777","cluster_addr":"172.21.15.49:6803/2744935777","heartbeat_back_addr":"172.21.15.49:6807/2744935777","heartbeat_front_addr":"172.21.15.49:6805/2744935777","state":["exists","up"]},{"osd":1,"uuid":"80461bd9-59ef-46df-9eea-bad92d960c57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6811","nonce":1655120118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6815","nonce":1655120118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6821","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6823","nonce":1655120118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6817","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6819","nonce":1655120118}]},"public_addr":"172.21.15.49:6811/1655120118","cluster_addr":"172.21.15.49:6815/1655120118","heartbeat_back_addr":"172.21.15.49:6823/1655120118","heartbeat_front_addr":"172.21.15.49:6819/1655120118","state":["exists","up"]},{"osd":2,"uuid":"d6bf40eb-6e42-4ec9-8b3d-0b6c5a6def79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6810","nonce":3815472376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6814","nonce":3815472376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6822","nonce":3815472376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6818","nonce":3815472376}]},"public_addr":"172.21.15.49:6810/3815472376","cluster_addr":"172.21.15.49:6814/3815472376","heartbeat_back_addr":"172.21.15.49:6822/3815472376","heartbeat_front_addr":"172.21.15.49:6818/3815472376","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.641492+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.668598+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.614940+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T07:24:56.600 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-16T07:24:28.947521+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-16T07:24:32.994128+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-16T07:24:34.097577+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3600000143051147, 'score_stable': 1.3600000143051147, 'optimal_score': 1, 'raw_score_acting': 1.3600000143051147, 'raw_score_stable': 1.3600000143051147, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-16T07:24:56.600 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-16T07:24:56.905 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2024-03-16T07:24:56.918 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-16T07:24:57.268 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2024-03-16T07:24:57.287 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-16T07:24:57.594 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2024-03-16T07:24:57.607 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T07:24:57.912 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:24:57.912 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":16,"fsid":"f91af061-9eac-4793-87fa-8d27ae3d242f","created":"2024-03-16T07:24:20.357868+0000","modified":"2024-03-16T07:24:36.750684+0000","last_up_change":"2024-03-16T07:24:27.474980+0000","last_in_change":"2024-03-16T07:24:21.254179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T07:24:28.947521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-16T07:24:32.994128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-16T07:24:34.097577+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3600000143051147,"score_stable":1.3600000143051147,"optimal_score":1,"raw_score_acting":1.3600000143051147,"raw_score_stable":1.3600000143051147,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2df14aac-98dc-4e3c-ae7e-9eb677aa30be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6801","nonce":2744935777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6803","nonce":2744935777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6807","nonce":2744935777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6805","nonce":2744935777}]},"public_addr":"172.21.15.49:6801/2744935777","cluster_addr":"172.21.15.49:6803/2744935777","heartbeat_back_addr":"172.21.15.49:6807/2744935777","heartbeat_front_addr":"172.21.15.49:6805/2744935777","state":["exists","up"]},{"osd":1,"uuid":"80461bd9-59ef-46df-9eea-bad92d960c57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6811","nonce":1655120118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6815","nonce":1655120118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6821","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6823","nonce":1655120118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6817","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6819","nonce":1655120118}]},"public_addr":"172.21.15.49:6811/1655120118","cluster_addr":"172.21.15.49:6815/1655120118","heartbeat_back_addr":"172.21.15.49:6823/1655120118","heartbeat_front_addr":"172.21.15.49:6819/1655120118","state":["exists","up"]},{"osd":2,"uuid":"d6bf40eb-6e42-4ec9-8b3d-0b6c5a6def79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6810","nonce":3815472376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6814","nonce":3815472376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6822","nonce":3815472376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6818","nonce":3815472376}]},"public_addr":"172.21.15.49:6810/3815472376","cluster_addr":"172.21.15.49:6814/3815472376","heartbeat_back_addr":"172.21.15.49:6822/3815472376","heartbeat_front_addr":"172.21.15.49:6818/3815472376","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.641492+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.668598+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.614940+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T07:24:57.925 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-16T07:24:28.947521+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-16T07:24:32.994128+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-16T07:24:34.097577+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3600000143051147, 'score_stable': 1.3600000143051147, 'optimal_score': 1, 'raw_score_acting': 1.3600000143051147, 'raw_score_stable': 1.3600000143051147, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-16T07:24:57.925 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-16T07:24:58.243 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2024-03-16T07:24:58.256 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-16T07:24:58.570 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2024-03-16T07:24:58.583 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-16T07:24:58.906 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2024-03-16T07:24:58.919 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T07:24:59.257 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:24:59.257 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":16,"fsid":"f91af061-9eac-4793-87fa-8d27ae3d242f","created":"2024-03-16T07:24:20.357868+0000","modified":"2024-03-16T07:24:36.750684+0000","last_up_change":"2024-03-16T07:24:27.474980+0000","last_in_change":"2024-03-16T07:24:21.254179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T07:24:28.947521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-16T07:24:32.994128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-16T07:24:34.097577+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3600000143051147,"score_stable":1.3600000143051147,"optimal_score":1,"raw_score_acting":1.3600000143051147,"raw_score_stable":1.3600000143051147,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2df14aac-98dc-4e3c-ae7e-9eb677aa30be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6801","nonce":2744935777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6803","nonce":2744935777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6807","nonce":2744935777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6805","nonce":2744935777}]},"public_addr":"172.21.15.49:6801/2744935777","cluster_addr":"172.21.15.49:6803/2744935777","heartbeat_back_addr":"172.21.15.49:6807/2744935777","heartbeat_front_addr":"172.21.15.49:6805/2744935777","state":["exists","up"]},{"osd":1,"uuid":"80461bd9-59ef-46df-9eea-bad92d960c57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6811","nonce":1655120118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6815","nonce":1655120118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6821","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6823","nonce":1655120118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6817","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6819","nonce":1655120118}]},"public_addr":"172.21.15.49:6811/1655120118","cluster_addr":"172.21.15.49:6815/1655120118","heartbeat_back_addr":"172.21.15.49:6823/1655120118","heartbeat_front_addr":"172.21.15.49:6819/1655120118","state":["exists","up"]},{"osd":2,"uuid":"d6bf40eb-6e42-4ec9-8b3d-0b6c5a6def79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6810","nonce":3815472376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6814","nonce":3815472376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6822","nonce":3815472376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6818","nonce":3815472376}]},"public_addr":"172.21.15.49:6810/3815472376","cluster_addr":"172.21.15.49:6814/3815472376","heartbeat_back_addr":"172.21.15.49:6822/3815472376","heartbeat_front_addr":"172.21.15.49:6818/3815472376","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.641492+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.668598+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.614940+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T07:24:59.270 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-16T07:24:28.947521+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-16T07:24:32.994128+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-16T07:24:34.097577+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3600000143051147, 'score_stable': 1.3600000143051147, 'optimal_score': 1, 'raw_score_acting': 1.3600000143051147, 'raw_score_stable': 1.3600000143051147, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-16T07:24:59.271 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-16T07:24:59.617 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2024-03-16T07:24:59.630 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-16T07:24:59.942 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2024-03-16T07:24:59.956 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-16T07:25:00.262 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2024-03-16T07:25:00.278 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T07:25:00.608 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:25:00.609 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":16,"fsid":"f91af061-9eac-4793-87fa-8d27ae3d242f","created":"2024-03-16T07:24:20.357868+0000","modified":"2024-03-16T07:24:36.750684+0000","last_up_change":"2024-03-16T07:24:27.474980+0000","last_in_change":"2024-03-16T07:24:21.254179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T07:24:28.947521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-16T07:24:32.994128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-16T07:24:34.097577+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3600000143051147,"score_stable":1.3600000143051147,"optimal_score":1,"raw_score_acting":1.3600000143051147,"raw_score_stable":1.3600000143051147,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2df14aac-98dc-4e3c-ae7e-9eb677aa30be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6801","nonce":2744935777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6803","nonce":2744935777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6807","nonce":2744935777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6805","nonce":2744935777}]},"public_addr":"172.21.15.49:6801/2744935777","cluster_addr":"172.21.15.49:6803/2744935777","heartbeat_back_addr":"172.21.15.49:6807/2744935777","heartbeat_front_addr":"172.21.15.49:6805/2744935777","state":["exists","up"]},{"osd":1,"uuid":"80461bd9-59ef-46df-9eea-bad92d960c57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6811","nonce":1655120118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6815","nonce":1655120118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6821","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6823","nonce":1655120118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6817","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6819","nonce":1655120118}]},"public_addr":"172.21.15.49:6811/1655120118","cluster_addr":"172.21.15.49:6815/1655120118","heartbeat_back_addr":"172.21.15.49:6823/1655120118","heartbeat_front_addr":"172.21.15.49:6819/1655120118","state":["exists","up"]},{"osd":2,"uuid":"d6bf40eb-6e42-4ec9-8b3d-0b6c5a6def79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6810","nonce":3815472376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6814","nonce":3815472376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6822","nonce":3815472376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6818","nonce":3815472376}]},"public_addr":"172.21.15.49:6810/3815472376","cluster_addr":"172.21.15.49:6814/3815472376","heartbeat_back_addr":"172.21.15.49:6822/3815472376","heartbeat_front_addr":"172.21.15.49:6818/3815472376","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.641492+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.668598+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.614940+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T07:25:00.622 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-16T07:24:28.947521+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-16T07:24:32.994128+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-16T07:24:34.097577+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3600000143051147, 'score_stable': 1.3600000143051147, 'optimal_score': 1, 'raw_score_acting': 1.3600000143051147, 'raw_score_stable': 1.3600000143051147, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-16T07:25:00.622 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-16T07:25:00.940 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2024-03-16T07:25:00.953 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-16T07:25:01.257 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2024-03-16T07:25:01.275 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-16T07:25:01.705 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2024-03-16T07:25:01.733 INFO:tasks.cephfs_test_runner:Starting test: test_add_ancestor_and_child_directory (tasks.cephfs.test_mirroring.TestMirroring) 2024-03-16T07:25:01.733 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T07:25:02.086 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:25:02.086 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":16,"fsid":"f91af061-9eac-4793-87fa-8d27ae3d242f","created":"2024-03-16T07:24:20.357868+0000","modified":"2024-03-16T07:24:36.750684+0000","last_up_change":"2024-03-16T07:24:27.474980+0000","last_in_change":"2024-03-16T07:24:21.254179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T07:24:28.947521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-16T07:24:32.994128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-16T07:24:34.097577+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3600000143051147,"score_stable":1.3600000143051147,"optimal_score":1,"raw_score_acting":1.3600000143051147,"raw_score_stable":1.3600000143051147,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2df14aac-98dc-4e3c-ae7e-9eb677aa30be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6801","nonce":2744935777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6803","nonce":2744935777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6807","nonce":2744935777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6805","nonce":2744935777}]},"public_addr":"172.21.15.49:6801/2744935777","cluster_addr":"172.21.15.49:6803/2744935777","heartbeat_back_addr":"172.21.15.49:6807/2744935777","heartbeat_front_addr":"172.21.15.49:6805/2744935777","state":["exists","up"]},{"osd":1,"uuid":"80461bd9-59ef-46df-9eea-bad92d960c57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6811","nonce":1655120118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6815","nonce":1655120118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6821","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6823","nonce":1655120118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6817","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6819","nonce":1655120118}]},"public_addr":"172.21.15.49:6811/1655120118","cluster_addr":"172.21.15.49:6815/1655120118","heartbeat_back_addr":"172.21.15.49:6823/1655120118","heartbeat_front_addr":"172.21.15.49:6819/1655120118","state":["exists","up"]},{"osd":2,"uuid":"d6bf40eb-6e42-4ec9-8b3d-0b6c5a6def79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6810","nonce":3815472376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6814","nonce":3815472376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6822","nonce":3815472376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6818","nonce":3815472376}]},"public_addr":"172.21.15.49:6810/3815472376","cluster_addr":"172.21.15.49:6814/3815472376","heartbeat_back_addr":"172.21.15.49:6822/3815472376","heartbeat_front_addr":"172.21.15.49:6818/3815472376","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.641492+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.668598+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.614940+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T07:25:02.103 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-16T07:24:28.947521+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-16T07:24:32.994128+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-16T07:24:34.097577+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3600000143051147, 'score_stable': 1.3600000143051147, 'optimal_score': 1, 'raw_score_acting': 1.3600000143051147, 'raw_score_stable': 1.3600000143051147, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-16T07:25:02.104 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-16T07:25:02.482 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2024-03-16T07:25:02.495 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-16T07:25:02.799 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2024-03-16T07:25:02.812 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-16T07:25:03.122 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2024-03-16T07:25:03.135 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_mirroring.TestMirroring.test_add_ancestor_and_child_directory' 2024-03-16T07:25:03.952 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-03-16T07:25:04.324 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-03-16T07:25:04.325 DEBUG:teuthology.orchestra.run.smithi049:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-03-16T07:25:04.370 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-03-16T07:25:04.370 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-03-16T07:25:04.370 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-16T07:25:04.385 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-03-16T07:25:04.386 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-16T07:25:04.441 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T07:25:04.787 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:25:04.787 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":16,"fsid":"f91af061-9eac-4793-87fa-8d27ae3d242f","created":"2024-03-16T07:24:20.357868+0000","modified":"2024-03-16T07:24:36.750684+0000","last_up_change":"2024-03-16T07:24:27.474980+0000","last_in_change":"2024-03-16T07:24:21.254179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T07:24:28.947521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-16T07:24:32.994128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-16T07:24:34.097577+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3600000143051147,"score_stable":1.3600000143051147,"optimal_score":1,"raw_score_acting":1.3600000143051147,"raw_score_stable":1.3600000143051147,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2df14aac-98dc-4e3c-ae7e-9eb677aa30be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6801","nonce":2744935777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6803","nonce":2744935777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6807","nonce":2744935777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6805","nonce":2744935777}]},"public_addr":"172.21.15.49:6801/2744935777","cluster_addr":"172.21.15.49:6803/2744935777","heartbeat_back_addr":"172.21.15.49:6807/2744935777","heartbeat_front_addr":"172.21.15.49:6805/2744935777","state":["exists","up"]},{"osd":1,"uuid":"80461bd9-59ef-46df-9eea-bad92d960c57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6811","nonce":1655120118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6815","nonce":1655120118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6821","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6823","nonce":1655120118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6817","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6819","nonce":1655120118}]},"public_addr":"172.21.15.49:6811/1655120118","cluster_addr":"172.21.15.49:6815/1655120118","heartbeat_back_addr":"172.21.15.49:6823/1655120118","heartbeat_front_addr":"172.21.15.49:6819/1655120118","state":["exists","up"]},{"osd":2,"uuid":"d6bf40eb-6e42-4ec9-8b3d-0b6c5a6def79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6810","nonce":3815472376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6814","nonce":3815472376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6822","nonce":3815472376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6818","nonce":3815472376}]},"public_addr":"172.21.15.49:6810/3815472376","cluster_addr":"172.21.15.49:6814/3815472376","heartbeat_back_addr":"172.21.15.49:6822/3815472376","heartbeat_front_addr":"172.21.15.49:6818/3815472376","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.641492+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.668598+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.614940+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T07:25:04.800 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-16T07:24:28.947521+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-16T07:24:32.994128+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-16T07:24:34.097577+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3600000143051147, 'score_stable': 1.3600000143051147, 'optimal_score': 1, 'raw_score_acting': 1.3600000143051147, 'raw_score_stable': 1.3600000143051147, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-16T07:25:04.800 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-16T07:25:05.105 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2024-03-16T07:25:05.118 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-16T07:25:05.440 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2024-03-16T07:25:05.453 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-16T07:25:05.757 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2024-03-16T07:25:05.771 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-16T07:25:06.085 INFO:teuthology.orchestra.run.smithi049.stderr:listed 0 entries 2024-03-16T07:25:06.098 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-03-16T07:25:06.099 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-16T07:25:06.115 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T07:25:06.475 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:25:06.476 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":16,"fsid":"f91af061-9eac-4793-87fa-8d27ae3d242f","created":"2024-03-16T07:24:20.357868+0000","modified":"2024-03-16T07:24:36.750684+0000","last_up_change":"2024-03-16T07:24:27.474980+0000","last_in_change":"2024-03-16T07:24:21.254179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T07:24:28.947521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-16T07:24:32.994128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-16T07:24:34.097577+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3600000143051147,"score_stable":1.3600000143051147,"optimal_score":1,"raw_score_acting":1.3600000143051147,"raw_score_stable":1.3600000143051147,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2df14aac-98dc-4e3c-ae7e-9eb677aa30be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6801","nonce":2744935777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6803","nonce":2744935777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6807","nonce":2744935777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6805","nonce":2744935777}]},"public_addr":"172.21.15.49:6801/2744935777","cluster_addr":"172.21.15.49:6803/2744935777","heartbeat_back_addr":"172.21.15.49:6807/2744935777","heartbeat_front_addr":"172.21.15.49:6805/2744935777","state":["exists","up"]},{"osd":1,"uuid":"80461bd9-59ef-46df-9eea-bad92d960c57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6811","nonce":1655120118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6815","nonce":1655120118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6821","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6823","nonce":1655120118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6817","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6819","nonce":1655120118}]},"public_addr":"172.21.15.49:6811/1655120118","cluster_addr":"172.21.15.49:6815/1655120118","heartbeat_back_addr":"172.21.15.49:6823/1655120118","heartbeat_front_addr":"172.21.15.49:6819/1655120118","state":["exists","up"]},{"osd":2,"uuid":"d6bf40eb-6e42-4ec9-8b3d-0b6c5a6def79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6810","nonce":3815472376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6814","nonce":3815472376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6822","nonce":3815472376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6818","nonce":3815472376}]},"public_addr":"172.21.15.49:6810/3815472376","cluster_addr":"172.21.15.49:6814/3815472376","heartbeat_back_addr":"172.21.15.49:6822/3815472376","heartbeat_front_addr":"172.21.15.49:6818/3815472376","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.641492+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.668598+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.614940+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T07:25:06.488 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-16T07:24:28.947521+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-16T07:24:32.994128+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-16T07:24:34.097577+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3600000143051147, 'score_stable': 1.3600000143051147, 'optimal_score': 1, 'raw_score_acting': 1.3600000143051147, 'raw_score_stable': 1.3600000143051147, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-16T07:25:06.489 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-16T07:25:06.819 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2024-03-16T07:25:06.836 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-16T07:25:07.169 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2024-03-16T07:25:07.182 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-16T07:25:07.487 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2024-03-16T07:25:07.501 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-16T07:25:07.826 INFO:teuthology.orchestra.run.smithi049.stderr:listed 0 entries 2024-03-16T07:25:07.844 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi049.front.sepia.ceph.com... 2024-03-16T07:25:07.844 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:25:07.844 DEBUG:teuthology.orchestra.run.smithi049:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-03-16T07:25:07.874 INFO:teuthology.orchestra.run:waiting for 300 2024-03-16T07:25:07.875 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi049.front.sepia.ceph.com 2024-03-16T07:25:07.875 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:25:07.875 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-03-16T07:25:07.936 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-03-16T07:25:07.936 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-16T07:25:07.991 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-03-16T07:25:07.992 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-16T07:25:08.020 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T07:25:08.049 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T07:25:08.393 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:25:08.393 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":16,"fsid":"f91af061-9eac-4793-87fa-8d27ae3d242f","created":"2024-03-16T07:24:20.357868+0000","modified":"2024-03-16T07:24:36.750684+0000","last_up_change":"2024-03-16T07:24:27.474980+0000","last_in_change":"2024-03-16T07:24:21.254179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T07:24:28.947521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-16T07:24:32.994128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-16T07:24:34.097577+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3600000143051147,"score_stable":1.3600000143051147,"optimal_score":1,"raw_score_acting":1.3600000143051147,"raw_score_stable":1.3600000143051147,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2df14aac-98dc-4e3c-ae7e-9eb677aa30be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6801","nonce":2744935777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6803","nonce":2744935777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6807","nonce":2744935777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6805","nonce":2744935777}]},"public_addr":"172.21.15.49:6801/2744935777","cluster_addr":"172.21.15.49:6803/2744935777","heartbeat_back_addr":"172.21.15.49:6807/2744935777","heartbeat_front_addr":"172.21.15.49:6805/2744935777","state":["exists","up"]},{"osd":1,"uuid":"80461bd9-59ef-46df-9eea-bad92d960c57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6811","nonce":1655120118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6815","nonce":1655120118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6821","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6823","nonce":1655120118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6817","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6819","nonce":1655120118}]},"public_addr":"172.21.15.49:6811/1655120118","cluster_addr":"172.21.15.49:6815/1655120118","heartbeat_back_addr":"172.21.15.49:6823/1655120118","heartbeat_front_addr":"172.21.15.49:6819/1655120118","state":["exists","up"]},{"osd":2,"uuid":"d6bf40eb-6e42-4ec9-8b3d-0b6c5a6def79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6810","nonce":3815472376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6814","nonce":3815472376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6822","nonce":3815472376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6818","nonce":3815472376}]},"public_addr":"172.21.15.49:6810/3815472376","cluster_addr":"172.21.15.49:6814/3815472376","heartbeat_back_addr":"172.21.15.49:6822/3815472376","heartbeat_front_addr":"172.21.15.49:6818/3815472376","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.641492+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.668598+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.614940+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T07:25:08.408 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-16T07:24:28.947521+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-16T07:24:32.994128+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-16T07:24:34.097577+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3600000143051147, 'score_stable': 1.3600000143051147, 'optimal_score': 1, 'raw_score_acting': 1.3600000143051147, 'raw_score_stable': 1.3600000143051147, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-16T07:25:08.408 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-16T07:25:08.804 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2024-03-16T07:25:08.817 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-16T07:25:09.124 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2024-03-16T07:25:09.137 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-16T07:25:09.458 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2024-03-16T07:25:09.471 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-16T07:25:09.815 INFO:teuthology.orchestra.run.smithi049.stderr:listed 0 entries 2024-03-16T07:25:09.828 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-03-16T07:25:09.828 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-16T07:25:09.844 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T07:25:10.190 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:25:10.190 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":16,"fsid":"f91af061-9eac-4793-87fa-8d27ae3d242f","created":"2024-03-16T07:24:20.357868+0000","modified":"2024-03-16T07:24:36.750684+0000","last_up_change":"2024-03-16T07:24:27.474980+0000","last_in_change":"2024-03-16T07:24:21.254179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T07:24:28.947521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-16T07:24:32.994128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-16T07:24:34.097577+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3600000143051147,"score_stable":1.3600000143051147,"optimal_score":1,"raw_score_acting":1.3600000143051147,"raw_score_stable":1.3600000143051147,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2df14aac-98dc-4e3c-ae7e-9eb677aa30be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6801","nonce":2744935777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6803","nonce":2744935777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6807","nonce":2744935777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6805","nonce":2744935777}]},"public_addr":"172.21.15.49:6801/2744935777","cluster_addr":"172.21.15.49:6803/2744935777","heartbeat_back_addr":"172.21.15.49:6807/2744935777","heartbeat_front_addr":"172.21.15.49:6805/2744935777","state":["exists","up"]},{"osd":1,"uuid":"80461bd9-59ef-46df-9eea-bad92d960c57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6811","nonce":1655120118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6815","nonce":1655120118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6821","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6823","nonce":1655120118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6817","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6819","nonce":1655120118}]},"public_addr":"172.21.15.49:6811/1655120118","cluster_addr":"172.21.15.49:6815/1655120118","heartbeat_back_addr":"172.21.15.49:6823/1655120118","heartbeat_front_addr":"172.21.15.49:6819/1655120118","state":["exists","up"]},{"osd":2,"uuid":"d6bf40eb-6e42-4ec9-8b3d-0b6c5a6def79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6810","nonce":3815472376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6814","nonce":3815472376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6822","nonce":3815472376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6818","nonce":3815472376}]},"public_addr":"172.21.15.49:6810/3815472376","cluster_addr":"172.21.15.49:6814/3815472376","heartbeat_back_addr":"172.21.15.49:6822/3815472376","heartbeat_front_addr":"172.21.15.49:6818/3815472376","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.641492+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.668598+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.614940+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T07:25:10.203 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-16T07:24:28.947521+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-16T07:24:32.994128+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-16T07:24:34.097577+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3600000143051147, 'score_stable': 1.3600000143051147, 'optimal_score': 1, 'raw_score_acting': 1.3600000143051147, 'raw_score_stable': 1.3600000143051147, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-16T07:25:10.203 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-16T07:25:10.507 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2024-03-16T07:25:10.521 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-16T07:25:10.967 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2024-03-16T07:25:10.984 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-16T07:25:11.289 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2024-03-16T07:25:11.302 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-16T07:25:11.691 INFO:teuthology.orchestra.run.smithi049.stderr:listed 0 entries 2024-03-16T07:25:11.704 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi049.front.sepia.ceph.com... 2024-03-16T07:25:11.704 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:25:11.704 DEBUG:teuthology.orchestra.run.smithi049:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2024-03-16T07:25:11.735 INFO:teuthology.orchestra.run:waiting for 300 2024-03-16T07:25:11.735 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi049.front.sepia.ceph.com 2024-03-16T07:25:11.735 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:25:11.735 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-03-16T07:25:11.790 INFO:tasks.cephfs.cephfs_test_case:[, ] 2024-03-16T07:25:11.790 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T07:25:12.177 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:25:12.177 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4137,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6827/874710529","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":874710529},{"type":"v1","addr":"172.21.15.49:6827","nonce":874710529}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4144,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6829/2575941527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":2575941527},{"type":"v1","addr":"172.21.15.49:6829","nonce":2575941527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4145,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6832/3158244217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":3158244217},{"type":"v1","addr":"172.21.15.49:6832","nonce":3158244217}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4146,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6833/3138521926","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6831","nonce":3138521926},{"type":"v1","addr":"172.21.15.49:6833","nonce":3138521926}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-16T07:24:35.123262+0000","modified":"2024-03-16T07:24:38.246781+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4149},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4149":{"gid":4149,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6835/2474486057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":2474486057},{"type":"v1","addr":"172.21.15.49:6835","nonce":2474486057}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4149,"qdb_cluster":[4149]},"id":1}]} 2024-03-16T07:25:12.177 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 8 2024-03-16T07:25:12.191 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T07:25:12.561 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:25:12.561 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":16,"fsid":"f91af061-9eac-4793-87fa-8d27ae3d242f","created":"2024-03-16T07:24:20.357868+0000","modified":"2024-03-16T07:24:36.750684+0000","last_up_change":"2024-03-16T07:24:27.474980+0000","last_in_change":"2024-03-16T07:24:21.254179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T07:24:28.947521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-16T07:24:32.994128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-16T07:24:34.097577+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3600000143051147,"score_stable":1.3600000143051147,"optimal_score":1,"raw_score_acting":1.3600000143051147,"raw_score_stable":1.3600000143051147,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2df14aac-98dc-4e3c-ae7e-9eb677aa30be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6801","nonce":2744935777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6803","nonce":2744935777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6807","nonce":2744935777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6805","nonce":2744935777}]},"public_addr":"172.21.15.49:6801/2744935777","cluster_addr":"172.21.15.49:6803/2744935777","heartbeat_back_addr":"172.21.15.49:6807/2744935777","heartbeat_front_addr":"172.21.15.49:6805/2744935777","state":["exists","up"]},{"osd":1,"uuid":"80461bd9-59ef-46df-9eea-bad92d960c57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6811","nonce":1655120118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6815","nonce":1655120118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6821","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6823","nonce":1655120118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6817","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6819","nonce":1655120118}]},"public_addr":"172.21.15.49:6811/1655120118","cluster_addr":"172.21.15.49:6815/1655120118","heartbeat_back_addr":"172.21.15.49:6823/1655120118","heartbeat_front_addr":"172.21.15.49:6819/1655120118","state":["exists","up"]},{"osd":2,"uuid":"d6bf40eb-6e42-4ec9-8b3d-0b6c5a6def79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6810","nonce":3815472376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6814","nonce":3815472376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6822","nonce":3815472376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6818","nonce":3815472376}]},"public_addr":"172.21.15.49:6810/3815472376","cluster_addr":"172.21.15.49:6814/3815472376","heartbeat_back_addr":"172.21.15.49:6822/3815472376","heartbeat_front_addr":"172.21.15.49:6818/3815472376","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.641492+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.668598+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.614940+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T07:25:12.574 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-16T07:24:28.947521+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-16T07:24:32.994128+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-16T07:24:34.097577+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3600000143051147, 'score_stable': 1.3600000143051147, 'optimal_score': 1, 'raw_score_acting': 1.3600000143051147, 'raw_score_stable': 1.3600000143051147, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-16T07:25:12.575 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-16T07:25:12.880 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2024-03-16T07:25:12.893 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-16T07:25:13.397 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2024-03-16T07:25:13.410 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-16T07:25:13.753 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2024-03-16T07:25:13.767 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T07:25:14.111 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:25:14.111 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4137,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6827/874710529","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":874710529},{"type":"v1","addr":"172.21.15.49:6827","nonce":874710529}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4144,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6829/2575941527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":2575941527},{"type":"v1","addr":"172.21.15.49:6829","nonce":2575941527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4145,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6832/3158244217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":3158244217},{"type":"v1","addr":"172.21.15.49:6832","nonce":3158244217}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4146,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6833/3138521926","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6831","nonce":3138521926},{"type":"v1","addr":"172.21.15.49:6833","nonce":3138521926}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-16T07:24:35.123262+0000","modified":"2024-03-16T07:24:38.246781+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4149},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4149":{"gid":4149,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6835/2474486057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":2474486057},{"type":"v1","addr":"172.21.15.49:6835","nonce":2474486057}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4149,"qdb_cluster":[4149]},"id":1}]} 2024-03-16T07:25:14.112 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 8 2024-03-16T07:25:14.124 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T07:25:14.446 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:25:14.446 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":16,"fsid":"f91af061-9eac-4793-87fa-8d27ae3d242f","created":"2024-03-16T07:24:20.357868+0000","modified":"2024-03-16T07:24:36.750684+0000","last_up_change":"2024-03-16T07:24:27.474980+0000","last_in_change":"2024-03-16T07:24:21.254179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T07:24:28.947521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-16T07:24:32.994128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-16T07:24:34.097577+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3600000143051147,"score_stable":1.3600000143051147,"optimal_score":1,"raw_score_acting":1.3600000143051147,"raw_score_stable":1.3600000143051147,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2df14aac-98dc-4e3c-ae7e-9eb677aa30be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6801","nonce":2744935777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6803","nonce":2744935777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6807","nonce":2744935777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6805","nonce":2744935777}]},"public_addr":"172.21.15.49:6801/2744935777","cluster_addr":"172.21.15.49:6803/2744935777","heartbeat_back_addr":"172.21.15.49:6807/2744935777","heartbeat_front_addr":"172.21.15.49:6805/2744935777","state":["exists","up"]},{"osd":1,"uuid":"80461bd9-59ef-46df-9eea-bad92d960c57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6811","nonce":1655120118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6815","nonce":1655120118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6821","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6823","nonce":1655120118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6817","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6819","nonce":1655120118}]},"public_addr":"172.21.15.49:6811/1655120118","cluster_addr":"172.21.15.49:6815/1655120118","heartbeat_back_addr":"172.21.15.49:6823/1655120118","heartbeat_front_addr":"172.21.15.49:6819/1655120118","state":["exists","up"]},{"osd":2,"uuid":"d6bf40eb-6e42-4ec9-8b3d-0b6c5a6def79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6810","nonce":3815472376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6814","nonce":3815472376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6822","nonce":3815472376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6818","nonce":3815472376}]},"public_addr":"172.21.15.49:6810/3815472376","cluster_addr":"172.21.15.49:6814/3815472376","heartbeat_back_addr":"172.21.15.49:6822/3815472376","heartbeat_front_addr":"172.21.15.49:6818/3815472376","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.641492+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.668598+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.614940+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T07:25:14.458 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-03-16T07:25:14.459 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T07:25:14.805 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:25:14.806 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4137,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6827/874710529","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":874710529},{"type":"v1","addr":"172.21.15.49:6827","nonce":874710529}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4144,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6829/2575941527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":2575941527},{"type":"v1","addr":"172.21.15.49:6829","nonce":2575941527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4145,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6832/3158244217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":3158244217},{"type":"v1","addr":"172.21.15.49:6832","nonce":3158244217}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4146,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6833/3138521926","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6831","nonce":3138521926},{"type":"v1","addr":"172.21.15.49:6833","nonce":3138521926}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-16T07:24:35.123262+0000","modified":"2024-03-16T07:24:38.246781+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4149},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4149":{"gid":4149,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6835/2474486057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":2474486057},{"type":"v1","addr":"172.21.15.49:6835","nonce":2474486057}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4149,"qdb_cluster":[4149]},"id":1}]} 2024-03-16T07:25:14.806 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 8 2024-03-16T07:25:14.818 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T07:25:15.159 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:25:15.159 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4137,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6827/874710529","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":874710529},{"type":"v1","addr":"172.21.15.49:6827","nonce":874710529}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4144,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6829/2575941527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":2575941527},{"type":"v1","addr":"172.21.15.49:6829","nonce":2575941527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4145,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6832/3158244217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":3158244217},{"type":"v1","addr":"172.21.15.49:6832","nonce":3158244217}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4146,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6833/3138521926","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6831","nonce":3138521926},{"type":"v1","addr":"172.21.15.49:6833","nonce":3138521926}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-16T07:24:35.123262+0000","modified":"2024-03-16T07:24:38.246781+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4149},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4149":{"gid":4149,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6835/2474486057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":2474486057},{"type":"v1","addr":"172.21.15.49:6835","nonce":2474486057}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4149,"qdb_cluster":[4149]},"id":1}]} 2024-03-16T07:25:15.159 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 8 2024-03-16T07:25:15.172 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T07:25:15.609 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:25:15.609 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":16,"fsid":"f91af061-9eac-4793-87fa-8d27ae3d242f","created":"2024-03-16T07:24:20.357868+0000","modified":"2024-03-16T07:24:36.750684+0000","last_up_change":"2024-03-16T07:24:27.474980+0000","last_in_change":"2024-03-16T07:24:21.254179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T07:24:28.947521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-16T07:24:32.994128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-16T07:24:34.097577+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3600000143051147,"score_stable":1.3600000143051147,"optimal_score":1,"raw_score_acting":1.3600000143051147,"raw_score_stable":1.3600000143051147,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2df14aac-98dc-4e3c-ae7e-9eb677aa30be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6801","nonce":2744935777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6803","nonce":2744935777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6807","nonce":2744935777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6805","nonce":2744935777}]},"public_addr":"172.21.15.49:6801/2744935777","cluster_addr":"172.21.15.49:6803/2744935777","heartbeat_back_addr":"172.21.15.49:6807/2744935777","heartbeat_front_addr":"172.21.15.49:6805/2744935777","state":["exists","up"]},{"osd":1,"uuid":"80461bd9-59ef-46df-9eea-bad92d960c57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6811","nonce":1655120118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6815","nonce":1655120118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6821","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6823","nonce":1655120118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6817","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6819","nonce":1655120118}]},"public_addr":"172.21.15.49:6811/1655120118","cluster_addr":"172.21.15.49:6815/1655120118","heartbeat_back_addr":"172.21.15.49:6823/1655120118","heartbeat_front_addr":"172.21.15.49:6819/1655120118","state":["exists","up"]},{"osd":2,"uuid":"d6bf40eb-6e42-4ec9-8b3d-0b6c5a6def79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6810","nonce":3815472376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6814","nonce":3815472376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6822","nonce":3815472376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6818","nonce":3815472376}]},"public_addr":"172.21.15.49:6810/3815472376","cluster_addr":"172.21.15.49:6814/3815472376","heartbeat_back_addr":"172.21.15.49:6822/3815472376","heartbeat_front_addr":"172.21.15.49:6818/3815472376","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.641492+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.668598+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.614940+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T07:25:15.623 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-03-16T07:25:16.030 INFO:tasks.ceph.mon.a.smithi049.stderr:2024-03-16T07:25:16.030+0000 7feb67011640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-03-16T07:25:16.030 INFO:teuthology.orchestra.run.smithi049.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-03-16T07:25:16.032 INFO:tasks.ceph.mds.d.smithi049.stderr: -206> 2024-03-16T07:24:39.726+0000 7f75aac95640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-03-16T07:25:16.046 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-03-16T07:25:16.060 INFO:tasks.ceph.mds.d.smithi049.stdout:starting mds.d at 2024-03-16T07:25:16.323 INFO:tasks.cephfs_mirror.client.mirror.smithi049.stderr:==00:00:00:25.466 40927== 2024-03-16T07:25:16.323 INFO:tasks.cephfs_mirror.client.mirror.smithi049.stderr:==00:00:00:25.466 40927== Exit program on first error (--exit-on-first-error=yes) 2024-03-16T07:25:16.436 INFO:tasks.cephfs_mirror.client.mirror.smithi049.stderr:daemon-helper: command failed with exit status 42 2024-03-16T07:25:17.046 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-03-16T07:25:18.034 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_metadata' removed 2024-03-16T07:25:18.054 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-03-16T07:25:19.037 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_data' removed 2024-03-16T07:25:19.060 INFO:tasks.ceph.mds.a:Restarting daemon 2024-03-16T07:25:19.061 INFO:tasks.ceph.mds.a:Stopping old one... 2024-03-16T07:25:19.061 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-03-16T07:25:19.061 INFO:teuthology.orchestra.run:waiting for 300 2024-03-16T07:25:19.061 INFO:tasks.ceph.mds.b:Restarting daemon 2024-03-16T07:25:19.061 INFO:tasks.ceph.mds.b:Stopping old one... 2024-03-16T07:25:19.061 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-03-16T07:25:19.061 INFO:teuthology.orchestra.run:waiting for 300 2024-03-16T07:25:19.062 INFO:tasks.ceph.mds.c:Restarting daemon 2024-03-16T07:25:19.062 INFO:tasks.ceph.mds.c:Stopping old one... 2024-03-16T07:25:19.062 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-03-16T07:25:19.062 INFO:teuthology.orchestra.run:waiting for 300 2024-03-16T07:25:19.062 INFO:tasks.ceph.mds.d:Restarting daemon 2024-03-16T07:25:19.062 INFO:tasks.ceph.mds.d:Stopping old one... 2024-03-16T07:25:19.062 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-03-16T07:25:19.062 INFO:teuthology.orchestra.run:waiting for 300 2024-03-16T07:25:19.063 INFO:tasks.ceph.mds.e:Restarting daemon 2024-03-16T07:25:19.063 INFO:tasks.ceph.mds.e:Stopping old one... 2024-03-16T07:25:19.063 DEBUG:tasks.ceph.mds.e:waiting for process to exit 2024-03-16T07:25:19.063 INFO:teuthology.orchestra.run:waiting for 300 2024-03-16T07:25:19.077 INFO:tasks.ceph.mds.a:Stopped 2024-03-16T07:25:19.077 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-03-16T07:25:19.079 INFO:tasks.ceph.mds.b:Stopped 2024-03-16T07:25:19.079 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-03-16T07:25:19.080 INFO:tasks.ceph.mds.c:Stopped 2024-03-16T07:25:19.080 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-03-16T07:25:19.081 INFO:tasks.ceph.mds.a:Started 2024-03-16T07:25:19.081 DEBUG:teuthology.parallel:result is None 2024-03-16T07:25:19.082 INFO:tasks.ceph.mds.d:Stopped 2024-03-16T07:25:19.082 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-03-16T07:25:19.083 INFO:tasks.ceph.mds.e:Stopped 2024-03-16T07:25:19.083 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i e 2024-03-16T07:25:19.125 INFO:tasks.ceph.mds.b:Started 2024-03-16T07:25:19.126 INFO:tasks.ceph.mds.c:Started 2024-03-16T07:25:19.126 DEBUG:teuthology.parallel:result is None 2024-03-16T07:25:19.126 DEBUG:teuthology.parallel:result is None 2024-03-16T07:25:19.127 INFO:tasks.ceph.mds.d:Started 2024-03-16T07:25:19.127 INFO:tasks.ceph.mds.e:Started 2024-03-16T07:25:19.127 DEBUG:teuthology.parallel:result is None 2024-03-16T07:25:19.127 DEBUG:teuthology.parallel:result is None 2024-03-16T07:25:19.128 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-03-16T07:25:19.183 INFO:tasks.ceph.mds.a.smithi049.stdout:starting mds.a at 2024-03-16T07:25:19.220 INFO:tasks.ceph.mds.b.smithi049.stdout:starting mds.b at 2024-03-16T07:25:19.221 INFO:tasks.ceph.mds.d.smithi049.stdout:starting mds.d at 2024-03-16T07:25:19.228 INFO:tasks.ceph.mds.c.smithi049.stdout:starting mds.c at 2024-03-16T07:25:19.242 INFO:tasks.ceph.mds.e.smithi049.stdout:starting mds.e at 2024-03-16T07:25:20.042 INFO:teuthology.orchestra.run.smithi049.stderr: removed all blocklist entries 2024-03-16T07:25:20.057 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-03-16T07:25:20.429 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:25:20.429 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-03-16T07:25:20.429 INFO:teuthology.orchestra.run.smithi049.stdout: "auth_dump": [ 2024-03-16T07:25:20.429 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:25:20.430 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.a", 2024-03-16T07:25:20.430 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAZSfVlKDkWLhAAVo2ZJMZSwTGLhocUPcHaUw==", 2024-03-16T07:25:20.430 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-03-16T07:25:20.430 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2024-03-16T07:25:20.430 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2024-03-16T07:25:20.430 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2024-03-16T07:25:20.430 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-03-16T07:25:20.430 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:25:20.430 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:25:20.430 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:25:20.430 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.b", 2024-03-16T07:25:20.430 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAZSfVl53IaNhAATOLh8Lzad03tyKQph1oowQ==", 2024-03-16T07:25:20.430 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-03-16T07:25:20.431 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2024-03-16T07:25:20.431 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2024-03-16T07:25:20.431 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2024-03-16T07:25:20.431 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-03-16T07:25:20.431 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:25:20.431 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:25:20.431 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:25:20.431 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.c", 2024-03-16T07:25:20.431 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAaSfVlI3p/AhAAZEetRkGlMLMEI7hMN7pS5w==", 2024-03-16T07:25:20.431 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-03-16T07:25:20.431 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2024-03-16T07:25:20.431 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2024-03-16T07:25:20.431 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2024-03-16T07:25:20.432 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-03-16T07:25:20.432 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:25:20.432 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:25:20.432 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:25:20.432 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.d", 2024-03-16T07:25:20.432 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAaSfVl3ueIChAA640lcZj8yUgH9jq7r7B+bA==", 2024-03-16T07:25:20.432 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-03-16T07:25:20.432 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2024-03-16T07:25:20.432 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2024-03-16T07:25:20.432 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2024-03-16T07:25:20.432 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-03-16T07:25:20.432 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:25:20.432 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:25:20.432 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:25:20.433 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.e", 2024-03-16T07:25:20.433 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAaSfVl8OySEhAAyF3ScxdSuQ0jhZhRbJ2gEg==", 2024-03-16T07:25:20.433 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-03-16T07:25:20.433 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2024-03-16T07:25:20.433 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2024-03-16T07:25:20.433 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2024-03-16T07:25:20.433 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-03-16T07:25:20.433 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:25:20.433 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:25:20.433 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:25:20.433 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.0", 2024-03-16T07:25:20.433 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAbSfVlNhmeKBAAVnxZbeNKU/kVViG2vb2+tQ==", 2024-03-16T07:25:20.433 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-03-16T07:25:20.433 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2024-03-16T07:25:20.434 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2024-03-16T07:25:20.434 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-03-16T07:25:20.434 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:25:20.434 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:25:20.434 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:25:20.434 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.1", 2024-03-16T07:25:20.434 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAdSfVlNNNkNhAAKhYH9tWxFT8HH6ZLMnaK7A==", 2024-03-16T07:25:20.434 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-03-16T07:25:20.434 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2024-03-16T07:25:20.434 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2024-03-16T07:25:20.434 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-03-16T07:25:20.434 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:25:20.434 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:25:20.434 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:25:20.434 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.2", 2024-03-16T07:25:20.435 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAgSfVlXJh1BxAAEOX+brDLOLTkp0thYQgMrw==", 2024-03-16T07:25:20.435 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-03-16T07:25:20.435 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2024-03-16T07:25:20.435 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2024-03-16T07:25:20.435 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-03-16T07:25:20.435 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:25:20.435 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:25:20.435 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:25:20.435 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.0", 2024-03-16T07:25:20.435 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAaSfVlmBmvGRAAaxdhkajaioVlq23dyv/g4g==", 2024-03-16T07:25:20.435 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-03-16T07:25:20.435 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2024-03-16T07:25:20.435 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow r", 2024-03-16T07:25:20.435 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow rw", 2024-03-16T07:25:20.435 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rwx" 2024-03-16T07:25:20.436 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:25:20.436 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:25:20.436 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:25:20.436 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.1", 2024-03-16T07:25:20.436 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAaSfVlCp2DHRAAdVsc+jh/QA74EBwffEqP5g==", 2024-03-16T07:25:20.436 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-03-16T07:25:20.436 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2024-03-16T07:25:20.436 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow r", 2024-03-16T07:25:20.436 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow rw", 2024-03-16T07:25:20.436 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rwx" 2024-03-16T07:25:20.436 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:25:20.436 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:25:20.436 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:25:20.436 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.admin", 2024-03-16T07:25:20.436 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAZSfVl0iRiFxAArXglVmR8MpJZNrXNv5tS7A==", 2024-03-16T07:25:20.436 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-03-16T07:25:20.437 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow *", 2024-03-16T07:25:20.437 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2024-03-16T07:25:20.437 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2024-03-16T07:25:20.437 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-03-16T07:25:20.437 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:25:20.437 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:25:20.437 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:25:20.437 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.bootstrap-mds", 2024-03-16T07:25:20.437 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAkSfVluxVbFRAAokl/mFtTs3qiY6PudKqVKw==", 2024-03-16T07:25:20.437 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-03-16T07:25:20.437 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile bootstrap-mds" 2024-03-16T07:25:20.437 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:25:20.437 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:25:20.437 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:25:20.437 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.bootstrap-mgr", 2024-03-16T07:25:20.437 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAkSfVlLB5bFRAAFkt4wCBZ7TjEnz6XWDTq8Q==", 2024-03-16T07:25:20.438 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-03-16T07:25:20.438 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile bootstrap-mgr" 2024-03-16T07:25:20.438 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:25:20.438 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:25:20.438 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:25:20.438 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.bootstrap-osd", 2024-03-16T07:25:20.438 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAkSfVlpyVbFRAA2jel/z2lDpY1CvMXrOEPNQ==", 2024-03-16T07:25:20.438 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-03-16T07:25:20.438 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile bootstrap-osd" 2024-03-16T07:25:20.438 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:25:20.438 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:25:20.438 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:25:20.438 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.bootstrap-rbd", 2024-03-16T07:25:20.438 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAkSfVlSS1bFRAA+6rlYifu6dRcT+UWqeB+ug==", 2024-03-16T07:25:20.438 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-03-16T07:25:20.438 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile bootstrap-rbd" 2024-03-16T07:25:20.439 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:25:20.439 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:25:20.439 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:25:20.439 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-03-16T07:25:20.439 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAkSfVlADVbFRAAKGGHo74cIVWIuAKDNSNR3Q==", 2024-03-16T07:25:20.439 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-03-16T07:25:20.439 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-03-16T07:25:20.439 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:25:20.439 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:25:20.439 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:25:20.439 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.bootstrap-rgw", 2024-03-16T07:25:20.439 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAkSfVlgjxbFRAAPD2ALw0Eglhmk/tf8exDMg==", 2024-03-16T07:25:20.439 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-03-16T07:25:20.439 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile bootstrap-rgw" 2024-03-16T07:25:20.439 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:25:20.439 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:25:20.440 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:25:20.440 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.mirror", 2024-03-16T07:25:20.440 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAaSfVldspUIRAAa1kAy23ZdMBfbhy+7HMVqA==", 2024-03-16T07:25:20.440 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-03-16T07:25:20.440 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow r", 2024-03-16T07:25:20.440 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow r", 2024-03-16T07:25:20.440 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "profile cephfs-mirror", 2024-03-16T07:25:20.440 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rw tag cephfs metadata=*, allow r tag cephfs data=*" 2024-03-16T07:25:20.440 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:25:20.440 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:25:20.440 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:25:20.440 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.mirror_remote", 2024-03-16T07:25:20.440 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAaSfVlaygzJRAAJVP9XACdC2Wikb4ZtKci9g==", 2024-03-16T07:25:20.441 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-03-16T07:25:20.441 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow rwps", 2024-03-16T07:25:20.441 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow r", 2024-03-16T07:25:20.441 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow r", 2024-03-16T07:25:20.441 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rw tag cephfs *=*" 2024-03-16T07:25:20.441 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:25:20.441 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:25:20.441 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:25:20.441 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mgr.x", 2024-03-16T07:25:20.441 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAZSfVlX9BEKhAAftDfT7+IPsQFhrTPl2h0SQ==", 2024-03-16T07:25:20.441 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-03-16T07:25:20.441 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow *", 2024-03-16T07:25:20.441 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile mgr", 2024-03-16T07:25:20.441 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-03-16T07:25:20.441 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:25:20.441 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:25:20.442 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2024-03-16T07:25:20.442 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-03-16T07:25:20.443 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-03-16T07:25:20.828 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-03-16T07:25:21.221 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-03-16T07:25:21.603 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-03-16T07:25:21.988 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-03-16T07:25:22.373 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-03-16T07:25:22.755 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T07:25:23.057 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:25:23.057 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":24,"fsid":"f91af061-9eac-4793-87fa-8d27ae3d242f","created":"2024-03-16T07:24:20.357868+0000","modified":"2024-03-16T07:25:20.050591+0000","last_up_change":"2024-03-16T07:24:27.474980+0000","last_in_change":"2024-03-16T07:24:21.254179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T07:24:28.947521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2df14aac-98dc-4e3c-ae7e-9eb677aa30be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6801","nonce":2744935777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6803","nonce":2744935777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6807","nonce":2744935777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6805","nonce":2744935777}]},"public_addr":"172.21.15.49:6801/2744935777","cluster_addr":"172.21.15.49:6803/2744935777","heartbeat_back_addr":"172.21.15.49:6807/2744935777","heartbeat_front_addr":"172.21.15.49:6805/2744935777","state":["exists","up"]},{"osd":1,"uuid":"80461bd9-59ef-46df-9eea-bad92d960c57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6811","nonce":1655120118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6815","nonce":1655120118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6821","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6823","nonce":1655120118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6817","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6819","nonce":1655120118}]},"public_addr":"172.21.15.49:6811/1655120118","cluster_addr":"172.21.15.49:6815/1655120118","heartbeat_back_addr":"172.21.15.49:6823/1655120118","heartbeat_front_addr":"172.21.15.49:6819/1655120118","state":["exists","up"]},{"osd":2,"uuid":"d6bf40eb-6e42-4ec9-8b3d-0b6c5a6def79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6810","nonce":3815472376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6814","nonce":3815472376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6822","nonce":3815472376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6818","nonce":3815472376}]},"public_addr":"172.21.15.49:6810/3815472376","cluster_addr":"172.21.15.49:6814/3815472376","heartbeat_back_addr":"172.21.15.49:6822/3815472376","heartbeat_front_addr":"172.21.15.49:6818/3815472376","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.641492+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.668598+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.614940+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T07:25:23.070 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-16T07:24:28.947521+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-16T07:25:23.070 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-16T07:25:23.372 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2024-03-16T07:25:23.385 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-03-16T07:25:23.687 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:25:23.687 INFO:teuthology.orchestra.run.smithi049.stdout:[ 2024-03-16T07:25:23.687 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:25:23.687 INFO:teuthology.orchestra.run.smithi049.stdout: "poolnum": 1, 2024-03-16T07:25:23.687 INFO:teuthology.orchestra.run.smithi049.stdout: "poolname": ".mgr" 2024-03-16T07:25:23.687 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:25:23.687 INFO:teuthology.orchestra.run.smithi049.stdout:] 2024-03-16T07:25:23.699 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-03-16T07:25:23.699 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-03-16T07:25:24.744 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_metadata' created 2024-03-16T07:25:24.765 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-03-16T07:25:25.749 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_data' created 2024-03-16T07:25:25.780 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-03-16T07:25:26.748 INFO:teuthology.orchestra.run.smithi049.stderr:new fs with metadata pool 4 and data pool 5 2024-03-16T07:25:26.794 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T07:25:27.102 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:25:27.102 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":27,"fsid":"f91af061-9eac-4793-87fa-8d27ae3d242f","created":"2024-03-16T07:24:20.357868+0000","modified":"2024-03-16T07:25:26.124394+0000","last_up_change":"2024-03-16T07:24:27.474980+0000","last_in_change":"2024-03-16T07:24:21.254179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T07:24:28.947521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-03-16T07:25:24.035315+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-03-16T07:25:25.110355+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.0800000429153442,"score_stable":1.0800000429153442,"optimal_score":1,"raw_score_acting":1.0800000429153442,"raw_score_stable":1.0800000429153442,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2df14aac-98dc-4e3c-ae7e-9eb677aa30be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6801","nonce":2744935777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6803","nonce":2744935777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6807","nonce":2744935777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6805","nonce":2744935777}]},"public_addr":"172.21.15.49:6801/2744935777","cluster_addr":"172.21.15.49:6803/2744935777","heartbeat_back_addr":"172.21.15.49:6807/2744935777","heartbeat_front_addr":"172.21.15.49:6805/2744935777","state":["exists","up"]},{"osd":1,"uuid":"80461bd9-59ef-46df-9eea-bad92d960c57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6811","nonce":1655120118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6815","nonce":1655120118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6821","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6823","nonce":1655120118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6817","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6819","nonce":1655120118}]},"public_addr":"172.21.15.49:6811/1655120118","cluster_addr":"172.21.15.49:6815/1655120118","heartbeat_back_addr":"172.21.15.49:6823/1655120118","heartbeat_front_addr":"172.21.15.49:6819/1655120118","state":["exists","up"]},{"osd":2,"uuid":"d6bf40eb-6e42-4ec9-8b3d-0b6c5a6def79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6810","nonce":3815472376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6814","nonce":3815472376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6822","nonce":3815472376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6818","nonce":3815472376}]},"public_addr":"172.21.15.49:6810/3815472376","cluster_addr":"172.21.15.49:6814/3815472376","heartbeat_back_addr":"172.21.15.49:6822/3815472376","heartbeat_front_addr":"172.21.15.49:6818/3815472376","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.641492+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.668598+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.614940+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T07:25:27.114 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T07:25:27.415 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:25:27.415 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":27,"fsid":"f91af061-9eac-4793-87fa-8d27ae3d242f","created":"2024-03-16T07:24:20.357868+0000","modified":"2024-03-16T07:25:26.124394+0000","last_up_change":"2024-03-16T07:24:27.474980+0000","last_in_change":"2024-03-16T07:24:21.254179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T07:24:28.947521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-03-16T07:25:24.035315+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-03-16T07:25:25.110355+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.0800000429153442,"score_stable":1.0800000429153442,"optimal_score":1,"raw_score_acting":1.0800000429153442,"raw_score_stable":1.0800000429153442,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2df14aac-98dc-4e3c-ae7e-9eb677aa30be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6801","nonce":2744935777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6803","nonce":2744935777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6807","nonce":2744935777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6805","nonce":2744935777}]},"public_addr":"172.21.15.49:6801/2744935777","cluster_addr":"172.21.15.49:6803/2744935777","heartbeat_back_addr":"172.21.15.49:6807/2744935777","heartbeat_front_addr":"172.21.15.49:6805/2744935777","state":["exists","up"]},{"osd":1,"uuid":"80461bd9-59ef-46df-9eea-bad92d960c57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6811","nonce":1655120118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6815","nonce":1655120118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6821","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6823","nonce":1655120118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6817","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6819","nonce":1655120118}]},"public_addr":"172.21.15.49:6811/1655120118","cluster_addr":"172.21.15.49:6815/1655120118","heartbeat_back_addr":"172.21.15.49:6823/1655120118","heartbeat_front_addr":"172.21.15.49:6819/1655120118","state":["exists","up"]},{"osd":2,"uuid":"d6bf40eb-6e42-4ec9-8b3d-0b6c5a6def79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6810","nonce":3815472376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6814","nonce":3815472376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6822","nonce":3815472376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6818","nonce":3815472376}]},"public_addr":"172.21.15.49:6810/3815472376","cluster_addr":"172.21.15.49:6814/3815472376","heartbeat_back_addr":"172.21.15.49:6822/3815472376","heartbeat_front_addr":"172.21.15.49:6818/3815472376","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.641492+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.668598+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.614940+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T07:25:27.427 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-03-16T07:25:28.775 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-03-16T07:25:28.775 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-03-16T07:25:29.778 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-03-16T07:25:29.778 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T07:25:30.126 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:25:30.126 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4497,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6827/2700845528","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":2700845528},{"type":"v1","addr":"172.21.15.49:6827","nonce":2700845528}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4502,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6830/1983317600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":1983317600},{"type":"v1","addr":"172.21.15.49:6830","nonce":1983317600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4503,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6831/1363178912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6829","nonce":1363178912},{"type":"v1","addr":"172.21.15.49:6831","nonce":1363178912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4506,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6833/4243939102","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":4243939102},{"type":"v1","addr":"172.21.15.49:6833","nonce":4243939102}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-16T07:25:26.124693+0000","modified":"2024-03-16T07:25:29.119108+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4509},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4509":{"gid":4509,"name":"e","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6835/3541821089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":3541821089},{"type":"v1","addr":"172.21.15.49:6835","nonce":3541821089}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4509,"qdb_cluster":[4509]},"id":2}]} 2024-03-16T07:25:30.126 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 17 2024-03-16T07:25:30.139 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T07:25:30.442 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:25:30.442 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":28,"fsid":"f91af061-9eac-4793-87fa-8d27ae3d242f","created":"2024-03-16T07:24:20.357868+0000","modified":"2024-03-16T07:25:27.758329+0000","last_up_change":"2024-03-16T07:24:27.474980+0000","last_in_change":"2024-03-16T07:24:21.254179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T07:24:28.947521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-03-16T07:25:24.035315+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-03-16T07:25:25.110355+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.0800000429153442,"score_stable":1.0800000429153442,"optimal_score":1,"raw_score_acting":1.0800000429153442,"raw_score_stable":1.0800000429153442,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2df14aac-98dc-4e3c-ae7e-9eb677aa30be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6801","nonce":2744935777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6803","nonce":2744935777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6807","nonce":2744935777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6805","nonce":2744935777}]},"public_addr":"172.21.15.49:6801/2744935777","cluster_addr":"172.21.15.49:6803/2744935777","heartbeat_back_addr":"172.21.15.49:6807/2744935777","heartbeat_front_addr":"172.21.15.49:6805/2744935777","state":["exists","up"]},{"osd":1,"uuid":"80461bd9-59ef-46df-9eea-bad92d960c57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6811","nonce":1655120118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6815","nonce":1655120118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6821","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6823","nonce":1655120118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6817","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6819","nonce":1655120118}]},"public_addr":"172.21.15.49:6811/1655120118","cluster_addr":"172.21.15.49:6815/1655120118","heartbeat_back_addr":"172.21.15.49:6823/1655120118","heartbeat_front_addr":"172.21.15.49:6819/1655120118","state":["exists","up"]},{"osd":2,"uuid":"d6bf40eb-6e42-4ec9-8b3d-0b6c5a6def79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6810","nonce":3815472376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6814","nonce":3815472376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6822","nonce":3815472376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6818","nonce":3815472376}]},"public_addr":"172.21.15.49:6810/3815472376","cluster_addr":"172.21.15.49:6814/3815472376","heartbeat_back_addr":"172.21.15.49:6822/3815472376","heartbeat_front_addr":"172.21.15.49:6818/3815472376","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.641492+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.668598+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.614940+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T07:25:30.455 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-03-16T07:25:30.455 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-16T07:25:30.761 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:25:30.763 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2024-03-16T07:25:30.772 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":53,"stamp":"2024-03-16T07:25:28.907660+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":181,"num_write_kb":1908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":135,"ondisk_log_size":135,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":109,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":314572800,"kb_used":95452,"kb_used_data":1920,"kb_used_omap":4,"kb_used_meta":93499,"kb_avail":314477348,"statfs":{"total":322122547200,"available":322024804352,"internally_reserved":0,"allocated":1966080,"data_stored":1424587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":95743311},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.160620"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-03-16T07:25:27.762770+0000","last_change":"2024-03-16T07:25:26.778321+0000","last_active":"2024-03-16T07:25:27.762770+0000","last_peered":"2024-03-16T07:25:27.762770+0000","last_clean":"2024-03-16T07:25:27.762770+0000","last_became_active":"2024-03-16T07:25:26.778060+0000","last_became_peered":"2024-03-16T07:25:26.778060+0000","last_unstale":"2024-03-16T07:25:27.762770+0000","last_undegraded":"2024-03-16T07:25:27.762770+0000","last_fullsized":"2024-03-16T07:25:27.762770+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:56:24.824794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-16T07:25:26.799947+0000","last_change":"2024-03-16T07:25:26.797893+0000","last_active":"2024-03-16T07:25:26.799947+0000","last_peered":"2024-03-16T07:25:26.799947+0000","last_clean":"2024-03-16T07:25:26.799947+0000","last_became_active":"2024-03-16T07:25:26.795108+0000","last_became_peered":"2024-03-16T07:25:26.795108+0000","last_unstale":"2024-03-16T07:25:26.799947+0000","last_undegraded":"2024-03-16T07:25:26.799947+0000","last_fullsized":"2024-03-16T07:25:26.799947+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:16:20.453551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-16T07:25:26.781968+0000","last_change":"2024-03-16T07:25:26.779789+0000","last_active":"2024-03-16T07:25:26.781968+0000","last_peered":"2024-03-16T07:25:26.781968+0000","last_clean":"2024-03-16T07:25:26.781968+0000","last_became_active":"2024-03-16T07:25:26.779560+0000","last_became_peered":"2024-03-16T07:25:26.779560+0000","last_unstale":"2024-03-16T07:25:26.781968+0000","last_undegraded":"2024-03-16T07:25:26.781968+0000","last_fullsized":"2024-03-16T07:25:26.781968+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:22:11.503652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-16T07:25:26.784416+0000","last_change":"2024-03-16T07:25:26.782517+0000","last_active":"2024-03-16T07:25:26.784416+0000","last_peered":"2024-03-16T07:25:26.784416+0000","last_clean":"2024-03-16T07:25:26.784416+0000","last_became_active":"2024-03-16T07:25:26.782289+0000","last_became_peered":"2024-03-16T07:25:26.782289+0000","last_unstale":"2024-03-16T07:25:26.784416+0000","last_undegraded":"2024-03-16T07:25:26.784416+0000","last_fullsized":"2024-03-16T07:25:26.784416+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:19:13.645991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-03-16T07:25:27.763009+0000","last_change":"2024-03-16T07:25:26.782881+0000","last_active":"2024-03-16T07:25:27.763009+0000","last_peered":"2024-03-16T07:25:27.763009+0000","last_clean":"2024-03-16T07:25:27.763009+0000","last_became_active":"2024-03-16T07:25:26.782050+0000","last_became_peered":"2024-03-16T07:25:26.782050+0000","last_unstale":"2024-03-16T07:25:27.763009+0000","last_undegraded":"2024-03-16T07:25:27.763009+0000","last_fullsized":"2024-03-16T07:25:27.763009+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:39:12.805004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-16T07:25:26.770300+0000","last_change":"2024-03-16T07:25:26.767484+0000","last_active":"2024-03-16T07:25:26.770300+0000","last_peered":"2024-03-16T07:25:26.770300+0000","last_clean":"2024-03-16T07:25:26.770300+0000","last_became_active":"2024-03-16T07:25:26.766849+0000","last_became_peered":"2024-03-16T07:25:26.766849+0000","last_unstale":"2024-03-16T07:25:26.770300+0000","last_undegraded":"2024-03-16T07:25:26.770300+0000","last_fullsized":"2024-03-16T07:25:26.770300+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:42:57.382624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-03-16T07:25:27.763525+0000","last_change":"2024-03-16T07:25:26.789325+0000","last_active":"2024-03-16T07:25:27.763525+0000","last_peered":"2024-03-16T07:25:27.763525+0000","last_clean":"2024-03-16T07:25:27.763525+0000","last_became_active":"2024-03-16T07:25:26.789018+0000","last_became_peered":"2024-03-16T07:25:26.789018+0000","last_unstale":"2024-03-16T07:25:27.763525+0000","last_undegraded":"2024-03-16T07:25:27.763525+0000","last_fullsized":"2024-03-16T07:25:27.763525+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:25:48.897323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-03-16T07:25:27.762068+0000","last_change":"2024-03-16T07:25:26.791413+0000","last_active":"2024-03-16T07:25:27.762068+0000","last_peered":"2024-03-16T07:25:27.762068+0000","last_clean":"2024-03-16T07:25:27.762068+0000","last_became_active":"2024-03-16T07:25:26.790271+0000","last_became_peered":"2024-03-16T07:25:26.790271+0000","last_unstale":"2024-03-16T07:25:27.762068+0000","last_undegraded":"2024-03-16T07:25:27.762068+0000","last_fullsized":"2024-03-16T07:25:27.762068+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:00:23.249950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-16T07:25:26.797060+0000","last_change":"2024-03-16T07:25:26.793226+0000","last_active":"2024-03-16T07:25:26.797060+0000","last_peered":"2024-03-16T07:25:26.797060+0000","last_clean":"2024-03-16T07:25:26.797060+0000","last_became_active":"2024-03-16T07:25:26.792996+0000","last_became_peered":"2024-03-16T07:25:26.792996+0000","last_unstale":"2024-03-16T07:25:26.797060+0000","last_undegraded":"2024-03-16T07:25:26.797060+0000","last_fullsized":"2024-03-16T07:25:26.797060+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:26:17.093512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-16T07:25:26.797130+0000","last_change":"2024-03-16T07:25:26.793964+0000","last_active":"2024-03-16T07:25:26.797130+0000","last_peered":"2024-03-16T07:25:26.797130+0000","last_clean":"2024-03-16T07:25:26.797130+0000","last_became_active":"2024-03-16T07:25:26.793713+0000","last_became_peered":"2024-03-16T07:25:26.793713+0000","last_unstale":"2024-03-16T07:25:26.797130+0000","last_undegraded":"2024-03-16T07:25:26.797130+0000","last_fullsized":"2024-03-16T07:25:26.797130+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:47:16.548086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-16T07:25:26.800014+0000","last_change":"2024-03-16T07:25:26.796897+0000","last_active":"2024-03-16T07:25:26.800014+0000","last_peered":"2024-03-16T07:25:26.800014+0000","last_clean":"2024-03-16T07:25:26.800014+0000","last_became_active":"2024-03-16T07:25:26.795947+0000","last_became_peered":"2024-03-16T07:25:26.795947+0000","last_unstale":"2024-03-16T07:25:26.800014+0000","last_undegraded":"2024-03-16T07:25:26.800014+0000","last_fullsized":"2024-03-16T07:25:26.800014+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:13:14.226330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-16T07:25:26.783460+0000","last_change":"2024-03-16T07:25:26.781727+0000","last_active":"2024-03-16T07:25:26.783460+0000","last_peered":"2024-03-16T07:25:26.783460+0000","last_clean":"2024-03-16T07:25:26.783460+0000","last_became_active":"2024-03-16T07:25:26.781481+0000","last_became_peered":"2024-03-16T07:25:26.781481+0000","last_unstale":"2024-03-16T07:25:26.783460+0000","last_undegraded":"2024-03-16T07:25:26.783460+0000","last_fullsized":"2024-03-16T07:25:26.783460+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:12:51.075847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-03-16T07:25:27.762185+0000","last_change":"2024-03-16T07:25:26.790704+0000","last_active":"2024-03-16T07:25:27.762185+0000","last_peered":"2024-03-16T07:25:27.762185+0000","last_clean":"2024-03-16T07:25:27.762185+0000","last_became_active":"2024-03-16T07:25:26.790439+0000","last_became_peered":"2024-03-16T07:25:26.790439+0000","last_unstale":"2024-03-16T07:25:27.762185+0000","last_undegraded":"2024-03-16T07:25:27.762185+0000","last_fullsized":"2024-03-16T07:25:27.762185+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:26:17.093512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-16T07:25:26.784520+0000","last_change":"2024-03-16T07:25:26.776183+0000","last_active":"2024-03-16T07:25:26.784520+0000","last_peered":"2024-03-16T07:25:26.784520+0000","last_clean":"2024-03-16T07:25:26.784520+0000","last_became_active":"2024-03-16T07:25:26.775565+0000","last_became_peered":"2024-03-16T07:25:26.775565+0000","last_unstale":"2024-03-16T07:25:26.784520+0000","last_undegraded":"2024-03-16T07:25:26.784520+0000","last_fullsized":"2024-03-16T07:25:26.784520+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:52:53.885034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-16T07:25:26.775919+0000","last_change":"2024-03-16T07:25:26.773093+0000","last_active":"2024-03-16T07:25:26.775919+0000","last_peered":"2024-03-16T07:25:26.775919+0000","last_clean":"2024-03-16T07:25:26.775919+0000","last_became_active":"2024-03-16T07:25:26.772835+0000","last_became_peered":"2024-03-16T07:25:26.772835+0000","last_unstale":"2024-03-16T07:25:26.775919+0000","last_undegraded":"2024-03-16T07:25:26.775919+0000","last_fullsized":"2024-03-16T07:25:26.775919+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:52:53.752332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-16T07:25:26.776072+0000","last_change":"2024-03-16T07:25:26.773366+0000","last_active":"2024-03-16T07:25:26.776072+0000","last_peered":"2024-03-16T07:25:26.776072+0000","last_clean":"2024-03-16T07:25:26.776072+0000","last_became_active":"2024-03-16T07:25:26.773118+0000","last_became_peered":"2024-03-16T07:25:26.773118+0000","last_unstale":"2024-03-16T07:25:26.776072+0000","last_undegraded":"2024-03-16T07:25:26.776072+0000","last_fullsized":"2024-03-16T07:25:26.776072+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:44:15.933653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-16T07:25:26.781302+0000","last_change":"2024-03-16T07:25:26.775670+0000","last_active":"2024-03-16T07:25:26.781302+0000","last_peered":"2024-03-16T07:25:26.781302+0000","last_clean":"2024-03-16T07:25:26.781302+0000","last_became_active":"2024-03-16T07:25:26.775387+0000","last_became_peered":"2024-03-16T07:25:26.775387+0000","last_unstale":"2024-03-16T07:25:26.781302+0000","last_undegraded":"2024-03-16T07:25:26.781302+0000","last_fullsized":"2024-03-16T07:25:26.781302+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:39:12.805004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-16T07:25:26.799929+0000","last_change":"2024-03-16T07:25:26.797761+0000","last_active":"2024-03-16T07:25:26.799929+0000","last_peered":"2024-03-16T07:25:26.799929+0000","last_clean":"2024-03-16T07:25:26.799929+0000","last_became_active":"2024-03-16T07:25:26.796108+0000","last_became_peered":"2024-03-16T07:25:26.796108+0000","last_unstale":"2024-03-16T07:25:26.799929+0000","last_undegraded":"2024-03-16T07:25:26.799929+0000","last_fullsized":"2024-03-16T07:25:26.799929+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:51:32.782998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-16T07:25:26.799995+0000","last_change":"2024-03-16T07:25:26.796633+0000","last_active":"2024-03-16T07:25:26.799995+0000","last_peered":"2024-03-16T07:25:26.799995+0000","last_clean":"2024-03-16T07:25:26.799995+0000","last_became_active":"2024-03-16T07:25:26.795891+0000","last_became_peered":"2024-03-16T07:25:26.795891+0000","last_unstale":"2024-03-16T07:25:26.799995+0000","last_undegraded":"2024-03-16T07:25:26.799995+0000","last_fullsized":"2024-03-16T07:25:26.799995+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:16:18.923166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-03-16T07:25:27.763702+0000","last_change":"2024-03-16T07:25:26.782390+0000","last_active":"2024-03-16T07:25:27.763702+0000","last_peered":"2024-03-16T07:25:27.763702+0000","last_clean":"2024-03-16T07:25:27.763702+0000","last_became_active":"2024-03-16T07:25:26.781829+0000","last_became_peered":"2024-03-16T07:25:26.781829+0000","last_unstale":"2024-03-16T07:25:27.763702+0000","last_undegraded":"2024-03-16T07:25:27.763702+0000","last_fullsized":"2024-03-16T07:25:27.763702+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:53:30.197560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-16T07:25:26.784942+0000","last_change":"2024-03-16T07:25:26.781114+0000","last_active":"2024-03-16T07:25:26.784942+0000","last_peered":"2024-03-16T07:25:26.784942+0000","last_clean":"2024-03-16T07:25:26.784942+0000","last_became_active":"2024-03-16T07:25:26.780863+0000","last_became_peered":"2024-03-16T07:25:26.780863+0000","last_unstale":"2024-03-16T07:25:26.784942+0000","last_undegraded":"2024-03-16T07:25:26.784942+0000","last_fullsized":"2024-03-16T07:25:26.784942+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:39:17.634888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-03-16T07:25:27.763719+0000","last_change":"2024-03-16T07:25:26.780517+0000","last_active":"2024-03-16T07:25:27.763719+0000","last_peered":"2024-03-16T07:25:27.763719+0000","last_clean":"2024-03-16T07:25:27.763719+0000","last_became_active":"2024-03-16T07:25:26.779906+0000","last_became_peered":"2024-03-16T07:25:26.779906+0000","last_unstale":"2024-03-16T07:25:27.763719+0000","last_undegraded":"2024-03-16T07:25:27.763719+0000","last_fullsized":"2024-03-16T07:25:27.763719+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:16:18.923166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-16T07:25:26.799880+0000","last_change":"2024-03-16T07:25:26.797082+0000","last_active":"2024-03-16T07:25:26.799880+0000","last_peered":"2024-03-16T07:25:26.799880+0000","last_clean":"2024-03-16T07:25:26.799880+0000","last_became_active":"2024-03-16T07:25:26.794623+0000","last_became_peered":"2024-03-16T07:25:26.794623+0000","last_unstale":"2024-03-16T07:25:26.799880+0000","last_undegraded":"2024-03-16T07:25:26.799880+0000","last_fullsized":"2024-03-16T07:25:26.799880+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:47:18.096711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-03-16T07:25:27.762141+0000","last_change":"2024-03-16T07:25:26.788304+0000","last_active":"2024-03-16T07:25:27.762141+0000","last_peered":"2024-03-16T07:25:27.762141+0000","last_clean":"2024-03-16T07:25:27.762141+0000","last_became_active":"2024-03-16T07:25:26.787434+0000","last_became_peered":"2024-03-16T07:25:26.787434+0000","last_unstale":"2024-03-16T07:25:27.762141+0000","last_undegraded":"2024-03-16T07:25:27.762141+0000","last_fullsized":"2024-03-16T07:25:27.762141+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:35:14.107259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-16T07:25:26.793921+0000","last_change":"2024-03-16T07:25:26.792087+0000","last_active":"2024-03-16T07:25:26.793921+0000","last_peered":"2024-03-16T07:25:26.793921+0000","last_clean":"2024-03-16T07:25:26.793921+0000","last_became_active":"2024-03-16T07:25:26.791866+0000","last_became_peered":"2024-03-16T07:25:26.791866+0000","last_unstale":"2024-03-16T07:25:26.793921+0000","last_undegraded":"2024-03-16T07:25:26.793921+0000","last_fullsized":"2024-03-16T07:25:26.793921+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:00:23.249950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-16T07:25:26.789075+0000","last_change":"2024-03-16T07:25:26.784187+0000","last_active":"2024-03-16T07:25:26.789075+0000","last_peered":"2024-03-16T07:25:26.789075+0000","last_clean":"2024-03-16T07:25:26.789075+0000","last_became_active":"2024-03-16T07:25:26.783915+0000","last_became_peered":"2024-03-16T07:25:26.783915+0000","last_unstale":"2024-03-16T07:25:26.789075+0000","last_undegraded":"2024-03-16T07:25:26.789075+0000","last_fullsized":"2024-03-16T07:25:26.789075+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:29:40.433127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-16T07:25:26.791547+0000","last_change":"2024-03-16T07:25:26.791013+0000","last_active":"2024-03-16T07:25:26.791547+0000","last_peered":"2024-03-16T07:25:26.791547+0000","last_clean":"2024-03-16T07:25:26.791547+0000","last_became_active":"2024-03-16T07:25:26.790781+0000","last_became_peered":"2024-03-16T07:25:26.790781+0000","last_unstale":"2024-03-16T07:25:26.791547+0000","last_undegraded":"2024-03-16T07:25:26.791547+0000","last_fullsized":"2024-03-16T07:25:26.791547+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:04:31.101158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-03-16T07:25:27.763801+0000","last_change":"2024-03-16T07:25:26.782081+0000","last_active":"2024-03-16T07:25:27.763801+0000","last_peered":"2024-03-16T07:25:27.763801+0000","last_clean":"2024-03-16T07:25:27.763801+0000","last_became_active":"2024-03-16T07:25:26.781123+0000","last_became_peered":"2024-03-16T07:25:26.781123+0000","last_unstale":"2024-03-16T07:25:27.763801+0000","last_undegraded":"2024-03-16T07:25:27.763801+0000","last_fullsized":"2024-03-16T07:25:27.763801+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:47:18.096711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-16T07:25:26.799963+0000","last_change":"2024-03-16T07:25:26.798086+0000","last_active":"2024-03-16T07:25:26.799963+0000","last_peered":"2024-03-16T07:25:26.799963+0000","last_clean":"2024-03-16T07:25:26.799963+0000","last_became_active":"2024-03-16T07:25:26.795175+0000","last_became_peered":"2024-03-16T07:25:26.795175+0000","last_unstale":"2024-03-16T07:25:26.799963+0000","last_undegraded":"2024-03-16T07:25:26.799963+0000","last_fullsized":"2024-03-16T07:25:26.799963+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:36:58.986457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-16T07:25:26.784498+0000","last_change":"2024-03-16T07:25:26.775812+0000","last_active":"2024-03-16T07:25:26.784498+0000","last_peered":"2024-03-16T07:25:26.784498+0000","last_clean":"2024-03-16T07:25:26.784498+0000","last_became_active":"2024-03-16T07:25:26.775250+0000","last_became_peered":"2024-03-16T07:25:26.775250+0000","last_unstale":"2024-03-16T07:25:26.784498+0000","last_undegraded":"2024-03-16T07:25:26.784498+0000","last_fullsized":"2024-03-16T07:25:26.784498+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:36:38.284510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-03-16T07:25:27.763307+0000","last_change":"2024-03-16T07:25:26.779663+0000","last_active":"2024-03-16T07:25:27.763307+0000","last_peered":"2024-03-16T07:25:27.763307+0000","last_clean":"2024-03-16T07:25:27.763307+0000","last_became_active":"2024-03-16T07:25:26.779395+0000","last_became_peered":"2024-03-16T07:25:26.779395+0000","last_unstale":"2024-03-16T07:25:27.763307+0000","last_undegraded":"2024-03-16T07:25:27.763307+0000","last_fullsized":"2024-03-16T07:25:27.763307+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:39:17.634888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-03-16T07:25:27.762223+0000","last_change":"2024-03-16T07:25:26.788490+0000","last_active":"2024-03-16T07:25:27.762223+0000","last_peered":"2024-03-16T07:25:27.762223+0000","last_clean":"2024-03-16T07:25:27.762223+0000","last_became_active":"2024-03-16T07:25:26.787773+0000","last_became_peered":"2024-03-16T07:25:26.787773+0000","last_unstale":"2024-03-16T07:25:27.762223+0000","last_undegraded":"2024-03-16T07:25:27.762223+0000","last_fullsized":"2024-03-16T07:25:27.762223+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:47:16.548086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-16T07:25:26.776376+0000","last_change":"2024-03-16T07:25:26.774904+0000","last_active":"2024-03-16T07:25:26.776376+0000","last_peered":"2024-03-16T07:25:26.776376+0000","last_clean":"2024-03-16T07:25:26.776376+0000","last_became_active":"2024-03-16T07:25:26.774655+0000","last_became_peered":"2024-03-16T07:25:26.774655+0000","last_unstale":"2024-03-16T07:25:26.776376+0000","last_undegraded":"2024-03-16T07:25:26.776376+0000","last_fullsized":"2024-03-16T07:25:26.776376+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:56:24.824794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"27'4","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-16T07:25:26.797552+0000","last_change":"2024-03-16T07:25:25.774269+0000","last_active":"2024-03-16T07:25:26.797552+0000","last_peered":"2024-03-16T07:25:26.797552+0000","last_clean":"2024-03-16T07:25:26.797552+0000","last_became_active":"2024-03-16T07:25:25.774016+0000","last_became_peered":"2024-03-16T07:25:25.774016+0000","last_unstale":"2024-03-16T07:25:26.797552+0000","last_undegraded":"2024-03-16T07:25:26.797552+0000","last_fullsized":"2024-03-16T07:25:26.797552+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_clean_scrub_stamp":"2024-03-16T07:25:24.745467+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:24:12.540520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-03-16T07:25:27.763010+0000","last_change":"2024-03-16T07:25:26.787749+0000","last_active":"2024-03-16T07:25:27.763010+0000","last_peered":"2024-03-16T07:25:27.763010+0000","last_clean":"2024-03-16T07:25:27.763010+0000","last_became_active":"2024-03-16T07:25:26.787465+0000","last_became_peered":"2024-03-16T07:25:26.787465+0000","last_unstale":"2024-03-16T07:25:27.763010+0000","last_undegraded":"2024-03-16T07:25:27.763010+0000","last_fullsized":"2024-03-16T07:25:27.763010+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:36:38.284510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"27'1","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-16T07:25:26.796326+0000","last_change":"2024-03-16T07:25:25.771867+0000","last_active":"2024-03-16T07:25:26.796326+0000","last_peered":"2024-03-16T07:25:26.796326+0000","last_clean":"2024-03-16T07:25:26.796326+0000","last_became_active":"2024-03-16T07:25:25.771573+0000","last_became_peered":"2024-03-16T07:25:25.771573+0000","last_unstale":"2024-03-16T07:25:26.796326+0000","last_undegraded":"2024-03-16T07:25:26.796326+0000","last_fullsized":"2024-03-16T07:25:26.796326+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_clean_scrub_stamp":"2024-03-16T07:25:24.745467+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:30:31.592675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-03-16T07:25:27.763849+0000","last_change":"2024-03-16T07:25:26.782505+0000","last_active":"2024-03-16T07:25:27.763849+0000","last_peered":"2024-03-16T07:25:27.763849+0000","last_clean":"2024-03-16T07:25:27.763849+0000","last_became_active":"2024-03-16T07:25:26.781458+0000","last_became_peered":"2024-03-16T07:25:26.781458+0000","last_unstale":"2024-03-16T07:25:27.763849+0000","last_undegraded":"2024-03-16T07:25:27.763849+0000","last_fullsized":"2024-03-16T07:25:27.763849+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:34:16.025272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"27'2","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-16T07:25:26.796129+0000","last_change":"2024-03-16T07:25:25.773676+0000","last_active":"2024-03-16T07:25:26.796129+0000","last_peered":"2024-03-16T07:25:26.796129+0000","last_clean":"2024-03-16T07:25:26.796129+0000","last_became_active":"2024-03-16T07:25:25.773426+0000","last_became_peered":"2024-03-16T07:25:25.773426+0000","last_unstale":"2024-03-16T07:25:26.796129+0000","last_undegraded":"2024-03-16T07:25:26.796129+0000","last_fullsized":"2024-03-16T07:25:26.796129+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_clean_scrub_stamp":"2024-03-16T07:25:24.745467+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:26:16.092140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-16T07:25:26.791562+0000","last_change":"2024-03-16T07:25:26.790198+0000","last_active":"2024-03-16T07:25:26.791562+0000","last_peered":"2024-03-16T07:25:26.791562+0000","last_clean":"2024-03-16T07:25:26.791562+0000","last_became_active":"2024-03-16T07:25:26.789918+0000","last_became_peered":"2024-03-16T07:25:26.789918+0000","last_unstale":"2024-03-16T07:25:26.791562+0000","last_undegraded":"2024-03-16T07:25:26.791562+0000","last_fullsized":"2024-03-16T07:25:26.791562+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:30:32.594047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"27'2","reported_seq":16,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-03-16T07:25:27.763950+0000","last_change":"2024-03-16T07:25:25.776429+0000","last_active":"2024-03-16T07:25:27.763950+0000","last_peered":"2024-03-16T07:25:27.763950+0000","last_clean":"2024-03-16T07:25:27.763950+0000","last_became_active":"2024-03-16T07:25:25.776189+0000","last_became_peered":"2024-03-16T07:25:25.776189+0000","last_unstale":"2024-03-16T07:25:27.763950+0000","last_undegraded":"2024-03-16T07:25:27.763950+0000","last_fullsized":"2024-03-16T07:25:27.763950+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_clean_scrub_stamp":"2024-03-16T07:25:24.745467+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:56:07.751589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-16T07:25:26.789619+0000","last_change":"2024-03-16T07:25:26.788243+0000","last_active":"2024-03-16T07:25:26.789619+0000","last_peered":"2024-03-16T07:25:26.789619+0000","last_clean":"2024-03-16T07:25:26.789619+0000","last_became_active":"2024-03-16T07:25:26.787967+0000","last_became_peered":"2024-03-16T07:25:26.787967+0000","last_unstale":"2024-03-16T07:25:26.789619+0000","last_undegraded":"2024-03-16T07:25:26.789619+0000","last_fullsized":"2024-03-16T07:25:26.789619+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:07:30.175119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"27'1","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-03-16T07:25:27.762862+0000","last_change":"2024-03-16T07:25:25.777040+0000","last_active":"2024-03-16T07:25:27.762862+0000","last_peered":"2024-03-16T07:25:27.762862+0000","last_clean":"2024-03-16T07:25:27.762862+0000","last_became_active":"2024-03-16T07:25:25.776802+0000","last_became_peered":"2024-03-16T07:25:25.776802+0000","last_unstale":"2024-03-16T07:25:27.762862+0000","last_undegraded":"2024-03-16T07:25:27.762862+0000","last_fullsized":"2024-03-16T07:25:27.762862+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_clean_scrub_stamp":"2024-03-16T07:25:24.745467+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:23:21.193828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-03-16T07:25:27.762477+0000","last_change":"2024-03-16T07:25:26.783520+0000","last_active":"2024-03-16T07:25:27.762477+0000","last_peered":"2024-03-16T07:25:27.762477+0000","last_clean":"2024-03-16T07:25:27.762477+0000","last_became_active":"2024-03-16T07:25:26.782402+0000","last_became_peered":"2024-03-16T07:25:26.782402+0000","last_unstale":"2024-03-16T07:25:27.762477+0000","last_undegraded":"2024-03-16T07:25:27.762477+0000","last_fullsized":"2024-03-16T07:25:27.762477+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:52:53.752332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"27'1","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-03-16T07:25:27.763902+0000","last_change":"2024-03-16T07:25:25.769228+0000","last_active":"2024-03-16T07:25:27.763902+0000","last_peered":"2024-03-16T07:25:27.763902+0000","last_clean":"2024-03-16T07:25:27.763902+0000","last_became_active":"2024-03-16T07:25:25.768968+0000","last_became_peered":"2024-03-16T07:25:25.768968+0000","last_unstale":"2024-03-16T07:25:27.763902+0000","last_undegraded":"2024-03-16T07:25:27.763902+0000","last_fullsized":"2024-03-16T07:25:27.763902+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_clean_scrub_stamp":"2024-03-16T07:25:24.745467+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:51:25.934804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-16T07:25:26.782011+0000","last_change":"2024-03-16T07:25:26.779275+0000","last_active":"2024-03-16T07:25:26.782011+0000","last_peered":"2024-03-16T07:25:26.782011+0000","last_clean":"2024-03-16T07:25:26.782011+0000","last_became_active":"2024-03-16T07:25:26.779010+0000","last_became_peered":"2024-03-16T07:25:26.779010+0000","last_unstale":"2024-03-16T07:25:26.782011+0000","last_undegraded":"2024-03-16T07:25:26.782011+0000","last_fullsized":"2024-03-16T07:25:26.782011+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:58:20.759128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-16T07:25:26.763175+0000","last_change":"2024-03-16T07:25:25.765015+0000","last_active":"2024-03-16T07:25:26.763175+0000","last_peered":"2024-03-16T07:25:26.763175+0000","last_clean":"2024-03-16T07:25:26.763175+0000","last_became_active":"2024-03-16T07:25:25.764293+0000","last_became_peered":"2024-03-16T07:25:25.764293+0000","last_unstale":"2024-03-16T07:25:26.763175+0000","last_undegraded":"2024-03-16T07:25:26.763175+0000","last_fullsized":"2024-03-16T07:25:26.763175+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_clean_scrub_stamp":"2024-03-16T07:25:24.745467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:56:32.782012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-16T07:25:26.781731+0000","last_change":"2024-03-16T07:25:26.779863+0000","last_active":"2024-03-16T07:25:26.781731+0000","last_peered":"2024-03-16T07:25:26.781731+0000","last_clean":"2024-03-16T07:25:26.781731+0000","last_became_active":"2024-03-16T07:25:26.779362+0000","last_became_peered":"2024-03-16T07:25:26.779362+0000","last_unstale":"2024-03-16T07:25:26.781731+0000","last_undegraded":"2024-03-16T07:25:26.781731+0000","last_fullsized":"2024-03-16T07:25:26.781731+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:02:27.035138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-03-16T07:25:27.762549+0000","last_change":"2024-03-16T07:25:25.777178+0000","last_active":"2024-03-16T07:25:27.762549+0000","last_peered":"2024-03-16T07:25:27.762549+0000","last_clean":"2024-03-16T07:25:27.762549+0000","last_became_active":"2024-03-16T07:25:25.776915+0000","last_became_peered":"2024-03-16T07:25:25.776915+0000","last_unstale":"2024-03-16T07:25:27.762549+0000","last_undegraded":"2024-03-16T07:25:27.762549+0000","last_fullsized":"2024-03-16T07:25:27.762549+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_clean_scrub_stamp":"2024-03-16T07:25:24.745467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:46:35.716476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-16T07:25:26.787344+0000","last_change":"2024-03-16T07:25:26.783155+0000","last_active":"2024-03-16T07:25:26.787344+0000","last_peered":"2024-03-16T07:25:26.787344+0000","last_clean":"2024-03-16T07:25:26.787344+0000","last_became_active":"2024-03-16T07:25:26.782902+0000","last_became_peered":"2024-03-16T07:25:26.782902+0000","last_unstale":"2024-03-16T07:25:26.787344+0000","last_undegraded":"2024-03-16T07:25:26.787344+0000","last_fullsized":"2024-03-16T07:25:26.787344+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:43:22.848966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-16T07:25:26.765628+0000","last_change":"2024-03-16T07:25:25.772980+0000","last_active":"2024-03-16T07:25:26.765628+0000","last_peered":"2024-03-16T07:25:26.765628+0000","last_clean":"2024-03-16T07:25:26.765628+0000","last_became_active":"2024-03-16T07:25:25.772547+0000","last_became_peered":"2024-03-16T07:25:25.772547+0000","last_unstale":"2024-03-16T07:25:26.765628+0000","last_undegraded":"2024-03-16T07:25:26.765628+0000","last_fullsized":"2024-03-16T07:25:26.765628+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_clean_scrub_stamp":"2024-03-16T07:25:24.745467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:56:24.076896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-03-16T07:25:27.763202+0000","last_change":"2024-03-16T07:25:26.788379+0000","last_active":"2024-03-16T07:25:27.763202+0000","last_peered":"2024-03-16T07:25:27.763202+0000","last_clean":"2024-03-16T07:25:27.763202+0000","last_became_active":"2024-03-16T07:25:26.788113+0000","last_became_peered":"2024-03-16T07:25:26.788113+0000","last_unstale":"2024-03-16T07:25:27.763202+0000","last_undegraded":"2024-03-16T07:25:27.763202+0000","last_fullsized":"2024-03-16T07:25:27.763202+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:56:44.440768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-16T07:25:26.763379+0000","last_change":"2024-03-16T07:25:25.766665+0000","last_active":"2024-03-16T07:25:26.763379+0000","last_peered":"2024-03-16T07:25:26.763379+0000","last_clean":"2024-03-16T07:25:26.763379+0000","last_became_active":"2024-03-16T07:25:25.765031+0000","last_became_peered":"2024-03-16T07:25:25.765031+0000","last_unstale":"2024-03-16T07:25:26.763379+0000","last_undegraded":"2024-03-16T07:25:26.763379+0000","last_fullsized":"2024-03-16T07:25:26.763379+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_clean_scrub_stamp":"2024-03-16T07:25:24.745467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:00:22.248577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-16T07:25:26.776355+0000","last_change":"2024-03-16T07:25:26.774990+0000","last_active":"2024-03-16T07:25:26.776355+0000","last_peered":"2024-03-16T07:25:26.776355+0000","last_clean":"2024-03-16T07:25:26.776355+0000","last_became_active":"2024-03-16T07:25:26.774538+0000","last_became_peered":"2024-03-16T07:25:26.774538+0000","last_unstale":"2024-03-16T07:25:26.776355+0000","last_undegraded":"2024-03-16T07:25:26.776355+0000","last_fullsized":"2024-03-16T07:25:26.776355+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:50:36.836140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"27'3","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-16T07:25:26.796164+0000","last_change":"2024-03-16T07:25:25.772575+0000","last_active":"2024-03-16T07:25:26.796164+0000","last_peered":"2024-03-16T07:25:26.796164+0000","last_clean":"2024-03-16T07:25:26.796164+0000","last_became_active":"2024-03-16T07:25:25.771846+0000","last_became_peered":"2024-03-16T07:25:25.771846+0000","last_unstale":"2024-03-16T07:25:26.796164+0000","last_undegraded":"2024-03-16T07:25:26.796164+0000","last_fullsized":"2024-03-16T07:25:26.796164+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_clean_scrub_stamp":"2024-03-16T07:25:24.745467+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:47:15.546713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-16T07:25:26.799899+0000","last_change":"2024-03-16T07:25:26.796428+0000","last_active":"2024-03-16T07:25:26.799899+0000","last_peered":"2024-03-16T07:25:26.799899+0000","last_clean":"2024-03-16T07:25:26.799899+0000","last_became_active":"2024-03-16T07:25:26.795282+0000","last_became_peered":"2024-03-16T07:25:26.795282+0000","last_unstale":"2024-03-16T07:25:26.799899+0000","last_undegraded":"2024-03-16T07:25:26.799899+0000","last_fullsized":"2024-03-16T07:25:26.799899+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:25:48.897323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"27'6","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-16T07:25:26.801999+0000","last_change":"2024-03-16T07:25:25.770852+0000","last_active":"2024-03-16T07:25:26.801999+0000","last_peered":"2024-03-16T07:25:26.801999+0000","last_clean":"2024-03-16T07:25:26.801999+0000","last_became_active":"2024-03-16T07:25:25.770506+0000","last_became_peered":"2024-03-16T07:25:25.770506+0000","last_unstale":"2024-03-16T07:25:26.801999+0000","last_undegraded":"2024-03-16T07:25:26.801999+0000","last_fullsized":"2024-03-16T07:25:26.801999+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_clean_scrub_stamp":"2024-03-16T07:25:24.745467+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:28:55.817930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-16T07:25:26.769527+0000","last_change":"2024-03-16T07:25:26.767088+0000","last_active":"2024-03-16T07:25:26.769527+0000","last_peered":"2024-03-16T07:25:26.769527+0000","last_clean":"2024-03-16T07:25:26.769527+0000","last_became_active":"2024-03-16T07:25:26.766517+0000","last_became_peered":"2024-03-16T07:25:26.766517+0000","last_unstale":"2024-03-16T07:25:26.769527+0000","last_undegraded":"2024-03-16T07:25:26.769527+0000","last_fullsized":"2024-03-16T07:25:26.769527+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:27:42.795734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"27'2","reported_seq":16,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-03-16T07:25:27.763116+0000","last_change":"2024-03-16T07:25:25.777623+0000","last_active":"2024-03-16T07:25:27.763116+0000","last_peered":"2024-03-16T07:25:27.763116+0000","last_clean":"2024-03-16T07:25:27.763116+0000","last_became_active":"2024-03-16T07:25:25.776995+0000","last_became_peered":"2024-03-16T07:25:25.776995+0000","last_unstale":"2024-03-16T07:25:27.763116+0000","last_undegraded":"2024-03-16T07:25:27.763116+0000","last_fullsized":"2024-03-16T07:25:27.763116+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_clean_scrub_stamp":"2024-03-16T07:25:24.745467+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:51:34.836861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-16T07:25:26.793960+0000","last_change":"2024-03-16T07:25:26.791462+0000","last_active":"2024-03-16T07:25:26.793960+0000","last_peered":"2024-03-16T07:25:26.793960+0000","last_clean":"2024-03-16T07:25:26.793960+0000","last_became_active":"2024-03-16T07:25:26.791154+0000","last_became_peered":"2024-03-16T07:25:26.791154+0000","last_unstale":"2024-03-16T07:25:26.793960+0000","last_undegraded":"2024-03-16T07:25:26.793960+0000","last_fullsized":"2024-03-16T07:25:26.793960+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:56:33.783384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-16T07:25:26.754601+0000","last_change":"2024-03-16T07:25:25.766436+0000","last_active":"2024-03-16T07:25:26.754601+0000","last_peered":"2024-03-16T07:25:26.754601+0000","last_clean":"2024-03-16T07:25:26.754601+0000","last_became_active":"2024-03-16T07:25:25.766215+0000","last_became_peered":"2024-03-16T07:25:25.766215+0000","last_unstale":"2024-03-16T07:25:26.754601+0000","last_undegraded":"2024-03-16T07:25:26.754601+0000","last_fullsized":"2024-03-16T07:25:26.754601+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_clean_scrub_stamp":"2024-03-16T07:25:24.745467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:51:34.836861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-03-16T07:25:27.762307+0000","last_change":"2024-03-16T07:25:26.788681+0000","last_active":"2024-03-16T07:25:27.762307+0000","last_peered":"2024-03-16T07:25:27.762307+0000","last_clean":"2024-03-16T07:25:27.762307+0000","last_became_active":"2024-03-16T07:25:26.788069+0000","last_became_peered":"2024-03-16T07:25:26.788069+0000","last_unstale":"2024-03-16T07:25:27.762307+0000","last_undegraded":"2024-03-16T07:25:27.762307+0000","last_fullsized":"2024-03-16T07:25:27.762307+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:56:25.078268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-03-16T07:25:27.763646+0000","last_change":"2024-03-16T07:25:25.767424+0000","last_active":"2024-03-16T07:25:27.763646+0000","last_peered":"2024-03-16T07:25:27.763646+0000","last_clean":"2024-03-16T07:25:27.763646+0000","last_became_active":"2024-03-16T07:25:25.767167+0000","last_became_peered":"2024-03-16T07:25:25.767167+0000","last_unstale":"2024-03-16T07:25:27.763646+0000","last_undegraded":"2024-03-16T07:25:27.763646+0000","last_fullsized":"2024-03-16T07:25:27.763646+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_clean_scrub_stamp":"2024-03-16T07:25:24.745467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:55:08.055595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-16T07:25:26.779921+0000","last_change":"2024-03-16T07:25:26.778809+0000","last_active":"2024-03-16T07:25:26.779921+0000","last_peered":"2024-03-16T07:25:26.779921+0000","last_clean":"2024-03-16T07:25:26.779921+0000","last_became_active":"2024-03-16T07:25:26.778552+0000","last_became_peered":"2024-03-16T07:25:26.778552+0000","last_unstale":"2024-03-16T07:25:26.779921+0000","last_undegraded":"2024-03-16T07:25:26.779921+0000","last_fullsized":"2024-03-16T07:25:26.779921+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:28:05.097218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"27'8","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-16T07:25:26.800764+0000","last_change":"2024-03-16T07:25:25.770830+0000","last_active":"2024-03-16T07:25:26.800764+0000","last_peered":"2024-03-16T07:25:26.800764+0000","last_clean":"2024-03-16T07:25:26.800764+0000","last_became_active":"2024-03-16T07:25:25.770533+0000","last_became_peered":"2024-03-16T07:25:25.770533+0000","last_unstale":"2024-03-16T07:25:26.800764+0000","last_undegraded":"2024-03-16T07:25:26.800764+0000","last_fullsized":"2024-03-16T07:25:26.800764+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_clean_scrub_stamp":"2024-03-16T07:25:24.745467+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:12:18.043604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-03-16T07:25:27.762899+0000","last_change":"2024-03-16T07:25:26.783403+0000","last_active":"2024-03-16T07:25:27.762899+0000","last_peered":"2024-03-16T07:25:27.762899+0000","last_clean":"2024-03-16T07:25:27.762899+0000","last_became_active":"2024-03-16T07:25:26.782811+0000","last_became_peered":"2024-03-16T07:25:26.782811+0000","last_unstale":"2024-03-16T07:25:27.762899+0000","last_undegraded":"2024-03-16T07:25:27.762899+0000","last_fullsized":"2024-03-16T07:25:27.762899+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:50:36.836140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"27'1","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-16T07:25:26.799459+0000","last_change":"2024-03-16T07:25:25.768264+0000","last_active":"2024-03-16T07:25:26.799459+0000","last_peered":"2024-03-16T07:25:26.799459+0000","last_clean":"2024-03-16T07:25:26.799459+0000","last_became_active":"2024-03-16T07:25:25.767788+0000","last_became_peered":"2024-03-16T07:25:25.767788+0000","last_unstale":"2024-03-16T07:25:26.799459+0000","last_undegraded":"2024-03-16T07:25:26.799459+0000","last_fullsized":"2024-03-16T07:25:26.799459+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_clean_scrub_stamp":"2024-03-16T07:25:24.745467+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:49:12.241606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-16T07:25:26.791528+0000","last_change":"2024-03-16T07:25:26.791000+0000","last_active":"2024-03-16T07:25:26.791528+0000","last_peered":"2024-03-16T07:25:26.791528+0000","last_clean":"2024-03-16T07:25:26.791528+0000","last_became_active":"2024-03-16T07:25:26.790748+0000","last_became_peered":"2024-03-16T07:25:26.790748+0000","last_unstale":"2024-03-16T07:25:26.791528+0000","last_undegraded":"2024-03-16T07:25:26.791528+0000","last_fullsized":"2024-03-16T07:25:26.791528+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:03:21.014921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"27'2","reported_seq":16,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-03-16T07:25:27.763156+0000","last_change":"2024-03-16T07:25:25.777336+0000","last_active":"2024-03-16T07:25:27.763156+0000","last_peered":"2024-03-16T07:25:27.763156+0000","last_clean":"2024-03-16T07:25:27.763156+0000","last_became_active":"2024-03-16T07:25:25.776801+0000","last_became_peered":"2024-03-16T07:25:25.776801+0000","last_unstale":"2024-03-16T07:25:27.763156+0000","last_undegraded":"2024-03-16T07:25:27.763156+0000","last_fullsized":"2024-03-16T07:25:27.763156+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_clean_scrub_stamp":"2024-03-16T07:25:24.745467+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:12:18.043604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-16T07:25:26.797204+0000","last_change":"2024-03-16T07:25:26.792837+0000","last_active":"2024-03-16T07:25:26.797204+0000","last_peered":"2024-03-16T07:25:26.797204+0000","last_clean":"2024-03-16T07:25:26.797204+0000","last_became_active":"2024-03-16T07:25:26.792560+0000","last_became_peered":"2024-03-16T07:25:26.792560+0000","last_unstale":"2024-03-16T07:25:26.797204+0000","last_undegraded":"2024-03-16T07:25:26.797204+0000","last_fullsized":"2024-03-16T07:25:26.797204+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:35:14.107259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"27'1","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-16T07:25:26.799369+0000","last_change":"2024-03-16T07:25:25.767060+0000","last_active":"2024-03-16T07:25:26.799369+0000","last_peered":"2024-03-16T07:25:26.799369+0000","last_clean":"2024-03-16T07:25:26.799369+0000","last_became_active":"2024-03-16T07:25:25.766634+0000","last_became_peered":"2024-03-16T07:25:25.766634+0000","last_unstale":"2024-03-16T07:25:26.799369+0000","last_undegraded":"2024-03-16T07:25:26.799369+0000","last_fullsized":"2024-03-16T07:25:26.799369+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_clean_scrub_stamp":"2024-03-16T07:25:24.745467+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:45:27.137248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-03-16T07:25:27.762769+0000","last_change":"2024-03-16T07:25:26.777451+0000","last_active":"2024-03-16T07:25:27.762769+0000","last_peered":"2024-03-16T07:25:27.762769+0000","last_clean":"2024-03-16T07:25:27.762769+0000","last_became_active":"2024-03-16T07:25:26.777208+0000","last_became_peered":"2024-03-16T07:25:26.777208+0000","last_unstale":"2024-03-16T07:25:27.762769+0000","last_undegraded":"2024-03-16T07:25:27.762769+0000","last_fullsized":"2024-03-16T07:25:27.762769+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:15:25.308866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-16T07:25:26.762543+0000","last_change":"2024-03-16T07:25:25.772328+0000","last_active":"2024-03-16T07:25:26.762543+0000","last_peered":"2024-03-16T07:25:26.762543+0000","last_clean":"2024-03-16T07:25:26.762543+0000","last_became_active":"2024-03-16T07:25:25.772044+0000","last_became_peered":"2024-03-16T07:25:25.772044+0000","last_unstale":"2024-03-16T07:25:26.762543+0000","last_undegraded":"2024-03-16T07:25:26.762543+0000","last_fullsized":"2024-03-16T07:25:26.762543+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_clean_scrub_stamp":"2024-03-16T07:25:24.745467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:03:20.013549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-03-16T07:25:27.763777+0000","last_change":"2024-03-16T07:25:26.780721+0000","last_active":"2024-03-16T07:25:27.763777+0000","last_peered":"2024-03-16T07:25:27.763777+0000","last_clean":"2024-03-16T07:25:27.763777+0000","last_became_active":"2024-03-16T07:25:26.780222+0000","last_became_peered":"2024-03-16T07:25:26.780222+0000","last_unstale":"2024-03-16T07:25:27.763777+0000","last_undegraded":"2024-03-16T07:25:27.763777+0000","last_fullsized":"2024-03-16T07:25:27.763777+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:13:14.226330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"27'2","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-16T07:25:26.799158+0000","last_change":"2024-03-16T07:25:25.772458+0000","last_active":"2024-03-16T07:25:26.799158+0000","last_peered":"2024-03-16T07:25:26.799158+0000","last_clean":"2024-03-16T07:25:26.799158+0000","last_became_active":"2024-03-16T07:25:25.772025+0000","last_became_peered":"2024-03-16T07:25:25.772025+0000","last_unstale":"2024-03-16T07:25:26.799158+0000","last_undegraded":"2024-03-16T07:25:26.799158+0000","last_fullsized":"2024-03-16T07:25:26.799158+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_clean_scrub_stamp":"2024-03-16T07:25:24.745467+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:13:25.638087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-03-16T07:25:27.762758+0000","last_change":"2024-03-16T07:25:26.782666+0000","last_active":"2024-03-16T07:25:27.762758+0000","last_peered":"2024-03-16T07:25:27.762758+0000","last_clean":"2024-03-16T07:25:27.762758+0000","last_became_active":"2024-03-16T07:25:26.781644+0000","last_became_peered":"2024-03-16T07:25:26.781644+0000","last_unstale":"2024-03-16T07:25:27.762758+0000","last_undegraded":"2024-03-16T07:25:27.762758+0000","last_fullsized":"2024-03-16T07:25:27.762758+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:44:15.933653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-03-16T07:25:27.763908+0000","last_change":"2024-03-16T07:25:25.776342+0000","last_active":"2024-03-16T07:25:27.763908+0000","last_peered":"2024-03-16T07:25:27.763908+0000","last_clean":"2024-03-16T07:25:27.763908+0000","last_became_active":"2024-03-16T07:25:25.776083+0000","last_became_peered":"2024-03-16T07:25:25.776083+0000","last_unstale":"2024-03-16T07:25:27.763908+0000","last_undegraded":"2024-03-16T07:25:27.763908+0000","last_fullsized":"2024-03-16T07:25:27.763908+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_clean_scrub_stamp":"2024-03-16T07:25:24.745467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:22:26.980496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-03-16T07:25:27.762377+0000","last_change":"2024-03-16T07:25:26.781283+0000","last_active":"2024-03-16T07:25:27.762377+0000","last_peered":"2024-03-16T07:25:27.762377+0000","last_clean":"2024-03-16T07:25:27.762377+0000","last_became_active":"2024-03-16T07:25:26.781030+0000","last_became_peered":"2024-03-16T07:25:26.781030+0000","last_unstale":"2024-03-16T07:25:27.762377+0000","last_undegraded":"2024-03-16T07:25:27.762377+0000","last_fullsized":"2024-03-16T07:25:27.762377+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:24:13.541892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-16T07:25:26.754197+0000","last_change":"2024-03-16T07:25:25.769426+0000","last_active":"2024-03-16T07:25:26.754197+0000","last_peered":"2024-03-16T07:25:26.754197+0000","last_clean":"2024-03-16T07:25:26.754197+0000","last_became_active":"2024-03-16T07:25:25.769183+0000","last_became_peered":"2024-03-16T07:25:25.769183+0000","last_unstale":"2024-03-16T07:25:26.754197+0000","last_undegraded":"2024-03-16T07:25:26.754197+0000","last_fullsized":"2024-03-16T07:25:26.754197+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_clean_scrub_stamp":"2024-03-16T07:25:24.745467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:23:21.193828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-16T07:25:26.789646+0000","last_change":"2024-03-16T07:25:26.788813+0000","last_active":"2024-03-16T07:25:26.789646+0000","last_peered":"2024-03-16T07:25:26.789646+0000","last_clean":"2024-03-16T07:25:26.789646+0000","last_became_active":"2024-03-16T07:25:26.788546+0000","last_became_peered":"2024-03-16T07:25:26.788546+0000","last_unstale":"2024-03-16T07:25:26.789646+0000","last_undegraded":"2024-03-16T07:25:26.789646+0000","last_fullsized":"2024-03-16T07:25:26.789646+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:58:28.330508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-16T07:25:26.753443+0000","last_change":"2024-03-16T07:25:25.775102+0000","last_active":"2024-03-16T07:25:26.753443+0000","last_peered":"2024-03-16T07:25:26.753443+0000","last_clean":"2024-03-16T07:25:26.753443+0000","last_became_active":"2024-03-16T07:25:25.774651+0000","last_became_peered":"2024-03-16T07:25:25.774651+0000","last_unstale":"2024-03-16T07:25:26.753443+0000","last_undegraded":"2024-03-16T07:25:26.753443+0000","last_fullsized":"2024-03-16T07:25:26.753443+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_clean_scrub_stamp":"2024-03-16T07:25:24.745467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:46:35.716476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-03-16T07:25:27.763057+0000","last_change":"2024-03-16T07:25:26.787104+0000","last_active":"2024-03-16T07:25:27.763057+0000","last_peered":"2024-03-16T07:25:27.763057+0000","last_clean":"2024-03-16T07:25:27.763057+0000","last_became_active":"2024-03-16T07:25:26.786575+0000","last_became_peered":"2024-03-16T07:25:26.786575+0000","last_unstale":"2024-03-16T07:25:27.763057+0000","last_undegraded":"2024-03-16T07:25:27.763057+0000","last_fullsized":"2024-03-16T07:25:27.763057+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:52:53.885034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"27'2","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-16T07:25:26.789169+0000","last_change":"2024-03-16T07:25:25.771377+0000","last_active":"2024-03-16T07:25:26.789169+0000","last_peered":"2024-03-16T07:25:26.789169+0000","last_clean":"2024-03-16T07:25:26.789169+0000","last_became_active":"2024-03-16T07:25:25.771098+0000","last_became_peered":"2024-03-16T07:25:25.771098+0000","last_unstale":"2024-03-16T07:25:26.789169+0000","last_undegraded":"2024-03-16T07:25:26.789169+0000","last_fullsized":"2024-03-16T07:25:26.789169+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_clean_scrub_stamp":"2024-03-16T07:25:24.745467+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:05:38.205183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-16T07:25:26.799917+0000","last_change":"2024-03-16T07:25:26.797488+0000","last_active":"2024-03-16T07:25:26.799917+0000","last_peered":"2024-03-16T07:25:26.799917+0000","last_clean":"2024-03-16T07:25:26.799917+0000","last_became_active":"2024-03-16T07:25:26.794894+0000","last_became_peered":"2024-03-16T07:25:26.794894+0000","last_unstale":"2024-03-16T07:25:26.799917+0000","last_undegraded":"2024-03-16T07:25:26.799917+0000","last_fullsized":"2024-03-16T07:25:26.799917+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:03:56.402808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-16T07:25:26.763555+0000","last_change":"2024-03-16T07:25:25.773182+0000","last_active":"2024-03-16T07:25:26.763555+0000","last_peered":"2024-03-16T07:25:26.763555+0000","last_clean":"2024-03-16T07:25:26.763555+0000","last_became_active":"2024-03-16T07:25:25.772861+0000","last_became_peered":"2024-03-16T07:25:25.772861+0000","last_unstale":"2024-03-16T07:25:26.763555+0000","last_undegraded":"2024-03-16T07:25:26.763555+0000","last_fullsized":"2024-03-16T07:25:26.763555+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_clean_scrub_stamp":"2024-03-16T07:25:24.745467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:35:13.105887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-16T07:25:26.799919+0000","last_change":"2024-03-16T07:25:26.796631+0000","last_active":"2024-03-16T07:25:26.799919+0000","last_peered":"2024-03-16T07:25:26.799919+0000","last_clean":"2024-03-16T07:25:26.799919+0000","last_became_active":"2024-03-16T07:25:26.795444+0000","last_became_peered":"2024-03-16T07:25:26.795444+0000","last_unstale":"2024-03-16T07:25:26.799919+0000","last_undegraded":"2024-03-16T07:25:26.799919+0000","last_fullsized":"2024-03-16T07:25:26.799919+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:53:30.197560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-16T07:25:26.756073+0000","last_change":"2024-03-16T07:25:25.766122+0000","last_active":"2024-03-16T07:25:26.756073+0000","last_peered":"2024-03-16T07:25:26.756073+0000","last_clean":"2024-03-16T07:25:26.756073+0000","last_became_active":"2024-03-16T07:25:25.765858+0000","last_became_peered":"2024-03-16T07:25:25.765858+0000","last_unstale":"2024-03-16T07:25:26.756073+0000","last_undegraded":"2024-03-16T07:25:26.756073+0000","last_fullsized":"2024-03-16T07:25:26.756073+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_clean_scrub_stamp":"2024-03-16T07:25:24.745467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:31:45.647975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-16T07:25:26.784539+0000","last_change":"2024-03-16T07:25:26.776390+0000","last_active":"2024-03-16T07:25:26.784539+0000","last_peered":"2024-03-16T07:25:26.784539+0000","last_clean":"2024-03-16T07:25:26.784539+0000","last_became_active":"2024-03-16T07:25:26.776048+0000","last_became_peered":"2024-03-16T07:25:26.776048+0000","last_unstale":"2024-03-16T07:25:26.784539+0000","last_undegraded":"2024-03-16T07:25:26.784539+0000","last_fullsized":"2024-03-16T07:25:26.784539+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:56:44.440768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-16T07:25:26.762884+0000","last_change":"2024-03-16T07:25:25.764585+0000","last_active":"2024-03-16T07:25:26.762884+0000","last_peered":"2024-03-16T07:25:26.762884+0000","last_clean":"2024-03-16T07:25:26.762884+0000","last_became_active":"2024-03-16T07:25:25.764145+0000","last_became_peered":"2024-03-16T07:25:25.764145+0000","last_unstale":"2024-03-16T07:25:26.762884+0000","last_undegraded":"2024-03-16T07:25:26.762884+0000","last_fullsized":"2024-03-16T07:25:26.762884+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_clean_scrub_stamp":"2024-03-16T07:25:24.745467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:04:30.099786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-16T07:25:26.799945+0000","last_change":"2024-03-16T07:25:26.797291+0000","last_active":"2024-03-16T07:25:26.799945+0000","last_peered":"2024-03-16T07:25:26.799945+0000","last_clean":"2024-03-16T07:25:26.799945+0000","last_became_active":"2024-03-16T07:25:26.794780+0000","last_became_peered":"2024-03-16T07:25:26.794780+0000","last_unstale":"2024-03-16T07:25:26.799945+0000","last_undegraded":"2024-03-16T07:25:26.799945+0000","last_fullsized":"2024-03-16T07:25:26.799945+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:34:16.025272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-16T07:25:26.754771+0000","last_change":"2024-03-16T07:25:25.770422+0000","last_active":"2024-03-16T07:25:26.754771+0000","last_peered":"2024-03-16T07:25:26.754771+0000","last_clean":"2024-03-16T07:25:26.754771+0000","last_became_active":"2024-03-16T07:25:25.770153+0000","last_became_peered":"2024-03-16T07:25:25.770153+0000","last_unstale":"2024-03-16T07:25:26.754771+0000","last_undegraded":"2024-03-16T07:25:26.754771+0000","last_fullsized":"2024-03-16T07:25:26.754771+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_clean_scrub_stamp":"2024-03-16T07:25:24.745467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:21:53.419532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-03-16T07:25:27.762473+0000","last_change":"2024-03-16T07:25:26.791209+0000","last_active":"2024-03-16T07:25:27.762473+0000","last_peered":"2024-03-16T07:25:27.762473+0000","last_clean":"2024-03-16T07:25:27.762473+0000","last_became_active":"2024-03-16T07:25:26.790886+0000","last_became_peered":"2024-03-16T07:25:26.790886+0000","last_unstale":"2024-03-16T07:25:27.762473+0000","last_undegraded":"2024-03-16T07:25:27.762473+0000","last_fullsized":"2024-03-16T07:25:27.762473+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:13:26.639460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-03-16T07:25:27.763396+0000","last_change":"2024-03-16T07:25:25.769122+0000","last_active":"2024-03-16T07:25:27.763396+0000","last_peered":"2024-03-16T07:25:27.763396+0000","last_clean":"2024-03-16T07:25:27.763396+0000","last_became_active":"2024-03-16T07:25:25.768867+0000","last_became_peered":"2024-03-16T07:25:25.768867+0000","last_unstale":"2024-03-16T07:25:27.763396+0000","last_undegraded":"2024-03-16T07:25:27.763396+0000","last_fullsized":"2024-03-16T07:25:27.763396+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_clean_scrub_stamp":"2024-03-16T07:25:24.745467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:31:27.516098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-16T07:25:26.788716+0000","last_change":"2024-03-16T07:25:26.783268+0000","last_active":"2024-03-16T07:25:26.788716+0000","last_peered":"2024-03-16T07:25:26.788716+0000","last_clean":"2024-03-16T07:25:26.788716+0000","last_became_active":"2024-03-16T07:25:26.782999+0000","last_became_peered":"2024-03-16T07:25:26.782999+0000","last_unstale":"2024-03-16T07:25:26.788716+0000","last_undegraded":"2024-03-16T07:25:26.788716+0000","last_fullsized":"2024-03-16T07:25:26.788716+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:16:07.923318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-16T07:25:26.759089+0000","last_change":"2024-03-16T07:25:25.771801+0000","last_active":"2024-03-16T07:25:26.759089+0000","last_peered":"2024-03-16T07:25:26.759089+0000","last_clean":"2024-03-16T07:25:26.759089+0000","last_became_active":"2024-03-16T07:25:25.771527+0000","last_became_peered":"2024-03-16T07:25:25.771527+0000","last_unstale":"2024-03-16T07:25:26.759089+0000","last_undegraded":"2024-03-16T07:25:26.759089+0000","last_fullsized":"2024-03-16T07:25:26.759089+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_clean_scrub_stamp":"2024-03-16T07:25:24.745467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:58:27.329136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-16T07:25:26.776337+0000","last_change":"2024-03-16T07:25:26.774790+0000","last_active":"2024-03-16T07:25:26.776337+0000","last_peered":"2024-03-16T07:25:26.776337+0000","last_clean":"2024-03-16T07:25:26.776337+0000","last_became_active":"2024-03-16T07:25:26.774186+0000","last_became_peered":"2024-03-16T07:25:26.774186+0000","last_unstale":"2024-03-16T07:25:26.776337+0000","last_undegraded":"2024-03-16T07:25:26.776337+0000","last_fullsized":"2024-03-16T07:25:26.776337+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:15:25.308866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-16T07:25:26.755307+0000","last_change":"2024-03-16T07:25:25.766868+0000","last_active":"2024-03-16T07:25:26.755307+0000","last_peered":"2024-03-16T07:25:26.755307+0000","last_clean":"2024-03-16T07:25:26.755307+0000","last_became_active":"2024-03-16T07:25:25.766116+0000","last_became_peered":"2024-03-16T07:25:25.766116+0000","last_unstale":"2024-03-16T07:25:26.755307+0000","last_undegraded":"2024-03-16T07:25:26.755307+0000","last_fullsized":"2024-03-16T07:25:26.755307+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_clean_scrub_stamp":"2024-03-16T07:25:24.745467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:27:23.414873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'97","reported_seq":167,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-16T07:25:26.753427+0000","last_change":"2024-03-16T07:24:31.650537+0000","last_active":"2024-03-16T07:25:26.753427+0000","last_peered":"2024-03-16T07:25:26.753427+0000","last_clean":"2024-03-16T07:25:26.753427+0000","last_became_active":"2024-03-16T07:24:31.649574+0000","last_became_peered":"2024-03-16T07:24:31.649574+0000","last_unstale":"2024-03-16T07:25:26.753427+0000","last_undegraded":"2024-03-16T07:25:26.753427+0000","last_fullsized":"2024-03-16T07:25:26.753427+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:29.719970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:29.719970+0000","last_clean_scrub_stamp":"2024-03-16T07:24:29.719970+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:31:35.774554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738383,"num_pgs":60,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":31420,"kb_used_data":244,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":104826180,"statfs":{"total":107374182400,"available":107342008320,"internally_reserved":0,"allocated":249856,"data_stored":79803,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738383,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":32020,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":104825580,"statfs":{"total":107374182400,"available":107341393920,"internally_reserved":0,"allocated":864256,"data_stored":672455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738383,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":32012,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":104825588,"statfs":{"total":107374182400,"available":107341402112,"internally_reserved":0,"allocated":851968,"data_stored":672329,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-16T07:25:30.777 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-16T07:25:31.050 INFO:tasks.ceph.mds.e.smithi049.stderr:2024-03-16T07:25:31.052+0000 7fe501dbd640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-03-16T07:25:31.117 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:25:31.118 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2024-03-16T07:25:31.128 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":54,"stamp":"2024-03-16T07:25:30.908046+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":181,"num_write_kb":1908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":135,"ondisk_log_size":135,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":109,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":314572800,"kb_used":95452,"kb_used_data":1920,"kb_used_omap":4,"kb_used_meta":93499,"kb_avail":314477348,"statfs":{"total":322122547200,"available":322024804352,"internally_reserved":0,"allocated":1966080,"data_stored":1424587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":95743311},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000932"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-03-16T07:25:27.762770+0000","last_change":"2024-03-16T07:25:26.778321+0000","last_active":"2024-03-16T07:25:27.762770+0000","last_peered":"2024-03-16T07:25:27.762770+0000","last_clean":"2024-03-16T07:25:27.762770+0000","last_became_active":"2024-03-16T07:25:26.778060+0000","last_became_peered":"2024-03-16T07:25:26.778060+0000","last_unstale":"2024-03-16T07:25:27.762770+0000","last_undegraded":"2024-03-16T07:25:27.762770+0000","last_fullsized":"2024-03-16T07:25:27.762770+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:56:24.824794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-16T07:25:26.799947+0000","last_change":"2024-03-16T07:25:26.797893+0000","last_active":"2024-03-16T07:25:26.799947+0000","last_peered":"2024-03-16T07:25:26.799947+0000","last_clean":"2024-03-16T07:25:26.799947+0000","last_became_active":"2024-03-16T07:25:26.795108+0000","last_became_peered":"2024-03-16T07:25:26.795108+0000","last_unstale":"2024-03-16T07:25:26.799947+0000","last_undegraded":"2024-03-16T07:25:26.799947+0000","last_fullsized":"2024-03-16T07:25:26.799947+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:16:20.453551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-16T07:25:26.781968+0000","last_change":"2024-03-16T07:25:26.779789+0000","last_active":"2024-03-16T07:25:26.781968+0000","last_peered":"2024-03-16T07:25:26.781968+0000","last_clean":"2024-03-16T07:25:26.781968+0000","last_became_active":"2024-03-16T07:25:26.779560+0000","last_became_peered":"2024-03-16T07:25:26.779560+0000","last_unstale":"2024-03-16T07:25:26.781968+0000","last_undegraded":"2024-03-16T07:25:26.781968+0000","last_fullsized":"2024-03-16T07:25:26.781968+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:22:11.503652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-16T07:25:26.784416+0000","last_change":"2024-03-16T07:25:26.782517+0000","last_active":"2024-03-16T07:25:26.784416+0000","last_peered":"2024-03-16T07:25:26.784416+0000","last_clean":"2024-03-16T07:25:26.784416+0000","last_became_active":"2024-03-16T07:25:26.782289+0000","last_became_peered":"2024-03-16T07:25:26.782289+0000","last_unstale":"2024-03-16T07:25:26.784416+0000","last_undegraded":"2024-03-16T07:25:26.784416+0000","last_fullsized":"2024-03-16T07:25:26.784416+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:19:13.645991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-03-16T07:25:27.763009+0000","last_change":"2024-03-16T07:25:26.782881+0000","last_active":"2024-03-16T07:25:27.763009+0000","last_peered":"2024-03-16T07:25:27.763009+0000","last_clean":"2024-03-16T07:25:27.763009+0000","last_became_active":"2024-03-16T07:25:26.782050+0000","last_became_peered":"2024-03-16T07:25:26.782050+0000","last_unstale":"2024-03-16T07:25:27.763009+0000","last_undegraded":"2024-03-16T07:25:27.763009+0000","last_fullsized":"2024-03-16T07:25:27.763009+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:39:12.805004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-16T07:25:26.770300+0000","last_change":"2024-03-16T07:25:26.767484+0000","last_active":"2024-03-16T07:25:26.770300+0000","last_peered":"2024-03-16T07:25:26.770300+0000","last_clean":"2024-03-16T07:25:26.770300+0000","last_became_active":"2024-03-16T07:25:26.766849+0000","last_became_peered":"2024-03-16T07:25:26.766849+0000","last_unstale":"2024-03-16T07:25:26.770300+0000","last_undegraded":"2024-03-16T07:25:26.770300+0000","last_fullsized":"2024-03-16T07:25:26.770300+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:42:57.382624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-03-16T07:25:27.763525+0000","last_change":"2024-03-16T07:25:26.789325+0000","last_active":"2024-03-16T07:25:27.763525+0000","last_peered":"2024-03-16T07:25:27.763525+0000","last_clean":"2024-03-16T07:25:27.763525+0000","last_became_active":"2024-03-16T07:25:26.789018+0000","last_became_peered":"2024-03-16T07:25:26.789018+0000","last_unstale":"2024-03-16T07:25:27.763525+0000","last_undegraded":"2024-03-16T07:25:27.763525+0000","last_fullsized":"2024-03-16T07:25:27.763525+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:25:48.897323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-03-16T07:25:27.762068+0000","last_change":"2024-03-16T07:25:26.791413+0000","last_active":"2024-03-16T07:25:27.762068+0000","last_peered":"2024-03-16T07:25:27.762068+0000","last_clean":"2024-03-16T07:25:27.762068+0000","last_became_active":"2024-03-16T07:25:26.790271+0000","last_became_peered":"2024-03-16T07:25:26.790271+0000","last_unstale":"2024-03-16T07:25:27.762068+0000","last_undegraded":"2024-03-16T07:25:27.762068+0000","last_fullsized":"2024-03-16T07:25:27.762068+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:00:23.249950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-16T07:25:26.797060+0000","last_change":"2024-03-16T07:25:26.793226+0000","last_active":"2024-03-16T07:25:26.797060+0000","last_peered":"2024-03-16T07:25:26.797060+0000","last_clean":"2024-03-16T07:25:26.797060+0000","last_became_active":"2024-03-16T07:25:26.792996+0000","last_became_peered":"2024-03-16T07:25:26.792996+0000","last_unstale":"2024-03-16T07:25:26.797060+0000","last_undegraded":"2024-03-16T07:25:26.797060+0000","last_fullsized":"2024-03-16T07:25:26.797060+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:26:17.093512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-16T07:25:26.797130+0000","last_change":"2024-03-16T07:25:26.793964+0000","last_active":"2024-03-16T07:25:26.797130+0000","last_peered":"2024-03-16T07:25:26.797130+0000","last_clean":"2024-03-16T07:25:26.797130+0000","last_became_active":"2024-03-16T07:25:26.793713+0000","last_became_peered":"2024-03-16T07:25:26.793713+0000","last_unstale":"2024-03-16T07:25:26.797130+0000","last_undegraded":"2024-03-16T07:25:26.797130+0000","last_fullsized":"2024-03-16T07:25:26.797130+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:47:16.548086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-16T07:25:26.800014+0000","last_change":"2024-03-16T07:25:26.796897+0000","last_active":"2024-03-16T07:25:26.800014+0000","last_peered":"2024-03-16T07:25:26.800014+0000","last_clean":"2024-03-16T07:25:26.800014+0000","last_became_active":"2024-03-16T07:25:26.795947+0000","last_became_peered":"2024-03-16T07:25:26.795947+0000","last_unstale":"2024-03-16T07:25:26.800014+0000","last_undegraded":"2024-03-16T07:25:26.800014+0000","last_fullsized":"2024-03-16T07:25:26.800014+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:13:14.226330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-16T07:25:26.783460+0000","last_change":"2024-03-16T07:25:26.781727+0000","last_active":"2024-03-16T07:25:26.783460+0000","last_peered":"2024-03-16T07:25:26.783460+0000","last_clean":"2024-03-16T07:25:26.783460+0000","last_became_active":"2024-03-16T07:25:26.781481+0000","last_became_peered":"2024-03-16T07:25:26.781481+0000","last_unstale":"2024-03-16T07:25:26.783460+0000","last_undegraded":"2024-03-16T07:25:26.783460+0000","last_fullsized":"2024-03-16T07:25:26.783460+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:12:51.075847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-03-16T07:25:27.762185+0000","last_change":"2024-03-16T07:25:26.790704+0000","last_active":"2024-03-16T07:25:27.762185+0000","last_peered":"2024-03-16T07:25:27.762185+0000","last_clean":"2024-03-16T07:25:27.762185+0000","last_became_active":"2024-03-16T07:25:26.790439+0000","last_became_peered":"2024-03-16T07:25:26.790439+0000","last_unstale":"2024-03-16T07:25:27.762185+0000","last_undegraded":"2024-03-16T07:25:27.762185+0000","last_fullsized":"2024-03-16T07:25:27.762185+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:26:17.093512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-16T07:25:26.784520+0000","last_change":"2024-03-16T07:25:26.776183+0000","last_active":"2024-03-16T07:25:26.784520+0000","last_peered":"2024-03-16T07:25:26.784520+0000","last_clean":"2024-03-16T07:25:26.784520+0000","last_became_active":"2024-03-16T07:25:26.775565+0000","last_became_peered":"2024-03-16T07:25:26.775565+0000","last_unstale":"2024-03-16T07:25:26.784520+0000","last_undegraded":"2024-03-16T07:25:26.784520+0000","last_fullsized":"2024-03-16T07:25:26.784520+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:52:53.885034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-16T07:25:26.775919+0000","last_change":"2024-03-16T07:25:26.773093+0000","last_active":"2024-03-16T07:25:26.775919+0000","last_peered":"2024-03-16T07:25:26.775919+0000","last_clean":"2024-03-16T07:25:26.775919+0000","last_became_active":"2024-03-16T07:25:26.772835+0000","last_became_peered":"2024-03-16T07:25:26.772835+0000","last_unstale":"2024-03-16T07:25:26.775919+0000","last_undegraded":"2024-03-16T07:25:26.775919+0000","last_fullsized":"2024-03-16T07:25:26.775919+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:52:53.752332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-16T07:25:26.776072+0000","last_change":"2024-03-16T07:25:26.773366+0000","last_active":"2024-03-16T07:25:26.776072+0000","last_peered":"2024-03-16T07:25:26.776072+0000","last_clean":"2024-03-16T07:25:26.776072+0000","last_became_active":"2024-03-16T07:25:26.773118+0000","last_became_peered":"2024-03-16T07:25:26.773118+0000","last_unstale":"2024-03-16T07:25:26.776072+0000","last_undegraded":"2024-03-16T07:25:26.776072+0000","last_fullsized":"2024-03-16T07:25:26.776072+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:44:15.933653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-16T07:25:26.781302+0000","last_change":"2024-03-16T07:25:26.775670+0000","last_active":"2024-03-16T07:25:26.781302+0000","last_peered":"2024-03-16T07:25:26.781302+0000","last_clean":"2024-03-16T07:25:26.781302+0000","last_became_active":"2024-03-16T07:25:26.775387+0000","last_became_peered":"2024-03-16T07:25:26.775387+0000","last_unstale":"2024-03-16T07:25:26.781302+0000","last_undegraded":"2024-03-16T07:25:26.781302+0000","last_fullsized":"2024-03-16T07:25:26.781302+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:39:12.805004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-16T07:25:26.799929+0000","last_change":"2024-03-16T07:25:26.797761+0000","last_active":"2024-03-16T07:25:26.799929+0000","last_peered":"2024-03-16T07:25:26.799929+0000","last_clean":"2024-03-16T07:25:26.799929+0000","last_became_active":"2024-03-16T07:25:26.796108+0000","last_became_peered":"2024-03-16T07:25:26.796108+0000","last_unstale":"2024-03-16T07:25:26.799929+0000","last_undegraded":"2024-03-16T07:25:26.799929+0000","last_fullsized":"2024-03-16T07:25:26.799929+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:51:32.782998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-16T07:25:26.799995+0000","last_change":"2024-03-16T07:25:26.796633+0000","last_active":"2024-03-16T07:25:26.799995+0000","last_peered":"2024-03-16T07:25:26.799995+0000","last_clean":"2024-03-16T07:25:26.799995+0000","last_became_active":"2024-03-16T07:25:26.795891+0000","last_became_peered":"2024-03-16T07:25:26.795891+0000","last_unstale":"2024-03-16T07:25:26.799995+0000","last_undegraded":"2024-03-16T07:25:26.799995+0000","last_fullsized":"2024-03-16T07:25:26.799995+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:16:18.923166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-03-16T07:25:27.763702+0000","last_change":"2024-03-16T07:25:26.782390+0000","last_active":"2024-03-16T07:25:27.763702+0000","last_peered":"2024-03-16T07:25:27.763702+0000","last_clean":"2024-03-16T07:25:27.763702+0000","last_became_active":"2024-03-16T07:25:26.781829+0000","last_became_peered":"2024-03-16T07:25:26.781829+0000","last_unstale":"2024-03-16T07:25:27.763702+0000","last_undegraded":"2024-03-16T07:25:27.763702+0000","last_fullsized":"2024-03-16T07:25:27.763702+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:53:30.197560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-16T07:25:26.784942+0000","last_change":"2024-03-16T07:25:26.781114+0000","last_active":"2024-03-16T07:25:26.784942+0000","last_peered":"2024-03-16T07:25:26.784942+0000","last_clean":"2024-03-16T07:25:26.784942+0000","last_became_active":"2024-03-16T07:25:26.780863+0000","last_became_peered":"2024-03-16T07:25:26.780863+0000","last_unstale":"2024-03-16T07:25:26.784942+0000","last_undegraded":"2024-03-16T07:25:26.784942+0000","last_fullsized":"2024-03-16T07:25:26.784942+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:39:17.634888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-03-16T07:25:27.763719+0000","last_change":"2024-03-16T07:25:26.780517+0000","last_active":"2024-03-16T07:25:27.763719+0000","last_peered":"2024-03-16T07:25:27.763719+0000","last_clean":"2024-03-16T07:25:27.763719+0000","last_became_active":"2024-03-16T07:25:26.779906+0000","last_became_peered":"2024-03-16T07:25:26.779906+0000","last_unstale":"2024-03-16T07:25:27.763719+0000","last_undegraded":"2024-03-16T07:25:27.763719+0000","last_fullsized":"2024-03-16T07:25:27.763719+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:16:18.923166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-16T07:25:26.799880+0000","last_change":"2024-03-16T07:25:26.797082+0000","last_active":"2024-03-16T07:25:26.799880+0000","last_peered":"2024-03-16T07:25:26.799880+0000","last_clean":"2024-03-16T07:25:26.799880+0000","last_became_active":"2024-03-16T07:25:26.794623+0000","last_became_peered":"2024-03-16T07:25:26.794623+0000","last_unstale":"2024-03-16T07:25:26.799880+0000","last_undegraded":"2024-03-16T07:25:26.799880+0000","last_fullsized":"2024-03-16T07:25:26.799880+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:47:18.096711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-03-16T07:25:27.762141+0000","last_change":"2024-03-16T07:25:26.788304+0000","last_active":"2024-03-16T07:25:27.762141+0000","last_peered":"2024-03-16T07:25:27.762141+0000","last_clean":"2024-03-16T07:25:27.762141+0000","last_became_active":"2024-03-16T07:25:26.787434+0000","last_became_peered":"2024-03-16T07:25:26.787434+0000","last_unstale":"2024-03-16T07:25:27.762141+0000","last_undegraded":"2024-03-16T07:25:27.762141+0000","last_fullsized":"2024-03-16T07:25:27.762141+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:35:14.107259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-16T07:25:26.793921+0000","last_change":"2024-03-16T07:25:26.792087+0000","last_active":"2024-03-16T07:25:26.793921+0000","last_peered":"2024-03-16T07:25:26.793921+0000","last_clean":"2024-03-16T07:25:26.793921+0000","last_became_active":"2024-03-16T07:25:26.791866+0000","last_became_peered":"2024-03-16T07:25:26.791866+0000","last_unstale":"2024-03-16T07:25:26.793921+0000","last_undegraded":"2024-03-16T07:25:26.793921+0000","last_fullsized":"2024-03-16T07:25:26.793921+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:00:23.249950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-16T07:25:26.789075+0000","last_change":"2024-03-16T07:25:26.784187+0000","last_active":"2024-03-16T07:25:26.789075+0000","last_peered":"2024-03-16T07:25:26.789075+0000","last_clean":"2024-03-16T07:25:26.789075+0000","last_became_active":"2024-03-16T07:25:26.783915+0000","last_became_peered":"2024-03-16T07:25:26.783915+0000","last_unstale":"2024-03-16T07:25:26.789075+0000","last_undegraded":"2024-03-16T07:25:26.789075+0000","last_fullsized":"2024-03-16T07:25:26.789075+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:29:40.433127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-16T07:25:26.791547+0000","last_change":"2024-03-16T07:25:26.791013+0000","last_active":"2024-03-16T07:25:26.791547+0000","last_peered":"2024-03-16T07:25:26.791547+0000","last_clean":"2024-03-16T07:25:26.791547+0000","last_became_active":"2024-03-16T07:25:26.790781+0000","last_became_peered":"2024-03-16T07:25:26.790781+0000","last_unstale":"2024-03-16T07:25:26.791547+0000","last_undegraded":"2024-03-16T07:25:26.791547+0000","last_fullsized":"2024-03-16T07:25:26.791547+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:04:31.101158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-03-16T07:25:27.763801+0000","last_change":"2024-03-16T07:25:26.782081+0000","last_active":"2024-03-16T07:25:27.763801+0000","last_peered":"2024-03-16T07:25:27.763801+0000","last_clean":"2024-03-16T07:25:27.763801+0000","last_became_active":"2024-03-16T07:25:26.781123+0000","last_became_peered":"2024-03-16T07:25:26.781123+0000","last_unstale":"2024-03-16T07:25:27.763801+0000","last_undegraded":"2024-03-16T07:25:27.763801+0000","last_fullsized":"2024-03-16T07:25:27.763801+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:47:18.096711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-16T07:25:26.799963+0000","last_change":"2024-03-16T07:25:26.798086+0000","last_active":"2024-03-16T07:25:26.799963+0000","last_peered":"2024-03-16T07:25:26.799963+0000","last_clean":"2024-03-16T07:25:26.799963+0000","last_became_active":"2024-03-16T07:25:26.795175+0000","last_became_peered":"2024-03-16T07:25:26.795175+0000","last_unstale":"2024-03-16T07:25:26.799963+0000","last_undegraded":"2024-03-16T07:25:26.799963+0000","last_fullsized":"2024-03-16T07:25:26.799963+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:36:58.986457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-16T07:25:26.784498+0000","last_change":"2024-03-16T07:25:26.775812+0000","last_active":"2024-03-16T07:25:26.784498+0000","last_peered":"2024-03-16T07:25:26.784498+0000","last_clean":"2024-03-16T07:25:26.784498+0000","last_became_active":"2024-03-16T07:25:26.775250+0000","last_became_peered":"2024-03-16T07:25:26.775250+0000","last_unstale":"2024-03-16T07:25:26.784498+0000","last_undegraded":"2024-03-16T07:25:26.784498+0000","last_fullsized":"2024-03-16T07:25:26.784498+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:36:38.284510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-03-16T07:25:27.763307+0000","last_change":"2024-03-16T07:25:26.779663+0000","last_active":"2024-03-16T07:25:27.763307+0000","last_peered":"2024-03-16T07:25:27.763307+0000","last_clean":"2024-03-16T07:25:27.763307+0000","last_became_active":"2024-03-16T07:25:26.779395+0000","last_became_peered":"2024-03-16T07:25:26.779395+0000","last_unstale":"2024-03-16T07:25:27.763307+0000","last_undegraded":"2024-03-16T07:25:27.763307+0000","last_fullsized":"2024-03-16T07:25:27.763307+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:39:17.634888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-03-16T07:25:27.762223+0000","last_change":"2024-03-16T07:25:26.788490+0000","last_active":"2024-03-16T07:25:27.762223+0000","last_peered":"2024-03-16T07:25:27.762223+0000","last_clean":"2024-03-16T07:25:27.762223+0000","last_became_active":"2024-03-16T07:25:26.787773+0000","last_became_peered":"2024-03-16T07:25:26.787773+0000","last_unstale":"2024-03-16T07:25:27.762223+0000","last_undegraded":"2024-03-16T07:25:27.762223+0000","last_fullsized":"2024-03-16T07:25:27.762223+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:47:16.548086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-16T07:25:26.776376+0000","last_change":"2024-03-16T07:25:26.774904+0000","last_active":"2024-03-16T07:25:26.776376+0000","last_peered":"2024-03-16T07:25:26.776376+0000","last_clean":"2024-03-16T07:25:26.776376+0000","last_became_active":"2024-03-16T07:25:26.774655+0000","last_became_peered":"2024-03-16T07:25:26.774655+0000","last_unstale":"2024-03-16T07:25:26.776376+0000","last_undegraded":"2024-03-16T07:25:26.776376+0000","last_fullsized":"2024-03-16T07:25:26.776376+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:56:24.824794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"27'4","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-16T07:25:26.797552+0000","last_change":"2024-03-16T07:25:25.774269+0000","last_active":"2024-03-16T07:25:26.797552+0000","last_peered":"2024-03-16T07:25:26.797552+0000","last_clean":"2024-03-16T07:25:26.797552+0000","last_became_active":"2024-03-16T07:25:25.774016+0000","last_became_peered":"2024-03-16T07:25:25.774016+0000","last_unstale":"2024-03-16T07:25:26.797552+0000","last_undegraded":"2024-03-16T07:25:26.797552+0000","last_fullsized":"2024-03-16T07:25:26.797552+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_clean_scrub_stamp":"2024-03-16T07:25:24.745467+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:24:12.540520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-03-16T07:25:27.763010+0000","last_change":"2024-03-16T07:25:26.787749+0000","last_active":"2024-03-16T07:25:27.763010+0000","last_peered":"2024-03-16T07:25:27.763010+0000","last_clean":"2024-03-16T07:25:27.763010+0000","last_became_active":"2024-03-16T07:25:26.787465+0000","last_became_peered":"2024-03-16T07:25:26.787465+0000","last_unstale":"2024-03-16T07:25:27.763010+0000","last_undegraded":"2024-03-16T07:25:27.763010+0000","last_fullsized":"2024-03-16T07:25:27.763010+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:36:38.284510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"27'1","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-16T07:25:26.796326+0000","last_change":"2024-03-16T07:25:25.771867+0000","last_active":"2024-03-16T07:25:26.796326+0000","last_peered":"2024-03-16T07:25:26.796326+0000","last_clean":"2024-03-16T07:25:26.796326+0000","last_became_active":"2024-03-16T07:25:25.771573+0000","last_became_peered":"2024-03-16T07:25:25.771573+0000","last_unstale":"2024-03-16T07:25:26.796326+0000","last_undegraded":"2024-03-16T07:25:26.796326+0000","last_fullsized":"2024-03-16T07:25:26.796326+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_clean_scrub_stamp":"2024-03-16T07:25:24.745467+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:30:31.592675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-03-16T07:25:27.763849+0000","last_change":"2024-03-16T07:25:26.782505+0000","last_active":"2024-03-16T07:25:27.763849+0000","last_peered":"2024-03-16T07:25:27.763849+0000","last_clean":"2024-03-16T07:25:27.763849+0000","last_became_active":"2024-03-16T07:25:26.781458+0000","last_became_peered":"2024-03-16T07:25:26.781458+0000","last_unstale":"2024-03-16T07:25:27.763849+0000","last_undegraded":"2024-03-16T07:25:27.763849+0000","last_fullsized":"2024-03-16T07:25:27.763849+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:34:16.025272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"27'2","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-16T07:25:26.796129+0000","last_change":"2024-03-16T07:25:25.773676+0000","last_active":"2024-03-16T07:25:26.796129+0000","last_peered":"2024-03-16T07:25:26.796129+0000","last_clean":"2024-03-16T07:25:26.796129+0000","last_became_active":"2024-03-16T07:25:25.773426+0000","last_became_peered":"2024-03-16T07:25:25.773426+0000","last_unstale":"2024-03-16T07:25:26.796129+0000","last_undegraded":"2024-03-16T07:25:26.796129+0000","last_fullsized":"2024-03-16T07:25:26.796129+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_clean_scrub_stamp":"2024-03-16T07:25:24.745467+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:26:16.092140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-16T07:25:26.791562+0000","last_change":"2024-03-16T07:25:26.790198+0000","last_active":"2024-03-16T07:25:26.791562+0000","last_peered":"2024-03-16T07:25:26.791562+0000","last_clean":"2024-03-16T07:25:26.791562+0000","last_became_active":"2024-03-16T07:25:26.789918+0000","last_became_peered":"2024-03-16T07:25:26.789918+0000","last_unstale":"2024-03-16T07:25:26.791562+0000","last_undegraded":"2024-03-16T07:25:26.791562+0000","last_fullsized":"2024-03-16T07:25:26.791562+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:30:32.594047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"27'2","reported_seq":16,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-03-16T07:25:27.763950+0000","last_change":"2024-03-16T07:25:25.776429+0000","last_active":"2024-03-16T07:25:27.763950+0000","last_peered":"2024-03-16T07:25:27.763950+0000","last_clean":"2024-03-16T07:25:27.763950+0000","last_became_active":"2024-03-16T07:25:25.776189+0000","last_became_peered":"2024-03-16T07:25:25.776189+0000","last_unstale":"2024-03-16T07:25:27.763950+0000","last_undegraded":"2024-03-16T07:25:27.763950+0000","last_fullsized":"2024-03-16T07:25:27.763950+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_clean_scrub_stamp":"2024-03-16T07:25:24.745467+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:56:07.751589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-16T07:25:26.789619+0000","last_change":"2024-03-16T07:25:26.788243+0000","last_active":"2024-03-16T07:25:26.789619+0000","last_peered":"2024-03-16T07:25:26.789619+0000","last_clean":"2024-03-16T07:25:26.789619+0000","last_became_active":"2024-03-16T07:25:26.787967+0000","last_became_peered":"2024-03-16T07:25:26.787967+0000","last_unstale":"2024-03-16T07:25:26.789619+0000","last_undegraded":"2024-03-16T07:25:26.789619+0000","last_fullsized":"2024-03-16T07:25:26.789619+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:07:30.175119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"27'1","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-03-16T07:25:27.762862+0000","last_change":"2024-03-16T07:25:25.777040+0000","last_active":"2024-03-16T07:25:27.762862+0000","last_peered":"2024-03-16T07:25:27.762862+0000","last_clean":"2024-03-16T07:25:27.762862+0000","last_became_active":"2024-03-16T07:25:25.776802+0000","last_became_peered":"2024-03-16T07:25:25.776802+0000","last_unstale":"2024-03-16T07:25:27.762862+0000","last_undegraded":"2024-03-16T07:25:27.762862+0000","last_fullsized":"2024-03-16T07:25:27.762862+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_clean_scrub_stamp":"2024-03-16T07:25:24.745467+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:23:21.193828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-03-16T07:25:27.762477+0000","last_change":"2024-03-16T07:25:26.783520+0000","last_active":"2024-03-16T07:25:27.762477+0000","last_peered":"2024-03-16T07:25:27.762477+0000","last_clean":"2024-03-16T07:25:27.762477+0000","last_became_active":"2024-03-16T07:25:26.782402+0000","last_became_peered":"2024-03-16T07:25:26.782402+0000","last_unstale":"2024-03-16T07:25:27.762477+0000","last_undegraded":"2024-03-16T07:25:27.762477+0000","last_fullsized":"2024-03-16T07:25:27.762477+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:52:53.752332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"27'1","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-03-16T07:25:27.763902+0000","last_change":"2024-03-16T07:25:25.769228+0000","last_active":"2024-03-16T07:25:27.763902+0000","last_peered":"2024-03-16T07:25:27.763902+0000","last_clean":"2024-03-16T07:25:27.763902+0000","last_became_active":"2024-03-16T07:25:25.768968+0000","last_became_peered":"2024-03-16T07:25:25.768968+0000","last_unstale":"2024-03-16T07:25:27.763902+0000","last_undegraded":"2024-03-16T07:25:27.763902+0000","last_fullsized":"2024-03-16T07:25:27.763902+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_clean_scrub_stamp":"2024-03-16T07:25:24.745467+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:51:25.934804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-16T07:25:26.782011+0000","last_change":"2024-03-16T07:25:26.779275+0000","last_active":"2024-03-16T07:25:26.782011+0000","last_peered":"2024-03-16T07:25:26.782011+0000","last_clean":"2024-03-16T07:25:26.782011+0000","last_became_active":"2024-03-16T07:25:26.779010+0000","last_became_peered":"2024-03-16T07:25:26.779010+0000","last_unstale":"2024-03-16T07:25:26.782011+0000","last_undegraded":"2024-03-16T07:25:26.782011+0000","last_fullsized":"2024-03-16T07:25:26.782011+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:58:20.759128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-16T07:25:26.763175+0000","last_change":"2024-03-16T07:25:25.765015+0000","last_active":"2024-03-16T07:25:26.763175+0000","last_peered":"2024-03-16T07:25:26.763175+0000","last_clean":"2024-03-16T07:25:26.763175+0000","last_became_active":"2024-03-16T07:25:25.764293+0000","last_became_peered":"2024-03-16T07:25:25.764293+0000","last_unstale":"2024-03-16T07:25:26.763175+0000","last_undegraded":"2024-03-16T07:25:26.763175+0000","last_fullsized":"2024-03-16T07:25:26.763175+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_clean_scrub_stamp":"2024-03-16T07:25:24.745467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:56:32.782012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-16T07:25:26.781731+0000","last_change":"2024-03-16T07:25:26.779863+0000","last_active":"2024-03-16T07:25:26.781731+0000","last_peered":"2024-03-16T07:25:26.781731+0000","last_clean":"2024-03-16T07:25:26.781731+0000","last_became_active":"2024-03-16T07:25:26.779362+0000","last_became_peered":"2024-03-16T07:25:26.779362+0000","last_unstale":"2024-03-16T07:25:26.781731+0000","last_undegraded":"2024-03-16T07:25:26.781731+0000","last_fullsized":"2024-03-16T07:25:26.781731+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:02:27.035138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-03-16T07:25:27.762549+0000","last_change":"2024-03-16T07:25:25.777178+0000","last_active":"2024-03-16T07:25:27.762549+0000","last_peered":"2024-03-16T07:25:27.762549+0000","last_clean":"2024-03-16T07:25:27.762549+0000","last_became_active":"2024-03-16T07:25:25.776915+0000","last_became_peered":"2024-03-16T07:25:25.776915+0000","last_unstale":"2024-03-16T07:25:27.762549+0000","last_undegraded":"2024-03-16T07:25:27.762549+0000","last_fullsized":"2024-03-16T07:25:27.762549+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_clean_scrub_stamp":"2024-03-16T07:25:24.745467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:46:35.716476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-16T07:25:26.787344+0000","last_change":"2024-03-16T07:25:26.783155+0000","last_active":"2024-03-16T07:25:26.787344+0000","last_peered":"2024-03-16T07:25:26.787344+0000","last_clean":"2024-03-16T07:25:26.787344+0000","last_became_active":"2024-03-16T07:25:26.782902+0000","last_became_peered":"2024-03-16T07:25:26.782902+0000","last_unstale":"2024-03-16T07:25:26.787344+0000","last_undegraded":"2024-03-16T07:25:26.787344+0000","last_fullsized":"2024-03-16T07:25:26.787344+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:43:22.848966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-16T07:25:26.765628+0000","last_change":"2024-03-16T07:25:25.772980+0000","last_active":"2024-03-16T07:25:26.765628+0000","last_peered":"2024-03-16T07:25:26.765628+0000","last_clean":"2024-03-16T07:25:26.765628+0000","last_became_active":"2024-03-16T07:25:25.772547+0000","last_became_peered":"2024-03-16T07:25:25.772547+0000","last_unstale":"2024-03-16T07:25:26.765628+0000","last_undegraded":"2024-03-16T07:25:26.765628+0000","last_fullsized":"2024-03-16T07:25:26.765628+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_clean_scrub_stamp":"2024-03-16T07:25:24.745467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:56:24.076896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-03-16T07:25:27.763202+0000","last_change":"2024-03-16T07:25:26.788379+0000","last_active":"2024-03-16T07:25:27.763202+0000","last_peered":"2024-03-16T07:25:27.763202+0000","last_clean":"2024-03-16T07:25:27.763202+0000","last_became_active":"2024-03-16T07:25:26.788113+0000","last_became_peered":"2024-03-16T07:25:26.788113+0000","last_unstale":"2024-03-16T07:25:27.763202+0000","last_undegraded":"2024-03-16T07:25:27.763202+0000","last_fullsized":"2024-03-16T07:25:27.763202+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:56:44.440768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-16T07:25:26.763379+0000","last_change":"2024-03-16T07:25:25.766665+0000","last_active":"2024-03-16T07:25:26.763379+0000","last_peered":"2024-03-16T07:25:26.763379+0000","last_clean":"2024-03-16T07:25:26.763379+0000","last_became_active":"2024-03-16T07:25:25.765031+0000","last_became_peered":"2024-03-16T07:25:25.765031+0000","last_unstale":"2024-03-16T07:25:26.763379+0000","last_undegraded":"2024-03-16T07:25:26.763379+0000","last_fullsized":"2024-03-16T07:25:26.763379+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_clean_scrub_stamp":"2024-03-16T07:25:24.745467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:00:22.248577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-16T07:25:26.776355+0000","last_change":"2024-03-16T07:25:26.774990+0000","last_active":"2024-03-16T07:25:26.776355+0000","last_peered":"2024-03-16T07:25:26.776355+0000","last_clean":"2024-03-16T07:25:26.776355+0000","last_became_active":"2024-03-16T07:25:26.774538+0000","last_became_peered":"2024-03-16T07:25:26.774538+0000","last_unstale":"2024-03-16T07:25:26.776355+0000","last_undegraded":"2024-03-16T07:25:26.776355+0000","last_fullsized":"2024-03-16T07:25:26.776355+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:50:36.836140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"27'3","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-16T07:25:26.796164+0000","last_change":"2024-03-16T07:25:25.772575+0000","last_active":"2024-03-16T07:25:26.796164+0000","last_peered":"2024-03-16T07:25:26.796164+0000","last_clean":"2024-03-16T07:25:26.796164+0000","last_became_active":"2024-03-16T07:25:25.771846+0000","last_became_peered":"2024-03-16T07:25:25.771846+0000","last_unstale":"2024-03-16T07:25:26.796164+0000","last_undegraded":"2024-03-16T07:25:26.796164+0000","last_fullsized":"2024-03-16T07:25:26.796164+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_clean_scrub_stamp":"2024-03-16T07:25:24.745467+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:47:15.546713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-16T07:25:26.799899+0000","last_change":"2024-03-16T07:25:26.796428+0000","last_active":"2024-03-16T07:25:26.799899+0000","last_peered":"2024-03-16T07:25:26.799899+0000","last_clean":"2024-03-16T07:25:26.799899+0000","last_became_active":"2024-03-16T07:25:26.795282+0000","last_became_peered":"2024-03-16T07:25:26.795282+0000","last_unstale":"2024-03-16T07:25:26.799899+0000","last_undegraded":"2024-03-16T07:25:26.799899+0000","last_fullsized":"2024-03-16T07:25:26.799899+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:25:48.897323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"27'6","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-16T07:25:26.801999+0000","last_change":"2024-03-16T07:25:25.770852+0000","last_active":"2024-03-16T07:25:26.801999+0000","last_peered":"2024-03-16T07:25:26.801999+0000","last_clean":"2024-03-16T07:25:26.801999+0000","last_became_active":"2024-03-16T07:25:25.770506+0000","last_became_peered":"2024-03-16T07:25:25.770506+0000","last_unstale":"2024-03-16T07:25:26.801999+0000","last_undegraded":"2024-03-16T07:25:26.801999+0000","last_fullsized":"2024-03-16T07:25:26.801999+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_clean_scrub_stamp":"2024-03-16T07:25:24.745467+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:28:55.817930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-16T07:25:26.769527+0000","last_change":"2024-03-16T07:25:26.767088+0000","last_active":"2024-03-16T07:25:26.769527+0000","last_peered":"2024-03-16T07:25:26.769527+0000","last_clean":"2024-03-16T07:25:26.769527+0000","last_became_active":"2024-03-16T07:25:26.766517+0000","last_became_peered":"2024-03-16T07:25:26.766517+0000","last_unstale":"2024-03-16T07:25:26.769527+0000","last_undegraded":"2024-03-16T07:25:26.769527+0000","last_fullsized":"2024-03-16T07:25:26.769527+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:27:42.795734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"27'2","reported_seq":16,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-03-16T07:25:27.763116+0000","last_change":"2024-03-16T07:25:25.777623+0000","last_active":"2024-03-16T07:25:27.763116+0000","last_peered":"2024-03-16T07:25:27.763116+0000","last_clean":"2024-03-16T07:25:27.763116+0000","last_became_active":"2024-03-16T07:25:25.776995+0000","last_became_peered":"2024-03-16T07:25:25.776995+0000","last_unstale":"2024-03-16T07:25:27.763116+0000","last_undegraded":"2024-03-16T07:25:27.763116+0000","last_fullsized":"2024-03-16T07:25:27.763116+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_clean_scrub_stamp":"2024-03-16T07:25:24.745467+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:51:34.836861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-16T07:25:26.793960+0000","last_change":"2024-03-16T07:25:26.791462+0000","last_active":"2024-03-16T07:25:26.793960+0000","last_peered":"2024-03-16T07:25:26.793960+0000","last_clean":"2024-03-16T07:25:26.793960+0000","last_became_active":"2024-03-16T07:25:26.791154+0000","last_became_peered":"2024-03-16T07:25:26.791154+0000","last_unstale":"2024-03-16T07:25:26.793960+0000","last_undegraded":"2024-03-16T07:25:26.793960+0000","last_fullsized":"2024-03-16T07:25:26.793960+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:56:33.783384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-16T07:25:26.754601+0000","last_change":"2024-03-16T07:25:25.766436+0000","last_active":"2024-03-16T07:25:26.754601+0000","last_peered":"2024-03-16T07:25:26.754601+0000","last_clean":"2024-03-16T07:25:26.754601+0000","last_became_active":"2024-03-16T07:25:25.766215+0000","last_became_peered":"2024-03-16T07:25:25.766215+0000","last_unstale":"2024-03-16T07:25:26.754601+0000","last_undegraded":"2024-03-16T07:25:26.754601+0000","last_fullsized":"2024-03-16T07:25:26.754601+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_clean_scrub_stamp":"2024-03-16T07:25:24.745467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:51:34.836861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-03-16T07:25:27.762307+0000","last_change":"2024-03-16T07:25:26.788681+0000","last_active":"2024-03-16T07:25:27.762307+0000","last_peered":"2024-03-16T07:25:27.762307+0000","last_clean":"2024-03-16T07:25:27.762307+0000","last_became_active":"2024-03-16T07:25:26.788069+0000","last_became_peered":"2024-03-16T07:25:26.788069+0000","last_unstale":"2024-03-16T07:25:27.762307+0000","last_undegraded":"2024-03-16T07:25:27.762307+0000","last_fullsized":"2024-03-16T07:25:27.762307+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:56:25.078268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-03-16T07:25:27.763646+0000","last_change":"2024-03-16T07:25:25.767424+0000","last_active":"2024-03-16T07:25:27.763646+0000","last_peered":"2024-03-16T07:25:27.763646+0000","last_clean":"2024-03-16T07:25:27.763646+0000","last_became_active":"2024-03-16T07:25:25.767167+0000","last_became_peered":"2024-03-16T07:25:25.767167+0000","last_unstale":"2024-03-16T07:25:27.763646+0000","last_undegraded":"2024-03-16T07:25:27.763646+0000","last_fullsized":"2024-03-16T07:25:27.763646+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_clean_scrub_stamp":"2024-03-16T07:25:24.745467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:55:08.055595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-16T07:25:26.779921+0000","last_change":"2024-03-16T07:25:26.778809+0000","last_active":"2024-03-16T07:25:26.779921+0000","last_peered":"2024-03-16T07:25:26.779921+0000","last_clean":"2024-03-16T07:25:26.779921+0000","last_became_active":"2024-03-16T07:25:26.778552+0000","last_became_peered":"2024-03-16T07:25:26.778552+0000","last_unstale":"2024-03-16T07:25:26.779921+0000","last_undegraded":"2024-03-16T07:25:26.779921+0000","last_fullsized":"2024-03-16T07:25:26.779921+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:28:05.097218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"27'8","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-16T07:25:26.800764+0000","last_change":"2024-03-16T07:25:25.770830+0000","last_active":"2024-03-16T07:25:26.800764+0000","last_peered":"2024-03-16T07:25:26.800764+0000","last_clean":"2024-03-16T07:25:26.800764+0000","last_became_active":"2024-03-16T07:25:25.770533+0000","last_became_peered":"2024-03-16T07:25:25.770533+0000","last_unstale":"2024-03-16T07:25:26.800764+0000","last_undegraded":"2024-03-16T07:25:26.800764+0000","last_fullsized":"2024-03-16T07:25:26.800764+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_clean_scrub_stamp":"2024-03-16T07:25:24.745467+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:12:18.043604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-03-16T07:25:27.762899+0000","last_change":"2024-03-16T07:25:26.783403+0000","last_active":"2024-03-16T07:25:27.762899+0000","last_peered":"2024-03-16T07:25:27.762899+0000","last_clean":"2024-03-16T07:25:27.762899+0000","last_became_active":"2024-03-16T07:25:26.782811+0000","last_became_peered":"2024-03-16T07:25:26.782811+0000","last_unstale":"2024-03-16T07:25:27.762899+0000","last_undegraded":"2024-03-16T07:25:27.762899+0000","last_fullsized":"2024-03-16T07:25:27.762899+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:50:36.836140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"27'1","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-16T07:25:26.799459+0000","last_change":"2024-03-16T07:25:25.768264+0000","last_active":"2024-03-16T07:25:26.799459+0000","last_peered":"2024-03-16T07:25:26.799459+0000","last_clean":"2024-03-16T07:25:26.799459+0000","last_became_active":"2024-03-16T07:25:25.767788+0000","last_became_peered":"2024-03-16T07:25:25.767788+0000","last_unstale":"2024-03-16T07:25:26.799459+0000","last_undegraded":"2024-03-16T07:25:26.799459+0000","last_fullsized":"2024-03-16T07:25:26.799459+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_clean_scrub_stamp":"2024-03-16T07:25:24.745467+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:49:12.241606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-16T07:25:26.791528+0000","last_change":"2024-03-16T07:25:26.791000+0000","last_active":"2024-03-16T07:25:26.791528+0000","last_peered":"2024-03-16T07:25:26.791528+0000","last_clean":"2024-03-16T07:25:26.791528+0000","last_became_active":"2024-03-16T07:25:26.790748+0000","last_became_peered":"2024-03-16T07:25:26.790748+0000","last_unstale":"2024-03-16T07:25:26.791528+0000","last_undegraded":"2024-03-16T07:25:26.791528+0000","last_fullsized":"2024-03-16T07:25:26.791528+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:03:21.014921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"27'2","reported_seq":16,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-03-16T07:25:27.763156+0000","last_change":"2024-03-16T07:25:25.777336+0000","last_active":"2024-03-16T07:25:27.763156+0000","last_peered":"2024-03-16T07:25:27.763156+0000","last_clean":"2024-03-16T07:25:27.763156+0000","last_became_active":"2024-03-16T07:25:25.776801+0000","last_became_peered":"2024-03-16T07:25:25.776801+0000","last_unstale":"2024-03-16T07:25:27.763156+0000","last_undegraded":"2024-03-16T07:25:27.763156+0000","last_fullsized":"2024-03-16T07:25:27.763156+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_clean_scrub_stamp":"2024-03-16T07:25:24.745467+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:12:18.043604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-16T07:25:26.797204+0000","last_change":"2024-03-16T07:25:26.792837+0000","last_active":"2024-03-16T07:25:26.797204+0000","last_peered":"2024-03-16T07:25:26.797204+0000","last_clean":"2024-03-16T07:25:26.797204+0000","last_became_active":"2024-03-16T07:25:26.792560+0000","last_became_peered":"2024-03-16T07:25:26.792560+0000","last_unstale":"2024-03-16T07:25:26.797204+0000","last_undegraded":"2024-03-16T07:25:26.797204+0000","last_fullsized":"2024-03-16T07:25:26.797204+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:35:14.107259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"27'1","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-16T07:25:26.799369+0000","last_change":"2024-03-16T07:25:25.767060+0000","last_active":"2024-03-16T07:25:26.799369+0000","last_peered":"2024-03-16T07:25:26.799369+0000","last_clean":"2024-03-16T07:25:26.799369+0000","last_became_active":"2024-03-16T07:25:25.766634+0000","last_became_peered":"2024-03-16T07:25:25.766634+0000","last_unstale":"2024-03-16T07:25:26.799369+0000","last_undegraded":"2024-03-16T07:25:26.799369+0000","last_fullsized":"2024-03-16T07:25:26.799369+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_clean_scrub_stamp":"2024-03-16T07:25:24.745467+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:45:27.137248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-03-16T07:25:27.762769+0000","last_change":"2024-03-16T07:25:26.777451+0000","last_active":"2024-03-16T07:25:27.762769+0000","last_peered":"2024-03-16T07:25:27.762769+0000","last_clean":"2024-03-16T07:25:27.762769+0000","last_became_active":"2024-03-16T07:25:26.777208+0000","last_became_peered":"2024-03-16T07:25:26.777208+0000","last_unstale":"2024-03-16T07:25:27.762769+0000","last_undegraded":"2024-03-16T07:25:27.762769+0000","last_fullsized":"2024-03-16T07:25:27.762769+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:15:25.308866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-16T07:25:26.762543+0000","last_change":"2024-03-16T07:25:25.772328+0000","last_active":"2024-03-16T07:25:26.762543+0000","last_peered":"2024-03-16T07:25:26.762543+0000","last_clean":"2024-03-16T07:25:26.762543+0000","last_became_active":"2024-03-16T07:25:25.772044+0000","last_became_peered":"2024-03-16T07:25:25.772044+0000","last_unstale":"2024-03-16T07:25:26.762543+0000","last_undegraded":"2024-03-16T07:25:26.762543+0000","last_fullsized":"2024-03-16T07:25:26.762543+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_clean_scrub_stamp":"2024-03-16T07:25:24.745467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:03:20.013549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-03-16T07:25:27.763777+0000","last_change":"2024-03-16T07:25:26.780721+0000","last_active":"2024-03-16T07:25:27.763777+0000","last_peered":"2024-03-16T07:25:27.763777+0000","last_clean":"2024-03-16T07:25:27.763777+0000","last_became_active":"2024-03-16T07:25:26.780222+0000","last_became_peered":"2024-03-16T07:25:26.780222+0000","last_unstale":"2024-03-16T07:25:27.763777+0000","last_undegraded":"2024-03-16T07:25:27.763777+0000","last_fullsized":"2024-03-16T07:25:27.763777+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:13:14.226330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"27'2","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-16T07:25:26.799158+0000","last_change":"2024-03-16T07:25:25.772458+0000","last_active":"2024-03-16T07:25:26.799158+0000","last_peered":"2024-03-16T07:25:26.799158+0000","last_clean":"2024-03-16T07:25:26.799158+0000","last_became_active":"2024-03-16T07:25:25.772025+0000","last_became_peered":"2024-03-16T07:25:25.772025+0000","last_unstale":"2024-03-16T07:25:26.799158+0000","last_undegraded":"2024-03-16T07:25:26.799158+0000","last_fullsized":"2024-03-16T07:25:26.799158+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_clean_scrub_stamp":"2024-03-16T07:25:24.745467+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:13:25.638087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-03-16T07:25:27.762758+0000","last_change":"2024-03-16T07:25:26.782666+0000","last_active":"2024-03-16T07:25:27.762758+0000","last_peered":"2024-03-16T07:25:27.762758+0000","last_clean":"2024-03-16T07:25:27.762758+0000","last_became_active":"2024-03-16T07:25:26.781644+0000","last_became_peered":"2024-03-16T07:25:26.781644+0000","last_unstale":"2024-03-16T07:25:27.762758+0000","last_undegraded":"2024-03-16T07:25:27.762758+0000","last_fullsized":"2024-03-16T07:25:27.762758+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:44:15.933653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-03-16T07:25:27.763908+0000","last_change":"2024-03-16T07:25:25.776342+0000","last_active":"2024-03-16T07:25:27.763908+0000","last_peered":"2024-03-16T07:25:27.763908+0000","last_clean":"2024-03-16T07:25:27.763908+0000","last_became_active":"2024-03-16T07:25:25.776083+0000","last_became_peered":"2024-03-16T07:25:25.776083+0000","last_unstale":"2024-03-16T07:25:27.763908+0000","last_undegraded":"2024-03-16T07:25:27.763908+0000","last_fullsized":"2024-03-16T07:25:27.763908+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_clean_scrub_stamp":"2024-03-16T07:25:24.745467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:22:26.980496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-03-16T07:25:27.762377+0000","last_change":"2024-03-16T07:25:26.781283+0000","last_active":"2024-03-16T07:25:27.762377+0000","last_peered":"2024-03-16T07:25:27.762377+0000","last_clean":"2024-03-16T07:25:27.762377+0000","last_became_active":"2024-03-16T07:25:26.781030+0000","last_became_peered":"2024-03-16T07:25:26.781030+0000","last_unstale":"2024-03-16T07:25:27.762377+0000","last_undegraded":"2024-03-16T07:25:27.762377+0000","last_fullsized":"2024-03-16T07:25:27.762377+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:24:13.541892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-16T07:25:26.754197+0000","last_change":"2024-03-16T07:25:25.769426+0000","last_active":"2024-03-16T07:25:26.754197+0000","last_peered":"2024-03-16T07:25:26.754197+0000","last_clean":"2024-03-16T07:25:26.754197+0000","last_became_active":"2024-03-16T07:25:25.769183+0000","last_became_peered":"2024-03-16T07:25:25.769183+0000","last_unstale":"2024-03-16T07:25:26.754197+0000","last_undegraded":"2024-03-16T07:25:26.754197+0000","last_fullsized":"2024-03-16T07:25:26.754197+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_clean_scrub_stamp":"2024-03-16T07:25:24.745467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:23:21.193828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-16T07:25:26.789646+0000","last_change":"2024-03-16T07:25:26.788813+0000","last_active":"2024-03-16T07:25:26.789646+0000","last_peered":"2024-03-16T07:25:26.789646+0000","last_clean":"2024-03-16T07:25:26.789646+0000","last_became_active":"2024-03-16T07:25:26.788546+0000","last_became_peered":"2024-03-16T07:25:26.788546+0000","last_unstale":"2024-03-16T07:25:26.789646+0000","last_undegraded":"2024-03-16T07:25:26.789646+0000","last_fullsized":"2024-03-16T07:25:26.789646+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:58:28.330508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-16T07:25:26.753443+0000","last_change":"2024-03-16T07:25:25.775102+0000","last_active":"2024-03-16T07:25:26.753443+0000","last_peered":"2024-03-16T07:25:26.753443+0000","last_clean":"2024-03-16T07:25:26.753443+0000","last_became_active":"2024-03-16T07:25:25.774651+0000","last_became_peered":"2024-03-16T07:25:25.774651+0000","last_unstale":"2024-03-16T07:25:26.753443+0000","last_undegraded":"2024-03-16T07:25:26.753443+0000","last_fullsized":"2024-03-16T07:25:26.753443+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_clean_scrub_stamp":"2024-03-16T07:25:24.745467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:46:35.716476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-03-16T07:25:27.763057+0000","last_change":"2024-03-16T07:25:26.787104+0000","last_active":"2024-03-16T07:25:27.763057+0000","last_peered":"2024-03-16T07:25:27.763057+0000","last_clean":"2024-03-16T07:25:27.763057+0000","last_became_active":"2024-03-16T07:25:26.786575+0000","last_became_peered":"2024-03-16T07:25:26.786575+0000","last_unstale":"2024-03-16T07:25:27.763057+0000","last_undegraded":"2024-03-16T07:25:27.763057+0000","last_fullsized":"2024-03-16T07:25:27.763057+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:52:53.885034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"27'2","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-16T07:25:26.789169+0000","last_change":"2024-03-16T07:25:25.771377+0000","last_active":"2024-03-16T07:25:26.789169+0000","last_peered":"2024-03-16T07:25:26.789169+0000","last_clean":"2024-03-16T07:25:26.789169+0000","last_became_active":"2024-03-16T07:25:25.771098+0000","last_became_peered":"2024-03-16T07:25:25.771098+0000","last_unstale":"2024-03-16T07:25:26.789169+0000","last_undegraded":"2024-03-16T07:25:26.789169+0000","last_fullsized":"2024-03-16T07:25:26.789169+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_clean_scrub_stamp":"2024-03-16T07:25:24.745467+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:05:38.205183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-16T07:25:26.799917+0000","last_change":"2024-03-16T07:25:26.797488+0000","last_active":"2024-03-16T07:25:26.799917+0000","last_peered":"2024-03-16T07:25:26.799917+0000","last_clean":"2024-03-16T07:25:26.799917+0000","last_became_active":"2024-03-16T07:25:26.794894+0000","last_became_peered":"2024-03-16T07:25:26.794894+0000","last_unstale":"2024-03-16T07:25:26.799917+0000","last_undegraded":"2024-03-16T07:25:26.799917+0000","last_fullsized":"2024-03-16T07:25:26.799917+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:03:56.402808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-16T07:25:26.763555+0000","last_change":"2024-03-16T07:25:25.773182+0000","last_active":"2024-03-16T07:25:26.763555+0000","last_peered":"2024-03-16T07:25:26.763555+0000","last_clean":"2024-03-16T07:25:26.763555+0000","last_became_active":"2024-03-16T07:25:25.772861+0000","last_became_peered":"2024-03-16T07:25:25.772861+0000","last_unstale":"2024-03-16T07:25:26.763555+0000","last_undegraded":"2024-03-16T07:25:26.763555+0000","last_fullsized":"2024-03-16T07:25:26.763555+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_clean_scrub_stamp":"2024-03-16T07:25:24.745467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:35:13.105887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-16T07:25:26.799919+0000","last_change":"2024-03-16T07:25:26.796631+0000","last_active":"2024-03-16T07:25:26.799919+0000","last_peered":"2024-03-16T07:25:26.799919+0000","last_clean":"2024-03-16T07:25:26.799919+0000","last_became_active":"2024-03-16T07:25:26.795444+0000","last_became_peered":"2024-03-16T07:25:26.795444+0000","last_unstale":"2024-03-16T07:25:26.799919+0000","last_undegraded":"2024-03-16T07:25:26.799919+0000","last_fullsized":"2024-03-16T07:25:26.799919+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:53:30.197560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-16T07:25:26.756073+0000","last_change":"2024-03-16T07:25:25.766122+0000","last_active":"2024-03-16T07:25:26.756073+0000","last_peered":"2024-03-16T07:25:26.756073+0000","last_clean":"2024-03-16T07:25:26.756073+0000","last_became_active":"2024-03-16T07:25:25.765858+0000","last_became_peered":"2024-03-16T07:25:25.765858+0000","last_unstale":"2024-03-16T07:25:26.756073+0000","last_undegraded":"2024-03-16T07:25:26.756073+0000","last_fullsized":"2024-03-16T07:25:26.756073+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_clean_scrub_stamp":"2024-03-16T07:25:24.745467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:31:45.647975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-16T07:25:26.784539+0000","last_change":"2024-03-16T07:25:26.776390+0000","last_active":"2024-03-16T07:25:26.784539+0000","last_peered":"2024-03-16T07:25:26.784539+0000","last_clean":"2024-03-16T07:25:26.784539+0000","last_became_active":"2024-03-16T07:25:26.776048+0000","last_became_peered":"2024-03-16T07:25:26.776048+0000","last_unstale":"2024-03-16T07:25:26.784539+0000","last_undegraded":"2024-03-16T07:25:26.784539+0000","last_fullsized":"2024-03-16T07:25:26.784539+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:56:44.440768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-16T07:25:26.762884+0000","last_change":"2024-03-16T07:25:25.764585+0000","last_active":"2024-03-16T07:25:26.762884+0000","last_peered":"2024-03-16T07:25:26.762884+0000","last_clean":"2024-03-16T07:25:26.762884+0000","last_became_active":"2024-03-16T07:25:25.764145+0000","last_became_peered":"2024-03-16T07:25:25.764145+0000","last_unstale":"2024-03-16T07:25:26.762884+0000","last_undegraded":"2024-03-16T07:25:26.762884+0000","last_fullsized":"2024-03-16T07:25:26.762884+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_clean_scrub_stamp":"2024-03-16T07:25:24.745467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:04:30.099786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-16T07:25:26.799945+0000","last_change":"2024-03-16T07:25:26.797291+0000","last_active":"2024-03-16T07:25:26.799945+0000","last_peered":"2024-03-16T07:25:26.799945+0000","last_clean":"2024-03-16T07:25:26.799945+0000","last_became_active":"2024-03-16T07:25:26.794780+0000","last_became_peered":"2024-03-16T07:25:26.794780+0000","last_unstale":"2024-03-16T07:25:26.799945+0000","last_undegraded":"2024-03-16T07:25:26.799945+0000","last_fullsized":"2024-03-16T07:25:26.799945+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:34:16.025272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-16T07:25:26.754771+0000","last_change":"2024-03-16T07:25:25.770422+0000","last_active":"2024-03-16T07:25:26.754771+0000","last_peered":"2024-03-16T07:25:26.754771+0000","last_clean":"2024-03-16T07:25:26.754771+0000","last_became_active":"2024-03-16T07:25:25.770153+0000","last_became_peered":"2024-03-16T07:25:25.770153+0000","last_unstale":"2024-03-16T07:25:26.754771+0000","last_undegraded":"2024-03-16T07:25:26.754771+0000","last_fullsized":"2024-03-16T07:25:26.754771+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_clean_scrub_stamp":"2024-03-16T07:25:24.745467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:21:53.419532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-03-16T07:25:27.762473+0000","last_change":"2024-03-16T07:25:26.791209+0000","last_active":"2024-03-16T07:25:27.762473+0000","last_peered":"2024-03-16T07:25:27.762473+0000","last_clean":"2024-03-16T07:25:27.762473+0000","last_became_active":"2024-03-16T07:25:26.790886+0000","last_became_peered":"2024-03-16T07:25:26.790886+0000","last_unstale":"2024-03-16T07:25:27.762473+0000","last_undegraded":"2024-03-16T07:25:27.762473+0000","last_fullsized":"2024-03-16T07:25:27.762473+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:13:26.639460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-03-16T07:25:27.763396+0000","last_change":"2024-03-16T07:25:25.769122+0000","last_active":"2024-03-16T07:25:27.763396+0000","last_peered":"2024-03-16T07:25:27.763396+0000","last_clean":"2024-03-16T07:25:27.763396+0000","last_became_active":"2024-03-16T07:25:25.768867+0000","last_became_peered":"2024-03-16T07:25:25.768867+0000","last_unstale":"2024-03-16T07:25:27.763396+0000","last_undegraded":"2024-03-16T07:25:27.763396+0000","last_fullsized":"2024-03-16T07:25:27.763396+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_clean_scrub_stamp":"2024-03-16T07:25:24.745467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:31:27.516098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-16T07:25:26.788716+0000","last_change":"2024-03-16T07:25:26.783268+0000","last_active":"2024-03-16T07:25:26.788716+0000","last_peered":"2024-03-16T07:25:26.788716+0000","last_clean":"2024-03-16T07:25:26.788716+0000","last_became_active":"2024-03-16T07:25:26.782999+0000","last_became_peered":"2024-03-16T07:25:26.782999+0000","last_unstale":"2024-03-16T07:25:26.788716+0000","last_undegraded":"2024-03-16T07:25:26.788716+0000","last_fullsized":"2024-03-16T07:25:26.788716+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:16:07.923318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-16T07:25:26.759089+0000","last_change":"2024-03-16T07:25:25.771801+0000","last_active":"2024-03-16T07:25:26.759089+0000","last_peered":"2024-03-16T07:25:26.759089+0000","last_clean":"2024-03-16T07:25:26.759089+0000","last_became_active":"2024-03-16T07:25:25.771527+0000","last_became_peered":"2024-03-16T07:25:25.771527+0000","last_unstale":"2024-03-16T07:25:26.759089+0000","last_undegraded":"2024-03-16T07:25:26.759089+0000","last_fullsized":"2024-03-16T07:25:26.759089+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_clean_scrub_stamp":"2024-03-16T07:25:24.745467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:58:27.329136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-16T07:25:26.776337+0000","last_change":"2024-03-16T07:25:26.774790+0000","last_active":"2024-03-16T07:25:26.776337+0000","last_peered":"2024-03-16T07:25:26.776337+0000","last_clean":"2024-03-16T07:25:26.776337+0000","last_became_active":"2024-03-16T07:25:26.774186+0000","last_became_peered":"2024-03-16T07:25:26.774186+0000","last_unstale":"2024-03-16T07:25:26.776337+0000","last_undegraded":"2024-03-16T07:25:26.776337+0000","last_fullsized":"2024-03-16T07:25:26.776337+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:15:25.308866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-16T07:25:26.755307+0000","last_change":"2024-03-16T07:25:25.766868+0000","last_active":"2024-03-16T07:25:26.755307+0000","last_peered":"2024-03-16T07:25:26.755307+0000","last_clean":"2024-03-16T07:25:26.755307+0000","last_became_active":"2024-03-16T07:25:25.766116+0000","last_became_peered":"2024-03-16T07:25:25.766116+0000","last_unstale":"2024-03-16T07:25:26.755307+0000","last_undegraded":"2024-03-16T07:25:26.755307+0000","last_fullsized":"2024-03-16T07:25:26.755307+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_clean_scrub_stamp":"2024-03-16T07:25:24.745467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:27:23.414873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'97","reported_seq":167,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-16T07:25:26.753427+0000","last_change":"2024-03-16T07:24:31.650537+0000","last_active":"2024-03-16T07:25:26.753427+0000","last_peered":"2024-03-16T07:25:26.753427+0000","last_clean":"2024-03-16T07:25:26.753427+0000","last_became_active":"2024-03-16T07:24:31.649574+0000","last_became_peered":"2024-03-16T07:24:31.649574+0000","last_unstale":"2024-03-16T07:25:26.753427+0000","last_undegraded":"2024-03-16T07:25:26.753427+0000","last_fullsized":"2024-03-16T07:25:26.753427+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:29.719970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:29.719970+0000","last_clean_scrub_stamp":"2024-03-16T07:24:29.719970+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:31:35.774554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738383,"num_pgs":60,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":31420,"kb_used_data":244,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":104826180,"statfs":{"total":107374182400,"available":107342008320,"internally_reserved":0,"allocated":249856,"data_stored":79803,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738383,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":32020,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":104825580,"statfs":{"total":107374182400,"available":107341393920,"internally_reserved":0,"allocated":864256,"data_stored":672455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738383,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":32012,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":104825588,"statfs":{"total":107374182400,"available":107341402112,"internally_reserved":0,"allocated":851968,"data_stored":672329,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-16T07:25:31.132 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-03-16T07:25:31.132 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-03-16T07:25:31.552 INFO:teuthology.orchestra.run.smithi049.stdout:[client.0] 2024-03-16T07:25:31.553 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQAaSfVlmBmvGRAAaxdhkajaioVlq23dyv/g4g== 2024-03-16T07:25:31.553 INFO:teuthology.orchestra.run.smithi049.stdout: caps mds = "allow" 2024-03-16T07:25:31.553 INFO:teuthology.orchestra.run.smithi049.stdout: caps mon = "allow r" 2024-03-16T07:25:31.553 INFO:teuthology.orchestra.run.smithi049.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-03-16T07:25:31.553 INFO:teuthology.orchestra.run.smithi049.stderr:updated caps for client.0 2024-03-16T07:25:31.565 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T07:25:31.905 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:25:31.905 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4497,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6827/2700845528","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":2700845528},{"type":"v1","addr":"172.21.15.49:6827","nonce":2700845528}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4502,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6830/1983317600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":1983317600},{"type":"v1","addr":"172.21.15.49:6830","nonce":1983317600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4503,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6831/1363178912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6829","nonce":1363178912},{"type":"v1","addr":"172.21.15.49:6831","nonce":1363178912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4506,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6833/4243939102","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":4243939102},{"type":"v1","addr":"172.21.15.49:6833","nonce":4243939102}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-16T07:25:26.124693+0000","modified":"2024-03-16T07:25:29.119108+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4509},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4509":{"gid":4509,"name":"e","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6835/3541821089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":3541821089},{"type":"v1","addr":"172.21.15.49:6835","nonce":3541821089}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4509,"qdb_cluster":[4509]},"id":2}]} 2024-03-16T07:25:31.905 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 17 2024-03-16T07:25:32.419 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-03-16T07:25:26.124693+0000', 'modified': '2024-03-16T07:25:29.119108+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4509}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4509': {'gid': 4509, 'name': 'e', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.49:6835/3541821089', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.49:6834', 'nonce': 3541821089}, {'type': 'v1', 'addr': '172.21.15.49:6835', 'nonce': 3541821089}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4509, 'qdb_cluster': [4509]} 2024-03-16T07:25:32.419 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-03-16T07:25:32.420 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.e status 2024-03-16T07:25:32.541 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-16T07:25:32.543+0000 7f8cc77fe640 0 client.4586 ms_handle_reset on v2:172.21.15.49:6834/3541821089 2024-03-16T07:25:32.564 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-16T07:25:32.566+0000 7f8cc77fe640 0 client.4588 ms_handle_reset on v2:172.21.15.49:6834/3541821089 2024-03-16T07:25:32.564 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-03-16T07:25:32.565 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_fsid": "f91af061-9eac-4793-87fa-8d27ae3d242f", 2024-03-16T07:25:32.565 INFO:teuthology.orchestra.run.smithi049.stdout: "whoami": 0, 2024-03-16T07:25:32.565 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 4509, 2024-03-16T07:25:32.565 INFO:teuthology.orchestra.run.smithi049.stdout: "want_state": "up:active", 2024-03-16T07:25:32.565 INFO:teuthology.orchestra.run.smithi049.stdout: "state": "up:active", 2024-03-16T07:25:32.565 INFO:teuthology.orchestra.run.smithi049.stdout: "fs_name": "cephfs", 2024-03-16T07:25:32.565 INFO:teuthology.orchestra.run.smithi049.stdout: "rank_uptime": 5.8157565499999997, 2024-03-16T07:25:32.565 INFO:teuthology.orchestra.run.smithi049.stdout: "mdsmap_epoch": 17, 2024-03-16T07:25:32.565 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch": 28, 2024-03-16T07:25:32.565 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch_barrier": 28, 2024-03-16T07:25:32.565 INFO:teuthology.orchestra.run.smithi049.stdout: "uptime": 13.320490371 2024-03-16T07:25:32.565 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-03-16T07:25:32.576 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-03-16T07:25:32.915 INFO:teuthology.orchestra.run.smithi049.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-03-16T07:25:32.927 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-03-16T07:25:32.928 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-03-16T07:25:32.928 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi049.front.sepia.ceph.com 2024-03-16T07:25:32.928 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-03-16T07:25:32.928 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-03-16T07:25:32.928 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-03-16T07:25:32.928 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-03-16T07:25:32.928 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-03-16T07:25:32.928 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-03-16T07:25:32.928 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:25:32.928 DEBUG:teuthology.orchestra.run.smithi049:> ip addr 2024-03-16T07:25:32.943 INFO:teuthology.orchestra.run.smithi049.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-16T07:25:32.943 INFO:teuthology.orchestra.run.smithi049.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-16T07:25:32.943 INFO:teuthology.orchestra.run.smithi049.stdout: inet 127.0.0.1/8 scope host lo 2024-03-16T07:25:32.944 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-03-16T07:25:32.944 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 ::1/128 scope host 2024-03-16T07:25:32.944 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-03-16T07:25:32.944 INFO:teuthology.orchestra.run.smithi049.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-16T07:25:32.944 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:6b:ff:84 brd ff:ff:ff:ff:ff:ff 2024-03-16T07:25:32.944 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp7s0f0 2024-03-16T07:25:32.944 INFO:teuthology.orchestra.run.smithi049.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-16T07:25:32.944 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:6b:ff:85 brd ff:ff:ff:ff:ff:ff 2024-03-16T07:25:32.944 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp7s0f1 2024-03-16T07:25:32.944 INFO:teuthology.orchestra.run.smithi049.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-03-16T07:25:32.944 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:bd:15:66 brd ff:ff:ff:ff:ff:ff 2024-03-16T07:25:32.944 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp1s0f0 2024-03-16T07:25:32.944 INFO:teuthology.orchestra.run.smithi049.stdout: inet 172.21.15.49/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-03-16T07:25:32.944 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft 42375sec preferred_lft 42375sec 2024-03-16T07:25:32.944 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::ec4:7aff:febd:1566/64 scope link noprefixroute 2024-03-16T07:25:32.945 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-03-16T07:25:32.945 INFO:teuthology.orchestra.run.smithi049.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-16T07:25:32.945 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:bd:15:67 brd ff:ff:ff:ff:ff:ff 2024-03-16T07:25:32.945 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp1s0f1 2024-03-16T07:25:32.945 INFO:teuthology.orchestra.run.smithi049.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-03-16T07:25:32.945 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether a2:f1:88:c1:22:e7 brd ff:ff:ff:ff:ff:ff 2024-03-16T07:25:32.945 INFO:teuthology.orchestra.run.smithi049.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-03-16T07:25:32.945 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-03-16T07:25:32.945 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::e0e6:55ff:fe4d:1d68/64 scope link 2024-03-16T07:25:32.945 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-03-16T07:25:32.945 INFO:teuthology.orchestra.run.smithi049.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-03-16T07:25:32.945 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether ee:10:71:d7:68:c4 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-16T07:25:32.945 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::ec10:71ff:fed7:68c4/64 scope link 2024-03-16T07:25:32.945 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-03-16T07:25:32.945 INFO:teuthology.orchestra.run.smithi049.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-03-16T07:25:32.945 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether a2:f1:88:c1:22:e7 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-16T07:25:32.946 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::a0f1:88ff:fec1:22e7/64 scope link 2024-03-16T07:25:32.946 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-03-16T07:25:32.946 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:25:32.946 DEBUG:teuthology.orchestra.run.smithi049:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-03-16T07:25:33.013 INFO:teuthology.orchestra.run.smithi049.stdout:1 2024-03-16T07:25:33.015 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:25:33.015 DEBUG:teuthology.orchestra.run.smithi049:> route 2024-03-16T07:25:33.070 INFO:teuthology.orchestra.run.smithi049.stdout:Kernel IP routing table 2024-03-16T07:25:33.070 INFO:teuthology.orchestra.run.smithi049.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-03-16T07:25:33.071 INFO:teuthology.orchestra.run.smithi049.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-03-16T07:25:33.071 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-03-16T07:25:33.071 INFO:teuthology.orchestra.run.smithi049.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-03-16T07:25:33.071 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-16T07:25:33.071 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-03-16T07:25:33.071 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-03-16T07:25:33.071 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-03-16T07:25:33.071 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-03-16T07:25:33.071 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-03-16T07:25:33.160 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-16T07:25:33 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-16T07:25:33.212 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-16T07:25:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-16T07:25:33.218 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:25:33.218 DEBUG:teuthology.orchestra.run.smithi049:> ip netns list 2024-03-16T07:25:33.233 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 1) 2024-03-16T07:25:33.233 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-03-16T07:25:33.234 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-03-16T07:25:33.234 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:25:33.234 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link set brx.0 up 2024-03-16T07:25:33.306 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-03-16T07:25:33.306 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-16T07:25:33.306 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-03-16T07:25:33.361 INFO:teuthology.orchestra.run.smithi049.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-03-16T07:25:33.361 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-16T07:25:33.361 DEBUG:teuthology.orchestra.run.smithi049:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-03-16T07:25:33.416 DEBUG:teuthology.orchestra.run.smithi049:> sudo modprobe fuse 2024-03-16T07:25:33.487 DEBUG:teuthology.orchestra.run.smithi049:> cat /proc/self/mounts | awk '{print $2}' 2024-03-16T07:25:33.544 INFO:teuthology.orchestra.run.smithi049.stdout:/proc 2024-03-16T07:25:33.544 INFO:teuthology.orchestra.run.smithi049.stdout:/sys 2024-03-16T07:25:33.544 INFO:teuthology.orchestra.run.smithi049.stdout:/dev 2024-03-16T07:25:33.544 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/security 2024-03-16T07:25:33.544 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/shm 2024-03-16T07:25:33.544 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/pts 2024-03-16T07:25:33.544 INFO:teuthology.orchestra.run.smithi049.stdout:/run 2024-03-16T07:25:33.544 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/cgroup 2024-03-16T07:25:33.544 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/pstore 2024-03-16T07:25:33.544 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/bpf 2024-03-16T07:25:33.544 INFO:teuthology.orchestra.run.smithi049.stdout:/ 2024-03-16T07:25:33.545 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/selinux 2024-03-16T07:25:33.545 INFO:teuthology.orchestra.run.smithi049.stdout:/proc/sys/fs/binfmt_misc 2024-03-16T07:25:33.545 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/mqueue 2024-03-16T07:25:33.545 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/hugepages 2024-03-16T07:25:33.545 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/debug 2024-03-16T07:25:33.545 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/tracing 2024-03-16T07:25:33.545 INFO:teuthology.orchestra.run.smithi049.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-03-16T07:25:33.545 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/fuse/connections 2024-03-16T07:25:33.545 INFO:teuthology.orchestra.run.smithi049.stdout:/run/credentials/systemd-sysctl.service 2024-03-16T07:25:33.545 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/config 2024-03-16T07:25:33.545 INFO:teuthology.orchestra.run.smithi049.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-03-16T07:25:33.545 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/nfs/rpc_pipefs 2024-03-16T07:25:33.545 INFO:teuthology.orchestra.run.smithi049.stdout:/run/user/1000 2024-03-16T07:25:33.545 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph 2024-03-16T07:25:33.545 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-0 2024-03-16T07:25:33.546 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-1 2024-03-16T07:25:33.546 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-2 2024-03-16T07:25:33.546 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns 2024-03-16T07:25:33.546 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-16T07:25:33.546 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-16T07:25:33.546 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-16T07:25:33.546 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-16T07:25:33.546 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:25:33.546 DEBUG:teuthology.orchestra.run.smithi049:> ls /sys/fs/fuse/connections 2024-03-16T07:25:33.598 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-03-16T07:25:33.599 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-03-16T07:25:33.641 DEBUG:teuthology.orchestra.run.smithi049:> sudo modprobe fuse 2024-03-16T07:25:33.672 DEBUG:teuthology.orchestra.run.smithi049:> cat /proc/self/mounts | awk '{print $2}' 2024-03-16T07:25:33.730 INFO:teuthology.orchestra.run.smithi049.stdout:/proc 2024-03-16T07:25:33.730 INFO:teuthology.orchestra.run.smithi049.stdout:/sys 2024-03-16T07:25:33.730 INFO:teuthology.orchestra.run.smithi049.stdout:/dev 2024-03-16T07:25:33.730 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/security 2024-03-16T07:25:33.730 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/shm 2024-03-16T07:25:33.730 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/pts 2024-03-16T07:25:33.731 INFO:teuthology.orchestra.run.smithi049.stdout:/run 2024-03-16T07:25:33.731 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/cgroup 2024-03-16T07:25:33.731 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/pstore 2024-03-16T07:25:33.731 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/bpf 2024-03-16T07:25:33.731 INFO:teuthology.orchestra.run.smithi049.stdout:/ 2024-03-16T07:25:33.731 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/selinux 2024-03-16T07:25:33.731 INFO:teuthology.orchestra.run.smithi049.stdout:/proc/sys/fs/binfmt_misc 2024-03-16T07:25:33.731 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/mqueue 2024-03-16T07:25:33.731 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/hugepages 2024-03-16T07:25:33.731 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/debug 2024-03-16T07:25:33.731 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/tracing 2024-03-16T07:25:33.731 INFO:teuthology.orchestra.run.smithi049.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-03-16T07:25:33.731 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/fuse/connections 2024-03-16T07:25:33.731 INFO:teuthology.orchestra.run.smithi049.stdout:/run/credentials/systemd-sysctl.service 2024-03-16T07:25:33.732 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/config 2024-03-16T07:25:33.732 INFO:teuthology.orchestra.run.smithi049.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-03-16T07:25:33.732 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/nfs/rpc_pipefs 2024-03-16T07:25:33.732 INFO:teuthology.orchestra.run.smithi049.stdout:/run/user/1000 2024-03-16T07:25:33.732 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph 2024-03-16T07:25:33.732 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-0 2024-03-16T07:25:33.732 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-1 2024-03-16T07:25:33.732 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-2 2024-03-16T07:25:33.732 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns 2024-03-16T07:25:33.732 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-16T07:25:33.732 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-16T07:25:33.732 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-16T07:25:33.732 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-16T07:25:33.732 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:25:33.733 DEBUG:teuthology.orchestra.run.smithi049:> ls /sys/fs/fuse/connections 2024-03-16T07:25:33.742 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi049.stderr:2024-03-16T07:25:33.744+0000 7f0c0043d480 -1 init, newargv = 0x55d54c03dce0 newargc=15 2024-03-16T07:25:33.742 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi049.stderr:ceph-fuse[46468]: starting ceph client 2024-03-16T07:25:33.746 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi049.stderr:ceph-fuse[46468]: starting fuse 2024-03-16T07:25:33.758 INFO:teuthology.orchestra.run.smithi049.stdout:41 2024-03-16T07:25:33.758 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2024-03-16T07:25:33.758 DEBUG:teuthology.orchestra.run.smithi049:> sudo stdin-killer -- python3 -c ' 2024-03-16T07:25:33.758 DEBUG:teuthology.orchestra.run.smithi049:> import glob 2024-03-16T07:25:33.758 DEBUG:teuthology.orchestra.run.smithi049:> import re 2024-03-16T07:25:33.758 DEBUG:teuthology.orchestra.run.smithi049:> import os 2024-03-16T07:25:33.758 DEBUG:teuthology.orchestra.run.smithi049:> import subprocess 2024-03-16T07:25:33.758 DEBUG:teuthology.orchestra.run.smithi049:> 2024-03-16T07:25:33.759 DEBUG:teuthology.orchestra.run.smithi049:> def _find_admin_socket(client_name): 2024-03-16T07:25:33.759 DEBUG:teuthology.orchestra.run.smithi049:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-03-16T07:25:33.759 DEBUG:teuthology.orchestra.run.smithi049:> files = glob.glob(asok_path) 2024-03-16T07:25:33.759 DEBUG:teuthology.orchestra.run.smithi049:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-03-16T07:25:33.759 DEBUG:teuthology.orchestra.run.smithi049:> 2024-03-16T07:25:33.759 DEBUG:teuthology.orchestra.run.smithi049:> # Given a non-glob path, it better be there 2024-03-16T07:25:33.759 DEBUG:teuthology.orchestra.run.smithi049:> if "*" not in asok_path: 2024-03-16T07:25:33.759 DEBUG:teuthology.orchestra.run.smithi049:> assert(len(files) == 1) 2024-03-16T07:25:33.759 DEBUG:teuthology.orchestra.run.smithi049:> return files[0] 2024-03-16T07:25:33.759 DEBUG:teuthology.orchestra.run.smithi049:> 2024-03-16T07:25:33.759 DEBUG:teuthology.orchestra.run.smithi049:> for f in files: 2024-03-16T07:25:33.759 DEBUG:teuthology.orchestra.run.smithi049:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-03-16T07:25:33.759 DEBUG:teuthology.orchestra.run.smithi049:> if os.path.exists("/proc/{0}".format(pid)): 2024-03-16T07:25:33.759 DEBUG:teuthology.orchestra.run.smithi049:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-03-16T07:25:33.759 DEBUG:teuthology.orchestra.run.smithi049:> contents = proc_f.read() 2024-03-16T07:25:33.759 DEBUG:teuthology.orchestra.run.smithi049:> if mountpoint in contents: 2024-03-16T07:25:33.760 DEBUG:teuthology.orchestra.run.smithi049:> return f 2024-03-16T07:25:33.760 DEBUG:teuthology.orchestra.run.smithi049:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-03-16T07:25:33.760 DEBUG:teuthology.orchestra.run.smithi049:> 2024-03-16T07:25:33.760 DEBUG:teuthology.orchestra.run.smithi049:> print(_find_admin_socket("client.0")) 2024-03-16T07:25:33.760 DEBUG:teuthology.orchestra.run.smithi049:> ' 2024-03-16T07:25:33.883 INFO:teuthology.orchestra.run.smithi049.stdout:/var/run/ceph/ceph-client.0.46468.asok 2024-03-16T07:25:33.886 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-16T07:25:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-16T07:25:33.894 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.46468.asok 2024-03-16T07:25:33.894 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:25:33.894 DEBUG:teuthology.orchestra.run.smithi049:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.46468.asok status 2024-03-16T07:25:34.036 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-03-16T07:25:34.037 INFO:teuthology.orchestra.run.smithi049.stdout: "metadata": { 2024-03-16T07:25:34.037 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph_sha1": "3d78f5ba07bf18880172c07d4d7b4ac00c9d30af", 2024-03-16T07:25:34.037 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph_version": "ceph version 19.0.0-2162-g3d78f5ba (3d78f5ba07bf18880172c07d4d7b4ac00c9d30af) squid (dev)", 2024-03-16T07:25:34.037 INFO:teuthology.orchestra.run.smithi049.stdout: "entity_id": "0", 2024-03-16T07:25:34.037 INFO:teuthology.orchestra.run.smithi049.stdout: "hostname": "smithi049", 2024-03-16T07:25:34.037 INFO:teuthology.orchestra.run.smithi049.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-03-16T07:25:34.037 INFO:teuthology.orchestra.run.smithi049.stdout: "pid": "46468", 2024-03-16T07:25:34.037 INFO:teuthology.orchestra.run.smithi049.stdout: "root": "/" 2024-03-16T07:25:34.037 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:25:34.037 INFO:teuthology.orchestra.run.smithi049.stdout: "dentry_count": 0, 2024-03-16T07:25:34.037 INFO:teuthology.orchestra.run.smithi049.stdout: "dentry_pinned_count": 0, 2024-03-16T07:25:34.037 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 4594, 2024-03-16T07:25:34.037 INFO:teuthology.orchestra.run.smithi049.stdout: "inst": { 2024-03-16T07:25:34.037 INFO:teuthology.orchestra.run.smithi049.stdout: "name": { 2024-03-16T07:25:34.038 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "client", 2024-03-16T07:25:34.038 INFO:teuthology.orchestra.run.smithi049.stdout: "num": 4594 2024-03-16T07:25:34.038 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:25:34.038 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": { 2024-03-16T07:25:34.038 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2024-03-16T07:25:34.038 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "192.168.0.1:0", 2024-03-16T07:25:34.038 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 2854068374 2024-03-16T07:25:34.038 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:25:34.038 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:25:34.038 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": { 2024-03-16T07:25:34.038 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2024-03-16T07:25:34.038 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "192.168.0.1:0", 2024-03-16T07:25:34.038 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 2854068374 2024-03-16T07:25:34.038 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:25:34.038 INFO:teuthology.orchestra.run.smithi049.stdout: "inst_str": "client.4594 192.168.0.1:0/2854068374", 2024-03-16T07:25:34.038 INFO:teuthology.orchestra.run.smithi049.stdout: "addr_str": "192.168.0.1:0/2854068374", 2024-03-16T07:25:34.039 INFO:teuthology.orchestra.run.smithi049.stdout: "inode_count": 1, 2024-03-16T07:25:34.039 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_epoch": 17, 2024-03-16T07:25:34.039 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_epoch": 28, 2024-03-16T07:25:34.039 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_epoch_barrier": 0, 2024-03-16T07:25:34.039 INFO:teuthology.orchestra.run.smithi049.stdout: "blocklisted": false, 2024-03-16T07:25:34.039 INFO:teuthology.orchestra.run.smithi049.stdout: "fs_name": "cephfs" 2024-03-16T07:25:34.039 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-03-16T07:25:34.045 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:25:34.045 DEBUG:teuthology.orchestra.run.smithi049:> stat --file-system '--printf=%T 2024-03-16T07:25:34.045 DEBUG:teuthology.orchestra.run.smithi049:> ' -- /home/ubuntu/cephtest/mnt.0 2024-03-16T07:25:34.060 INFO:teuthology.orchestra.run.smithi049.stdout:fuseblk 2024-03-16T07:25:34.060 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-03-16T07:25:34.060 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:25:34.060 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-03-16T07:25:34.130 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-03-16T07:25:34.587 INFO:teuthology.orchestra.run.smithi049.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-03-16T07:25:34.600 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-03-16T07:25:34.600 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-03-16T07:25:34.600 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi049.front.sepia.ceph.com 2024-03-16T07:25:34.600 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-03-16T07:25:34.600 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-03-16T07:25:34.600 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-03-16T07:25:34.600 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-03-16T07:25:34.600 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-03-16T07:25:34.600 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-03-16T07:25:34.600 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:25:34.601 DEBUG:teuthology.orchestra.run.smithi049:> ip addr 2024-03-16T07:25:34.616 INFO:teuthology.orchestra.run.smithi049.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-16T07:25:34.616 INFO:teuthology.orchestra.run.smithi049.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-16T07:25:34.616 INFO:teuthology.orchestra.run.smithi049.stdout: inet 127.0.0.1/8 scope host lo 2024-03-16T07:25:34.616 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-03-16T07:25:34.616 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 ::1/128 scope host 2024-03-16T07:25:34.616 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-03-16T07:25:34.616 INFO:teuthology.orchestra.run.smithi049.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-16T07:25:34.616 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:6b:ff:84 brd ff:ff:ff:ff:ff:ff 2024-03-16T07:25:34.616 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp7s0f0 2024-03-16T07:25:34.616 INFO:teuthology.orchestra.run.smithi049.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-16T07:25:34.617 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:6b:ff:85 brd ff:ff:ff:ff:ff:ff 2024-03-16T07:25:34.617 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp7s0f1 2024-03-16T07:25:34.617 INFO:teuthology.orchestra.run.smithi049.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-03-16T07:25:34.617 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:bd:15:66 brd ff:ff:ff:ff:ff:ff 2024-03-16T07:25:34.617 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp1s0f0 2024-03-16T07:25:34.617 INFO:teuthology.orchestra.run.smithi049.stdout: inet 172.21.15.49/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-03-16T07:25:34.617 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft 42373sec preferred_lft 42373sec 2024-03-16T07:25:34.617 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::ec4:7aff:febd:1566/64 scope link noprefixroute 2024-03-16T07:25:34.617 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-03-16T07:25:34.617 INFO:teuthology.orchestra.run.smithi049.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-16T07:25:34.617 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:bd:15:67 brd ff:ff:ff:ff:ff:ff 2024-03-16T07:25:34.617 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp1s0f1 2024-03-16T07:25:34.617 INFO:teuthology.orchestra.run.smithi049.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-03-16T07:25:34.617 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether a2:f1:88:c1:22:e7 brd ff:ff:ff:ff:ff:ff 2024-03-16T07:25:34.617 INFO:teuthology.orchestra.run.smithi049.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-03-16T07:25:34.618 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-03-16T07:25:34.618 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::e0e6:55ff:fe4d:1d68/64 scope link 2024-03-16T07:25:34.618 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-03-16T07:25:34.618 INFO:teuthology.orchestra.run.smithi049.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-03-16T07:25:34.618 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether ee:10:71:d7:68:c4 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-16T07:25:34.618 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::ec10:71ff:fed7:68c4/64 scope link 2024-03-16T07:25:34.618 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-03-16T07:25:34.618 INFO:teuthology.orchestra.run.smithi049.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-03-16T07:25:34.618 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether a2:f1:88:c1:22:e7 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-16T07:25:34.618 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::a0f1:88ff:fec1:22e7/64 scope link 2024-03-16T07:25:34.618 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-03-16T07:25:34.619 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:25:34.619 DEBUG:teuthology.orchestra.run.smithi049:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-03-16T07:25:34.685 INFO:teuthology.orchestra.run.smithi049.stdout:1 2024-03-16T07:25:34.687 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:25:34.687 DEBUG:teuthology.orchestra.run.smithi049:> route 2024-03-16T07:25:34.742 INFO:teuthology.orchestra.run.smithi049.stdout:Kernel IP routing table 2024-03-16T07:25:34.743 INFO:teuthology.orchestra.run.smithi049.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-03-16T07:25:34.743 INFO:teuthology.orchestra.run.smithi049.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-03-16T07:25:34.743 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-03-16T07:25:34.743 INFO:teuthology.orchestra.run.smithi049.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-03-16T07:25:34.743 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-16T07:25:34.743 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-03-16T07:25:34.743 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-03-16T07:25:34.743 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-03-16T07:25:34.743 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-03-16T07:25:34.743 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-03-16T07:25:34.833 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-16T07:25:34 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-16T07:25:34.885 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-16T07:25:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-16T07:25:34.891 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:25:34.891 DEBUG:teuthology.orchestra.run.smithi049:> ip netns list 2024-03-16T07:25:34.906 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 1) 2024-03-16T07:25:34.906 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-03-16T07:25:34.907 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-03-16T07:25:34.907 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:25:34.907 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link set brx.1 up 2024-03-16T07:25:34.978 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-03-16T07:25:34.978 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-16T07:25:34.978 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-03-16T07:25:35.033 INFO:teuthology.orchestra.run.smithi049.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-03-16T07:25:35.033 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-16T07:25:35.033 DEBUG:teuthology.orchestra.run.smithi049:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-03-16T07:25:35.087 DEBUG:teuthology.orchestra.run.smithi049:> sudo modprobe fuse 2024-03-16T07:25:35.158 DEBUG:teuthology.orchestra.run.smithi049:> cat /proc/self/mounts | awk '{print $2}' 2024-03-16T07:25:35.214 INFO:teuthology.orchestra.run.smithi049.stdout:/proc 2024-03-16T07:25:35.214 INFO:teuthology.orchestra.run.smithi049.stdout:/sys 2024-03-16T07:25:35.214 INFO:teuthology.orchestra.run.smithi049.stdout:/dev 2024-03-16T07:25:35.214 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/security 2024-03-16T07:25:35.214 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/shm 2024-03-16T07:25:35.214 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/pts 2024-03-16T07:25:35.214 INFO:teuthology.orchestra.run.smithi049.stdout:/run 2024-03-16T07:25:35.214 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/cgroup 2024-03-16T07:25:35.214 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/pstore 2024-03-16T07:25:35.214 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/bpf 2024-03-16T07:25:35.214 INFO:teuthology.orchestra.run.smithi049.stdout:/ 2024-03-16T07:25:35.214 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/selinux 2024-03-16T07:25:35.214 INFO:teuthology.orchestra.run.smithi049.stdout:/proc/sys/fs/binfmt_misc 2024-03-16T07:25:35.214 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/mqueue 2024-03-16T07:25:35.215 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/hugepages 2024-03-16T07:25:35.215 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/debug 2024-03-16T07:25:35.215 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/tracing 2024-03-16T07:25:35.215 INFO:teuthology.orchestra.run.smithi049.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-03-16T07:25:35.215 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/fuse/connections 2024-03-16T07:25:35.215 INFO:teuthology.orchestra.run.smithi049.stdout:/run/credentials/systemd-sysctl.service 2024-03-16T07:25:35.215 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/config 2024-03-16T07:25:35.215 INFO:teuthology.orchestra.run.smithi049.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-03-16T07:25:35.215 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/nfs/rpc_pipefs 2024-03-16T07:25:35.215 INFO:teuthology.orchestra.run.smithi049.stdout:/run/user/1000 2024-03-16T07:25:35.215 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph 2024-03-16T07:25:35.215 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-0 2024-03-16T07:25:35.215 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-1 2024-03-16T07:25:35.215 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-2 2024-03-16T07:25:35.215 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns 2024-03-16T07:25:35.215 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-16T07:25:35.216 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-16T07:25:35.216 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-16T07:25:35.216 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-16T07:25:35.216 INFO:teuthology.orchestra.run.smithi049.stdout:/home/ubuntu/cephtest/mnt.0 2024-03-16T07:25:35.216 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:25:35.216 DEBUG:teuthology.orchestra.run.smithi049:> ls /sys/fs/fuse/connections 2024-03-16T07:25:35.269 INFO:teuthology.orchestra.run.smithi049.stdout:41 2024-03-16T07:25:35.269 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [41] 2024-03-16T07:25:35.269 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-03-16T07:25:35.311 DEBUG:teuthology.orchestra.run.smithi049:> sudo modprobe fuse 2024-03-16T07:25:35.343 DEBUG:teuthology.orchestra.run.smithi049:> cat /proc/self/mounts | awk '{print $2}' 2024-03-16T07:25:35.399 INFO:teuthology.orchestra.run.smithi049.stdout:/proc 2024-03-16T07:25:35.399 INFO:teuthology.orchestra.run.smithi049.stdout:/sys 2024-03-16T07:25:35.399 INFO:teuthology.orchestra.run.smithi049.stdout:/dev 2024-03-16T07:25:35.399 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/security 2024-03-16T07:25:35.399 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/shm 2024-03-16T07:25:35.399 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/pts 2024-03-16T07:25:35.399 INFO:teuthology.orchestra.run.smithi049.stdout:/run 2024-03-16T07:25:35.399 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/cgroup 2024-03-16T07:25:35.399 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/pstore 2024-03-16T07:25:35.399 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/bpf 2024-03-16T07:25:35.400 INFO:teuthology.orchestra.run.smithi049.stdout:/ 2024-03-16T07:25:35.400 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/selinux 2024-03-16T07:25:35.400 INFO:teuthology.orchestra.run.smithi049.stdout:/proc/sys/fs/binfmt_misc 2024-03-16T07:25:35.400 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/mqueue 2024-03-16T07:25:35.400 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/hugepages 2024-03-16T07:25:35.400 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/debug 2024-03-16T07:25:35.400 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/tracing 2024-03-16T07:25:35.400 INFO:teuthology.orchestra.run.smithi049.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-03-16T07:25:35.400 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/fuse/connections 2024-03-16T07:25:35.400 INFO:teuthology.orchestra.run.smithi049.stdout:/run/credentials/systemd-sysctl.service 2024-03-16T07:25:35.400 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/config 2024-03-16T07:25:35.400 INFO:teuthology.orchestra.run.smithi049.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-03-16T07:25:35.400 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/nfs/rpc_pipefs 2024-03-16T07:25:35.400 INFO:teuthology.orchestra.run.smithi049.stdout:/run/user/1000 2024-03-16T07:25:35.400 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph 2024-03-16T07:25:35.401 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-0 2024-03-16T07:25:35.401 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-1 2024-03-16T07:25:35.401 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-2 2024-03-16T07:25:35.401 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns 2024-03-16T07:25:35.401 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-16T07:25:35.401 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-16T07:25:35.401 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-16T07:25:35.401 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-16T07:25:35.401 INFO:teuthology.orchestra.run.smithi049.stdout:/home/ubuntu/cephtest/mnt.0 2024-03-16T07:25:35.401 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:25:35.401 DEBUG:teuthology.orchestra.run.smithi049:> ls /sys/fs/fuse/connections 2024-03-16T07:25:35.412 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi049.stderr:2024-03-16T07:25:35.413+0000 7ff5b2638480 -1 init, newargv = 0x561470d6c360 newargc=15 2024-03-16T07:25:35.412 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi049.stderr:ceph-fuse[46882]: starting ceph client 2024-03-16T07:25:35.416 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi049.stderr:ceph-fuse[46882]: starting fuse 2024-03-16T07:25:35.428 INFO:teuthology.orchestra.run.smithi049.stdout:41 2024-03-16T07:25:35.428 INFO:teuthology.orchestra.run.smithi049.stdout:44 2024-03-16T07:25:35.428 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41, 44] 2024-03-16T07:25:35.428 DEBUG:teuthology.orchestra.run.smithi049:> sudo stdin-killer -- python3 -c ' 2024-03-16T07:25:35.428 DEBUG:teuthology.orchestra.run.smithi049:> import glob 2024-03-16T07:25:35.428 DEBUG:teuthology.orchestra.run.smithi049:> import re 2024-03-16T07:25:35.428 DEBUG:teuthology.orchestra.run.smithi049:> import os 2024-03-16T07:25:35.428 DEBUG:teuthology.orchestra.run.smithi049:> import subprocess 2024-03-16T07:25:35.428 DEBUG:teuthology.orchestra.run.smithi049:> 2024-03-16T07:25:35.428 DEBUG:teuthology.orchestra.run.smithi049:> def _find_admin_socket(client_name): 2024-03-16T07:25:35.428 DEBUG:teuthology.orchestra.run.smithi049:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-03-16T07:25:35.429 DEBUG:teuthology.orchestra.run.smithi049:> files = glob.glob(asok_path) 2024-03-16T07:25:35.429 DEBUG:teuthology.orchestra.run.smithi049:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-03-16T07:25:35.429 DEBUG:teuthology.orchestra.run.smithi049:> 2024-03-16T07:25:35.429 DEBUG:teuthology.orchestra.run.smithi049:> # Given a non-glob path, it better be there 2024-03-16T07:25:35.429 DEBUG:teuthology.orchestra.run.smithi049:> if "*" not in asok_path: 2024-03-16T07:25:35.429 DEBUG:teuthology.orchestra.run.smithi049:> assert(len(files) == 1) 2024-03-16T07:25:35.429 DEBUG:teuthology.orchestra.run.smithi049:> return files[0] 2024-03-16T07:25:35.429 DEBUG:teuthology.orchestra.run.smithi049:> 2024-03-16T07:25:35.429 DEBUG:teuthology.orchestra.run.smithi049:> for f in files: 2024-03-16T07:25:35.429 DEBUG:teuthology.orchestra.run.smithi049:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-03-16T07:25:35.429 DEBUG:teuthology.orchestra.run.smithi049:> if os.path.exists("/proc/{0}".format(pid)): 2024-03-16T07:25:35.429 DEBUG:teuthology.orchestra.run.smithi049:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-03-16T07:25:35.429 DEBUG:teuthology.orchestra.run.smithi049:> contents = proc_f.read() 2024-03-16T07:25:35.429 DEBUG:teuthology.orchestra.run.smithi049:> if mountpoint in contents: 2024-03-16T07:25:35.429 DEBUG:teuthology.orchestra.run.smithi049:> return f 2024-03-16T07:25:35.429 DEBUG:teuthology.orchestra.run.smithi049:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-03-16T07:25:35.430 DEBUG:teuthology.orchestra.run.smithi049:> 2024-03-16T07:25:35.430 DEBUG:teuthology.orchestra.run.smithi049:> print(_find_admin_socket("client.1")) 2024-03-16T07:25:35.430 DEBUG:teuthology.orchestra.run.smithi049:> ' 2024-03-16T07:25:35.553 INFO:teuthology.orchestra.run.smithi049.stdout:/var/run/ceph/ceph-client.1.46882.asok 2024-03-16T07:25:35.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-16T07:25:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-16T07:25:35.564 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.46882.asok 2024-03-16T07:25:35.564 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:25:35.564 DEBUG:teuthology.orchestra.run.smithi049:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.46882.asok status 2024-03-16T07:25:35.707 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-03-16T07:25:35.707 INFO:teuthology.orchestra.run.smithi049.stdout: "metadata": { 2024-03-16T07:25:35.707 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph_sha1": "3d78f5ba07bf18880172c07d4d7b4ac00c9d30af", 2024-03-16T07:25:35.707 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph_version": "ceph version 19.0.0-2162-g3d78f5ba (3d78f5ba07bf18880172c07d4d7b4ac00c9d30af) squid (dev)", 2024-03-16T07:25:35.707 INFO:teuthology.orchestra.run.smithi049.stdout: "entity_id": "1", 2024-03-16T07:25:35.707 INFO:teuthology.orchestra.run.smithi049.stdout: "hostname": "smithi049", 2024-03-16T07:25:35.707 INFO:teuthology.orchestra.run.smithi049.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-03-16T07:25:35.707 INFO:teuthology.orchestra.run.smithi049.stdout: "pid": "46882", 2024-03-16T07:25:35.707 INFO:teuthology.orchestra.run.smithi049.stdout: "root": "/" 2024-03-16T07:25:35.707 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:25:35.707 INFO:teuthology.orchestra.run.smithi049.stdout: "dentry_count": 0, 2024-03-16T07:25:35.707 INFO:teuthology.orchestra.run.smithi049.stdout: "dentry_pinned_count": 0, 2024-03-16T07:25:35.707 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 4600, 2024-03-16T07:25:35.708 INFO:teuthology.orchestra.run.smithi049.stdout: "inst": { 2024-03-16T07:25:35.708 INFO:teuthology.orchestra.run.smithi049.stdout: "name": { 2024-03-16T07:25:35.708 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "client", 2024-03-16T07:25:35.708 INFO:teuthology.orchestra.run.smithi049.stdout: "num": 4600 2024-03-16T07:25:35.708 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:25:35.708 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": { 2024-03-16T07:25:35.708 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2024-03-16T07:25:35.708 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "192.168.0.2:0", 2024-03-16T07:25:35.708 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 4114229944 2024-03-16T07:25:35.708 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:25:35.708 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:25:35.708 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": { 2024-03-16T07:25:35.708 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2024-03-16T07:25:35.708 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "192.168.0.2:0", 2024-03-16T07:25:35.708 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 4114229944 2024-03-16T07:25:35.708 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:25:35.709 INFO:teuthology.orchestra.run.smithi049.stdout: "inst_str": "client.4600 192.168.0.2:0/4114229944", 2024-03-16T07:25:35.709 INFO:teuthology.orchestra.run.smithi049.stdout: "addr_str": "192.168.0.2:0/4114229944", 2024-03-16T07:25:35.709 INFO:teuthology.orchestra.run.smithi049.stdout: "inode_count": 1, 2024-03-16T07:25:35.709 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_epoch": 17, 2024-03-16T07:25:35.709 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_epoch": 28, 2024-03-16T07:25:35.709 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_epoch_barrier": 0, 2024-03-16T07:25:35.709 INFO:teuthology.orchestra.run.smithi049.stdout: "blocklisted": false, 2024-03-16T07:25:35.709 INFO:teuthology.orchestra.run.smithi049.stdout: "fs_name": "cephfs" 2024-03-16T07:25:35.709 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-03-16T07:25:35.715 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:25:35.715 DEBUG:teuthology.orchestra.run.smithi049:> stat --file-system '--printf=%T 2024-03-16T07:25:35.715 DEBUG:teuthology.orchestra.run.smithi049:> ' -- /home/ubuntu/cephtest/mnt.1 2024-03-16T07:25:35.731 INFO:teuthology.orchestra.run.smithi049.stdout:fuseblk 2024-03-16T07:25:35.731 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-03-16T07:25:35.731 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:25:35.731 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-03-16T07:25:35.802 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2024-03-16T07:25:36.789 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T07:25:37.092 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:25:37.093 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":28,"fsid":"f91af061-9eac-4793-87fa-8d27ae3d242f","created":"2024-03-16T07:24:20.357868+0000","modified":"2024-03-16T07:25:27.758329+0000","last_up_change":"2024-03-16T07:24:27.474980+0000","last_in_change":"2024-03-16T07:24:21.254179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T07:24:28.947521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-03-16T07:25:24.035315+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-03-16T07:25:25.110355+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.0800000429153442,"score_stable":1.0800000429153442,"optimal_score":1,"raw_score_acting":1.0800000429153442,"raw_score_stable":1.0800000429153442,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2df14aac-98dc-4e3c-ae7e-9eb677aa30be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6801","nonce":2744935777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6803","nonce":2744935777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6807","nonce":2744935777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6805","nonce":2744935777}]},"public_addr":"172.21.15.49:6801/2744935777","cluster_addr":"172.21.15.49:6803/2744935777","heartbeat_back_addr":"172.21.15.49:6807/2744935777","heartbeat_front_addr":"172.21.15.49:6805/2744935777","state":["exists","up"]},{"osd":1,"uuid":"80461bd9-59ef-46df-9eea-bad92d960c57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6811","nonce":1655120118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6815","nonce":1655120118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6821","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6823","nonce":1655120118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6817","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6819","nonce":1655120118}]},"public_addr":"172.21.15.49:6811/1655120118","cluster_addr":"172.21.15.49:6815/1655120118","heartbeat_back_addr":"172.21.15.49:6823/1655120118","heartbeat_front_addr":"172.21.15.49:6819/1655120118","state":["exists","up"]},{"osd":2,"uuid":"d6bf40eb-6e42-4ec9-8b3d-0b6c5a6def79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6810","nonce":3815472376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6814","nonce":3815472376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6822","nonce":3815472376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6818","nonce":3815472376}]},"public_addr":"172.21.15.49:6810/3815472376","cluster_addr":"172.21.15.49:6814/3815472376","heartbeat_back_addr":"172.21.15.49:6822/3815472376","heartbeat_front_addr":"172.21.15.49:6818/3815472376","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.641492+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.668598+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.614940+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T07:25:37.105 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-16T07:24:28.947521+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-16T07:25:24.035315+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-03-16T07:25:25.110355+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.0800000429153442, 'score_stable': 1.0800000429153442, 'optimal_score': 1, 'raw_score_acting': 1.0800000429153442, 'raw_score_stable': 1.0800000429153442, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-16T07:25:37.105 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-16T07:25:37.409 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2024-03-16T07:25:37.426 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-16T07:25:37.729 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2024-03-16T07:25:37.741 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-16T07:25:38.044 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2024-03-16T07:25:38.057 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-03-16T07:25:38.097 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T07:25:38.359 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:25:38.359 INFO:teuthology.orchestra.run.smithi049.stdout:[ 2024-03-16T07:25:38.360 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:25:38.360 INFO:teuthology.orchestra.run.smithi049.stdout: "poolnum": 1, 2024-03-16T07:25:38.360 INFO:teuthology.orchestra.run.smithi049.stdout: "poolname": ".mgr" 2024-03-16T07:25:38.360 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:25:38.360 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:25:38.360 INFO:teuthology.orchestra.run.smithi049.stdout: "poolnum": 4, 2024-03-16T07:25:38.360 INFO:teuthology.orchestra.run.smithi049.stdout: "poolname": "cephfs_metadata" 2024-03-16T07:25:38.360 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:25:38.360 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:25:38.360 INFO:teuthology.orchestra.run.smithi049.stdout: "poolnum": 5, 2024-03-16T07:25:38.360 INFO:teuthology.orchestra.run.smithi049.stdout: "poolname": "cephfs_data" 2024-03-16T07:25:38.360 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:25:38.360 INFO:teuthology.orchestra.run.smithi049.stdout:] 2024-03-16T07:25:38.372 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'backup_fs' 2024-03-16T07:25:38.372 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create backup_fs_metadata --pg_num_min 64 2024-03-16T07:25:38.780 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'backup_fs_metadata' created 2024-03-16T07:25:38.803 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create backup_fs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-03-16T07:25:39.783 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'backup_fs_data' created 2024-03-16T07:25:39.810 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new backup_fs backup_fs_metadata backup_fs_data 2024-03-16T07:25:40.783 INFO:teuthology.orchestra.run.smithi049.stderr:new fs with metadata pool 6 and data pool 7 2024-03-16T07:25:40.836 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T07:25:41.142 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:25:41.142 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":31,"fsid":"f91af061-9eac-4793-87fa-8d27ae3d242f","created":"2024-03-16T07:24:20.357868+0000","modified":"2024-03-16T07:25:40.160102+0000","last_up_change":"2024-03-16T07:24:27.474980+0000","last_in_change":"2024-03-16T07:24:21.254179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T07:24:28.947521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-03-16T07:25:24.035315+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-03-16T07:25:25.110355+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.0800000429153442,"score_stable":1.0800000429153442,"optimal_score":1,"raw_score_acting":1.0800000429153442,"raw_score_stable":1.0800000429153442,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"backup_fs_metadata","create_time":"2024-03-16T07:25:38.710921+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"backup_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.2200000286102295,"score_stable":1.2200000286102295,"optimal_score":1,"raw_score_acting":1.2200000286102295,"raw_score_stable":1.2200000286102295,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"backup_fs_data","create_time":"2024-03-16T07:25:39.142890+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"backup_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.2200000286102295,"score_stable":1.2200000286102295,"optimal_score":1,"raw_score_acting":1.2200000286102295,"raw_score_stable":1.2200000286102295,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2df14aac-98dc-4e3c-ae7e-9eb677aa30be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6801","nonce":2744935777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6803","nonce":2744935777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6807","nonce":2744935777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6805","nonce":2744935777}]},"public_addr":"172.21.15.49:6801/2744935777","cluster_addr":"172.21.15.49:6803/2744935777","heartbeat_back_addr":"172.21.15.49:6807/2744935777","heartbeat_front_addr":"172.21.15.49:6805/2744935777","state":["exists","up"]},{"osd":1,"uuid":"80461bd9-59ef-46df-9eea-bad92d960c57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6811","nonce":1655120118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6815","nonce":1655120118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6821","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6823","nonce":1655120118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6817","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6819","nonce":1655120118}]},"public_addr":"172.21.15.49:6811/1655120118","cluster_addr":"172.21.15.49:6815/1655120118","heartbeat_back_addr":"172.21.15.49:6823/1655120118","heartbeat_front_addr":"172.21.15.49:6819/1655120118","state":["exists","up"]},{"osd":2,"uuid":"d6bf40eb-6e42-4ec9-8b3d-0b6c5a6def79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6810","nonce":3815472376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6814","nonce":3815472376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6822","nonce":3815472376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6818","nonce":3815472376}]},"public_addr":"172.21.15.49:6810/3815472376","cluster_addr":"172.21.15.49:6814/3815472376","heartbeat_back_addr":"172.21.15.49:6822/3815472376","heartbeat_front_addr":"172.21.15.49:6818/3815472376","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.641492+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.668598+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.614940+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T07:25:41.160 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T07:25:41.468 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:25:41.468 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":31,"fsid":"f91af061-9eac-4793-87fa-8d27ae3d242f","created":"2024-03-16T07:24:20.357868+0000","modified":"2024-03-16T07:25:40.160102+0000","last_up_change":"2024-03-16T07:24:27.474980+0000","last_in_change":"2024-03-16T07:24:21.254179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T07:24:28.947521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-03-16T07:25:24.035315+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-03-16T07:25:25.110355+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.0800000429153442,"score_stable":1.0800000429153442,"optimal_score":1,"raw_score_acting":1.0800000429153442,"raw_score_stable":1.0800000429153442,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"backup_fs_metadata","create_time":"2024-03-16T07:25:38.710921+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"backup_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.2200000286102295,"score_stable":1.2200000286102295,"optimal_score":1,"raw_score_acting":1.2200000286102295,"raw_score_stable":1.2200000286102295,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"backup_fs_data","create_time":"2024-03-16T07:25:39.142890+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"backup_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.2200000286102295,"score_stable":1.2200000286102295,"optimal_score":1,"raw_score_acting":1.2200000286102295,"raw_score_stable":1.2200000286102295,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2df14aac-98dc-4e3c-ae7e-9eb677aa30be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6801","nonce":2744935777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6803","nonce":2744935777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6807","nonce":2744935777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6805","nonce":2744935777}]},"public_addr":"172.21.15.49:6801/2744935777","cluster_addr":"172.21.15.49:6803/2744935777","heartbeat_back_addr":"172.21.15.49:6807/2744935777","heartbeat_front_addr":"172.21.15.49:6805/2744935777","state":["exists","up"]},{"osd":1,"uuid":"80461bd9-59ef-46df-9eea-bad92d960c57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6811","nonce":1655120118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6815","nonce":1655120118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6821","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6823","nonce":1655120118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6817","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6819","nonce":1655120118}]},"public_addr":"172.21.15.49:6811/1655120118","cluster_addr":"172.21.15.49:6815/1655120118","heartbeat_back_addr":"172.21.15.49:6823/1655120118","heartbeat_front_addr":"172.21.15.49:6819/1655120118","state":["exists","up"]},{"osd":2,"uuid":"d6bf40eb-6e42-4ec9-8b3d-0b6c5a6def79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6810","nonce":3815472376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6814","nonce":3815472376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6822","nonce":3815472376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6818","nonce":3815472376}]},"public_addr":"172.21.15.49:6810/3815472376","cluster_addr":"172.21.15.49:6814/3815472376","heartbeat_back_addr":"172.21.15.49:6822/3815472376","heartbeat_front_addr":"172.21.15.49:6818/3815472376","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.641492+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.668598+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.614940+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T07:25:41.481 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set backup_fs standby_count_wanted 0 2024-03-16T07:25:42.817 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-03-16T07:25:42.817 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set backup_fs allow_standby_replay false 2024-03-16T07:25:43.820 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'backup_fs' 2024-03-16T07:25:43.820 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T07:25:44.166 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:25:44.166 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":23,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4497,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6827/2700845528","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":2700845528},{"type":"v1","addr":"172.21.15.49:6827","nonce":2700845528}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4502,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6830/1983317600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":1983317600},{"type":"v1","addr":"172.21.15.49:6830","nonce":1983317600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4503,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6831/1363178912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6829","nonce":1363178912},{"type":"v1","addr":"172.21.15.49:6831","nonce":1363178912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-16T07:25:26.124693+0000","modified":"2024-03-16T07:25:29.119108+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4509},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4509":{"gid":4509,"name":"e","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6835/3541821089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":3541821089},{"type":"v1","addr":"172.21.15.49:6835","nonce":3541821089}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4509,"qdb_cluster":[4509]},"id":2},{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-16T07:25:40.160397+0000","modified":"2024-03-16T07:25:43.171652+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4506},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4506":{"gid":4506,"name":"c","rank":0,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.49:6833/4243939102","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":4243939102},{"type":"v1","addr":"172.21.15.49:6833","nonce":4243939102}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"backup_fs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4506,"qdb_cluster":[4506]},"id":3}]} 2024-03-16T07:25:44.166 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 23 2024-03-16T07:25:44.178 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T07:25:44.570 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:25:44.570 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":32,"fsid":"f91af061-9eac-4793-87fa-8d27ae3d242f","created":"2024-03-16T07:24:20.357868+0000","modified":"2024-03-16T07:25:41.798369+0000","last_up_change":"2024-03-16T07:24:27.474980+0000","last_in_change":"2024-03-16T07:24:21.254179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T07:24:28.947521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-03-16T07:25:24.035315+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-03-16T07:25:25.110355+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.0800000429153442,"score_stable":1.0800000429153442,"optimal_score":1,"raw_score_acting":1.0800000429153442,"raw_score_stable":1.0800000429153442,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"backup_fs_metadata","create_time":"2024-03-16T07:25:38.710921+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"backup_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.2200000286102295,"score_stable":1.2200000286102295,"optimal_score":1,"raw_score_acting":1.2200000286102295,"raw_score_stable":1.2200000286102295,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"backup_fs_data","create_time":"2024-03-16T07:25:39.142890+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"backup_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.2200000286102295,"score_stable":1.2200000286102295,"optimal_score":1,"raw_score_acting":1.2200000286102295,"raw_score_stable":1.2200000286102295,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2df14aac-98dc-4e3c-ae7e-9eb677aa30be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6801","nonce":2744935777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6803","nonce":2744935777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6807","nonce":2744935777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6805","nonce":2744935777}]},"public_addr":"172.21.15.49:6801/2744935777","cluster_addr":"172.21.15.49:6803/2744935777","heartbeat_back_addr":"172.21.15.49:6807/2744935777","heartbeat_front_addr":"172.21.15.49:6805/2744935777","state":["exists","up"]},{"osd":1,"uuid":"80461bd9-59ef-46df-9eea-bad92d960c57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6811","nonce":1655120118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6815","nonce":1655120118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6821","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6823","nonce":1655120118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6817","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6819","nonce":1655120118}]},"public_addr":"172.21.15.49:6811/1655120118","cluster_addr":"172.21.15.49:6815/1655120118","heartbeat_back_addr":"172.21.15.49:6823/1655120118","heartbeat_front_addr":"172.21.15.49:6819/1655120118","state":["exists","up"]},{"osd":2,"uuid":"d6bf40eb-6e42-4ec9-8b3d-0b6c5a6def79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6810","nonce":3815472376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6814","nonce":3815472376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6822","nonce":3815472376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6818","nonce":3815472376}]},"public_addr":"172.21.15.49:6810/3815472376","cluster_addr":"172.21.15.49:6814/3815472376","heartbeat_back_addr":"172.21.15.49:6822/3815472376","heartbeat_front_addr":"172.21.15.49:6818/3815472376","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.641492+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.668598+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.614940+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T07:25:44.583 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-03-16T07:25:44.583 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-16T07:25:44.933 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:25:44.936 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2024-03-16T07:25:44.943 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":65,"stamp":"2024-03-16T07:25:44.910225+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596885,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":230,"num_write_kb":1925,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":178,"ondisk_log_size":178,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":226,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":314572800,"kb_used":95676,"kb_used_data":2128,"kb_used_omap":4,"kb_used_meta":93499,"kb_avail":314477124,"statfs":{"total":322122547200,"available":322024574976,"internally_reserved":0,"allocated":2179072,"data_stored":1498383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":95743311},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001022"},"pg_stats":[{"pgid":"7.6","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-16T07:25:40.830149+0000","last_change":"2024-03-16T07:25:40.829330+0000","last_active":"2024-03-16T07:25:40.830149+0000","last_peered":"2024-03-16T07:25:40.830149+0000","last_clean":"2024-03-16T07:25:40.830149+0000","last_became_active":"2024-03-16T07:25:40.829091+0000","last_became_peered":"2024-03-16T07:25:40.829091+0000","last_unstale":"2024-03-16T07:25:40.830149+0000","last_undegraded":"2024-03-16T07:25:40.830149+0000","last_fullsized":"2024-03-16T07:25:40.830149+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_clean_scrub_stamp":"2024-03-16T07:25:39.782521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:17:30.080005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'97","reported_seq":177,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.807111+0000","last_change":"2024-03-16T07:24:31.650537+0000","last_active":"2024-03-16T07:25:41.807111+0000","last_peered":"2024-03-16T07:25:41.807111+0000","last_clean":"2024-03-16T07:25:41.807111+0000","last_became_active":"2024-03-16T07:24:31.649574+0000","last_became_peered":"2024-03-16T07:24:31.649574+0000","last_unstale":"2024-03-16T07:25:41.807111+0000","last_undegraded":"2024-03-16T07:25:41.807111+0000","last_fullsized":"2024-03-16T07:25:41.807111+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:29.719970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:29.719970+0000","last_clean_scrub_stamp":"2024-03-16T07:24:29.719970+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:31:35.774554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.805415+0000","last_change":"2024-03-16T07:25:25.766868+0000","last_active":"2024-03-16T07:25:41.805415+0000","last_peered":"2024-03-16T07:25:41.805415+0000","last_clean":"2024-03-16T07:25:41.805415+0000","last_became_active":"2024-03-16T07:25:25.766116+0000","last_became_peered":"2024-03-16T07:25:25.766116+0000","last_unstale":"2024-03-16T07:25:41.805415+0000","last_undegraded":"2024-03-16T07:25:41.805415+0000","last_fullsized":"2024-03-16T07:25:41.805415+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_clean_scrub_stamp":"2024-03-16T07:25:24.745467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:27:23.414873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-16T07:25:40.788951+0000","last_change":"2024-03-16T07:25:26.774790+0000","last_active":"2024-03-16T07:25:40.788951+0000","last_peered":"2024-03-16T07:25:40.788951+0000","last_clean":"2024-03-16T07:25:40.788951+0000","last_became_active":"2024-03-16T07:25:26.774186+0000","last_became_peered":"2024-03-16T07:25:26.774186+0000","last_unstale":"2024-03-16T07:25:40.788951+0000","last_undegraded":"2024-03-16T07:25:40.788951+0000","last_fullsized":"2024-03-16T07:25:40.788951+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:20:23.541708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"31'2","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-16T07:25:40.828636+0000","last_change":"2024-03-16T07:25:39.811684+0000","last_active":"2024-03-16T07:25:40.828636+0000","last_peered":"2024-03-16T07:25:40.828636+0000","last_clean":"2024-03-16T07:25:40.828636+0000","last_became_active":"2024-03-16T07:25:39.811288+0000","last_became_peered":"2024-03-16T07:25:39.811288+0000","last_unstale":"2024-03-16T07:25:40.828636+0000","last_undegraded":"2024-03-16T07:25:40.828636+0000","last_fullsized":"2024-03-16T07:25:40.828636+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:38.779484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:38.779484+0000","last_clean_scrub_stamp":"2024-03-16T07:25:38.779484+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:16:10.819666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-16T07:25:40.830180+0000","last_change":"2024-03-16T07:25:40.829297+0000","last_active":"2024-03-16T07:25:40.830180+0000","last_peered":"2024-03-16T07:25:40.830180+0000","last_clean":"2024-03-16T07:25:40.830180+0000","last_became_active":"2024-03-16T07:25:40.828924+0000","last_became_peered":"2024-03-16T07:25:40.828924+0000","last_unstale":"2024-03-16T07:25:40.830180+0000","last_undegraded":"2024-03-16T07:25:40.830180+0000","last_fullsized":"2024-03-16T07:25:40.830180+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_clean_scrub_stamp":"2024-03-16T07:25:39.782521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:10:02.901457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":20,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-16T07:25:40.789649+0000","last_change":"2024-03-16T07:25:25.771801+0000","last_active":"2024-03-16T07:25:40.789649+0000","last_peered":"2024-03-16T07:25:40.789649+0000","last_clean":"2024-03-16T07:25:40.789649+0000","last_became_active":"2024-03-16T07:25:25.771527+0000","last_became_peered":"2024-03-16T07:25:25.771527+0000","last_unstale":"2024-03-16T07:25:40.789649+0000","last_undegraded":"2024-03-16T07:25:40.789649+0000","last_fullsized":"2024-03-16T07:25:40.789649+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_clean_scrub_stamp":"2024-03-16T07:25:24.745467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:58:27.329136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.803701+0000","last_change":"2024-03-16T07:25:26.783268+0000","last_active":"2024-03-16T07:25:41.803701+0000","last_peered":"2024-03-16T07:25:41.803701+0000","last_clean":"2024-03-16T07:25:41.803701+0000","last_became_active":"2024-03-16T07:25:26.782999+0000","last_became_peered":"2024-03-16T07:25:26.782999+0000","last_unstale":"2024-03-16T07:25:41.803701+0000","last_undegraded":"2024-03-16T07:25:41.803701+0000","last_fullsized":"2024-03-16T07:25:41.803701+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:56:24.824794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.805519+0000","last_change":"2024-03-16T07:25:39.803593+0000","last_active":"2024-03-16T07:25:41.805519+0000","last_peered":"2024-03-16T07:25:41.805519+0000","last_clean":"2024-03-16T07:25:41.805519+0000","last_became_active":"2024-03-16T07:25:39.803225+0000","last_became_peered":"2024-03-16T07:25:39.803225+0000","last_unstale":"2024-03-16T07:25:41.805519+0000","last_undegraded":"2024-03-16T07:25:41.805519+0000","last_fullsized":"2024-03-16T07:25:41.805519+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:38.779484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:38.779484+0000","last_clean_scrub_stamp":"2024-03-16T07:25:38.779484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:14:23.265309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.805071+0000","last_change":"2024-03-16T07:25:40.819154+0000","last_active":"2024-03-16T07:25:41.805071+0000","last_peered":"2024-03-16T07:25:41.805071+0000","last_clean":"2024-03-16T07:25:41.805071+0000","last_became_active":"2024-03-16T07:25:40.815805+0000","last_became_peered":"2024-03-16T07:25:40.815805+0000","last_unstale":"2024-03-16T07:25:41.805071+0000","last_undegraded":"2024-03-16T07:25:41.805071+0000","last_fullsized":"2024-03-16T07:25:41.805071+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_clean_scrub_stamp":"2024-03-16T07:25:39.782521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:16:11.822703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.803996+0000","last_change":"2024-03-16T07:25:25.769122+0000","last_active":"2024-03-16T07:25:41.803996+0000","last_peered":"2024-03-16T07:25:41.803996+0000","last_clean":"2024-03-16T07:25:41.803996+0000","last_became_active":"2024-03-16T07:25:25.768867+0000","last_became_peered":"2024-03-16T07:25:25.768867+0000","last_unstale":"2024-03-16T07:25:41.803996+0000","last_undegraded":"2024-03-16T07:25:41.803996+0000","last_fullsized":"2024-03-16T07:25:41.803996+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_clean_scrub_stamp":"2024-03-16T07:25:24.745467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:31:27.516098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.805989+0000","last_change":"2024-03-16T07:25:26.791209+0000","last_active":"2024-03-16T07:25:41.805989+0000","last_peered":"2024-03-16T07:25:41.805989+0000","last_clean":"2024-03-16T07:25:41.805989+0000","last_became_active":"2024-03-16T07:25:26.790886+0000","last_became_peered":"2024-03-16T07:25:26.790886+0000","last_unstale":"2024-03-16T07:25:41.805989+0000","last_undegraded":"2024-03-16T07:25:41.805989+0000","last_fullsized":"2024-03-16T07:25:41.805989+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:13:26.639460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-16T07:25:40.793239+0000","last_change":"2024-03-16T07:25:39.812175+0000","last_active":"2024-03-16T07:25:40.793239+0000","last_peered":"2024-03-16T07:25:40.793239+0000","last_clean":"2024-03-16T07:25:40.793239+0000","last_became_active":"2024-03-16T07:25:39.811716+0000","last_became_peered":"2024-03-16T07:25:39.811716+0000","last_unstale":"2024-03-16T07:25:40.793239+0000","last_undegraded":"2024-03-16T07:25:40.793239+0000","last_fullsized":"2024-03-16T07:25:40.793239+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:38.779484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:38.779484+0000","last_clean_scrub_stamp":"2024-03-16T07:25:38.779484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:29:41.295588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.804802+0000","last_change":"2024-03-16T07:25:40.820109+0000","last_active":"2024-03-16T07:25:41.804802+0000","last_peered":"2024-03-16T07:25:41.804802+0000","last_clean":"2024-03-16T07:25:41.804802+0000","last_became_active":"2024-03-16T07:25:40.819894+0000","last_became_peered":"2024-03-16T07:25:40.819894+0000","last_unstale":"2024-03-16T07:25:41.804802+0000","last_undegraded":"2024-03-16T07:25:41.804802+0000","last_fullsized":"2024-03-16T07:25:41.804802+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_clean_scrub_stamp":"2024-03-16T07:25:39.782521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:30:09.484996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.803395+0000","last_change":"2024-03-16T07:25:25.770422+0000","last_active":"2024-03-16T07:25:41.803395+0000","last_peered":"2024-03-16T07:25:41.803395+0000","last_clean":"2024-03-16T07:25:41.803395+0000","last_became_active":"2024-03-16T07:25:25.770153+0000","last_became_peered":"2024-03-16T07:25:25.770153+0000","last_unstale":"2024-03-16T07:25:41.803395+0000","last_undegraded":"2024-03-16T07:25:41.803395+0000","last_fullsized":"2024-03-16T07:25:41.803395+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_clean_scrub_stamp":"2024-03-16T07:25:24.745467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:21:53.419532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-16T07:25:40.792513+0000","last_change":"2024-03-16T07:25:26.797291+0000","last_active":"2024-03-16T07:25:40.792513+0000","last_peered":"2024-03-16T07:25:40.792513+0000","last_clean":"2024-03-16T07:25:40.792513+0000","last_became_active":"2024-03-16T07:25:26.794780+0000","last_became_peered":"2024-03-16T07:25:26.794780+0000","last_unstale":"2024-03-16T07:25:40.792513+0000","last_undegraded":"2024-03-16T07:25:40.792513+0000","last_fullsized":"2024-03-16T07:25:40.792513+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:38:56.222762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-16T07:25:40.788979+0000","last_change":"2024-03-16T07:25:39.810268+0000","last_active":"2024-03-16T07:25:40.788979+0000","last_peered":"2024-03-16T07:25:40.788979+0000","last_clean":"2024-03-16T07:25:40.788979+0000","last_became_active":"2024-03-16T07:25:39.807126+0000","last_became_peered":"2024-03-16T07:25:39.807126+0000","last_unstale":"2024-03-16T07:25:40.788979+0000","last_undegraded":"2024-03-16T07:25:40.788979+0000","last_fullsized":"2024-03-16T07:25:40.788979+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:38.779484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:38.779484+0000","last_clean_scrub_stamp":"2024-03-16T07:25:38.779484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:39:56.614958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.807004+0000","last_change":"2024-03-16T07:25:40.827237+0000","last_active":"2024-03-16T07:25:41.807004+0000","last_peered":"2024-03-16T07:25:41.807004+0000","last_clean":"2024-03-16T07:25:41.807004+0000","last_became_active":"2024-03-16T07:25:40.826843+0000","last_became_peered":"2024-03-16T07:25:40.826843+0000","last_unstale":"2024-03-16T07:25:41.807004+0000","last_undegraded":"2024-03-16T07:25:41.807004+0000","last_fullsized":"2024-03-16T07:25:41.807004+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_clean_scrub_stamp":"2024-03-16T07:25:39.782521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:44:48.980147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":20,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-16T07:25:40.791430+0000","last_change":"2024-03-16T07:25:25.764585+0000","last_active":"2024-03-16T07:25:40.791430+0000","last_peered":"2024-03-16T07:25:40.791430+0000","last_clean":"2024-03-16T07:25:40.791430+0000","last_became_active":"2024-03-16T07:25:25.764145+0000","last_became_peered":"2024-03-16T07:25:25.764145+0000","last_unstale":"2024-03-16T07:25:40.791430+0000","last_undegraded":"2024-03-16T07:25:40.791430+0000","last_fullsized":"2024-03-16T07:25:40.791430+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_clean_scrub_stamp":"2024-03-16T07:25:24.745467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:04:30.099786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-16T07:25:40.789589+0000","last_change":"2024-03-16T07:25:26.776390+0000","last_active":"2024-03-16T07:25:40.789589+0000","last_peered":"2024-03-16T07:25:40.789589+0000","last_clean":"2024-03-16T07:25:40.789589+0000","last_became_active":"2024-03-16T07:25:26.776048+0000","last_became_peered":"2024-03-16T07:25:26.776048+0000","last_unstale":"2024-03-16T07:25:40.789589+0000","last_undegraded":"2024-03-16T07:25:40.789589+0000","last_fullsized":"2024-03-16T07:25:40.789589+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:51:04.025947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.804256+0000","last_change":"2024-03-16T07:25:39.809328+0000","last_active":"2024-03-16T07:25:41.804256+0000","last_peered":"2024-03-16T07:25:41.804256+0000","last_clean":"2024-03-16T07:25:41.804256+0000","last_became_active":"2024-03-16T07:25:39.809093+0000","last_became_peered":"2024-03-16T07:25:39.809093+0000","last_unstale":"2024-03-16T07:25:41.804256+0000","last_undegraded":"2024-03-16T07:25:41.804256+0000","last_fullsized":"2024-03-16T07:25:41.804256+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:38.779484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:38.779484+0000","last_clean_scrub_stamp":"2024-03-16T07:25:38.779484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:20:20.029111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.810726+0000","last_change":"2024-03-16T07:25:40.826272+0000","last_active":"2024-03-16T07:25:41.810726+0000","last_peered":"2024-03-16T07:25:41.810726+0000","last_clean":"2024-03-16T07:25:41.810726+0000","last_became_active":"2024-03-16T07:25:40.826021+0000","last_became_peered":"2024-03-16T07:25:40.826021+0000","last_unstale":"2024-03-16T07:25:41.810726+0000","last_undegraded":"2024-03-16T07:25:41.810726+0000","last_fullsized":"2024-03-16T07:25:41.810726+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_clean_scrub_stamp":"2024-03-16T07:25:39.782521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:45:18.030885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.804963+0000","last_change":"2024-03-16T07:25:25.766122+0000","last_active":"2024-03-16T07:25:41.804963+0000","last_peered":"2024-03-16T07:25:41.804963+0000","last_clean":"2024-03-16T07:25:41.804963+0000","last_became_active":"2024-03-16T07:25:25.765858+0000","last_became_peered":"2024-03-16T07:25:25.765858+0000","last_unstale":"2024-03-16T07:25:41.804963+0000","last_undegraded":"2024-03-16T07:25:41.804963+0000","last_fullsized":"2024-03-16T07:25:41.804963+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_clean_scrub_stamp":"2024-03-16T07:25:24.745467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:31:45.647975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-16T07:25:40.792176+0000","last_change":"2024-03-16T07:25:26.796631+0000","last_active":"2024-03-16T07:25:40.792176+0000","last_peered":"2024-03-16T07:25:40.792176+0000","last_clean":"2024-03-16T07:25:40.792176+0000","last_became_active":"2024-03-16T07:25:26.795444+0000","last_became_peered":"2024-03-16T07:25:26.795444+0000","last_unstale":"2024-03-16T07:25:40.792176+0000","last_undegraded":"2024-03-16T07:25:40.792176+0000","last_fullsized":"2024-03-16T07:25:40.792176+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:24:20.038095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"32'1","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:42.791246+0000","last_change":"2024-03-16T07:25:39.810716+0000","last_active":"2024-03-16T07:25:42.791246+0000","last_peered":"2024-03-16T07:25:42.791246+0000","last_clean":"2024-03-16T07:25:42.791246+0000","last_became_active":"2024-03-16T07:25:39.810469+0000","last_became_peered":"2024-03-16T07:25:39.810469+0000","last_unstale":"2024-03-16T07:25:42.791246+0000","last_undegraded":"2024-03-16T07:25:42.791246+0000","last_fullsized":"2024-03-16T07:25:42.791246+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:38.779484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:38.779484+0000","last_clean_scrub_stamp":"2024-03-16T07:25:38.779484+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:30:27.102059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.808032+0000","last_change":"2024-03-16T07:25:40.809010+0000","last_active":"2024-03-16T07:25:41.808032+0000","last_peered":"2024-03-16T07:25:41.808032+0000","last_clean":"2024-03-16T07:25:41.808032+0000","last_became_active":"2024-03-16T07:25:40.808769+0000","last_became_peered":"2024-03-16T07:25:40.808769+0000","last_unstale":"2024-03-16T07:25:41.808032+0000","last_undegraded":"2024-03-16T07:25:41.808032+0000","last_fullsized":"2024-03-16T07:25:41.808032+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_clean_scrub_stamp":"2024-03-16T07:25:39.782521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:43:35.925010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"28'1","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-16T07:25:40.791259+0000","last_change":"2024-03-16T07:25:25.773182+0000","last_active":"2024-03-16T07:25:40.791259+0000","last_peered":"2024-03-16T07:25:40.791259+0000","last_clean":"2024-03-16T07:25:40.791259+0000","last_became_active":"2024-03-16T07:25:25.772861+0000","last_became_peered":"2024-03-16T07:25:25.772861+0000","last_unstale":"2024-03-16T07:25:40.791259+0000","last_undegraded":"2024-03-16T07:25:40.791259+0000","last_fullsized":"2024-03-16T07:25:40.791259+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_clean_scrub_stamp":"2024-03-16T07:25:24.745467+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:35:13.105887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-16T07:25:40.791802+0000","last_change":"2024-03-16T07:25:26.797488+0000","last_active":"2024-03-16T07:25:40.791802+0000","last_peered":"2024-03-16T07:25:40.791802+0000","last_clean":"2024-03-16T07:25:40.791802+0000","last_became_active":"2024-03-16T07:25:26.794894+0000","last_became_peered":"2024-03-16T07:25:26.794894+0000","last_unstale":"2024-03-16T07:25:40.791802+0000","last_undegraded":"2024-03-16T07:25:40.791802+0000","last_fullsized":"2024-03-16T07:25:40.791802+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:29:04.480593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.805944+0000","last_change":"2024-03-16T07:25:39.816151+0000","last_active":"2024-03-16T07:25:41.805944+0000","last_peered":"2024-03-16T07:25:41.805944+0000","last_clean":"2024-03-16T07:25:41.805944+0000","last_became_active":"2024-03-16T07:25:39.815863+0000","last_became_peered":"2024-03-16T07:25:39.815863+0000","last_unstale":"2024-03-16T07:25:41.805944+0000","last_undegraded":"2024-03-16T07:25:41.805944+0000","last_fullsized":"2024-03-16T07:25:41.805944+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:38.779484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:38.779484+0000","last_clean_scrub_stamp":"2024-03-16T07:25:38.779484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:39:09.255406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-16T07:25:40.817241+0000","last_change":"2024-03-16T07:25:40.812403+0000","last_active":"2024-03-16T07:25:40.817241+0000","last_peered":"2024-03-16T07:25:40.817241+0000","last_clean":"2024-03-16T07:25:40.817241+0000","last_became_active":"2024-03-16T07:25:40.812080+0000","last_became_peered":"2024-03-16T07:25:40.812080+0000","last_unstale":"2024-03-16T07:25:40.817241+0000","last_undegraded":"2024-03-16T07:25:40.817241+0000","last_fullsized":"2024-03-16T07:25:40.817241+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_clean_scrub_stamp":"2024-03-16T07:25:39.782521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:28:29.876723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"27'2","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.806940+0000","last_change":"2024-03-16T07:25:25.771377+0000","last_active":"2024-03-16T07:25:41.806940+0000","last_peered":"2024-03-16T07:25:41.806940+0000","last_clean":"2024-03-16T07:25:41.806940+0000","last_became_active":"2024-03-16T07:25:25.771098+0000","last_became_peered":"2024-03-16T07:25:25.771098+0000","last_unstale":"2024-03-16T07:25:41.806940+0000","last_undegraded":"2024-03-16T07:25:41.806940+0000","last_fullsized":"2024-03-16T07:25:41.806940+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_clean_scrub_stamp":"2024-03-16T07:25:24.745467+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:05:38.205183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.809664+0000","last_change":"2024-03-16T07:25:26.787104+0000","last_active":"2024-03-16T07:25:41.809664+0000","last_peered":"2024-03-16T07:25:41.809664+0000","last_clean":"2024-03-16T07:25:41.809664+0000","last_became_active":"2024-03-16T07:25:26.786575+0000","last_became_peered":"2024-03-16T07:25:26.786575+0000","last_unstale":"2024-03-16T07:25:41.809664+0000","last_undegraded":"2024-03-16T07:25:41.809664+0000","last_fullsized":"2024-03-16T07:25:41.809664+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:52:53.885034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-16T07:25:40.793116+0000","last_change":"2024-03-16T07:25:39.808069+0000","last_active":"2024-03-16T07:25:40.793116+0000","last_peered":"2024-03-16T07:25:40.793116+0000","last_clean":"2024-03-16T07:25:40.793116+0000","last_became_active":"2024-03-16T07:25:39.807716+0000","last_became_peered":"2024-03-16T07:25:39.807716+0000","last_unstale":"2024-03-16T07:25:40.793116+0000","last_undegraded":"2024-03-16T07:25:40.793116+0000","last_fullsized":"2024-03-16T07:25:40.793116+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:38.779484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:38.779484+0000","last_clean_scrub_stamp":"2024-03-16T07:25:38.779484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:49:50.182222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.805925+0000","last_change":"2024-03-16T07:25:40.823734+0000","last_active":"2024-03-16T07:25:41.805925+0000","last_peered":"2024-03-16T07:25:41.805925+0000","last_clean":"2024-03-16T07:25:41.805925+0000","last_became_active":"2024-03-16T07:25:40.823493+0000","last_became_peered":"2024-03-16T07:25:40.823493+0000","last_unstale":"2024-03-16T07:25:41.805925+0000","last_undegraded":"2024-03-16T07:25:41.805925+0000","last_fullsized":"2024-03-16T07:25:41.805925+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_clean_scrub_stamp":"2024-03-16T07:25:39.782521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:16:11.822703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.806831+0000","last_change":"2024-03-16T07:25:25.775102+0000","last_active":"2024-03-16T07:25:41.806831+0000","last_peered":"2024-03-16T07:25:41.806831+0000","last_clean":"2024-03-16T07:25:41.806831+0000","last_became_active":"2024-03-16T07:25:25.774651+0000","last_became_peered":"2024-03-16T07:25:25.774651+0000","last_unstale":"2024-03-16T07:25:41.806831+0000","last_undegraded":"2024-03-16T07:25:41.806831+0000","last_fullsized":"2024-03-16T07:25:41.806831+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_clean_scrub_stamp":"2024-03-16T07:25:24.745467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:46:35.716476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.803919+0000","last_change":"2024-03-16T07:25:26.788813+0000","last_active":"2024-03-16T07:25:41.803919+0000","last_peered":"2024-03-16T07:25:41.803919+0000","last_clean":"2024-03-16T07:25:41.803919+0000","last_became_active":"2024-03-16T07:25:26.788546+0000","last_became_peered":"2024-03-16T07:25:26.788546+0000","last_unstale":"2024-03-16T07:25:41.803919+0000","last_undegraded":"2024-03-16T07:25:41.803919+0000","last_fullsized":"2024-03-16T07:25:41.803919+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:15:25.308866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-16T07:25:40.790498+0000","last_change":"2024-03-16T07:25:39.807821+0000","last_active":"2024-03-16T07:25:40.790498+0000","last_peered":"2024-03-16T07:25:40.790498+0000","last_clean":"2024-03-16T07:25:40.790498+0000","last_became_active":"2024-03-16T07:25:39.807201+0000","last_became_peered":"2024-03-16T07:25:39.807201+0000","last_unstale":"2024-03-16T07:25:40.790498+0000","last_undegraded":"2024-03-16T07:25:40.790498+0000","last_fullsized":"2024-03-16T07:25:40.790498+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:38.779484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:38.779484+0000","last_clean_scrub_stamp":"2024-03-16T07:25:38.779484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:08:44.275402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.804832+0000","last_change":"2024-03-16T07:25:40.818955+0000","last_active":"2024-03-16T07:25:41.804832+0000","last_peered":"2024-03-16T07:25:41.804832+0000","last_clean":"2024-03-16T07:25:41.804832+0000","last_became_active":"2024-03-16T07:25:40.815283+0000","last_became_peered":"2024-03-16T07:25:40.815283+0000","last_unstale":"2024-03-16T07:25:41.804832+0000","last_undegraded":"2024-03-16T07:25:41.804832+0000","last_fullsized":"2024-03-16T07:25:41.804832+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_clean_scrub_stamp":"2024-03-16T07:25:39.782521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:26:49.376060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.803536+0000","last_change":"2024-03-16T07:25:25.769426+0000","last_active":"2024-03-16T07:25:41.803536+0000","last_peered":"2024-03-16T07:25:41.803536+0000","last_clean":"2024-03-16T07:25:41.803536+0000","last_became_active":"2024-03-16T07:25:25.769183+0000","last_became_peered":"2024-03-16T07:25:25.769183+0000","last_unstale":"2024-03-16T07:25:41.803536+0000","last_undegraded":"2024-03-16T07:25:41.803536+0000","last_fullsized":"2024-03-16T07:25:41.803536+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_clean_scrub_stamp":"2024-03-16T07:25:24.745467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:23:21.193828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.806074+0000","last_change":"2024-03-16T07:25:26.781283+0000","last_active":"2024-03-16T07:25:41.806074+0000","last_peered":"2024-03-16T07:25:41.806074+0000","last_clean":"2024-03-16T07:25:41.806074+0000","last_became_active":"2024-03-16T07:25:26.781030+0000","last_became_peered":"2024-03-16T07:25:26.781030+0000","last_unstale":"2024-03-16T07:25:41.806074+0000","last_undegraded":"2024-03-16T07:25:41.806074+0000","last_fullsized":"2024-03-16T07:25:41.806074+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:24:13.541892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"31'2","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.805251+0000","last_change":"2024-03-16T07:25:39.814162+0000","last_active":"2024-03-16T07:25:41.805251+0000","last_peered":"2024-03-16T07:25:41.805251+0000","last_clean":"2024-03-16T07:25:41.805251+0000","last_became_active":"2024-03-16T07:25:39.813908+0000","last_became_peered":"2024-03-16T07:25:39.813908+0000","last_unstale":"2024-03-16T07:25:41.805251+0000","last_undegraded":"2024-03-16T07:25:41.805251+0000","last_fullsized":"2024-03-16T07:25:41.805251+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:38.779484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:38.779484+0000","last_clean_scrub_stamp":"2024-03-16T07:25:38.779484+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:11:41.117211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-16T07:25:40.829923+0000","last_change":"2024-03-16T07:25:40.824183+0000","last_active":"2024-03-16T07:25:40.829923+0000","last_peered":"2024-03-16T07:25:40.829923+0000","last_clean":"2024-03-16T07:25:40.829923+0000","last_became_active":"2024-03-16T07:25:40.823902+0000","last_became_peered":"2024-03-16T07:25:40.823902+0000","last_unstale":"2024-03-16T07:25:40.829923+0000","last_undegraded":"2024-03-16T07:25:40.829923+0000","last_fullsized":"2024-03-16T07:25:40.829923+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_clean_scrub_stamp":"2024-03-16T07:25:39.782521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:27:28.185344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.804124+0000","last_change":"2024-03-16T07:25:25.776342+0000","last_active":"2024-03-16T07:25:41.804124+0000","last_peered":"2024-03-16T07:25:41.804124+0000","last_clean":"2024-03-16T07:25:41.804124+0000","last_became_active":"2024-03-16T07:25:25.776083+0000","last_became_peered":"2024-03-16T07:25:25.776083+0000","last_unstale":"2024-03-16T07:25:41.804124+0000","last_undegraded":"2024-03-16T07:25:41.804124+0000","last_fullsized":"2024-03-16T07:25:41.804124+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_clean_scrub_stamp":"2024-03-16T07:25:24.745467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:22:26.980496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.807656+0000","last_change":"2024-03-16T07:25:26.782666+0000","last_active":"2024-03-16T07:25:41.807656+0000","last_peered":"2024-03-16T07:25:41.807656+0000","last_clean":"2024-03-16T07:25:41.807656+0000","last_became_active":"2024-03-16T07:25:26.781644+0000","last_became_peered":"2024-03-16T07:25:26.781644+0000","last_unstale":"2024-03-16T07:25:41.807656+0000","last_undegraded":"2024-03-16T07:25:41.807656+0000","last_fullsized":"2024-03-16T07:25:41.807656+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:44:15.933653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.806645+0000","last_change":"2024-03-16T07:25:39.816300+0000","last_active":"2024-03-16T07:25:41.806645+0000","last_peered":"2024-03-16T07:25:41.806645+0000","last_clean":"2024-03-16T07:25:41.806645+0000","last_became_active":"2024-03-16T07:25:39.815329+0000","last_became_peered":"2024-03-16T07:25:39.815329+0000","last_unstale":"2024-03-16T07:25:41.806645+0000","last_undegraded":"2024-03-16T07:25:41.806645+0000","last_fullsized":"2024-03-16T07:25:41.806645+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:38.779484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:38.779484+0000","last_clean_scrub_stamp":"2024-03-16T07:25:38.779484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:24:33.070739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.805892+0000","last_change":"2024-03-16T07:25:40.818544+0000","last_active":"2024-03-16T07:25:41.805892+0000","last_peered":"2024-03-16T07:25:41.805892+0000","last_clean":"2024-03-16T07:25:41.805892+0000","last_became_active":"2024-03-16T07:25:40.814772+0000","last_became_peered":"2024-03-16T07:25:40.814772+0000","last_unstale":"2024-03-16T07:25:41.805892+0000","last_undegraded":"2024-03-16T07:25:41.805892+0000","last_fullsized":"2024-03-16T07:25:41.805892+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_clean_scrub_stamp":"2024-03-16T07:25:39.782521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:29:42.298625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"27'2","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-16T07:25:40.791701+0000","last_change":"2024-03-16T07:25:25.772458+0000","last_active":"2024-03-16T07:25:40.791701+0000","last_peered":"2024-03-16T07:25:40.791701+0000","last_clean":"2024-03-16T07:25:40.791701+0000","last_became_active":"2024-03-16T07:25:25.772025+0000","last_became_peered":"2024-03-16T07:25:25.772025+0000","last_unstale":"2024-03-16T07:25:40.791701+0000","last_undegraded":"2024-03-16T07:25:40.791701+0000","last_fullsized":"2024-03-16T07:25:40.791701+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_clean_scrub_stamp":"2024-03-16T07:25:24.745467+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:13:25.638087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.804361+0000","last_change":"2024-03-16T07:25:26.780721+0000","last_active":"2024-03-16T07:25:41.804361+0000","last_peered":"2024-03-16T07:25:41.804361+0000","last_clean":"2024-03-16T07:25:41.804361+0000","last_became_active":"2024-03-16T07:25:26.780222+0000","last_became_peered":"2024-03-16T07:25:26.780222+0000","last_unstale":"2024-03-16T07:25:41.804361+0000","last_undegraded":"2024-03-16T07:25:41.804361+0000","last_fullsized":"2024-03-16T07:25:41.804361+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:13:14.226330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-16T07:25:40.790034+0000","last_change":"2024-03-16T07:25:39.806708+0000","last_active":"2024-03-16T07:25:40.790034+0000","last_peered":"2024-03-16T07:25:40.790034+0000","last_clean":"2024-03-16T07:25:40.790034+0000","last_became_active":"2024-03-16T07:25:39.806053+0000","last_became_peered":"2024-03-16T07:25:39.806053+0000","last_unstale":"2024-03-16T07:25:40.790034+0000","last_undegraded":"2024-03-16T07:25:40.790034+0000","last_fullsized":"2024-03-16T07:25:40.790034+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:38.779484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:38.779484+0000","last_clean_scrub_stamp":"2024-03-16T07:25:38.779484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:30:08.481959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-16T07:25:40.821271+0000","last_change":"2024-03-16T07:25:40.819800+0000","last_active":"2024-03-16T07:25:40.821271+0000","last_peered":"2024-03-16T07:25:40.821271+0000","last_clean":"2024-03-16T07:25:40.821271+0000","last_became_active":"2024-03-16T07:25:40.816068+0000","last_became_peered":"2024-03-16T07:25:40.816068+0000","last_unstale":"2024-03-16T07:25:40.821271+0000","last_undegraded":"2024-03-16T07:25:40.821271+0000","last_fullsized":"2024-03-16T07:25:40.821271+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_clean_scrub_stamp":"2024-03-16T07:25:39.782521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:59:41.389545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":20,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-16T07:25:40.788212+0000","last_change":"2024-03-16T07:25:25.772328+0000","last_active":"2024-03-16T07:25:40.788212+0000","last_peered":"2024-03-16T07:25:40.788212+0000","last_clean":"2024-03-16T07:25:40.788212+0000","last_became_active":"2024-03-16T07:25:25.772044+0000","last_became_peered":"2024-03-16T07:25:25.772044+0000","last_unstale":"2024-03-16T07:25:40.788212+0000","last_undegraded":"2024-03-16T07:25:40.788212+0000","last_fullsized":"2024-03-16T07:25:40.788212+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_clean_scrub_stamp":"2024-03-16T07:25:24.745467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:03:20.013549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.808295+0000","last_change":"2024-03-16T07:25:26.777451+0000","last_active":"2024-03-16T07:25:41.808295+0000","last_peered":"2024-03-16T07:25:41.808295+0000","last_clean":"2024-03-16T07:25:41.808295+0000","last_became_active":"2024-03-16T07:25:26.777208+0000","last_became_peered":"2024-03-16T07:25:26.777208+0000","last_unstale":"2024-03-16T07:25:41.808295+0000","last_undegraded":"2024-03-16T07:25:41.808295+0000","last_fullsized":"2024-03-16T07:25:41.808295+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:15:25.308866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"31'2","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.810723+0000","last_change":"2024-03-16T07:25:39.809237+0000","last_active":"2024-03-16T07:25:41.810723+0000","last_peered":"2024-03-16T07:25:41.810723+0000","last_clean":"2024-03-16T07:25:41.810723+0000","last_became_active":"2024-03-16T07:25:39.808988+0000","last_became_peered":"2024-03-16T07:25:39.808988+0000","last_unstale":"2024-03-16T07:25:41.810723+0000","last_undegraded":"2024-03-16T07:25:41.810723+0000","last_fullsized":"2024-03-16T07:25:41.810723+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:38.779484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:38.779484+0000","last_clean_scrub_stamp":"2024-03-16T07:25:38.779484+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:11:14.735801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.810059+0000","last_change":"2024-03-16T07:25:40.811208+0000","last_active":"2024-03-16T07:25:41.810059+0000","last_peered":"2024-03-16T07:25:41.810059+0000","last_clean":"2024-03-16T07:25:41.810059+0000","last_became_active":"2024-03-16T07:25:40.810971+0000","last_became_peered":"2024-03-16T07:25:40.810971+0000","last_unstale":"2024-03-16T07:25:41.810059+0000","last_undegraded":"2024-03-16T07:25:41.810059+0000","last_fullsized":"2024-03-16T07:25:41.810059+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_clean_scrub_stamp":"2024-03-16T07:25:39.782521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:10:57.157265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"27'1","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.805515+0000","last_change":"2024-03-16T07:25:25.767060+0000","last_active":"2024-03-16T07:25:41.805515+0000","last_peered":"2024-03-16T07:25:41.805515+0000","last_clean":"2024-03-16T07:25:41.805515+0000","last_became_active":"2024-03-16T07:25:25.766634+0000","last_became_peered":"2024-03-16T07:25:25.766634+0000","last_unstale":"2024-03-16T07:25:41.805515+0000","last_undegraded":"2024-03-16T07:25:41.805515+0000","last_fullsized":"2024-03-16T07:25:41.805515+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_clean_scrub_stamp":"2024-03-16T07:25:24.745467+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:45:27.137248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.805345+0000","last_change":"2024-03-16T07:25:26.792837+0000","last_active":"2024-03-16T07:25:41.805345+0000","last_peered":"2024-03-16T07:25:41.805345+0000","last_clean":"2024-03-16T07:25:41.805345+0000","last_became_active":"2024-03-16T07:25:26.792560+0000","last_became_peered":"2024-03-16T07:25:26.792560+0000","last_unstale":"2024-03-16T07:25:41.805345+0000","last_undegraded":"2024-03-16T07:25:41.805345+0000","last_fullsized":"2024-03-16T07:25:41.805345+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:39:17.634888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"31'1","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.809128+0000","last_change":"2024-03-16T07:25:39.807802+0000","last_active":"2024-03-16T07:25:41.809128+0000","last_peered":"2024-03-16T07:25:41.809128+0000","last_clean":"2024-03-16T07:25:41.809128+0000","last_became_active":"2024-03-16T07:25:39.807555+0000","last_became_peered":"2024-03-16T07:25:39.807555+0000","last_unstale":"2024-03-16T07:25:41.809128+0000","last_undegraded":"2024-03-16T07:25:41.809128+0000","last_fullsized":"2024-03-16T07:25:41.809128+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:38.779484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:38.779484+0000","last_clean_scrub_stamp":"2024-03-16T07:25:38.779484+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:39:17.951211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.805365+0000","last_change":"2024-03-16T07:25:40.816770+0000","last_active":"2024-03-16T07:25:41.805365+0000","last_peered":"2024-03-16T07:25:41.805365+0000","last_clean":"2024-03-16T07:25:41.805365+0000","last_became_active":"2024-03-16T07:25:40.816383+0000","last_became_peered":"2024-03-16T07:25:40.816383+0000","last_unstale":"2024-03-16T07:25:41.805365+0000","last_undegraded":"2024-03-16T07:25:41.805365+0000","last_fullsized":"2024-03-16T07:25:41.805365+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_clean_scrub_stamp":"2024-03-16T07:25:39.782521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:08:45.278439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"27'2","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.803802+0000","last_change":"2024-03-16T07:25:25.777336+0000","last_active":"2024-03-16T07:25:41.803802+0000","last_peered":"2024-03-16T07:25:41.803802+0000","last_clean":"2024-03-16T07:25:41.803802+0000","last_became_active":"2024-03-16T07:25:25.776801+0000","last_became_peered":"2024-03-16T07:25:25.776801+0000","last_unstale":"2024-03-16T07:25:41.803802+0000","last_undegraded":"2024-03-16T07:25:41.803802+0000","last_fullsized":"2024-03-16T07:25:41.803802+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_clean_scrub_stamp":"2024-03-16T07:25:24.745467+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:12:18.043604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.807375+0000","last_change":"2024-03-16T07:25:26.791000+0000","last_active":"2024-03-16T07:25:41.807375+0000","last_peered":"2024-03-16T07:25:41.807375+0000","last_clean":"2024-03-16T07:25:41.807375+0000","last_became_active":"2024-03-16T07:25:26.790748+0000","last_became_peered":"2024-03-16T07:25:26.790748+0000","last_unstale":"2024-03-16T07:25:41.807375+0000","last_undegraded":"2024-03-16T07:25:41.807375+0000","last_fullsized":"2024-03-16T07:25:41.807375+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:34:16.025272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.805580+0000","last_change":"2024-03-16T07:25:39.811315+0000","last_active":"2024-03-16T07:25:41.805580+0000","last_peered":"2024-03-16T07:25:41.805580+0000","last_clean":"2024-03-16T07:25:41.805580+0000","last_became_active":"2024-03-16T07:25:39.811085+0000","last_became_peered":"2024-03-16T07:25:39.811085+0000","last_unstale":"2024-03-16T07:25:41.805580+0000","last_undegraded":"2024-03-16T07:25:41.805580+0000","last_fullsized":"2024-03-16T07:25:41.805580+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:38.779484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:38.779484+0000","last_clean_scrub_stamp":"2024-03-16T07:25:38.779484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:06:44.686324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.808604+0000","last_change":"2024-03-16T07:25:40.828327+0000","last_active":"2024-03-16T07:25:41.808604+0000","last_peered":"2024-03-16T07:25:41.808604+0000","last_clean":"2024-03-16T07:25:41.808604+0000","last_became_active":"2024-03-16T07:25:40.823497+0000","last_became_peered":"2024-03-16T07:25:40.823497+0000","last_unstale":"2024-03-16T07:25:41.808604+0000","last_undegraded":"2024-03-16T07:25:41.808604+0000","last_fullsized":"2024-03-16T07:25:41.808604+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_clean_scrub_stamp":"2024-03-16T07:25:39.782521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:25:21.200968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"27'1","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.807192+0000","last_change":"2024-03-16T07:25:25.768264+0000","last_active":"2024-03-16T07:25:41.807192+0000","last_peered":"2024-03-16T07:25:41.807192+0000","last_clean":"2024-03-16T07:25:41.807192+0000","last_became_active":"2024-03-16T07:25:25.767788+0000","last_became_peered":"2024-03-16T07:25:25.767788+0000","last_unstale":"2024-03-16T07:25:41.807192+0000","last_undegraded":"2024-03-16T07:25:41.807192+0000","last_fullsized":"2024-03-16T07:25:41.807192+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_clean_scrub_stamp":"2024-03-16T07:25:24.745467+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:49:12.241606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.809751+0000","last_change":"2024-03-16T07:25:26.783403+0000","last_active":"2024-03-16T07:25:41.809751+0000","last_peered":"2024-03-16T07:25:41.809751+0000","last_clean":"2024-03-16T07:25:41.809751+0000","last_became_active":"2024-03-16T07:25:26.782811+0000","last_became_peered":"2024-03-16T07:25:26.782811+0000","last_unstale":"2024-03-16T07:25:41.809751+0000","last_undegraded":"2024-03-16T07:25:41.809751+0000","last_fullsized":"2024-03-16T07:25:41.809751+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:50:36.836140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"31'1","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.806824+0000","last_change":"2024-03-16T07:25:39.816558+0000","last_active":"2024-03-16T07:25:41.806824+0000","last_peered":"2024-03-16T07:25:41.806824+0000","last_clean":"2024-03-16T07:25:41.806824+0000","last_became_active":"2024-03-16T07:25:39.816326+0000","last_became_peered":"2024-03-16T07:25:39.816326+0000","last_unstale":"2024-03-16T07:25:41.806824+0000","last_undegraded":"2024-03-16T07:25:41.806824+0000","last_fullsized":"2024-03-16T07:25:41.806824+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:38.779484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:38.779484+0000","last_clean_scrub_stamp":"2024-03-16T07:25:38.779484+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:39:32.405889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-16T07:25:40.830156+0000","last_change":"2024-03-16T07:25:40.829100+0000","last_active":"2024-03-16T07:25:40.830156+0000","last_peered":"2024-03-16T07:25:40.830156+0000","last_clean":"2024-03-16T07:25:40.830156+0000","last_became_active":"2024-03-16T07:25:40.828587+0000","last_became_peered":"2024-03-16T07:25:40.828587+0000","last_unstale":"2024-03-16T07:25:40.830156+0000","last_undegraded":"2024-03-16T07:25:40.830156+0000","last_fullsized":"2024-03-16T07:25:40.830156+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_clean_scrub_stamp":"2024-03-16T07:25:39.782521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:24:59.045110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"27'8","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.806900+0000","last_change":"2024-03-16T07:25:25.770830+0000","last_active":"2024-03-16T07:25:41.806900+0000","last_peered":"2024-03-16T07:25:41.806900+0000","last_clean":"2024-03-16T07:25:41.806900+0000","last_became_active":"2024-03-16T07:25:25.770533+0000","last_became_peered":"2024-03-16T07:25:25.770533+0000","last_unstale":"2024-03-16T07:25:41.806900+0000","last_undegraded":"2024-03-16T07:25:41.806900+0000","last_fullsized":"2024-03-16T07:25:41.806900+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_clean_scrub_stamp":"2024-03-16T07:25:24.745467+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:12:18.043604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.804128+0000","last_change":"2024-03-16T07:25:26.778809+0000","last_active":"2024-03-16T07:25:41.804128+0000","last_peered":"2024-03-16T07:25:41.804128+0000","last_clean":"2024-03-16T07:25:41.804128+0000","last_became_active":"2024-03-16T07:25:26.778552+0000","last_became_peered":"2024-03-16T07:25:26.778552+0000","last_unstale":"2024-03-16T07:25:41.804128+0000","last_undegraded":"2024-03-16T07:25:41.804128+0000","last_fullsized":"2024-03-16T07:25:41.804128+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:56:25.078268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-16T07:25:40.789793+0000","last_change":"2024-03-16T07:25:39.812392+0000","last_active":"2024-03-16T07:25:40.789793+0000","last_peered":"2024-03-16T07:25:40.789793+0000","last_clean":"2024-03-16T07:25:40.789793+0000","last_became_active":"2024-03-16T07:25:39.809345+0000","last_became_peered":"2024-03-16T07:25:39.809345+0000","last_unstale":"2024-03-16T07:25:40.789793+0000","last_undegraded":"2024-03-16T07:25:40.789793+0000","last_fullsized":"2024-03-16T07:25:40.789793+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:38.779484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:38.779484+0000","last_clean_scrub_stamp":"2024-03-16T07:25:38.779484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:38:50.906193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.806103+0000","last_change":"2024-03-16T07:25:40.816518+0000","last_active":"2024-03-16T07:25:41.806103+0000","last_peered":"2024-03-16T07:25:41.806103+0000","last_clean":"2024-03-16T07:25:41.806103+0000","last_became_active":"2024-03-16T07:25:40.816010+0000","last_became_peered":"2024-03-16T07:25:40.816010+0000","last_unstale":"2024-03-16T07:25:41.806103+0000","last_undegraded":"2024-03-16T07:25:41.806103+0000","last_fullsized":"2024-03-16T07:25:41.806103+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_clean_scrub_stamp":"2024-03-16T07:25:39.782521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:49:51.185259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.803799+0000","last_change":"2024-03-16T07:25:25.767424+0000","last_active":"2024-03-16T07:25:41.803799+0000","last_peered":"2024-03-16T07:25:41.803799+0000","last_clean":"2024-03-16T07:25:41.803799+0000","last_became_active":"2024-03-16T07:25:25.767167+0000","last_became_peered":"2024-03-16T07:25:25.767167+0000","last_unstale":"2024-03-16T07:25:41.803799+0000","last_undegraded":"2024-03-16T07:25:41.803799+0000","last_fullsized":"2024-03-16T07:25:41.803799+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_clean_scrub_stamp":"2024-03-16T07:25:24.745467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:55:08.055595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.806157+0000","last_change":"2024-03-16T07:25:26.788681+0000","last_active":"2024-03-16T07:25:41.806157+0000","last_peered":"2024-03-16T07:25:41.806157+0000","last_clean":"2024-03-16T07:25:41.806157+0000","last_became_active":"2024-03-16T07:25:26.788069+0000","last_became_peered":"2024-03-16T07:25:26.788069+0000","last_unstale":"2024-03-16T07:25:41.806157+0000","last_undegraded":"2024-03-16T07:25:41.806157+0000","last_fullsized":"2024-03-16T07:25:41.806157+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:56:25.078268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"31'2","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.808105+0000","last_change":"2024-03-16T07:25:39.816014+0000","last_active":"2024-03-16T07:25:41.808105+0000","last_peered":"2024-03-16T07:25:41.808105+0000","last_clean":"2024-03-16T07:25:41.808105+0000","last_became_active":"2024-03-16T07:25:39.814649+0000","last_became_peered":"2024-03-16T07:25:39.814649+0000","last_unstale":"2024-03-16T07:25:41.808105+0000","last_undegraded":"2024-03-16T07:25:41.808105+0000","last_fullsized":"2024-03-16T07:25:41.808105+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:38.779484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:38.779484+0000","last_clean_scrub_stamp":"2024-03-16T07:25:38.779484+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:55:32.148674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.804942+0000","last_change":"2024-03-16T07:25:40.815193+0000","last_active":"2024-03-16T07:25:41.804942+0000","last_peered":"2024-03-16T07:25:41.804942+0000","last_clean":"2024-03-16T07:25:41.804942+0000","last_became_active":"2024-03-16T07:25:40.814970+0000","last_became_peered":"2024-03-16T07:25:40.814970+0000","last_unstale":"2024-03-16T07:25:41.804942+0000","last_undegraded":"2024-03-16T07:25:41.804942+0000","last_fullsized":"2024-03-16T07:25:41.804942+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_clean_scrub_stamp":"2024-03-16T07:25:39.782521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:08:45.278439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.804813+0000","last_change":"2024-03-16T07:25:25.766436+0000","last_active":"2024-03-16T07:25:41.804813+0000","last_peered":"2024-03-16T07:25:41.804813+0000","last_clean":"2024-03-16T07:25:41.804813+0000","last_became_active":"2024-03-16T07:25:25.766215+0000","last_became_peered":"2024-03-16T07:25:25.766215+0000","last_unstale":"2024-03-16T07:25:41.804813+0000","last_undegraded":"2024-03-16T07:25:41.804813+0000","last_fullsized":"2024-03-16T07:25:41.804813+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_clean_scrub_stamp":"2024-03-16T07:25:24.745467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:51:34.836861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.805919+0000","last_change":"2024-03-16T07:25:26.791462+0000","last_active":"2024-03-16T07:25:41.805919+0000","last_peered":"2024-03-16T07:25:41.805919+0000","last_clean":"2024-03-16T07:25:41.805919+0000","last_became_active":"2024-03-16T07:25:26.791154+0000","last_became_peered":"2024-03-16T07:25:26.791154+0000","last_unstale":"2024-03-16T07:25:41.805919+0000","last_undegraded":"2024-03-16T07:25:41.805919+0000","last_fullsized":"2024-03-16T07:25:41.805919+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:52:53.885034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.10","version":"31'8","reported_seq":20,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-16T07:25:40.830756+0000","last_change":"2024-03-16T07:25:39.810227+0000","last_active":"2024-03-16T07:25:40.830756+0000","last_peered":"2024-03-16T07:25:40.830756+0000","last_clean":"2024-03-16T07:25:40.830756+0000","last_became_active":"2024-03-16T07:25:39.807510+0000","last_became_peered":"2024-03-16T07:25:39.807510+0000","last_unstale":"2024-03-16T07:25:40.830756+0000","last_undegraded":"2024-03-16T07:25:40.830756+0000","last_fullsized":"2024-03-16T07:25:40.830756+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:38.779484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:38.779484+0000","last_clean_scrub_stamp":"2024-03-16T07:25:38.779484+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:09:30.467543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.806851+0000","last_change":"2024-03-16T07:25:40.827054+0000","last_active":"2024-03-16T07:25:41.806851+0000","last_peered":"2024-03-16T07:25:41.806851+0000","last_clean":"2024-03-16T07:25:41.806851+0000","last_became_active":"2024-03-16T07:25:40.826815+0000","last_became_peered":"2024-03-16T07:25:40.826815+0000","last_unstale":"2024-03-16T07:25:41.806851+0000","last_undegraded":"2024-03-16T07:25:41.806851+0000","last_fullsized":"2024-03-16T07:25:41.806851+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_clean_scrub_stamp":"2024-03-16T07:25:39.782521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:32:59.653762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"27'2","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.808228+0000","last_change":"2024-03-16T07:25:25.777623+0000","last_active":"2024-03-16T07:25:41.808228+0000","last_peered":"2024-03-16T07:25:41.808228+0000","last_clean":"2024-03-16T07:25:41.808228+0000","last_became_active":"2024-03-16T07:25:25.776995+0000","last_became_peered":"2024-03-16T07:25:25.776995+0000","last_unstale":"2024-03-16T07:25:41.808228+0000","last_undegraded":"2024-03-16T07:25:41.808228+0000","last_fullsized":"2024-03-16T07:25:41.808228+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_clean_scrub_stamp":"2024-03-16T07:25:24.745467+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:51:34.836861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.804987+0000","last_change":"2024-03-16T07:25:26.767088+0000","last_active":"2024-03-16T07:25:41.804987+0000","last_peered":"2024-03-16T07:25:41.804987+0000","last_clean":"2024-03-16T07:25:41.804987+0000","last_became_active":"2024-03-16T07:25:26.766517+0000","last_became_peered":"2024-03-16T07:25:26.766517+0000","last_unstale":"2024-03-16T07:25:41.804987+0000","last_undegraded":"2024-03-16T07:25:41.804987+0000","last_fullsized":"2024-03-16T07:25:41.804987+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:44:15.933653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.804591+0000","last_change":"2024-03-16T07:25:39.814536+0000","last_active":"2024-03-16T07:25:41.804591+0000","last_peered":"2024-03-16T07:25:41.804591+0000","last_clean":"2024-03-16T07:25:41.804591+0000","last_became_active":"2024-03-16T07:25:39.814232+0000","last_became_peered":"2024-03-16T07:25:39.814232+0000","last_unstale":"2024-03-16T07:25:41.804591+0000","last_undegraded":"2024-03-16T07:25:41.804591+0000","last_fullsized":"2024-03-16T07:25:41.804591+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:38.779484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:38.779484+0000","last_clean_scrub_stamp":"2024-03-16T07:25:38.779484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:29:17.513237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.810791+0000","last_change":"2024-03-16T07:25:40.821705+0000","last_active":"2024-03-16T07:25:41.810791+0000","last_peered":"2024-03-16T07:25:41.810791+0000","last_clean":"2024-03-16T07:25:41.810791+0000","last_became_active":"2024-03-16T07:25:40.821461+0000","last_became_peered":"2024-03-16T07:25:40.821461+0000","last_unstale":"2024-03-16T07:25:41.810791+0000","last_undegraded":"2024-03-16T07:25:41.810791+0000","last_fullsized":"2024-03-16T07:25:41.810791+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_clean_scrub_stamp":"2024-03-16T07:25:39.782521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:28:29.876723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"28'9","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.805174+0000","last_change":"2024-03-16T07:25:25.770852+0000","last_active":"2024-03-16T07:25:41.805174+0000","last_peered":"2024-03-16T07:25:41.805174+0000","last_clean":"2024-03-16T07:25:41.805174+0000","last_became_active":"2024-03-16T07:25:25.770506+0000","last_became_peered":"2024-03-16T07:25:25.770506+0000","last_unstale":"2024-03-16T07:25:41.805174+0000","last_undegraded":"2024-03-16T07:25:41.805174+0000","last_fullsized":"2024-03-16T07:25:41.805174+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_clean_scrub_stamp":"2024-03-16T07:25:24.745467+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:28:55.817930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3309,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-16T07:25:40.792271+0000","last_change":"2024-03-16T07:25:26.796428+0000","last_active":"2024-03-16T07:25:40.792271+0000","last_peered":"2024-03-16T07:25:40.792271+0000","last_clean":"2024-03-16T07:25:40.792271+0000","last_became_active":"2024-03-16T07:25:26.795282+0000","last_became_peered":"2024-03-16T07:25:26.795282+0000","last_unstale":"2024-03-16T07:25:40.792271+0000","last_undegraded":"2024-03-16T07:25:40.792271+0000","last_fullsized":"2024-03-16T07:25:40.792271+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:39:04.918567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-16T07:25:40.791768+0000","last_change":"2024-03-16T07:25:39.806040+0000","last_active":"2024-03-16T07:25:40.791768+0000","last_peered":"2024-03-16T07:25:40.791768+0000","last_clean":"2024-03-16T07:25:40.791768+0000","last_became_active":"2024-03-16T07:25:39.805800+0000","last_became_peered":"2024-03-16T07:25:39.805800+0000","last_unstale":"2024-03-16T07:25:40.791768+0000","last_undegraded":"2024-03-16T07:25:40.791768+0000","last_fullsized":"2024-03-16T07:25:40.791768+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:38.779484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:38.779484+0000","last_clean_scrub_stamp":"2024-03-16T07:25:38.779484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:44:14.164920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.810653+0000","last_change":"2024-03-16T07:25:40.818543+0000","last_active":"2024-03-16T07:25:41.810653+0000","last_peered":"2024-03-16T07:25:41.810653+0000","last_clean":"2024-03-16T07:25:41.810653+0000","last_became_active":"2024-03-16T07:25:40.810273+0000","last_became_peered":"2024-03-16T07:25:40.810273+0000","last_unstale":"2024-03-16T07:25:41.810653+0000","last_undegraded":"2024-03-16T07:25:41.810653+0000","last_fullsized":"2024-03-16T07:25:41.810653+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_clean_scrub_stamp":"2024-03-16T07:25:39.782521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:30:39.951321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"27'3","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-16T07:25:40.792072+0000","last_change":"2024-03-16T07:25:25.772575+0000","last_active":"2024-03-16T07:25:40.792072+0000","last_peered":"2024-03-16T07:25:40.792072+0000","last_clean":"2024-03-16T07:25:40.792072+0000","last_became_active":"2024-03-16T07:25:25.771846+0000","last_became_peered":"2024-03-16T07:25:25.771846+0000","last_unstale":"2024-03-16T07:25:40.792072+0000","last_undegraded":"2024-03-16T07:25:40.792072+0000","last_fullsized":"2024-03-16T07:25:40.792072+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_clean_scrub_stamp":"2024-03-16T07:25:24.745467+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:47:15.546713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-16T07:25:40.788756+0000","last_change":"2024-03-16T07:25:26.774990+0000","last_active":"2024-03-16T07:25:40.788756+0000","last_peered":"2024-03-16T07:25:40.788756+0000","last_clean":"2024-03-16T07:25:40.788756+0000","last_became_active":"2024-03-16T07:25:26.774538+0000","last_became_peered":"2024-03-16T07:25:26.774538+0000","last_unstale":"2024-03-16T07:25:40.788756+0000","last_undegraded":"2024-03-16T07:25:40.788756+0000","last_fullsized":"2024-03-16T07:25:40.788756+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:06:31.653680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.810895+0000","last_change":"2024-03-16T07:25:39.813294+0000","last_active":"2024-03-16T07:25:41.810895+0000","last_peered":"2024-03-16T07:25:41.810895+0000","last_clean":"2024-03-16T07:25:41.810895+0000","last_became_active":"2024-03-16T07:25:39.813026+0000","last_became_peered":"2024-03-16T07:25:39.813026+0000","last_unstale":"2024-03-16T07:25:41.810895+0000","last_undegraded":"2024-03-16T07:25:41.810895+0000","last_fullsized":"2024-03-16T07:25:41.810895+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:38.779484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:38.779484+0000","last_clean_scrub_stamp":"2024-03-16T07:25:38.779484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:20:36.574352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.803752+0000","last_change":"2024-03-16T07:25:40.815006+0000","last_active":"2024-03-16T07:25:41.803752+0000","last_peered":"2024-03-16T07:25:41.803752+0000","last_clean":"2024-03-16T07:25:41.803752+0000","last_became_active":"2024-03-16T07:25:40.814479+0000","last_became_peered":"2024-03-16T07:25:40.814479+0000","last_unstale":"2024-03-16T07:25:41.803752+0000","last_undegraded":"2024-03-16T07:25:41.803752+0000","last_fullsized":"2024-03-16T07:25:41.803752+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_clean_scrub_stamp":"2024-03-16T07:25:39.782521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:39:57.617994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":20,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-16T07:25:40.790947+0000","last_change":"2024-03-16T07:25:25.766665+0000","last_active":"2024-03-16T07:25:40.790947+0000","last_peered":"2024-03-16T07:25:40.790947+0000","last_clean":"2024-03-16T07:25:40.790947+0000","last_became_active":"2024-03-16T07:25:25.765031+0000","last_became_peered":"2024-03-16T07:25:25.765031+0000","last_unstale":"2024-03-16T07:25:40.790947+0000","last_undegraded":"2024-03-16T07:25:40.790947+0000","last_fullsized":"2024-03-16T07:25:40.790947+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_clean_scrub_stamp":"2024-03-16T07:25:24.745467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:00:22.248577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.809489+0000","last_change":"2024-03-16T07:25:26.788379+0000","last_active":"2024-03-16T07:25:41.809489+0000","last_peered":"2024-03-16T07:25:41.809489+0000","last_clean":"2024-03-16T07:25:41.809489+0000","last_became_active":"2024-03-16T07:25:26.788113+0000","last_became_peered":"2024-03-16T07:25:26.788113+0000","last_unstale":"2024-03-16T07:25:41.809489+0000","last_undegraded":"2024-03-16T07:25:41.809489+0000","last_fullsized":"2024-03-16T07:25:41.809489+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:56:44.440768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.14","version":"31'6","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.808832+0000","last_change":"2024-03-16T07:25:39.815954+0000","last_active":"2024-03-16T07:25:41.808832+0000","last_peered":"2024-03-16T07:25:41.808832+0000","last_clean":"2024-03-16T07:25:41.808832+0000","last_became_active":"2024-03-16T07:25:39.815712+0000","last_became_peered":"2024-03-16T07:25:39.815712+0000","last_unstale":"2024-03-16T07:25:41.808832+0000","last_undegraded":"2024-03-16T07:25:41.808832+0000","last_fullsized":"2024-03-16T07:25:41.808832+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:38.779484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:38.779484+0000","last_clean_scrub_stamp":"2024-03-16T07:25:38.779484+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:11:41.117211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.806075+0000","last_change":"2024-03-16T07:25:40.825695+0000","last_active":"2024-03-16T07:25:41.806075+0000","last_peered":"2024-03-16T07:25:41.806075+0000","last_clean":"2024-03-16T07:25:41.806075+0000","last_became_active":"2024-03-16T07:25:40.825452+0000","last_became_peered":"2024-03-16T07:25:40.825452+0000","last_unstale":"2024-03-16T07:25:41.806075+0000","last_undegraded":"2024-03-16T07:25:41.806075+0000","last_fullsized":"2024-03-16T07:25:41.806075+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_clean_scrub_stamp":"2024-03-16T07:25:39.782521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:44:15.167957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":20,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-16T07:25:40.790054+0000","last_change":"2024-03-16T07:25:25.772980+0000","last_active":"2024-03-16T07:25:40.790054+0000","last_peered":"2024-03-16T07:25:40.790054+0000","last_clean":"2024-03-16T07:25:40.790054+0000","last_became_active":"2024-03-16T07:25:25.772547+0000","last_became_peered":"2024-03-16T07:25:25.772547+0000","last_unstale":"2024-03-16T07:25:40.790054+0000","last_undegraded":"2024-03-16T07:25:40.790054+0000","last_fullsized":"2024-03-16T07:25:40.790054+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_clean_scrub_stamp":"2024-03-16T07:25:24.745467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:56:24.076896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.807204+0000","last_change":"2024-03-16T07:25:26.783155+0000","last_active":"2024-03-16T07:25:41.807204+0000","last_peered":"2024-03-16T07:25:41.807204+0000","last_clean":"2024-03-16T07:25:41.807204+0000","last_became_active":"2024-03-16T07:25:26.782902+0000","last_became_peered":"2024-03-16T07:25:26.782902+0000","last_unstale":"2024-03-16T07:25:41.807204+0000","last_undegraded":"2024-03-16T07:25:41.807204+0000","last_fullsized":"2024-03-16T07:25:41.807204+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:47:18.096711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.15","version":"31'3","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.808196+0000","last_change":"2024-03-16T07:25:39.814309+0000","last_active":"2024-03-16T07:25:41.808196+0000","last_peered":"2024-03-16T07:25:41.808196+0000","last_clean":"2024-03-16T07:25:41.808196+0000","last_became_active":"2024-03-16T07:25:39.813772+0000","last_became_peered":"2024-03-16T07:25:39.813772+0000","last_unstale":"2024-03-16T07:25:41.808196+0000","last_undegraded":"2024-03-16T07:25:41.808196+0000","last_fullsized":"2024-03-16T07:25:41.808196+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:38.779484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:38.779484+0000","last_clean_scrub_stamp":"2024-03-16T07:25:38.779484+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:46:30.027911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-16T07:25:40.830197+0000","last_change":"2024-03-16T07:25:40.829249+0000","last_active":"2024-03-16T07:25:40.830197+0000","last_peered":"2024-03-16T07:25:40.830197+0000","last_clean":"2024-03-16T07:25:40.830197+0000","last_became_active":"2024-03-16T07:25:40.828830+0000","last_became_peered":"2024-03-16T07:25:40.828830+0000","last_unstale":"2024-03-16T07:25:40.830197+0000","last_undegraded":"2024-03-16T07:25:40.830197+0000","last_fullsized":"2024-03-16T07:25:40.830197+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_clean_scrub_stamp":"2024-03-16T07:25:39.782521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:26:08.638629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.805723+0000","last_change":"2024-03-16T07:25:25.777178+0000","last_active":"2024-03-16T07:25:41.805723+0000","last_peered":"2024-03-16T07:25:41.805723+0000","last_clean":"2024-03-16T07:25:41.805723+0000","last_became_active":"2024-03-16T07:25:25.776915+0000","last_became_peered":"2024-03-16T07:25:25.776915+0000","last_unstale":"2024-03-16T07:25:41.805723+0000","last_undegraded":"2024-03-16T07:25:41.805723+0000","last_fullsized":"2024-03-16T07:25:41.805723+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_clean_scrub_stamp":"2024-03-16T07:25:24.745467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:46:35.716476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.804301+0000","last_change":"2024-03-16T07:25:26.779863+0000","last_active":"2024-03-16T07:25:41.804301+0000","last_peered":"2024-03-16T07:25:41.804301+0000","last_clean":"2024-03-16T07:25:41.804301+0000","last_became_active":"2024-03-16T07:25:26.779362+0000","last_became_peered":"2024-03-16T07:25:26.779362+0000","last_unstale":"2024-03-16T07:25:41.804301+0000","last_undegraded":"2024-03-16T07:25:41.804301+0000","last_fullsized":"2024-03-16T07:25:41.804301+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:13:26.639460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"31'1","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-16T07:25:40.810847+0000","last_change":"2024-03-16T07:25:39.807450+0000","last_active":"2024-03-16T07:25:40.810847+0000","last_peered":"2024-03-16T07:25:40.810847+0000","last_clean":"2024-03-16T07:25:40.810847+0000","last_became_active":"2024-03-16T07:25:39.806882+0000","last_became_peered":"2024-03-16T07:25:39.806882+0000","last_unstale":"2024-03-16T07:25:40.810847+0000","last_undegraded":"2024-03-16T07:25:40.810847+0000","last_fullsized":"2024-03-16T07:25:40.810847+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:38.779484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:38.779484+0000","last_clean_scrub_stamp":"2024-03-16T07:25:38.779484+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:26:48.373023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.804078+0000","last_change":"2024-03-16T07:25:40.819352+0000","last_active":"2024-03-16T07:25:41.804078+0000","last_peered":"2024-03-16T07:25:41.804078+0000","last_clean":"2024-03-16T07:25:41.804078+0000","last_became_active":"2024-03-16T07:25:40.814728+0000","last_became_peered":"2024-03-16T07:25:40.814728+0000","last_unstale":"2024-03-16T07:25:41.804078+0000","last_undegraded":"2024-03-16T07:25:41.804078+0000","last_fullsized":"2024-03-16T07:25:41.804078+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_clean_scrub_stamp":"2024-03-16T07:25:39.782521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:23:10.642307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":20,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-16T07:25:40.791929+0000","last_change":"2024-03-16T07:25:25.765015+0000","last_active":"2024-03-16T07:25:40.791929+0000","last_peered":"2024-03-16T07:25:40.791929+0000","last_clean":"2024-03-16T07:25:40.791929+0000","last_became_active":"2024-03-16T07:25:25.764293+0000","last_became_peered":"2024-03-16T07:25:25.764293+0000","last_unstale":"2024-03-16T07:25:40.791929+0000","last_undegraded":"2024-03-16T07:25:40.791929+0000","last_fullsized":"2024-03-16T07:25:40.791929+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_clean_scrub_stamp":"2024-03-16T07:25:24.745467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:56:32.782012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.807003+0000","last_change":"2024-03-16T07:25:26.779275+0000","last_active":"2024-03-16T07:25:41.807003+0000","last_peered":"2024-03-16T07:25:41.807003+0000","last_clean":"2024-03-16T07:25:41.807003+0000","last_became_active":"2024-03-16T07:25:26.779010+0000","last_became_peered":"2024-03-16T07:25:26.779010+0000","last_unstale":"2024-03-16T07:25:41.807003+0000","last_undegraded":"2024-03-16T07:25:41.807003+0000","last_fullsized":"2024-03-16T07:25:41.807003+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:50:36.836140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"31'1","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-16T07:25:40.828351+0000","last_change":"2024-03-16T07:25:39.812298+0000","last_active":"2024-03-16T07:25:40.828351+0000","last_peered":"2024-03-16T07:25:40.828351+0000","last_clean":"2024-03-16T07:25:40.828351+0000","last_became_active":"2024-03-16T07:25:39.811817+0000","last_became_peered":"2024-03-16T07:25:39.811817+0000","last_unstale":"2024-03-16T07:25:40.828351+0000","last_undegraded":"2024-03-16T07:25:40.828351+0000","last_fullsized":"2024-03-16T07:25:40.828351+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:38.779484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:38.779484+0000","last_clean_scrub_stamp":"2024-03-16T07:25:38.779484+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:32:58.650725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.803874+0000","last_change":"2024-03-16T07:25:40.823179+0000","last_active":"2024-03-16T07:25:41.803874+0000","last_peered":"2024-03-16T07:25:41.803874+0000","last_clean":"2024-03-16T07:25:41.803874+0000","last_became_active":"2024-03-16T07:25:40.822971+0000","last_became_peered":"2024-03-16T07:25:40.822971+0000","last_unstale":"2024-03-16T07:25:41.803874+0000","last_undegraded":"2024-03-16T07:25:41.803874+0000","last_fullsized":"2024-03-16T07:25:41.803874+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_clean_scrub_stamp":"2024-03-16T07:25:39.782521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:38:51.909230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"27'1","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.804215+0000","last_change":"2024-03-16T07:25:25.769228+0000","last_active":"2024-03-16T07:25:41.804215+0000","last_peered":"2024-03-16T07:25:41.804215+0000","last_clean":"2024-03-16T07:25:41.804215+0000","last_became_active":"2024-03-16T07:25:25.768968+0000","last_became_peered":"2024-03-16T07:25:25.768968+0000","last_unstale":"2024-03-16T07:25:41.804215+0000","last_undegraded":"2024-03-16T07:25:41.804215+0000","last_fullsized":"2024-03-16T07:25:41.804215+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_clean_scrub_stamp":"2024-03-16T07:25:24.745467+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:51:25.934804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.807753+0000","last_change":"2024-03-16T07:25:26.783520+0000","last_active":"2024-03-16T07:25:41.807753+0000","last_peered":"2024-03-16T07:25:41.807753+0000","last_clean":"2024-03-16T07:25:41.807753+0000","last_became_active":"2024-03-16T07:25:26.782402+0000","last_became_peered":"2024-03-16T07:25:26.782402+0000","last_unstale":"2024-03-16T07:25:41.807753+0000","last_undegraded":"2024-03-16T07:25:41.807753+0000","last_fullsized":"2024-03-16T07:25:41.807753+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:52:53.752332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-16T07:25:40.789591+0000","last_change":"2024-03-16T07:25:39.810442+0000","last_active":"2024-03-16T07:25:40.789591+0000","last_peered":"2024-03-16T07:25:40.789591+0000","last_clean":"2024-03-16T07:25:40.789591+0000","last_became_active":"2024-03-16T07:25:39.809179+0000","last_became_peered":"2024-03-16T07:25:39.809179+0000","last_unstale":"2024-03-16T07:25:40.789591+0000","last_undegraded":"2024-03-16T07:25:40.789591+0000","last_fullsized":"2024-03-16T07:25:40.789591+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:38.779484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:38.779484+0000","last_clean_scrub_stamp":"2024-03-16T07:25:38.779484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:23:09.639270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-16T07:25:40.820816+0000","last_change":"2024-03-16T07:25:40.818004+0000","last_active":"2024-03-16T07:25:40.820816+0000","last_peered":"2024-03-16T07:25:40.820816+0000","last_clean":"2024-03-16T07:25:40.820816+0000","last_became_active":"2024-03-16T07:25:40.816893+0000","last_became_peered":"2024-03-16T07:25:40.816893+0000","last_unstale":"2024-03-16T07:25:40.820816+0000","last_undegraded":"2024-03-16T07:25:40.820816+0000","last_fullsized":"2024-03-16T07:25:40.820816+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_clean_scrub_stamp":"2024-03-16T07:25:39.782521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:09:20.405239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"27'1","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.807352+0000","last_change":"2024-03-16T07:25:25.777040+0000","last_active":"2024-03-16T07:25:41.807352+0000","last_peered":"2024-03-16T07:25:41.807352+0000","last_clean":"2024-03-16T07:25:41.807352+0000","last_became_active":"2024-03-16T07:25:25.776802+0000","last_became_peered":"2024-03-16T07:25:25.776802+0000","last_unstale":"2024-03-16T07:25:41.807352+0000","last_undegraded":"2024-03-16T07:25:41.807352+0000","last_fullsized":"2024-03-16T07:25:41.807352+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_clean_scrub_stamp":"2024-03-16T07:25:24.745467+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:23:21.193828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.805088+0000","last_change":"2024-03-16T07:25:26.788243+0000","last_active":"2024-03-16T07:25:41.805088+0000","last_peered":"2024-03-16T07:25:41.805088+0000","last_clean":"2024-03-16T07:25:41.805088+0000","last_became_active":"2024-03-16T07:25:26.787967+0000","last_became_peered":"2024-03-16T07:25:26.787967+0000","last_unstale":"2024-03-16T07:25:41.805088+0000","last_undegraded":"2024-03-16T07:25:41.805088+0000","last_fullsized":"2024-03-16T07:25:41.805088+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:52:53.752332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-16T07:25:40.789259+0000","last_change":"2024-03-16T07:25:39.808982+0000","last_active":"2024-03-16T07:25:40.789259+0000","last_peered":"2024-03-16T07:25:40.789259+0000","last_clean":"2024-03-16T07:25:40.789259+0000","last_became_active":"2024-03-16T07:25:39.807812+0000","last_became_peered":"2024-03-16T07:25:39.807812+0000","last_unstale":"2024-03-16T07:25:40.789259+0000","last_undegraded":"2024-03-16T07:25:40.789259+0000","last_fullsized":"2024-03-16T07:25:40.789259+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:38.779484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:38.779484+0000","last_clean_scrub_stamp":"2024-03-16T07:25:38.779484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:09:17.233532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-16T07:25:40.825977+0000","last_change":"2024-03-16T07:25:40.822536+0000","last_active":"2024-03-16T07:25:40.825977+0000","last_peered":"2024-03-16T07:25:40.825977+0000","last_clean":"2024-03-16T07:25:40.825977+0000","last_became_active":"2024-03-16T07:25:40.822297+0000","last_became_peered":"2024-03-16T07:25:40.822297+0000","last_unstale":"2024-03-16T07:25:40.825977+0000","last_undegraded":"2024-03-16T07:25:40.825977+0000","last_fullsized":"2024-03-16T07:25:40.825977+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_clean_scrub_stamp":"2024-03-16T07:25:39.782521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:29:21.923502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"31'1","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.810741+0000","last_change":"2024-03-16T07:25:39.802978+0000","last_active":"2024-03-16T07:25:41.810741+0000","last_peered":"2024-03-16T07:25:41.810741+0000","last_clean":"2024-03-16T07:25:41.810741+0000","last_became_active":"2024-03-16T07:25:39.802721+0000","last_became_peered":"2024-03-16T07:25:39.802721+0000","last_unstale":"2024-03-16T07:25:41.810741+0000","last_undegraded":"2024-03-16T07:25:41.810741+0000","last_fullsized":"2024-03-16T07:25:41.810741+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:38.779484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:38.779484+0000","last_clean_scrub_stamp":"2024-03-16T07:25:38.779484+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:17:24.780924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"27'2","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.808412+0000","last_change":"2024-03-16T07:25:25.776429+0000","last_active":"2024-03-16T07:25:41.808412+0000","last_peered":"2024-03-16T07:25:41.808412+0000","last_clean":"2024-03-16T07:25:41.808412+0000","last_became_active":"2024-03-16T07:25:25.776189+0000","last_became_peered":"2024-03-16T07:25:25.776189+0000","last_unstale":"2024-03-16T07:25:41.808412+0000","last_undegraded":"2024-03-16T07:25:41.808412+0000","last_fullsized":"2024-03-16T07:25:41.808412+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_clean_scrub_stamp":"2024-03-16T07:25:24.745467+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:56:07.751589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.806106+0000","last_change":"2024-03-16T07:25:26.790198+0000","last_active":"2024-03-16T07:25:41.806106+0000","last_peered":"2024-03-16T07:25:41.806106+0000","last_clean":"2024-03-16T07:25:41.806106+0000","last_became_active":"2024-03-16T07:25:26.789918+0000","last_became_peered":"2024-03-16T07:25:26.789918+0000","last_unstale":"2024-03-16T07:25:41.806106+0000","last_undegraded":"2024-03-16T07:25:41.806106+0000","last_fullsized":"2024-03-16T07:25:41.806106+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:51:32.782998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.807148+0000","last_change":"2024-03-16T07:25:40.821019+0000","last_active":"2024-03-16T07:25:41.807148+0000","last_peered":"2024-03-16T07:25:41.807148+0000","last_clean":"2024-03-16T07:25:41.807148+0000","last_became_active":"2024-03-16T07:25:40.820433+0000","last_became_peered":"2024-03-16T07:25:40.820433+0000","last_unstale":"2024-03-16T07:25:41.807148+0000","last_undegraded":"2024-03-16T07:25:41.807148+0000","last_fullsized":"2024-03-16T07:25:41.807148+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_clean_scrub_stamp":"2024-03-16T07:25:39.782521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:43:35.925010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"31'4","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.809044+0000","last_change":"2024-03-16T07:25:39.816818+0000","last_active":"2024-03-16T07:25:41.809044+0000","last_peered":"2024-03-16T07:25:41.809044+0000","last_clean":"2024-03-16T07:25:41.809044+0000","last_became_active":"2024-03-16T07:25:39.816585+0000","last_became_peered":"2024-03-16T07:25:39.816585+0000","last_unstale":"2024-03-16T07:25:41.809044+0000","last_undegraded":"2024-03-16T07:25:41.809044+0000","last_fullsized":"2024-03-16T07:25:41.809044+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:38.779484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:38.779484+0000","last_clean_scrub_stamp":"2024-03-16T07:25:38.779484+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:27:39.841099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"27'2","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-16T07:25:40.790918+0000","last_change":"2024-03-16T07:25:25.773676+0000","last_active":"2024-03-16T07:25:40.790918+0000","last_peered":"2024-03-16T07:25:40.790918+0000","last_clean":"2024-03-16T07:25:40.790918+0000","last_became_active":"2024-03-16T07:25:25.773426+0000","last_became_peered":"2024-03-16T07:25:25.773426+0000","last_unstale":"2024-03-16T07:25:40.790918+0000","last_undegraded":"2024-03-16T07:25:40.790918+0000","last_fullsized":"2024-03-16T07:25:40.790918+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_clean_scrub_stamp":"2024-03-16T07:25:24.745467+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:26:16.092140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.808568+0000","last_change":"2024-03-16T07:25:26.782505+0000","last_active":"2024-03-16T07:25:41.808568+0000","last_peered":"2024-03-16T07:25:41.808568+0000","last_clean":"2024-03-16T07:25:41.808568+0000","last_became_active":"2024-03-16T07:25:26.781458+0000","last_became_peered":"2024-03-16T07:25:26.781458+0000","last_unstale":"2024-03-16T07:25:41.808568+0000","last_undegraded":"2024-03-16T07:25:41.808568+0000","last_fullsized":"2024-03-16T07:25:41.808568+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:34:16.025272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.805214+0000","last_change":"2024-03-16T07:25:40.817385+0000","last_active":"2024-03-16T07:25:41.805214+0000","last_peered":"2024-03-16T07:25:41.805214+0000","last_clean":"2024-03-16T07:25:41.805214+0000","last_became_active":"2024-03-16T07:25:40.817167+0000","last_became_peered":"2024-03-16T07:25:40.817167+0000","last_unstale":"2024-03-16T07:25:41.805214+0000","last_undegraded":"2024-03-16T07:25:41.805214+0000","last_fullsized":"2024-03-16T07:25:41.805214+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_clean_scrub_stamp":"2024-03-16T07:25:39.782521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:26:49.376060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"27'1","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-16T07:25:40.791049+0000","last_change":"2024-03-16T07:25:25.771867+0000","last_active":"2024-03-16T07:25:40.791049+0000","last_peered":"2024-03-16T07:25:40.791049+0000","last_clean":"2024-03-16T07:25:40.791049+0000","last_became_active":"2024-03-16T07:25:25.771573+0000","last_became_peered":"2024-03-16T07:25:25.771573+0000","last_unstale":"2024-03-16T07:25:40.791049+0000","last_undegraded":"2024-03-16T07:25:40.791049+0000","last_fullsized":"2024-03-16T07:25:40.791049+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_clean_scrub_stamp":"2024-03-16T07:25:24.745467+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:30:31.592675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.809406+0000","last_change":"2024-03-16T07:25:26.787749+0000","last_active":"2024-03-16T07:25:41.809406+0000","last_peered":"2024-03-16T07:25:41.809406+0000","last_clean":"2024-03-16T07:25:41.809406+0000","last_became_active":"2024-03-16T07:25:26.787465+0000","last_became_peered":"2024-03-16T07:25:26.787465+0000","last_unstale":"2024-03-16T07:25:41.809406+0000","last_undegraded":"2024-03-16T07:25:41.809406+0000","last_fullsized":"2024-03-16T07:25:41.809406+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:36:38.284510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"31'2","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.805119+0000","last_change":"2024-03-16T07:25:39.810728+0000","last_active":"2024-03-16T07:25:41.805119+0000","last_peered":"2024-03-16T07:25:41.805119+0000","last_clean":"2024-03-16T07:25:41.805119+0000","last_became_active":"2024-03-16T07:25:39.810487+0000","last_became_peered":"2024-03-16T07:25:39.810487+0000","last_unstale":"2024-03-16T07:25:41.805119+0000","last_undegraded":"2024-03-16T07:25:41.805119+0000","last_fullsized":"2024-03-16T07:25:41.805119+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:38.779484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:38.779484+0000","last_clean_scrub_stamp":"2024-03-16T07:25:38.779484+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:43:04.571401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.808364+0000","last_change":"2024-03-16T07:25:40.823668+0000","last_active":"2024-03-16T07:25:41.808364+0000","last_peered":"2024-03-16T07:25:41.808364+0000","last_clean":"2024-03-16T07:25:41.808364+0000","last_became_active":"2024-03-16T07:25:40.820307+0000","last_became_peered":"2024-03-16T07:25:40.820307+0000","last_unstale":"2024-03-16T07:25:41.808364+0000","last_undegraded":"2024-03-16T07:25:41.808364+0000","last_fullsized":"2024-03-16T07:25:41.808364+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_clean_scrub_stamp":"2024-03-16T07:25:39.782521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:45:18.030885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"27'4","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-16T07:25:40.790485+0000","last_change":"2024-03-16T07:25:25.774269+0000","last_active":"2024-03-16T07:25:40.790485+0000","last_peered":"2024-03-16T07:25:40.790485+0000","last_clean":"2024-03-16T07:25:40.790485+0000","last_became_active":"2024-03-16T07:25:25.774016+0000","last_became_peered":"2024-03-16T07:25:25.774016+0000","last_unstale":"2024-03-16T07:25:40.790485+0000","last_undegraded":"2024-03-16T07:25:40.790485+0000","last_fullsized":"2024-03-16T07:25:40.790485+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_clean_scrub_stamp":"2024-03-16T07:25:24.745467+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:24:12.540520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-16T07:25:40.791156+0000","last_change":"2024-03-16T07:25:26.774904+0000","last_active":"2024-03-16T07:25:40.791156+0000","last_peered":"2024-03-16T07:25:40.791156+0000","last_clean":"2024-03-16T07:25:40.791156+0000","last_became_active":"2024-03-16T07:25:26.774655+0000","last_became_peered":"2024-03-16T07:25:26.774655+0000","last_unstale":"2024-03-16T07:25:40.791156+0000","last_undegraded":"2024-03-16T07:25:40.791156+0000","last_fullsized":"2024-03-16T07:25:40.791156+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:55:19.116029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"31'2","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.807116+0000","last_change":"2024-03-16T07:25:39.817185+0000","last_active":"2024-03-16T07:25:41.807116+0000","last_peered":"2024-03-16T07:25:41.807116+0000","last_clean":"2024-03-16T07:25:41.807116+0000","last_became_active":"2024-03-16T07:25:39.816950+0000","last_became_peered":"2024-03-16T07:25:39.816950+0000","last_unstale":"2024-03-16T07:25:41.807116+0000","last_undegraded":"2024-03-16T07:25:41.807116+0000","last_fullsized":"2024-03-16T07:25:41.807116+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:38.779484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:38.779484+0000","last_clean_scrub_stamp":"2024-03-16T07:25:38.779484+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:42:27.716029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.803943+0000","last_change":"2024-03-16T07:25:40.815520+0000","last_active":"2024-03-16T07:25:41.803943+0000","last_peered":"2024-03-16T07:25:41.803943+0000","last_clean":"2024-03-16T07:25:41.803943+0000","last_became_active":"2024-03-16T07:25:40.814416+0000","last_became_peered":"2024-03-16T07:25:40.814416+0000","last_unstale":"2024-03-16T07:25:41.803943+0000","last_undegraded":"2024-03-16T07:25:41.803943+0000","last_fullsized":"2024-03-16T07:25:41.803943+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_clean_scrub_stamp":"2024-03-16T07:25:39.782521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:09:18.236569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.806693+0000","last_change":"2024-03-16T07:25:26.788490+0000","last_active":"2024-03-16T07:25:41.806693+0000","last_peered":"2024-03-16T07:25:41.806693+0000","last_clean":"2024-03-16T07:25:41.806693+0000","last_became_active":"2024-03-16T07:25:26.787773+0000","last_became_peered":"2024-03-16T07:25:26.787773+0000","last_unstale":"2024-03-16T07:25:41.806693+0000","last_undegraded":"2024-03-16T07:25:41.806693+0000","last_fullsized":"2024-03-16T07:25:41.806693+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:47:16.548086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-16T07:25:40.821484+0000","last_change":"2024-03-16T07:25:40.820999+0000","last_active":"2024-03-16T07:25:40.821484+0000","last_peered":"2024-03-16T07:25:40.821484+0000","last_clean":"2024-03-16T07:25:40.821484+0000","last_became_active":"2024-03-16T07:25:40.820243+0000","last_became_peered":"2024-03-16T07:25:40.820243+0000","last_unstale":"2024-03-16T07:25:40.821484+0000","last_undegraded":"2024-03-16T07:25:40.821484+0000","last_fullsized":"2024-03-16T07:25:40.821484+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_clean_scrub_stamp":"2024-03-16T07:25:39.782521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:43:36.497286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.804142+0000","last_change":"2024-03-16T07:25:26.779663+0000","last_active":"2024-03-16T07:25:41.804142+0000","last_peered":"2024-03-16T07:25:41.804142+0000","last_clean":"2024-03-16T07:25:41.804142+0000","last_became_active":"2024-03-16T07:25:26.779395+0000","last_became_peered":"2024-03-16T07:25:26.779395+0000","last_unstale":"2024-03-16T07:25:41.804142+0000","last_undegraded":"2024-03-16T07:25:41.804142+0000","last_fullsized":"2024-03-16T07:25:41.804142+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:39:17.634888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.805678+0000","last_change":"2024-03-16T07:25:40.815740+0000","last_active":"2024-03-16T07:25:41.805678+0000","last_peered":"2024-03-16T07:25:41.805678+0000","last_clean":"2024-03-16T07:25:41.805678+0000","last_became_active":"2024-03-16T07:25:40.815492+0000","last_became_peered":"2024-03-16T07:25:40.815492+0000","last_unstale":"2024-03-16T07:25:41.805678+0000","last_undegraded":"2024-03-16T07:25:41.805678+0000","last_fullsized":"2024-03-16T07:25:41.805678+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_clean_scrub_stamp":"2024-03-16T07:25:39.782521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:49:51.185259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-16T07:25:40.789844+0000","last_change":"2024-03-16T07:25:26.775812+0000","last_active":"2024-03-16T07:25:40.789844+0000","last_peered":"2024-03-16T07:25:40.789844+0000","last_clean":"2024-03-16T07:25:40.789844+0000","last_became_active":"2024-03-16T07:25:26.775250+0000","last_became_peered":"2024-03-16T07:25:26.775250+0000","last_unstale":"2024-03-16T07:25:40.789844+0000","last_undegraded":"2024-03-16T07:25:40.789844+0000","last_fullsized":"2024-03-16T07:25:40.789844+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:28:39.013422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.804085+0000","last_change":"2024-03-16T07:25:40.822074+0000","last_active":"2024-03-16T07:25:41.804085+0000","last_peered":"2024-03-16T07:25:41.804085+0000","last_clean":"2024-03-16T07:25:41.804085+0000","last_became_active":"2024-03-16T07:25:40.821836+0000","last_became_peered":"2024-03-16T07:25:40.821836+0000","last_unstale":"2024-03-16T07:25:41.804085+0000","last_undegraded":"2024-03-16T07:25:41.804085+0000","last_fullsized":"2024-03-16T07:25:41.804085+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_clean_scrub_stamp":"2024-03-16T07:25:39.782521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:30:09.484996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-16T07:25:40.792601+0000","last_change":"2024-03-16T07:25:26.798086+0000","last_active":"2024-03-16T07:25:40.792601+0000","last_peered":"2024-03-16T07:25:40.792601+0000","last_clean":"2024-03-16T07:25:40.792601+0000","last_became_active":"2024-03-16T07:25:26.795175+0000","last_became_peered":"2024-03-16T07:25:26.795175+0000","last_unstale":"2024-03-16T07:25:40.792601+0000","last_undegraded":"2024-03-16T07:25:40.792601+0000","last_fullsized":"2024-03-16T07:25:40.792601+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:42:51.538757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.810116+0000","last_change":"2024-03-16T07:25:40.811781+0000","last_active":"2024-03-16T07:25:41.810116+0000","last_peered":"2024-03-16T07:25:41.810116+0000","last_clean":"2024-03-16T07:25:41.810116+0000","last_became_active":"2024-03-16T07:25:40.811541+0000","last_became_peered":"2024-03-16T07:25:40.811541+0000","last_unstale":"2024-03-16T07:25:41.810116+0000","last_undegraded":"2024-03-16T07:25:41.810116+0000","last_fullsized":"2024-03-16T07:25:41.810116+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_clean_scrub_stamp":"2024-03-16T07:25:39.782521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:17:16.794149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.808668+0000","last_change":"2024-03-16T07:25:26.782081+0000","last_active":"2024-03-16T07:25:41.808668+0000","last_peered":"2024-03-16T07:25:41.808668+0000","last_clean":"2024-03-16T07:25:41.808668+0000","last_became_active":"2024-03-16T07:25:26.781123+0000","last_became_peered":"2024-03-16T07:25:26.781123+0000","last_unstale":"2024-03-16T07:25:41.808668+0000","last_undegraded":"2024-03-16T07:25:41.808668+0000","last_fullsized":"2024-03-16T07:25:41.808668+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:47:18.096711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-16T07:25:40.830129+0000","last_change":"2024-03-16T07:25:40.828782+0000","last_active":"2024-03-16T07:25:40.830129+0000","last_peered":"2024-03-16T07:25:40.830129+0000","last_clean":"2024-03-16T07:25:40.830129+0000","last_became_active":"2024-03-16T07:25:40.828409+0000","last_became_peered":"2024-03-16T07:25:40.828409+0000","last_unstale":"2024-03-16T07:25:40.830129+0000","last_undegraded":"2024-03-16T07:25:40.830129+0000","last_fullsized":"2024-03-16T07:25:40.830129+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_clean_scrub_stamp":"2024-03-16T07:25:39.782521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:13:00.377550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.806921+0000","last_change":"2024-03-16T07:25:26.791013+0000","last_active":"2024-03-16T07:25:41.806921+0000","last_peered":"2024-03-16T07:25:41.806921+0000","last_clean":"2024-03-16T07:25:41.806921+0000","last_became_active":"2024-03-16T07:25:26.790781+0000","last_became_peered":"2024-03-16T07:25:26.790781+0000","last_unstale":"2024-03-16T07:25:41.806921+0000","last_undegraded":"2024-03-16T07:25:41.806921+0000","last_fullsized":"2024-03-16T07:25:41.806921+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:13:14.226330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.808231+0000","last_change":"2024-03-16T07:25:40.823458+0000","last_active":"2024-03-16T07:25:41.808231+0000","last_peered":"2024-03-16T07:25:41.808231+0000","last_clean":"2024-03-16T07:25:41.808231+0000","last_became_active":"2024-03-16T07:25:40.820067+0000","last_became_peered":"2024-03-16T07:25:40.820067+0000","last_unstale":"2024-03-16T07:25:41.808231+0000","last_undegraded":"2024-03-16T07:25:41.808231+0000","last_fullsized":"2024-03-16T07:25:41.808231+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_clean_scrub_stamp":"2024-03-16T07:25:39.782521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:30:39.951321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.807282+0000","last_change":"2024-03-16T07:25:26.784187+0000","last_active":"2024-03-16T07:25:41.807282+0000","last_peered":"2024-03-16T07:25:41.807282+0000","last_clean":"2024-03-16T07:25:41.807282+0000","last_became_active":"2024-03-16T07:25:26.783915+0000","last_became_peered":"2024-03-16T07:25:26.783915+0000","last_unstale":"2024-03-16T07:25:41.807282+0000","last_undegraded":"2024-03-16T07:25:41.807282+0000","last_fullsized":"2024-03-16T07:25:41.807282+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:53:30.197560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-16T07:25:40.817593+0000","last_change":"2024-03-16T07:25:40.813164+0000","last_active":"2024-03-16T07:25:40.817593+0000","last_peered":"2024-03-16T07:25:40.817593+0000","last_clean":"2024-03-16T07:25:40.817593+0000","last_became_active":"2024-03-16T07:25:40.812443+0000","last_became_peered":"2024-03-16T07:25:40.812443+0000","last_unstale":"2024-03-16T07:25:40.817593+0000","last_undegraded":"2024-03-16T07:25:40.817593+0000","last_fullsized":"2024-03-16T07:25:40.817593+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_clean_scrub_stamp":"2024-03-16T07:25:39.782521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:25:21.200968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.807461+0000","last_change":"2024-03-16T07:25:26.792087+0000","last_active":"2024-03-16T07:25:41.807461+0000","last_peered":"2024-03-16T07:25:41.807461+0000","last_clean":"2024-03-16T07:25:41.807461+0000","last_became_active":"2024-03-16T07:25:26.791866+0000","last_became_peered":"2024-03-16T07:25:26.791866+0000","last_unstale":"2024-03-16T07:25:41.807461+0000","last_undegraded":"2024-03-16T07:25:41.807461+0000","last_fullsized":"2024-03-16T07:25:41.807461+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:16:18.923166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-16T07:25:40.820785+0000","last_change":"2024-03-16T07:25:40.816360+0000","last_active":"2024-03-16T07:25:40.820785+0000","last_peered":"2024-03-16T07:25:40.820785+0000","last_clean":"2024-03-16T07:25:40.820785+0000","last_became_active":"2024-03-16T07:25:40.816119+0000","last_became_peered":"2024-03-16T07:25:40.816119+0000","last_unstale":"2024-03-16T07:25:40.820785+0000","last_undegraded":"2024-03-16T07:25:40.820785+0000","last_fullsized":"2024-03-16T07:25:40.820785+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_clean_scrub_stamp":"2024-03-16T07:25:39.782521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:10:57.157265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.806260+0000","last_change":"2024-03-16T07:25:26.788304+0000","last_active":"2024-03-16T07:25:41.806260+0000","last_peered":"2024-03-16T07:25:41.806260+0000","last_clean":"2024-03-16T07:25:41.806260+0000","last_became_active":"2024-03-16T07:25:26.787434+0000","last_became_peered":"2024-03-16T07:25:26.787434+0000","last_unstale":"2024-03-16T07:25:41.806260+0000","last_undegraded":"2024-03-16T07:25:41.806260+0000","last_fullsized":"2024-03-16T07:25:41.806260+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:35:14.107259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.807598+0000","last_change":"2024-03-16T07:25:40.825839+0000","last_active":"2024-03-16T07:25:41.807598+0000","last_peered":"2024-03-16T07:25:41.807598+0000","last_clean":"2024-03-16T07:25:41.807598+0000","last_became_active":"2024-03-16T07:25:40.824786+0000","last_became_peered":"2024-03-16T07:25:40.824786+0000","last_unstale":"2024-03-16T07:25:41.807598+0000","last_undegraded":"2024-03-16T07:25:41.807598+0000","last_fullsized":"2024-03-16T07:25:41.807598+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_clean_scrub_stamp":"2024-03-16T07:25:39.782521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:32:59.653762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-16T07:25:40.789850+0000","last_change":"2024-03-16T07:25:26.797082+0000","last_active":"2024-03-16T07:25:40.789850+0000","last_peered":"2024-03-16T07:25:40.789850+0000","last_clean":"2024-03-16T07:25:40.789850+0000","last_became_active":"2024-03-16T07:25:26.794623+0000","last_became_peered":"2024-03-16T07:25:26.794623+0000","last_unstale":"2024-03-16T07:25:40.789850+0000","last_undegraded":"2024-03-16T07:25:40.789850+0000","last_fullsized":"2024-03-16T07:25:40.789850+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:16:04.340775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.805537+0000","last_change":"2024-03-16T07:25:40.819493+0000","last_active":"2024-03-16T07:25:41.805537+0000","last_peered":"2024-03-16T07:25:41.805537+0000","last_clean":"2024-03-16T07:25:41.805537+0000","last_became_active":"2024-03-16T07:25:40.819113+0000","last_became_peered":"2024-03-16T07:25:40.819113+0000","last_unstale":"2024-03-16T07:25:41.805537+0000","last_undegraded":"2024-03-16T07:25:41.805537+0000","last_fullsized":"2024-03-16T07:25:41.805537+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_clean_scrub_stamp":"2024-03-16T07:25:39.782521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:44:15.167957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.804447+0000","last_change":"2024-03-16T07:25:26.780517+0000","last_active":"2024-03-16T07:25:41.804447+0000","last_peered":"2024-03-16T07:25:41.804447+0000","last_clean":"2024-03-16T07:25:41.804447+0000","last_became_active":"2024-03-16T07:25:26.779906+0000","last_became_peered":"2024-03-16T07:25:26.779906+0000","last_unstale":"2024-03-16T07:25:41.804447+0000","last_undegraded":"2024-03-16T07:25:41.804447+0000","last_fullsized":"2024-03-16T07:25:41.804447+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:16:18.923166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-16T07:25:40.808223+0000","last_change":"2024-03-16T07:25:40.804032+0000","last_active":"2024-03-16T07:25:40.808223+0000","last_peered":"2024-03-16T07:25:40.808223+0000","last_clean":"2024-03-16T07:25:40.808223+0000","last_became_active":"2024-03-16T07:25:40.803801+0000","last_became_peered":"2024-03-16T07:25:40.803801+0000","last_unstale":"2024-03-16T07:25:40.808223+0000","last_undegraded":"2024-03-16T07:25:40.808223+0000","last_fullsized":"2024-03-16T07:25:40.808223+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_clean_scrub_stamp":"2024-03-16T07:25:39.782521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:44:48.980147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-16T07:25:40.791525+0000","last_change":"2024-03-16T07:25:26.781114+0000","last_active":"2024-03-16T07:25:40.791525+0000","last_peered":"2024-03-16T07:25:40.791525+0000","last_clean":"2024-03-16T07:25:40.791525+0000","last_became_active":"2024-03-16T07:25:26.780863+0000","last_became_peered":"2024-03-16T07:25:26.780863+0000","last_unstale":"2024-03-16T07:25:40.791525+0000","last_undegraded":"2024-03-16T07:25:40.791525+0000","last_fullsized":"2024-03-16T07:25:40.791525+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:14:10.232665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.806564+0000","last_change":"2024-03-16T07:25:40.821248+0000","last_active":"2024-03-16T07:25:41.806564+0000","last_peered":"2024-03-16T07:25:41.806564+0000","last_clean":"2024-03-16T07:25:41.806564+0000","last_became_active":"2024-03-16T07:25:40.820751+0000","last_became_peered":"2024-03-16T07:25:40.820751+0000","last_unstale":"2024-03-16T07:25:41.806564+0000","last_undegraded":"2024-03-16T07:25:41.806564+0000","last_fullsized":"2024-03-16T07:25:41.806564+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_clean_scrub_stamp":"2024-03-16T07:25:39.782521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:29:42.298625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.808674+0000","last_change":"2024-03-16T07:25:26.782390+0000","last_active":"2024-03-16T07:25:41.808674+0000","last_peered":"2024-03-16T07:25:41.808674+0000","last_clean":"2024-03-16T07:25:41.808674+0000","last_became_active":"2024-03-16T07:25:26.781829+0000","last_became_peered":"2024-03-16T07:25:26.781829+0000","last_unstale":"2024-03-16T07:25:41.808674+0000","last_undegraded":"2024-03-16T07:25:41.808674+0000","last_fullsized":"2024-03-16T07:25:41.808674+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:53:30.197560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.808885+0000","last_change":"2024-03-16T07:25:40.824399+0000","last_active":"2024-03-16T07:25:41.808885+0000","last_peered":"2024-03-16T07:25:41.808885+0000","last_clean":"2024-03-16T07:25:41.808885+0000","last_became_active":"2024-03-16T07:25:40.824179+0000","last_became_peered":"2024-03-16T07:25:40.824179+0000","last_unstale":"2024-03-16T07:25:41.808885+0000","last_undegraded":"2024-03-16T07:25:41.808885+0000","last_fullsized":"2024-03-16T07:25:41.808885+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_clean_scrub_stamp":"2024-03-16T07:25:39.782521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:25:30.792729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-16T07:25:40.793304+0000","last_change":"2024-03-16T07:25:26.796633+0000","last_active":"2024-03-16T07:25:40.793304+0000","last_peered":"2024-03-16T07:25:40.793304+0000","last_clean":"2024-03-16T07:25:40.793304+0000","last_became_active":"2024-03-16T07:25:26.795891+0000","last_became_peered":"2024-03-16T07:25:26.795891+0000","last_unstale":"2024-03-16T07:25:40.793304+0000","last_undegraded":"2024-03-16T07:25:40.793304+0000","last_fullsized":"2024-03-16T07:25:40.793304+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:56:52.032603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.808093+0000","last_change":"2024-03-16T07:25:40.826151+0000","last_active":"2024-03-16T07:25:41.808093+0000","last_peered":"2024-03-16T07:25:41.808093+0000","last_clean":"2024-03-16T07:25:41.808093+0000","last_became_active":"2024-03-16T07:25:40.825700+0000","last_became_peered":"2024-03-16T07:25:40.825700+0000","last_unstale":"2024-03-16T07:25:41.808093+0000","last_undegraded":"2024-03-16T07:25:41.808093+0000","last_fullsized":"2024-03-16T07:25:41.808093+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_clean_scrub_stamp":"2024-03-16T07:25:39.782521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:49:48.590307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-16T07:25:40.791245+0000","last_change":"2024-03-16T07:25:26.797761+0000","last_active":"2024-03-16T07:25:40.791245+0000","last_peered":"2024-03-16T07:25:40.791245+0000","last_clean":"2024-03-16T07:25:40.791245+0000","last_became_active":"2024-03-16T07:25:26.796108+0000","last_became_peered":"2024-03-16T07:25:26.796108+0000","last_unstale":"2024-03-16T07:25:40.791245+0000","last_undegraded":"2024-03-16T07:25:40.791245+0000","last_fullsized":"2024-03-16T07:25:40.791245+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:46:16.995267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-16T07:25:40.819973+0000","last_change":"2024-03-16T07:25:40.813438+0000","last_active":"2024-03-16T07:25:40.819973+0000","last_peered":"2024-03-16T07:25:40.819973+0000","last_clean":"2024-03-16T07:25:40.819973+0000","last_became_active":"2024-03-16T07:25:40.812772+0000","last_became_peered":"2024-03-16T07:25:40.812772+0000","last_unstale":"2024-03-16T07:25:40.819973+0000","last_undegraded":"2024-03-16T07:25:40.819973+0000","last_fullsized":"2024-03-16T07:25:40.819973+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_clean_scrub_stamp":"2024-03-16T07:25:39.782521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:33:18.199318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-16T07:25:40.791701+0000","last_change":"2024-03-16T07:25:26.775670+0000","last_active":"2024-03-16T07:25:40.791701+0000","last_peered":"2024-03-16T07:25:40.791701+0000","last_clean":"2024-03-16T07:25:40.791701+0000","last_became_active":"2024-03-16T07:25:26.775387+0000","last_became_peered":"2024-03-16T07:25:26.775387+0000","last_unstale":"2024-03-16T07:25:40.791701+0000","last_undegraded":"2024-03-16T07:25:40.791701+0000","last_fullsized":"2024-03-16T07:25:40.791701+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:11:28.084567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-16T07:25:40.817223+0000","last_change":"2024-03-16T07:25:40.811949+0000","last_active":"2024-03-16T07:25:40.817223+0000","last_peered":"2024-03-16T07:25:40.817223+0000","last_clean":"2024-03-16T07:25:40.817223+0000","last_became_active":"2024-03-16T07:25:40.811369+0000","last_became_peered":"2024-03-16T07:25:40.811369+0000","last_unstale":"2024-03-16T07:25:40.817223+0000","last_undegraded":"2024-03-16T07:25:40.817223+0000","last_fullsized":"2024-03-16T07:25:40.817223+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_clean_scrub_stamp":"2024-03-16T07:25:39.782521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:30:39.951321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-16T07:25:40.790026+0000","last_change":"2024-03-16T07:25:26.773366+0000","last_active":"2024-03-16T07:25:40.790026+0000","last_peered":"2024-03-16T07:25:40.790026+0000","last_clean":"2024-03-16T07:25:40.790026+0000","last_became_active":"2024-03-16T07:25:26.773118+0000","last_became_peered":"2024-03-16T07:25:26.773118+0000","last_unstale":"2024-03-16T07:25:40.790026+0000","last_undegraded":"2024-03-16T07:25:40.790026+0000","last_fullsized":"2024-03-16T07:25:40.790026+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:54:15.721612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.808427+0000","last_change":"2024-03-16T07:25:40.812355+0000","last_active":"2024-03-16T07:25:41.808427+0000","last_peered":"2024-03-16T07:25:41.808427+0000","last_clean":"2024-03-16T07:25:41.808427+0000","last_became_active":"2024-03-16T07:25:40.812127+0000","last_became_peered":"2024-03-16T07:25:40.812127+0000","last_unstale":"2024-03-16T07:25:41.808427+0000","last_undegraded":"2024-03-16T07:25:41.808427+0000","last_fullsized":"2024-03-16T07:25:41.808427+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_clean_scrub_stamp":"2024-03-16T07:25:39.782521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:28:29.876723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-16T07:25:40.789001+0000","last_change":"2024-03-16T07:25:26.773093+0000","last_active":"2024-03-16T07:25:40.789001+0000","last_peered":"2024-03-16T07:25:40.789001+0000","last_clean":"2024-03-16T07:25:40.789001+0000","last_became_active":"2024-03-16T07:25:26.772835+0000","last_became_peered":"2024-03-16T07:25:26.772835+0000","last_unstale":"2024-03-16T07:25:40.789001+0000","last_undegraded":"2024-03-16T07:25:40.789001+0000","last_fullsized":"2024-03-16T07:25:40.789001+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:25:52.701175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-16T07:25:40.820835+0000","last_change":"2024-03-16T07:25:40.818199+0000","last_active":"2024-03-16T07:25:40.820835+0000","last_peered":"2024-03-16T07:25:40.820835+0000","last_clean":"2024-03-16T07:25:40.820835+0000","last_became_active":"2024-03-16T07:25:40.817788+0000","last_became_peered":"2024-03-16T07:25:40.817788+0000","last_unstale":"2024-03-16T07:25:40.820835+0000","last_undegraded":"2024-03-16T07:25:40.820835+0000","last_fullsized":"2024-03-16T07:25:40.820835+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_clean_scrub_stamp":"2024-03-16T07:25:39.782521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:25:23.088335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-16T07:25:40.789996+0000","last_change":"2024-03-16T07:25:26.776183+0000","last_active":"2024-03-16T07:25:40.789996+0000","last_peered":"2024-03-16T07:25:40.789996+0000","last_clean":"2024-03-16T07:25:40.789996+0000","last_became_active":"2024-03-16T07:25:26.775565+0000","last_became_peered":"2024-03-16T07:25:26.775565+0000","last_unstale":"2024-03-16T07:25:40.789996+0000","last_undegraded":"2024-03-16T07:25:40.789996+0000","last_fullsized":"2024-03-16T07:25:40.789996+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:27:47.666750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.804490+0000","last_change":"2024-03-16T07:25:40.823310+0000","last_active":"2024-03-16T07:25:41.804490+0000","last_peered":"2024-03-16T07:25:41.804490+0000","last_clean":"2024-03-16T07:25:41.804490+0000","last_became_active":"2024-03-16T07:25:40.820421+0000","last_became_peered":"2024-03-16T07:25:40.820421+0000","last_unstale":"2024-03-16T07:25:41.804490+0000","last_undegraded":"2024-03-16T07:25:41.804490+0000","last_fullsized":"2024-03-16T07:25:41.804490+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_clean_scrub_stamp":"2024-03-16T07:25:39.782521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:38:51.909230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.807952+0000","last_change":"2024-03-16T07:25:26.790704+0000","last_active":"2024-03-16T07:25:41.807952+0000","last_peered":"2024-03-16T07:25:41.807952+0000","last_clean":"2024-03-16T07:25:41.807952+0000","last_became_active":"2024-03-16T07:25:26.790439+0000","last_became_peered":"2024-03-16T07:25:26.790439+0000","last_unstale":"2024-03-16T07:25:41.807952+0000","last_undegraded":"2024-03-16T07:25:41.807952+0000","last_fullsized":"2024-03-16T07:25:41.807952+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:26:17.093512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-16T07:25:40.830887+0000","last_change":"2024-03-16T07:25:40.829946+0000","last_active":"2024-03-16T07:25:40.830887+0000","last_peered":"2024-03-16T07:25:40.830887+0000","last_clean":"2024-03-16T07:25:40.830887+0000","last_became_active":"2024-03-16T07:25:40.829720+0000","last_became_peered":"2024-03-16T07:25:40.829720+0000","last_unstale":"2024-03-16T07:25:40.830887+0000","last_undegraded":"2024-03-16T07:25:40.830887+0000","last_fullsized":"2024-03-16T07:25:40.830887+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_clean_scrub_stamp":"2024-03-16T07:25:39.782521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:53:08.397356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.805442+0000","last_change":"2024-03-16T07:25:26.781727+0000","last_active":"2024-03-16T07:25:41.805442+0000","last_peered":"2024-03-16T07:25:41.805442+0000","last_clean":"2024-03-16T07:25:41.805442+0000","last_became_active":"2024-03-16T07:25:26.781481+0000","last_became_peered":"2024-03-16T07:25:26.781481+0000","last_unstale":"2024-03-16T07:25:41.805442+0000","last_undegraded":"2024-03-16T07:25:41.805442+0000","last_fullsized":"2024-03-16T07:25:41.805442+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:39:12.805004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-16T07:25:40.821288+0000","last_change":"2024-03-16T07:25:40.819998+0000","last_active":"2024-03-16T07:25:40.821288+0000","last_peered":"2024-03-16T07:25:40.821288+0000","last_clean":"2024-03-16T07:25:40.821288+0000","last_became_active":"2024-03-16T07:25:40.819542+0000","last_became_peered":"2024-03-16T07:25:40.819542+0000","last_unstale":"2024-03-16T07:25:40.821288+0000","last_undegraded":"2024-03-16T07:25:40.821288+0000","last_fullsized":"2024-03-16T07:25:40.821288+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_clean_scrub_stamp":"2024-03-16T07:25:39.782521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:47:44.531089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-16T07:25:40.793472+0000","last_change":"2024-03-16T07:25:26.796897+0000","last_active":"2024-03-16T07:25:40.793472+0000","last_peered":"2024-03-16T07:25:40.793472+0000","last_clean":"2024-03-16T07:25:40.793472+0000","last_became_active":"2024-03-16T07:25:26.795947+0000","last_became_peered":"2024-03-16T07:25:26.795947+0000","last_unstale":"2024-03-16T07:25:40.793472+0000","last_undegraded":"2024-03-16T07:25:40.793472+0000","last_fullsized":"2024-03-16T07:25:40.793472+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:29:13.224702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.807954+0000","last_change":"2024-03-16T07:25:40.825964+0000","last_active":"2024-03-16T07:25:41.807954+0000","last_peered":"2024-03-16T07:25:41.807954+0000","last_clean":"2024-03-16T07:25:41.807954+0000","last_became_active":"2024-03-16T07:25:40.825002+0000","last_became_peered":"2024-03-16T07:25:40.825002+0000","last_unstale":"2024-03-16T07:25:41.807954+0000","last_undegraded":"2024-03-16T07:25:41.807954+0000","last_fullsized":"2024-03-16T07:25:41.807954+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_clean_scrub_stamp":"2024-03-16T07:25:39.782521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:44:48.980147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.807369+0000","last_change":"2024-03-16T07:25:26.793964+0000","last_active":"2024-03-16T07:25:41.807369+0000","last_peered":"2024-03-16T07:25:41.807369+0000","last_clean":"2024-03-16T07:25:41.807369+0000","last_became_active":"2024-03-16T07:25:26.793713+0000","last_became_peered":"2024-03-16T07:25:26.793713+0000","last_unstale":"2024-03-16T07:25:41.807369+0000","last_undegraded":"2024-03-16T07:25:41.807369+0000","last_fullsized":"2024-03-16T07:25:41.807369+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:25:48.897323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-16T07:25:40.820085+0000","last_change":"2024-03-16T07:25:40.816787+0000","last_active":"2024-03-16T07:25:40.820085+0000","last_peered":"2024-03-16T07:25:40.820085+0000","last_clean":"2024-03-16T07:25:40.820085+0000","last_became_active":"2024-03-16T07:25:40.816558+0000","last_became_peered":"2024-03-16T07:25:40.816558+0000","last_unstale":"2024-03-16T07:25:40.820085+0000","last_undegraded":"2024-03-16T07:25:40.820085+0000","last_fullsized":"2024-03-16T07:25:40.820085+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_clean_scrub_stamp":"2024-03-16T07:25:39.782521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:17:16.794149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.807297+0000","last_change":"2024-03-16T07:25:26.793226+0000","last_active":"2024-03-16T07:25:41.807297+0000","last_peered":"2024-03-16T07:25:41.807297+0000","last_clean":"2024-03-16T07:25:41.807297+0000","last_became_active":"2024-03-16T07:25:26.792996+0000","last_became_peered":"2024-03-16T07:25:26.792996+0000","last_unstale":"2024-03-16T07:25:41.807297+0000","last_undegraded":"2024-03-16T07:25:41.807297+0000","last_fullsized":"2024-03-16T07:25:41.807297+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:03:56.402808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-16T07:25:40.817244+0000","last_change":"2024-03-16T07:25:40.812147+0000","last_active":"2024-03-16T07:25:40.817244+0000","last_peered":"2024-03-16T07:25:40.817244+0000","last_clean":"2024-03-16T07:25:40.817244+0000","last_became_active":"2024-03-16T07:25:40.811720+0000","last_became_peered":"2024-03-16T07:25:40.811720+0000","last_unstale":"2024-03-16T07:25:40.817244+0000","last_undegraded":"2024-03-16T07:25:40.817244+0000","last_fullsized":"2024-03-16T07:25:40.817244+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_clean_scrub_stamp":"2024-03-16T07:25:39.782521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:45:18.030885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.806401+0000","last_change":"2024-03-16T07:25:26.791413+0000","last_active":"2024-03-16T07:25:41.806401+0000","last_peered":"2024-03-16T07:25:41.806401+0000","last_clean":"2024-03-16T07:25:41.806401+0000","last_became_active":"2024-03-16T07:25:26.790271+0000","last_became_peered":"2024-03-16T07:25:26.790271+0000","last_unstale":"2024-03-16T07:25:41.806401+0000","last_undegraded":"2024-03-16T07:25:41.806401+0000","last_fullsized":"2024-03-16T07:25:41.806401+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:00:23.249950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-16T07:25:40.820116+0000","last_change":"2024-03-16T07:25:40.813961+0000","last_active":"2024-03-16T07:25:40.820116+0000","last_peered":"2024-03-16T07:25:40.820116+0000","last_clean":"2024-03-16T07:25:40.820116+0000","last_became_active":"2024-03-16T07:25:40.813231+0000","last_became_peered":"2024-03-16T07:25:40.813231+0000","last_unstale":"2024-03-16T07:25:40.820116+0000","last_undegraded":"2024-03-16T07:25:40.820116+0000","last_fullsized":"2024-03-16T07:25:40.820116+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_clean_scrub_stamp":"2024-03-16T07:25:39.782521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:25:30.792729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.803896+0000","last_change":"2024-03-16T07:25:26.789325+0000","last_active":"2024-03-16T07:25:41.803896+0000","last_peered":"2024-03-16T07:25:41.803896+0000","last_clean":"2024-03-16T07:25:41.803896+0000","last_became_active":"2024-03-16T07:25:26.789018+0000","last_became_peered":"2024-03-16T07:25:26.789018+0000","last_unstale":"2024-03-16T07:25:41.803896+0000","last_undegraded":"2024-03-16T07:25:41.803896+0000","last_fullsized":"2024-03-16T07:25:41.803896+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:25:48.897323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-16T07:25:40.822712+0000","last_change":"2024-03-16T07:25:40.821382+0000","last_active":"2024-03-16T07:25:40.822712+0000","last_peered":"2024-03-16T07:25:40.822712+0000","last_clean":"2024-03-16T07:25:40.822712+0000","last_became_active":"2024-03-16T07:25:40.821120+0000","last_became_peered":"2024-03-16T07:25:40.821120+0000","last_unstale":"2024-03-16T07:25:40.822712+0000","last_undegraded":"2024-03-16T07:25:40.822712+0000","last_fullsized":"2024-03-16T07:25:40.822712+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_clean_scrub_stamp":"2024-03-16T07:25:39.782521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:42:32.939255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.805243+0000","last_change":"2024-03-16T07:25:26.767484+0000","last_active":"2024-03-16T07:25:41.805243+0000","last_peered":"2024-03-16T07:25:41.805243+0000","last_clean":"2024-03-16T07:25:41.805243+0000","last_became_active":"2024-03-16T07:25:26.766849+0000","last_became_peered":"2024-03-16T07:25:26.766849+0000","last_unstale":"2024-03-16T07:25:41.805243+0000","last_undegraded":"2024-03-16T07:25:41.805243+0000","last_fullsized":"2024-03-16T07:25:41.805243+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:24:13.541892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-16T07:25:40.829945+0000","last_change":"2024-03-16T07:25:40.827657+0000","last_active":"2024-03-16T07:25:40.829945+0000","last_peered":"2024-03-16T07:25:40.829945+0000","last_clean":"2024-03-16T07:25:40.829945+0000","last_became_active":"2024-03-16T07:25:40.827343+0000","last_became_peered":"2024-03-16T07:25:40.827343+0000","last_unstale":"2024-03-16T07:25:40.829945+0000","last_undegraded":"2024-03-16T07:25:40.829945+0000","last_fullsized":"2024-03-16T07:25:40.829945+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_clean_scrub_stamp":"2024-03-16T07:25:39.782521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:56:50.774729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.807256+0000","last_change":"2024-03-16T07:25:26.782881+0000","last_active":"2024-03-16T07:25:41.807256+0000","last_peered":"2024-03-16T07:25:41.807256+0000","last_clean":"2024-03-16T07:25:41.807256+0000","last_became_active":"2024-03-16T07:25:26.782050+0000","last_became_peered":"2024-03-16T07:25:26.782050+0000","last_unstale":"2024-03-16T07:25:41.807256+0000","last_undegraded":"2024-03-16T07:25:41.807256+0000","last_fullsized":"2024-03-16T07:25:41.807256+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:39:12.805004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.809923+0000","last_change":"2024-03-16T07:25:40.818823+0000","last_active":"2024-03-16T07:25:41.809923+0000","last_peered":"2024-03-16T07:25:41.809923+0000","last_clean":"2024-03-16T07:25:41.809923+0000","last_became_active":"2024-03-16T07:25:40.818589+0000","last_became_peered":"2024-03-16T07:25:40.818589+0000","last_unstale":"2024-03-16T07:25:41.809923+0000","last_undegraded":"2024-03-16T07:25:41.809923+0000","last_fullsized":"2024-03-16T07:25:41.809923+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_clean_scrub_stamp":"2024-03-16T07:25:39.782521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:33:18.199318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.805719+0000","last_change":"2024-03-16T07:25:26.782517+0000","last_active":"2024-03-16T07:25:41.805719+0000","last_peered":"2024-03-16T07:25:41.805719+0000","last_clean":"2024-03-16T07:25:41.805719+0000","last_became_active":"2024-03-16T07:25:26.782289+0000","last_became_peered":"2024-03-16T07:25:26.782289+0000","last_unstale":"2024-03-16T07:25:41.805719+0000","last_undegraded":"2024-03-16T07:25:41.805719+0000","last_fullsized":"2024-03-16T07:25:41.805719+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:56:44.440768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-16T07:25:40.812888+0000","last_change":"2024-03-16T07:25:40.806823+0000","last_active":"2024-03-16T07:25:40.812888+0000","last_peered":"2024-03-16T07:25:40.812888+0000","last_clean":"2024-03-16T07:25:40.812888+0000","last_became_active":"2024-03-16T07:25:40.806031+0000","last_became_peered":"2024-03-16T07:25:40.806031+0000","last_unstale":"2024-03-16T07:25:40.812888+0000","last_undegraded":"2024-03-16T07:25:40.812888+0000","last_fullsized":"2024-03-16T07:25:40.812888+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_clean_scrub_stamp":"2024-03-16T07:25:39.782521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:49:48.590307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.807164+0000","last_change":"2024-03-16T07:25:26.779789+0000","last_active":"2024-03-16T07:25:41.807164+0000","last_peered":"2024-03-16T07:25:41.807164+0000","last_clean":"2024-03-16T07:25:41.807164+0000","last_became_active":"2024-03-16T07:25:26.779560+0000","last_became_peered":"2024-03-16T07:25:26.779560+0000","last_unstale":"2024-03-16T07:25:41.807164+0000","last_undegraded":"2024-03-16T07:25:41.807164+0000","last_fullsized":"2024-03-16T07:25:41.807164+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:36:38.284510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-16T07:25:40.808272+0000","last_change":"2024-03-16T07:25:40.805732+0000","last_active":"2024-03-16T07:25:40.808272+0000","last_peered":"2024-03-16T07:25:40.808272+0000","last_clean":"2024-03-16T07:25:40.808272+0000","last_became_active":"2024-03-16T07:25:40.805481+0000","last_became_peered":"2024-03-16T07:25:40.805481+0000","last_unstale":"2024-03-16T07:25:40.808272+0000","last_undegraded":"2024-03-16T07:25:40.808272+0000","last_fullsized":"2024-03-16T07:25:40.808272+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_clean_scrub_stamp":"2024-03-16T07:25:39.782521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:43:35.925010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-16T07:25:40.791376+0000","last_change":"2024-03-16T07:25:26.797893+0000","last_active":"2024-03-16T07:25:40.791376+0000","last_peered":"2024-03-16T07:25:40.791376+0000","last_clean":"2024-03-16T07:25:40.791376+0000","last_became_active":"2024-03-16T07:25:26.795108+0000","last_became_peered":"2024-03-16T07:25:26.795108+0000","last_unstale":"2024-03-16T07:25:40.791376+0000","last_undegraded":"2024-03-16T07:25:40.791376+0000","last_fullsized":"2024-03-16T07:25:40.791376+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:27:26.808454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.807396+0000","last_change":"2024-03-16T07:25:40.822656+0000","last_active":"2024-03-16T07:25:41.807396+0000","last_peered":"2024-03-16T07:25:41.807396+0000","last_clean":"2024-03-16T07:25:41.807396+0000","last_became_active":"2024-03-16T07:25:40.822433+0000","last_became_peered":"2024-03-16T07:25:40.822433+0000","last_unstale":"2024-03-16T07:25:41.807396+0000","last_undegraded":"2024-03-16T07:25:41.807396+0000","last_fullsized":"2024-03-16T07:25:41.807396+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_clean_scrub_stamp":"2024-03-16T07:25:39.782521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:49:48.590307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3f","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.809274+0000","last_change":"2024-03-16T07:25:26.778321+0000","last_active":"2024-03-16T07:25:41.809274+0000","last_peered":"2024-03-16T07:25:41.809274+0000","last_clean":"2024-03-16T07:25:41.809274+0000","last_became_active":"2024-03-16T07:25:26.778060+0000","last_became_peered":"2024-03-16T07:25:26.778060+0000","last_unstale":"2024-03-16T07:25:41.809274+0000","last_undegraded":"2024-03-16T07:25:41.809274+0000","last_fullsized":"2024-03-16T07:25:41.809274+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:56:24.824794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":4107,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":8214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738386,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":31504,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":104826096,"statfs":{"total":107374182400,"available":107341922304,"internally_reserved":0,"allocated":331776,"data_stored":105636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738386,"num_pgs":79,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":32088,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":104825512,"statfs":{"total":107374182400,"available":107341324288,"internally_reserved":0,"allocated":929792,"data_stored":697771,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738386,"num_pgs":80,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":32084,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":104825516,"statfs":{"total":107374182400,"available":107341328384,"internally_reserved":0,"allocated":917504,"data_stored":694976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3981,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":4107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-16T07:25:44.951 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-16T07:25:45.323 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:25:45.327 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2024-03-16T07:25:45.336 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":65,"stamp":"2024-03-16T07:25:44.910225+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596885,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":230,"num_write_kb":1925,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":178,"ondisk_log_size":178,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":226,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":314572800,"kb_used":95676,"kb_used_data":2128,"kb_used_omap":4,"kb_used_meta":93499,"kb_avail":314477124,"statfs":{"total":322122547200,"available":322024574976,"internally_reserved":0,"allocated":2179072,"data_stored":1498383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":95743311},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001022"},"pg_stats":[{"pgid":"7.6","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-16T07:25:40.830149+0000","last_change":"2024-03-16T07:25:40.829330+0000","last_active":"2024-03-16T07:25:40.830149+0000","last_peered":"2024-03-16T07:25:40.830149+0000","last_clean":"2024-03-16T07:25:40.830149+0000","last_became_active":"2024-03-16T07:25:40.829091+0000","last_became_peered":"2024-03-16T07:25:40.829091+0000","last_unstale":"2024-03-16T07:25:40.830149+0000","last_undegraded":"2024-03-16T07:25:40.830149+0000","last_fullsized":"2024-03-16T07:25:40.830149+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_clean_scrub_stamp":"2024-03-16T07:25:39.782521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:17:30.080005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'97","reported_seq":177,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.807111+0000","last_change":"2024-03-16T07:24:31.650537+0000","last_active":"2024-03-16T07:25:41.807111+0000","last_peered":"2024-03-16T07:25:41.807111+0000","last_clean":"2024-03-16T07:25:41.807111+0000","last_became_active":"2024-03-16T07:24:31.649574+0000","last_became_peered":"2024-03-16T07:24:31.649574+0000","last_unstale":"2024-03-16T07:25:41.807111+0000","last_undegraded":"2024-03-16T07:25:41.807111+0000","last_fullsized":"2024-03-16T07:25:41.807111+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:29.719970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:29.719970+0000","last_clean_scrub_stamp":"2024-03-16T07:24:29.719970+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:31:35.774554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.805415+0000","last_change":"2024-03-16T07:25:25.766868+0000","last_active":"2024-03-16T07:25:41.805415+0000","last_peered":"2024-03-16T07:25:41.805415+0000","last_clean":"2024-03-16T07:25:41.805415+0000","last_became_active":"2024-03-16T07:25:25.766116+0000","last_became_peered":"2024-03-16T07:25:25.766116+0000","last_unstale":"2024-03-16T07:25:41.805415+0000","last_undegraded":"2024-03-16T07:25:41.805415+0000","last_fullsized":"2024-03-16T07:25:41.805415+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_clean_scrub_stamp":"2024-03-16T07:25:24.745467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:27:23.414873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-16T07:25:40.788951+0000","last_change":"2024-03-16T07:25:26.774790+0000","last_active":"2024-03-16T07:25:40.788951+0000","last_peered":"2024-03-16T07:25:40.788951+0000","last_clean":"2024-03-16T07:25:40.788951+0000","last_became_active":"2024-03-16T07:25:26.774186+0000","last_became_peered":"2024-03-16T07:25:26.774186+0000","last_unstale":"2024-03-16T07:25:40.788951+0000","last_undegraded":"2024-03-16T07:25:40.788951+0000","last_fullsized":"2024-03-16T07:25:40.788951+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:20:23.541708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"31'2","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-16T07:25:40.828636+0000","last_change":"2024-03-16T07:25:39.811684+0000","last_active":"2024-03-16T07:25:40.828636+0000","last_peered":"2024-03-16T07:25:40.828636+0000","last_clean":"2024-03-16T07:25:40.828636+0000","last_became_active":"2024-03-16T07:25:39.811288+0000","last_became_peered":"2024-03-16T07:25:39.811288+0000","last_unstale":"2024-03-16T07:25:40.828636+0000","last_undegraded":"2024-03-16T07:25:40.828636+0000","last_fullsized":"2024-03-16T07:25:40.828636+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:38.779484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:38.779484+0000","last_clean_scrub_stamp":"2024-03-16T07:25:38.779484+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:16:10.819666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-16T07:25:40.830180+0000","last_change":"2024-03-16T07:25:40.829297+0000","last_active":"2024-03-16T07:25:40.830180+0000","last_peered":"2024-03-16T07:25:40.830180+0000","last_clean":"2024-03-16T07:25:40.830180+0000","last_became_active":"2024-03-16T07:25:40.828924+0000","last_became_peered":"2024-03-16T07:25:40.828924+0000","last_unstale":"2024-03-16T07:25:40.830180+0000","last_undegraded":"2024-03-16T07:25:40.830180+0000","last_fullsized":"2024-03-16T07:25:40.830180+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_clean_scrub_stamp":"2024-03-16T07:25:39.782521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:10:02.901457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":20,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-16T07:25:40.789649+0000","last_change":"2024-03-16T07:25:25.771801+0000","last_active":"2024-03-16T07:25:40.789649+0000","last_peered":"2024-03-16T07:25:40.789649+0000","last_clean":"2024-03-16T07:25:40.789649+0000","last_became_active":"2024-03-16T07:25:25.771527+0000","last_became_peered":"2024-03-16T07:25:25.771527+0000","last_unstale":"2024-03-16T07:25:40.789649+0000","last_undegraded":"2024-03-16T07:25:40.789649+0000","last_fullsized":"2024-03-16T07:25:40.789649+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_clean_scrub_stamp":"2024-03-16T07:25:24.745467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:58:27.329136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.803701+0000","last_change":"2024-03-16T07:25:26.783268+0000","last_active":"2024-03-16T07:25:41.803701+0000","last_peered":"2024-03-16T07:25:41.803701+0000","last_clean":"2024-03-16T07:25:41.803701+0000","last_became_active":"2024-03-16T07:25:26.782999+0000","last_became_peered":"2024-03-16T07:25:26.782999+0000","last_unstale":"2024-03-16T07:25:41.803701+0000","last_undegraded":"2024-03-16T07:25:41.803701+0000","last_fullsized":"2024-03-16T07:25:41.803701+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:56:24.824794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.805519+0000","last_change":"2024-03-16T07:25:39.803593+0000","last_active":"2024-03-16T07:25:41.805519+0000","last_peered":"2024-03-16T07:25:41.805519+0000","last_clean":"2024-03-16T07:25:41.805519+0000","last_became_active":"2024-03-16T07:25:39.803225+0000","last_became_peered":"2024-03-16T07:25:39.803225+0000","last_unstale":"2024-03-16T07:25:41.805519+0000","last_undegraded":"2024-03-16T07:25:41.805519+0000","last_fullsized":"2024-03-16T07:25:41.805519+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:38.779484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:38.779484+0000","last_clean_scrub_stamp":"2024-03-16T07:25:38.779484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:14:23.265309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.805071+0000","last_change":"2024-03-16T07:25:40.819154+0000","last_active":"2024-03-16T07:25:41.805071+0000","last_peered":"2024-03-16T07:25:41.805071+0000","last_clean":"2024-03-16T07:25:41.805071+0000","last_became_active":"2024-03-16T07:25:40.815805+0000","last_became_peered":"2024-03-16T07:25:40.815805+0000","last_unstale":"2024-03-16T07:25:41.805071+0000","last_undegraded":"2024-03-16T07:25:41.805071+0000","last_fullsized":"2024-03-16T07:25:41.805071+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_clean_scrub_stamp":"2024-03-16T07:25:39.782521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:16:11.822703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.803996+0000","last_change":"2024-03-16T07:25:25.769122+0000","last_active":"2024-03-16T07:25:41.803996+0000","last_peered":"2024-03-16T07:25:41.803996+0000","last_clean":"2024-03-16T07:25:41.803996+0000","last_became_active":"2024-03-16T07:25:25.768867+0000","last_became_peered":"2024-03-16T07:25:25.768867+0000","last_unstale":"2024-03-16T07:25:41.803996+0000","last_undegraded":"2024-03-16T07:25:41.803996+0000","last_fullsized":"2024-03-16T07:25:41.803996+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_clean_scrub_stamp":"2024-03-16T07:25:24.745467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:31:27.516098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.805989+0000","last_change":"2024-03-16T07:25:26.791209+0000","last_active":"2024-03-16T07:25:41.805989+0000","last_peered":"2024-03-16T07:25:41.805989+0000","last_clean":"2024-03-16T07:25:41.805989+0000","last_became_active":"2024-03-16T07:25:26.790886+0000","last_became_peered":"2024-03-16T07:25:26.790886+0000","last_unstale":"2024-03-16T07:25:41.805989+0000","last_undegraded":"2024-03-16T07:25:41.805989+0000","last_fullsized":"2024-03-16T07:25:41.805989+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:13:26.639460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-16T07:25:40.793239+0000","last_change":"2024-03-16T07:25:39.812175+0000","last_active":"2024-03-16T07:25:40.793239+0000","last_peered":"2024-03-16T07:25:40.793239+0000","last_clean":"2024-03-16T07:25:40.793239+0000","last_became_active":"2024-03-16T07:25:39.811716+0000","last_became_peered":"2024-03-16T07:25:39.811716+0000","last_unstale":"2024-03-16T07:25:40.793239+0000","last_undegraded":"2024-03-16T07:25:40.793239+0000","last_fullsized":"2024-03-16T07:25:40.793239+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:38.779484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:38.779484+0000","last_clean_scrub_stamp":"2024-03-16T07:25:38.779484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:29:41.295588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.804802+0000","last_change":"2024-03-16T07:25:40.820109+0000","last_active":"2024-03-16T07:25:41.804802+0000","last_peered":"2024-03-16T07:25:41.804802+0000","last_clean":"2024-03-16T07:25:41.804802+0000","last_became_active":"2024-03-16T07:25:40.819894+0000","last_became_peered":"2024-03-16T07:25:40.819894+0000","last_unstale":"2024-03-16T07:25:41.804802+0000","last_undegraded":"2024-03-16T07:25:41.804802+0000","last_fullsized":"2024-03-16T07:25:41.804802+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_clean_scrub_stamp":"2024-03-16T07:25:39.782521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:30:09.484996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.803395+0000","last_change":"2024-03-16T07:25:25.770422+0000","last_active":"2024-03-16T07:25:41.803395+0000","last_peered":"2024-03-16T07:25:41.803395+0000","last_clean":"2024-03-16T07:25:41.803395+0000","last_became_active":"2024-03-16T07:25:25.770153+0000","last_became_peered":"2024-03-16T07:25:25.770153+0000","last_unstale":"2024-03-16T07:25:41.803395+0000","last_undegraded":"2024-03-16T07:25:41.803395+0000","last_fullsized":"2024-03-16T07:25:41.803395+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_clean_scrub_stamp":"2024-03-16T07:25:24.745467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:21:53.419532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-16T07:25:40.792513+0000","last_change":"2024-03-16T07:25:26.797291+0000","last_active":"2024-03-16T07:25:40.792513+0000","last_peered":"2024-03-16T07:25:40.792513+0000","last_clean":"2024-03-16T07:25:40.792513+0000","last_became_active":"2024-03-16T07:25:26.794780+0000","last_became_peered":"2024-03-16T07:25:26.794780+0000","last_unstale":"2024-03-16T07:25:40.792513+0000","last_undegraded":"2024-03-16T07:25:40.792513+0000","last_fullsized":"2024-03-16T07:25:40.792513+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:38:56.222762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-16T07:25:40.788979+0000","last_change":"2024-03-16T07:25:39.810268+0000","last_active":"2024-03-16T07:25:40.788979+0000","last_peered":"2024-03-16T07:25:40.788979+0000","last_clean":"2024-03-16T07:25:40.788979+0000","last_became_active":"2024-03-16T07:25:39.807126+0000","last_became_peered":"2024-03-16T07:25:39.807126+0000","last_unstale":"2024-03-16T07:25:40.788979+0000","last_undegraded":"2024-03-16T07:25:40.788979+0000","last_fullsized":"2024-03-16T07:25:40.788979+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:38.779484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:38.779484+0000","last_clean_scrub_stamp":"2024-03-16T07:25:38.779484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:39:56.614958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.807004+0000","last_change":"2024-03-16T07:25:40.827237+0000","last_active":"2024-03-16T07:25:41.807004+0000","last_peered":"2024-03-16T07:25:41.807004+0000","last_clean":"2024-03-16T07:25:41.807004+0000","last_became_active":"2024-03-16T07:25:40.826843+0000","last_became_peered":"2024-03-16T07:25:40.826843+0000","last_unstale":"2024-03-16T07:25:41.807004+0000","last_undegraded":"2024-03-16T07:25:41.807004+0000","last_fullsized":"2024-03-16T07:25:41.807004+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_clean_scrub_stamp":"2024-03-16T07:25:39.782521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:44:48.980147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":20,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-16T07:25:40.791430+0000","last_change":"2024-03-16T07:25:25.764585+0000","last_active":"2024-03-16T07:25:40.791430+0000","last_peered":"2024-03-16T07:25:40.791430+0000","last_clean":"2024-03-16T07:25:40.791430+0000","last_became_active":"2024-03-16T07:25:25.764145+0000","last_became_peered":"2024-03-16T07:25:25.764145+0000","last_unstale":"2024-03-16T07:25:40.791430+0000","last_undegraded":"2024-03-16T07:25:40.791430+0000","last_fullsized":"2024-03-16T07:25:40.791430+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_clean_scrub_stamp":"2024-03-16T07:25:24.745467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:04:30.099786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-16T07:25:40.789589+0000","last_change":"2024-03-16T07:25:26.776390+0000","last_active":"2024-03-16T07:25:40.789589+0000","last_peered":"2024-03-16T07:25:40.789589+0000","last_clean":"2024-03-16T07:25:40.789589+0000","last_became_active":"2024-03-16T07:25:26.776048+0000","last_became_peered":"2024-03-16T07:25:26.776048+0000","last_unstale":"2024-03-16T07:25:40.789589+0000","last_undegraded":"2024-03-16T07:25:40.789589+0000","last_fullsized":"2024-03-16T07:25:40.789589+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:51:04.025947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.804256+0000","last_change":"2024-03-16T07:25:39.809328+0000","last_active":"2024-03-16T07:25:41.804256+0000","last_peered":"2024-03-16T07:25:41.804256+0000","last_clean":"2024-03-16T07:25:41.804256+0000","last_became_active":"2024-03-16T07:25:39.809093+0000","last_became_peered":"2024-03-16T07:25:39.809093+0000","last_unstale":"2024-03-16T07:25:41.804256+0000","last_undegraded":"2024-03-16T07:25:41.804256+0000","last_fullsized":"2024-03-16T07:25:41.804256+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:38.779484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:38.779484+0000","last_clean_scrub_stamp":"2024-03-16T07:25:38.779484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:20:20.029111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.810726+0000","last_change":"2024-03-16T07:25:40.826272+0000","last_active":"2024-03-16T07:25:41.810726+0000","last_peered":"2024-03-16T07:25:41.810726+0000","last_clean":"2024-03-16T07:25:41.810726+0000","last_became_active":"2024-03-16T07:25:40.826021+0000","last_became_peered":"2024-03-16T07:25:40.826021+0000","last_unstale":"2024-03-16T07:25:41.810726+0000","last_undegraded":"2024-03-16T07:25:41.810726+0000","last_fullsized":"2024-03-16T07:25:41.810726+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_clean_scrub_stamp":"2024-03-16T07:25:39.782521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:45:18.030885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.804963+0000","last_change":"2024-03-16T07:25:25.766122+0000","last_active":"2024-03-16T07:25:41.804963+0000","last_peered":"2024-03-16T07:25:41.804963+0000","last_clean":"2024-03-16T07:25:41.804963+0000","last_became_active":"2024-03-16T07:25:25.765858+0000","last_became_peered":"2024-03-16T07:25:25.765858+0000","last_unstale":"2024-03-16T07:25:41.804963+0000","last_undegraded":"2024-03-16T07:25:41.804963+0000","last_fullsized":"2024-03-16T07:25:41.804963+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_clean_scrub_stamp":"2024-03-16T07:25:24.745467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:31:45.647975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-16T07:25:40.792176+0000","last_change":"2024-03-16T07:25:26.796631+0000","last_active":"2024-03-16T07:25:40.792176+0000","last_peered":"2024-03-16T07:25:40.792176+0000","last_clean":"2024-03-16T07:25:40.792176+0000","last_became_active":"2024-03-16T07:25:26.795444+0000","last_became_peered":"2024-03-16T07:25:26.795444+0000","last_unstale":"2024-03-16T07:25:40.792176+0000","last_undegraded":"2024-03-16T07:25:40.792176+0000","last_fullsized":"2024-03-16T07:25:40.792176+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:24:20.038095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"32'1","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:42.791246+0000","last_change":"2024-03-16T07:25:39.810716+0000","last_active":"2024-03-16T07:25:42.791246+0000","last_peered":"2024-03-16T07:25:42.791246+0000","last_clean":"2024-03-16T07:25:42.791246+0000","last_became_active":"2024-03-16T07:25:39.810469+0000","last_became_peered":"2024-03-16T07:25:39.810469+0000","last_unstale":"2024-03-16T07:25:42.791246+0000","last_undegraded":"2024-03-16T07:25:42.791246+0000","last_fullsized":"2024-03-16T07:25:42.791246+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:38.779484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:38.779484+0000","last_clean_scrub_stamp":"2024-03-16T07:25:38.779484+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:30:27.102059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.808032+0000","last_change":"2024-03-16T07:25:40.809010+0000","last_active":"2024-03-16T07:25:41.808032+0000","last_peered":"2024-03-16T07:25:41.808032+0000","last_clean":"2024-03-16T07:25:41.808032+0000","last_became_active":"2024-03-16T07:25:40.808769+0000","last_became_peered":"2024-03-16T07:25:40.808769+0000","last_unstale":"2024-03-16T07:25:41.808032+0000","last_undegraded":"2024-03-16T07:25:41.808032+0000","last_fullsized":"2024-03-16T07:25:41.808032+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_clean_scrub_stamp":"2024-03-16T07:25:39.782521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:43:35.925010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"28'1","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-16T07:25:40.791259+0000","last_change":"2024-03-16T07:25:25.773182+0000","last_active":"2024-03-16T07:25:40.791259+0000","last_peered":"2024-03-16T07:25:40.791259+0000","last_clean":"2024-03-16T07:25:40.791259+0000","last_became_active":"2024-03-16T07:25:25.772861+0000","last_became_peered":"2024-03-16T07:25:25.772861+0000","last_unstale":"2024-03-16T07:25:40.791259+0000","last_undegraded":"2024-03-16T07:25:40.791259+0000","last_fullsized":"2024-03-16T07:25:40.791259+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_clean_scrub_stamp":"2024-03-16T07:25:24.745467+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:35:13.105887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-16T07:25:40.791802+0000","last_change":"2024-03-16T07:25:26.797488+0000","last_active":"2024-03-16T07:25:40.791802+0000","last_peered":"2024-03-16T07:25:40.791802+0000","last_clean":"2024-03-16T07:25:40.791802+0000","last_became_active":"2024-03-16T07:25:26.794894+0000","last_became_peered":"2024-03-16T07:25:26.794894+0000","last_unstale":"2024-03-16T07:25:40.791802+0000","last_undegraded":"2024-03-16T07:25:40.791802+0000","last_fullsized":"2024-03-16T07:25:40.791802+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:29:04.480593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.805944+0000","last_change":"2024-03-16T07:25:39.816151+0000","last_active":"2024-03-16T07:25:41.805944+0000","last_peered":"2024-03-16T07:25:41.805944+0000","last_clean":"2024-03-16T07:25:41.805944+0000","last_became_active":"2024-03-16T07:25:39.815863+0000","last_became_peered":"2024-03-16T07:25:39.815863+0000","last_unstale":"2024-03-16T07:25:41.805944+0000","last_undegraded":"2024-03-16T07:25:41.805944+0000","last_fullsized":"2024-03-16T07:25:41.805944+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:38.779484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:38.779484+0000","last_clean_scrub_stamp":"2024-03-16T07:25:38.779484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:39:09.255406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-16T07:25:40.817241+0000","last_change":"2024-03-16T07:25:40.812403+0000","last_active":"2024-03-16T07:25:40.817241+0000","last_peered":"2024-03-16T07:25:40.817241+0000","last_clean":"2024-03-16T07:25:40.817241+0000","last_became_active":"2024-03-16T07:25:40.812080+0000","last_became_peered":"2024-03-16T07:25:40.812080+0000","last_unstale":"2024-03-16T07:25:40.817241+0000","last_undegraded":"2024-03-16T07:25:40.817241+0000","last_fullsized":"2024-03-16T07:25:40.817241+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_clean_scrub_stamp":"2024-03-16T07:25:39.782521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:28:29.876723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"27'2","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.806940+0000","last_change":"2024-03-16T07:25:25.771377+0000","last_active":"2024-03-16T07:25:41.806940+0000","last_peered":"2024-03-16T07:25:41.806940+0000","last_clean":"2024-03-16T07:25:41.806940+0000","last_became_active":"2024-03-16T07:25:25.771098+0000","last_became_peered":"2024-03-16T07:25:25.771098+0000","last_unstale":"2024-03-16T07:25:41.806940+0000","last_undegraded":"2024-03-16T07:25:41.806940+0000","last_fullsized":"2024-03-16T07:25:41.806940+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_clean_scrub_stamp":"2024-03-16T07:25:24.745467+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:05:38.205183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.809664+0000","last_change":"2024-03-16T07:25:26.787104+0000","last_active":"2024-03-16T07:25:41.809664+0000","last_peered":"2024-03-16T07:25:41.809664+0000","last_clean":"2024-03-16T07:25:41.809664+0000","last_became_active":"2024-03-16T07:25:26.786575+0000","last_became_peered":"2024-03-16T07:25:26.786575+0000","last_unstale":"2024-03-16T07:25:41.809664+0000","last_undegraded":"2024-03-16T07:25:41.809664+0000","last_fullsized":"2024-03-16T07:25:41.809664+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:52:53.885034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-16T07:25:40.793116+0000","last_change":"2024-03-16T07:25:39.808069+0000","last_active":"2024-03-16T07:25:40.793116+0000","last_peered":"2024-03-16T07:25:40.793116+0000","last_clean":"2024-03-16T07:25:40.793116+0000","last_became_active":"2024-03-16T07:25:39.807716+0000","last_became_peered":"2024-03-16T07:25:39.807716+0000","last_unstale":"2024-03-16T07:25:40.793116+0000","last_undegraded":"2024-03-16T07:25:40.793116+0000","last_fullsized":"2024-03-16T07:25:40.793116+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:38.779484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:38.779484+0000","last_clean_scrub_stamp":"2024-03-16T07:25:38.779484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:49:50.182222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.805925+0000","last_change":"2024-03-16T07:25:40.823734+0000","last_active":"2024-03-16T07:25:41.805925+0000","last_peered":"2024-03-16T07:25:41.805925+0000","last_clean":"2024-03-16T07:25:41.805925+0000","last_became_active":"2024-03-16T07:25:40.823493+0000","last_became_peered":"2024-03-16T07:25:40.823493+0000","last_unstale":"2024-03-16T07:25:41.805925+0000","last_undegraded":"2024-03-16T07:25:41.805925+0000","last_fullsized":"2024-03-16T07:25:41.805925+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_clean_scrub_stamp":"2024-03-16T07:25:39.782521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:16:11.822703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.806831+0000","last_change":"2024-03-16T07:25:25.775102+0000","last_active":"2024-03-16T07:25:41.806831+0000","last_peered":"2024-03-16T07:25:41.806831+0000","last_clean":"2024-03-16T07:25:41.806831+0000","last_became_active":"2024-03-16T07:25:25.774651+0000","last_became_peered":"2024-03-16T07:25:25.774651+0000","last_unstale":"2024-03-16T07:25:41.806831+0000","last_undegraded":"2024-03-16T07:25:41.806831+0000","last_fullsized":"2024-03-16T07:25:41.806831+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_clean_scrub_stamp":"2024-03-16T07:25:24.745467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:46:35.716476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.803919+0000","last_change":"2024-03-16T07:25:26.788813+0000","last_active":"2024-03-16T07:25:41.803919+0000","last_peered":"2024-03-16T07:25:41.803919+0000","last_clean":"2024-03-16T07:25:41.803919+0000","last_became_active":"2024-03-16T07:25:26.788546+0000","last_became_peered":"2024-03-16T07:25:26.788546+0000","last_unstale":"2024-03-16T07:25:41.803919+0000","last_undegraded":"2024-03-16T07:25:41.803919+0000","last_fullsized":"2024-03-16T07:25:41.803919+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:15:25.308866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-16T07:25:40.790498+0000","last_change":"2024-03-16T07:25:39.807821+0000","last_active":"2024-03-16T07:25:40.790498+0000","last_peered":"2024-03-16T07:25:40.790498+0000","last_clean":"2024-03-16T07:25:40.790498+0000","last_became_active":"2024-03-16T07:25:39.807201+0000","last_became_peered":"2024-03-16T07:25:39.807201+0000","last_unstale":"2024-03-16T07:25:40.790498+0000","last_undegraded":"2024-03-16T07:25:40.790498+0000","last_fullsized":"2024-03-16T07:25:40.790498+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:38.779484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:38.779484+0000","last_clean_scrub_stamp":"2024-03-16T07:25:38.779484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:08:44.275402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.804832+0000","last_change":"2024-03-16T07:25:40.818955+0000","last_active":"2024-03-16T07:25:41.804832+0000","last_peered":"2024-03-16T07:25:41.804832+0000","last_clean":"2024-03-16T07:25:41.804832+0000","last_became_active":"2024-03-16T07:25:40.815283+0000","last_became_peered":"2024-03-16T07:25:40.815283+0000","last_unstale":"2024-03-16T07:25:41.804832+0000","last_undegraded":"2024-03-16T07:25:41.804832+0000","last_fullsized":"2024-03-16T07:25:41.804832+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_clean_scrub_stamp":"2024-03-16T07:25:39.782521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:26:49.376060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.803536+0000","last_change":"2024-03-16T07:25:25.769426+0000","last_active":"2024-03-16T07:25:41.803536+0000","last_peered":"2024-03-16T07:25:41.803536+0000","last_clean":"2024-03-16T07:25:41.803536+0000","last_became_active":"2024-03-16T07:25:25.769183+0000","last_became_peered":"2024-03-16T07:25:25.769183+0000","last_unstale":"2024-03-16T07:25:41.803536+0000","last_undegraded":"2024-03-16T07:25:41.803536+0000","last_fullsized":"2024-03-16T07:25:41.803536+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_clean_scrub_stamp":"2024-03-16T07:25:24.745467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:23:21.193828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.806074+0000","last_change":"2024-03-16T07:25:26.781283+0000","last_active":"2024-03-16T07:25:41.806074+0000","last_peered":"2024-03-16T07:25:41.806074+0000","last_clean":"2024-03-16T07:25:41.806074+0000","last_became_active":"2024-03-16T07:25:26.781030+0000","last_became_peered":"2024-03-16T07:25:26.781030+0000","last_unstale":"2024-03-16T07:25:41.806074+0000","last_undegraded":"2024-03-16T07:25:41.806074+0000","last_fullsized":"2024-03-16T07:25:41.806074+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:24:13.541892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"31'2","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.805251+0000","last_change":"2024-03-16T07:25:39.814162+0000","last_active":"2024-03-16T07:25:41.805251+0000","last_peered":"2024-03-16T07:25:41.805251+0000","last_clean":"2024-03-16T07:25:41.805251+0000","last_became_active":"2024-03-16T07:25:39.813908+0000","last_became_peered":"2024-03-16T07:25:39.813908+0000","last_unstale":"2024-03-16T07:25:41.805251+0000","last_undegraded":"2024-03-16T07:25:41.805251+0000","last_fullsized":"2024-03-16T07:25:41.805251+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:38.779484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:38.779484+0000","last_clean_scrub_stamp":"2024-03-16T07:25:38.779484+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:11:41.117211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-16T07:25:40.829923+0000","last_change":"2024-03-16T07:25:40.824183+0000","last_active":"2024-03-16T07:25:40.829923+0000","last_peered":"2024-03-16T07:25:40.829923+0000","last_clean":"2024-03-16T07:25:40.829923+0000","last_became_active":"2024-03-16T07:25:40.823902+0000","last_became_peered":"2024-03-16T07:25:40.823902+0000","last_unstale":"2024-03-16T07:25:40.829923+0000","last_undegraded":"2024-03-16T07:25:40.829923+0000","last_fullsized":"2024-03-16T07:25:40.829923+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_clean_scrub_stamp":"2024-03-16T07:25:39.782521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:27:28.185344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.804124+0000","last_change":"2024-03-16T07:25:25.776342+0000","last_active":"2024-03-16T07:25:41.804124+0000","last_peered":"2024-03-16T07:25:41.804124+0000","last_clean":"2024-03-16T07:25:41.804124+0000","last_became_active":"2024-03-16T07:25:25.776083+0000","last_became_peered":"2024-03-16T07:25:25.776083+0000","last_unstale":"2024-03-16T07:25:41.804124+0000","last_undegraded":"2024-03-16T07:25:41.804124+0000","last_fullsized":"2024-03-16T07:25:41.804124+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_clean_scrub_stamp":"2024-03-16T07:25:24.745467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:22:26.980496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.807656+0000","last_change":"2024-03-16T07:25:26.782666+0000","last_active":"2024-03-16T07:25:41.807656+0000","last_peered":"2024-03-16T07:25:41.807656+0000","last_clean":"2024-03-16T07:25:41.807656+0000","last_became_active":"2024-03-16T07:25:26.781644+0000","last_became_peered":"2024-03-16T07:25:26.781644+0000","last_unstale":"2024-03-16T07:25:41.807656+0000","last_undegraded":"2024-03-16T07:25:41.807656+0000","last_fullsized":"2024-03-16T07:25:41.807656+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:44:15.933653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.806645+0000","last_change":"2024-03-16T07:25:39.816300+0000","last_active":"2024-03-16T07:25:41.806645+0000","last_peered":"2024-03-16T07:25:41.806645+0000","last_clean":"2024-03-16T07:25:41.806645+0000","last_became_active":"2024-03-16T07:25:39.815329+0000","last_became_peered":"2024-03-16T07:25:39.815329+0000","last_unstale":"2024-03-16T07:25:41.806645+0000","last_undegraded":"2024-03-16T07:25:41.806645+0000","last_fullsized":"2024-03-16T07:25:41.806645+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:38.779484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:38.779484+0000","last_clean_scrub_stamp":"2024-03-16T07:25:38.779484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:24:33.070739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.805892+0000","last_change":"2024-03-16T07:25:40.818544+0000","last_active":"2024-03-16T07:25:41.805892+0000","last_peered":"2024-03-16T07:25:41.805892+0000","last_clean":"2024-03-16T07:25:41.805892+0000","last_became_active":"2024-03-16T07:25:40.814772+0000","last_became_peered":"2024-03-16T07:25:40.814772+0000","last_unstale":"2024-03-16T07:25:41.805892+0000","last_undegraded":"2024-03-16T07:25:41.805892+0000","last_fullsized":"2024-03-16T07:25:41.805892+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_clean_scrub_stamp":"2024-03-16T07:25:39.782521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:29:42.298625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"27'2","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-16T07:25:40.791701+0000","last_change":"2024-03-16T07:25:25.772458+0000","last_active":"2024-03-16T07:25:40.791701+0000","last_peered":"2024-03-16T07:25:40.791701+0000","last_clean":"2024-03-16T07:25:40.791701+0000","last_became_active":"2024-03-16T07:25:25.772025+0000","last_became_peered":"2024-03-16T07:25:25.772025+0000","last_unstale":"2024-03-16T07:25:40.791701+0000","last_undegraded":"2024-03-16T07:25:40.791701+0000","last_fullsized":"2024-03-16T07:25:40.791701+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_clean_scrub_stamp":"2024-03-16T07:25:24.745467+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:13:25.638087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.804361+0000","last_change":"2024-03-16T07:25:26.780721+0000","last_active":"2024-03-16T07:25:41.804361+0000","last_peered":"2024-03-16T07:25:41.804361+0000","last_clean":"2024-03-16T07:25:41.804361+0000","last_became_active":"2024-03-16T07:25:26.780222+0000","last_became_peered":"2024-03-16T07:25:26.780222+0000","last_unstale":"2024-03-16T07:25:41.804361+0000","last_undegraded":"2024-03-16T07:25:41.804361+0000","last_fullsized":"2024-03-16T07:25:41.804361+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:13:14.226330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-16T07:25:40.790034+0000","last_change":"2024-03-16T07:25:39.806708+0000","last_active":"2024-03-16T07:25:40.790034+0000","last_peered":"2024-03-16T07:25:40.790034+0000","last_clean":"2024-03-16T07:25:40.790034+0000","last_became_active":"2024-03-16T07:25:39.806053+0000","last_became_peered":"2024-03-16T07:25:39.806053+0000","last_unstale":"2024-03-16T07:25:40.790034+0000","last_undegraded":"2024-03-16T07:25:40.790034+0000","last_fullsized":"2024-03-16T07:25:40.790034+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:38.779484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:38.779484+0000","last_clean_scrub_stamp":"2024-03-16T07:25:38.779484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:30:08.481959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-16T07:25:40.821271+0000","last_change":"2024-03-16T07:25:40.819800+0000","last_active":"2024-03-16T07:25:40.821271+0000","last_peered":"2024-03-16T07:25:40.821271+0000","last_clean":"2024-03-16T07:25:40.821271+0000","last_became_active":"2024-03-16T07:25:40.816068+0000","last_became_peered":"2024-03-16T07:25:40.816068+0000","last_unstale":"2024-03-16T07:25:40.821271+0000","last_undegraded":"2024-03-16T07:25:40.821271+0000","last_fullsized":"2024-03-16T07:25:40.821271+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_clean_scrub_stamp":"2024-03-16T07:25:39.782521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:59:41.389545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":20,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-16T07:25:40.788212+0000","last_change":"2024-03-16T07:25:25.772328+0000","last_active":"2024-03-16T07:25:40.788212+0000","last_peered":"2024-03-16T07:25:40.788212+0000","last_clean":"2024-03-16T07:25:40.788212+0000","last_became_active":"2024-03-16T07:25:25.772044+0000","last_became_peered":"2024-03-16T07:25:25.772044+0000","last_unstale":"2024-03-16T07:25:40.788212+0000","last_undegraded":"2024-03-16T07:25:40.788212+0000","last_fullsized":"2024-03-16T07:25:40.788212+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_clean_scrub_stamp":"2024-03-16T07:25:24.745467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:03:20.013549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.808295+0000","last_change":"2024-03-16T07:25:26.777451+0000","last_active":"2024-03-16T07:25:41.808295+0000","last_peered":"2024-03-16T07:25:41.808295+0000","last_clean":"2024-03-16T07:25:41.808295+0000","last_became_active":"2024-03-16T07:25:26.777208+0000","last_became_peered":"2024-03-16T07:25:26.777208+0000","last_unstale":"2024-03-16T07:25:41.808295+0000","last_undegraded":"2024-03-16T07:25:41.808295+0000","last_fullsized":"2024-03-16T07:25:41.808295+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:15:25.308866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"31'2","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.810723+0000","last_change":"2024-03-16T07:25:39.809237+0000","last_active":"2024-03-16T07:25:41.810723+0000","last_peered":"2024-03-16T07:25:41.810723+0000","last_clean":"2024-03-16T07:25:41.810723+0000","last_became_active":"2024-03-16T07:25:39.808988+0000","last_became_peered":"2024-03-16T07:25:39.808988+0000","last_unstale":"2024-03-16T07:25:41.810723+0000","last_undegraded":"2024-03-16T07:25:41.810723+0000","last_fullsized":"2024-03-16T07:25:41.810723+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:38.779484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:38.779484+0000","last_clean_scrub_stamp":"2024-03-16T07:25:38.779484+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:11:14.735801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.810059+0000","last_change":"2024-03-16T07:25:40.811208+0000","last_active":"2024-03-16T07:25:41.810059+0000","last_peered":"2024-03-16T07:25:41.810059+0000","last_clean":"2024-03-16T07:25:41.810059+0000","last_became_active":"2024-03-16T07:25:40.810971+0000","last_became_peered":"2024-03-16T07:25:40.810971+0000","last_unstale":"2024-03-16T07:25:41.810059+0000","last_undegraded":"2024-03-16T07:25:41.810059+0000","last_fullsized":"2024-03-16T07:25:41.810059+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_clean_scrub_stamp":"2024-03-16T07:25:39.782521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:10:57.157265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"27'1","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.805515+0000","last_change":"2024-03-16T07:25:25.767060+0000","last_active":"2024-03-16T07:25:41.805515+0000","last_peered":"2024-03-16T07:25:41.805515+0000","last_clean":"2024-03-16T07:25:41.805515+0000","last_became_active":"2024-03-16T07:25:25.766634+0000","last_became_peered":"2024-03-16T07:25:25.766634+0000","last_unstale":"2024-03-16T07:25:41.805515+0000","last_undegraded":"2024-03-16T07:25:41.805515+0000","last_fullsized":"2024-03-16T07:25:41.805515+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_clean_scrub_stamp":"2024-03-16T07:25:24.745467+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:45:27.137248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.805345+0000","last_change":"2024-03-16T07:25:26.792837+0000","last_active":"2024-03-16T07:25:41.805345+0000","last_peered":"2024-03-16T07:25:41.805345+0000","last_clean":"2024-03-16T07:25:41.805345+0000","last_became_active":"2024-03-16T07:25:26.792560+0000","last_became_peered":"2024-03-16T07:25:26.792560+0000","last_unstale":"2024-03-16T07:25:41.805345+0000","last_undegraded":"2024-03-16T07:25:41.805345+0000","last_fullsized":"2024-03-16T07:25:41.805345+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:39:17.634888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"31'1","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.809128+0000","last_change":"2024-03-16T07:25:39.807802+0000","last_active":"2024-03-16T07:25:41.809128+0000","last_peered":"2024-03-16T07:25:41.809128+0000","last_clean":"2024-03-16T07:25:41.809128+0000","last_became_active":"2024-03-16T07:25:39.807555+0000","last_became_peered":"2024-03-16T07:25:39.807555+0000","last_unstale":"2024-03-16T07:25:41.809128+0000","last_undegraded":"2024-03-16T07:25:41.809128+0000","last_fullsized":"2024-03-16T07:25:41.809128+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:38.779484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:38.779484+0000","last_clean_scrub_stamp":"2024-03-16T07:25:38.779484+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:39:17.951211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.805365+0000","last_change":"2024-03-16T07:25:40.816770+0000","last_active":"2024-03-16T07:25:41.805365+0000","last_peered":"2024-03-16T07:25:41.805365+0000","last_clean":"2024-03-16T07:25:41.805365+0000","last_became_active":"2024-03-16T07:25:40.816383+0000","last_became_peered":"2024-03-16T07:25:40.816383+0000","last_unstale":"2024-03-16T07:25:41.805365+0000","last_undegraded":"2024-03-16T07:25:41.805365+0000","last_fullsized":"2024-03-16T07:25:41.805365+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_clean_scrub_stamp":"2024-03-16T07:25:39.782521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:08:45.278439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"27'2","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.803802+0000","last_change":"2024-03-16T07:25:25.777336+0000","last_active":"2024-03-16T07:25:41.803802+0000","last_peered":"2024-03-16T07:25:41.803802+0000","last_clean":"2024-03-16T07:25:41.803802+0000","last_became_active":"2024-03-16T07:25:25.776801+0000","last_became_peered":"2024-03-16T07:25:25.776801+0000","last_unstale":"2024-03-16T07:25:41.803802+0000","last_undegraded":"2024-03-16T07:25:41.803802+0000","last_fullsized":"2024-03-16T07:25:41.803802+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_clean_scrub_stamp":"2024-03-16T07:25:24.745467+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:12:18.043604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.807375+0000","last_change":"2024-03-16T07:25:26.791000+0000","last_active":"2024-03-16T07:25:41.807375+0000","last_peered":"2024-03-16T07:25:41.807375+0000","last_clean":"2024-03-16T07:25:41.807375+0000","last_became_active":"2024-03-16T07:25:26.790748+0000","last_became_peered":"2024-03-16T07:25:26.790748+0000","last_unstale":"2024-03-16T07:25:41.807375+0000","last_undegraded":"2024-03-16T07:25:41.807375+0000","last_fullsized":"2024-03-16T07:25:41.807375+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:34:16.025272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.805580+0000","last_change":"2024-03-16T07:25:39.811315+0000","last_active":"2024-03-16T07:25:41.805580+0000","last_peered":"2024-03-16T07:25:41.805580+0000","last_clean":"2024-03-16T07:25:41.805580+0000","last_became_active":"2024-03-16T07:25:39.811085+0000","last_became_peered":"2024-03-16T07:25:39.811085+0000","last_unstale":"2024-03-16T07:25:41.805580+0000","last_undegraded":"2024-03-16T07:25:41.805580+0000","last_fullsized":"2024-03-16T07:25:41.805580+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:38.779484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:38.779484+0000","last_clean_scrub_stamp":"2024-03-16T07:25:38.779484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:06:44.686324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.808604+0000","last_change":"2024-03-16T07:25:40.828327+0000","last_active":"2024-03-16T07:25:41.808604+0000","last_peered":"2024-03-16T07:25:41.808604+0000","last_clean":"2024-03-16T07:25:41.808604+0000","last_became_active":"2024-03-16T07:25:40.823497+0000","last_became_peered":"2024-03-16T07:25:40.823497+0000","last_unstale":"2024-03-16T07:25:41.808604+0000","last_undegraded":"2024-03-16T07:25:41.808604+0000","last_fullsized":"2024-03-16T07:25:41.808604+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_clean_scrub_stamp":"2024-03-16T07:25:39.782521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:25:21.200968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"27'1","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.807192+0000","last_change":"2024-03-16T07:25:25.768264+0000","last_active":"2024-03-16T07:25:41.807192+0000","last_peered":"2024-03-16T07:25:41.807192+0000","last_clean":"2024-03-16T07:25:41.807192+0000","last_became_active":"2024-03-16T07:25:25.767788+0000","last_became_peered":"2024-03-16T07:25:25.767788+0000","last_unstale":"2024-03-16T07:25:41.807192+0000","last_undegraded":"2024-03-16T07:25:41.807192+0000","last_fullsized":"2024-03-16T07:25:41.807192+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_clean_scrub_stamp":"2024-03-16T07:25:24.745467+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:49:12.241606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.809751+0000","last_change":"2024-03-16T07:25:26.783403+0000","last_active":"2024-03-16T07:25:41.809751+0000","last_peered":"2024-03-16T07:25:41.809751+0000","last_clean":"2024-03-16T07:25:41.809751+0000","last_became_active":"2024-03-16T07:25:26.782811+0000","last_became_peered":"2024-03-16T07:25:26.782811+0000","last_unstale":"2024-03-16T07:25:41.809751+0000","last_undegraded":"2024-03-16T07:25:41.809751+0000","last_fullsized":"2024-03-16T07:25:41.809751+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:50:36.836140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"31'1","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.806824+0000","last_change":"2024-03-16T07:25:39.816558+0000","last_active":"2024-03-16T07:25:41.806824+0000","last_peered":"2024-03-16T07:25:41.806824+0000","last_clean":"2024-03-16T07:25:41.806824+0000","last_became_active":"2024-03-16T07:25:39.816326+0000","last_became_peered":"2024-03-16T07:25:39.816326+0000","last_unstale":"2024-03-16T07:25:41.806824+0000","last_undegraded":"2024-03-16T07:25:41.806824+0000","last_fullsized":"2024-03-16T07:25:41.806824+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:38.779484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:38.779484+0000","last_clean_scrub_stamp":"2024-03-16T07:25:38.779484+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:39:32.405889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-16T07:25:40.830156+0000","last_change":"2024-03-16T07:25:40.829100+0000","last_active":"2024-03-16T07:25:40.830156+0000","last_peered":"2024-03-16T07:25:40.830156+0000","last_clean":"2024-03-16T07:25:40.830156+0000","last_became_active":"2024-03-16T07:25:40.828587+0000","last_became_peered":"2024-03-16T07:25:40.828587+0000","last_unstale":"2024-03-16T07:25:40.830156+0000","last_undegraded":"2024-03-16T07:25:40.830156+0000","last_fullsized":"2024-03-16T07:25:40.830156+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_clean_scrub_stamp":"2024-03-16T07:25:39.782521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:24:59.045110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"27'8","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.806900+0000","last_change":"2024-03-16T07:25:25.770830+0000","last_active":"2024-03-16T07:25:41.806900+0000","last_peered":"2024-03-16T07:25:41.806900+0000","last_clean":"2024-03-16T07:25:41.806900+0000","last_became_active":"2024-03-16T07:25:25.770533+0000","last_became_peered":"2024-03-16T07:25:25.770533+0000","last_unstale":"2024-03-16T07:25:41.806900+0000","last_undegraded":"2024-03-16T07:25:41.806900+0000","last_fullsized":"2024-03-16T07:25:41.806900+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_clean_scrub_stamp":"2024-03-16T07:25:24.745467+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:12:18.043604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.804128+0000","last_change":"2024-03-16T07:25:26.778809+0000","last_active":"2024-03-16T07:25:41.804128+0000","last_peered":"2024-03-16T07:25:41.804128+0000","last_clean":"2024-03-16T07:25:41.804128+0000","last_became_active":"2024-03-16T07:25:26.778552+0000","last_became_peered":"2024-03-16T07:25:26.778552+0000","last_unstale":"2024-03-16T07:25:41.804128+0000","last_undegraded":"2024-03-16T07:25:41.804128+0000","last_fullsized":"2024-03-16T07:25:41.804128+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:56:25.078268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-16T07:25:40.789793+0000","last_change":"2024-03-16T07:25:39.812392+0000","last_active":"2024-03-16T07:25:40.789793+0000","last_peered":"2024-03-16T07:25:40.789793+0000","last_clean":"2024-03-16T07:25:40.789793+0000","last_became_active":"2024-03-16T07:25:39.809345+0000","last_became_peered":"2024-03-16T07:25:39.809345+0000","last_unstale":"2024-03-16T07:25:40.789793+0000","last_undegraded":"2024-03-16T07:25:40.789793+0000","last_fullsized":"2024-03-16T07:25:40.789793+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:38.779484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:38.779484+0000","last_clean_scrub_stamp":"2024-03-16T07:25:38.779484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:38:50.906193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.806103+0000","last_change":"2024-03-16T07:25:40.816518+0000","last_active":"2024-03-16T07:25:41.806103+0000","last_peered":"2024-03-16T07:25:41.806103+0000","last_clean":"2024-03-16T07:25:41.806103+0000","last_became_active":"2024-03-16T07:25:40.816010+0000","last_became_peered":"2024-03-16T07:25:40.816010+0000","last_unstale":"2024-03-16T07:25:41.806103+0000","last_undegraded":"2024-03-16T07:25:41.806103+0000","last_fullsized":"2024-03-16T07:25:41.806103+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_clean_scrub_stamp":"2024-03-16T07:25:39.782521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:49:51.185259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.803799+0000","last_change":"2024-03-16T07:25:25.767424+0000","last_active":"2024-03-16T07:25:41.803799+0000","last_peered":"2024-03-16T07:25:41.803799+0000","last_clean":"2024-03-16T07:25:41.803799+0000","last_became_active":"2024-03-16T07:25:25.767167+0000","last_became_peered":"2024-03-16T07:25:25.767167+0000","last_unstale":"2024-03-16T07:25:41.803799+0000","last_undegraded":"2024-03-16T07:25:41.803799+0000","last_fullsized":"2024-03-16T07:25:41.803799+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_clean_scrub_stamp":"2024-03-16T07:25:24.745467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:55:08.055595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.806157+0000","last_change":"2024-03-16T07:25:26.788681+0000","last_active":"2024-03-16T07:25:41.806157+0000","last_peered":"2024-03-16T07:25:41.806157+0000","last_clean":"2024-03-16T07:25:41.806157+0000","last_became_active":"2024-03-16T07:25:26.788069+0000","last_became_peered":"2024-03-16T07:25:26.788069+0000","last_unstale":"2024-03-16T07:25:41.806157+0000","last_undegraded":"2024-03-16T07:25:41.806157+0000","last_fullsized":"2024-03-16T07:25:41.806157+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:56:25.078268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"31'2","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.808105+0000","last_change":"2024-03-16T07:25:39.816014+0000","last_active":"2024-03-16T07:25:41.808105+0000","last_peered":"2024-03-16T07:25:41.808105+0000","last_clean":"2024-03-16T07:25:41.808105+0000","last_became_active":"2024-03-16T07:25:39.814649+0000","last_became_peered":"2024-03-16T07:25:39.814649+0000","last_unstale":"2024-03-16T07:25:41.808105+0000","last_undegraded":"2024-03-16T07:25:41.808105+0000","last_fullsized":"2024-03-16T07:25:41.808105+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:38.779484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:38.779484+0000","last_clean_scrub_stamp":"2024-03-16T07:25:38.779484+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:55:32.148674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.804942+0000","last_change":"2024-03-16T07:25:40.815193+0000","last_active":"2024-03-16T07:25:41.804942+0000","last_peered":"2024-03-16T07:25:41.804942+0000","last_clean":"2024-03-16T07:25:41.804942+0000","last_became_active":"2024-03-16T07:25:40.814970+0000","last_became_peered":"2024-03-16T07:25:40.814970+0000","last_unstale":"2024-03-16T07:25:41.804942+0000","last_undegraded":"2024-03-16T07:25:41.804942+0000","last_fullsized":"2024-03-16T07:25:41.804942+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_clean_scrub_stamp":"2024-03-16T07:25:39.782521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:08:45.278439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.804813+0000","last_change":"2024-03-16T07:25:25.766436+0000","last_active":"2024-03-16T07:25:41.804813+0000","last_peered":"2024-03-16T07:25:41.804813+0000","last_clean":"2024-03-16T07:25:41.804813+0000","last_became_active":"2024-03-16T07:25:25.766215+0000","last_became_peered":"2024-03-16T07:25:25.766215+0000","last_unstale":"2024-03-16T07:25:41.804813+0000","last_undegraded":"2024-03-16T07:25:41.804813+0000","last_fullsized":"2024-03-16T07:25:41.804813+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_clean_scrub_stamp":"2024-03-16T07:25:24.745467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:51:34.836861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.805919+0000","last_change":"2024-03-16T07:25:26.791462+0000","last_active":"2024-03-16T07:25:41.805919+0000","last_peered":"2024-03-16T07:25:41.805919+0000","last_clean":"2024-03-16T07:25:41.805919+0000","last_became_active":"2024-03-16T07:25:26.791154+0000","last_became_peered":"2024-03-16T07:25:26.791154+0000","last_unstale":"2024-03-16T07:25:41.805919+0000","last_undegraded":"2024-03-16T07:25:41.805919+0000","last_fullsized":"2024-03-16T07:25:41.805919+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:52:53.885034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.10","version":"31'8","reported_seq":20,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-16T07:25:40.830756+0000","last_change":"2024-03-16T07:25:39.810227+0000","last_active":"2024-03-16T07:25:40.830756+0000","last_peered":"2024-03-16T07:25:40.830756+0000","last_clean":"2024-03-16T07:25:40.830756+0000","last_became_active":"2024-03-16T07:25:39.807510+0000","last_became_peered":"2024-03-16T07:25:39.807510+0000","last_unstale":"2024-03-16T07:25:40.830756+0000","last_undegraded":"2024-03-16T07:25:40.830756+0000","last_fullsized":"2024-03-16T07:25:40.830756+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:38.779484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:38.779484+0000","last_clean_scrub_stamp":"2024-03-16T07:25:38.779484+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:09:30.467543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.806851+0000","last_change":"2024-03-16T07:25:40.827054+0000","last_active":"2024-03-16T07:25:41.806851+0000","last_peered":"2024-03-16T07:25:41.806851+0000","last_clean":"2024-03-16T07:25:41.806851+0000","last_became_active":"2024-03-16T07:25:40.826815+0000","last_became_peered":"2024-03-16T07:25:40.826815+0000","last_unstale":"2024-03-16T07:25:41.806851+0000","last_undegraded":"2024-03-16T07:25:41.806851+0000","last_fullsized":"2024-03-16T07:25:41.806851+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_clean_scrub_stamp":"2024-03-16T07:25:39.782521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:32:59.653762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"27'2","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.808228+0000","last_change":"2024-03-16T07:25:25.777623+0000","last_active":"2024-03-16T07:25:41.808228+0000","last_peered":"2024-03-16T07:25:41.808228+0000","last_clean":"2024-03-16T07:25:41.808228+0000","last_became_active":"2024-03-16T07:25:25.776995+0000","last_became_peered":"2024-03-16T07:25:25.776995+0000","last_unstale":"2024-03-16T07:25:41.808228+0000","last_undegraded":"2024-03-16T07:25:41.808228+0000","last_fullsized":"2024-03-16T07:25:41.808228+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_clean_scrub_stamp":"2024-03-16T07:25:24.745467+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:51:34.836861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.804987+0000","last_change":"2024-03-16T07:25:26.767088+0000","last_active":"2024-03-16T07:25:41.804987+0000","last_peered":"2024-03-16T07:25:41.804987+0000","last_clean":"2024-03-16T07:25:41.804987+0000","last_became_active":"2024-03-16T07:25:26.766517+0000","last_became_peered":"2024-03-16T07:25:26.766517+0000","last_unstale":"2024-03-16T07:25:41.804987+0000","last_undegraded":"2024-03-16T07:25:41.804987+0000","last_fullsized":"2024-03-16T07:25:41.804987+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:44:15.933653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.804591+0000","last_change":"2024-03-16T07:25:39.814536+0000","last_active":"2024-03-16T07:25:41.804591+0000","last_peered":"2024-03-16T07:25:41.804591+0000","last_clean":"2024-03-16T07:25:41.804591+0000","last_became_active":"2024-03-16T07:25:39.814232+0000","last_became_peered":"2024-03-16T07:25:39.814232+0000","last_unstale":"2024-03-16T07:25:41.804591+0000","last_undegraded":"2024-03-16T07:25:41.804591+0000","last_fullsized":"2024-03-16T07:25:41.804591+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:38.779484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:38.779484+0000","last_clean_scrub_stamp":"2024-03-16T07:25:38.779484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:29:17.513237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.810791+0000","last_change":"2024-03-16T07:25:40.821705+0000","last_active":"2024-03-16T07:25:41.810791+0000","last_peered":"2024-03-16T07:25:41.810791+0000","last_clean":"2024-03-16T07:25:41.810791+0000","last_became_active":"2024-03-16T07:25:40.821461+0000","last_became_peered":"2024-03-16T07:25:40.821461+0000","last_unstale":"2024-03-16T07:25:41.810791+0000","last_undegraded":"2024-03-16T07:25:41.810791+0000","last_fullsized":"2024-03-16T07:25:41.810791+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_clean_scrub_stamp":"2024-03-16T07:25:39.782521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:28:29.876723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"28'9","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.805174+0000","last_change":"2024-03-16T07:25:25.770852+0000","last_active":"2024-03-16T07:25:41.805174+0000","last_peered":"2024-03-16T07:25:41.805174+0000","last_clean":"2024-03-16T07:25:41.805174+0000","last_became_active":"2024-03-16T07:25:25.770506+0000","last_became_peered":"2024-03-16T07:25:25.770506+0000","last_unstale":"2024-03-16T07:25:41.805174+0000","last_undegraded":"2024-03-16T07:25:41.805174+0000","last_fullsized":"2024-03-16T07:25:41.805174+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_clean_scrub_stamp":"2024-03-16T07:25:24.745467+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:28:55.817930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3309,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-16T07:25:40.792271+0000","last_change":"2024-03-16T07:25:26.796428+0000","last_active":"2024-03-16T07:25:40.792271+0000","last_peered":"2024-03-16T07:25:40.792271+0000","last_clean":"2024-03-16T07:25:40.792271+0000","last_became_active":"2024-03-16T07:25:26.795282+0000","last_became_peered":"2024-03-16T07:25:26.795282+0000","last_unstale":"2024-03-16T07:25:40.792271+0000","last_undegraded":"2024-03-16T07:25:40.792271+0000","last_fullsized":"2024-03-16T07:25:40.792271+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:39:04.918567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-16T07:25:40.791768+0000","last_change":"2024-03-16T07:25:39.806040+0000","last_active":"2024-03-16T07:25:40.791768+0000","last_peered":"2024-03-16T07:25:40.791768+0000","last_clean":"2024-03-16T07:25:40.791768+0000","last_became_active":"2024-03-16T07:25:39.805800+0000","last_became_peered":"2024-03-16T07:25:39.805800+0000","last_unstale":"2024-03-16T07:25:40.791768+0000","last_undegraded":"2024-03-16T07:25:40.791768+0000","last_fullsized":"2024-03-16T07:25:40.791768+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:38.779484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:38.779484+0000","last_clean_scrub_stamp":"2024-03-16T07:25:38.779484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:44:14.164920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.810653+0000","last_change":"2024-03-16T07:25:40.818543+0000","last_active":"2024-03-16T07:25:41.810653+0000","last_peered":"2024-03-16T07:25:41.810653+0000","last_clean":"2024-03-16T07:25:41.810653+0000","last_became_active":"2024-03-16T07:25:40.810273+0000","last_became_peered":"2024-03-16T07:25:40.810273+0000","last_unstale":"2024-03-16T07:25:41.810653+0000","last_undegraded":"2024-03-16T07:25:41.810653+0000","last_fullsized":"2024-03-16T07:25:41.810653+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_clean_scrub_stamp":"2024-03-16T07:25:39.782521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:30:39.951321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"27'3","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-16T07:25:40.792072+0000","last_change":"2024-03-16T07:25:25.772575+0000","last_active":"2024-03-16T07:25:40.792072+0000","last_peered":"2024-03-16T07:25:40.792072+0000","last_clean":"2024-03-16T07:25:40.792072+0000","last_became_active":"2024-03-16T07:25:25.771846+0000","last_became_peered":"2024-03-16T07:25:25.771846+0000","last_unstale":"2024-03-16T07:25:40.792072+0000","last_undegraded":"2024-03-16T07:25:40.792072+0000","last_fullsized":"2024-03-16T07:25:40.792072+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_clean_scrub_stamp":"2024-03-16T07:25:24.745467+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:47:15.546713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-16T07:25:40.788756+0000","last_change":"2024-03-16T07:25:26.774990+0000","last_active":"2024-03-16T07:25:40.788756+0000","last_peered":"2024-03-16T07:25:40.788756+0000","last_clean":"2024-03-16T07:25:40.788756+0000","last_became_active":"2024-03-16T07:25:26.774538+0000","last_became_peered":"2024-03-16T07:25:26.774538+0000","last_unstale":"2024-03-16T07:25:40.788756+0000","last_undegraded":"2024-03-16T07:25:40.788756+0000","last_fullsized":"2024-03-16T07:25:40.788756+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:06:31.653680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.810895+0000","last_change":"2024-03-16T07:25:39.813294+0000","last_active":"2024-03-16T07:25:41.810895+0000","last_peered":"2024-03-16T07:25:41.810895+0000","last_clean":"2024-03-16T07:25:41.810895+0000","last_became_active":"2024-03-16T07:25:39.813026+0000","last_became_peered":"2024-03-16T07:25:39.813026+0000","last_unstale":"2024-03-16T07:25:41.810895+0000","last_undegraded":"2024-03-16T07:25:41.810895+0000","last_fullsized":"2024-03-16T07:25:41.810895+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:38.779484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:38.779484+0000","last_clean_scrub_stamp":"2024-03-16T07:25:38.779484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:20:36.574352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.803752+0000","last_change":"2024-03-16T07:25:40.815006+0000","last_active":"2024-03-16T07:25:41.803752+0000","last_peered":"2024-03-16T07:25:41.803752+0000","last_clean":"2024-03-16T07:25:41.803752+0000","last_became_active":"2024-03-16T07:25:40.814479+0000","last_became_peered":"2024-03-16T07:25:40.814479+0000","last_unstale":"2024-03-16T07:25:41.803752+0000","last_undegraded":"2024-03-16T07:25:41.803752+0000","last_fullsized":"2024-03-16T07:25:41.803752+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_clean_scrub_stamp":"2024-03-16T07:25:39.782521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:39:57.617994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":20,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-16T07:25:40.790947+0000","last_change":"2024-03-16T07:25:25.766665+0000","last_active":"2024-03-16T07:25:40.790947+0000","last_peered":"2024-03-16T07:25:40.790947+0000","last_clean":"2024-03-16T07:25:40.790947+0000","last_became_active":"2024-03-16T07:25:25.765031+0000","last_became_peered":"2024-03-16T07:25:25.765031+0000","last_unstale":"2024-03-16T07:25:40.790947+0000","last_undegraded":"2024-03-16T07:25:40.790947+0000","last_fullsized":"2024-03-16T07:25:40.790947+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_clean_scrub_stamp":"2024-03-16T07:25:24.745467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:00:22.248577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.809489+0000","last_change":"2024-03-16T07:25:26.788379+0000","last_active":"2024-03-16T07:25:41.809489+0000","last_peered":"2024-03-16T07:25:41.809489+0000","last_clean":"2024-03-16T07:25:41.809489+0000","last_became_active":"2024-03-16T07:25:26.788113+0000","last_became_peered":"2024-03-16T07:25:26.788113+0000","last_unstale":"2024-03-16T07:25:41.809489+0000","last_undegraded":"2024-03-16T07:25:41.809489+0000","last_fullsized":"2024-03-16T07:25:41.809489+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:56:44.440768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.14","version":"31'6","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.808832+0000","last_change":"2024-03-16T07:25:39.815954+0000","last_active":"2024-03-16T07:25:41.808832+0000","last_peered":"2024-03-16T07:25:41.808832+0000","last_clean":"2024-03-16T07:25:41.808832+0000","last_became_active":"2024-03-16T07:25:39.815712+0000","last_became_peered":"2024-03-16T07:25:39.815712+0000","last_unstale":"2024-03-16T07:25:41.808832+0000","last_undegraded":"2024-03-16T07:25:41.808832+0000","last_fullsized":"2024-03-16T07:25:41.808832+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:38.779484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:38.779484+0000","last_clean_scrub_stamp":"2024-03-16T07:25:38.779484+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:11:41.117211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.806075+0000","last_change":"2024-03-16T07:25:40.825695+0000","last_active":"2024-03-16T07:25:41.806075+0000","last_peered":"2024-03-16T07:25:41.806075+0000","last_clean":"2024-03-16T07:25:41.806075+0000","last_became_active":"2024-03-16T07:25:40.825452+0000","last_became_peered":"2024-03-16T07:25:40.825452+0000","last_unstale":"2024-03-16T07:25:41.806075+0000","last_undegraded":"2024-03-16T07:25:41.806075+0000","last_fullsized":"2024-03-16T07:25:41.806075+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_clean_scrub_stamp":"2024-03-16T07:25:39.782521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:44:15.167957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":20,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-16T07:25:40.790054+0000","last_change":"2024-03-16T07:25:25.772980+0000","last_active":"2024-03-16T07:25:40.790054+0000","last_peered":"2024-03-16T07:25:40.790054+0000","last_clean":"2024-03-16T07:25:40.790054+0000","last_became_active":"2024-03-16T07:25:25.772547+0000","last_became_peered":"2024-03-16T07:25:25.772547+0000","last_unstale":"2024-03-16T07:25:40.790054+0000","last_undegraded":"2024-03-16T07:25:40.790054+0000","last_fullsized":"2024-03-16T07:25:40.790054+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_clean_scrub_stamp":"2024-03-16T07:25:24.745467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:56:24.076896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.807204+0000","last_change":"2024-03-16T07:25:26.783155+0000","last_active":"2024-03-16T07:25:41.807204+0000","last_peered":"2024-03-16T07:25:41.807204+0000","last_clean":"2024-03-16T07:25:41.807204+0000","last_became_active":"2024-03-16T07:25:26.782902+0000","last_became_peered":"2024-03-16T07:25:26.782902+0000","last_unstale":"2024-03-16T07:25:41.807204+0000","last_undegraded":"2024-03-16T07:25:41.807204+0000","last_fullsized":"2024-03-16T07:25:41.807204+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:47:18.096711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.15","version":"31'3","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.808196+0000","last_change":"2024-03-16T07:25:39.814309+0000","last_active":"2024-03-16T07:25:41.808196+0000","last_peered":"2024-03-16T07:25:41.808196+0000","last_clean":"2024-03-16T07:25:41.808196+0000","last_became_active":"2024-03-16T07:25:39.813772+0000","last_became_peered":"2024-03-16T07:25:39.813772+0000","last_unstale":"2024-03-16T07:25:41.808196+0000","last_undegraded":"2024-03-16T07:25:41.808196+0000","last_fullsized":"2024-03-16T07:25:41.808196+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:38.779484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:38.779484+0000","last_clean_scrub_stamp":"2024-03-16T07:25:38.779484+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:46:30.027911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-16T07:25:40.830197+0000","last_change":"2024-03-16T07:25:40.829249+0000","last_active":"2024-03-16T07:25:40.830197+0000","last_peered":"2024-03-16T07:25:40.830197+0000","last_clean":"2024-03-16T07:25:40.830197+0000","last_became_active":"2024-03-16T07:25:40.828830+0000","last_became_peered":"2024-03-16T07:25:40.828830+0000","last_unstale":"2024-03-16T07:25:40.830197+0000","last_undegraded":"2024-03-16T07:25:40.830197+0000","last_fullsized":"2024-03-16T07:25:40.830197+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_clean_scrub_stamp":"2024-03-16T07:25:39.782521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:26:08.638629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.805723+0000","last_change":"2024-03-16T07:25:25.777178+0000","last_active":"2024-03-16T07:25:41.805723+0000","last_peered":"2024-03-16T07:25:41.805723+0000","last_clean":"2024-03-16T07:25:41.805723+0000","last_became_active":"2024-03-16T07:25:25.776915+0000","last_became_peered":"2024-03-16T07:25:25.776915+0000","last_unstale":"2024-03-16T07:25:41.805723+0000","last_undegraded":"2024-03-16T07:25:41.805723+0000","last_fullsized":"2024-03-16T07:25:41.805723+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_clean_scrub_stamp":"2024-03-16T07:25:24.745467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:46:35.716476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.804301+0000","last_change":"2024-03-16T07:25:26.779863+0000","last_active":"2024-03-16T07:25:41.804301+0000","last_peered":"2024-03-16T07:25:41.804301+0000","last_clean":"2024-03-16T07:25:41.804301+0000","last_became_active":"2024-03-16T07:25:26.779362+0000","last_became_peered":"2024-03-16T07:25:26.779362+0000","last_unstale":"2024-03-16T07:25:41.804301+0000","last_undegraded":"2024-03-16T07:25:41.804301+0000","last_fullsized":"2024-03-16T07:25:41.804301+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:13:26.639460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"31'1","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-16T07:25:40.810847+0000","last_change":"2024-03-16T07:25:39.807450+0000","last_active":"2024-03-16T07:25:40.810847+0000","last_peered":"2024-03-16T07:25:40.810847+0000","last_clean":"2024-03-16T07:25:40.810847+0000","last_became_active":"2024-03-16T07:25:39.806882+0000","last_became_peered":"2024-03-16T07:25:39.806882+0000","last_unstale":"2024-03-16T07:25:40.810847+0000","last_undegraded":"2024-03-16T07:25:40.810847+0000","last_fullsized":"2024-03-16T07:25:40.810847+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:38.779484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:38.779484+0000","last_clean_scrub_stamp":"2024-03-16T07:25:38.779484+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:26:48.373023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.804078+0000","last_change":"2024-03-16T07:25:40.819352+0000","last_active":"2024-03-16T07:25:41.804078+0000","last_peered":"2024-03-16T07:25:41.804078+0000","last_clean":"2024-03-16T07:25:41.804078+0000","last_became_active":"2024-03-16T07:25:40.814728+0000","last_became_peered":"2024-03-16T07:25:40.814728+0000","last_unstale":"2024-03-16T07:25:41.804078+0000","last_undegraded":"2024-03-16T07:25:41.804078+0000","last_fullsized":"2024-03-16T07:25:41.804078+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_clean_scrub_stamp":"2024-03-16T07:25:39.782521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:23:10.642307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":20,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-16T07:25:40.791929+0000","last_change":"2024-03-16T07:25:25.765015+0000","last_active":"2024-03-16T07:25:40.791929+0000","last_peered":"2024-03-16T07:25:40.791929+0000","last_clean":"2024-03-16T07:25:40.791929+0000","last_became_active":"2024-03-16T07:25:25.764293+0000","last_became_peered":"2024-03-16T07:25:25.764293+0000","last_unstale":"2024-03-16T07:25:40.791929+0000","last_undegraded":"2024-03-16T07:25:40.791929+0000","last_fullsized":"2024-03-16T07:25:40.791929+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_clean_scrub_stamp":"2024-03-16T07:25:24.745467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:56:32.782012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.807003+0000","last_change":"2024-03-16T07:25:26.779275+0000","last_active":"2024-03-16T07:25:41.807003+0000","last_peered":"2024-03-16T07:25:41.807003+0000","last_clean":"2024-03-16T07:25:41.807003+0000","last_became_active":"2024-03-16T07:25:26.779010+0000","last_became_peered":"2024-03-16T07:25:26.779010+0000","last_unstale":"2024-03-16T07:25:41.807003+0000","last_undegraded":"2024-03-16T07:25:41.807003+0000","last_fullsized":"2024-03-16T07:25:41.807003+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:50:36.836140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"31'1","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-16T07:25:40.828351+0000","last_change":"2024-03-16T07:25:39.812298+0000","last_active":"2024-03-16T07:25:40.828351+0000","last_peered":"2024-03-16T07:25:40.828351+0000","last_clean":"2024-03-16T07:25:40.828351+0000","last_became_active":"2024-03-16T07:25:39.811817+0000","last_became_peered":"2024-03-16T07:25:39.811817+0000","last_unstale":"2024-03-16T07:25:40.828351+0000","last_undegraded":"2024-03-16T07:25:40.828351+0000","last_fullsized":"2024-03-16T07:25:40.828351+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:38.779484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:38.779484+0000","last_clean_scrub_stamp":"2024-03-16T07:25:38.779484+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:32:58.650725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.803874+0000","last_change":"2024-03-16T07:25:40.823179+0000","last_active":"2024-03-16T07:25:41.803874+0000","last_peered":"2024-03-16T07:25:41.803874+0000","last_clean":"2024-03-16T07:25:41.803874+0000","last_became_active":"2024-03-16T07:25:40.822971+0000","last_became_peered":"2024-03-16T07:25:40.822971+0000","last_unstale":"2024-03-16T07:25:41.803874+0000","last_undegraded":"2024-03-16T07:25:41.803874+0000","last_fullsized":"2024-03-16T07:25:41.803874+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_clean_scrub_stamp":"2024-03-16T07:25:39.782521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:38:51.909230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"27'1","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.804215+0000","last_change":"2024-03-16T07:25:25.769228+0000","last_active":"2024-03-16T07:25:41.804215+0000","last_peered":"2024-03-16T07:25:41.804215+0000","last_clean":"2024-03-16T07:25:41.804215+0000","last_became_active":"2024-03-16T07:25:25.768968+0000","last_became_peered":"2024-03-16T07:25:25.768968+0000","last_unstale":"2024-03-16T07:25:41.804215+0000","last_undegraded":"2024-03-16T07:25:41.804215+0000","last_fullsized":"2024-03-16T07:25:41.804215+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_clean_scrub_stamp":"2024-03-16T07:25:24.745467+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:51:25.934804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.807753+0000","last_change":"2024-03-16T07:25:26.783520+0000","last_active":"2024-03-16T07:25:41.807753+0000","last_peered":"2024-03-16T07:25:41.807753+0000","last_clean":"2024-03-16T07:25:41.807753+0000","last_became_active":"2024-03-16T07:25:26.782402+0000","last_became_peered":"2024-03-16T07:25:26.782402+0000","last_unstale":"2024-03-16T07:25:41.807753+0000","last_undegraded":"2024-03-16T07:25:41.807753+0000","last_fullsized":"2024-03-16T07:25:41.807753+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:52:53.752332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-16T07:25:40.789591+0000","last_change":"2024-03-16T07:25:39.810442+0000","last_active":"2024-03-16T07:25:40.789591+0000","last_peered":"2024-03-16T07:25:40.789591+0000","last_clean":"2024-03-16T07:25:40.789591+0000","last_became_active":"2024-03-16T07:25:39.809179+0000","last_became_peered":"2024-03-16T07:25:39.809179+0000","last_unstale":"2024-03-16T07:25:40.789591+0000","last_undegraded":"2024-03-16T07:25:40.789591+0000","last_fullsized":"2024-03-16T07:25:40.789591+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:38.779484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:38.779484+0000","last_clean_scrub_stamp":"2024-03-16T07:25:38.779484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:23:09.639270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-16T07:25:40.820816+0000","last_change":"2024-03-16T07:25:40.818004+0000","last_active":"2024-03-16T07:25:40.820816+0000","last_peered":"2024-03-16T07:25:40.820816+0000","last_clean":"2024-03-16T07:25:40.820816+0000","last_became_active":"2024-03-16T07:25:40.816893+0000","last_became_peered":"2024-03-16T07:25:40.816893+0000","last_unstale":"2024-03-16T07:25:40.820816+0000","last_undegraded":"2024-03-16T07:25:40.820816+0000","last_fullsized":"2024-03-16T07:25:40.820816+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_clean_scrub_stamp":"2024-03-16T07:25:39.782521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:09:20.405239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"27'1","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.807352+0000","last_change":"2024-03-16T07:25:25.777040+0000","last_active":"2024-03-16T07:25:41.807352+0000","last_peered":"2024-03-16T07:25:41.807352+0000","last_clean":"2024-03-16T07:25:41.807352+0000","last_became_active":"2024-03-16T07:25:25.776802+0000","last_became_peered":"2024-03-16T07:25:25.776802+0000","last_unstale":"2024-03-16T07:25:41.807352+0000","last_undegraded":"2024-03-16T07:25:41.807352+0000","last_fullsized":"2024-03-16T07:25:41.807352+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_clean_scrub_stamp":"2024-03-16T07:25:24.745467+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:23:21.193828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.805088+0000","last_change":"2024-03-16T07:25:26.788243+0000","last_active":"2024-03-16T07:25:41.805088+0000","last_peered":"2024-03-16T07:25:41.805088+0000","last_clean":"2024-03-16T07:25:41.805088+0000","last_became_active":"2024-03-16T07:25:26.787967+0000","last_became_peered":"2024-03-16T07:25:26.787967+0000","last_unstale":"2024-03-16T07:25:41.805088+0000","last_undegraded":"2024-03-16T07:25:41.805088+0000","last_fullsized":"2024-03-16T07:25:41.805088+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:52:53.752332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-16T07:25:40.789259+0000","last_change":"2024-03-16T07:25:39.808982+0000","last_active":"2024-03-16T07:25:40.789259+0000","last_peered":"2024-03-16T07:25:40.789259+0000","last_clean":"2024-03-16T07:25:40.789259+0000","last_became_active":"2024-03-16T07:25:39.807812+0000","last_became_peered":"2024-03-16T07:25:39.807812+0000","last_unstale":"2024-03-16T07:25:40.789259+0000","last_undegraded":"2024-03-16T07:25:40.789259+0000","last_fullsized":"2024-03-16T07:25:40.789259+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:38.779484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:38.779484+0000","last_clean_scrub_stamp":"2024-03-16T07:25:38.779484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:09:17.233532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-16T07:25:40.825977+0000","last_change":"2024-03-16T07:25:40.822536+0000","last_active":"2024-03-16T07:25:40.825977+0000","last_peered":"2024-03-16T07:25:40.825977+0000","last_clean":"2024-03-16T07:25:40.825977+0000","last_became_active":"2024-03-16T07:25:40.822297+0000","last_became_peered":"2024-03-16T07:25:40.822297+0000","last_unstale":"2024-03-16T07:25:40.825977+0000","last_undegraded":"2024-03-16T07:25:40.825977+0000","last_fullsized":"2024-03-16T07:25:40.825977+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_clean_scrub_stamp":"2024-03-16T07:25:39.782521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:29:21.923502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"31'1","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.810741+0000","last_change":"2024-03-16T07:25:39.802978+0000","last_active":"2024-03-16T07:25:41.810741+0000","last_peered":"2024-03-16T07:25:41.810741+0000","last_clean":"2024-03-16T07:25:41.810741+0000","last_became_active":"2024-03-16T07:25:39.802721+0000","last_became_peered":"2024-03-16T07:25:39.802721+0000","last_unstale":"2024-03-16T07:25:41.810741+0000","last_undegraded":"2024-03-16T07:25:41.810741+0000","last_fullsized":"2024-03-16T07:25:41.810741+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:38.779484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:38.779484+0000","last_clean_scrub_stamp":"2024-03-16T07:25:38.779484+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:17:24.780924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"27'2","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.808412+0000","last_change":"2024-03-16T07:25:25.776429+0000","last_active":"2024-03-16T07:25:41.808412+0000","last_peered":"2024-03-16T07:25:41.808412+0000","last_clean":"2024-03-16T07:25:41.808412+0000","last_became_active":"2024-03-16T07:25:25.776189+0000","last_became_peered":"2024-03-16T07:25:25.776189+0000","last_unstale":"2024-03-16T07:25:41.808412+0000","last_undegraded":"2024-03-16T07:25:41.808412+0000","last_fullsized":"2024-03-16T07:25:41.808412+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_clean_scrub_stamp":"2024-03-16T07:25:24.745467+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:56:07.751589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.806106+0000","last_change":"2024-03-16T07:25:26.790198+0000","last_active":"2024-03-16T07:25:41.806106+0000","last_peered":"2024-03-16T07:25:41.806106+0000","last_clean":"2024-03-16T07:25:41.806106+0000","last_became_active":"2024-03-16T07:25:26.789918+0000","last_became_peered":"2024-03-16T07:25:26.789918+0000","last_unstale":"2024-03-16T07:25:41.806106+0000","last_undegraded":"2024-03-16T07:25:41.806106+0000","last_fullsized":"2024-03-16T07:25:41.806106+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:51:32.782998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.807148+0000","last_change":"2024-03-16T07:25:40.821019+0000","last_active":"2024-03-16T07:25:41.807148+0000","last_peered":"2024-03-16T07:25:41.807148+0000","last_clean":"2024-03-16T07:25:41.807148+0000","last_became_active":"2024-03-16T07:25:40.820433+0000","last_became_peered":"2024-03-16T07:25:40.820433+0000","last_unstale":"2024-03-16T07:25:41.807148+0000","last_undegraded":"2024-03-16T07:25:41.807148+0000","last_fullsized":"2024-03-16T07:25:41.807148+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_clean_scrub_stamp":"2024-03-16T07:25:39.782521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:43:35.925010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"31'4","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.809044+0000","last_change":"2024-03-16T07:25:39.816818+0000","last_active":"2024-03-16T07:25:41.809044+0000","last_peered":"2024-03-16T07:25:41.809044+0000","last_clean":"2024-03-16T07:25:41.809044+0000","last_became_active":"2024-03-16T07:25:39.816585+0000","last_became_peered":"2024-03-16T07:25:39.816585+0000","last_unstale":"2024-03-16T07:25:41.809044+0000","last_undegraded":"2024-03-16T07:25:41.809044+0000","last_fullsized":"2024-03-16T07:25:41.809044+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:38.779484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:38.779484+0000","last_clean_scrub_stamp":"2024-03-16T07:25:38.779484+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:27:39.841099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"27'2","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-16T07:25:40.790918+0000","last_change":"2024-03-16T07:25:25.773676+0000","last_active":"2024-03-16T07:25:40.790918+0000","last_peered":"2024-03-16T07:25:40.790918+0000","last_clean":"2024-03-16T07:25:40.790918+0000","last_became_active":"2024-03-16T07:25:25.773426+0000","last_became_peered":"2024-03-16T07:25:25.773426+0000","last_unstale":"2024-03-16T07:25:40.790918+0000","last_undegraded":"2024-03-16T07:25:40.790918+0000","last_fullsized":"2024-03-16T07:25:40.790918+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_clean_scrub_stamp":"2024-03-16T07:25:24.745467+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:26:16.092140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.808568+0000","last_change":"2024-03-16T07:25:26.782505+0000","last_active":"2024-03-16T07:25:41.808568+0000","last_peered":"2024-03-16T07:25:41.808568+0000","last_clean":"2024-03-16T07:25:41.808568+0000","last_became_active":"2024-03-16T07:25:26.781458+0000","last_became_peered":"2024-03-16T07:25:26.781458+0000","last_unstale":"2024-03-16T07:25:41.808568+0000","last_undegraded":"2024-03-16T07:25:41.808568+0000","last_fullsized":"2024-03-16T07:25:41.808568+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:34:16.025272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.805214+0000","last_change":"2024-03-16T07:25:40.817385+0000","last_active":"2024-03-16T07:25:41.805214+0000","last_peered":"2024-03-16T07:25:41.805214+0000","last_clean":"2024-03-16T07:25:41.805214+0000","last_became_active":"2024-03-16T07:25:40.817167+0000","last_became_peered":"2024-03-16T07:25:40.817167+0000","last_unstale":"2024-03-16T07:25:41.805214+0000","last_undegraded":"2024-03-16T07:25:41.805214+0000","last_fullsized":"2024-03-16T07:25:41.805214+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_clean_scrub_stamp":"2024-03-16T07:25:39.782521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:26:49.376060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"27'1","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-16T07:25:40.791049+0000","last_change":"2024-03-16T07:25:25.771867+0000","last_active":"2024-03-16T07:25:40.791049+0000","last_peered":"2024-03-16T07:25:40.791049+0000","last_clean":"2024-03-16T07:25:40.791049+0000","last_became_active":"2024-03-16T07:25:25.771573+0000","last_became_peered":"2024-03-16T07:25:25.771573+0000","last_unstale":"2024-03-16T07:25:40.791049+0000","last_undegraded":"2024-03-16T07:25:40.791049+0000","last_fullsized":"2024-03-16T07:25:40.791049+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_clean_scrub_stamp":"2024-03-16T07:25:24.745467+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:30:31.592675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.809406+0000","last_change":"2024-03-16T07:25:26.787749+0000","last_active":"2024-03-16T07:25:41.809406+0000","last_peered":"2024-03-16T07:25:41.809406+0000","last_clean":"2024-03-16T07:25:41.809406+0000","last_became_active":"2024-03-16T07:25:26.787465+0000","last_became_peered":"2024-03-16T07:25:26.787465+0000","last_unstale":"2024-03-16T07:25:41.809406+0000","last_undegraded":"2024-03-16T07:25:41.809406+0000","last_fullsized":"2024-03-16T07:25:41.809406+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:36:38.284510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"31'2","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.805119+0000","last_change":"2024-03-16T07:25:39.810728+0000","last_active":"2024-03-16T07:25:41.805119+0000","last_peered":"2024-03-16T07:25:41.805119+0000","last_clean":"2024-03-16T07:25:41.805119+0000","last_became_active":"2024-03-16T07:25:39.810487+0000","last_became_peered":"2024-03-16T07:25:39.810487+0000","last_unstale":"2024-03-16T07:25:41.805119+0000","last_undegraded":"2024-03-16T07:25:41.805119+0000","last_fullsized":"2024-03-16T07:25:41.805119+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:38.779484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:38.779484+0000","last_clean_scrub_stamp":"2024-03-16T07:25:38.779484+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:43:04.571401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.808364+0000","last_change":"2024-03-16T07:25:40.823668+0000","last_active":"2024-03-16T07:25:41.808364+0000","last_peered":"2024-03-16T07:25:41.808364+0000","last_clean":"2024-03-16T07:25:41.808364+0000","last_became_active":"2024-03-16T07:25:40.820307+0000","last_became_peered":"2024-03-16T07:25:40.820307+0000","last_unstale":"2024-03-16T07:25:41.808364+0000","last_undegraded":"2024-03-16T07:25:41.808364+0000","last_fullsized":"2024-03-16T07:25:41.808364+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_clean_scrub_stamp":"2024-03-16T07:25:39.782521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:45:18.030885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"27'4","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-16T07:25:40.790485+0000","last_change":"2024-03-16T07:25:25.774269+0000","last_active":"2024-03-16T07:25:40.790485+0000","last_peered":"2024-03-16T07:25:40.790485+0000","last_clean":"2024-03-16T07:25:40.790485+0000","last_became_active":"2024-03-16T07:25:25.774016+0000","last_became_peered":"2024-03-16T07:25:25.774016+0000","last_unstale":"2024-03-16T07:25:40.790485+0000","last_undegraded":"2024-03-16T07:25:40.790485+0000","last_fullsized":"2024-03-16T07:25:40.790485+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:24.745467+0000","last_clean_scrub_stamp":"2024-03-16T07:25:24.745467+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:24:12.540520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-16T07:25:40.791156+0000","last_change":"2024-03-16T07:25:26.774904+0000","last_active":"2024-03-16T07:25:40.791156+0000","last_peered":"2024-03-16T07:25:40.791156+0000","last_clean":"2024-03-16T07:25:40.791156+0000","last_became_active":"2024-03-16T07:25:26.774655+0000","last_became_peered":"2024-03-16T07:25:26.774655+0000","last_unstale":"2024-03-16T07:25:40.791156+0000","last_undegraded":"2024-03-16T07:25:40.791156+0000","last_fullsized":"2024-03-16T07:25:40.791156+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:55:19.116029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"31'2","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.807116+0000","last_change":"2024-03-16T07:25:39.817185+0000","last_active":"2024-03-16T07:25:41.807116+0000","last_peered":"2024-03-16T07:25:41.807116+0000","last_clean":"2024-03-16T07:25:41.807116+0000","last_became_active":"2024-03-16T07:25:39.816950+0000","last_became_peered":"2024-03-16T07:25:39.816950+0000","last_unstale":"2024-03-16T07:25:41.807116+0000","last_undegraded":"2024-03-16T07:25:41.807116+0000","last_fullsized":"2024-03-16T07:25:41.807116+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:38.779484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:38.779484+0000","last_clean_scrub_stamp":"2024-03-16T07:25:38.779484+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:42:27.716029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.803943+0000","last_change":"2024-03-16T07:25:40.815520+0000","last_active":"2024-03-16T07:25:41.803943+0000","last_peered":"2024-03-16T07:25:41.803943+0000","last_clean":"2024-03-16T07:25:41.803943+0000","last_became_active":"2024-03-16T07:25:40.814416+0000","last_became_peered":"2024-03-16T07:25:40.814416+0000","last_unstale":"2024-03-16T07:25:41.803943+0000","last_undegraded":"2024-03-16T07:25:41.803943+0000","last_fullsized":"2024-03-16T07:25:41.803943+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_clean_scrub_stamp":"2024-03-16T07:25:39.782521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:09:18.236569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.806693+0000","last_change":"2024-03-16T07:25:26.788490+0000","last_active":"2024-03-16T07:25:41.806693+0000","last_peered":"2024-03-16T07:25:41.806693+0000","last_clean":"2024-03-16T07:25:41.806693+0000","last_became_active":"2024-03-16T07:25:26.787773+0000","last_became_peered":"2024-03-16T07:25:26.787773+0000","last_unstale":"2024-03-16T07:25:41.806693+0000","last_undegraded":"2024-03-16T07:25:41.806693+0000","last_fullsized":"2024-03-16T07:25:41.806693+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:47:16.548086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-16T07:25:40.821484+0000","last_change":"2024-03-16T07:25:40.820999+0000","last_active":"2024-03-16T07:25:40.821484+0000","last_peered":"2024-03-16T07:25:40.821484+0000","last_clean":"2024-03-16T07:25:40.821484+0000","last_became_active":"2024-03-16T07:25:40.820243+0000","last_became_peered":"2024-03-16T07:25:40.820243+0000","last_unstale":"2024-03-16T07:25:40.821484+0000","last_undegraded":"2024-03-16T07:25:40.821484+0000","last_fullsized":"2024-03-16T07:25:40.821484+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_clean_scrub_stamp":"2024-03-16T07:25:39.782521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:43:36.497286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.804142+0000","last_change":"2024-03-16T07:25:26.779663+0000","last_active":"2024-03-16T07:25:41.804142+0000","last_peered":"2024-03-16T07:25:41.804142+0000","last_clean":"2024-03-16T07:25:41.804142+0000","last_became_active":"2024-03-16T07:25:26.779395+0000","last_became_peered":"2024-03-16T07:25:26.779395+0000","last_unstale":"2024-03-16T07:25:41.804142+0000","last_undegraded":"2024-03-16T07:25:41.804142+0000","last_fullsized":"2024-03-16T07:25:41.804142+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:39:17.634888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.805678+0000","last_change":"2024-03-16T07:25:40.815740+0000","last_active":"2024-03-16T07:25:41.805678+0000","last_peered":"2024-03-16T07:25:41.805678+0000","last_clean":"2024-03-16T07:25:41.805678+0000","last_became_active":"2024-03-16T07:25:40.815492+0000","last_became_peered":"2024-03-16T07:25:40.815492+0000","last_unstale":"2024-03-16T07:25:41.805678+0000","last_undegraded":"2024-03-16T07:25:41.805678+0000","last_fullsized":"2024-03-16T07:25:41.805678+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_clean_scrub_stamp":"2024-03-16T07:25:39.782521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:49:51.185259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-16T07:25:40.789844+0000","last_change":"2024-03-16T07:25:26.775812+0000","last_active":"2024-03-16T07:25:40.789844+0000","last_peered":"2024-03-16T07:25:40.789844+0000","last_clean":"2024-03-16T07:25:40.789844+0000","last_became_active":"2024-03-16T07:25:26.775250+0000","last_became_peered":"2024-03-16T07:25:26.775250+0000","last_unstale":"2024-03-16T07:25:40.789844+0000","last_undegraded":"2024-03-16T07:25:40.789844+0000","last_fullsized":"2024-03-16T07:25:40.789844+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:28:39.013422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.804085+0000","last_change":"2024-03-16T07:25:40.822074+0000","last_active":"2024-03-16T07:25:41.804085+0000","last_peered":"2024-03-16T07:25:41.804085+0000","last_clean":"2024-03-16T07:25:41.804085+0000","last_became_active":"2024-03-16T07:25:40.821836+0000","last_became_peered":"2024-03-16T07:25:40.821836+0000","last_unstale":"2024-03-16T07:25:41.804085+0000","last_undegraded":"2024-03-16T07:25:41.804085+0000","last_fullsized":"2024-03-16T07:25:41.804085+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_clean_scrub_stamp":"2024-03-16T07:25:39.782521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:30:09.484996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-16T07:25:40.792601+0000","last_change":"2024-03-16T07:25:26.798086+0000","last_active":"2024-03-16T07:25:40.792601+0000","last_peered":"2024-03-16T07:25:40.792601+0000","last_clean":"2024-03-16T07:25:40.792601+0000","last_became_active":"2024-03-16T07:25:26.795175+0000","last_became_peered":"2024-03-16T07:25:26.795175+0000","last_unstale":"2024-03-16T07:25:40.792601+0000","last_undegraded":"2024-03-16T07:25:40.792601+0000","last_fullsized":"2024-03-16T07:25:40.792601+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:42:51.538757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.810116+0000","last_change":"2024-03-16T07:25:40.811781+0000","last_active":"2024-03-16T07:25:41.810116+0000","last_peered":"2024-03-16T07:25:41.810116+0000","last_clean":"2024-03-16T07:25:41.810116+0000","last_became_active":"2024-03-16T07:25:40.811541+0000","last_became_peered":"2024-03-16T07:25:40.811541+0000","last_unstale":"2024-03-16T07:25:41.810116+0000","last_undegraded":"2024-03-16T07:25:41.810116+0000","last_fullsized":"2024-03-16T07:25:41.810116+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_clean_scrub_stamp":"2024-03-16T07:25:39.782521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:17:16.794149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.808668+0000","last_change":"2024-03-16T07:25:26.782081+0000","last_active":"2024-03-16T07:25:41.808668+0000","last_peered":"2024-03-16T07:25:41.808668+0000","last_clean":"2024-03-16T07:25:41.808668+0000","last_became_active":"2024-03-16T07:25:26.781123+0000","last_became_peered":"2024-03-16T07:25:26.781123+0000","last_unstale":"2024-03-16T07:25:41.808668+0000","last_undegraded":"2024-03-16T07:25:41.808668+0000","last_fullsized":"2024-03-16T07:25:41.808668+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:47:18.096711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-16T07:25:40.830129+0000","last_change":"2024-03-16T07:25:40.828782+0000","last_active":"2024-03-16T07:25:40.830129+0000","last_peered":"2024-03-16T07:25:40.830129+0000","last_clean":"2024-03-16T07:25:40.830129+0000","last_became_active":"2024-03-16T07:25:40.828409+0000","last_became_peered":"2024-03-16T07:25:40.828409+0000","last_unstale":"2024-03-16T07:25:40.830129+0000","last_undegraded":"2024-03-16T07:25:40.830129+0000","last_fullsized":"2024-03-16T07:25:40.830129+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_clean_scrub_stamp":"2024-03-16T07:25:39.782521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:13:00.377550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.806921+0000","last_change":"2024-03-16T07:25:26.791013+0000","last_active":"2024-03-16T07:25:41.806921+0000","last_peered":"2024-03-16T07:25:41.806921+0000","last_clean":"2024-03-16T07:25:41.806921+0000","last_became_active":"2024-03-16T07:25:26.790781+0000","last_became_peered":"2024-03-16T07:25:26.790781+0000","last_unstale":"2024-03-16T07:25:41.806921+0000","last_undegraded":"2024-03-16T07:25:41.806921+0000","last_fullsized":"2024-03-16T07:25:41.806921+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:13:14.226330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.808231+0000","last_change":"2024-03-16T07:25:40.823458+0000","last_active":"2024-03-16T07:25:41.808231+0000","last_peered":"2024-03-16T07:25:41.808231+0000","last_clean":"2024-03-16T07:25:41.808231+0000","last_became_active":"2024-03-16T07:25:40.820067+0000","last_became_peered":"2024-03-16T07:25:40.820067+0000","last_unstale":"2024-03-16T07:25:41.808231+0000","last_undegraded":"2024-03-16T07:25:41.808231+0000","last_fullsized":"2024-03-16T07:25:41.808231+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_clean_scrub_stamp":"2024-03-16T07:25:39.782521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:30:39.951321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.807282+0000","last_change":"2024-03-16T07:25:26.784187+0000","last_active":"2024-03-16T07:25:41.807282+0000","last_peered":"2024-03-16T07:25:41.807282+0000","last_clean":"2024-03-16T07:25:41.807282+0000","last_became_active":"2024-03-16T07:25:26.783915+0000","last_became_peered":"2024-03-16T07:25:26.783915+0000","last_unstale":"2024-03-16T07:25:41.807282+0000","last_undegraded":"2024-03-16T07:25:41.807282+0000","last_fullsized":"2024-03-16T07:25:41.807282+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:53:30.197560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-16T07:25:40.817593+0000","last_change":"2024-03-16T07:25:40.813164+0000","last_active":"2024-03-16T07:25:40.817593+0000","last_peered":"2024-03-16T07:25:40.817593+0000","last_clean":"2024-03-16T07:25:40.817593+0000","last_became_active":"2024-03-16T07:25:40.812443+0000","last_became_peered":"2024-03-16T07:25:40.812443+0000","last_unstale":"2024-03-16T07:25:40.817593+0000","last_undegraded":"2024-03-16T07:25:40.817593+0000","last_fullsized":"2024-03-16T07:25:40.817593+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_clean_scrub_stamp":"2024-03-16T07:25:39.782521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:25:21.200968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.807461+0000","last_change":"2024-03-16T07:25:26.792087+0000","last_active":"2024-03-16T07:25:41.807461+0000","last_peered":"2024-03-16T07:25:41.807461+0000","last_clean":"2024-03-16T07:25:41.807461+0000","last_became_active":"2024-03-16T07:25:26.791866+0000","last_became_peered":"2024-03-16T07:25:26.791866+0000","last_unstale":"2024-03-16T07:25:41.807461+0000","last_undegraded":"2024-03-16T07:25:41.807461+0000","last_fullsized":"2024-03-16T07:25:41.807461+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:16:18.923166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-16T07:25:40.820785+0000","last_change":"2024-03-16T07:25:40.816360+0000","last_active":"2024-03-16T07:25:40.820785+0000","last_peered":"2024-03-16T07:25:40.820785+0000","last_clean":"2024-03-16T07:25:40.820785+0000","last_became_active":"2024-03-16T07:25:40.816119+0000","last_became_peered":"2024-03-16T07:25:40.816119+0000","last_unstale":"2024-03-16T07:25:40.820785+0000","last_undegraded":"2024-03-16T07:25:40.820785+0000","last_fullsized":"2024-03-16T07:25:40.820785+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_clean_scrub_stamp":"2024-03-16T07:25:39.782521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:10:57.157265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.806260+0000","last_change":"2024-03-16T07:25:26.788304+0000","last_active":"2024-03-16T07:25:41.806260+0000","last_peered":"2024-03-16T07:25:41.806260+0000","last_clean":"2024-03-16T07:25:41.806260+0000","last_became_active":"2024-03-16T07:25:26.787434+0000","last_became_peered":"2024-03-16T07:25:26.787434+0000","last_unstale":"2024-03-16T07:25:41.806260+0000","last_undegraded":"2024-03-16T07:25:41.806260+0000","last_fullsized":"2024-03-16T07:25:41.806260+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:35:14.107259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.807598+0000","last_change":"2024-03-16T07:25:40.825839+0000","last_active":"2024-03-16T07:25:41.807598+0000","last_peered":"2024-03-16T07:25:41.807598+0000","last_clean":"2024-03-16T07:25:41.807598+0000","last_became_active":"2024-03-16T07:25:40.824786+0000","last_became_peered":"2024-03-16T07:25:40.824786+0000","last_unstale":"2024-03-16T07:25:41.807598+0000","last_undegraded":"2024-03-16T07:25:41.807598+0000","last_fullsized":"2024-03-16T07:25:41.807598+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_clean_scrub_stamp":"2024-03-16T07:25:39.782521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:32:59.653762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-16T07:25:40.789850+0000","last_change":"2024-03-16T07:25:26.797082+0000","last_active":"2024-03-16T07:25:40.789850+0000","last_peered":"2024-03-16T07:25:40.789850+0000","last_clean":"2024-03-16T07:25:40.789850+0000","last_became_active":"2024-03-16T07:25:26.794623+0000","last_became_peered":"2024-03-16T07:25:26.794623+0000","last_unstale":"2024-03-16T07:25:40.789850+0000","last_undegraded":"2024-03-16T07:25:40.789850+0000","last_fullsized":"2024-03-16T07:25:40.789850+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:16:04.340775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.805537+0000","last_change":"2024-03-16T07:25:40.819493+0000","last_active":"2024-03-16T07:25:41.805537+0000","last_peered":"2024-03-16T07:25:41.805537+0000","last_clean":"2024-03-16T07:25:41.805537+0000","last_became_active":"2024-03-16T07:25:40.819113+0000","last_became_peered":"2024-03-16T07:25:40.819113+0000","last_unstale":"2024-03-16T07:25:41.805537+0000","last_undegraded":"2024-03-16T07:25:41.805537+0000","last_fullsized":"2024-03-16T07:25:41.805537+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_clean_scrub_stamp":"2024-03-16T07:25:39.782521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:44:15.167957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.804447+0000","last_change":"2024-03-16T07:25:26.780517+0000","last_active":"2024-03-16T07:25:41.804447+0000","last_peered":"2024-03-16T07:25:41.804447+0000","last_clean":"2024-03-16T07:25:41.804447+0000","last_became_active":"2024-03-16T07:25:26.779906+0000","last_became_peered":"2024-03-16T07:25:26.779906+0000","last_unstale":"2024-03-16T07:25:41.804447+0000","last_undegraded":"2024-03-16T07:25:41.804447+0000","last_fullsized":"2024-03-16T07:25:41.804447+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:16:18.923166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-16T07:25:40.808223+0000","last_change":"2024-03-16T07:25:40.804032+0000","last_active":"2024-03-16T07:25:40.808223+0000","last_peered":"2024-03-16T07:25:40.808223+0000","last_clean":"2024-03-16T07:25:40.808223+0000","last_became_active":"2024-03-16T07:25:40.803801+0000","last_became_peered":"2024-03-16T07:25:40.803801+0000","last_unstale":"2024-03-16T07:25:40.808223+0000","last_undegraded":"2024-03-16T07:25:40.808223+0000","last_fullsized":"2024-03-16T07:25:40.808223+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_clean_scrub_stamp":"2024-03-16T07:25:39.782521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:44:48.980147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-16T07:25:40.791525+0000","last_change":"2024-03-16T07:25:26.781114+0000","last_active":"2024-03-16T07:25:40.791525+0000","last_peered":"2024-03-16T07:25:40.791525+0000","last_clean":"2024-03-16T07:25:40.791525+0000","last_became_active":"2024-03-16T07:25:26.780863+0000","last_became_peered":"2024-03-16T07:25:26.780863+0000","last_unstale":"2024-03-16T07:25:40.791525+0000","last_undegraded":"2024-03-16T07:25:40.791525+0000","last_fullsized":"2024-03-16T07:25:40.791525+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:14:10.232665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.806564+0000","last_change":"2024-03-16T07:25:40.821248+0000","last_active":"2024-03-16T07:25:41.806564+0000","last_peered":"2024-03-16T07:25:41.806564+0000","last_clean":"2024-03-16T07:25:41.806564+0000","last_became_active":"2024-03-16T07:25:40.820751+0000","last_became_peered":"2024-03-16T07:25:40.820751+0000","last_unstale":"2024-03-16T07:25:41.806564+0000","last_undegraded":"2024-03-16T07:25:41.806564+0000","last_fullsized":"2024-03-16T07:25:41.806564+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_clean_scrub_stamp":"2024-03-16T07:25:39.782521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:29:42.298625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.808674+0000","last_change":"2024-03-16T07:25:26.782390+0000","last_active":"2024-03-16T07:25:41.808674+0000","last_peered":"2024-03-16T07:25:41.808674+0000","last_clean":"2024-03-16T07:25:41.808674+0000","last_became_active":"2024-03-16T07:25:26.781829+0000","last_became_peered":"2024-03-16T07:25:26.781829+0000","last_unstale":"2024-03-16T07:25:41.808674+0000","last_undegraded":"2024-03-16T07:25:41.808674+0000","last_fullsized":"2024-03-16T07:25:41.808674+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:53:30.197560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.808885+0000","last_change":"2024-03-16T07:25:40.824399+0000","last_active":"2024-03-16T07:25:41.808885+0000","last_peered":"2024-03-16T07:25:41.808885+0000","last_clean":"2024-03-16T07:25:41.808885+0000","last_became_active":"2024-03-16T07:25:40.824179+0000","last_became_peered":"2024-03-16T07:25:40.824179+0000","last_unstale":"2024-03-16T07:25:41.808885+0000","last_undegraded":"2024-03-16T07:25:41.808885+0000","last_fullsized":"2024-03-16T07:25:41.808885+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_clean_scrub_stamp":"2024-03-16T07:25:39.782521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:25:30.792729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-16T07:25:40.793304+0000","last_change":"2024-03-16T07:25:26.796633+0000","last_active":"2024-03-16T07:25:40.793304+0000","last_peered":"2024-03-16T07:25:40.793304+0000","last_clean":"2024-03-16T07:25:40.793304+0000","last_became_active":"2024-03-16T07:25:26.795891+0000","last_became_peered":"2024-03-16T07:25:26.795891+0000","last_unstale":"2024-03-16T07:25:40.793304+0000","last_undegraded":"2024-03-16T07:25:40.793304+0000","last_fullsized":"2024-03-16T07:25:40.793304+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:56:52.032603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.808093+0000","last_change":"2024-03-16T07:25:40.826151+0000","last_active":"2024-03-16T07:25:41.808093+0000","last_peered":"2024-03-16T07:25:41.808093+0000","last_clean":"2024-03-16T07:25:41.808093+0000","last_became_active":"2024-03-16T07:25:40.825700+0000","last_became_peered":"2024-03-16T07:25:40.825700+0000","last_unstale":"2024-03-16T07:25:41.808093+0000","last_undegraded":"2024-03-16T07:25:41.808093+0000","last_fullsized":"2024-03-16T07:25:41.808093+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_clean_scrub_stamp":"2024-03-16T07:25:39.782521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:49:48.590307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-16T07:25:40.791245+0000","last_change":"2024-03-16T07:25:26.797761+0000","last_active":"2024-03-16T07:25:40.791245+0000","last_peered":"2024-03-16T07:25:40.791245+0000","last_clean":"2024-03-16T07:25:40.791245+0000","last_became_active":"2024-03-16T07:25:26.796108+0000","last_became_peered":"2024-03-16T07:25:26.796108+0000","last_unstale":"2024-03-16T07:25:40.791245+0000","last_undegraded":"2024-03-16T07:25:40.791245+0000","last_fullsized":"2024-03-16T07:25:40.791245+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:46:16.995267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-16T07:25:40.819973+0000","last_change":"2024-03-16T07:25:40.813438+0000","last_active":"2024-03-16T07:25:40.819973+0000","last_peered":"2024-03-16T07:25:40.819973+0000","last_clean":"2024-03-16T07:25:40.819973+0000","last_became_active":"2024-03-16T07:25:40.812772+0000","last_became_peered":"2024-03-16T07:25:40.812772+0000","last_unstale":"2024-03-16T07:25:40.819973+0000","last_undegraded":"2024-03-16T07:25:40.819973+0000","last_fullsized":"2024-03-16T07:25:40.819973+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_clean_scrub_stamp":"2024-03-16T07:25:39.782521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:33:18.199318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-16T07:25:40.791701+0000","last_change":"2024-03-16T07:25:26.775670+0000","last_active":"2024-03-16T07:25:40.791701+0000","last_peered":"2024-03-16T07:25:40.791701+0000","last_clean":"2024-03-16T07:25:40.791701+0000","last_became_active":"2024-03-16T07:25:26.775387+0000","last_became_peered":"2024-03-16T07:25:26.775387+0000","last_unstale":"2024-03-16T07:25:40.791701+0000","last_undegraded":"2024-03-16T07:25:40.791701+0000","last_fullsized":"2024-03-16T07:25:40.791701+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:11:28.084567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-16T07:25:40.817223+0000","last_change":"2024-03-16T07:25:40.811949+0000","last_active":"2024-03-16T07:25:40.817223+0000","last_peered":"2024-03-16T07:25:40.817223+0000","last_clean":"2024-03-16T07:25:40.817223+0000","last_became_active":"2024-03-16T07:25:40.811369+0000","last_became_peered":"2024-03-16T07:25:40.811369+0000","last_unstale":"2024-03-16T07:25:40.817223+0000","last_undegraded":"2024-03-16T07:25:40.817223+0000","last_fullsized":"2024-03-16T07:25:40.817223+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_clean_scrub_stamp":"2024-03-16T07:25:39.782521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:30:39.951321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-16T07:25:40.790026+0000","last_change":"2024-03-16T07:25:26.773366+0000","last_active":"2024-03-16T07:25:40.790026+0000","last_peered":"2024-03-16T07:25:40.790026+0000","last_clean":"2024-03-16T07:25:40.790026+0000","last_became_active":"2024-03-16T07:25:26.773118+0000","last_became_peered":"2024-03-16T07:25:26.773118+0000","last_unstale":"2024-03-16T07:25:40.790026+0000","last_undegraded":"2024-03-16T07:25:40.790026+0000","last_fullsized":"2024-03-16T07:25:40.790026+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:54:15.721612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.808427+0000","last_change":"2024-03-16T07:25:40.812355+0000","last_active":"2024-03-16T07:25:41.808427+0000","last_peered":"2024-03-16T07:25:41.808427+0000","last_clean":"2024-03-16T07:25:41.808427+0000","last_became_active":"2024-03-16T07:25:40.812127+0000","last_became_peered":"2024-03-16T07:25:40.812127+0000","last_unstale":"2024-03-16T07:25:41.808427+0000","last_undegraded":"2024-03-16T07:25:41.808427+0000","last_fullsized":"2024-03-16T07:25:41.808427+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_clean_scrub_stamp":"2024-03-16T07:25:39.782521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:28:29.876723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-16T07:25:40.789001+0000","last_change":"2024-03-16T07:25:26.773093+0000","last_active":"2024-03-16T07:25:40.789001+0000","last_peered":"2024-03-16T07:25:40.789001+0000","last_clean":"2024-03-16T07:25:40.789001+0000","last_became_active":"2024-03-16T07:25:26.772835+0000","last_became_peered":"2024-03-16T07:25:26.772835+0000","last_unstale":"2024-03-16T07:25:40.789001+0000","last_undegraded":"2024-03-16T07:25:40.789001+0000","last_fullsized":"2024-03-16T07:25:40.789001+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:25:52.701175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-16T07:25:40.820835+0000","last_change":"2024-03-16T07:25:40.818199+0000","last_active":"2024-03-16T07:25:40.820835+0000","last_peered":"2024-03-16T07:25:40.820835+0000","last_clean":"2024-03-16T07:25:40.820835+0000","last_became_active":"2024-03-16T07:25:40.817788+0000","last_became_peered":"2024-03-16T07:25:40.817788+0000","last_unstale":"2024-03-16T07:25:40.820835+0000","last_undegraded":"2024-03-16T07:25:40.820835+0000","last_fullsized":"2024-03-16T07:25:40.820835+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_clean_scrub_stamp":"2024-03-16T07:25:39.782521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:25:23.088335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-16T07:25:40.789996+0000","last_change":"2024-03-16T07:25:26.776183+0000","last_active":"2024-03-16T07:25:40.789996+0000","last_peered":"2024-03-16T07:25:40.789996+0000","last_clean":"2024-03-16T07:25:40.789996+0000","last_became_active":"2024-03-16T07:25:26.775565+0000","last_became_peered":"2024-03-16T07:25:26.775565+0000","last_unstale":"2024-03-16T07:25:40.789996+0000","last_undegraded":"2024-03-16T07:25:40.789996+0000","last_fullsized":"2024-03-16T07:25:40.789996+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:27:47.666750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.804490+0000","last_change":"2024-03-16T07:25:40.823310+0000","last_active":"2024-03-16T07:25:41.804490+0000","last_peered":"2024-03-16T07:25:41.804490+0000","last_clean":"2024-03-16T07:25:41.804490+0000","last_became_active":"2024-03-16T07:25:40.820421+0000","last_became_peered":"2024-03-16T07:25:40.820421+0000","last_unstale":"2024-03-16T07:25:41.804490+0000","last_undegraded":"2024-03-16T07:25:41.804490+0000","last_fullsized":"2024-03-16T07:25:41.804490+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_clean_scrub_stamp":"2024-03-16T07:25:39.782521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:38:51.909230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.807952+0000","last_change":"2024-03-16T07:25:26.790704+0000","last_active":"2024-03-16T07:25:41.807952+0000","last_peered":"2024-03-16T07:25:41.807952+0000","last_clean":"2024-03-16T07:25:41.807952+0000","last_became_active":"2024-03-16T07:25:26.790439+0000","last_became_peered":"2024-03-16T07:25:26.790439+0000","last_unstale":"2024-03-16T07:25:41.807952+0000","last_undegraded":"2024-03-16T07:25:41.807952+0000","last_fullsized":"2024-03-16T07:25:41.807952+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:26:17.093512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-16T07:25:40.830887+0000","last_change":"2024-03-16T07:25:40.829946+0000","last_active":"2024-03-16T07:25:40.830887+0000","last_peered":"2024-03-16T07:25:40.830887+0000","last_clean":"2024-03-16T07:25:40.830887+0000","last_became_active":"2024-03-16T07:25:40.829720+0000","last_became_peered":"2024-03-16T07:25:40.829720+0000","last_unstale":"2024-03-16T07:25:40.830887+0000","last_undegraded":"2024-03-16T07:25:40.830887+0000","last_fullsized":"2024-03-16T07:25:40.830887+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_clean_scrub_stamp":"2024-03-16T07:25:39.782521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:53:08.397356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.805442+0000","last_change":"2024-03-16T07:25:26.781727+0000","last_active":"2024-03-16T07:25:41.805442+0000","last_peered":"2024-03-16T07:25:41.805442+0000","last_clean":"2024-03-16T07:25:41.805442+0000","last_became_active":"2024-03-16T07:25:26.781481+0000","last_became_peered":"2024-03-16T07:25:26.781481+0000","last_unstale":"2024-03-16T07:25:41.805442+0000","last_undegraded":"2024-03-16T07:25:41.805442+0000","last_fullsized":"2024-03-16T07:25:41.805442+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:39:12.805004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-16T07:25:40.821288+0000","last_change":"2024-03-16T07:25:40.819998+0000","last_active":"2024-03-16T07:25:40.821288+0000","last_peered":"2024-03-16T07:25:40.821288+0000","last_clean":"2024-03-16T07:25:40.821288+0000","last_became_active":"2024-03-16T07:25:40.819542+0000","last_became_peered":"2024-03-16T07:25:40.819542+0000","last_unstale":"2024-03-16T07:25:40.821288+0000","last_undegraded":"2024-03-16T07:25:40.821288+0000","last_fullsized":"2024-03-16T07:25:40.821288+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_clean_scrub_stamp":"2024-03-16T07:25:39.782521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:47:44.531089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-16T07:25:40.793472+0000","last_change":"2024-03-16T07:25:26.796897+0000","last_active":"2024-03-16T07:25:40.793472+0000","last_peered":"2024-03-16T07:25:40.793472+0000","last_clean":"2024-03-16T07:25:40.793472+0000","last_became_active":"2024-03-16T07:25:26.795947+0000","last_became_peered":"2024-03-16T07:25:26.795947+0000","last_unstale":"2024-03-16T07:25:40.793472+0000","last_undegraded":"2024-03-16T07:25:40.793472+0000","last_fullsized":"2024-03-16T07:25:40.793472+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:29:13.224702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.807954+0000","last_change":"2024-03-16T07:25:40.825964+0000","last_active":"2024-03-16T07:25:41.807954+0000","last_peered":"2024-03-16T07:25:41.807954+0000","last_clean":"2024-03-16T07:25:41.807954+0000","last_became_active":"2024-03-16T07:25:40.825002+0000","last_became_peered":"2024-03-16T07:25:40.825002+0000","last_unstale":"2024-03-16T07:25:41.807954+0000","last_undegraded":"2024-03-16T07:25:41.807954+0000","last_fullsized":"2024-03-16T07:25:41.807954+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_clean_scrub_stamp":"2024-03-16T07:25:39.782521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:44:48.980147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.807369+0000","last_change":"2024-03-16T07:25:26.793964+0000","last_active":"2024-03-16T07:25:41.807369+0000","last_peered":"2024-03-16T07:25:41.807369+0000","last_clean":"2024-03-16T07:25:41.807369+0000","last_became_active":"2024-03-16T07:25:26.793713+0000","last_became_peered":"2024-03-16T07:25:26.793713+0000","last_unstale":"2024-03-16T07:25:41.807369+0000","last_undegraded":"2024-03-16T07:25:41.807369+0000","last_fullsized":"2024-03-16T07:25:41.807369+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:25:48.897323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-16T07:25:40.820085+0000","last_change":"2024-03-16T07:25:40.816787+0000","last_active":"2024-03-16T07:25:40.820085+0000","last_peered":"2024-03-16T07:25:40.820085+0000","last_clean":"2024-03-16T07:25:40.820085+0000","last_became_active":"2024-03-16T07:25:40.816558+0000","last_became_peered":"2024-03-16T07:25:40.816558+0000","last_unstale":"2024-03-16T07:25:40.820085+0000","last_undegraded":"2024-03-16T07:25:40.820085+0000","last_fullsized":"2024-03-16T07:25:40.820085+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_clean_scrub_stamp":"2024-03-16T07:25:39.782521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:17:16.794149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.807297+0000","last_change":"2024-03-16T07:25:26.793226+0000","last_active":"2024-03-16T07:25:41.807297+0000","last_peered":"2024-03-16T07:25:41.807297+0000","last_clean":"2024-03-16T07:25:41.807297+0000","last_became_active":"2024-03-16T07:25:26.792996+0000","last_became_peered":"2024-03-16T07:25:26.792996+0000","last_unstale":"2024-03-16T07:25:41.807297+0000","last_undegraded":"2024-03-16T07:25:41.807297+0000","last_fullsized":"2024-03-16T07:25:41.807297+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:03:56.402808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-16T07:25:40.817244+0000","last_change":"2024-03-16T07:25:40.812147+0000","last_active":"2024-03-16T07:25:40.817244+0000","last_peered":"2024-03-16T07:25:40.817244+0000","last_clean":"2024-03-16T07:25:40.817244+0000","last_became_active":"2024-03-16T07:25:40.811720+0000","last_became_peered":"2024-03-16T07:25:40.811720+0000","last_unstale":"2024-03-16T07:25:40.817244+0000","last_undegraded":"2024-03-16T07:25:40.817244+0000","last_fullsized":"2024-03-16T07:25:40.817244+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_clean_scrub_stamp":"2024-03-16T07:25:39.782521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:45:18.030885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.806401+0000","last_change":"2024-03-16T07:25:26.791413+0000","last_active":"2024-03-16T07:25:41.806401+0000","last_peered":"2024-03-16T07:25:41.806401+0000","last_clean":"2024-03-16T07:25:41.806401+0000","last_became_active":"2024-03-16T07:25:26.790271+0000","last_became_peered":"2024-03-16T07:25:26.790271+0000","last_unstale":"2024-03-16T07:25:41.806401+0000","last_undegraded":"2024-03-16T07:25:41.806401+0000","last_fullsized":"2024-03-16T07:25:41.806401+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:00:23.249950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-16T07:25:40.820116+0000","last_change":"2024-03-16T07:25:40.813961+0000","last_active":"2024-03-16T07:25:40.820116+0000","last_peered":"2024-03-16T07:25:40.820116+0000","last_clean":"2024-03-16T07:25:40.820116+0000","last_became_active":"2024-03-16T07:25:40.813231+0000","last_became_peered":"2024-03-16T07:25:40.813231+0000","last_unstale":"2024-03-16T07:25:40.820116+0000","last_undegraded":"2024-03-16T07:25:40.820116+0000","last_fullsized":"2024-03-16T07:25:40.820116+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_clean_scrub_stamp":"2024-03-16T07:25:39.782521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:25:30.792729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.803896+0000","last_change":"2024-03-16T07:25:26.789325+0000","last_active":"2024-03-16T07:25:41.803896+0000","last_peered":"2024-03-16T07:25:41.803896+0000","last_clean":"2024-03-16T07:25:41.803896+0000","last_became_active":"2024-03-16T07:25:26.789018+0000","last_became_peered":"2024-03-16T07:25:26.789018+0000","last_unstale":"2024-03-16T07:25:41.803896+0000","last_undegraded":"2024-03-16T07:25:41.803896+0000","last_fullsized":"2024-03-16T07:25:41.803896+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:25:48.897323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-16T07:25:40.822712+0000","last_change":"2024-03-16T07:25:40.821382+0000","last_active":"2024-03-16T07:25:40.822712+0000","last_peered":"2024-03-16T07:25:40.822712+0000","last_clean":"2024-03-16T07:25:40.822712+0000","last_became_active":"2024-03-16T07:25:40.821120+0000","last_became_peered":"2024-03-16T07:25:40.821120+0000","last_unstale":"2024-03-16T07:25:40.822712+0000","last_undegraded":"2024-03-16T07:25:40.822712+0000","last_fullsized":"2024-03-16T07:25:40.822712+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_clean_scrub_stamp":"2024-03-16T07:25:39.782521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:42:32.939255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.805243+0000","last_change":"2024-03-16T07:25:26.767484+0000","last_active":"2024-03-16T07:25:41.805243+0000","last_peered":"2024-03-16T07:25:41.805243+0000","last_clean":"2024-03-16T07:25:41.805243+0000","last_became_active":"2024-03-16T07:25:26.766849+0000","last_became_peered":"2024-03-16T07:25:26.766849+0000","last_unstale":"2024-03-16T07:25:41.805243+0000","last_undegraded":"2024-03-16T07:25:41.805243+0000","last_fullsized":"2024-03-16T07:25:41.805243+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:24:13.541892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-16T07:25:40.829945+0000","last_change":"2024-03-16T07:25:40.827657+0000","last_active":"2024-03-16T07:25:40.829945+0000","last_peered":"2024-03-16T07:25:40.829945+0000","last_clean":"2024-03-16T07:25:40.829945+0000","last_became_active":"2024-03-16T07:25:40.827343+0000","last_became_peered":"2024-03-16T07:25:40.827343+0000","last_unstale":"2024-03-16T07:25:40.829945+0000","last_undegraded":"2024-03-16T07:25:40.829945+0000","last_fullsized":"2024-03-16T07:25:40.829945+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_clean_scrub_stamp":"2024-03-16T07:25:39.782521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:56:50.774729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.807256+0000","last_change":"2024-03-16T07:25:26.782881+0000","last_active":"2024-03-16T07:25:41.807256+0000","last_peered":"2024-03-16T07:25:41.807256+0000","last_clean":"2024-03-16T07:25:41.807256+0000","last_became_active":"2024-03-16T07:25:26.782050+0000","last_became_peered":"2024-03-16T07:25:26.782050+0000","last_unstale":"2024-03-16T07:25:41.807256+0000","last_undegraded":"2024-03-16T07:25:41.807256+0000","last_fullsized":"2024-03-16T07:25:41.807256+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:39:12.805004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.809923+0000","last_change":"2024-03-16T07:25:40.818823+0000","last_active":"2024-03-16T07:25:41.809923+0000","last_peered":"2024-03-16T07:25:41.809923+0000","last_clean":"2024-03-16T07:25:41.809923+0000","last_became_active":"2024-03-16T07:25:40.818589+0000","last_became_peered":"2024-03-16T07:25:40.818589+0000","last_unstale":"2024-03-16T07:25:41.809923+0000","last_undegraded":"2024-03-16T07:25:41.809923+0000","last_fullsized":"2024-03-16T07:25:41.809923+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_clean_scrub_stamp":"2024-03-16T07:25:39.782521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:33:18.199318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.805719+0000","last_change":"2024-03-16T07:25:26.782517+0000","last_active":"2024-03-16T07:25:41.805719+0000","last_peered":"2024-03-16T07:25:41.805719+0000","last_clean":"2024-03-16T07:25:41.805719+0000","last_became_active":"2024-03-16T07:25:26.782289+0000","last_became_peered":"2024-03-16T07:25:26.782289+0000","last_unstale":"2024-03-16T07:25:41.805719+0000","last_undegraded":"2024-03-16T07:25:41.805719+0000","last_fullsized":"2024-03-16T07:25:41.805719+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:56:44.440768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-16T07:25:40.812888+0000","last_change":"2024-03-16T07:25:40.806823+0000","last_active":"2024-03-16T07:25:40.812888+0000","last_peered":"2024-03-16T07:25:40.812888+0000","last_clean":"2024-03-16T07:25:40.812888+0000","last_became_active":"2024-03-16T07:25:40.806031+0000","last_became_peered":"2024-03-16T07:25:40.806031+0000","last_unstale":"2024-03-16T07:25:40.812888+0000","last_undegraded":"2024-03-16T07:25:40.812888+0000","last_fullsized":"2024-03-16T07:25:40.812888+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_clean_scrub_stamp":"2024-03-16T07:25:39.782521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:49:48.590307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.807164+0000","last_change":"2024-03-16T07:25:26.779789+0000","last_active":"2024-03-16T07:25:41.807164+0000","last_peered":"2024-03-16T07:25:41.807164+0000","last_clean":"2024-03-16T07:25:41.807164+0000","last_became_active":"2024-03-16T07:25:26.779560+0000","last_became_peered":"2024-03-16T07:25:26.779560+0000","last_unstale":"2024-03-16T07:25:41.807164+0000","last_undegraded":"2024-03-16T07:25:41.807164+0000","last_fullsized":"2024-03-16T07:25:41.807164+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:36:38.284510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-16T07:25:40.808272+0000","last_change":"2024-03-16T07:25:40.805732+0000","last_active":"2024-03-16T07:25:40.808272+0000","last_peered":"2024-03-16T07:25:40.808272+0000","last_clean":"2024-03-16T07:25:40.808272+0000","last_became_active":"2024-03-16T07:25:40.805481+0000","last_became_peered":"2024-03-16T07:25:40.805481+0000","last_unstale":"2024-03-16T07:25:40.808272+0000","last_undegraded":"2024-03-16T07:25:40.808272+0000","last_fullsized":"2024-03-16T07:25:40.808272+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_clean_scrub_stamp":"2024-03-16T07:25:39.782521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:43:35.925010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-16T07:25:40.791376+0000","last_change":"2024-03-16T07:25:26.797893+0000","last_active":"2024-03-16T07:25:40.791376+0000","last_peered":"2024-03-16T07:25:40.791376+0000","last_clean":"2024-03-16T07:25:40.791376+0000","last_became_active":"2024-03-16T07:25:26.795108+0000","last_became_peered":"2024-03-16T07:25:26.795108+0000","last_unstale":"2024-03-16T07:25:40.791376+0000","last_undegraded":"2024-03-16T07:25:40.791376+0000","last_fullsized":"2024-03-16T07:25:40.791376+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:27:26.808454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.807396+0000","last_change":"2024-03-16T07:25:40.822656+0000","last_active":"2024-03-16T07:25:41.807396+0000","last_peered":"2024-03-16T07:25:41.807396+0000","last_clean":"2024-03-16T07:25:41.807396+0000","last_became_active":"2024-03-16T07:25:40.822433+0000","last_became_peered":"2024-03-16T07:25:40.822433+0000","last_unstale":"2024-03-16T07:25:41.807396+0000","last_undegraded":"2024-03-16T07:25:41.807396+0000","last_fullsized":"2024-03-16T07:25:41.807396+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:39.782521+0000","last_clean_scrub_stamp":"2024-03-16T07:25:39.782521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:49:48.590307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3f","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T07:25:41.809274+0000","last_change":"2024-03-16T07:25:26.778321+0000","last_active":"2024-03-16T07:25:41.809274+0000","last_peered":"2024-03-16T07:25:41.809274+0000","last_clean":"2024-03-16T07:25:41.809274+0000","last_became_active":"2024-03-16T07:25:26.778060+0000","last_became_peered":"2024-03-16T07:25:26.778060+0000","last_unstale":"2024-03-16T07:25:41.809274+0000","last_undegraded":"2024-03-16T07:25:41.809274+0000","last_fullsized":"2024-03-16T07:25:41.809274+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:25:25.746840+0000","last_clean_scrub_stamp":"2024-03-16T07:25:25.746840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:56:24.824794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":4107,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":8214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738386,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":31504,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":104826096,"statfs":{"total":107374182400,"available":107341922304,"internally_reserved":0,"allocated":331776,"data_stored":105636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738386,"num_pgs":79,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":32088,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":104825512,"statfs":{"total":107374182400,"available":107341324288,"internally_reserved":0,"allocated":929792,"data_stored":697771,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738386,"num_pgs":80,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":32084,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":104825516,"statfs":{"total":107374182400,"available":107341328384,"internally_reserved":0,"allocated":917504,"data_stored":694976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3981,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":4107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-16T07:25:45.342 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-03-16T07:25:45.342 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T07:25:45.782 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:25:45.782 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":23,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4497,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6827/2700845528","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":2700845528},{"type":"v1","addr":"172.21.15.49:6827","nonce":2700845528}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4502,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6830/1983317600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":1983317600},{"type":"v1","addr":"172.21.15.49:6830","nonce":1983317600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4503,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6831/1363178912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6829","nonce":1363178912},{"type":"v1","addr":"172.21.15.49:6831","nonce":1363178912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-16T07:25:26.124693+0000","modified":"2024-03-16T07:25:29.119108+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4509},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4509":{"gid":4509,"name":"e","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6835/3541821089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":3541821089},{"type":"v1","addr":"172.21.15.49:6835","nonce":3541821089}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4509,"qdb_cluster":[4509]},"id":2},{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-16T07:25:40.160397+0000","modified":"2024-03-16T07:25:43.171652+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4506},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4506":{"gid":4506,"name":"c","rank":0,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.49:6833/4243939102","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":4243939102},{"type":"v1","addr":"172.21.15.49:6833","nonce":4243939102}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"backup_fs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4506,"qdb_cluster":[4506]},"id":3}]} 2024-03-16T07:25:45.782 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 23 2024-03-16T07:25:46.050 INFO:tasks.ceph.mds.c.smithi049.stderr:2024-03-16T07:25:46.051+0000 7f1d4955b640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-03-16T07:25:46.298 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 23, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-03-16T07:25:40.160397+0000', 'modified': '2024-03-16T07:25:43.171652+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4506}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4506': {'gid': 4506, 'name': 'c', 'rank': 0, 'incarnation': 19, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.49:6833/4243939102', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.49:6832', 'nonce': 4243939102}, {'type': 'v1', 'addr': '172.21.15.49:6833', 'nonce': 4243939102}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'backup_fs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4506, 'qdb_cluster': [4506]} 2024-03-16T07:25:46.298 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-03-16T07:25:46.298 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-03-16T07:25:46.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-16T07:25:46.425+0000 7f833bfff640 0 client.4659 ms_handle_reset on v2:172.21.15.49:6832/4243939102 2024-03-16T07:25:46.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-16T07:25:46.449+0000 7f833bfff640 0 client.4661 ms_handle_reset on v2:172.21.15.49:6832/4243939102 2024-03-16T07:25:46.448 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-03-16T07:25:46.448 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_fsid": "f91af061-9eac-4793-87fa-8d27ae3d242f", 2024-03-16T07:25:46.448 INFO:teuthology.orchestra.run.smithi049.stdout: "whoami": 0, 2024-03-16T07:25:46.448 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 4506, 2024-03-16T07:25:46.448 INFO:teuthology.orchestra.run.smithi049.stdout: "want_state": "up:active", 2024-03-16T07:25:46.448 INFO:teuthology.orchestra.run.smithi049.stdout: "state": "up:active", 2024-03-16T07:25:46.449 INFO:teuthology.orchestra.run.smithi049.stdout: "fs_name": "backup_fs", 2024-03-16T07:25:46.449 INFO:teuthology.orchestra.run.smithi049.stdout: "rank_uptime": 5.6640497869999997, 2024-03-16T07:25:46.449 INFO:teuthology.orchestra.run.smithi049.stdout: "mdsmap_epoch": 23, 2024-03-16T07:25:46.449 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch": 32, 2024-03-16T07:25:46.449 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch_barrier": 32, 2024-03-16T07:25:46.449 INFO:teuthology.orchestra.run.smithi049.stdout: "uptime": 27.217962504999999 2024-03-16T07:25:46.449 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-03-16T07:25:46.459 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable mirroring 2024-03-16T07:25:46.886 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:25:46.887 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p d1/d2/d3) 2024-03-16T07:25:46.909 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:25:46.909 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p d1/d4) 2024-03-16T07:25:46.966 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-03-16T07:25:46.966 DEBUG:teuthology.orchestra.run.smithi049:counter dump for fs: cephfs> ceph --admin-daemon /var/run/ceph/cephfs-mirror.asok counter dump 2024-03-16T07:25:47.286 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-03-16T07:25:47.286 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker": [ 2024-03-16T07:25:47.287 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:25:47.287 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:25:47.287 INFO:teuthology.orchestra.run.smithi049.stdout: "id": "0" 2024-03-16T07:25:47.287 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:25:47.287 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:25:47.287 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_ready_timeouts": 0, 2024-03-16T07:25:47.287 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_idle_timeouts": 0 2024-03-16T07:25:47.287 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:25:47.287 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:25:47.287 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:25:47.287 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:25:47.287 INFO:teuthology.orchestra.run.smithi049.stdout: "id": "1" 2024-03-16T07:25:47.288 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:25:47.288 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:25:47.288 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_ready_timeouts": 0, 2024-03-16T07:25:47.288 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_idle_timeouts": 0 2024-03-16T07:25:47.288 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:25:47.288 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:25:47.288 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:25:47.288 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:25:47.288 INFO:teuthology.orchestra.run.smithi049.stdout: "id": "2" 2024-03-16T07:25:47.288 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:25:47.288 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:25:47.288 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_ready_timeouts": 0, 2024-03-16T07:25:47.289 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_idle_timeouts": 0 2024-03-16T07:25:47.289 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:25:47.289 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:25:47.289 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:25:47.289 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-0": [ 2024-03-16T07:25:47.289 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:25:47.289 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:25:47.289 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:25:47.289 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 1, 2024-03-16T07:25:47.289 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 8, 2024-03-16T07:25:47.289 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 144, 2024-03-16T07:25:47.289 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 82000, 2024-03-16T07:25:47.289 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 3, 2024-03-16T07:25:47.290 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 1, 2024-03-16T07:25:47.290 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 0.137201596, 2024-03-16T07:25:47.290 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.021224087, 2024-03-16T07:25:47.290 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 0.106250352, 2024-03-16T07:25:47.290 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-03-16T07:25:47.290 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T07:25:47.290 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 7, 2024-03-16T07:25:47.290 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.112949457, 2024-03-16T07:25:47.290 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.016135636 2024-03-16T07:25:47.290 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:25:47.290 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-03-16T07:25:47.290 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:25:47.291 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:25:47.291 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:25:47.291 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:25:47.291 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 144, 2024-03-16T07:25:47.291 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 82000 2024-03-16T07:25:47.291 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:25:47.291 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:25:47.291 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:25:47.291 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-1": [ 2024-03-16T07:25:47.291 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:25:47.291 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:25:47.291 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:25:47.291 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 17, 2024-03-16T07:25:47.291 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 3, 2024-03-16T07:25:47.292 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 61392, 2024-03-16T07:25:47.292 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 464, 2024-03-16T07:25:47.292 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 3, 2024-03-16T07:25:47.292 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 0, 2024-03-16T07:25:47.292 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 0.182132815, 2024-03-16T07:25:47.292 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.000941664, 2024-03-16T07:25:47.292 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 0.134994780, 2024-03-16T07:25:47.292 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.045859523, 2024-03-16T07:25:47.292 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T07:25:47.292 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 3, 2024-03-16T07:25:47.292 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.054357270, 2024-03-16T07:25:47.292 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.018119090 2024-03-16T07:25:47.292 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:25:47.293 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-03-16T07:25:47.293 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:25:47.293 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:25:47.293 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:25:47.293 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:25:47.293 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 61392, 2024-03-16T07:25:47.293 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 464 2024-03-16T07:25:47.293 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:25:47.293 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:25:47.293 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:25:47.293 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-2": [ 2024-03-16T07:25:47.293 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:25:47.293 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:25:47.294 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:25:47.294 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 9, 2024-03-16T07:25:47.294 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 6, 2024-03-16T07:25:47.294 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 96352, 2024-03-16T07:25:47.294 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 928, 2024-03-16T07:25:47.294 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 2, 2024-03-16T07:25:47.294 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 1, 2024-03-16T07:25:47.294 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 0.098190162, 2024-03-16T07:25:47.294 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.004035088, 2024-03-16T07:25:47.294 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 0.218109597, 2024-03-16T07:25:47.294 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-03-16T07:25:47.294 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T07:25:47.295 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 6, 2024-03-16T07:25:47.295 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.158362306, 2024-03-16T07:25:47.295 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.026393717 2024-03-16T07:25:47.295 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:25:47.295 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-03-16T07:25:47.295 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:25:47.295 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:25:47.295 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:25:47.295 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:25:47.295 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 96352, 2024-03-16T07:25:47.295 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 928 2024-03-16T07:25:47.295 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:25:47.295 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:25:47.295 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:25:47.296 INFO:teuthology.orchestra.run.smithi049.stdout: "cct": [ 2024-03-16T07:25:47.296 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:25:47.296 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:25:47.296 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:25:47.296 INFO:teuthology.orchestra.run.smithi049.stdout: "total_workers": 0, 2024-03-16T07:25:47.296 INFO:teuthology.orchestra.run.smithi049.stdout: "unhealthy_workers": 0 2024-03-16T07:25:47.296 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:25:47.296 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:25:47.296 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:25:47.296 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs_mirror": [ 2024-03-16T07:25:47.296 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:25:47.296 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:25:47.296 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:25:47.296 INFO:teuthology.orchestra.run.smithi049.stdout: "mirrored_filesystems": 0, 2024-03-16T07:25:47.297 INFO:teuthology.orchestra.run.smithi049.stdout: "mirror_enable_failures": 0 2024-03-16T07:25:47.297 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:25:47.297 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:25:47.297 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:25:47.297 INFO:teuthology.orchestra.run.smithi049.stdout: "mempool": [ 2024-03-16T07:25:47.297 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:25:47.297 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:25:47.297 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:25:47.297 INFO:teuthology.orchestra.run.smithi049.stdout: "bloom_filter_bytes": 0, 2024-03-16T07:25:47.297 INFO:teuthology.orchestra.run.smithi049.stdout: "bloom_filter_items": 0, 2024-03-16T07:25:47.297 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_alloc_bytes": 0, 2024-03-16T07:25:47.298 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_alloc_items": 0, 2024-03-16T07:25:47.298 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_data_bytes": 0, 2024-03-16T07:25:47.298 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_data_items": 0, 2024-03-16T07:25:47.298 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_onode_bytes": 0, 2024-03-16T07:25:47.298 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_onode_items": 0, 2024-03-16T07:25:47.298 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_meta_bytes": 0, 2024-03-16T07:25:47.298 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_meta_items": 0, 2024-03-16T07:25:47.298 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_other_bytes": 0, 2024-03-16T07:25:47.298 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_other_items": 0, 2024-03-16T07:25:47.298 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_buffer_bytes": 0, 2024-03-16T07:25:47.298 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_buffer_items": 0, 2024-03-16T07:25:47.299 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_extent_bytes": 0, 2024-03-16T07:25:47.299 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_extent_items": 0, 2024-03-16T07:25:47.299 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_blob_bytes": 0, 2024-03-16T07:25:47.299 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_blob_items": 0, 2024-03-16T07:25:47.299 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_shared_blob_bytes": 0, 2024-03-16T07:25:47.299 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_shared_blob_items": 0, 2024-03-16T07:25:47.299 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_inline_bl_bytes": 0, 2024-03-16T07:25:47.299 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_inline_bl_items": 0, 2024-03-16T07:25:47.299 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_fsck_bytes": 0, 2024-03-16T07:25:47.299 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_fsck_items": 0, 2024-03-16T07:25:47.299 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_txc_bytes": 0, 2024-03-16T07:25:47.300 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_txc_items": 0, 2024-03-16T07:25:47.300 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_deferred_bytes": 0, 2024-03-16T07:25:47.300 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_deferred_items": 0, 2024-03-16T07:25:47.300 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_bytes": 0, 2024-03-16T07:25:47.300 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_items": 0, 2024-03-16T07:25:47.300 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_bytes": 0, 2024-03-16T07:25:47.300 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_items": 0, 2024-03-16T07:25:47.300 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_reader_bytes": 0, 2024-03-16T07:25:47.300 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_reader_items": 0, 2024-03-16T07:25:47.300 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_writer_bytes": 0, 2024-03-16T07:25:47.300 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_writer_items": 0, 2024-03-16T07:25:47.300 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_anon_bytes": 148386, 2024-03-16T07:25:47.300 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_anon_items": 24, 2024-03-16T07:25:47.301 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_meta_bytes": 0, 2024-03-16T07:25:47.301 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_meta_items": 0, 2024-03-16T07:25:47.301 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_bytes": 0, 2024-03-16T07:25:47.301 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_items": 0, 2024-03-16T07:25:47.301 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_mapbl_bytes": 0, 2024-03-16T07:25:47.301 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_mapbl_items": 0, 2024-03-16T07:25:47.301 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pglog_bytes": 0, 2024-03-16T07:25:47.301 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pglog_items": 0, 2024-03-16T07:25:47.301 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_bytes": 4824, 2024-03-16T07:25:47.301 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_items": 52, 2024-03-16T07:25:47.301 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_mapping_bytes": 0, 2024-03-16T07:25:47.301 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_mapping_items": 0, 2024-03-16T07:25:47.301 INFO:teuthology.orchestra.run.smithi049.stdout: "pgmap_bytes": 0, 2024-03-16T07:25:47.301 INFO:teuthology.orchestra.run.smithi049.stdout: "pgmap_items": 0, 2024-03-16T07:25:47.302 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_co_bytes": 0, 2024-03-16T07:25:47.302 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_co_items": 0, 2024-03-16T07:25:47.302 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_1_bytes": 0, 2024-03-16T07:25:47.302 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_1_items": 0, 2024-03-16T07:25:47.302 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_2_bytes": 0, 2024-03-16T07:25:47.302 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_2_items": 0 2024-03-16T07:25:47.302 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:25:47.302 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:25:47.302 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:25:47.302 INFO:teuthology.orchestra.run.smithi049.stdout: "objecter": [ 2024-03-16T07:25:47.302 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:25:47.302 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:25:47.303 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:25:47.303 INFO:teuthology.orchestra.run.smithi049.stdout: "op_active": 0, 2024-03-16T07:25:47.303 INFO:teuthology.orchestra.run.smithi049.stdout: "op_laggy": 0, 2024-03-16T07:25:47.303 INFO:teuthology.orchestra.run.smithi049.stdout: "op_send": 0, 2024-03-16T07:25:47.303 INFO:teuthology.orchestra.run.smithi049.stdout: "op_send_bytes": 0, 2024-03-16T07:25:47.303 INFO:teuthology.orchestra.run.smithi049.stdout: "op_resend": 0, 2024-03-16T07:25:47.303 INFO:teuthology.orchestra.run.smithi049.stdout: "op_reply": 0, 2024-03-16T07:25:47.303 INFO:teuthology.orchestra.run.smithi049.stdout: "op_latency": { 2024-03-16T07:25:47.303 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:25:47.303 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:25:47.303 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:25:47.303 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:25:47.303 INFO:teuthology.orchestra.run.smithi049.stdout: "op_inflight": 0, 2024-03-16T07:25:47.304 INFO:teuthology.orchestra.run.smithi049.stdout: "oplen_avg": { 2024-03-16T07:25:47.304 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:25:47.304 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0 2024-03-16T07:25:47.304 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:25:47.304 INFO:teuthology.orchestra.run.smithi049.stdout: "op": 0, 2024-03-16T07:25:47.304 INFO:teuthology.orchestra.run.smithi049.stdout: "op_r": 0, 2024-03-16T07:25:47.304 INFO:teuthology.orchestra.run.smithi049.stdout: "op_w": 0, 2024-03-16T07:25:47.304 INFO:teuthology.orchestra.run.smithi049.stdout: "op_rmw": 0, 2024-03-16T07:25:47.304 INFO:teuthology.orchestra.run.smithi049.stdout: "op_pg": 0, 2024-03-16T07:25:47.304 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_stat": 0, 2024-03-16T07:25:47.304 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_create": 0, 2024-03-16T07:25:47.305 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_read": 0, 2024-03-16T07:25:47.305 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_write": 0, 2024-03-16T07:25:47.305 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_writefull": 0, 2024-03-16T07:25:47.305 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_writesame": 0, 2024-03-16T07:25:47.305 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_append": 0, 2024-03-16T07:25:47.305 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_zero": 0, 2024-03-16T07:25:47.305 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_truncate": 0, 2024-03-16T07:25:47.305 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_delete": 0, 2024-03-16T07:25:47.305 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_mapext": 0, 2024-03-16T07:25:47.305 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_sparse_read": 0, 2024-03-16T07:25:47.305 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_clonerange": 0, 2024-03-16T07:25:47.305 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_getxattr": 0, 2024-03-16T07:25:47.305 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_setxattr": 0, 2024-03-16T07:25:47.306 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_cmpxattr": 0, 2024-03-16T07:25:47.306 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_rmxattr": 0, 2024-03-16T07:25:47.306 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_resetxattrs": 0, 2024-03-16T07:25:47.306 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_call": 0, 2024-03-16T07:25:47.306 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_watch": 0, 2024-03-16T07:25:47.306 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_notify": 0, 2024-03-16T07:25:47.306 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_src_cmpxattr": 0, 2024-03-16T07:25:47.306 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_pgls": 0, 2024-03-16T07:25:47.306 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_pgls_filter": 0, 2024-03-16T07:25:47.306 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_other": 0, 2024-03-16T07:25:47.306 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_active": 0, 2024-03-16T07:25:47.307 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_send": 0, 2024-03-16T07:25:47.307 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_resend": 0, 2024-03-16T07:25:47.307 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_ping": 0, 2024-03-16T07:25:47.307 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_active": 0, 2024-03-16T07:25:47.307 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_send": 0, 2024-03-16T07:25:47.307 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_resend": 0, 2024-03-16T07:25:47.307 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_active": 0, 2024-03-16T07:25:47.307 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_send": 0, 2024-03-16T07:25:47.307 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_resend": 0, 2024-03-16T07:25:47.307 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_active": 0, 2024-03-16T07:25:47.307 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_send": 0, 2024-03-16T07:25:47.307 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_resend": 0, 2024-03-16T07:25:47.307 INFO:teuthology.orchestra.run.smithi049.stdout: "command_active": 0, 2024-03-16T07:25:47.308 INFO:teuthology.orchestra.run.smithi049.stdout: "command_send": 0, 2024-03-16T07:25:47.308 INFO:teuthology.orchestra.run.smithi049.stdout: "command_resend": 0, 2024-03-16T07:25:47.308 INFO:teuthology.orchestra.run.smithi049.stdout: "map_epoch": 0, 2024-03-16T07:25:47.308 INFO:teuthology.orchestra.run.smithi049.stdout: "map_full": 0, 2024-03-16T07:25:47.308 INFO:teuthology.orchestra.run.smithi049.stdout: "map_inc": 0, 2024-03-16T07:25:47.308 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_sessions": 0, 2024-03-16T07:25:47.308 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_session_open": 0, 2024-03-16T07:25:47.308 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_session_close": 0, 2024-03-16T07:25:47.308 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_laggy": 0, 2024-03-16T07:25:47.308 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_wr": 0, 2024-03-16T07:25:47.308 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_rd": 0, 2024-03-16T07:25:47.308 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_del": 0 2024-03-16T07:25:47.309 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:25:47.309 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:25:47.309 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:25:47.309 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-msgr_dispatch_throttler-client": [ 2024-03-16T07:25:47.309 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:25:47.309 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:25:47.309 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:25:47.309 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:25:47.309 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-03-16T07:25:47.309 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:25:47.309 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 17, 2024-03-16T07:25:47.309 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 59087, 2024-03-16T07:25:47.310 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:25:47.310 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 17, 2024-03-16T07:25:47.310 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:25:47.310 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:25:47.310 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 17, 2024-03-16T07:25:47.310 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 59087, 2024-03-16T07:25:47.310 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:25:47.310 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:25:47.310 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:25:47.310 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:25:47.310 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:25:47.310 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:25:47.311 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:25:47.311 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:25:47.311 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-msgr_dispatch_throttler-radosclient": [ 2024-03-16T07:25:47.311 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:25:47.311 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:25:47.311 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:25:47.311 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:25:47.311 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-03-16T07:25:47.311 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:25:47.311 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 7, 2024-03-16T07:25:47.311 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 94729, 2024-03-16T07:25:47.311 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:25:47.311 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 7, 2024-03-16T07:25:47.311 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:25:47.312 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:25:47.312 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 7, 2024-03-16T07:25:47.312 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 94729, 2024-03-16T07:25:47.312 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:25:47.312 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:25:47.312 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:25:47.312 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:25:47.312 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:25:47.312 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:25:47.312 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:25:47.312 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:25:47.312 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-objecter_bytes": [ 2024-03-16T07:25:47.312 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:25:47.312 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:25:47.313 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:25:47.313 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:25:47.313 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-03-16T07:25:47.313 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:25:47.313 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 0, 2024-03-16T07:25:47.313 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 0, 2024-03-16T07:25:47.313 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:25:47.313 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 0, 2024-03-16T07:25:47.313 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:25:47.313 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:25:47.313 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 0, 2024-03-16T07:25:47.313 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 0, 2024-03-16T07:25:47.313 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:25:47.314 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:25:47.314 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:25:47.314 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:25:47.314 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:25:47.314 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:25:47.314 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:25:47.314 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:25:47.314 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-objecter_ops": [ 2024-03-16T07:25:47.314 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:25:47.314 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:25:47.314 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:25:47.315 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:25:47.315 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 1024, 2024-03-16T07:25:47.315 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:25:47.315 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 0, 2024-03-16T07:25:47.315 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 0, 2024-03-16T07:25:47.315 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:25:47.315 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 0, 2024-03-16T07:25:47.315 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:25:47.315 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:25:47.315 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 0, 2024-03-16T07:25:47.315 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 0, 2024-03-16T07:25:47.315 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:25:47.315 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:25:47.316 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:25:47.316 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:25:47.316 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:25:47.316 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:25:47.316 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:25:47.316 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2024-03-16T07:25:47.316 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-03-16T07:25:47.317 DEBUG:tasks.cephfs.test_mirroring:command returned={ "AsyncMessenger::Worker": [ { "labels": { "id": "0" }, "counters": { "msgr_connection_ready_timeouts": 0, "msgr_connection_idle_timeouts": 0 } }, { "labels": { "id": "1" }, "counters": { "msgr_connection_ready_timeouts": 0, "msgr_connection_idle_timeouts": 0 } }, { "labels": { "id": "2" }, "counters": { "msgr_connection_ready_timeouts": 0, "msgr_connection_idle_timeouts": 0 } } ], "AsyncMessenger::Worker-0": [ { "labels": {}, "counters": { "msgr_recv_messages": 1, "msgr_send_messages": 8, "msgr_recv_bytes": 144, "msgr_send_bytes": 82000, "msgr_created_connections": 3, "msgr_active_connections": 1, "msgr_running_total_time": 0.137201596, "msgr_running_send_time": 0.021224087, "msgr_running_recv_time": 0.106250352, "msgr_running_fast_dispatch_time": 0.000000000, "msgr_send_messages_queue_lat": { "avgcount": 7, "sum": 0.112949457, "avgtime": 0.016135636 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "msgr_recv_encrypted_bytes": 144, "msgr_send_encrypted_bytes": 82000 } } ], "AsyncMessenger::Worker-1": [ { "labels": {}, "counters": { "msgr_recv_messages": 17, "msgr_send_messages": 3, "msgr_recv_bytes": 61392, "msgr_send_bytes": 464, "msgr_created_connections": 3, "msgr_active_connections": 0, "msgr_running_total_time": 0.182132815, "msgr_running_send_time": 0.000941664, "msgr_running_recv_time": 0.134994780, "msgr_running_fast_dispatch_time": 0.045859523, "msgr_send_messages_queue_lat": { "avgcount": 3, "sum": 0.054357270, "avgtime": 0.018119090 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "msgr_recv_encrypted_bytes": 61392, "msgr_send_encrypted_bytes": 464 } } ], "AsyncMessenger::Worker-2": [ { "labels": {}, "counters": { "msgr_recv_messages": 9, "msgr_send_messages": 6, "msgr_recv_bytes": 96352, "msgr_send_bytes": 928, "msgr_created_connections": 2, "msgr_active_connections": 1, "msgr_running_total_time": 0.098190162, "msgr_running_send_time": 0.004035088, "msgr_running_recv_time": 0.218109597, "msgr_running_fast_dispatch_time": 0.000000000, "msgr_send_messages_queue_lat": { "avgcount": 6, "sum": 0.158362306, "avgtime": 0.026393717 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "msgr_recv_encrypted_bytes": 96352, "msgr_send_encrypted_bytes": 928 } } ], "cct": [ { "labels": {}, "counters": { "total_workers": 0, "unhealthy_workers": 0 } } ], "cephfs_mirror": [ { "labels": {}, "counters": { "mirrored_filesystems": 0, "mirror_enable_failures": 0 } } ], "mempool": [ { "labels": {}, "counters": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_cache_buffer_bytes": 0, "bluestore_cache_buffer_items": 0, "bluestore_extent_bytes": 0, "bluestore_extent_items": 0, "bluestore_blob_bytes": 0, "bluestore_blob_items": 0, "bluestore_shared_blob_bytes": 0, "bluestore_shared_blob_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_items": 0, "bluefs_bytes": 0, "bluefs_items": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "buffer_anon_bytes": 148386, "buffer_anon_items": 24, "buffer_meta_bytes": 0, "buffer_meta_items": 0, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 4824, "osdmap_items": 52, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "mds_co_bytes": 0, "mds_co_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 } } ], "objecter": [ { "labels": {}, "counters": { "op_active": 0, "op_laggy": 0, "op_send": 0, "op_send_bytes": 0, "op_resend": 0, "op_reply": 0, "op_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "op_inflight": 0, "oplen_avg": { "avgcount": 0, "sum": 0 }, "op": 0, "op_r": 0, "op_w": 0, "op_rmw": 0, "op_pg": 0, "osdop_stat": 0, "osdop_create": 0, "osdop_read": 0, "osdop_write": 0, "osdop_writefull": 0, "osdop_writesame": 0, "osdop_append": 0, "osdop_zero": 0, "osdop_truncate": 0, "osdop_delete": 0, "osdop_mapext": 0, "osdop_sparse_read": 0, "osdop_clonerange": 0, "osdop_getxattr": 0, "osdop_setxattr": 0, "osdop_cmpxattr": 0, "osdop_rmxattr": 0, "osdop_resetxattrs": 0, "osdop_call": 0, "osdop_watch": 0, "osdop_notify": 0, "osdop_src_cmpxattr": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_other": 0, "linger_active": 0, "linger_send": 0, "linger_resend": 0, "linger_ping": 0, "poolop_active": 0, "poolop_send": 0, "poolop_resend": 0, "poolstat_active": 0, "poolstat_send": 0, "poolstat_resend": 0, "statfs_active": 0, "statfs_send": 0, "statfs_resend": 0, "command_active": 0, "command_send": 0, "command_resend": 0, "map_epoch": 0, "map_full": 0, "map_inc": 0, "osd_sessions": 0, "osd_session_open": 0, "osd_session_close": 0, "osd_laggy": 0, "omap_wr": 0, "omap_rd": 0, "omap_del": 0 } } ], "throttle-msgr_dispatch_throttler-client": [ { "labels": {}, "counters": { "val": 0, "max": 104857600, "get_started": 0, "get": 17, "get_sum": 59087, "get_or_fail_fail": 0, "get_or_fail_success": 17, "take": 0, "take_sum": 0, "put": 17, "put_sum": 59087, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ], "throttle-msgr_dispatch_throttler-radosclient": [ { "labels": {}, "counters": { "val": 0, "max": 104857600, "get_started": 0, "get": 7, "get_sum": 94729, "get_or_fail_fail": 0, "get_or_fail_success": 7, "take": 0, "take_sum": 0, "put": 7, "put_sum": 94729, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ], "throttle-objecter_bytes": [ { "labels": {}, "counters": { "val": 0, "max": 104857600, "get_started": 0, "get": 0, "get_sum": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "take": 0, "take_sum": 0, "put": 0, "put_sum": 0, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ], "throttle-objecter_ops": [ { "labels": {}, "counters": { "val": 0, "max": 1024, "get_started": 0, "get": 0, "get_sum": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "take": 0, "take_sum": 0, "put": 0, "put_sum": 0, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ] } 2024-03-16T07:25:47.318 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snapshot mirror enable cephfs 2024-03-16T07:25:47.337 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:25:47.338+0000 7fa316a12040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-16T07:25:47.425 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:25:47.426+0000 7fa316a12040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-16T07:25:47.918 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:25:47.918+0000 7fa316a12040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-16T07:25:47.986 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:25:47.987+0000 7fa316a12040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-16T07:25:48.065 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:25:48.066+0000 7fa316a12040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-16T07:25:48.124 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:25:48.125+0000 7fa316a12040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-16T07:25:48.168 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:25:48.168+0000 7fa316a12040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-16T07:25:48.314 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:25:48.314+0000 7fa316a12040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-16T07:25:48.370 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:25:48.370+0000 7fa316a12040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-16T07:25:48.415 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:25:48.415+0000 7fa316a12040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-16T07:25:48.497 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:25:48.498+0000 7fa316a12040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-16T07:25:48.554 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:25:48.555+0000 7fa316a12040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-16T07:25:48.970 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:25:48.971+0000 7fa316a12040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-16T07:25:49.108 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:25:49.109+0000 7fa316a12040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-16T07:25:49.205 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:25:49.206+0000 7fa316a12040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-16T07:25:49.251 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:25:49.252+0000 7fa316a12040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-16T07:25:49.367 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:25:49.368+0000 7fa316a12040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-16T07:25:49.463 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:25:49.464+0000 7fa316a12040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-16T07:25:49.661 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:25:49.662+0000 7fa316a12040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-16T07:25:49.705 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:25:49.706+0000 7fa316a12040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-16T07:25:49.835 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:25:49.835+0000 7fa316a12040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-16T07:25:50.601 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:25:50.602+0000 7fa316a12040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-16T07:25:50.929 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:25:50.930+0000 7fa316a12040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-16T07:25:51.019 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:25:51.020+0000 7fa316a12040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-16T07:25:51.155 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:25:51.156+0000 7fa316a12040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-16T07:25:51.246 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:25:51.246+0000 7fa29625f640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:25:51.246 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:25:51.246+0000 7fa29625f640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:25:51.246 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:25:51.246+0000 7fa29625f640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:25:51.246 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:25:51.246+0000 7fa29625f640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:25:51.246 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:25:51.246+0000 7fa29625f640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:25:51.247 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:25:51.247+0000 7fa293259640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:25:51.247 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:25:51.247+0000 7fa293259640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:25:51.247 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:25:51.247+0000 7fa293259640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:25:51.247 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:25:51.247+0000 7fa293259640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:25:51.247 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:25:51.247+0000 7fa293259640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:25:51.260 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:25:51.261+0000 7fa29625f640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:25:51.260 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:25:51.261+0000 7fa29625f640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:25:51.260 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:25:51.261+0000 7fa29625f640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:25:51.260 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:25:51.261+0000 7fa29625f640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:25:51.260 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:25:51.261+0000 7fa29625f640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:25:51.261 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:25:51.262+0000 7fa293259640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:25:51.262 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:25:51.262+0000 7fa293259640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:25:51.262 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:25:51.262+0000 7fa293259640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:25:51.262 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:25:51.262+0000 7fa293259640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:25:51.262 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:25:51.262+0000 7fa293259640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:25:53.180 INFO:teuthology.orchestra.run.smithi049.stdout:{} 2024-03-16T07:26:03.196 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-03-16T07:26:03.196 DEBUG:teuthology.orchestra.run.smithi049:mirror status for fs: cephfs> ceph --admin-daemon /var/run/ceph/cephfs-mirror.asok fs mirror status cephfs@2 2024-03-16T07:26:03.318 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-03-16T07:26:03.318 INFO:teuthology.orchestra.run.smithi049.stdout: "rados_inst": "172.21.15.49:0/3295617512", 2024-03-16T07:26:03.318 INFO:teuthology.orchestra.run.smithi049.stdout: "peers": {}, 2024-03-16T07:26:03.318 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_dirs": { 2024-03-16T07:26:03.318 INFO:teuthology.orchestra.run.smithi049.stdout: "dir_count": 0 2024-03-16T07:26:03.318 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:03.318 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-03-16T07:26:03.328 DEBUG:tasks.cephfs.test_mirroring:command returned={ "rados_inst": "172.21.15.49:0/3295617512", "peers": {}, "snap_dirs": { "dir_count": 0 } } 2024-03-16T07:26:03.328 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-03-16T07:26:03.329 DEBUG:teuthology.orchestra.run.smithi049:counter dump for fs: cephfs> ceph --admin-daemon /var/run/ceph/cephfs-mirror.asok counter dump 2024-03-16T07:26:03.432 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-03-16T07:26:03.432 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker": [ 2024-03-16T07:26:03.432 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:26:03.432 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:26:03.432 INFO:teuthology.orchestra.run.smithi049.stdout: "id": "0" 2024-03-16T07:26:03.432 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:26:03.432 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:26:03.432 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_ready_timeouts": 0, 2024-03-16T07:26:03.432 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_idle_timeouts": 0 2024-03-16T07:26:03.432 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:03.432 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:26:03.433 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:26:03.433 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:26:03.433 INFO:teuthology.orchestra.run.smithi049.stdout: "id": "1" 2024-03-16T07:26:03.433 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:26:03.433 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:26:03.433 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_ready_timeouts": 0, 2024-03-16T07:26:03.433 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_idle_timeouts": 0 2024-03-16T07:26:03.433 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:03.433 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:26:03.433 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:26:03.433 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:26:03.433 INFO:teuthology.orchestra.run.smithi049.stdout: "id": "2" 2024-03-16T07:26:03.433 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:26:03.433 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:26:03.433 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_ready_timeouts": 0, 2024-03-16T07:26:03.433 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_idle_timeouts": 0 2024-03-16T07:26:03.433 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:03.434 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:03.434 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:26:03.434 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-0": [ 2024-03-16T07:26:03.434 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:26:03.434 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:26:03.434 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:26:03.434 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 2, 2024-03-16T07:26:03.434 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 12, 2024-03-16T07:26:03.434 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 288, 2024-03-16T07:26:03.434 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 161648, 2024-03-16T07:26:03.434 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 4, 2024-03-16T07:26:03.434 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 2, 2024-03-16T07:26:03.434 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 0.158603971, 2024-03-16T07:26:03.434 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.032185955, 2024-03-16T07:26:03.435 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 0.111513973, 2024-03-16T07:26:03.435 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-03-16T07:26:03.435 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T07:26:03.435 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 11, 2024-03-16T07:26:03.435 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.119393333, 2024-03-16T07:26:03.435 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.010853939 2024-03-16T07:26:03.435 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:26:03.435 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-03-16T07:26:03.435 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:26:03.435 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:26:03.435 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:26:03.435 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:26:03.435 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 288, 2024-03-16T07:26:03.435 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 161648 2024-03-16T07:26:03.435 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:03.435 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:03.436 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:26:03.436 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-1": [ 2024-03-16T07:26:03.436 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:26:03.436 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:26:03.436 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:26:03.436 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 18, 2024-03-16T07:26:03.436 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 3, 2024-03-16T07:26:03.436 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 66272, 2024-03-16T07:26:03.436 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 464, 2024-03-16T07:26:03.436 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 3, 2024-03-16T07:26:03.436 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 0, 2024-03-16T07:26:03.436 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 0.199810103, 2024-03-16T07:26:03.436 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.001089857, 2024-03-16T07:26:03.436 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 0.137530807, 2024-03-16T07:26:03.436 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.060245166, 2024-03-16T07:26:03.436 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T07:26:03.437 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 3, 2024-03-16T07:26:03.437 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.054357270, 2024-03-16T07:26:03.437 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.018119090 2024-03-16T07:26:03.437 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:26:03.437 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-03-16T07:26:03.437 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:26:03.437 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:26:03.437 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:26:03.437 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:26:03.437 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 66272, 2024-03-16T07:26:03.437 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 464 2024-03-16T07:26:03.437 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:03.437 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:03.437 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:26:03.437 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-2": [ 2024-03-16T07:26:03.437 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:26:03.437 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:26:03.438 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:26:03.438 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 13, 2024-03-16T07:26:03.438 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 6, 2024-03-16T07:26:03.438 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 278496, 2024-03-16T07:26:03.438 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 928, 2024-03-16T07:26:03.438 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 2, 2024-03-16T07:26:03.438 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 1, 2024-03-16T07:26:03.438 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 0.191353593, 2024-03-16T07:26:03.438 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.004133027, 2024-03-16T07:26:03.438 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 0.385824647, 2024-03-16T07:26:03.438 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-03-16T07:26:03.438 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T07:26:03.438 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 6, 2024-03-16T07:26:03.438 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.158362306, 2024-03-16T07:26:03.438 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.026393717 2024-03-16T07:26:03.439 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:26:03.439 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-03-16T07:26:03.439 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:26:03.439 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:26:03.439 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:26:03.439 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:26:03.439 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 278496, 2024-03-16T07:26:03.439 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 928 2024-03-16T07:26:03.439 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:03.439 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:03.439 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:26:03.439 INFO:teuthology.orchestra.run.smithi049.stdout: "cct": [ 2024-03-16T07:26:03.439 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:26:03.439 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:26:03.439 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:26:03.439 INFO:teuthology.orchestra.run.smithi049.stdout: "total_workers": 0, 2024-03-16T07:26:03.440 INFO:teuthology.orchestra.run.smithi049.stdout: "unhealthy_workers": 0 2024-03-16T07:26:03.440 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:03.440 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:03.440 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:26:03.440 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs_mirror": [ 2024-03-16T07:26:03.440 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:26:03.440 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:26:03.440 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:26:03.440 INFO:teuthology.orchestra.run.smithi049.stdout: "mirrored_filesystems": 1, 2024-03-16T07:26:03.440 INFO:teuthology.orchestra.run.smithi049.stdout: "mirror_enable_failures": 0 2024-03-16T07:26:03.440 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:03.440 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:03.440 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:26:03.440 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs_mirror_mirrored_filesystems": [ 2024-03-16T07:26:03.440 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:26:03.440 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:26:03.441 INFO:teuthology.orchestra.run.smithi049.stdout: "filesystem": "cephfs" 2024-03-16T07:26:03.441 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:26:03.441 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:26:03.441 INFO:teuthology.orchestra.run.smithi049.stdout: "mirroring_peers": 0, 2024-03-16T07:26:03.441 INFO:teuthology.orchestra.run.smithi049.stdout: "directory_count": 0 2024-03-16T07:26:03.441 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:03.441 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:03.441 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:26:03.441 INFO:teuthology.orchestra.run.smithi049.stdout: "mempool": [ 2024-03-16T07:26:03.441 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:26:03.441 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:26:03.441 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:26:03.441 INFO:teuthology.orchestra.run.smithi049.stdout: "bloom_filter_bytes": 0, 2024-03-16T07:26:03.441 INFO:teuthology.orchestra.run.smithi049.stdout: "bloom_filter_items": 0, 2024-03-16T07:26:03.441 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_alloc_bytes": 0, 2024-03-16T07:26:03.441 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_alloc_items": 0, 2024-03-16T07:26:03.441 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_data_bytes": 0, 2024-03-16T07:26:03.442 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_data_items": 0, 2024-03-16T07:26:03.442 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_onode_bytes": 0, 2024-03-16T07:26:03.442 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_onode_items": 0, 2024-03-16T07:26:03.442 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_meta_bytes": 0, 2024-03-16T07:26:03.442 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_meta_items": 0, 2024-03-16T07:26:03.442 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_other_bytes": 0, 2024-03-16T07:26:03.442 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_other_items": 0, 2024-03-16T07:26:03.442 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_buffer_bytes": 0, 2024-03-16T07:26:03.442 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_buffer_items": 0, 2024-03-16T07:26:03.442 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_extent_bytes": 0, 2024-03-16T07:26:03.442 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_extent_items": 0, 2024-03-16T07:26:03.442 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_blob_bytes": 0, 2024-03-16T07:26:03.442 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_blob_items": 0, 2024-03-16T07:26:03.442 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_shared_blob_bytes": 0, 2024-03-16T07:26:03.442 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_shared_blob_items": 0, 2024-03-16T07:26:03.442 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_inline_bl_bytes": 0, 2024-03-16T07:26:03.443 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_inline_bl_items": 0, 2024-03-16T07:26:03.443 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_fsck_bytes": 0, 2024-03-16T07:26:03.443 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_fsck_items": 0, 2024-03-16T07:26:03.443 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_txc_bytes": 0, 2024-03-16T07:26:03.443 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_txc_items": 0, 2024-03-16T07:26:03.443 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_deferred_bytes": 0, 2024-03-16T07:26:03.443 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_deferred_items": 0, 2024-03-16T07:26:03.443 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_bytes": 0, 2024-03-16T07:26:03.443 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_items": 0, 2024-03-16T07:26:03.443 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_bytes": 0, 2024-03-16T07:26:03.443 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_items": 0, 2024-03-16T07:26:03.443 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_reader_bytes": 0, 2024-03-16T07:26:03.443 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_reader_items": 0, 2024-03-16T07:26:03.443 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_writer_bytes": 0, 2024-03-16T07:26:03.443 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_writer_items": 0, 2024-03-16T07:26:03.443 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_anon_bytes": 182719, 2024-03-16T07:26:03.443 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_anon_items": 53, 2024-03-16T07:26:03.444 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_meta_bytes": 0, 2024-03-16T07:26:03.444 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_meta_items": 0, 2024-03-16T07:26:03.444 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_bytes": 0, 2024-03-16T07:26:03.444 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_items": 0, 2024-03-16T07:26:03.444 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_mapbl_bytes": 0, 2024-03-16T07:26:03.444 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_mapbl_items": 0, 2024-03-16T07:26:03.444 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pglog_bytes": 0, 2024-03-16T07:26:03.444 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pglog_items": 0, 2024-03-16T07:26:03.444 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_bytes": 18440, 2024-03-16T07:26:03.444 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_items": 176, 2024-03-16T07:26:03.444 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_mapping_bytes": 0, 2024-03-16T07:26:03.444 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_mapping_items": 0, 2024-03-16T07:26:03.444 INFO:teuthology.orchestra.run.smithi049.stdout: "pgmap_bytes": 0, 2024-03-16T07:26:03.444 INFO:teuthology.orchestra.run.smithi049.stdout: "pgmap_items": 0, 2024-03-16T07:26:03.444 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_co_bytes": 0, 2024-03-16T07:26:03.444 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_co_items": 0, 2024-03-16T07:26:03.445 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_1_bytes": 0, 2024-03-16T07:26:03.445 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_1_items": 0, 2024-03-16T07:26:03.445 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_2_bytes": 0, 2024-03-16T07:26:03.445 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_2_items": 0 2024-03-16T07:26:03.445 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:03.445 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:03.445 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:26:03.445 INFO:teuthology.orchestra.run.smithi049.stdout: "objecter": [ 2024-03-16T07:26:03.445 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:26:03.445 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:26:03.445 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:26:03.445 INFO:teuthology.orchestra.run.smithi049.stdout: "op_active": 0, 2024-03-16T07:26:03.445 INFO:teuthology.orchestra.run.smithi049.stdout: "op_laggy": 0, 2024-03-16T07:26:03.445 INFO:teuthology.orchestra.run.smithi049.stdout: "op_send": 0, 2024-03-16T07:26:03.445 INFO:teuthology.orchestra.run.smithi049.stdout: "op_send_bytes": 0, 2024-03-16T07:26:03.445 INFO:teuthology.orchestra.run.smithi049.stdout: "op_resend": 0, 2024-03-16T07:26:03.445 INFO:teuthology.orchestra.run.smithi049.stdout: "op_reply": 0, 2024-03-16T07:26:03.446 INFO:teuthology.orchestra.run.smithi049.stdout: "op_latency": { 2024-03-16T07:26:03.446 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:26:03.446 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:26:03.446 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:26:03.446 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:26:03.446 INFO:teuthology.orchestra.run.smithi049.stdout: "op_inflight": 0, 2024-03-16T07:26:03.446 INFO:teuthology.orchestra.run.smithi049.stdout: "oplen_avg": { 2024-03-16T07:26:03.446 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:26:03.446 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0 2024-03-16T07:26:03.446 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:26:03.446 INFO:teuthology.orchestra.run.smithi049.stdout: "op": 0, 2024-03-16T07:26:03.446 INFO:teuthology.orchestra.run.smithi049.stdout: "op_r": 0, 2024-03-16T07:26:03.446 INFO:teuthology.orchestra.run.smithi049.stdout: "op_w": 0, 2024-03-16T07:26:03.446 INFO:teuthology.orchestra.run.smithi049.stdout: "op_rmw": 0, 2024-03-16T07:26:03.446 INFO:teuthology.orchestra.run.smithi049.stdout: "op_pg": 0, 2024-03-16T07:26:03.446 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_stat": 0, 2024-03-16T07:26:03.447 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_create": 0, 2024-03-16T07:26:03.447 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_read": 0, 2024-03-16T07:26:03.447 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_write": 0, 2024-03-16T07:26:03.447 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_writefull": 0, 2024-03-16T07:26:03.447 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_writesame": 0, 2024-03-16T07:26:03.447 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_append": 0, 2024-03-16T07:26:03.447 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_zero": 0, 2024-03-16T07:26:03.447 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_truncate": 0, 2024-03-16T07:26:03.447 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_delete": 0, 2024-03-16T07:26:03.447 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_mapext": 0, 2024-03-16T07:26:03.447 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_sparse_read": 0, 2024-03-16T07:26:03.447 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_clonerange": 0, 2024-03-16T07:26:03.447 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_getxattr": 0, 2024-03-16T07:26:03.447 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_setxattr": 0, 2024-03-16T07:26:03.447 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_cmpxattr": 0, 2024-03-16T07:26:03.447 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_rmxattr": 0, 2024-03-16T07:26:03.448 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_resetxattrs": 0, 2024-03-16T07:26:03.448 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_call": 0, 2024-03-16T07:26:03.448 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_watch": 0, 2024-03-16T07:26:03.448 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_notify": 0, 2024-03-16T07:26:03.448 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_src_cmpxattr": 0, 2024-03-16T07:26:03.448 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_pgls": 0, 2024-03-16T07:26:03.448 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_pgls_filter": 0, 2024-03-16T07:26:03.448 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_other": 0, 2024-03-16T07:26:03.448 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_active": 0, 2024-03-16T07:26:03.448 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_send": 0, 2024-03-16T07:26:03.448 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_resend": 0, 2024-03-16T07:26:03.448 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_ping": 0, 2024-03-16T07:26:03.448 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_active": 0, 2024-03-16T07:26:03.448 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_send": 0, 2024-03-16T07:26:03.449 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_resend": 0, 2024-03-16T07:26:03.449 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_active": 0, 2024-03-16T07:26:03.449 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_send": 0, 2024-03-16T07:26:03.449 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_resend": 0, 2024-03-16T07:26:03.449 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_active": 0, 2024-03-16T07:26:03.449 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_send": 0, 2024-03-16T07:26:03.449 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_resend": 0, 2024-03-16T07:26:03.449 INFO:teuthology.orchestra.run.smithi049.stdout: "command_active": 0, 2024-03-16T07:26:03.449 INFO:teuthology.orchestra.run.smithi049.stdout: "command_send": 0, 2024-03-16T07:26:03.449 INFO:teuthology.orchestra.run.smithi049.stdout: "command_resend": 0, 2024-03-16T07:26:03.449 INFO:teuthology.orchestra.run.smithi049.stdout: "map_epoch": 0, 2024-03-16T07:26:03.449 INFO:teuthology.orchestra.run.smithi049.stdout: "map_full": 0, 2024-03-16T07:26:03.449 INFO:teuthology.orchestra.run.smithi049.stdout: "map_inc": 0, 2024-03-16T07:26:03.449 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_sessions": 0, 2024-03-16T07:26:03.449 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_session_open": 0, 2024-03-16T07:26:03.450 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_session_close": 0, 2024-03-16T07:26:03.450 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_laggy": 0, 2024-03-16T07:26:03.450 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_wr": 0, 2024-03-16T07:26:03.450 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_rd": 0, 2024-03-16T07:26:03.450 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_del": 0 2024-03-16T07:26:03.450 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:03.450 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:03.450 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:26:03.450 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-msgr_dispatch_throttler-client": [ 2024-03-16T07:26:03.450 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:26:03.450 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:26:03.450 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:26:03.450 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:26:03.450 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-03-16T07:26:03.451 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:26:03.451 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 18, 2024-03-16T07:26:03.451 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 63833, 2024-03-16T07:26:03.451 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:26:03.451 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 18, 2024-03-16T07:26:03.451 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:26:03.451 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:26:03.451 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 18, 2024-03-16T07:26:03.451 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 63833, 2024-03-16T07:26:03.451 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:26:03.451 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:26:03.451 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:26:03.451 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:26:03.451 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:03.451 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:03.451 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:03.452 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:26:03.452 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-msgr_dispatch_throttler-radosclient": [ 2024-03-16T07:26:03.452 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:26:03.452 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:26:03.452 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:26:03.452 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:26:03.452 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-03-16T07:26:03.452 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:26:03.452 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 12, 2024-03-16T07:26:03.452 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 276329, 2024-03-16T07:26:03.452 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:26:03.452 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 12, 2024-03-16T07:26:03.452 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:26:03.452 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:26:03.452 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 12, 2024-03-16T07:26:03.452 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 276329, 2024-03-16T07:26:03.453 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:26:03.453 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:26:03.453 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:26:03.453 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:26:03.453 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:03.453 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:03.453 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:03.453 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:26:03.453 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-objecter_bytes": [ 2024-03-16T07:26:03.453 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:26:03.453 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:26:03.453 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:26:03.453 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:26:03.453 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-03-16T07:26:03.453 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:26:03.453 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 0, 2024-03-16T07:26:03.453 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 0, 2024-03-16T07:26:03.454 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:26:03.454 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 0, 2024-03-16T07:26:03.454 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:26:03.454 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:26:03.454 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 0, 2024-03-16T07:26:03.454 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 0, 2024-03-16T07:26:03.454 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:26:03.454 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:26:03.454 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:26:03.454 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:26:03.454 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:03.454 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:03.454 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:03.454 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:26:03.454 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-objecter_ops": [ 2024-03-16T07:26:03.455 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:26:03.455 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:26:03.455 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:26:03.455 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:26:03.455 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 1024, 2024-03-16T07:26:03.455 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:26:03.455 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 0, 2024-03-16T07:26:03.455 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 0, 2024-03-16T07:26:03.455 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:26:03.455 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 0, 2024-03-16T07:26:03.455 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:26:03.455 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:26:03.455 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 0, 2024-03-16T07:26:03.455 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 0, 2024-03-16T07:26:03.455 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:26:03.455 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:26:03.455 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:26:03.456 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:26:03.456 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:03.456 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:03.456 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:03.456 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2024-03-16T07:26:03.456 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-03-16T07:26:03.457 DEBUG:tasks.cephfs.test_mirroring:command returned={ "AsyncMessenger::Worker": [ { "labels": { "id": "0" }, "counters": { "msgr_connection_ready_timeouts": 0, "msgr_connection_idle_timeouts": 0 } }, { "labels": { "id": "1" }, "counters": { "msgr_connection_ready_timeouts": 0, "msgr_connection_idle_timeouts": 0 } }, { "labels": { "id": "2" }, "counters": { "msgr_connection_ready_timeouts": 0, "msgr_connection_idle_timeouts": 0 } } ], "AsyncMessenger::Worker-0": [ { "labels": {}, "counters": { "msgr_recv_messages": 2, "msgr_send_messages": 12, "msgr_recv_bytes": 288, "msgr_send_bytes": 161648, "msgr_created_connections": 4, "msgr_active_connections": 2, "msgr_running_total_time": 0.158603971, "msgr_running_send_time": 0.032185955, "msgr_running_recv_time": 0.111513973, "msgr_running_fast_dispatch_time": 0.000000000, "msgr_send_messages_queue_lat": { "avgcount": 11, "sum": 0.119393333, "avgtime": 0.010853939 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "msgr_recv_encrypted_bytes": 288, "msgr_send_encrypted_bytes": 161648 } } ], "AsyncMessenger::Worker-1": [ { "labels": {}, "counters": { "msgr_recv_messages": 18, "msgr_send_messages": 3, "msgr_recv_bytes": 66272, "msgr_send_bytes": 464, "msgr_created_connections": 3, "msgr_active_connections": 0, "msgr_running_total_time": 0.199810103, "msgr_running_send_time": 0.001089857, "msgr_running_recv_time": 0.137530807, "msgr_running_fast_dispatch_time": 0.060245166, "msgr_send_messages_queue_lat": { "avgcount": 3, "sum": 0.054357270, "avgtime": 0.018119090 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "msgr_recv_encrypted_bytes": 66272, "msgr_send_encrypted_bytes": 464 } } ], "AsyncMessenger::Worker-2": [ { "labels": {}, "counters": { "msgr_recv_messages": 13, "msgr_send_messages": 6, "msgr_recv_bytes": 278496, "msgr_send_bytes": 928, "msgr_created_connections": 2, "msgr_active_connections": 1, "msgr_running_total_time": 0.191353593, "msgr_running_send_time": 0.004133027, "msgr_running_recv_time": 0.385824647, "msgr_running_fast_dispatch_time": 0.000000000, "msgr_send_messages_queue_lat": { "avgcount": 6, "sum": 0.158362306, "avgtime": 0.026393717 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "msgr_recv_encrypted_bytes": 278496, "msgr_send_encrypted_bytes": 928 } } ], "cct": [ { "labels": {}, "counters": { "total_workers": 0, "unhealthy_workers": 0 } } ], "cephfs_mirror": [ { "labels": {}, "counters": { "mirrored_filesystems": 1, "mirror_enable_failures": 0 } } ], "cephfs_mirror_mirrored_filesystems": [ { "labels": { "filesystem": "cephfs" }, "counters": { "mirroring_peers": 0, "directory_count": 0 } } ], "mempool": [ { "labels": {}, "counters": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_cache_buffer_bytes": 0, "bluestore_cache_buffer_items": 0, "bluestore_extent_bytes": 0, "bluestore_extent_items": 0, "bluestore_blob_bytes": 0, "bluestore_blob_items": 0, "bluestore_shared_blob_bytes": 0, "bluestore_shared_blob_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_items": 0, "bluefs_bytes": 0, "bluefs_items": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "buffer_anon_bytes": 182719, "buffer_anon_items": 53, "buffer_meta_bytes": 0, "buffer_meta_items": 0, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 18440, "osdmap_items": 176, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "mds_co_bytes": 0, "mds_co_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 } } ], "objecter": [ { "labels": {}, "counters": { "op_active": 0, "op_laggy": 0, "op_send": 0, "op_send_bytes": 0, "op_resend": 0, "op_reply": 0, "op_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "op_inflight": 0, "oplen_avg": { "avgcount": 0, "sum": 0 }, "op": 0, "op_r": 0, "op_w": 0, "op_rmw": 0, "op_pg": 0, "osdop_stat": 0, "osdop_create": 0, "osdop_read": 0, "osdop_write": 0, "osdop_writefull": 0, "osdop_writesame": 0, "osdop_append": 0, "osdop_zero": 0, "osdop_truncate": 0, "osdop_delete": 0, "osdop_mapext": 0, "osdop_sparse_read": 0, "osdop_clonerange": 0, "osdop_getxattr": 0, "osdop_setxattr": 0, "osdop_cmpxattr": 0, "osdop_rmxattr": 0, "osdop_resetxattrs": 0, "osdop_call": 0, "osdop_watch": 0, "osdop_notify": 0, "osdop_src_cmpxattr": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_other": 0, "linger_active": 0, "linger_send": 0, "linger_resend": 0, "linger_ping": 0, "poolop_active": 0, "poolop_send": 0, "poolop_resend": 0, "poolstat_active": 0, "poolstat_send": 0, "poolstat_resend": 0, "statfs_active": 0, "statfs_send": 0, "statfs_resend": 0, "command_active": 0, "command_send": 0, "command_resend": 0, "map_epoch": 0, "map_full": 0, "map_inc": 0, "osd_sessions": 0, "osd_session_open": 0, "osd_session_close": 0, "osd_laggy": 0, "omap_wr": 0, "omap_rd": 0, "omap_del": 0 } } ], "throttle-msgr_dispatch_throttler-client": [ { "labels": {}, "counters": { "val": 0, "max": 104857600, "get_started": 0, "get": 18, "get_sum": 63833, "get_or_fail_fail": 0, "get_or_fail_success": 18, "take": 0, "take_sum": 0, "put": 18, "put_sum": 63833, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ], "throttle-msgr_dispatch_throttler-radosclient": [ { "labels": {}, "counters": { "val": 0, "max": 104857600, "get_started": 0, "get": 12, "get_sum": 276329, "get_or_fail_fail": 0, "get_or_fail_success": 12, "take": 0, "take_sum": 0, "put": 12, "put_sum": 276329, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ], "throttle-objecter_bytes": [ { "labels": {}, "counters": { "val": 0, "max": 104857600, "get_started": 0, "get": 0, "get_sum": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "take": 0, "take_sum": 0, "put": 0, "put_sum": 0, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ], "throttle-objecter_ops": [ { "labels": {}, "counters": { "val": 0, "max": 1024, "get_started": 0, "get": 0, "get_sum": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "take": 0, "take_sum": 0, "put": 0, "put_sum": 0, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ] } 2024-03-16T07:26:03.457 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-03-16T07:26:03.457 DEBUG:teuthology.orchestra.run.smithi049:counter dump for fs: cephfs> ceph --admin-daemon /var/run/ceph/cephfs-mirror.asok counter dump 2024-03-16T07:26:03.567 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-03-16T07:26:03.567 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker": [ 2024-03-16T07:26:03.567 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:26:03.567 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:26:03.567 INFO:teuthology.orchestra.run.smithi049.stdout: "id": "0" 2024-03-16T07:26:03.567 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:26:03.567 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:26:03.567 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_ready_timeouts": 0, 2024-03-16T07:26:03.567 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_idle_timeouts": 0 2024-03-16T07:26:03.567 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:03.567 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:26:03.567 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:26:03.568 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:26:03.568 INFO:teuthology.orchestra.run.smithi049.stdout: "id": "1" 2024-03-16T07:26:03.568 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:26:03.568 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:26:03.568 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_ready_timeouts": 0, 2024-03-16T07:26:03.568 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_idle_timeouts": 0 2024-03-16T07:26:03.568 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:03.568 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:26:03.568 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:26:03.568 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:26:03.568 INFO:teuthology.orchestra.run.smithi049.stdout: "id": "2" 2024-03-16T07:26:03.568 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:26:03.568 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:26:03.568 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_ready_timeouts": 0, 2024-03-16T07:26:03.568 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_idle_timeouts": 0 2024-03-16T07:26:03.569 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:03.569 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:03.569 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:26:03.569 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-0": [ 2024-03-16T07:26:03.569 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:26:03.569 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:26:03.569 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:26:03.569 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 2, 2024-03-16T07:26:03.569 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 12, 2024-03-16T07:26:03.569 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 288, 2024-03-16T07:26:03.569 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 161648, 2024-03-16T07:26:03.569 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 4, 2024-03-16T07:26:03.569 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 2, 2024-03-16T07:26:03.569 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 0.158603971, 2024-03-16T07:26:03.569 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.032185955, 2024-03-16T07:26:03.570 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 0.111513973, 2024-03-16T07:26:03.570 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-03-16T07:26:03.570 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T07:26:03.570 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 11, 2024-03-16T07:26:03.570 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.119393333, 2024-03-16T07:26:03.570 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.010853939 2024-03-16T07:26:03.570 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:26:03.570 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-03-16T07:26:03.570 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:26:03.570 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:26:03.570 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:26:03.570 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:26:03.570 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 288, 2024-03-16T07:26:03.570 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 161648 2024-03-16T07:26:03.571 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:03.571 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:03.571 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:26:03.571 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-1": [ 2024-03-16T07:26:03.571 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:26:03.571 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:26:03.571 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:26:03.571 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 18, 2024-03-16T07:26:03.571 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 3, 2024-03-16T07:26:03.571 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 66272, 2024-03-16T07:26:03.571 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 464, 2024-03-16T07:26:03.571 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 3, 2024-03-16T07:26:03.571 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 0, 2024-03-16T07:26:03.571 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 0.199810103, 2024-03-16T07:26:03.571 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.001089857, 2024-03-16T07:26:03.571 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 0.137530807, 2024-03-16T07:26:03.571 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.060245166, 2024-03-16T07:26:03.572 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T07:26:03.572 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 3, 2024-03-16T07:26:03.572 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.054357270, 2024-03-16T07:26:03.572 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.018119090 2024-03-16T07:26:03.572 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:26:03.572 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-03-16T07:26:03.572 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:26:03.572 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:26:03.572 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:26:03.572 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:26:03.572 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 66272, 2024-03-16T07:26:03.572 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 464 2024-03-16T07:26:03.572 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:03.572 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:03.572 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:26:03.572 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-2": [ 2024-03-16T07:26:03.573 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:26:03.573 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:26:03.573 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:26:03.573 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 13, 2024-03-16T07:26:03.573 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 6, 2024-03-16T07:26:03.573 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 278496, 2024-03-16T07:26:03.573 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 928, 2024-03-16T07:26:03.573 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 2, 2024-03-16T07:26:03.573 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 1, 2024-03-16T07:26:03.573 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 0.191353593, 2024-03-16T07:26:03.573 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.004133027, 2024-03-16T07:26:03.573 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 0.385824647, 2024-03-16T07:26:03.573 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-03-16T07:26:03.573 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T07:26:03.573 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 6, 2024-03-16T07:26:03.573 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.158362306, 2024-03-16T07:26:03.574 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.026393717 2024-03-16T07:26:03.574 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:26:03.574 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-03-16T07:26:03.574 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:26:03.574 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:26:03.574 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:26:03.574 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:26:03.574 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 278496, 2024-03-16T07:26:03.574 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 928 2024-03-16T07:26:03.574 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:03.574 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:03.574 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:26:03.574 INFO:teuthology.orchestra.run.smithi049.stdout: "cct": [ 2024-03-16T07:26:03.574 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:26:03.574 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:26:03.575 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:26:03.575 INFO:teuthology.orchestra.run.smithi049.stdout: "total_workers": 0, 2024-03-16T07:26:03.575 INFO:teuthology.orchestra.run.smithi049.stdout: "unhealthy_workers": 0 2024-03-16T07:26:03.575 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:03.575 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:03.575 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:26:03.575 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs_mirror": [ 2024-03-16T07:26:03.575 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:26:03.575 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:26:03.575 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:26:03.575 INFO:teuthology.orchestra.run.smithi049.stdout: "mirrored_filesystems": 1, 2024-03-16T07:26:03.575 INFO:teuthology.orchestra.run.smithi049.stdout: "mirror_enable_failures": 0 2024-03-16T07:26:03.575 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:03.575 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:03.575 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:26:03.575 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs_mirror_mirrored_filesystems": [ 2024-03-16T07:26:03.575 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:26:03.576 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:26:03.576 INFO:teuthology.orchestra.run.smithi049.stdout: "filesystem": "cephfs" 2024-03-16T07:26:03.576 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:26:03.576 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:26:03.576 INFO:teuthology.orchestra.run.smithi049.stdout: "mirroring_peers": 0, 2024-03-16T07:26:03.576 INFO:teuthology.orchestra.run.smithi049.stdout: "directory_count": 0 2024-03-16T07:26:03.576 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:03.576 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:03.576 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:26:03.576 INFO:teuthology.orchestra.run.smithi049.stdout: "mempool": [ 2024-03-16T07:26:03.576 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:26:03.576 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:26:03.576 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:26:03.576 INFO:teuthology.orchestra.run.smithi049.stdout: "bloom_filter_bytes": 0, 2024-03-16T07:26:03.576 INFO:teuthology.orchestra.run.smithi049.stdout: "bloom_filter_items": 0, 2024-03-16T07:26:03.576 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_alloc_bytes": 0, 2024-03-16T07:26:03.577 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_alloc_items": 0, 2024-03-16T07:26:03.577 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_data_bytes": 0, 2024-03-16T07:26:03.577 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_data_items": 0, 2024-03-16T07:26:03.577 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_onode_bytes": 0, 2024-03-16T07:26:03.577 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_onode_items": 0, 2024-03-16T07:26:03.577 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_meta_bytes": 0, 2024-03-16T07:26:03.577 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_meta_items": 0, 2024-03-16T07:26:03.577 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_other_bytes": 0, 2024-03-16T07:26:03.577 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_other_items": 0, 2024-03-16T07:26:03.577 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_buffer_bytes": 0, 2024-03-16T07:26:03.577 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_buffer_items": 0, 2024-03-16T07:26:03.577 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_extent_bytes": 0, 2024-03-16T07:26:03.577 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_extent_items": 0, 2024-03-16T07:26:03.577 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_blob_bytes": 0, 2024-03-16T07:26:03.577 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_blob_items": 0, 2024-03-16T07:26:03.577 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_shared_blob_bytes": 0, 2024-03-16T07:26:03.577 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_shared_blob_items": 0, 2024-03-16T07:26:03.577 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_inline_bl_bytes": 0, 2024-03-16T07:26:03.578 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_inline_bl_items": 0, 2024-03-16T07:26:03.578 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_fsck_bytes": 0, 2024-03-16T07:26:03.578 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_fsck_items": 0, 2024-03-16T07:26:03.578 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_txc_bytes": 0, 2024-03-16T07:26:03.578 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_txc_items": 0, 2024-03-16T07:26:03.578 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_deferred_bytes": 0, 2024-03-16T07:26:03.578 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_deferred_items": 0, 2024-03-16T07:26:03.578 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_bytes": 0, 2024-03-16T07:26:03.578 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_items": 0, 2024-03-16T07:26:03.578 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_bytes": 0, 2024-03-16T07:26:03.578 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_items": 0, 2024-03-16T07:26:03.578 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_reader_bytes": 0, 2024-03-16T07:26:03.578 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_reader_items": 0, 2024-03-16T07:26:03.578 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_writer_bytes": 0, 2024-03-16T07:26:03.578 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_writer_items": 0, 2024-03-16T07:26:03.578 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_anon_bytes": 182719, 2024-03-16T07:26:03.578 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_anon_items": 53, 2024-03-16T07:26:03.579 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_meta_bytes": 0, 2024-03-16T07:26:03.579 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_meta_items": 0, 2024-03-16T07:26:03.579 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_bytes": 0, 2024-03-16T07:26:03.579 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_items": 0, 2024-03-16T07:26:03.579 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_mapbl_bytes": 0, 2024-03-16T07:26:03.579 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_mapbl_items": 0, 2024-03-16T07:26:03.579 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pglog_bytes": 0, 2024-03-16T07:26:03.579 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pglog_items": 0, 2024-03-16T07:26:03.579 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_bytes": 18440, 2024-03-16T07:26:03.579 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_items": 176, 2024-03-16T07:26:03.579 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_mapping_bytes": 0, 2024-03-16T07:26:03.579 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_mapping_items": 0, 2024-03-16T07:26:03.579 INFO:teuthology.orchestra.run.smithi049.stdout: "pgmap_bytes": 0, 2024-03-16T07:26:03.579 INFO:teuthology.orchestra.run.smithi049.stdout: "pgmap_items": 0, 2024-03-16T07:26:03.579 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_co_bytes": 0, 2024-03-16T07:26:03.579 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_co_items": 0, 2024-03-16T07:26:03.579 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_1_bytes": 0, 2024-03-16T07:26:03.580 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_1_items": 0, 2024-03-16T07:26:03.580 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_2_bytes": 0, 2024-03-16T07:26:03.580 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_2_items": 0 2024-03-16T07:26:03.580 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:03.580 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:03.580 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:26:03.580 INFO:teuthology.orchestra.run.smithi049.stdout: "objecter": [ 2024-03-16T07:26:03.580 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:26:03.580 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:26:03.580 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:26:03.580 INFO:teuthology.orchestra.run.smithi049.stdout: "op_active": 0, 2024-03-16T07:26:03.580 INFO:teuthology.orchestra.run.smithi049.stdout: "op_laggy": 0, 2024-03-16T07:26:03.580 INFO:teuthology.orchestra.run.smithi049.stdout: "op_send": 0, 2024-03-16T07:26:03.580 INFO:teuthology.orchestra.run.smithi049.stdout: "op_send_bytes": 0, 2024-03-16T07:26:03.580 INFO:teuthology.orchestra.run.smithi049.stdout: "op_resend": 0, 2024-03-16T07:26:03.580 INFO:teuthology.orchestra.run.smithi049.stdout: "op_reply": 0, 2024-03-16T07:26:03.580 INFO:teuthology.orchestra.run.smithi049.stdout: "op_latency": { 2024-03-16T07:26:03.581 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:26:03.581 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:26:03.581 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:26:03.581 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:26:03.581 INFO:teuthology.orchestra.run.smithi049.stdout: "op_inflight": 0, 2024-03-16T07:26:03.581 INFO:teuthology.orchestra.run.smithi049.stdout: "oplen_avg": { 2024-03-16T07:26:03.581 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:26:03.581 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0 2024-03-16T07:26:03.581 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:26:03.581 INFO:teuthology.orchestra.run.smithi049.stdout: "op": 0, 2024-03-16T07:26:03.581 INFO:teuthology.orchestra.run.smithi049.stdout: "op_r": 0, 2024-03-16T07:26:03.581 INFO:teuthology.orchestra.run.smithi049.stdout: "op_w": 0, 2024-03-16T07:26:03.581 INFO:teuthology.orchestra.run.smithi049.stdout: "op_rmw": 0, 2024-03-16T07:26:03.581 INFO:teuthology.orchestra.run.smithi049.stdout: "op_pg": 0, 2024-03-16T07:26:03.581 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_stat": 0, 2024-03-16T07:26:03.581 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_create": 0, 2024-03-16T07:26:03.581 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_read": 0, 2024-03-16T07:26:03.582 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_write": 0, 2024-03-16T07:26:03.582 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_writefull": 0, 2024-03-16T07:26:03.582 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_writesame": 0, 2024-03-16T07:26:03.582 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_append": 0, 2024-03-16T07:26:03.582 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_zero": 0, 2024-03-16T07:26:03.582 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_truncate": 0, 2024-03-16T07:26:03.582 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_delete": 0, 2024-03-16T07:26:03.582 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_mapext": 0, 2024-03-16T07:26:03.582 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_sparse_read": 0, 2024-03-16T07:26:03.582 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_clonerange": 0, 2024-03-16T07:26:03.582 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_getxattr": 0, 2024-03-16T07:26:03.582 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_setxattr": 0, 2024-03-16T07:26:03.582 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_cmpxattr": 0, 2024-03-16T07:26:03.582 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_rmxattr": 0, 2024-03-16T07:26:03.582 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_resetxattrs": 0, 2024-03-16T07:26:03.583 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_call": 0, 2024-03-16T07:26:03.583 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_watch": 0, 2024-03-16T07:26:03.583 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_notify": 0, 2024-03-16T07:26:03.583 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_src_cmpxattr": 0, 2024-03-16T07:26:03.583 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_pgls": 0, 2024-03-16T07:26:03.583 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_pgls_filter": 0, 2024-03-16T07:26:03.583 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_other": 0, 2024-03-16T07:26:03.583 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_active": 0, 2024-03-16T07:26:03.583 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_send": 0, 2024-03-16T07:26:03.583 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_resend": 0, 2024-03-16T07:26:03.583 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_ping": 0, 2024-03-16T07:26:03.583 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_active": 0, 2024-03-16T07:26:03.583 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_send": 0, 2024-03-16T07:26:03.583 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_resend": 0, 2024-03-16T07:26:03.583 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_active": 0, 2024-03-16T07:26:03.583 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_send": 0, 2024-03-16T07:26:03.583 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_resend": 0, 2024-03-16T07:26:03.583 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_active": 0, 2024-03-16T07:26:03.584 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_send": 0, 2024-03-16T07:26:03.584 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_resend": 0, 2024-03-16T07:26:03.584 INFO:teuthology.orchestra.run.smithi049.stdout: "command_active": 0, 2024-03-16T07:26:03.584 INFO:teuthology.orchestra.run.smithi049.stdout: "command_send": 0, 2024-03-16T07:26:03.584 INFO:teuthology.orchestra.run.smithi049.stdout: "command_resend": 0, 2024-03-16T07:26:03.584 INFO:teuthology.orchestra.run.smithi049.stdout: "map_epoch": 0, 2024-03-16T07:26:03.584 INFO:teuthology.orchestra.run.smithi049.stdout: "map_full": 0, 2024-03-16T07:26:03.584 INFO:teuthology.orchestra.run.smithi049.stdout: "map_inc": 0, 2024-03-16T07:26:03.584 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_sessions": 0, 2024-03-16T07:26:03.584 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_session_open": 0, 2024-03-16T07:26:03.584 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_session_close": 0, 2024-03-16T07:26:03.584 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_laggy": 0, 2024-03-16T07:26:03.584 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_wr": 0, 2024-03-16T07:26:03.584 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_rd": 0, 2024-03-16T07:26:03.584 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_del": 0 2024-03-16T07:26:03.585 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:03.585 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:03.585 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:26:03.585 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-msgr_dispatch_throttler-client": [ 2024-03-16T07:26:03.585 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:26:03.585 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:26:03.585 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:26:03.585 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:26:03.585 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-03-16T07:26:03.585 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:26:03.585 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 18, 2024-03-16T07:26:03.585 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 63833, 2024-03-16T07:26:03.585 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:26:03.585 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 18, 2024-03-16T07:26:03.585 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:26:03.585 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:26:03.585 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 18, 2024-03-16T07:26:03.586 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 63833, 2024-03-16T07:26:03.586 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:26:03.586 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:26:03.586 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:26:03.586 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:26:03.586 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:03.586 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:03.586 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:03.586 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:26:03.586 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-msgr_dispatch_throttler-radosclient": [ 2024-03-16T07:26:03.586 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:26:03.586 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:26:03.586 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:26:03.586 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:26:03.586 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-03-16T07:26:03.586 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:26:03.586 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 12, 2024-03-16T07:26:03.587 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 276329, 2024-03-16T07:26:03.587 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:26:03.587 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 12, 2024-03-16T07:26:03.587 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:26:03.587 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:26:03.587 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 12, 2024-03-16T07:26:03.587 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 276329, 2024-03-16T07:26:03.587 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:26:03.587 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:26:03.587 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:26:03.587 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:26:03.587 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:03.587 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:03.587 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:03.587 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:26:03.587 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-objecter_bytes": [ 2024-03-16T07:26:03.588 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:26:03.588 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:26:03.588 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:26:03.588 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:26:03.588 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-03-16T07:26:03.588 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:26:03.588 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 0, 2024-03-16T07:26:03.588 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 0, 2024-03-16T07:26:03.588 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:26:03.588 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 0, 2024-03-16T07:26:03.588 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:26:03.588 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:26:03.588 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 0, 2024-03-16T07:26:03.588 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 0, 2024-03-16T07:26:03.588 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:26:03.588 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:26:03.588 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:26:03.589 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:26:03.589 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:03.589 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:03.589 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:03.589 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:26:03.589 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-objecter_ops": [ 2024-03-16T07:26:03.589 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:26:03.589 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:26:03.589 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:26:03.589 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:26:03.589 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 1024, 2024-03-16T07:26:03.589 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:26:03.589 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 0, 2024-03-16T07:26:03.589 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 0, 2024-03-16T07:26:03.589 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:26:03.589 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 0, 2024-03-16T07:26:03.589 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:26:03.589 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:26:03.590 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 0, 2024-03-16T07:26:03.590 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 0, 2024-03-16T07:26:03.590 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:26:03.590 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:26:03.590 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:26:03.590 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:26:03.590 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:03.590 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:03.590 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:03.590 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2024-03-16T07:26:03.590 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-03-16T07:26:03.591 DEBUG:tasks.cephfs.test_mirroring:command returned={ "AsyncMessenger::Worker": [ { "labels": { "id": "0" }, "counters": { "msgr_connection_ready_timeouts": 0, "msgr_connection_idle_timeouts": 0 } }, { "labels": { "id": "1" }, "counters": { "msgr_connection_ready_timeouts": 0, "msgr_connection_idle_timeouts": 0 } }, { "labels": { "id": "2" }, "counters": { "msgr_connection_ready_timeouts": 0, "msgr_connection_idle_timeouts": 0 } } ], "AsyncMessenger::Worker-0": [ { "labels": {}, "counters": { "msgr_recv_messages": 2, "msgr_send_messages": 12, "msgr_recv_bytes": 288, "msgr_send_bytes": 161648, "msgr_created_connections": 4, "msgr_active_connections": 2, "msgr_running_total_time": 0.158603971, "msgr_running_send_time": 0.032185955, "msgr_running_recv_time": 0.111513973, "msgr_running_fast_dispatch_time": 0.000000000, "msgr_send_messages_queue_lat": { "avgcount": 11, "sum": 0.119393333, "avgtime": 0.010853939 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "msgr_recv_encrypted_bytes": 288, "msgr_send_encrypted_bytes": 161648 } } ], "AsyncMessenger::Worker-1": [ { "labels": {}, "counters": { "msgr_recv_messages": 18, "msgr_send_messages": 3, "msgr_recv_bytes": 66272, "msgr_send_bytes": 464, "msgr_created_connections": 3, "msgr_active_connections": 0, "msgr_running_total_time": 0.199810103, "msgr_running_send_time": 0.001089857, "msgr_running_recv_time": 0.137530807, "msgr_running_fast_dispatch_time": 0.060245166, "msgr_send_messages_queue_lat": { "avgcount": 3, "sum": 0.054357270, "avgtime": 0.018119090 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "msgr_recv_encrypted_bytes": 66272, "msgr_send_encrypted_bytes": 464 } } ], "AsyncMessenger::Worker-2": [ { "labels": {}, "counters": { "msgr_recv_messages": 13, "msgr_send_messages": 6, "msgr_recv_bytes": 278496, "msgr_send_bytes": 928, "msgr_created_connections": 2, "msgr_active_connections": 1, "msgr_running_total_time": 0.191353593, "msgr_running_send_time": 0.004133027, "msgr_running_recv_time": 0.385824647, "msgr_running_fast_dispatch_time": 0.000000000, "msgr_send_messages_queue_lat": { "avgcount": 6, "sum": 0.158362306, "avgtime": 0.026393717 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "msgr_recv_encrypted_bytes": 278496, "msgr_send_encrypted_bytes": 928 } } ], "cct": [ { "labels": {}, "counters": { "total_workers": 0, "unhealthy_workers": 0 } } ], "cephfs_mirror": [ { "labels": {}, "counters": { "mirrored_filesystems": 1, "mirror_enable_failures": 0 } } ], "cephfs_mirror_mirrored_filesystems": [ { "labels": { "filesystem": "cephfs" }, "counters": { "mirroring_peers": 0, "directory_count": 0 } } ], "mempool": [ { "labels": {}, "counters": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_cache_buffer_bytes": 0, "bluestore_cache_buffer_items": 0, "bluestore_extent_bytes": 0, "bluestore_extent_items": 0, "bluestore_blob_bytes": 0, "bluestore_blob_items": 0, "bluestore_shared_blob_bytes": 0, "bluestore_shared_blob_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_items": 0, "bluefs_bytes": 0, "bluefs_items": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "buffer_anon_bytes": 182719, "buffer_anon_items": 53, "buffer_meta_bytes": 0, "buffer_meta_items": 0, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 18440, "osdmap_items": 176, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "mds_co_bytes": 0, "mds_co_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 } } ], "objecter": [ { "labels": {}, "counters": { "op_active": 0, "op_laggy": 0, "op_send": 0, "op_send_bytes": 0, "op_resend": 0, "op_reply": 0, "op_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "op_inflight": 0, "oplen_avg": { "avgcount": 0, "sum": 0 }, "op": 0, "op_r": 0, "op_w": 0, "op_rmw": 0, "op_pg": 0, "osdop_stat": 0, "osdop_create": 0, "osdop_read": 0, "osdop_write": 0, "osdop_writefull": 0, "osdop_writesame": 0, "osdop_append": 0, "osdop_zero": 0, "osdop_truncate": 0, "osdop_delete": 0, "osdop_mapext": 0, "osdop_sparse_read": 0, "osdop_clonerange": 0, "osdop_getxattr": 0, "osdop_setxattr": 0, "osdop_cmpxattr": 0, "osdop_rmxattr": 0, "osdop_resetxattrs": 0, "osdop_call": 0, "osdop_watch": 0, "osdop_notify": 0, "osdop_src_cmpxattr": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_other": 0, "linger_active": 0, "linger_send": 0, "linger_resend": 0, "linger_ping": 0, "poolop_active": 0, "poolop_send": 0, "poolop_resend": 0, "poolstat_active": 0, "poolstat_send": 0, "poolstat_resend": 0, "statfs_active": 0, "statfs_send": 0, "statfs_resend": 0, "command_active": 0, "command_send": 0, "command_resend": 0, "map_epoch": 0, "map_full": 0, "map_inc": 0, "osd_sessions": 0, "osd_session_open": 0, "osd_session_close": 0, "osd_laggy": 0, "omap_wr": 0, "omap_rd": 0, "omap_del": 0 } } ], "throttle-msgr_dispatch_throttler-client": [ { "labels": {}, "counters": { "val": 0, "max": 104857600, "get_started": 0, "get": 18, "get_sum": 63833, "get_or_fail_fail": 0, "get_or_fail_success": 18, "take": 0, "take_sum": 0, "put": 18, "put_sum": 63833, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ], "throttle-msgr_dispatch_throttler-radosclient": [ { "labels": {}, "counters": { "val": 0, "max": 104857600, "get_started": 0, "get": 12, "get_sum": 276329, "get_or_fail_fail": 0, "get_or_fail_success": 12, "take": 0, "take_sum": 0, "put": 12, "put_sum": 276329, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ], "throttle-objecter_bytes": [ { "labels": {}, "counters": { "val": 0, "max": 104857600, "get_started": 0, "get": 0, "get_sum": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "take": 0, "take_sum": 0, "put": 0, "put_sum": 0, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ], "throttle-objecter_ops": [ { "labels": {}, "counters": { "val": 0, "max": 1024, "get_started": 0, "get": 0, "get_sum": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "take": 0, "take_sum": 0, "put": 0, "put_sum": 0, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ] } 2024-03-16T07:26:03.591 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-03-16T07:26:03.592 DEBUG:teuthology.orchestra.run.smithi049:mirror status for fs: cephfs> ceph --admin-daemon /var/run/ceph/cephfs-mirror.asok fs mirror status cephfs@2 2024-03-16T07:26:03.715 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-03-16T07:26:03.715 INFO:teuthology.orchestra.run.smithi049.stdout: "rados_inst": "172.21.15.49:0/3295617512", 2024-03-16T07:26:03.715 INFO:teuthology.orchestra.run.smithi049.stdout: "peers": {}, 2024-03-16T07:26:03.715 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_dirs": { 2024-03-16T07:26:03.715 INFO:teuthology.orchestra.run.smithi049.stdout: "dir_count": 0 2024-03-16T07:26:03.715 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:03.715 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-03-16T07:26:03.726 DEBUG:tasks.cephfs.test_mirroring:command returned={ "rados_inst": "172.21.15.49:0/3295617512", "peers": {}, "snap_dirs": { "dir_count": 0 } } 2024-03-16T07:26:03.726 DEBUG:tasks.cephfs.test_mirroring:initial dir_count=0 2024-03-16T07:26:03.726 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snapshot mirror add cephfs /d1/d2/ 2024-03-16T07:26:04.137 INFO:teuthology.orchestra.run.smithi049.stdout:{} 2024-03-16T07:26:08.159 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T07:26:14.150 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-03-16T07:26:14.151 DEBUG:teuthology.orchestra.run.smithi049:mirror status for fs: cephfs> ceph --admin-daemon /var/run/ceph/cephfs-mirror.asok fs mirror status cephfs@2 2024-03-16T07:26:14.257 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-03-16T07:26:14.257 INFO:teuthology.orchestra.run.smithi049.stdout: "rados_inst": "172.21.15.49:0/3295617512", 2024-03-16T07:26:14.257 INFO:teuthology.orchestra.run.smithi049.stdout: "peers": {}, 2024-03-16T07:26:14.257 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_dirs": { 2024-03-16T07:26:14.257 INFO:teuthology.orchestra.run.smithi049.stdout: "dir_count": 1 2024-03-16T07:26:14.257 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:14.258 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-03-16T07:26:14.269 DEBUG:tasks.cephfs.test_mirroring:command returned={ "rados_inst": "172.21.15.49:0/3295617512", "peers": {}, "snap_dirs": { "dir_count": 1 } } 2024-03-16T07:26:14.269 DEBUG:tasks.cephfs.test_mirroring:new dir_count=1 2024-03-16T07:26:14.269 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-03-16T07:26:14.269 DEBUG:teuthology.orchestra.run.smithi049:counter dump for fs: cephfs> ceph --admin-daemon /var/run/ceph/cephfs-mirror.asok counter dump 2024-03-16T07:26:14.374 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-03-16T07:26:14.374 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker": [ 2024-03-16T07:26:14.374 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:26:14.374 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:26:14.374 INFO:teuthology.orchestra.run.smithi049.stdout: "id": "0" 2024-03-16T07:26:14.374 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:26:14.374 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:26:14.375 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_ready_timeouts": 0, 2024-03-16T07:26:14.375 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_idle_timeouts": 0 2024-03-16T07:26:14.375 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:14.375 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:26:14.375 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:26:14.375 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:26:14.375 INFO:teuthology.orchestra.run.smithi049.stdout: "id": "1" 2024-03-16T07:26:14.375 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:26:14.375 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:26:14.375 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_ready_timeouts": 0, 2024-03-16T07:26:14.375 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_idle_timeouts": 0 2024-03-16T07:26:14.375 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:14.375 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:26:14.375 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:26:14.375 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:26:14.376 INFO:teuthology.orchestra.run.smithi049.stdout: "id": "2" 2024-03-16T07:26:14.376 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:26:14.376 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:26:14.376 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_ready_timeouts": 0, 2024-03-16T07:26:14.376 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_idle_timeouts": 0 2024-03-16T07:26:14.376 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:14.376 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:14.376 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:26:14.376 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-0": [ 2024-03-16T07:26:14.376 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:26:14.376 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:26:14.376 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:26:14.376 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 2, 2024-03-16T07:26:14.376 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 14, 2024-03-16T07:26:14.377 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 288, 2024-03-16T07:26:14.377 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 162208, 2024-03-16T07:26:14.377 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 4, 2024-03-16T07:26:14.377 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 2, 2024-03-16T07:26:14.377 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 0.159432900, 2024-03-16T07:26:14.377 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.032948393, 2024-03-16T07:26:14.377 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 0.111513973, 2024-03-16T07:26:14.377 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-03-16T07:26:14.377 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T07:26:14.377 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 13, 2024-03-16T07:26:14.377 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.119693013, 2024-03-16T07:26:14.377 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.009207154 2024-03-16T07:26:14.377 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:26:14.377 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-03-16T07:26:14.377 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:26:14.378 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:26:14.378 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:26:14.378 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:26:14.378 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 288, 2024-03-16T07:26:14.378 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 162208 2024-03-16T07:26:14.378 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:14.378 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:14.378 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:26:14.378 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-1": [ 2024-03-16T07:26:14.378 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:26:14.378 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:26:14.378 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:26:14.378 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 18, 2024-03-16T07:26:14.378 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 3, 2024-03-16T07:26:14.378 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 66272, 2024-03-16T07:26:14.379 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 464, 2024-03-16T07:26:14.379 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 3, 2024-03-16T07:26:14.379 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 0, 2024-03-16T07:26:14.379 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 0.200256385, 2024-03-16T07:26:14.379 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.001134443, 2024-03-16T07:26:14.379 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 0.137657451, 2024-03-16T07:26:14.379 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.060245166, 2024-03-16T07:26:14.379 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T07:26:14.379 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 3, 2024-03-16T07:26:14.379 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.054357270, 2024-03-16T07:26:14.379 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.018119090 2024-03-16T07:26:14.379 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:26:14.379 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-03-16T07:26:14.379 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:26:14.379 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:26:14.379 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:26:14.380 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:26:14.380 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 66272, 2024-03-16T07:26:14.380 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 464 2024-03-16T07:26:14.380 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:14.380 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:14.380 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:26:14.380 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-2": [ 2024-03-16T07:26:14.380 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:26:14.380 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:26:14.380 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:26:14.380 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 13, 2024-03-16T07:26:14.380 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 6, 2024-03-16T07:26:14.380 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 278496, 2024-03-16T07:26:14.380 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 928, 2024-03-16T07:26:14.380 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 2, 2024-03-16T07:26:14.380 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 1, 2024-03-16T07:26:14.381 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 0.191712741, 2024-03-16T07:26:14.381 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.004178985, 2024-03-16T07:26:14.381 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 0.385961315, 2024-03-16T07:26:14.381 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-03-16T07:26:14.381 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T07:26:14.381 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 6, 2024-03-16T07:26:14.381 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.158362306, 2024-03-16T07:26:14.381 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.026393717 2024-03-16T07:26:14.381 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:26:14.381 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-03-16T07:26:14.381 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:26:14.381 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:26:14.381 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:26:14.381 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:26:14.381 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 278496, 2024-03-16T07:26:14.382 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 928 2024-03-16T07:26:14.382 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:14.382 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:14.382 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:26:14.382 INFO:teuthology.orchestra.run.smithi049.stdout: "cct": [ 2024-03-16T07:26:14.382 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:26:14.382 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:26:14.382 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:26:14.382 INFO:teuthology.orchestra.run.smithi049.stdout: "total_workers": 0, 2024-03-16T07:26:14.382 INFO:teuthology.orchestra.run.smithi049.stdout: "unhealthy_workers": 0 2024-03-16T07:26:14.382 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:14.382 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:14.382 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:26:14.382 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs_mirror": [ 2024-03-16T07:26:14.382 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:26:14.383 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:26:14.383 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:26:14.383 INFO:teuthology.orchestra.run.smithi049.stdout: "mirrored_filesystems": 1, 2024-03-16T07:26:14.383 INFO:teuthology.orchestra.run.smithi049.stdout: "mirror_enable_failures": 0 2024-03-16T07:26:14.383 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:14.383 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:14.383 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:26:14.383 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs_mirror_mirrored_filesystems": [ 2024-03-16T07:26:14.383 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:26:14.383 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:26:14.383 INFO:teuthology.orchestra.run.smithi049.stdout: "filesystem": "cephfs" 2024-03-16T07:26:14.383 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:26:14.383 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:26:14.383 INFO:teuthology.orchestra.run.smithi049.stdout: "mirroring_peers": 0, 2024-03-16T07:26:14.383 INFO:teuthology.orchestra.run.smithi049.stdout: "directory_count": 1 2024-03-16T07:26:14.383 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:14.384 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:14.384 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:26:14.384 INFO:teuthology.orchestra.run.smithi049.stdout: "mempool": [ 2024-03-16T07:26:14.384 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:26:14.384 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:26:14.384 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:26:14.384 INFO:teuthology.orchestra.run.smithi049.stdout: "bloom_filter_bytes": 0, 2024-03-16T07:26:14.384 INFO:teuthology.orchestra.run.smithi049.stdout: "bloom_filter_items": 0, 2024-03-16T07:26:14.384 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_alloc_bytes": 0, 2024-03-16T07:26:14.384 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_alloc_items": 0, 2024-03-16T07:26:14.384 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_data_bytes": 0, 2024-03-16T07:26:14.384 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_data_items": 0, 2024-03-16T07:26:14.384 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_onode_bytes": 0, 2024-03-16T07:26:14.384 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_onode_items": 0, 2024-03-16T07:26:14.384 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_meta_bytes": 0, 2024-03-16T07:26:14.384 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_meta_items": 0, 2024-03-16T07:26:14.385 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_other_bytes": 0, 2024-03-16T07:26:14.385 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_other_items": 0, 2024-03-16T07:26:14.385 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_buffer_bytes": 0, 2024-03-16T07:26:14.385 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_buffer_items": 0, 2024-03-16T07:26:14.385 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_extent_bytes": 0, 2024-03-16T07:26:14.385 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_extent_items": 0, 2024-03-16T07:26:14.385 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_blob_bytes": 0, 2024-03-16T07:26:14.385 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_blob_items": 0, 2024-03-16T07:26:14.385 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_shared_blob_bytes": 0, 2024-03-16T07:26:14.385 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_shared_blob_items": 0, 2024-03-16T07:26:14.385 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_inline_bl_bytes": 0, 2024-03-16T07:26:14.385 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_inline_bl_items": 0, 2024-03-16T07:26:14.385 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_fsck_bytes": 0, 2024-03-16T07:26:14.385 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_fsck_items": 0, 2024-03-16T07:26:14.385 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_txc_bytes": 0, 2024-03-16T07:26:14.385 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_txc_items": 0, 2024-03-16T07:26:14.386 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_deferred_bytes": 0, 2024-03-16T07:26:14.386 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_deferred_items": 0, 2024-03-16T07:26:14.386 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_bytes": 0, 2024-03-16T07:26:14.386 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_items": 0, 2024-03-16T07:26:14.386 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_bytes": 0, 2024-03-16T07:26:14.386 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_items": 0, 2024-03-16T07:26:14.386 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_reader_bytes": 0, 2024-03-16T07:26:14.386 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_reader_items": 0, 2024-03-16T07:26:14.386 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_writer_bytes": 0, 2024-03-16T07:26:14.386 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_writer_items": 0, 2024-03-16T07:26:14.386 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_anon_bytes": 182719, 2024-03-16T07:26:14.386 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_anon_items": 53, 2024-03-16T07:26:14.386 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_meta_bytes": 0, 2024-03-16T07:26:14.386 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_meta_items": 0, 2024-03-16T07:26:14.386 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_bytes": 0, 2024-03-16T07:26:14.386 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_items": 0, 2024-03-16T07:26:14.387 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_mapbl_bytes": 0, 2024-03-16T07:26:14.387 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_mapbl_items": 0, 2024-03-16T07:26:14.387 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pglog_bytes": 0, 2024-03-16T07:26:14.387 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pglog_items": 0, 2024-03-16T07:26:14.387 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_bytes": 18440, 2024-03-16T07:26:14.387 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_items": 176, 2024-03-16T07:26:14.387 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_mapping_bytes": 0, 2024-03-16T07:26:14.387 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_mapping_items": 0, 2024-03-16T07:26:14.387 INFO:teuthology.orchestra.run.smithi049.stdout: "pgmap_bytes": 0, 2024-03-16T07:26:14.387 INFO:teuthology.orchestra.run.smithi049.stdout: "pgmap_items": 0, 2024-03-16T07:26:14.387 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_co_bytes": 0, 2024-03-16T07:26:14.387 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_co_items": 0, 2024-03-16T07:26:14.387 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_1_bytes": 0, 2024-03-16T07:26:14.387 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_1_items": 0, 2024-03-16T07:26:14.387 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_2_bytes": 0, 2024-03-16T07:26:14.387 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_2_items": 0 2024-03-16T07:26:14.388 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:14.388 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:14.388 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:26:14.388 INFO:teuthology.orchestra.run.smithi049.stdout: "objecter": [ 2024-03-16T07:26:14.388 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:26:14.388 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:26:14.388 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:26:14.388 INFO:teuthology.orchestra.run.smithi049.stdout: "op_active": 0, 2024-03-16T07:26:14.388 INFO:teuthology.orchestra.run.smithi049.stdout: "op_laggy": 0, 2024-03-16T07:26:14.388 INFO:teuthology.orchestra.run.smithi049.stdout: "op_send": 0, 2024-03-16T07:26:14.388 INFO:teuthology.orchestra.run.smithi049.stdout: "op_send_bytes": 0, 2024-03-16T07:26:14.388 INFO:teuthology.orchestra.run.smithi049.stdout: "op_resend": 0, 2024-03-16T07:26:14.388 INFO:teuthology.orchestra.run.smithi049.stdout: "op_reply": 0, 2024-03-16T07:26:14.388 INFO:teuthology.orchestra.run.smithi049.stdout: "op_latency": { 2024-03-16T07:26:14.388 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:26:14.389 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:26:14.389 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:26:14.389 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:26:14.389 INFO:teuthology.orchestra.run.smithi049.stdout: "op_inflight": 0, 2024-03-16T07:26:14.389 INFO:teuthology.orchestra.run.smithi049.stdout: "oplen_avg": { 2024-03-16T07:26:14.389 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:26:14.389 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0 2024-03-16T07:26:14.389 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:26:14.389 INFO:teuthology.orchestra.run.smithi049.stdout: "op": 0, 2024-03-16T07:26:14.389 INFO:teuthology.orchestra.run.smithi049.stdout: "op_r": 0, 2024-03-16T07:26:14.389 INFO:teuthology.orchestra.run.smithi049.stdout: "op_w": 0, 2024-03-16T07:26:14.389 INFO:teuthology.orchestra.run.smithi049.stdout: "op_rmw": 0, 2024-03-16T07:26:14.389 INFO:teuthology.orchestra.run.smithi049.stdout: "op_pg": 0, 2024-03-16T07:26:14.389 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_stat": 0, 2024-03-16T07:26:14.390 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_create": 0, 2024-03-16T07:26:14.390 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_read": 0, 2024-03-16T07:26:14.390 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_write": 0, 2024-03-16T07:26:14.390 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_writefull": 0, 2024-03-16T07:26:14.390 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_writesame": 0, 2024-03-16T07:26:14.390 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_append": 0, 2024-03-16T07:26:14.390 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_zero": 0, 2024-03-16T07:26:14.390 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_truncate": 0, 2024-03-16T07:26:14.390 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_delete": 0, 2024-03-16T07:26:14.390 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_mapext": 0, 2024-03-16T07:26:14.390 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_sparse_read": 0, 2024-03-16T07:26:14.390 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_clonerange": 0, 2024-03-16T07:26:14.390 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_getxattr": 0, 2024-03-16T07:26:14.390 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_setxattr": 0, 2024-03-16T07:26:14.391 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_cmpxattr": 0, 2024-03-16T07:26:14.391 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_rmxattr": 0, 2024-03-16T07:26:14.391 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_resetxattrs": 0, 2024-03-16T07:26:14.391 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_call": 0, 2024-03-16T07:26:14.391 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_watch": 0, 2024-03-16T07:26:14.391 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_notify": 0, 2024-03-16T07:26:14.391 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_src_cmpxattr": 0, 2024-03-16T07:26:14.391 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_pgls": 0, 2024-03-16T07:26:14.391 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_pgls_filter": 0, 2024-03-16T07:26:14.391 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_other": 0, 2024-03-16T07:26:14.391 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_active": 0, 2024-03-16T07:26:14.391 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_send": 0, 2024-03-16T07:26:14.391 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_resend": 0, 2024-03-16T07:26:14.391 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_ping": 0, 2024-03-16T07:26:14.391 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_active": 0, 2024-03-16T07:26:14.392 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_send": 0, 2024-03-16T07:26:14.392 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_resend": 0, 2024-03-16T07:26:14.392 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_active": 0, 2024-03-16T07:26:14.392 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_send": 0, 2024-03-16T07:26:14.392 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_resend": 0, 2024-03-16T07:26:14.392 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_active": 0, 2024-03-16T07:26:14.392 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_send": 0, 2024-03-16T07:26:14.392 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_resend": 0, 2024-03-16T07:26:14.392 INFO:teuthology.orchestra.run.smithi049.stdout: "command_active": 0, 2024-03-16T07:26:14.392 INFO:teuthology.orchestra.run.smithi049.stdout: "command_send": 0, 2024-03-16T07:26:14.392 INFO:teuthology.orchestra.run.smithi049.stdout: "command_resend": 0, 2024-03-16T07:26:14.392 INFO:teuthology.orchestra.run.smithi049.stdout: "map_epoch": 0, 2024-03-16T07:26:14.392 INFO:teuthology.orchestra.run.smithi049.stdout: "map_full": 0, 2024-03-16T07:26:14.392 INFO:teuthology.orchestra.run.smithi049.stdout: "map_inc": 0, 2024-03-16T07:26:14.392 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_sessions": 0, 2024-03-16T07:26:14.392 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_session_open": 0, 2024-03-16T07:26:14.392 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_session_close": 0, 2024-03-16T07:26:14.392 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_laggy": 0, 2024-03-16T07:26:14.393 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_wr": 0, 2024-03-16T07:26:14.393 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_rd": 0, 2024-03-16T07:26:14.393 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_del": 0 2024-03-16T07:26:14.393 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:14.393 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:14.393 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:26:14.393 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-msgr_dispatch_throttler-client": [ 2024-03-16T07:26:14.393 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:26:14.393 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:26:14.393 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:26:14.393 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:26:14.393 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-03-16T07:26:14.393 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:26:14.393 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 18, 2024-03-16T07:26:14.393 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 63833, 2024-03-16T07:26:14.393 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:26:14.393 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 18, 2024-03-16T07:26:14.394 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:26:14.394 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:26:14.394 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 18, 2024-03-16T07:26:14.394 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 63833, 2024-03-16T07:26:14.394 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:26:14.394 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:26:14.394 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:26:14.394 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:26:14.394 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:14.394 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:14.394 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:14.394 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:26:14.394 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-msgr_dispatch_throttler-radosclient": [ 2024-03-16T07:26:14.394 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:26:14.394 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:26:14.395 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:26:14.395 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:26:14.395 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-03-16T07:26:14.395 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:26:14.395 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 12, 2024-03-16T07:26:14.395 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 276329, 2024-03-16T07:26:14.395 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:26:14.395 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 12, 2024-03-16T07:26:14.395 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:26:14.395 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:26:14.395 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 12, 2024-03-16T07:26:14.395 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 276329, 2024-03-16T07:26:14.395 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:26:14.395 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:26:14.395 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:26:14.396 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:26:14.396 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:14.396 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:14.396 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:14.396 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:26:14.396 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-objecter_bytes": [ 2024-03-16T07:26:14.396 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:26:14.396 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:26:14.396 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:26:14.396 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:26:14.396 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-03-16T07:26:14.396 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:26:14.396 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 0, 2024-03-16T07:26:14.396 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 0, 2024-03-16T07:26:14.397 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:26:14.397 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 0, 2024-03-16T07:26:14.397 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:26:14.397 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:26:14.397 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 0, 2024-03-16T07:26:14.397 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 0, 2024-03-16T07:26:14.397 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:26:14.397 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:26:14.397 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:26:14.397 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:26:14.397 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:14.397 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:14.397 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:14.397 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:26:14.397 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-objecter_ops": [ 2024-03-16T07:26:14.397 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:26:14.398 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:26:14.398 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:26:14.398 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:26:14.398 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 1024, 2024-03-16T07:26:14.398 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:26:14.398 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 0, 2024-03-16T07:26:14.398 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 0, 2024-03-16T07:26:14.398 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:26:14.398 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 0, 2024-03-16T07:26:14.398 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:26:14.398 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:26:14.398 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 0, 2024-03-16T07:26:14.398 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 0, 2024-03-16T07:26:14.398 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:26:14.398 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:26:14.399 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:26:14.399 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:26:14.399 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:14.399 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:14.399 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:14.399 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2024-03-16T07:26:14.399 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-03-16T07:26:14.400 DEBUG:tasks.cephfs.test_mirroring:command returned={ "AsyncMessenger::Worker": [ { "labels": { "id": "0" }, "counters": { "msgr_connection_ready_timeouts": 0, "msgr_connection_idle_timeouts": 0 } }, { "labels": { "id": "1" }, "counters": { "msgr_connection_ready_timeouts": 0, "msgr_connection_idle_timeouts": 0 } }, { "labels": { "id": "2" }, "counters": { "msgr_connection_ready_timeouts": 0, "msgr_connection_idle_timeouts": 0 } } ], "AsyncMessenger::Worker-0": [ { "labels": {}, "counters": { "msgr_recv_messages": 2, "msgr_send_messages": 14, "msgr_recv_bytes": 288, "msgr_send_bytes": 162208, "msgr_created_connections": 4, "msgr_active_connections": 2, "msgr_running_total_time": 0.159432900, "msgr_running_send_time": 0.032948393, "msgr_running_recv_time": 0.111513973, "msgr_running_fast_dispatch_time": 0.000000000, "msgr_send_messages_queue_lat": { "avgcount": 13, "sum": 0.119693013, "avgtime": 0.009207154 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "msgr_recv_encrypted_bytes": 288, "msgr_send_encrypted_bytes": 162208 } } ], "AsyncMessenger::Worker-1": [ { "labels": {}, "counters": { "msgr_recv_messages": 18, "msgr_send_messages": 3, "msgr_recv_bytes": 66272, "msgr_send_bytes": 464, "msgr_created_connections": 3, "msgr_active_connections": 0, "msgr_running_total_time": 0.200256385, "msgr_running_send_time": 0.001134443, "msgr_running_recv_time": 0.137657451, "msgr_running_fast_dispatch_time": 0.060245166, "msgr_send_messages_queue_lat": { "avgcount": 3, "sum": 0.054357270, "avgtime": 0.018119090 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "msgr_recv_encrypted_bytes": 66272, "msgr_send_encrypted_bytes": 464 } } ], "AsyncMessenger::Worker-2": [ { "labels": {}, "counters": { "msgr_recv_messages": 13, "msgr_send_messages": 6, "msgr_recv_bytes": 278496, "msgr_send_bytes": 928, "msgr_created_connections": 2, "msgr_active_connections": 1, "msgr_running_total_time": 0.191712741, "msgr_running_send_time": 0.004178985, "msgr_running_recv_time": 0.385961315, "msgr_running_fast_dispatch_time": 0.000000000, "msgr_send_messages_queue_lat": { "avgcount": 6, "sum": 0.158362306, "avgtime": 0.026393717 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "msgr_recv_encrypted_bytes": 278496, "msgr_send_encrypted_bytes": 928 } } ], "cct": [ { "labels": {}, "counters": { "total_workers": 0, "unhealthy_workers": 0 } } ], "cephfs_mirror": [ { "labels": {}, "counters": { "mirrored_filesystems": 1, "mirror_enable_failures": 0 } } ], "cephfs_mirror_mirrored_filesystems": [ { "labels": { "filesystem": "cephfs" }, "counters": { "mirroring_peers": 0, "directory_count": 1 } } ], "mempool": [ { "labels": {}, "counters": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_cache_buffer_bytes": 0, "bluestore_cache_buffer_items": 0, "bluestore_extent_bytes": 0, "bluestore_extent_items": 0, "bluestore_blob_bytes": 0, "bluestore_blob_items": 0, "bluestore_shared_blob_bytes": 0, "bluestore_shared_blob_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_items": 0, "bluefs_bytes": 0, "bluefs_items": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "buffer_anon_bytes": 182719, "buffer_anon_items": 53, "buffer_meta_bytes": 0, "buffer_meta_items": 0, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 18440, "osdmap_items": 176, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "mds_co_bytes": 0, "mds_co_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 } } ], "objecter": [ { "labels": {}, "counters": { "op_active": 0, "op_laggy": 0, "op_send": 0, "op_send_bytes": 0, "op_resend": 0, "op_reply": 0, "op_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "op_inflight": 0, "oplen_avg": { "avgcount": 0, "sum": 0 }, "op": 0, "op_r": 0, "op_w": 0, "op_rmw": 0, "op_pg": 0, "osdop_stat": 0, "osdop_create": 0, "osdop_read": 0, "osdop_write": 0, "osdop_writefull": 0, "osdop_writesame": 0, "osdop_append": 0, "osdop_zero": 0, "osdop_truncate": 0, "osdop_delete": 0, "osdop_mapext": 0, "osdop_sparse_read": 0, "osdop_clonerange": 0, "osdop_getxattr": 0, "osdop_setxattr": 0, "osdop_cmpxattr": 0, "osdop_rmxattr": 0, "osdop_resetxattrs": 0, "osdop_call": 0, "osdop_watch": 0, "osdop_notify": 0, "osdop_src_cmpxattr": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_other": 0, "linger_active": 0, "linger_send": 0, "linger_resend": 0, "linger_ping": 0, "poolop_active": 0, "poolop_send": 0, "poolop_resend": 0, "poolstat_active": 0, "poolstat_send": 0, "poolstat_resend": 0, "statfs_active": 0, "statfs_send": 0, "statfs_resend": 0, "command_active": 0, "command_send": 0, "command_resend": 0, "map_epoch": 0, "map_full": 0, "map_inc": 0, "osd_sessions": 0, "osd_session_open": 0, "osd_session_close": 0, "osd_laggy": 0, "omap_wr": 0, "omap_rd": 0, "omap_del": 0 } } ], "throttle-msgr_dispatch_throttler-client": [ { "labels": {}, "counters": { "val": 0, "max": 104857600, "get_started": 0, "get": 18, "get_sum": 63833, "get_or_fail_fail": 0, "get_or_fail_success": 18, "take": 0, "take_sum": 0, "put": 18, "put_sum": 63833, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ], "throttle-msgr_dispatch_throttler-radosclient": [ { "labels": {}, "counters": { "val": 0, "max": 104857600, "get_started": 0, "get": 12, "get_sum": 276329, "get_or_fail_fail": 0, "get_or_fail_success": 12, "take": 0, "take_sum": 0, "put": 12, "put_sum": 276329, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ], "throttle-objecter_bytes": [ { "labels": {}, "counters": { "val": 0, "max": 104857600, "get_started": 0, "get": 0, "get_sum": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "take": 0, "take_sum": 0, "put": 0, "put_sum": 0, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ], "throttle-objecter_ops": [ { "labels": {}, "counters": { "val": 0, "max": 1024, "get_started": 0, "get": 0, "get_sum": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "take": 0, "take_sum": 0, "put": 0, "put_sum": 0, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ] } 2024-03-16T07:26:14.400 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-03-16T07:26:14.400 DEBUG:teuthology.orchestra.run.smithi049:mirror status for fs: cephfs> ceph --admin-daemon /var/run/ceph/cephfs-mirror.asok fs mirror status cephfs@2 2024-03-16T07:26:14.517 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-03-16T07:26:14.517 INFO:teuthology.orchestra.run.smithi049.stdout: "rados_inst": "172.21.15.49:0/3295617512", 2024-03-16T07:26:14.517 INFO:teuthology.orchestra.run.smithi049.stdout: "peers": {}, 2024-03-16T07:26:14.517 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_dirs": { 2024-03-16T07:26:14.517 INFO:teuthology.orchestra.run.smithi049.stdout: "dir_count": 1 2024-03-16T07:26:14.517 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:14.517 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-03-16T07:26:14.525 DEBUG:tasks.cephfs.test_mirroring:command returned={ "rados_inst": "172.21.15.49:0/3295617512", "peers": {}, "snap_dirs": { "dir_count": 1 } } 2024-03-16T07:26:14.525 DEBUG:tasks.cephfs.test_mirroring:initial dir_count=1 2024-03-16T07:26:14.525 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snapshot mirror add cephfs / 2024-03-16T07:26:14.873 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:26:14.875+0000 7fa2a9305640 -1 mgr.server reply reply (22) Invalid argument / is a ancestor of tracked path /d1/d2 2024-03-16T07:26:14.874 INFO:teuthology.orchestra.run.smithi049.stderr:Error EINVAL: / is a ancestor of tracked path /d1/d2 2024-03-16T07:26:14.881 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-03-16T07:26:14.881 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-03-16T07:26:14.881 DEBUG:teuthology.orchestra.run.smithi049:mirror status for fs: cephfs> ceph --admin-daemon /var/run/ceph/cephfs-mirror.asok fs mirror status cephfs@2 2024-03-16T07:26:15.007 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-03-16T07:26:15.007 INFO:teuthology.orchestra.run.smithi049.stdout: "rados_inst": "172.21.15.49:0/3295617512", 2024-03-16T07:26:15.007 INFO:teuthology.orchestra.run.smithi049.stdout: "peers": {}, 2024-03-16T07:26:15.007 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_dirs": { 2024-03-16T07:26:15.007 INFO:teuthology.orchestra.run.smithi049.stdout: "dir_count": 1 2024-03-16T07:26:15.007 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:15.007 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-03-16T07:26:15.018 DEBUG:tasks.cephfs.test_mirroring:command returned={ "rados_inst": "172.21.15.49:0/3295617512", "peers": {}, "snap_dirs": { "dir_count": 1 } } 2024-03-16T07:26:15.018 DEBUG:tasks.cephfs.test_mirroring:initial dir_count=1 2024-03-16T07:26:15.018 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snapshot mirror add cephfs /d1 2024-03-16T07:26:15.448 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:26:15.450+0000 7fa2a9305640 -1 mgr.server reply reply (22) Invalid argument /d1 is a ancestor of tracked path /d1/d2 2024-03-16T07:26:15.449 INFO:teuthology.orchestra.run.smithi049.stderr:Error EINVAL: /d1 is a ancestor of tracked path /d1/d2 2024-03-16T07:26:15.453 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-03-16T07:26:15.453 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-03-16T07:26:15.453 DEBUG:teuthology.orchestra.run.smithi049:mirror status for fs: cephfs> ceph --admin-daemon /var/run/ceph/cephfs-mirror.asok fs mirror status cephfs@2 2024-03-16T07:26:15.553 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-03-16T07:26:15.553 INFO:teuthology.orchestra.run.smithi049.stdout: "rados_inst": "172.21.15.49:0/3295617512", 2024-03-16T07:26:15.553 INFO:teuthology.orchestra.run.smithi049.stdout: "peers": {}, 2024-03-16T07:26:15.553 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_dirs": { 2024-03-16T07:26:15.553 INFO:teuthology.orchestra.run.smithi049.stdout: "dir_count": 1 2024-03-16T07:26:15.553 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:15.553 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-03-16T07:26:15.560 DEBUG:tasks.cephfs.test_mirroring:command returned={ "rados_inst": "172.21.15.49:0/3295617512", "peers": {}, "snap_dirs": { "dir_count": 1 } } 2024-03-16T07:26:15.561 DEBUG:tasks.cephfs.test_mirroring:initial dir_count=1 2024-03-16T07:26:15.561 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snapshot mirror add cephfs /d1/d2/d3 2024-03-16T07:26:15.931 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:26:15.932+0000 7fa2a9305640 -1 mgr.server reply reply (22) Invalid argument /d1/d2/d3 is a subtree of tracked path /d1/d2 2024-03-16T07:26:15.931 INFO:teuthology.orchestra.run.smithi049.stderr:Error EINVAL: /d1/d2/d3 is a subtree of tracked path /d1/d2 2024-03-16T07:26:15.937 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-03-16T07:26:15.937 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-03-16T07:26:15.937 DEBUG:teuthology.orchestra.run.smithi049:counter dump for fs: cephfs> ceph --admin-daemon /var/run/ceph/cephfs-mirror.asok counter dump 2024-03-16T07:26:16.056 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-03-16T07:26:16.056 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker": [ 2024-03-16T07:26:16.056 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:26:16.056 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:26:16.057 INFO:teuthology.orchestra.run.smithi049.stdout: "id": "0" 2024-03-16T07:26:16.057 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:26:16.057 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:26:16.057 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_ready_timeouts": 0, 2024-03-16T07:26:16.057 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_idle_timeouts": 0 2024-03-16T07:26:16.057 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:16.057 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:26:16.057 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:26:16.057 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:26:16.057 INFO:teuthology.orchestra.run.smithi049.stdout: "id": "1" 2024-03-16T07:26:16.057 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:26:16.057 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:26:16.057 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_ready_timeouts": 0, 2024-03-16T07:26:16.057 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_idle_timeouts": 0 2024-03-16T07:26:16.057 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:16.058 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:26:16.058 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:26:16.058 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:26:16.058 INFO:teuthology.orchestra.run.smithi049.stdout: "id": "2" 2024-03-16T07:26:16.058 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:26:16.058 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:26:16.058 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_ready_timeouts": 0, 2024-03-16T07:26:16.058 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_idle_timeouts": 0 2024-03-16T07:26:16.058 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:16.058 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:16.058 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:26:16.058 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-0": [ 2024-03-16T07:26:16.058 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:26:16.058 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:26:16.058 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:26:16.059 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 2, 2024-03-16T07:26:16.059 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 14, 2024-03-16T07:26:16.059 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 288, 2024-03-16T07:26:16.059 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 162208, 2024-03-16T07:26:16.059 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 4, 2024-03-16T07:26:16.059 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 2, 2024-03-16T07:26:16.059 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 0.159432900, 2024-03-16T07:26:16.059 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.032948393, 2024-03-16T07:26:16.059 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 0.111513973, 2024-03-16T07:26:16.059 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-03-16T07:26:16.059 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T07:26:16.059 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 13, 2024-03-16T07:26:16.059 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.119693013, 2024-03-16T07:26:16.059 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.009207154 2024-03-16T07:26:16.059 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:26:16.059 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-03-16T07:26:16.060 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:26:16.060 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:26:16.060 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:26:16.060 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:26:16.060 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 288, 2024-03-16T07:26:16.060 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 162208 2024-03-16T07:26:16.060 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:16.060 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:16.060 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:26:16.060 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-1": [ 2024-03-16T07:26:16.060 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:26:16.060 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:26:16.060 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:26:16.060 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 18, 2024-03-16T07:26:16.060 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 3, 2024-03-16T07:26:16.060 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 66272, 2024-03-16T07:26:16.060 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 464, 2024-03-16T07:26:16.061 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 3, 2024-03-16T07:26:16.061 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 0, 2024-03-16T07:26:16.061 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 0.200256385, 2024-03-16T07:26:16.061 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.001134443, 2024-03-16T07:26:16.061 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 0.137657451, 2024-03-16T07:26:16.061 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.060245166, 2024-03-16T07:26:16.061 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T07:26:16.061 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 3, 2024-03-16T07:26:16.061 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.054357270, 2024-03-16T07:26:16.061 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.018119090 2024-03-16T07:26:16.061 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:26:16.061 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-03-16T07:26:16.061 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:26:16.061 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:26:16.061 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:26:16.061 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:26:16.061 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 66272, 2024-03-16T07:26:16.062 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 464 2024-03-16T07:26:16.062 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:16.062 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:16.062 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:26:16.062 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-2": [ 2024-03-16T07:26:16.062 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:26:16.062 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:26:16.062 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:26:16.062 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 13, 2024-03-16T07:26:16.062 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 6, 2024-03-16T07:26:16.062 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 278496, 2024-03-16T07:26:16.062 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 928, 2024-03-16T07:26:16.062 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 2, 2024-03-16T07:26:16.062 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 1, 2024-03-16T07:26:16.062 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 0.191712741, 2024-03-16T07:26:16.062 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.004178985, 2024-03-16T07:26:16.062 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 0.385961315, 2024-03-16T07:26:16.063 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-03-16T07:26:16.063 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T07:26:16.063 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 6, 2024-03-16T07:26:16.063 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.158362306, 2024-03-16T07:26:16.063 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.026393717 2024-03-16T07:26:16.063 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:26:16.063 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-03-16T07:26:16.063 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:26:16.063 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:26:16.063 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:26:16.063 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:26:16.063 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 278496, 2024-03-16T07:26:16.063 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 928 2024-03-16T07:26:16.063 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:16.063 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:16.063 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:26:16.064 INFO:teuthology.orchestra.run.smithi049.stdout: "cct": [ 2024-03-16T07:26:16.064 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:26:16.064 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:26:16.064 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:26:16.064 INFO:teuthology.orchestra.run.smithi049.stdout: "total_workers": 0, 2024-03-16T07:26:16.064 INFO:teuthology.orchestra.run.smithi049.stdout: "unhealthy_workers": 0 2024-03-16T07:26:16.064 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:16.064 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:16.064 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:26:16.064 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs_mirror": [ 2024-03-16T07:26:16.064 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:26:16.064 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:26:16.064 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:26:16.064 INFO:teuthology.orchestra.run.smithi049.stdout: "mirrored_filesystems": 1, 2024-03-16T07:26:16.064 INFO:teuthology.orchestra.run.smithi049.stdout: "mirror_enable_failures": 0 2024-03-16T07:26:16.064 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:16.064 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:16.065 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:26:16.065 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs_mirror_mirrored_filesystems": [ 2024-03-16T07:26:16.065 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:26:16.065 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:26:16.065 INFO:teuthology.orchestra.run.smithi049.stdout: "filesystem": "cephfs" 2024-03-16T07:26:16.065 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:26:16.065 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:26:16.065 INFO:teuthology.orchestra.run.smithi049.stdout: "mirroring_peers": 0, 2024-03-16T07:26:16.065 INFO:teuthology.orchestra.run.smithi049.stdout: "directory_count": 1 2024-03-16T07:26:16.065 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:16.065 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:16.065 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:26:16.065 INFO:teuthology.orchestra.run.smithi049.stdout: "mempool": [ 2024-03-16T07:26:16.065 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:26:16.065 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:26:16.065 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:26:16.065 INFO:teuthology.orchestra.run.smithi049.stdout: "bloom_filter_bytes": 0, 2024-03-16T07:26:16.066 INFO:teuthology.orchestra.run.smithi049.stdout: "bloom_filter_items": 0, 2024-03-16T07:26:16.066 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_alloc_bytes": 0, 2024-03-16T07:26:16.066 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_alloc_items": 0, 2024-03-16T07:26:16.066 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_data_bytes": 0, 2024-03-16T07:26:16.066 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_data_items": 0, 2024-03-16T07:26:16.066 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_onode_bytes": 0, 2024-03-16T07:26:16.066 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_onode_items": 0, 2024-03-16T07:26:16.066 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_meta_bytes": 0, 2024-03-16T07:26:16.066 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_meta_items": 0, 2024-03-16T07:26:16.066 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_other_bytes": 0, 2024-03-16T07:26:16.066 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_other_items": 0, 2024-03-16T07:26:16.066 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_buffer_bytes": 0, 2024-03-16T07:26:16.066 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_buffer_items": 0, 2024-03-16T07:26:16.066 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_extent_bytes": 0, 2024-03-16T07:26:16.066 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_extent_items": 0, 2024-03-16T07:26:16.066 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_blob_bytes": 0, 2024-03-16T07:26:16.066 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_blob_items": 0, 2024-03-16T07:26:16.067 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_shared_blob_bytes": 0, 2024-03-16T07:26:16.067 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_shared_blob_items": 0, 2024-03-16T07:26:16.067 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_inline_bl_bytes": 0, 2024-03-16T07:26:16.067 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_inline_bl_items": 0, 2024-03-16T07:26:16.067 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_fsck_bytes": 0, 2024-03-16T07:26:16.067 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_fsck_items": 0, 2024-03-16T07:26:16.067 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_txc_bytes": 0, 2024-03-16T07:26:16.067 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_txc_items": 0, 2024-03-16T07:26:16.067 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_deferred_bytes": 0, 2024-03-16T07:26:16.067 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_deferred_items": 0, 2024-03-16T07:26:16.067 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_bytes": 0, 2024-03-16T07:26:16.067 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_items": 0, 2024-03-16T07:26:16.067 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_bytes": 0, 2024-03-16T07:26:16.067 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_items": 0, 2024-03-16T07:26:16.067 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_reader_bytes": 0, 2024-03-16T07:26:16.067 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_reader_items": 0, 2024-03-16T07:26:16.067 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_writer_bytes": 0, 2024-03-16T07:26:16.068 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_writer_items": 0, 2024-03-16T07:26:16.068 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_anon_bytes": 182719, 2024-03-16T07:26:16.068 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_anon_items": 53, 2024-03-16T07:26:16.068 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_meta_bytes": 0, 2024-03-16T07:26:16.068 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_meta_items": 0, 2024-03-16T07:26:16.068 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_bytes": 0, 2024-03-16T07:26:16.068 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_items": 0, 2024-03-16T07:26:16.068 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_mapbl_bytes": 0, 2024-03-16T07:26:16.068 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_mapbl_items": 0, 2024-03-16T07:26:16.068 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pglog_bytes": 0, 2024-03-16T07:26:16.068 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pglog_items": 0, 2024-03-16T07:26:16.068 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_bytes": 18440, 2024-03-16T07:26:16.068 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_items": 176, 2024-03-16T07:26:16.068 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_mapping_bytes": 0, 2024-03-16T07:26:16.068 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_mapping_items": 0, 2024-03-16T07:26:16.068 INFO:teuthology.orchestra.run.smithi049.stdout: "pgmap_bytes": 0, 2024-03-16T07:26:16.068 INFO:teuthology.orchestra.run.smithi049.stdout: "pgmap_items": 0, 2024-03-16T07:26:16.069 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_co_bytes": 0, 2024-03-16T07:26:16.069 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_co_items": 0, 2024-03-16T07:26:16.069 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_1_bytes": 0, 2024-03-16T07:26:16.069 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_1_items": 0, 2024-03-16T07:26:16.069 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_2_bytes": 0, 2024-03-16T07:26:16.069 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_2_items": 0 2024-03-16T07:26:16.069 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:16.069 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:16.069 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:26:16.069 INFO:teuthology.orchestra.run.smithi049.stdout: "objecter": [ 2024-03-16T07:26:16.069 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:26:16.069 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:26:16.069 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:26:16.069 INFO:teuthology.orchestra.run.smithi049.stdout: "op_active": 0, 2024-03-16T07:26:16.070 INFO:teuthology.orchestra.run.smithi049.stdout: "op_laggy": 0, 2024-03-16T07:26:16.070 INFO:teuthology.orchestra.run.smithi049.stdout: "op_send": 0, 2024-03-16T07:26:16.070 INFO:teuthology.orchestra.run.smithi049.stdout: "op_send_bytes": 0, 2024-03-16T07:26:16.070 INFO:teuthology.orchestra.run.smithi049.stdout: "op_resend": 0, 2024-03-16T07:26:16.070 INFO:teuthology.orchestra.run.smithi049.stdout: "op_reply": 0, 2024-03-16T07:26:16.070 INFO:teuthology.orchestra.run.smithi049.stdout: "op_latency": { 2024-03-16T07:26:16.070 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:26:16.070 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:26:16.070 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:26:16.070 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:26:16.070 INFO:teuthology.orchestra.run.smithi049.stdout: "op_inflight": 0, 2024-03-16T07:26:16.070 INFO:teuthology.orchestra.run.smithi049.stdout: "oplen_avg": { 2024-03-16T07:26:16.070 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:26:16.070 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0 2024-03-16T07:26:16.070 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:26:16.071 INFO:teuthology.orchestra.run.smithi049.stdout: "op": 0, 2024-03-16T07:26:16.071 INFO:teuthology.orchestra.run.smithi049.stdout: "op_r": 0, 2024-03-16T07:26:16.071 INFO:teuthology.orchestra.run.smithi049.stdout: "op_w": 0, 2024-03-16T07:26:16.071 INFO:teuthology.orchestra.run.smithi049.stdout: "op_rmw": 0, 2024-03-16T07:26:16.071 INFO:teuthology.orchestra.run.smithi049.stdout: "op_pg": 0, 2024-03-16T07:26:16.071 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_stat": 0, 2024-03-16T07:26:16.071 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_create": 0, 2024-03-16T07:26:16.071 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_read": 0, 2024-03-16T07:26:16.071 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_write": 0, 2024-03-16T07:26:16.071 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_writefull": 0, 2024-03-16T07:26:16.071 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_writesame": 0, 2024-03-16T07:26:16.071 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_append": 0, 2024-03-16T07:26:16.071 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_zero": 0, 2024-03-16T07:26:16.071 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_truncate": 0, 2024-03-16T07:26:16.071 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_delete": 0, 2024-03-16T07:26:16.071 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_mapext": 0, 2024-03-16T07:26:16.071 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_sparse_read": 0, 2024-03-16T07:26:16.072 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_clonerange": 0, 2024-03-16T07:26:16.072 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_getxattr": 0, 2024-03-16T07:26:16.072 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_setxattr": 0, 2024-03-16T07:26:16.072 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_cmpxattr": 0, 2024-03-16T07:26:16.072 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_rmxattr": 0, 2024-03-16T07:26:16.072 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_resetxattrs": 0, 2024-03-16T07:26:16.072 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_call": 0, 2024-03-16T07:26:16.072 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_watch": 0, 2024-03-16T07:26:16.072 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_notify": 0, 2024-03-16T07:26:16.072 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_src_cmpxattr": 0, 2024-03-16T07:26:16.072 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_pgls": 0, 2024-03-16T07:26:16.072 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_pgls_filter": 0, 2024-03-16T07:26:16.072 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_other": 0, 2024-03-16T07:26:16.072 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_active": 0, 2024-03-16T07:26:16.072 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_send": 0, 2024-03-16T07:26:16.072 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_resend": 0, 2024-03-16T07:26:16.072 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_ping": 0, 2024-03-16T07:26:16.073 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_active": 0, 2024-03-16T07:26:16.073 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_send": 0, 2024-03-16T07:26:16.073 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_resend": 0, 2024-03-16T07:26:16.073 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_active": 0, 2024-03-16T07:26:16.073 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_send": 0, 2024-03-16T07:26:16.073 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_resend": 0, 2024-03-16T07:26:16.073 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_active": 0, 2024-03-16T07:26:16.073 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_send": 0, 2024-03-16T07:26:16.073 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_resend": 0, 2024-03-16T07:26:16.073 INFO:teuthology.orchestra.run.smithi049.stdout: "command_active": 0, 2024-03-16T07:26:16.073 INFO:teuthology.orchestra.run.smithi049.stdout: "command_send": 0, 2024-03-16T07:26:16.073 INFO:teuthology.orchestra.run.smithi049.stdout: "command_resend": 0, 2024-03-16T07:26:16.073 INFO:teuthology.orchestra.run.smithi049.stdout: "map_epoch": 0, 2024-03-16T07:26:16.073 INFO:teuthology.orchestra.run.smithi049.stdout: "map_full": 0, 2024-03-16T07:26:16.073 INFO:teuthology.orchestra.run.smithi049.stdout: "map_inc": 0, 2024-03-16T07:26:16.074 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_sessions": 0, 2024-03-16T07:26:16.074 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_session_open": 0, 2024-03-16T07:26:16.074 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_session_close": 0, 2024-03-16T07:26:16.074 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_laggy": 0, 2024-03-16T07:26:16.074 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_wr": 0, 2024-03-16T07:26:16.074 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_rd": 0, 2024-03-16T07:26:16.074 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_del": 0 2024-03-16T07:26:16.074 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:16.074 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:16.074 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:26:16.074 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-msgr_dispatch_throttler-client": [ 2024-03-16T07:26:16.074 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:26:16.074 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:26:16.074 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:26:16.074 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:26:16.075 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-03-16T07:26:16.075 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:26:16.075 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 18, 2024-03-16T07:26:16.075 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 63833, 2024-03-16T07:26:16.075 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:26:16.075 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 18, 2024-03-16T07:26:16.075 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:26:16.075 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:26:16.075 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 18, 2024-03-16T07:26:16.075 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 63833, 2024-03-16T07:26:16.075 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:26:16.075 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:26:16.075 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:26:16.075 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:26:16.075 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:16.075 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:16.075 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:16.076 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:26:16.076 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-msgr_dispatch_throttler-radosclient": [ 2024-03-16T07:26:16.076 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:26:16.076 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:26:16.076 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:26:16.076 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:26:16.076 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-03-16T07:26:16.076 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:26:16.076 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 12, 2024-03-16T07:26:16.076 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 276329, 2024-03-16T07:26:16.076 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:26:16.076 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 12, 2024-03-16T07:26:16.076 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:26:16.076 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:26:16.076 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 12, 2024-03-16T07:26:16.077 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 276329, 2024-03-16T07:26:16.077 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:26:16.077 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:26:16.077 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:26:16.077 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:26:16.077 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:16.077 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:16.077 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:16.077 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:26:16.077 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-objecter_bytes": [ 2024-03-16T07:26:16.077 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:26:16.077 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:26:16.077 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:26:16.077 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:26:16.077 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-03-16T07:26:16.077 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:26:16.078 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 0, 2024-03-16T07:26:16.078 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 0, 2024-03-16T07:26:16.078 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:26:16.078 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 0, 2024-03-16T07:26:16.078 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:26:16.078 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:26:16.078 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 0, 2024-03-16T07:26:16.078 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 0, 2024-03-16T07:26:16.078 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:26:16.078 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:26:16.078 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:26:16.078 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:26:16.078 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:16.078 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:16.078 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:16.079 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:26:16.079 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-objecter_ops": [ 2024-03-16T07:26:16.079 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:26:16.079 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:26:16.079 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:26:16.079 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:26:16.079 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 1024, 2024-03-16T07:26:16.079 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:26:16.079 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 0, 2024-03-16T07:26:16.079 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 0, 2024-03-16T07:26:16.079 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:26:16.079 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 0, 2024-03-16T07:26:16.079 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:26:16.079 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:26:16.079 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 0, 2024-03-16T07:26:16.079 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 0, 2024-03-16T07:26:16.079 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:26:16.080 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:26:16.080 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:26:16.080 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:26:16.080 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:16.080 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:16.080 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:16.080 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2024-03-16T07:26:16.080 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-03-16T07:26:16.081 DEBUG:tasks.cephfs.test_mirroring:command returned={ "AsyncMessenger::Worker": [ { "labels": { "id": "0" }, "counters": { "msgr_connection_ready_timeouts": 0, "msgr_connection_idle_timeouts": 0 } }, { "labels": { "id": "1" }, "counters": { "msgr_connection_ready_timeouts": 0, "msgr_connection_idle_timeouts": 0 } }, { "labels": { "id": "2" }, "counters": { "msgr_connection_ready_timeouts": 0, "msgr_connection_idle_timeouts": 0 } } ], "AsyncMessenger::Worker-0": [ { "labels": {}, "counters": { "msgr_recv_messages": 2, "msgr_send_messages": 14, "msgr_recv_bytes": 288, "msgr_send_bytes": 162208, "msgr_created_connections": 4, "msgr_active_connections": 2, "msgr_running_total_time": 0.159432900, "msgr_running_send_time": 0.032948393, "msgr_running_recv_time": 0.111513973, "msgr_running_fast_dispatch_time": 0.000000000, "msgr_send_messages_queue_lat": { "avgcount": 13, "sum": 0.119693013, "avgtime": 0.009207154 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "msgr_recv_encrypted_bytes": 288, "msgr_send_encrypted_bytes": 162208 } } ], "AsyncMessenger::Worker-1": [ { "labels": {}, "counters": { "msgr_recv_messages": 18, "msgr_send_messages": 3, "msgr_recv_bytes": 66272, "msgr_send_bytes": 464, "msgr_created_connections": 3, "msgr_active_connections": 0, "msgr_running_total_time": 0.200256385, "msgr_running_send_time": 0.001134443, "msgr_running_recv_time": 0.137657451, "msgr_running_fast_dispatch_time": 0.060245166, "msgr_send_messages_queue_lat": { "avgcount": 3, "sum": 0.054357270, "avgtime": 0.018119090 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "msgr_recv_encrypted_bytes": 66272, "msgr_send_encrypted_bytes": 464 } } ], "AsyncMessenger::Worker-2": [ { "labels": {}, "counters": { "msgr_recv_messages": 13, "msgr_send_messages": 6, "msgr_recv_bytes": 278496, "msgr_send_bytes": 928, "msgr_created_connections": 2, "msgr_active_connections": 1, "msgr_running_total_time": 0.191712741, "msgr_running_send_time": 0.004178985, "msgr_running_recv_time": 0.385961315, "msgr_running_fast_dispatch_time": 0.000000000, "msgr_send_messages_queue_lat": { "avgcount": 6, "sum": 0.158362306, "avgtime": 0.026393717 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "msgr_recv_encrypted_bytes": 278496, "msgr_send_encrypted_bytes": 928 } } ], "cct": [ { "labels": {}, "counters": { "total_workers": 0, "unhealthy_workers": 0 } } ], "cephfs_mirror": [ { "labels": {}, "counters": { "mirrored_filesystems": 1, "mirror_enable_failures": 0 } } ], "cephfs_mirror_mirrored_filesystems": [ { "labels": { "filesystem": "cephfs" }, "counters": { "mirroring_peers": 0, "directory_count": 1 } } ], "mempool": [ { "labels": {}, "counters": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_cache_buffer_bytes": 0, "bluestore_cache_buffer_items": 0, "bluestore_extent_bytes": 0, "bluestore_extent_items": 0, "bluestore_blob_bytes": 0, "bluestore_blob_items": 0, "bluestore_shared_blob_bytes": 0, "bluestore_shared_blob_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_items": 0, "bluefs_bytes": 0, "bluefs_items": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "buffer_anon_bytes": 182719, "buffer_anon_items": 53, "buffer_meta_bytes": 0, "buffer_meta_items": 0, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 18440, "osdmap_items": 176, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "mds_co_bytes": 0, "mds_co_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 } } ], "objecter": [ { "labels": {}, "counters": { "op_active": 0, "op_laggy": 0, "op_send": 0, "op_send_bytes": 0, "op_resend": 0, "op_reply": 0, "op_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "op_inflight": 0, "oplen_avg": { "avgcount": 0, "sum": 0 }, "op": 0, "op_r": 0, "op_w": 0, "op_rmw": 0, "op_pg": 0, "osdop_stat": 0, "osdop_create": 0, "osdop_read": 0, "osdop_write": 0, "osdop_writefull": 0, "osdop_writesame": 0, "osdop_append": 0, "osdop_zero": 0, "osdop_truncate": 0, "osdop_delete": 0, "osdop_mapext": 0, "osdop_sparse_read": 0, "osdop_clonerange": 0, "osdop_getxattr": 0, "osdop_setxattr": 0, "osdop_cmpxattr": 0, "osdop_rmxattr": 0, "osdop_resetxattrs": 0, "osdop_call": 0, "osdop_watch": 0, "osdop_notify": 0, "osdop_src_cmpxattr": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_other": 0, "linger_active": 0, "linger_send": 0, "linger_resend": 0, "linger_ping": 0, "poolop_active": 0, "poolop_send": 0, "poolop_resend": 0, "poolstat_active": 0, "poolstat_send": 0, "poolstat_resend": 0, "statfs_active": 0, "statfs_send": 0, "statfs_resend": 0, "command_active": 0, "command_send": 0, "command_resend": 0, "map_epoch": 0, "map_full": 0, "map_inc": 0, "osd_sessions": 0, "osd_session_open": 0, "osd_session_close": 0, "osd_laggy": 0, "omap_wr": 0, "omap_rd": 0, "omap_del": 0 } } ], "throttle-msgr_dispatch_throttler-client": [ { "labels": {}, "counters": { "val": 0, "max": 104857600, "get_started": 0, "get": 18, "get_sum": 63833, "get_or_fail_fail": 0, "get_or_fail_success": 18, "take": 0, "take_sum": 0, "put": 18, "put_sum": 63833, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ], "throttle-msgr_dispatch_throttler-radosclient": [ { "labels": {}, "counters": { "val": 0, "max": 104857600, "get_started": 0, "get": 12, "get_sum": 276329, "get_or_fail_fail": 0, "get_or_fail_success": 12, "take": 0, "take_sum": 0, "put": 12, "put_sum": 276329, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ], "throttle-objecter_bytes": [ { "labels": {}, "counters": { "val": 0, "max": 104857600, "get_started": 0, "get": 0, "get_sum": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "take": 0, "take_sum": 0, "put": 0, "put_sum": 0, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ], "throttle-objecter_ops": [ { "labels": {}, "counters": { "val": 0, "max": 1024, "get_started": 0, "get": 0, "get_sum": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "take": 0, "take_sum": 0, "put": 0, "put_sum": 0, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ] } 2024-03-16T07:26:16.081 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-03-16T07:26:16.081 DEBUG:teuthology.orchestra.run.smithi049:mirror status for fs: cephfs> ceph --admin-daemon /var/run/ceph/cephfs-mirror.asok fs mirror status cephfs@2 2024-03-16T07:26:16.175 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-03-16T07:26:16.175 INFO:teuthology.orchestra.run.smithi049.stdout: "rados_inst": "172.21.15.49:0/3295617512", 2024-03-16T07:26:16.175 INFO:teuthology.orchestra.run.smithi049.stdout: "peers": {}, 2024-03-16T07:26:16.175 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_dirs": { 2024-03-16T07:26:16.175 INFO:teuthology.orchestra.run.smithi049.stdout: "dir_count": 1 2024-03-16T07:26:16.175 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:16.175 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-03-16T07:26:16.183 DEBUG:tasks.cephfs.test_mirroring:command returned={ "rados_inst": "172.21.15.49:0/3295617512", "peers": {}, "snap_dirs": { "dir_count": 1 } } 2024-03-16T07:26:16.183 DEBUG:tasks.cephfs.test_mirroring:initial dir_count=1 2024-03-16T07:26:16.183 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snapshot mirror add cephfs /d1/d4/ 2024-03-16T07:26:16.548 INFO:teuthology.orchestra.run.smithi049.stdout:{} 2024-03-16T07:26:26.565 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-03-16T07:26:26.566 DEBUG:teuthology.orchestra.run.smithi049:mirror status for fs: cephfs> ceph --admin-daemon /var/run/ceph/cephfs-mirror.asok fs mirror status cephfs@2 2024-03-16T07:26:26.661 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-03-16T07:26:26.661 INFO:teuthology.orchestra.run.smithi049.stdout: "rados_inst": "172.21.15.49:0/3295617512", 2024-03-16T07:26:26.661 INFO:teuthology.orchestra.run.smithi049.stdout: "peers": {}, 2024-03-16T07:26:26.661 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_dirs": { 2024-03-16T07:26:26.661 INFO:teuthology.orchestra.run.smithi049.stdout: "dir_count": 2 2024-03-16T07:26:26.661 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:26.661 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-03-16T07:26:26.668 DEBUG:tasks.cephfs.test_mirroring:command returned={ "rados_inst": "172.21.15.49:0/3295617512", "peers": {}, "snap_dirs": { "dir_count": 2 } } 2024-03-16T07:26:26.668 DEBUG:tasks.cephfs.test_mirroring:new dir_count=2 2024-03-16T07:26:26.668 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-03-16T07:26:26.669 DEBUG:teuthology.orchestra.run.smithi049:counter dump for fs: cephfs> ceph --admin-daemon /var/run/ceph/cephfs-mirror.asok counter dump 2024-03-16T07:26:26.772 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-03-16T07:26:26.773 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker": [ 2024-03-16T07:26:26.773 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:26:26.773 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:26:26.773 INFO:teuthology.orchestra.run.smithi049.stdout: "id": "0" 2024-03-16T07:26:26.773 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:26:26.773 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:26:26.773 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_ready_timeouts": 0, 2024-03-16T07:26:26.773 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_idle_timeouts": 0 2024-03-16T07:26:26.773 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:26.773 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:26:26.773 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:26:26.773 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:26:26.773 INFO:teuthology.orchestra.run.smithi049.stdout: "id": "1" 2024-03-16T07:26:26.773 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:26:26.774 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:26:26.774 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_ready_timeouts": 0, 2024-03-16T07:26:26.774 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_idle_timeouts": 0 2024-03-16T07:26:26.774 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:26.774 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:26:26.774 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:26:26.774 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:26:26.774 INFO:teuthology.orchestra.run.smithi049.stdout: "id": "2" 2024-03-16T07:26:26.774 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:26:26.774 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:26:26.774 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_ready_timeouts": 0, 2024-03-16T07:26:26.774 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_idle_timeouts": 0 2024-03-16T07:26:26.774 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:26.774 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:26.774 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:26:26.775 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-0": [ 2024-03-16T07:26:26.775 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:26:26.775 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:26:26.775 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:26:26.775 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 2, 2024-03-16T07:26:26.775 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 16, 2024-03-16T07:26:26.775 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 288, 2024-03-16T07:26:26.775 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 162768, 2024-03-16T07:26:26.775 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 4, 2024-03-16T07:26:26.775 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 2, 2024-03-16T07:26:26.775 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 0.160515952, 2024-03-16T07:26:26.775 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.033941544, 2024-03-16T07:26:26.775 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 0.111513973, 2024-03-16T07:26:26.775 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-03-16T07:26:26.775 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T07:26:26.775 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 15, 2024-03-16T07:26:26.775 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.120049413, 2024-03-16T07:26:26.776 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.008003294 2024-03-16T07:26:26.776 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:26:26.776 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-03-16T07:26:26.776 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:26:26.776 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:26:26.776 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:26:26.776 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:26:26.776 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 288, 2024-03-16T07:26:26.776 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 162768 2024-03-16T07:26:26.776 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:26.776 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:26.776 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:26:26.776 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-1": [ 2024-03-16T07:26:26.776 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:26:26.776 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:26:26.777 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:26:26.777 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 18, 2024-03-16T07:26:26.777 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 3, 2024-03-16T07:26:26.777 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 66272, 2024-03-16T07:26:26.777 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 464, 2024-03-16T07:26:26.777 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 3, 2024-03-16T07:26:26.777 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 0, 2024-03-16T07:26:26.777 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 0.200602499, 2024-03-16T07:26:26.777 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.001184412, 2024-03-16T07:26:26.777 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 0.137790402, 2024-03-16T07:26:26.777 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.060245166, 2024-03-16T07:26:26.777 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T07:26:26.777 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 3, 2024-03-16T07:26:26.777 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.054357270, 2024-03-16T07:26:26.777 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.018119090 2024-03-16T07:26:26.778 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:26:26.778 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-03-16T07:26:26.778 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:26:26.778 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:26:26.778 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:26:26.778 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:26:26.778 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 66272, 2024-03-16T07:26:26.778 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 464 2024-03-16T07:26:26.778 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:26.778 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:26.778 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:26:26.778 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-2": [ 2024-03-16T07:26:26.778 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:26:26.778 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:26:26.778 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:26:26.779 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 13, 2024-03-16T07:26:26.779 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 6, 2024-03-16T07:26:26.779 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 278496, 2024-03-16T07:26:26.779 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 928, 2024-03-16T07:26:26.779 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 2, 2024-03-16T07:26:26.779 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 1, 2024-03-16T07:26:26.779 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 0.192244271, 2024-03-16T07:26:26.779 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.004238718, 2024-03-16T07:26:26.779 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 0.386103180, 2024-03-16T07:26:26.779 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-03-16T07:26:26.779 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T07:26:26.779 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 6, 2024-03-16T07:26:26.779 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.158362306, 2024-03-16T07:26:26.779 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.026393717 2024-03-16T07:26:26.779 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:26:26.779 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-03-16T07:26:26.780 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:26:26.780 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:26:26.780 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:26:26.780 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:26:26.780 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 278496, 2024-03-16T07:26:26.780 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 928 2024-03-16T07:26:26.780 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:26.780 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:26.780 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:26:26.780 INFO:teuthology.orchestra.run.smithi049.stdout: "cct": [ 2024-03-16T07:26:26.780 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:26:26.780 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:26:26.780 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:26:26.780 INFO:teuthology.orchestra.run.smithi049.stdout: "total_workers": 0, 2024-03-16T07:26:26.780 INFO:teuthology.orchestra.run.smithi049.stdout: "unhealthy_workers": 0 2024-03-16T07:26:26.781 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:26.781 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:26.781 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:26:26.781 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs_mirror": [ 2024-03-16T07:26:26.781 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:26:26.781 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:26:26.781 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:26:26.781 INFO:teuthology.orchestra.run.smithi049.stdout: "mirrored_filesystems": 1, 2024-03-16T07:26:26.781 INFO:teuthology.orchestra.run.smithi049.stdout: "mirror_enable_failures": 0 2024-03-16T07:26:26.781 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:26.781 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:26.781 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:26:26.781 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs_mirror_mirrored_filesystems": [ 2024-03-16T07:26:26.781 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:26:26.781 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:26:26.781 INFO:teuthology.orchestra.run.smithi049.stdout: "filesystem": "cephfs" 2024-03-16T07:26:26.782 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:26:26.782 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:26:26.782 INFO:teuthology.orchestra.run.smithi049.stdout: "mirroring_peers": 0, 2024-03-16T07:26:26.782 INFO:teuthology.orchestra.run.smithi049.stdout: "directory_count": 2 2024-03-16T07:26:26.782 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:26.782 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:26.782 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:26:26.782 INFO:teuthology.orchestra.run.smithi049.stdout: "mempool": [ 2024-03-16T07:26:26.782 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:26:26.782 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:26:26.782 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:26:26.782 INFO:teuthology.orchestra.run.smithi049.stdout: "bloom_filter_bytes": 0, 2024-03-16T07:26:26.782 INFO:teuthology.orchestra.run.smithi049.stdout: "bloom_filter_items": 0, 2024-03-16T07:26:26.782 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_alloc_bytes": 0, 2024-03-16T07:26:26.782 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_alloc_items": 0, 2024-03-16T07:26:26.782 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_data_bytes": 0, 2024-03-16T07:26:26.783 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_data_items": 0, 2024-03-16T07:26:26.783 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_onode_bytes": 0, 2024-03-16T07:26:26.783 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_onode_items": 0, 2024-03-16T07:26:26.783 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_meta_bytes": 0, 2024-03-16T07:26:26.783 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_meta_items": 0, 2024-03-16T07:26:26.783 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_other_bytes": 0, 2024-03-16T07:26:26.783 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_other_items": 0, 2024-03-16T07:26:26.783 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_buffer_bytes": 0, 2024-03-16T07:26:26.783 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_buffer_items": 0, 2024-03-16T07:26:26.783 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_extent_bytes": 0, 2024-03-16T07:26:26.783 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_extent_items": 0, 2024-03-16T07:26:26.783 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_blob_bytes": 0, 2024-03-16T07:26:26.783 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_blob_items": 0, 2024-03-16T07:26:26.783 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_shared_blob_bytes": 0, 2024-03-16T07:26:26.783 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_shared_blob_items": 0, 2024-03-16T07:26:26.783 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_inline_bl_bytes": 0, 2024-03-16T07:26:26.784 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_inline_bl_items": 0, 2024-03-16T07:26:26.784 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_fsck_bytes": 0, 2024-03-16T07:26:26.784 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_fsck_items": 0, 2024-03-16T07:26:26.784 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_txc_bytes": 0, 2024-03-16T07:26:26.784 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_txc_items": 0, 2024-03-16T07:26:26.784 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_deferred_bytes": 0, 2024-03-16T07:26:26.784 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_deferred_items": 0, 2024-03-16T07:26:26.784 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_bytes": 0, 2024-03-16T07:26:26.784 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_items": 0, 2024-03-16T07:26:26.784 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_bytes": 0, 2024-03-16T07:26:26.784 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_items": 0, 2024-03-16T07:26:26.784 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_reader_bytes": 0, 2024-03-16T07:26:26.784 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_reader_items": 0, 2024-03-16T07:26:26.784 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_writer_bytes": 0, 2024-03-16T07:26:26.784 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_writer_items": 0, 2024-03-16T07:26:26.784 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_anon_bytes": 182719, 2024-03-16T07:26:26.785 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_anon_items": 53, 2024-03-16T07:26:26.785 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_meta_bytes": 0, 2024-03-16T07:26:26.785 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_meta_items": 0, 2024-03-16T07:26:26.785 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_bytes": 0, 2024-03-16T07:26:26.785 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_items": 0, 2024-03-16T07:26:26.785 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_mapbl_bytes": 0, 2024-03-16T07:26:26.785 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_mapbl_items": 0, 2024-03-16T07:26:26.785 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pglog_bytes": 0, 2024-03-16T07:26:26.785 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pglog_items": 0, 2024-03-16T07:26:26.785 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_bytes": 18440, 2024-03-16T07:26:26.785 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_items": 176, 2024-03-16T07:26:26.785 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_mapping_bytes": 0, 2024-03-16T07:26:26.785 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_mapping_items": 0, 2024-03-16T07:26:26.785 INFO:teuthology.orchestra.run.smithi049.stdout: "pgmap_bytes": 0, 2024-03-16T07:26:26.785 INFO:teuthology.orchestra.run.smithi049.stdout: "pgmap_items": 0, 2024-03-16T07:26:26.785 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_co_bytes": 0, 2024-03-16T07:26:26.786 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_co_items": 0, 2024-03-16T07:26:26.786 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_1_bytes": 0, 2024-03-16T07:26:26.786 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_1_items": 0, 2024-03-16T07:26:26.786 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_2_bytes": 0, 2024-03-16T07:26:26.786 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_2_items": 0 2024-03-16T07:26:26.786 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:26.786 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:26.786 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:26:26.786 INFO:teuthology.orchestra.run.smithi049.stdout: "objecter": [ 2024-03-16T07:26:26.786 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:26:26.786 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:26:26.786 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:26:26.786 INFO:teuthology.orchestra.run.smithi049.stdout: "op_active": 0, 2024-03-16T07:26:26.786 INFO:teuthology.orchestra.run.smithi049.stdout: "op_laggy": 0, 2024-03-16T07:26:26.786 INFO:teuthology.orchestra.run.smithi049.stdout: "op_send": 0, 2024-03-16T07:26:26.786 INFO:teuthology.orchestra.run.smithi049.stdout: "op_send_bytes": 0, 2024-03-16T07:26:26.786 INFO:teuthology.orchestra.run.smithi049.stdout: "op_resend": 0, 2024-03-16T07:26:26.787 INFO:teuthology.orchestra.run.smithi049.stdout: "op_reply": 0, 2024-03-16T07:26:26.787 INFO:teuthology.orchestra.run.smithi049.stdout: "op_latency": { 2024-03-16T07:26:26.787 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:26:26.787 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:26:26.787 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:26:26.787 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:26:26.787 INFO:teuthology.orchestra.run.smithi049.stdout: "op_inflight": 0, 2024-03-16T07:26:26.787 INFO:teuthology.orchestra.run.smithi049.stdout: "oplen_avg": { 2024-03-16T07:26:26.787 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:26:26.787 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0 2024-03-16T07:26:26.787 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:26:26.787 INFO:teuthology.orchestra.run.smithi049.stdout: "op": 0, 2024-03-16T07:26:26.787 INFO:teuthology.orchestra.run.smithi049.stdout: "op_r": 0, 2024-03-16T07:26:26.787 INFO:teuthology.orchestra.run.smithi049.stdout: "op_w": 0, 2024-03-16T07:26:26.787 INFO:teuthology.orchestra.run.smithi049.stdout: "op_rmw": 0, 2024-03-16T07:26:26.788 INFO:teuthology.orchestra.run.smithi049.stdout: "op_pg": 0, 2024-03-16T07:26:26.788 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_stat": 0, 2024-03-16T07:26:26.788 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_create": 0, 2024-03-16T07:26:26.788 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_read": 0, 2024-03-16T07:26:26.788 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_write": 0, 2024-03-16T07:26:26.788 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_writefull": 0, 2024-03-16T07:26:26.788 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_writesame": 0, 2024-03-16T07:26:26.788 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_append": 0, 2024-03-16T07:26:26.788 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_zero": 0, 2024-03-16T07:26:26.788 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_truncate": 0, 2024-03-16T07:26:26.788 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_delete": 0, 2024-03-16T07:26:26.788 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_mapext": 0, 2024-03-16T07:26:26.788 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_sparse_read": 0, 2024-03-16T07:26:26.788 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_clonerange": 0, 2024-03-16T07:26:26.788 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_getxattr": 0, 2024-03-16T07:26:26.788 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_setxattr": 0, 2024-03-16T07:26:26.789 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_cmpxattr": 0, 2024-03-16T07:26:26.789 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_rmxattr": 0, 2024-03-16T07:26:26.789 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_resetxattrs": 0, 2024-03-16T07:26:26.789 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_call": 0, 2024-03-16T07:26:26.789 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_watch": 0, 2024-03-16T07:26:26.789 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_notify": 0, 2024-03-16T07:26:26.789 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_src_cmpxattr": 0, 2024-03-16T07:26:26.789 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_pgls": 0, 2024-03-16T07:26:26.789 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_pgls_filter": 0, 2024-03-16T07:26:26.789 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_other": 0, 2024-03-16T07:26:26.789 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_active": 0, 2024-03-16T07:26:26.789 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_send": 0, 2024-03-16T07:26:26.789 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_resend": 0, 2024-03-16T07:26:26.789 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_ping": 0, 2024-03-16T07:26:26.789 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_active": 0, 2024-03-16T07:26:26.790 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_send": 0, 2024-03-16T07:26:26.790 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_resend": 0, 2024-03-16T07:26:26.790 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_active": 0, 2024-03-16T07:26:26.790 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_send": 0, 2024-03-16T07:26:26.790 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_resend": 0, 2024-03-16T07:26:26.790 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_active": 0, 2024-03-16T07:26:26.790 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_send": 0, 2024-03-16T07:26:26.790 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_resend": 0, 2024-03-16T07:26:26.790 INFO:teuthology.orchestra.run.smithi049.stdout: "command_active": 0, 2024-03-16T07:26:26.790 INFO:teuthology.orchestra.run.smithi049.stdout: "command_send": 0, 2024-03-16T07:26:26.790 INFO:teuthology.orchestra.run.smithi049.stdout: "command_resend": 0, 2024-03-16T07:26:26.790 INFO:teuthology.orchestra.run.smithi049.stdout: "map_epoch": 0, 2024-03-16T07:26:26.790 INFO:teuthology.orchestra.run.smithi049.stdout: "map_full": 0, 2024-03-16T07:26:26.790 INFO:teuthology.orchestra.run.smithi049.stdout: "map_inc": 0, 2024-03-16T07:26:26.791 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_sessions": 0, 2024-03-16T07:26:26.791 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_session_open": 0, 2024-03-16T07:26:26.791 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_session_close": 0, 2024-03-16T07:26:26.791 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_laggy": 0, 2024-03-16T07:26:26.791 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_wr": 0, 2024-03-16T07:26:26.791 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_rd": 0, 2024-03-16T07:26:26.791 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_del": 0 2024-03-16T07:26:26.791 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:26.791 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:26.791 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:26:26.791 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-msgr_dispatch_throttler-client": [ 2024-03-16T07:26:26.791 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:26:26.791 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:26:26.791 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:26:26.791 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:26:26.792 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-03-16T07:26:26.792 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:26:26.792 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 18, 2024-03-16T07:26:26.792 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 63833, 2024-03-16T07:26:26.792 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:26:26.792 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 18, 2024-03-16T07:26:26.792 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:26:26.792 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:26:26.792 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 18, 2024-03-16T07:26:26.792 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 63833, 2024-03-16T07:26:26.792 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:26:26.792 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:26:26.792 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:26:26.792 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:26:26.792 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:26.792 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:26.793 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:26.793 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:26:26.793 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-msgr_dispatch_throttler-radosclient": [ 2024-03-16T07:26:26.793 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:26:26.793 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:26:26.793 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:26:26.793 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:26:26.793 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-03-16T07:26:26.793 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:26:26.793 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 12, 2024-03-16T07:26:26.793 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 276329, 2024-03-16T07:26:26.793 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:26:26.793 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 12, 2024-03-16T07:26:26.793 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:26:26.793 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:26:26.793 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 12, 2024-03-16T07:26:26.793 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 276329, 2024-03-16T07:26:26.794 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:26:26.794 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:26:26.794 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:26:26.794 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:26:26.794 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:26.794 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:26.794 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:26.794 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:26:26.794 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-objecter_bytes": [ 2024-03-16T07:26:26.794 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:26:26.794 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:26:26.794 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:26:26.794 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:26:26.794 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-03-16T07:26:26.794 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:26:26.795 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 0, 2024-03-16T07:26:26.795 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 0, 2024-03-16T07:26:26.795 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:26:26.795 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 0, 2024-03-16T07:26:26.795 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:26:26.795 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:26:26.795 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 0, 2024-03-16T07:26:26.795 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 0, 2024-03-16T07:26:26.795 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:26:26.795 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:26:26.795 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:26:26.795 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:26:26.795 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:26.795 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:26.795 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:26.795 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:26:26.796 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-objecter_ops": [ 2024-03-16T07:26:26.796 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:26:26.796 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:26:26.796 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:26:26.796 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:26:26.796 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 1024, 2024-03-16T07:26:26.796 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:26:26.796 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 0, 2024-03-16T07:26:26.796 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 0, 2024-03-16T07:26:26.796 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:26:26.796 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 0, 2024-03-16T07:26:26.796 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:26:26.796 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:26:26.796 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 0, 2024-03-16T07:26:26.796 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 0, 2024-03-16T07:26:26.796 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:26:26.797 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:26:26.797 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:26:26.797 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:26:26.797 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:26.797 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:26.797 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:26.797 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2024-03-16T07:26:26.797 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-03-16T07:26:26.798 DEBUG:tasks.cephfs.test_mirroring:command returned={ "AsyncMessenger::Worker": [ { "labels": { "id": "0" }, "counters": { "msgr_connection_ready_timeouts": 0, "msgr_connection_idle_timeouts": 0 } }, { "labels": { "id": "1" }, "counters": { "msgr_connection_ready_timeouts": 0, "msgr_connection_idle_timeouts": 0 } }, { "labels": { "id": "2" }, "counters": { "msgr_connection_ready_timeouts": 0, "msgr_connection_idle_timeouts": 0 } } ], "AsyncMessenger::Worker-0": [ { "labels": {}, "counters": { "msgr_recv_messages": 2, "msgr_send_messages": 16, "msgr_recv_bytes": 288, "msgr_send_bytes": 162768, "msgr_created_connections": 4, "msgr_active_connections": 2, "msgr_running_total_time": 0.160515952, "msgr_running_send_time": 0.033941544, "msgr_running_recv_time": 0.111513973, "msgr_running_fast_dispatch_time": 0.000000000, "msgr_send_messages_queue_lat": { "avgcount": 15, "sum": 0.120049413, "avgtime": 0.008003294 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "msgr_recv_encrypted_bytes": 288, "msgr_send_encrypted_bytes": 162768 } } ], "AsyncMessenger::Worker-1": [ { "labels": {}, "counters": { "msgr_recv_messages": 18, "msgr_send_messages": 3, "msgr_recv_bytes": 66272, "msgr_send_bytes": 464, "msgr_created_connections": 3, "msgr_active_connections": 0, "msgr_running_total_time": 0.200602499, "msgr_running_send_time": 0.001184412, "msgr_running_recv_time": 0.137790402, "msgr_running_fast_dispatch_time": 0.060245166, "msgr_send_messages_queue_lat": { "avgcount": 3, "sum": 0.054357270, "avgtime": 0.018119090 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "msgr_recv_encrypted_bytes": 66272, "msgr_send_encrypted_bytes": 464 } } ], "AsyncMessenger::Worker-2": [ { "labels": {}, "counters": { "msgr_recv_messages": 13, "msgr_send_messages": 6, "msgr_recv_bytes": 278496, "msgr_send_bytes": 928, "msgr_created_connections": 2, "msgr_active_connections": 1, "msgr_running_total_time": 0.192244271, "msgr_running_send_time": 0.004238718, "msgr_running_recv_time": 0.386103180, "msgr_running_fast_dispatch_time": 0.000000000, "msgr_send_messages_queue_lat": { "avgcount": 6, "sum": 0.158362306, "avgtime": 0.026393717 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "msgr_recv_encrypted_bytes": 278496, "msgr_send_encrypted_bytes": 928 } } ], "cct": [ { "labels": {}, "counters": { "total_workers": 0, "unhealthy_workers": 0 } } ], "cephfs_mirror": [ { "labels": {}, "counters": { "mirrored_filesystems": 1, "mirror_enable_failures": 0 } } ], "cephfs_mirror_mirrored_filesystems": [ { "labels": { "filesystem": "cephfs" }, "counters": { "mirroring_peers": 0, "directory_count": 2 } } ], "mempool": [ { "labels": {}, "counters": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_cache_buffer_bytes": 0, "bluestore_cache_buffer_items": 0, "bluestore_extent_bytes": 0, "bluestore_extent_items": 0, "bluestore_blob_bytes": 0, "bluestore_blob_items": 0, "bluestore_shared_blob_bytes": 0, "bluestore_shared_blob_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_items": 0, "bluefs_bytes": 0, "bluefs_items": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "buffer_anon_bytes": 182719, "buffer_anon_items": 53, "buffer_meta_bytes": 0, "buffer_meta_items": 0, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 18440, "osdmap_items": 176, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "mds_co_bytes": 0, "mds_co_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 } } ], "objecter": [ { "labels": {}, "counters": { "op_active": 0, "op_laggy": 0, "op_send": 0, "op_send_bytes": 0, "op_resend": 0, "op_reply": 0, "op_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "op_inflight": 0, "oplen_avg": { "avgcount": 0, "sum": 0 }, "op": 0, "op_r": 0, "op_w": 0, "op_rmw": 0, "op_pg": 0, "osdop_stat": 0, "osdop_create": 0, "osdop_read": 0, "osdop_write": 0, "osdop_writefull": 0, "osdop_writesame": 0, "osdop_append": 0, "osdop_zero": 0, "osdop_truncate": 0, "osdop_delete": 0, "osdop_mapext": 0, "osdop_sparse_read": 0, "osdop_clonerange": 0, "osdop_getxattr": 0, "osdop_setxattr": 0, "osdop_cmpxattr": 0, "osdop_rmxattr": 0, "osdop_resetxattrs": 0, "osdop_call": 0, "osdop_watch": 0, "osdop_notify": 0, "osdop_src_cmpxattr": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_other": 0, "linger_active": 0, "linger_send": 0, "linger_resend": 0, "linger_ping": 0, "poolop_active": 0, "poolop_send": 0, "poolop_resend": 0, "poolstat_active": 0, "poolstat_send": 0, "poolstat_resend": 0, "statfs_active": 0, "statfs_send": 0, "statfs_resend": 0, "command_active": 0, "command_send": 0, "command_resend": 0, "map_epoch": 0, "map_full": 0, "map_inc": 0, "osd_sessions": 0, "osd_session_open": 0, "osd_session_close": 0, "osd_laggy": 0, "omap_wr": 0, "omap_rd": 0, "omap_del": 0 } } ], "throttle-msgr_dispatch_throttler-client": [ { "labels": {}, "counters": { "val": 0, "max": 104857600, "get_started": 0, "get": 18, "get_sum": 63833, "get_or_fail_fail": 0, "get_or_fail_success": 18, "take": 0, "take_sum": 0, "put": 18, "put_sum": 63833, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ], "throttle-msgr_dispatch_throttler-radosclient": [ { "labels": {}, "counters": { "val": 0, "max": 104857600, "get_started": 0, "get": 12, "get_sum": 276329, "get_or_fail_fail": 0, "get_or_fail_success": 12, "take": 0, "take_sum": 0, "put": 12, "put_sum": 276329, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ], "throttle-objecter_bytes": [ { "labels": {}, "counters": { "val": 0, "max": 104857600, "get_started": 0, "get": 0, "get_sum": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "take": 0, "take_sum": 0, "put": 0, "put_sum": 0, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ], "throttle-objecter_ops": [ { "labels": {}, "counters": { "val": 0, "max": 1024, "get_started": 0, "get": 0, "get_sum": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "take": 0, "take_sum": 0, "put": 0, "put_sum": 0, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ] } 2024-03-16T07:26:26.798 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-03-16T07:26:26.798 DEBUG:teuthology.orchestra.run.smithi049:counter dump for fs: cephfs> ceph --admin-daemon /var/run/ceph/cephfs-mirror.asok counter dump 2024-03-16T07:26:26.903 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-03-16T07:26:26.903 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker": [ 2024-03-16T07:26:26.903 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:26:26.903 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:26:26.903 INFO:teuthology.orchestra.run.smithi049.stdout: "id": "0" 2024-03-16T07:26:26.903 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:26:26.903 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:26:26.903 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_ready_timeouts": 0, 2024-03-16T07:26:26.903 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_idle_timeouts": 0 2024-03-16T07:26:26.903 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:26.903 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:26:26.903 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:26:26.903 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:26:26.904 INFO:teuthology.orchestra.run.smithi049.stdout: "id": "1" 2024-03-16T07:26:26.904 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:26:26.904 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:26:26.904 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_ready_timeouts": 0, 2024-03-16T07:26:26.904 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_idle_timeouts": 0 2024-03-16T07:26:26.904 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:26.904 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:26:26.904 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:26:26.904 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:26:26.904 INFO:teuthology.orchestra.run.smithi049.stdout: "id": "2" 2024-03-16T07:26:26.904 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:26:26.904 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:26:26.904 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_ready_timeouts": 0, 2024-03-16T07:26:26.904 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_idle_timeouts": 0 2024-03-16T07:26:26.904 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:26.904 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:26.905 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:26:26.905 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-0": [ 2024-03-16T07:26:26.905 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:26:26.905 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:26:26.905 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:26:26.905 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 2, 2024-03-16T07:26:26.905 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 16, 2024-03-16T07:26:26.905 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 288, 2024-03-16T07:26:26.905 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 162768, 2024-03-16T07:26:26.905 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 4, 2024-03-16T07:26:26.906 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 2, 2024-03-16T07:26:26.906 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 0.160515952, 2024-03-16T07:26:26.906 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.033941544, 2024-03-16T07:26:26.906 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 0.111513973, 2024-03-16T07:26:26.906 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-03-16T07:26:26.906 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T07:26:26.906 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 15, 2024-03-16T07:26:26.906 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.120049413, 2024-03-16T07:26:26.906 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.008003294 2024-03-16T07:26:26.906 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:26:26.906 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-03-16T07:26:26.906 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:26:26.906 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:26:26.907 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:26:26.907 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:26:26.907 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 288, 2024-03-16T07:26:26.907 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 162768 2024-03-16T07:26:26.907 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:26.907 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:26.907 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:26:26.907 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-1": [ 2024-03-16T07:26:26.907 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:26:26.907 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:26:26.907 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:26:26.907 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 18, 2024-03-16T07:26:26.907 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 3, 2024-03-16T07:26:26.908 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 66272, 2024-03-16T07:26:26.908 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 464, 2024-03-16T07:26:26.908 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 3, 2024-03-16T07:26:26.908 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 0, 2024-03-16T07:26:26.908 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 0.200602499, 2024-03-16T07:26:26.908 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.001184412, 2024-03-16T07:26:26.908 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 0.137790402, 2024-03-16T07:26:26.908 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.060245166, 2024-03-16T07:26:26.908 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T07:26:26.908 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 3, 2024-03-16T07:26:26.908 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.054357270, 2024-03-16T07:26:26.908 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.018119090 2024-03-16T07:26:26.908 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:26:26.908 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-03-16T07:26:26.908 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:26:26.909 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:26:26.909 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:26:26.909 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:26:26.909 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 66272, 2024-03-16T07:26:26.909 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 464 2024-03-16T07:26:26.909 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:26.909 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:26.909 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:26:26.909 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-2": [ 2024-03-16T07:26:26.909 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:26:26.909 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:26:26.909 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:26:26.909 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 13, 2024-03-16T07:26:26.909 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 6, 2024-03-16T07:26:26.910 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 278496, 2024-03-16T07:26:26.910 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 928, 2024-03-16T07:26:26.910 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 2, 2024-03-16T07:26:26.910 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 1, 2024-03-16T07:26:26.910 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 0.192244271, 2024-03-16T07:26:26.910 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.004238718, 2024-03-16T07:26:26.910 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 0.386103180, 2024-03-16T07:26:26.910 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-03-16T07:26:26.910 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T07:26:26.910 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 6, 2024-03-16T07:26:26.910 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.158362306, 2024-03-16T07:26:26.910 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.026393717 2024-03-16T07:26:26.910 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:26:26.911 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-03-16T07:26:26.911 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:26:26.911 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:26:26.911 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:26:26.911 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:26:26.911 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 278496, 2024-03-16T07:26:26.911 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 928 2024-03-16T07:26:26.911 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:26.911 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:26.911 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:26:26.911 INFO:teuthology.orchestra.run.smithi049.stdout: "cct": [ 2024-03-16T07:26:26.911 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:26:26.911 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:26:26.911 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:26:26.911 INFO:teuthology.orchestra.run.smithi049.stdout: "total_workers": 0, 2024-03-16T07:26:26.912 INFO:teuthology.orchestra.run.smithi049.stdout: "unhealthy_workers": 0 2024-03-16T07:26:26.912 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:26.912 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:26.912 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:26:26.912 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs_mirror": [ 2024-03-16T07:26:26.912 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:26:26.912 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:26:26.912 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:26:26.912 INFO:teuthology.orchestra.run.smithi049.stdout: "mirrored_filesystems": 1, 2024-03-16T07:26:26.912 INFO:teuthology.orchestra.run.smithi049.stdout: "mirror_enable_failures": 0 2024-03-16T07:26:26.912 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:26.912 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:26.912 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:26:26.912 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs_mirror_mirrored_filesystems": [ 2024-03-16T07:26:26.912 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:26:26.913 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:26:26.913 INFO:teuthology.orchestra.run.smithi049.stdout: "filesystem": "cephfs" 2024-03-16T07:26:26.913 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:26:26.913 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:26:26.913 INFO:teuthology.orchestra.run.smithi049.stdout: "mirroring_peers": 0, 2024-03-16T07:26:26.913 INFO:teuthology.orchestra.run.smithi049.stdout: "directory_count": 2 2024-03-16T07:26:26.913 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:26.913 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:26.913 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:26:26.913 INFO:teuthology.orchestra.run.smithi049.stdout: "mempool": [ 2024-03-16T07:26:26.913 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:26:26.913 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:26:26.913 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:26:26.913 INFO:teuthology.orchestra.run.smithi049.stdout: "bloom_filter_bytes": 0, 2024-03-16T07:26:26.913 INFO:teuthology.orchestra.run.smithi049.stdout: "bloom_filter_items": 0, 2024-03-16T07:26:26.914 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_alloc_bytes": 0, 2024-03-16T07:26:26.914 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_alloc_items": 0, 2024-03-16T07:26:26.914 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_data_bytes": 0, 2024-03-16T07:26:26.914 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_data_items": 0, 2024-03-16T07:26:26.914 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_onode_bytes": 0, 2024-03-16T07:26:26.914 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_onode_items": 0, 2024-03-16T07:26:26.914 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_meta_bytes": 0, 2024-03-16T07:26:26.914 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_meta_items": 0, 2024-03-16T07:26:26.914 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_other_bytes": 0, 2024-03-16T07:26:26.914 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_other_items": 0, 2024-03-16T07:26:26.914 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_buffer_bytes": 0, 2024-03-16T07:26:26.914 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_buffer_items": 0, 2024-03-16T07:26:26.914 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_extent_bytes": 0, 2024-03-16T07:26:26.914 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_extent_items": 0, 2024-03-16T07:26:26.914 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_blob_bytes": 0, 2024-03-16T07:26:26.915 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_blob_items": 0, 2024-03-16T07:26:26.915 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_shared_blob_bytes": 0, 2024-03-16T07:26:26.915 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_shared_blob_items": 0, 2024-03-16T07:26:26.915 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_inline_bl_bytes": 0, 2024-03-16T07:26:26.915 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_inline_bl_items": 0, 2024-03-16T07:26:26.915 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_fsck_bytes": 0, 2024-03-16T07:26:26.915 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_fsck_items": 0, 2024-03-16T07:26:26.915 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_txc_bytes": 0, 2024-03-16T07:26:26.915 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_txc_items": 0, 2024-03-16T07:26:26.915 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_deferred_bytes": 0, 2024-03-16T07:26:26.915 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_deferred_items": 0, 2024-03-16T07:26:26.915 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_bytes": 0, 2024-03-16T07:26:26.915 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_items": 0, 2024-03-16T07:26:26.915 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_bytes": 0, 2024-03-16T07:26:26.915 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_items": 0, 2024-03-16T07:26:26.916 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_reader_bytes": 0, 2024-03-16T07:26:26.916 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_reader_items": 0, 2024-03-16T07:26:26.916 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_writer_bytes": 0, 2024-03-16T07:26:26.916 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_writer_items": 0, 2024-03-16T07:26:26.916 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_anon_bytes": 182719, 2024-03-16T07:26:26.916 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_anon_items": 53, 2024-03-16T07:26:26.916 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_meta_bytes": 0, 2024-03-16T07:26:26.916 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_meta_items": 0, 2024-03-16T07:26:26.916 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_bytes": 0, 2024-03-16T07:26:26.916 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_items": 0, 2024-03-16T07:26:26.916 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_mapbl_bytes": 0, 2024-03-16T07:26:26.916 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_mapbl_items": 0, 2024-03-16T07:26:26.916 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pglog_bytes": 0, 2024-03-16T07:26:26.917 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pglog_items": 0, 2024-03-16T07:26:26.917 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_bytes": 18440, 2024-03-16T07:26:26.917 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_items": 176, 2024-03-16T07:26:26.917 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_mapping_bytes": 0, 2024-03-16T07:26:26.917 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_mapping_items": 0, 2024-03-16T07:26:26.917 INFO:teuthology.orchestra.run.smithi049.stdout: "pgmap_bytes": 0, 2024-03-16T07:26:26.917 INFO:teuthology.orchestra.run.smithi049.stdout: "pgmap_items": 0, 2024-03-16T07:26:26.917 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_co_bytes": 0, 2024-03-16T07:26:26.917 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_co_items": 0, 2024-03-16T07:26:26.917 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_1_bytes": 0, 2024-03-16T07:26:26.917 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_1_items": 0, 2024-03-16T07:26:26.917 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_2_bytes": 0, 2024-03-16T07:26:26.917 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_2_items": 0 2024-03-16T07:26:26.917 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:26.917 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:26.917 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:26:26.918 INFO:teuthology.orchestra.run.smithi049.stdout: "objecter": [ 2024-03-16T07:26:26.918 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:26:26.918 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:26:26.918 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:26:26.918 INFO:teuthology.orchestra.run.smithi049.stdout: "op_active": 0, 2024-03-16T07:26:26.918 INFO:teuthology.orchestra.run.smithi049.stdout: "op_laggy": 0, 2024-03-16T07:26:26.918 INFO:teuthology.orchestra.run.smithi049.stdout: "op_send": 0, 2024-03-16T07:26:26.918 INFO:teuthology.orchestra.run.smithi049.stdout: "op_send_bytes": 0, 2024-03-16T07:26:26.918 INFO:teuthology.orchestra.run.smithi049.stdout: "op_resend": 0, 2024-03-16T07:26:26.918 INFO:teuthology.orchestra.run.smithi049.stdout: "op_reply": 0, 2024-03-16T07:26:26.918 INFO:teuthology.orchestra.run.smithi049.stdout: "op_latency": { 2024-03-16T07:26:26.918 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:26:26.918 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:26:26.918 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:26:26.919 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:26:26.919 INFO:teuthology.orchestra.run.smithi049.stdout: "op_inflight": 0, 2024-03-16T07:26:26.919 INFO:teuthology.orchestra.run.smithi049.stdout: "oplen_avg": { 2024-03-16T07:26:26.919 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:26:26.919 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0 2024-03-16T07:26:26.919 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:26:26.919 INFO:teuthology.orchestra.run.smithi049.stdout: "op": 0, 2024-03-16T07:26:26.919 INFO:teuthology.orchestra.run.smithi049.stdout: "op_r": 0, 2024-03-16T07:26:26.919 INFO:teuthology.orchestra.run.smithi049.stdout: "op_w": 0, 2024-03-16T07:26:26.919 INFO:teuthology.orchestra.run.smithi049.stdout: "op_rmw": 0, 2024-03-16T07:26:26.919 INFO:teuthology.orchestra.run.smithi049.stdout: "op_pg": 0, 2024-03-16T07:26:26.919 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_stat": 0, 2024-03-16T07:26:26.919 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_create": 0, 2024-03-16T07:26:26.919 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_read": 0, 2024-03-16T07:26:26.919 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_write": 0, 2024-03-16T07:26:26.919 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_writefull": 0, 2024-03-16T07:26:26.919 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_writesame": 0, 2024-03-16T07:26:26.920 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_append": 0, 2024-03-16T07:26:26.920 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_zero": 0, 2024-03-16T07:26:26.920 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_truncate": 0, 2024-03-16T07:26:26.920 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_delete": 0, 2024-03-16T07:26:26.920 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_mapext": 0, 2024-03-16T07:26:26.920 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_sparse_read": 0, 2024-03-16T07:26:26.920 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_clonerange": 0, 2024-03-16T07:26:26.920 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_getxattr": 0, 2024-03-16T07:26:26.920 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_setxattr": 0, 2024-03-16T07:26:26.920 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_cmpxattr": 0, 2024-03-16T07:26:26.920 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_rmxattr": 0, 2024-03-16T07:26:26.920 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_resetxattrs": 0, 2024-03-16T07:26:26.920 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_call": 0, 2024-03-16T07:26:26.920 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_watch": 0, 2024-03-16T07:26:26.920 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_notify": 0, 2024-03-16T07:26:26.920 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_src_cmpxattr": 0, 2024-03-16T07:26:26.921 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_pgls": 0, 2024-03-16T07:26:26.921 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_pgls_filter": 0, 2024-03-16T07:26:26.921 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_other": 0, 2024-03-16T07:26:26.921 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_active": 0, 2024-03-16T07:26:26.921 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_send": 0, 2024-03-16T07:26:26.921 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_resend": 0, 2024-03-16T07:26:26.921 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_ping": 0, 2024-03-16T07:26:26.921 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_active": 0, 2024-03-16T07:26:26.921 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_send": 0, 2024-03-16T07:26:26.921 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_resend": 0, 2024-03-16T07:26:26.921 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_active": 0, 2024-03-16T07:26:26.921 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_send": 0, 2024-03-16T07:26:26.921 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_resend": 0, 2024-03-16T07:26:26.922 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_active": 0, 2024-03-16T07:26:26.922 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_send": 0, 2024-03-16T07:26:26.922 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_resend": 0, 2024-03-16T07:26:26.922 INFO:teuthology.orchestra.run.smithi049.stdout: "command_active": 0, 2024-03-16T07:26:26.922 INFO:teuthology.orchestra.run.smithi049.stdout: "command_send": 0, 2024-03-16T07:26:26.922 INFO:teuthology.orchestra.run.smithi049.stdout: "command_resend": 0, 2024-03-16T07:26:26.922 INFO:teuthology.orchestra.run.smithi049.stdout: "map_epoch": 0, 2024-03-16T07:26:26.922 INFO:teuthology.orchestra.run.smithi049.stdout: "map_full": 0, 2024-03-16T07:26:26.922 INFO:teuthology.orchestra.run.smithi049.stdout: "map_inc": 0, 2024-03-16T07:26:26.922 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_sessions": 0, 2024-03-16T07:26:26.922 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_session_open": 0, 2024-03-16T07:26:26.922 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_session_close": 0, 2024-03-16T07:26:26.922 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_laggy": 0, 2024-03-16T07:26:26.922 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_wr": 0, 2024-03-16T07:26:26.922 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_rd": 0, 2024-03-16T07:26:26.923 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_del": 0 2024-03-16T07:26:26.923 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:26.923 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:26.923 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:26:26.923 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-msgr_dispatch_throttler-client": [ 2024-03-16T07:26:26.923 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:26:26.923 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:26:26.923 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:26:26.923 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:26:26.923 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-03-16T07:26:26.923 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:26:26.923 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 18, 2024-03-16T07:26:26.923 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 63833, 2024-03-16T07:26:26.923 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:26:26.924 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 18, 2024-03-16T07:26:26.924 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:26:26.924 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:26:26.924 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 18, 2024-03-16T07:26:26.924 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 63833, 2024-03-16T07:26:26.924 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:26:26.924 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:26:26.924 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:26:26.924 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:26:26.924 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:26.924 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:26.924 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:26.924 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:26:26.925 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-msgr_dispatch_throttler-radosclient": [ 2024-03-16T07:26:26.925 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:26:26.925 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:26:26.925 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:26:26.925 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:26:26.925 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-03-16T07:26:26.925 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:26:26.925 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 12, 2024-03-16T07:26:26.925 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 276329, 2024-03-16T07:26:26.925 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:26:26.925 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 12, 2024-03-16T07:26:26.925 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:26:26.925 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:26:26.925 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 12, 2024-03-16T07:26:26.925 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 276329, 2024-03-16T07:26:26.925 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:26:26.926 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:26:26.926 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:26:26.926 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:26:26.926 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:26.926 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:26.926 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:26.926 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:26:26.926 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-objecter_bytes": [ 2024-03-16T07:26:26.926 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:26:26.926 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:26:26.926 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:26:26.926 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:26:26.926 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-03-16T07:26:26.926 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:26:26.926 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 0, 2024-03-16T07:26:26.927 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 0, 2024-03-16T07:26:26.927 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:26:26.927 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 0, 2024-03-16T07:26:26.927 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:26:26.927 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:26:26.927 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 0, 2024-03-16T07:26:26.927 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 0, 2024-03-16T07:26:26.927 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:26:26.927 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:26:26.927 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:26:26.927 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:26:26.927 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:26.927 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:26.927 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:26.927 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:26:26.927 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-objecter_ops": [ 2024-03-16T07:26:26.928 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:26:26.928 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:26:26.928 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:26:26.928 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:26:26.928 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 1024, 2024-03-16T07:26:26.928 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:26:26.928 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 0, 2024-03-16T07:26:26.928 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 0, 2024-03-16T07:26:26.928 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:26:26.928 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 0, 2024-03-16T07:26:26.928 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:26:26.928 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:26:26.928 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 0, 2024-03-16T07:26:26.928 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 0, 2024-03-16T07:26:26.928 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:26:26.928 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:26:26.929 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:26:26.929 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:26:26.929 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:26.929 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:26.929 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:26.929 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2024-03-16T07:26:26.929 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-03-16T07:26:26.930 DEBUG:tasks.cephfs.test_mirroring:command returned={ "AsyncMessenger::Worker": [ { "labels": { "id": "0" }, "counters": { "msgr_connection_ready_timeouts": 0, "msgr_connection_idle_timeouts": 0 } }, { "labels": { "id": "1" }, "counters": { "msgr_connection_ready_timeouts": 0, "msgr_connection_idle_timeouts": 0 } }, { "labels": { "id": "2" }, "counters": { "msgr_connection_ready_timeouts": 0, "msgr_connection_idle_timeouts": 0 } } ], "AsyncMessenger::Worker-0": [ { "labels": {}, "counters": { "msgr_recv_messages": 2, "msgr_send_messages": 16, "msgr_recv_bytes": 288, "msgr_send_bytes": 162768, "msgr_created_connections": 4, "msgr_active_connections": 2, "msgr_running_total_time": 0.160515952, "msgr_running_send_time": 0.033941544, "msgr_running_recv_time": 0.111513973, "msgr_running_fast_dispatch_time": 0.000000000, "msgr_send_messages_queue_lat": { "avgcount": 15, "sum": 0.120049413, "avgtime": 0.008003294 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "msgr_recv_encrypted_bytes": 288, "msgr_send_encrypted_bytes": 162768 } } ], "AsyncMessenger::Worker-1": [ { "labels": {}, "counters": { "msgr_recv_messages": 18, "msgr_send_messages": 3, "msgr_recv_bytes": 66272, "msgr_send_bytes": 464, "msgr_created_connections": 3, "msgr_active_connections": 0, "msgr_running_total_time": 0.200602499, "msgr_running_send_time": 0.001184412, "msgr_running_recv_time": 0.137790402, "msgr_running_fast_dispatch_time": 0.060245166, "msgr_send_messages_queue_lat": { "avgcount": 3, "sum": 0.054357270, "avgtime": 0.018119090 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "msgr_recv_encrypted_bytes": 66272, "msgr_send_encrypted_bytes": 464 } } ], "AsyncMessenger::Worker-2": [ { "labels": {}, "counters": { "msgr_recv_messages": 13, "msgr_send_messages": 6, "msgr_recv_bytes": 278496, "msgr_send_bytes": 928, "msgr_created_connections": 2, "msgr_active_connections": 1, "msgr_running_total_time": 0.192244271, "msgr_running_send_time": 0.004238718, "msgr_running_recv_time": 0.386103180, "msgr_running_fast_dispatch_time": 0.000000000, "msgr_send_messages_queue_lat": { "avgcount": 6, "sum": 0.158362306, "avgtime": 0.026393717 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "msgr_recv_encrypted_bytes": 278496, "msgr_send_encrypted_bytes": 928 } } ], "cct": [ { "labels": {}, "counters": { "total_workers": 0, "unhealthy_workers": 0 } } ], "cephfs_mirror": [ { "labels": {}, "counters": { "mirrored_filesystems": 1, "mirror_enable_failures": 0 } } ], "cephfs_mirror_mirrored_filesystems": [ { "labels": { "filesystem": "cephfs" }, "counters": { "mirroring_peers": 0, "directory_count": 2 } } ], "mempool": [ { "labels": {}, "counters": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_cache_buffer_bytes": 0, "bluestore_cache_buffer_items": 0, "bluestore_extent_bytes": 0, "bluestore_extent_items": 0, "bluestore_blob_bytes": 0, "bluestore_blob_items": 0, "bluestore_shared_blob_bytes": 0, "bluestore_shared_blob_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_items": 0, "bluefs_bytes": 0, "bluefs_items": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "buffer_anon_bytes": 182719, "buffer_anon_items": 53, "buffer_meta_bytes": 0, "buffer_meta_items": 0, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 18440, "osdmap_items": 176, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "mds_co_bytes": 0, "mds_co_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 } } ], "objecter": [ { "labels": {}, "counters": { "op_active": 0, "op_laggy": 0, "op_send": 0, "op_send_bytes": 0, "op_resend": 0, "op_reply": 0, "op_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "op_inflight": 0, "oplen_avg": { "avgcount": 0, "sum": 0 }, "op": 0, "op_r": 0, "op_w": 0, "op_rmw": 0, "op_pg": 0, "osdop_stat": 0, "osdop_create": 0, "osdop_read": 0, "osdop_write": 0, "osdop_writefull": 0, "osdop_writesame": 0, "osdop_append": 0, "osdop_zero": 0, "osdop_truncate": 0, "osdop_delete": 0, "osdop_mapext": 0, "osdop_sparse_read": 0, "osdop_clonerange": 0, "osdop_getxattr": 0, "osdop_setxattr": 0, "osdop_cmpxattr": 0, "osdop_rmxattr": 0, "osdop_resetxattrs": 0, "osdop_call": 0, "osdop_watch": 0, "osdop_notify": 0, "osdop_src_cmpxattr": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_other": 0, "linger_active": 0, "linger_send": 0, "linger_resend": 0, "linger_ping": 0, "poolop_active": 0, "poolop_send": 0, "poolop_resend": 0, "poolstat_active": 0, "poolstat_send": 0, "poolstat_resend": 0, "statfs_active": 0, "statfs_send": 0, "statfs_resend": 0, "command_active": 0, "command_send": 0, "command_resend": 0, "map_epoch": 0, "map_full": 0, "map_inc": 0, "osd_sessions": 0, "osd_session_open": 0, "osd_session_close": 0, "osd_laggy": 0, "omap_wr": 0, "omap_rd": 0, "omap_del": 0 } } ], "throttle-msgr_dispatch_throttler-client": [ { "labels": {}, "counters": { "val": 0, "max": 104857600, "get_started": 0, "get": 18, "get_sum": 63833, "get_or_fail_fail": 0, "get_or_fail_success": 18, "take": 0, "take_sum": 0, "put": 18, "put_sum": 63833, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ], "throttle-msgr_dispatch_throttler-radosclient": [ { "labels": {}, "counters": { "val": 0, "max": 104857600, "get_started": 0, "get": 12, "get_sum": 276329, "get_or_fail_fail": 0, "get_or_fail_success": 12, "take": 0, "take_sum": 0, "put": 12, "put_sum": 276329, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ], "throttle-objecter_bytes": [ { "labels": {}, "counters": { "val": 0, "max": 104857600, "get_started": 0, "get": 0, "get_sum": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "take": 0, "take_sum": 0, "put": 0, "put_sum": 0, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ], "throttle-objecter_ops": [ { "labels": {}, "counters": { "val": 0, "max": 1024, "get_started": 0, "get": 0, "get_sum": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "take": 0, "take_sum": 0, "put": 0, "put_sum": 0, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ] } 2024-03-16T07:26:26.930 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snapshot mirror disable cephfs 2024-03-16T07:26:28.246 INFO:teuthology.orchestra.run.smithi049.stdout:{} 2024-03-16T07:26:38.232 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T07:26:38.262 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-03-16T07:26:38.262 DEBUG:teuthology.orchestra.run.smithi049:mirror status for fs: cephfs> ceph --admin-daemon /var/run/ceph/cephfs-mirror.asok fs mirror status cephfs@2 2024-03-16T07:26:38.405 INFO:teuthology.orchestra.run.smithi049.stderr:no valid command found; 10 closest matches: 2024-03-16T07:26:38.405 INFO:teuthology.orchestra.run.smithi049.stderr:0 2024-03-16T07:26:38.405 INFO:teuthology.orchestra.run.smithi049.stderr:1 2024-03-16T07:26:38.405 INFO:teuthology.orchestra.run.smithi049.stderr:2 2024-03-16T07:26:38.405 INFO:teuthology.orchestra.run.smithi049.stderr:abort 2024-03-16T07:26:38.405 INFO:teuthology.orchestra.run.smithi049.stderr:assert 2024-03-16T07:26:38.405 INFO:teuthology.orchestra.run.smithi049.stderr:config diff 2024-03-16T07:26:38.405 INFO:teuthology.orchestra.run.smithi049.stderr:config diff get 2024-03-16T07:26:38.405 INFO:teuthology.orchestra.run.smithi049.stderr:config get 2024-03-16T07:26:38.405 INFO:teuthology.orchestra.run.smithi049.stderr:config help [] 2024-03-16T07:26:38.405 INFO:teuthology.orchestra.run.smithi049.stderr:config set ... 2024-03-16T07:26:38.406 INFO:teuthology.orchestra.run.smithi049.stderr:admin_socket: invalid command 2024-03-16T07:26:38.406 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-03-16T07:26:38.407 WARNING:tasks.cephfs.test_mirroring:mirror daemon command with label "mirror status for fs: cephfs" failed: Command failed (mirror status for fs: cephfs) on smithi049 with status 22: 'ceph --admin-daemon /var/run/ceph/cephfs-mirror.asok fs mirror status cephfs@2' 2024-03-16T07:26:38.407 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-03-16T07:26:38.407 DEBUG:teuthology.orchestra.run.smithi049:counter dump for fs: cephfs> ceph --admin-daemon /var/run/ceph/cephfs-mirror.asok counter dump 2024-03-16T07:26:38.518 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-03-16T07:26:38.518 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker": [ 2024-03-16T07:26:38.518 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:26:38.518 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:26:38.518 INFO:teuthology.orchestra.run.smithi049.stdout: "id": "0" 2024-03-16T07:26:38.518 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:26:38.518 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:26:38.518 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_ready_timeouts": 0, 2024-03-16T07:26:38.518 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_idle_timeouts": 0 2024-03-16T07:26:38.518 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:38.518 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:26:38.519 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:26:38.519 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:26:38.519 INFO:teuthology.orchestra.run.smithi049.stdout: "id": "1" 2024-03-16T07:26:38.519 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:26:38.519 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:26:38.519 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_ready_timeouts": 0, 2024-03-16T07:26:38.519 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_idle_timeouts": 0 2024-03-16T07:26:38.519 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:38.519 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:26:38.519 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:26:38.519 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:26:38.519 INFO:teuthology.orchestra.run.smithi049.stdout: "id": "2" 2024-03-16T07:26:38.519 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:26:38.519 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:26:38.519 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_ready_timeouts": 0, 2024-03-16T07:26:38.520 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_idle_timeouts": 0 2024-03-16T07:26:38.520 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:38.520 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:38.520 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:26:38.520 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-0": [ 2024-03-16T07:26:38.520 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:26:38.520 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:26:38.520 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:26:38.520 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 2, 2024-03-16T07:26:38.520 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 19, 2024-03-16T07:26:38.520 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 288, 2024-03-16T07:26:38.520 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 163520, 2024-03-16T07:26:38.520 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 4, 2024-03-16T07:26:38.521 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 2, 2024-03-16T07:26:38.521 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 0.161751132, 2024-03-16T07:26:38.521 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.035072395, 2024-03-16T07:26:38.521 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 0.111513973, 2024-03-16T07:26:38.521 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-03-16T07:26:38.521 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T07:26:38.521 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 18, 2024-03-16T07:26:38.521 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.120564085, 2024-03-16T07:26:38.521 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.006698004 2024-03-16T07:26:38.521 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:26:38.521 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-03-16T07:26:38.521 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:26:38.521 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:26:38.521 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:26:38.522 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:26:38.522 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 288, 2024-03-16T07:26:38.522 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 163520 2024-03-16T07:26:38.522 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:38.522 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:38.522 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:26:38.522 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-1": [ 2024-03-16T07:26:38.522 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:26:38.522 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:26:38.522 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:26:38.522 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 19, 2024-03-16T07:26:38.522 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 3, 2024-03-16T07:26:38.522 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 71152, 2024-03-16T07:26:38.523 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 464, 2024-03-16T07:26:38.523 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 3, 2024-03-16T07:26:38.523 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 0, 2024-03-16T07:26:38.523 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 0.211944219, 2024-03-16T07:26:38.523 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.001459209, 2024-03-16T07:26:38.523 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 0.140042362, 2024-03-16T07:26:38.523 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.068381692, 2024-03-16T07:26:38.523 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T07:26:38.523 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 3, 2024-03-16T07:26:38.523 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.054357270, 2024-03-16T07:26:38.523 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.018119090 2024-03-16T07:26:38.523 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:26:38.523 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-03-16T07:26:38.523 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:26:38.523 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:26:38.524 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:26:38.524 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:26:38.524 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 71152, 2024-03-16T07:26:38.524 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 464 2024-03-16T07:26:38.524 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:38.524 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:38.524 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:26:38.524 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-2": [ 2024-03-16T07:26:38.524 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:26:38.524 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:26:38.524 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:26:38.524 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 13, 2024-03-16T07:26:38.524 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 6, 2024-03-16T07:26:38.524 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 278496, 2024-03-16T07:26:38.524 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 928, 2024-03-16T07:26:38.524 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 2, 2024-03-16T07:26:38.525 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 1, 2024-03-16T07:26:38.525 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 0.192628187, 2024-03-16T07:26:38.525 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.004296660, 2024-03-16T07:26:38.525 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 0.386243841, 2024-03-16T07:26:38.525 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-03-16T07:26:38.525 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T07:26:38.525 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 6, 2024-03-16T07:26:38.525 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.158362306, 2024-03-16T07:26:38.525 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.026393717 2024-03-16T07:26:38.525 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:26:38.525 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-03-16T07:26:38.525 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:26:38.525 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:26:38.525 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:26:38.525 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:26:38.526 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 278496, 2024-03-16T07:26:38.526 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 928 2024-03-16T07:26:38.526 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:38.526 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:38.526 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:26:38.526 INFO:teuthology.orchestra.run.smithi049.stdout: "cct": [ 2024-03-16T07:26:38.526 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:26:38.526 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:26:38.526 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:26:38.526 INFO:teuthology.orchestra.run.smithi049.stdout: "total_workers": 0, 2024-03-16T07:26:38.526 INFO:teuthology.orchestra.run.smithi049.stdout: "unhealthy_workers": 0 2024-03-16T07:26:38.526 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:38.526 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:38.526 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:26:38.526 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs_mirror": [ 2024-03-16T07:26:38.527 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:26:38.527 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:26:38.527 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:26:38.527 INFO:teuthology.orchestra.run.smithi049.stdout: "mirrored_filesystems": 0, 2024-03-16T07:26:38.527 INFO:teuthology.orchestra.run.smithi049.stdout: "mirror_enable_failures": 0 2024-03-16T07:26:38.527 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:38.527 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:38.527 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:26:38.527 INFO:teuthology.orchestra.run.smithi049.stdout: "mempool": [ 2024-03-16T07:26:38.527 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:26:38.527 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:26:38.527 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:26:38.527 INFO:teuthology.orchestra.run.smithi049.stdout: "bloom_filter_bytes": 0, 2024-03-16T07:26:38.527 INFO:teuthology.orchestra.run.smithi049.stdout: "bloom_filter_items": 0, 2024-03-16T07:26:38.527 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_alloc_bytes": 0, 2024-03-16T07:26:38.528 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_alloc_items": 0, 2024-03-16T07:26:38.528 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_data_bytes": 0, 2024-03-16T07:26:38.528 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_data_items": 0, 2024-03-16T07:26:38.528 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_onode_bytes": 0, 2024-03-16T07:26:38.528 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_onode_items": 0, 2024-03-16T07:26:38.528 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_meta_bytes": 0, 2024-03-16T07:26:38.528 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_meta_items": 0, 2024-03-16T07:26:38.528 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_other_bytes": 0, 2024-03-16T07:26:38.528 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_other_items": 0, 2024-03-16T07:26:38.528 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_buffer_bytes": 0, 2024-03-16T07:26:38.528 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_buffer_items": 0, 2024-03-16T07:26:38.528 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_extent_bytes": 0, 2024-03-16T07:26:38.528 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_extent_items": 0, 2024-03-16T07:26:38.529 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_blob_bytes": 0, 2024-03-16T07:26:38.529 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_blob_items": 0, 2024-03-16T07:26:38.529 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_shared_blob_bytes": 0, 2024-03-16T07:26:38.529 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_shared_blob_items": 0, 2024-03-16T07:26:38.529 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_inline_bl_bytes": 0, 2024-03-16T07:26:38.529 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_inline_bl_items": 0, 2024-03-16T07:26:38.529 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_fsck_bytes": 0, 2024-03-16T07:26:38.529 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_fsck_items": 0, 2024-03-16T07:26:38.529 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_txc_bytes": 0, 2024-03-16T07:26:38.529 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_txc_items": 0, 2024-03-16T07:26:38.529 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_deferred_bytes": 0, 2024-03-16T07:26:38.529 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_deferred_items": 0, 2024-03-16T07:26:38.529 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_bytes": 0, 2024-03-16T07:26:38.529 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_items": 0, 2024-03-16T07:26:38.529 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_bytes": 0, 2024-03-16T07:26:38.530 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_items": 0, 2024-03-16T07:26:38.530 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_reader_bytes": 0, 2024-03-16T07:26:38.530 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_reader_items": 0, 2024-03-16T07:26:38.530 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_writer_bytes": 0, 2024-03-16T07:26:38.530 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_writer_items": 0, 2024-03-16T07:26:38.530 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_anon_bytes": 148386, 2024-03-16T07:26:38.530 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_anon_items": 24, 2024-03-16T07:26:38.530 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_meta_bytes": 0, 2024-03-16T07:26:38.530 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_meta_items": 0, 2024-03-16T07:26:38.530 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_bytes": 0, 2024-03-16T07:26:38.530 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_items": 0, 2024-03-16T07:26:38.530 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_mapbl_bytes": 0, 2024-03-16T07:26:38.530 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_mapbl_items": 0, 2024-03-16T07:26:38.530 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pglog_bytes": 0, 2024-03-16T07:26:38.531 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pglog_items": 0, 2024-03-16T07:26:38.531 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_bytes": 4824, 2024-03-16T07:26:38.531 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_items": 52, 2024-03-16T07:26:38.531 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_mapping_bytes": 0, 2024-03-16T07:26:38.531 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_mapping_items": 0, 2024-03-16T07:26:38.531 INFO:teuthology.orchestra.run.smithi049.stdout: "pgmap_bytes": 0, 2024-03-16T07:26:38.531 INFO:teuthology.orchestra.run.smithi049.stdout: "pgmap_items": 0, 2024-03-16T07:26:38.531 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_co_bytes": 0, 2024-03-16T07:26:38.531 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_co_items": 0, 2024-03-16T07:26:38.531 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_1_bytes": 0, 2024-03-16T07:26:38.531 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_1_items": 0, 2024-03-16T07:26:38.531 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_2_bytes": 0, 2024-03-16T07:26:38.531 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_2_items": 0 2024-03-16T07:26:38.531 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:38.531 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:38.532 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:26:38.532 INFO:teuthology.orchestra.run.smithi049.stdout: "objecter": [ 2024-03-16T07:26:38.532 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:26:38.532 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:26:38.532 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:26:38.532 INFO:teuthology.orchestra.run.smithi049.stdout: "op_active": 0, 2024-03-16T07:26:38.532 INFO:teuthology.orchestra.run.smithi049.stdout: "op_laggy": 0, 2024-03-16T07:26:38.532 INFO:teuthology.orchestra.run.smithi049.stdout: "op_send": 0, 2024-03-16T07:26:38.532 INFO:teuthology.orchestra.run.smithi049.stdout: "op_send_bytes": 0, 2024-03-16T07:26:38.532 INFO:teuthology.orchestra.run.smithi049.stdout: "op_resend": 0, 2024-03-16T07:26:38.532 INFO:teuthology.orchestra.run.smithi049.stdout: "op_reply": 0, 2024-03-16T07:26:38.532 INFO:teuthology.orchestra.run.smithi049.stdout: "op_latency": { 2024-03-16T07:26:38.532 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:26:38.532 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:26:38.533 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:26:38.533 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:26:38.533 INFO:teuthology.orchestra.run.smithi049.stdout: "op_inflight": 0, 2024-03-16T07:26:38.533 INFO:teuthology.orchestra.run.smithi049.stdout: "oplen_avg": { 2024-03-16T07:26:38.533 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:26:38.533 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0 2024-03-16T07:26:38.533 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:26:38.533 INFO:teuthology.orchestra.run.smithi049.stdout: "op": 0, 2024-03-16T07:26:38.533 INFO:teuthology.orchestra.run.smithi049.stdout: "op_r": 0, 2024-03-16T07:26:38.533 INFO:teuthology.orchestra.run.smithi049.stdout: "op_w": 0, 2024-03-16T07:26:38.533 INFO:teuthology.orchestra.run.smithi049.stdout: "op_rmw": 0, 2024-03-16T07:26:38.533 INFO:teuthology.orchestra.run.smithi049.stdout: "op_pg": 0, 2024-03-16T07:26:38.533 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_stat": 0, 2024-03-16T07:26:38.533 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_create": 0, 2024-03-16T07:26:38.534 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_read": 0, 2024-03-16T07:26:38.534 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_write": 0, 2024-03-16T07:26:38.534 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_writefull": 0, 2024-03-16T07:26:38.534 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_writesame": 0, 2024-03-16T07:26:38.534 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_append": 0, 2024-03-16T07:26:38.534 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_zero": 0, 2024-03-16T07:26:38.534 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_truncate": 0, 2024-03-16T07:26:38.534 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_delete": 0, 2024-03-16T07:26:38.534 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_mapext": 0, 2024-03-16T07:26:38.534 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_sparse_read": 0, 2024-03-16T07:26:38.534 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_clonerange": 0, 2024-03-16T07:26:38.534 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_getxattr": 0, 2024-03-16T07:26:38.534 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_setxattr": 0, 2024-03-16T07:26:38.534 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_cmpxattr": 0, 2024-03-16T07:26:38.535 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_rmxattr": 0, 2024-03-16T07:26:38.535 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_resetxattrs": 0, 2024-03-16T07:26:38.535 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_call": 0, 2024-03-16T07:26:38.535 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_watch": 0, 2024-03-16T07:26:38.535 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_notify": 0, 2024-03-16T07:26:38.535 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_src_cmpxattr": 0, 2024-03-16T07:26:38.535 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_pgls": 0, 2024-03-16T07:26:38.535 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_pgls_filter": 0, 2024-03-16T07:26:38.535 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_other": 0, 2024-03-16T07:26:38.535 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_active": 0, 2024-03-16T07:26:38.535 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_send": 0, 2024-03-16T07:26:38.535 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_resend": 0, 2024-03-16T07:26:38.535 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_ping": 0, 2024-03-16T07:26:38.535 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_active": 0, 2024-03-16T07:26:38.535 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_send": 0, 2024-03-16T07:26:38.536 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_resend": 0, 2024-03-16T07:26:38.536 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_active": 0, 2024-03-16T07:26:38.536 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_send": 0, 2024-03-16T07:26:38.536 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_resend": 0, 2024-03-16T07:26:38.536 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_active": 0, 2024-03-16T07:26:38.536 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_send": 0, 2024-03-16T07:26:38.536 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_resend": 0, 2024-03-16T07:26:38.536 INFO:teuthology.orchestra.run.smithi049.stdout: "command_active": 0, 2024-03-16T07:26:38.536 INFO:teuthology.orchestra.run.smithi049.stdout: "command_send": 0, 2024-03-16T07:26:38.536 INFO:teuthology.orchestra.run.smithi049.stdout: "command_resend": 0, 2024-03-16T07:26:38.536 INFO:teuthology.orchestra.run.smithi049.stdout: "map_epoch": 0, 2024-03-16T07:26:38.536 INFO:teuthology.orchestra.run.smithi049.stdout: "map_full": 0, 2024-03-16T07:26:38.536 INFO:teuthology.orchestra.run.smithi049.stdout: "map_inc": 0, 2024-03-16T07:26:38.536 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_sessions": 0, 2024-03-16T07:26:38.536 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_session_open": 0, 2024-03-16T07:26:38.536 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_session_close": 0, 2024-03-16T07:26:38.536 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_laggy": 0, 2024-03-16T07:26:38.537 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_wr": 0, 2024-03-16T07:26:38.537 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_rd": 0, 2024-03-16T07:26:38.537 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_del": 0 2024-03-16T07:26:38.537 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:38.537 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:38.537 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:26:38.537 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-msgr_dispatch_throttler-client": [ 2024-03-16T07:26:38.537 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:26:38.537 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:26:38.537 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:26:38.537 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:26:38.537 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-03-16T07:26:38.537 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:26:38.537 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 19, 2024-03-16T07:26:38.537 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 68579, 2024-03-16T07:26:38.537 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:26:38.538 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 19, 2024-03-16T07:26:38.538 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:26:38.538 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:26:38.538 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 19, 2024-03-16T07:26:38.538 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 68579, 2024-03-16T07:26:38.538 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:26:38.538 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:26:38.538 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:26:38.538 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:26:38.538 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:38.538 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:38.538 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:38.538 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:26:38.538 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-msgr_dispatch_throttler-radosclient": [ 2024-03-16T07:26:38.538 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:26:38.538 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:26:38.539 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:26:38.539 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:26:38.539 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-03-16T07:26:38.539 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:26:38.539 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 12, 2024-03-16T07:26:38.539 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 276329, 2024-03-16T07:26:38.539 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:26:38.539 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 12, 2024-03-16T07:26:38.539 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:26:38.539 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:26:38.539 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 12, 2024-03-16T07:26:38.539 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 276329, 2024-03-16T07:26:38.539 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:26:38.539 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:26:38.539 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:26:38.540 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:26:38.540 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:38.540 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:38.540 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:38.540 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:26:38.540 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-objecter_bytes": [ 2024-03-16T07:26:38.540 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:26:38.540 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:26:38.540 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:26:38.540 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:26:38.540 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-03-16T07:26:38.540 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:26:38.540 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 0, 2024-03-16T07:26:38.540 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 0, 2024-03-16T07:26:38.540 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:26:38.541 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 0, 2024-03-16T07:26:38.541 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:26:38.541 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:26:38.541 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 0, 2024-03-16T07:26:38.541 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 0, 2024-03-16T07:26:38.541 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:26:38.541 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:26:38.541 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:26:38.541 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:26:38.541 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:38.541 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:38.541 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:38.541 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:26:38.541 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-objecter_ops": [ 2024-03-16T07:26:38.541 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:26:38.541 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:26:38.541 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:26:38.542 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:26:38.542 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 1024, 2024-03-16T07:26:38.542 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:26:38.542 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 0, 2024-03-16T07:26:38.542 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 0, 2024-03-16T07:26:38.542 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:26:38.542 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 0, 2024-03-16T07:26:38.542 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:26:38.542 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:26:38.542 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 0, 2024-03-16T07:26:38.542 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 0, 2024-03-16T07:26:38.542 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:26:38.542 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:26:38.542 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:26:38.543 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:26:38.543 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:38.543 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:38.543 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:26:38.543 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2024-03-16T07:26:38.543 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-03-16T07:26:38.544 DEBUG:tasks.cephfs.test_mirroring:command returned={ "AsyncMessenger::Worker": [ { "labels": { "id": "0" }, "counters": { "msgr_connection_ready_timeouts": 0, "msgr_connection_idle_timeouts": 0 } }, { "labels": { "id": "1" }, "counters": { "msgr_connection_ready_timeouts": 0, "msgr_connection_idle_timeouts": 0 } }, { "labels": { "id": "2" }, "counters": { "msgr_connection_ready_timeouts": 0, "msgr_connection_idle_timeouts": 0 } } ], "AsyncMessenger::Worker-0": [ { "labels": {}, "counters": { "msgr_recv_messages": 2, "msgr_send_messages": 19, "msgr_recv_bytes": 288, "msgr_send_bytes": 163520, "msgr_created_connections": 4, "msgr_active_connections": 2, "msgr_running_total_time": 0.161751132, "msgr_running_send_time": 0.035072395, "msgr_running_recv_time": 0.111513973, "msgr_running_fast_dispatch_time": 0.000000000, "msgr_send_messages_queue_lat": { "avgcount": 18, "sum": 0.120564085, "avgtime": 0.006698004 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "msgr_recv_encrypted_bytes": 288, "msgr_send_encrypted_bytes": 163520 } } ], "AsyncMessenger::Worker-1": [ { "labels": {}, "counters": { "msgr_recv_messages": 19, "msgr_send_messages": 3, "msgr_recv_bytes": 71152, "msgr_send_bytes": 464, "msgr_created_connections": 3, "msgr_active_connections": 0, "msgr_running_total_time": 0.211944219, "msgr_running_send_time": 0.001459209, "msgr_running_recv_time": 0.140042362, "msgr_running_fast_dispatch_time": 0.068381692, "msgr_send_messages_queue_lat": { "avgcount": 3, "sum": 0.054357270, "avgtime": 0.018119090 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "msgr_recv_encrypted_bytes": 71152, "msgr_send_encrypted_bytes": 464 } } ], "AsyncMessenger::Worker-2": [ { "labels": {}, "counters": { "msgr_recv_messages": 13, "msgr_send_messages": 6, "msgr_recv_bytes": 278496, "msgr_send_bytes": 928, "msgr_created_connections": 2, "msgr_active_connections": 1, "msgr_running_total_time": 0.192628187, "msgr_running_send_time": 0.004296660, "msgr_running_recv_time": 0.386243841, "msgr_running_fast_dispatch_time": 0.000000000, "msgr_send_messages_queue_lat": { "avgcount": 6, "sum": 0.158362306, "avgtime": 0.026393717 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "msgr_recv_encrypted_bytes": 278496, "msgr_send_encrypted_bytes": 928 } } ], "cct": [ { "labels": {}, "counters": { "total_workers": 0, "unhealthy_workers": 0 } } ], "cephfs_mirror": [ { "labels": {}, "counters": { "mirrored_filesystems": 0, "mirror_enable_failures": 0 } } ], "mempool": [ { "labels": {}, "counters": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_cache_buffer_bytes": 0, "bluestore_cache_buffer_items": 0, "bluestore_extent_bytes": 0, "bluestore_extent_items": 0, "bluestore_blob_bytes": 0, "bluestore_blob_items": 0, "bluestore_shared_blob_bytes": 0, "bluestore_shared_blob_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_items": 0, "bluefs_bytes": 0, "bluefs_items": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "buffer_anon_bytes": 148386, "buffer_anon_items": 24, "buffer_meta_bytes": 0, "buffer_meta_items": 0, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 4824, "osdmap_items": 52, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "mds_co_bytes": 0, "mds_co_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 } } ], "objecter": [ { "labels": {}, "counters": { "op_active": 0, "op_laggy": 0, "op_send": 0, "op_send_bytes": 0, "op_resend": 0, "op_reply": 0, "op_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "op_inflight": 0, "oplen_avg": { "avgcount": 0, "sum": 0 }, "op": 0, "op_r": 0, "op_w": 0, "op_rmw": 0, "op_pg": 0, "osdop_stat": 0, "osdop_create": 0, "osdop_read": 0, "osdop_write": 0, "osdop_writefull": 0, "osdop_writesame": 0, "osdop_append": 0, "osdop_zero": 0, "osdop_truncate": 0, "osdop_delete": 0, "osdop_mapext": 0, "osdop_sparse_read": 0, "osdop_clonerange": 0, "osdop_getxattr": 0, "osdop_setxattr": 0, "osdop_cmpxattr": 0, "osdop_rmxattr": 0, "osdop_resetxattrs": 0, "osdop_call": 0, "osdop_watch": 0, "osdop_notify": 0, "osdop_src_cmpxattr": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_other": 0, "linger_active": 0, "linger_send": 0, "linger_resend": 0, "linger_ping": 0, "poolop_active": 0, "poolop_send": 0, "poolop_resend": 0, "poolstat_active": 0, "poolstat_send": 0, "poolstat_resend": 0, "statfs_active": 0, "statfs_send": 0, "statfs_resend": 0, "command_active": 0, "command_send": 0, "command_resend": 0, "map_epoch": 0, "map_full": 0, "map_inc": 0, "osd_sessions": 0, "osd_session_open": 0, "osd_session_close": 0, "osd_laggy": 0, "omap_wr": 0, "omap_rd": 0, "omap_del": 0 } } ], "throttle-msgr_dispatch_throttler-client": [ { "labels": {}, "counters": { "val": 0, "max": 104857600, "get_started": 0, "get": 19, "get_sum": 68579, "get_or_fail_fail": 0, "get_or_fail_success": 19, "take": 0, "take_sum": 0, "put": 19, "put_sum": 68579, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ], "throttle-msgr_dispatch_throttler-radosclient": [ { "labels": {}, "counters": { "val": 0, "max": 104857600, "get_started": 0, "get": 12, "get_sum": 276329, "get_or_fail_fail": 0, "get_or_fail_success": 12, "take": 0, "take_sum": 0, "put": 12, "put_sum": 276329, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ], "throttle-objecter_bytes": [ { "labels": {}, "counters": { "val": 0, "max": 104857600, "get_started": 0, "get": 0, "get_sum": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "take": 0, "take_sum": 0, "put": 0, "put_sum": 0, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ], "throttle-objecter_ops": [ { "labels": {}, "counters": { "val": 0, "max": 1024, "get_started": 0, "get": 0, "get_sum": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "take": 0, "take_sum": 0, "put": 0, "put_sum": 0, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ] } 2024-03-16T07:26:38.544 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:26:38.544 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -rf d1) 2024-03-16T07:26:38.571 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable mirroring 2024-03-16T07:26:39.276 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-03-16T07:26:39.277 DEBUG:teuthology.orchestra.run.smithi049:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-03-16T07:26:39.326 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-03-16T07:26:39.326 INFO:tasks.cephfs.mount:Terminating background process 2024-03-16T07:26:39.326 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-03-16T07:26:39.326 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-16T07:26:39.342 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T07:26:39.763 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:26:39.765+0000 7fc4929db040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-16T07:26:39.822 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:26:39.824+0000 7fc4929db040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-16T07:26:39.867 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:26:39.867 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":34,"fsid":"f91af061-9eac-4793-87fa-8d27ae3d242f","created":"2024-03-16T07:24:20.357868+0000","modified":"2024-03-16T07:26:31.249230+0000","last_up_change":"2024-03-16T07:24:27.474980+0000","last_in_change":"2024-03-16T07:24:21.254179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T07:24:28.947521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-03-16T07:25:24.035315+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-03-16T07:25:25.110355+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.0800000429153442,"score_stable":1.0800000429153442,"optimal_score":1,"raw_score_acting":1.0800000429153442,"raw_score_stable":1.0800000429153442,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"backup_fs_metadata","create_time":"2024-03-16T07:25:38.710921+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"backup_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.2200000286102295,"score_stable":1.2200000286102295,"optimal_score":1,"raw_score_acting":1.2200000286102295,"raw_score_stable":1.2200000286102295,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"backup_fs_data","create_time":"2024-03-16T07:25:39.142890+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"backup_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.2200000286102295,"score_stable":1.2200000286102295,"optimal_score":1,"raw_score_acting":1.2200000286102295,"raw_score_stable":1.2200000286102295,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2df14aac-98dc-4e3c-ae7e-9eb677aa30be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6801","nonce":2744935777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6803","nonce":2744935777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6807","nonce":2744935777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6805","nonce":2744935777}]},"public_addr":"172.21.15.49:6801/2744935777","cluster_addr":"172.21.15.49:6803/2744935777","heartbeat_back_addr":"172.21.15.49:6807/2744935777","heartbeat_front_addr":"172.21.15.49:6805/2744935777","state":["exists","up"]},{"osd":1,"uuid":"80461bd9-59ef-46df-9eea-bad92d960c57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6811","nonce":1655120118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6815","nonce":1655120118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6821","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6823","nonce":1655120118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6817","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6819","nonce":1655120118}]},"public_addr":"172.21.15.49:6811/1655120118","cluster_addr":"172.21.15.49:6815/1655120118","heartbeat_back_addr":"172.21.15.49:6823/1655120118","heartbeat_front_addr":"172.21.15.49:6819/1655120118","state":["exists","up"]},{"osd":2,"uuid":"d6bf40eb-6e42-4ec9-8b3d-0b6c5a6def79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6810","nonce":3815472376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6814","nonce":3815472376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6822","nonce":3815472376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6818","nonce":3815472376}]},"public_addr":"172.21.15.49:6810/3815472376","cluster_addr":"172.21.15.49:6814/3815472376","heartbeat_back_addr":"172.21.15.49:6822/3815472376","heartbeat_front_addr":"172.21.15.49:6818/3815472376","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.641492+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.668598+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.614940+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.49:0/3295617512":"2024-03-16T08:26:30.316835+0000","172.21.15.49:6825/3723994962":"2024-03-17T07:25:51.170804+0000","172.21.15.49:6824/3723994962":"2024-03-17T07:25:51.170804+0000","172.21.15.49:0/2280956996":"2024-03-17T07:25:51.170804+0000","172.21.15.49:0/1380123362":"2024-03-17T07:25:51.170804+0000","172.21.15.49:0/1600139833":"2024-03-17T07:25:51.170804+0000","172.21.15.49:0/2278133012":"2024-03-17T07:25:51.170804+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T07:26:39.886 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-16T07:24:28.947521+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-16T07:25:24.035315+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-03-16T07:25:25.110355+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.0800000429153442, 'score_stable': 1.0800000429153442, 'optimal_score': 1, 'raw_score_acting': 1.0800000429153442, 'raw_score_stable': 1.0800000429153442, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'backup_fs_metadata', 'create_time': '2024-03-16T07:25:38.710921+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '31', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'backup_fs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.2200000286102295, 'score_stable': 1.2200000286102295, 'optimal_score': 1, 'raw_score_acting': 1.2200000286102295, 'raw_score_stable': 1.2200000286102295, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'backup_fs_data', 'create_time': '2024-03-16T07:25:39.142890+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '32', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'backup_fs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.2200000286102295, 'score_stable': 1.2200000286102295, 'optimal_score': 1, 'raw_score_acting': 1.2200000286102295, 'raw_score_stable': 1.2200000286102295, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-16T07:26:39.886 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-16T07:26:40.211 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2024-03-16T07:26:40.225 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-16T07:26:40.311 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:26:40.312+0000 7fc4929db040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-16T07:26:40.358 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:26:40.360+0000 7fc4929db040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-16T07:26:40.417 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:26:40.419+0000 7fc4929db040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-16T07:26:40.513 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:26:40.515+0000 7fc4929db040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-16T07:26:40.590 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:26:40.591+0000 7fc4929db040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-16T07:26:40.620 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2024-03-16T07:26:40.635 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-16T07:26:40.726 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:26:40.728+0000 7fc4929db040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-16T07:26:40.798 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:26:40.800+0000 7fc4929db040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-16T07:26:40.843 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:26:40.845+0000 7fc4929db040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-16T07:26:40.894 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:26:40.896+0000 7fc4929db040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-16T07:26:40.939 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:26:40.941+0000 7fc4929db040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-16T07:26:41.019 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2024-03-16T07:26:41.032 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get backup_fs_metadata pg_num 2024-03-16T07:26:41.377 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:26:41.378+0000 7fc4929db040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-16T07:26:41.461 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2024-03-16T07:26:41.479 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get backup_fs_data pg_num 2024-03-16T07:26:41.545 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:26:41.547+0000 7fc4929db040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-16T07:26:41.695 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:26:41.697+0000 7fc4929db040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-16T07:26:41.740 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:26:41.742+0000 7fc4929db040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-16T07:26:41.835 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2024-03-16T07:26:41.849 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-16T07:26:41.858 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:26:41.860+0000 7fc4929db040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-16T07:26:41.956 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:26:41.958+0000 7fc4929db040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-16T07:26:42.134 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:26:42.136+0000 7fc4929db040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-16T07:26:42.178 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:26:42.180+0000 7fc4929db040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-16T07:26:42.246 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/3295617512 2024-03-16T08:26:30.316835+0000 2024-03-16T07:26:42.246 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:6825/3723994962 2024-03-17T07:25:51.170804+0000 2024-03-16T07:26:42.246 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:6824/3723994962 2024-03-17T07:25:51.170804+0000 2024-03-16T07:26:42.247 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/2280956996 2024-03-17T07:25:51.170804+0000 2024-03-16T07:26:42.247 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/1380123362 2024-03-17T07:25:51.170804+0000 2024-03-16T07:26:42.247 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/1600139833 2024-03-17T07:25:51.170804+0000 2024-03-16T07:26:42.247 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/2278133012 2024-03-17T07:25:51.170804+0000 2024-03-16T07:26:42.247 INFO:teuthology.orchestra.run.smithi049.stderr:listed 7 entries 2024-03-16T07:26:42.259 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi049.front.sepia.ceph.com... 2024-03-16T07:26:42.260 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:26:42.260 DEBUG:teuthology.orchestra.run.smithi049:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-03-16T07:26:42.329 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi049.stderr:ceph-fuse[46468]: fuse finished with error 0 and tester_r 0 2024-03-16T07:26:42.331 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi049.front.sepia.ceph.com 2024-03-16T07:26:42.331 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:26:42.331 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-03-16T07:26:42.339 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:26:42.341+0000 7fc4929db040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-16T07:26:42.393 INFO:tasks.cephfs.mount:Terminating background process 2024-03-16T07:26:42.394 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-03-16T07:26:42.394 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-16T07:26:42.451 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T07:26:42.888 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:26:42.888 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":34,"fsid":"f91af061-9eac-4793-87fa-8d27ae3d242f","created":"2024-03-16T07:24:20.357868+0000","modified":"2024-03-16T07:26:31.249230+0000","last_up_change":"2024-03-16T07:24:27.474980+0000","last_in_change":"2024-03-16T07:24:21.254179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T07:24:28.947521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-03-16T07:25:24.035315+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-03-16T07:25:25.110355+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.0800000429153442,"score_stable":1.0800000429153442,"optimal_score":1,"raw_score_acting":1.0800000429153442,"raw_score_stable":1.0800000429153442,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"backup_fs_metadata","create_time":"2024-03-16T07:25:38.710921+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"backup_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.2200000286102295,"score_stable":1.2200000286102295,"optimal_score":1,"raw_score_acting":1.2200000286102295,"raw_score_stable":1.2200000286102295,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"backup_fs_data","create_time":"2024-03-16T07:25:39.142890+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"backup_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.2200000286102295,"score_stable":1.2200000286102295,"optimal_score":1,"raw_score_acting":1.2200000286102295,"raw_score_stable":1.2200000286102295,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2df14aac-98dc-4e3c-ae7e-9eb677aa30be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6801","nonce":2744935777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6803","nonce":2744935777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6807","nonce":2744935777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6805","nonce":2744935777}]},"public_addr":"172.21.15.49:6801/2744935777","cluster_addr":"172.21.15.49:6803/2744935777","heartbeat_back_addr":"172.21.15.49:6807/2744935777","heartbeat_front_addr":"172.21.15.49:6805/2744935777","state":["exists","up"]},{"osd":1,"uuid":"80461bd9-59ef-46df-9eea-bad92d960c57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6811","nonce":1655120118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6815","nonce":1655120118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6821","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6823","nonce":1655120118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6817","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6819","nonce":1655120118}]},"public_addr":"172.21.15.49:6811/1655120118","cluster_addr":"172.21.15.49:6815/1655120118","heartbeat_back_addr":"172.21.15.49:6823/1655120118","heartbeat_front_addr":"172.21.15.49:6819/1655120118","state":["exists","up"]},{"osd":2,"uuid":"d6bf40eb-6e42-4ec9-8b3d-0b6c5a6def79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6810","nonce":3815472376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6814","nonce":3815472376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6822","nonce":3815472376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6818","nonce":3815472376}]},"public_addr":"172.21.15.49:6810/3815472376","cluster_addr":"172.21.15.49:6814/3815472376","heartbeat_back_addr":"172.21.15.49:6822/3815472376","heartbeat_front_addr":"172.21.15.49:6818/3815472376","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.641492+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.668598+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.614940+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.49:0/3295617512":"2024-03-16T08:26:30.316835+0000","172.21.15.49:6825/3723994962":"2024-03-17T07:25:51.170804+0000","172.21.15.49:6824/3723994962":"2024-03-17T07:25:51.170804+0000","172.21.15.49:0/2280956996":"2024-03-17T07:25:51.170804+0000","172.21.15.49:0/1380123362":"2024-03-17T07:25:51.170804+0000","172.21.15.49:0/1600139833":"2024-03-17T07:25:51.170804+0000","172.21.15.49:0/2278133012":"2024-03-17T07:25:51.170804+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T07:26:42.901 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-16T07:24:28.947521+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-16T07:25:24.035315+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-03-16T07:25:25.110355+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.0800000429153442, 'score_stable': 1.0800000429153442, 'optimal_score': 1, 'raw_score_acting': 1.0800000429153442, 'raw_score_stable': 1.0800000429153442, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'backup_fs_metadata', 'create_time': '2024-03-16T07:25:38.710921+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '31', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'backup_fs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.2200000286102295, 'score_stable': 1.2200000286102295, 'optimal_score': 1, 'raw_score_acting': 1.2200000286102295, 'raw_score_stable': 1.2200000286102295, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'backup_fs_data', 'create_time': '2024-03-16T07:25:39.142890+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '32', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'backup_fs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.2200000286102295, 'score_stable': 1.2200000286102295, 'optimal_score': 1, 'raw_score_acting': 1.2200000286102295, 'raw_score_stable': 1.2200000286102295, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-16T07:26:42.902 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-16T07:26:43.178 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:26:43.179+0000 7fc4929db040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-16T07:26:43.211 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2024-03-16T07:26:43.225 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-16T07:26:43.511 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:26:43.512+0000 7fc4929db040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-16T07:26:43.545 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2024-03-16T07:26:43.564 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-16T07:26:43.564 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:26:43.566+0000 7fc4929db040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-16T07:26:43.690 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:26:43.692+0000 7fc4929db040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-16T07:26:43.793 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:26:43.795+0000 7fc417533640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:26:43.794 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:26:43.795+0000 7fc417533640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:26:43.794 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:26:43.795+0000 7fc417533640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:26:43.794 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:26:43.795+0000 7fc417533640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:26:43.794 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:26:43.795+0000 7fc417533640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:26:43.795 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:26:43.796+0000 7fc414d2e640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:26:43.795 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:26:43.796+0000 7fc414d2e640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:26:43.795 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:26:43.796+0000 7fc414d2e640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:26:43.795 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:26:43.796+0000 7fc414d2e640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:26:43.795 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:26:43.796+0000 7fc414d2e640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:26:43.805 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:26:43.806+0000 7fc417533640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:26:43.805 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:26:43.806+0000 7fc417533640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:26:43.805 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:26:43.806+0000 7fc417533640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:26:43.805 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:26:43.806+0000 7fc417533640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:26:43.805 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:26:43.806+0000 7fc417533640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:26:43.806 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:26:43.807+0000 7fc414d2e640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:26:43.806 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:26:43.807+0000 7fc414d2e640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:26:43.806 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:26:43.807+0000 7fc414d2e640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:26:43.806 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:26:43.807+0000 7fc414d2e640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:26:43.807 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:26:43.807+0000 7fc414d2e640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:26:43.912 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2024-03-16T07:26:43.925 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get backup_fs_metadata pg_num 2024-03-16T07:26:44.276 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2024-03-16T07:26:44.290 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get backup_fs_data pg_num 2024-03-16T07:26:44.593 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2024-03-16T07:26:44.605 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-16T07:26:44.981 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/3811452563 2024-03-17T07:26:43.706557+0000 2024-03-16T07:26:44.981 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/1835107982 2024-03-17T07:26:43.706557+0000 2024-03-16T07:26:44.981 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:6825/1628852325 2024-03-17T07:26:43.706557+0000 2024-03-16T07:26:44.981 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/2278133012 2024-03-17T07:25:51.170804+0000 2024-03-16T07:26:44.981 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:6824/1628852325 2024-03-17T07:26:43.706557+0000 2024-03-16T07:26:44.981 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/3939719787 2024-03-17T07:26:43.706557+0000 2024-03-16T07:26:44.981 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/2280956996 2024-03-17T07:25:51.170804+0000 2024-03-16T07:26:44.981 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/417307946 2024-03-17T07:26:43.706557+0000 2024-03-16T07:26:44.981 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/992397985 2024-03-17T07:26:43.706557+0000 2024-03-16T07:26:44.981 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:6824/3723994962 2024-03-17T07:25:51.170804+0000 2024-03-16T07:26:44.981 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/3175975684 2024-03-17T07:26:43.706557+0000 2024-03-16T07:26:44.982 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/227725099 2024-03-17T07:26:43.706557+0000 2024-03-16T07:26:44.982 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/2404418359 2024-03-17T07:26:43.706557+0000 2024-03-16T07:26:44.982 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:6825/3723994962 2024-03-17T07:25:51.170804+0000 2024-03-16T07:26:44.982 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/3295617512 2024-03-16T08:26:30.316835+0000 2024-03-16T07:26:44.982 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/1600139833 2024-03-17T07:25:51.170804+0000 2024-03-16T07:26:44.982 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/1380123362 2024-03-17T07:25:51.170804+0000 2024-03-16T07:26:44.982 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/1982487108 2024-03-17T07:26:43.706557+0000 2024-03-16T07:26:44.982 INFO:teuthology.orchestra.run.smithi049.stderr:listed 18 entries 2024-03-16T07:26:44.993 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi049.front.sepia.ceph.com... 2024-03-16T07:26:44.993 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:26:44.994 DEBUG:teuthology.orchestra.run.smithi049:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2024-03-16T07:26:45.022 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi049.stderr:ceph-fuse[46882]: fuse finished with error 0 and tester_r 0 2024-03-16T07:26:45.024 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi049.front.sepia.ceph.com 2024-03-16T07:26:45.024 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:26:45.024 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-03-16T07:26:45.118 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T07:26:45.496 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:26:45.497 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":25,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4497,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6827/2700845528","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":2700845528},{"type":"v1","addr":"172.21.15.49:6827","nonce":2700845528}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4502,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6830/1983317600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":1983317600},{"type":"v1","addr":"172.21.15.49:6830","nonce":1983317600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4503,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6831/1363178912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6829","nonce":1363178912},{"type":"v1","addr":"172.21.15.49:6831","nonce":1363178912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-16T07:25:26.124693+0000","modified":"2024-03-16T07:26:27.259642+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4509},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4509":{"gid":4509,"name":"e","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6835/3541821089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":3541821089},{"type":"v1","addr":"172.21.15.49:6835","nonce":3541821089}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4509,"qdb_cluster":[4509]},"id":2},{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-16T07:25:40.160397+0000","modified":"2024-03-16T07:25:43.171652+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4506},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4506":{"gid":4506,"name":"c","rank":0,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.49:6833/4243939102","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":4243939102},{"type":"v1","addr":"172.21.15.49:6833","nonce":4243939102}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"backup_fs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4506,"qdb_cluster":[4506]},"id":3}]} 2024-03-16T07:26:45.497 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 25 2024-03-16T07:26:45.514 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T07:26:45.855 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:26:45.855 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":35,"fsid":"f91af061-9eac-4793-87fa-8d27ae3d242f","created":"2024-03-16T07:24:20.357868+0000","modified":"2024-03-16T07:26:43.706628+0000","last_up_change":"2024-03-16T07:24:27.474980+0000","last_in_change":"2024-03-16T07:24:21.254179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T07:24:28.947521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-03-16T07:25:24.035315+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-03-16T07:25:25.110355+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.0800000429153442,"score_stable":1.0800000429153442,"optimal_score":1,"raw_score_acting":1.0800000429153442,"raw_score_stable":1.0800000429153442,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"backup_fs_metadata","create_time":"2024-03-16T07:25:38.710921+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"backup_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.2200000286102295,"score_stable":1.2200000286102295,"optimal_score":1,"raw_score_acting":1.2200000286102295,"raw_score_stable":1.2200000286102295,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"backup_fs_data","create_time":"2024-03-16T07:25:39.142890+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"backup_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.2200000286102295,"score_stable":1.2200000286102295,"optimal_score":1,"raw_score_acting":1.2200000286102295,"raw_score_stable":1.2200000286102295,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2df14aac-98dc-4e3c-ae7e-9eb677aa30be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6801","nonce":2744935777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6803","nonce":2744935777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6807","nonce":2744935777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6805","nonce":2744935777}]},"public_addr":"172.21.15.49:6801/2744935777","cluster_addr":"172.21.15.49:6803/2744935777","heartbeat_back_addr":"172.21.15.49:6807/2744935777","heartbeat_front_addr":"172.21.15.49:6805/2744935777","state":["exists","up"]},{"osd":1,"uuid":"80461bd9-59ef-46df-9eea-bad92d960c57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6811","nonce":1655120118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6815","nonce":1655120118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6821","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6823","nonce":1655120118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6817","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6819","nonce":1655120118}]},"public_addr":"172.21.15.49:6811/1655120118","cluster_addr":"172.21.15.49:6815/1655120118","heartbeat_back_addr":"172.21.15.49:6823/1655120118","heartbeat_front_addr":"172.21.15.49:6819/1655120118","state":["exists","up"]},{"osd":2,"uuid":"d6bf40eb-6e42-4ec9-8b3d-0b6c5a6def79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6810","nonce":3815472376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6814","nonce":3815472376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6822","nonce":3815472376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6818","nonce":3815472376}]},"public_addr":"172.21.15.49:6810/3815472376","cluster_addr":"172.21.15.49:6814/3815472376","heartbeat_back_addr":"172.21.15.49:6822/3815472376","heartbeat_front_addr":"172.21.15.49:6818/3815472376","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.641492+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.668598+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.614940+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.49:0/3811452563":"2024-03-17T07:26:43.706557+0000","172.21.15.49:0/1835107982":"2024-03-17T07:26:43.706557+0000","172.21.15.49:6825/1628852325":"2024-03-17T07:26:43.706557+0000","172.21.15.49:0/2278133012":"2024-03-17T07:25:51.170804+0000","172.21.15.49:6824/1628852325":"2024-03-17T07:26:43.706557+0000","172.21.15.49:0/3939719787":"2024-03-17T07:26:43.706557+0000","172.21.15.49:0/2280956996":"2024-03-17T07:25:51.170804+0000","172.21.15.49:0/417307946":"2024-03-17T07:26:43.706557+0000","172.21.15.49:0/992397985":"2024-03-17T07:26:43.706557+0000","172.21.15.49:6824/3723994962":"2024-03-17T07:25:51.170804+0000","172.21.15.49:0/3175975684":"2024-03-17T07:26:43.706557+0000","172.21.15.49:0/227725099":"2024-03-17T07:26:43.706557+0000","172.21.15.49:0/2404418359":"2024-03-17T07:26:43.706557+0000","172.21.15.49:6825/3723994962":"2024-03-17T07:25:51.170804+0000","172.21.15.49:0/3295617512":"2024-03-16T08:26:30.316835+0000","172.21.15.49:0/1600139833":"2024-03-17T07:25:51.170804+0000","172.21.15.49:0/1380123362":"2024-03-17T07:25:51.170804+0000","172.21.15.49:0/1982487108":"2024-03-17T07:26:43.706557+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T07:26:45.868 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-16T07:24:28.947521+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-16T07:25:24.035315+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-03-16T07:25:25.110355+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.0800000429153442, 'score_stable': 1.0800000429153442, 'optimal_score': 1, 'raw_score_acting': 1.0800000429153442, 'raw_score_stable': 1.0800000429153442, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'backup_fs_metadata', 'create_time': '2024-03-16T07:25:38.710921+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '31', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'backup_fs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.2200000286102295, 'score_stable': 1.2200000286102295, 'optimal_score': 1, 'raw_score_acting': 1.2200000286102295, 'raw_score_stable': 1.2200000286102295, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'backup_fs_data', 'create_time': '2024-03-16T07:25:39.142890+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '32', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'backup_fs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.2200000286102295, 'score_stable': 1.2200000286102295, 'optimal_score': 1, 'raw_score_acting': 1.2200000286102295, 'raw_score_stable': 1.2200000286102295, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-16T07:26:45.868 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-16T07:26:46.170 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2024-03-16T07:26:46.182 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-16T07:26:46.706 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2024-03-16T07:26:46.724 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-16T07:26:47.038 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2024-03-16T07:26:47.051 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get backup_fs_metadata pg_num 2024-03-16T07:26:47.418 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2024-03-16T07:26:47.435 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get backup_fs_data pg_num 2024-03-16T07:26:47.746 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2024-03-16T07:26:47.759 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T07:26:48.103 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:26:48.103 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":25,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4497,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6827/2700845528","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":2700845528},{"type":"v1","addr":"172.21.15.49:6827","nonce":2700845528}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4502,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6830/1983317600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":1983317600},{"type":"v1","addr":"172.21.15.49:6830","nonce":1983317600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4503,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6831/1363178912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6829","nonce":1363178912},{"type":"v1","addr":"172.21.15.49:6831","nonce":1363178912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-16T07:25:26.124693+0000","modified":"2024-03-16T07:26:27.259642+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4509},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4509":{"gid":4509,"name":"e","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6835/3541821089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":3541821089},{"type":"v1","addr":"172.21.15.49:6835","nonce":3541821089}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4509,"qdb_cluster":[4509]},"id":2},{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-16T07:25:40.160397+0000","modified":"2024-03-16T07:25:43.171652+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4506},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4506":{"gid":4506,"name":"c","rank":0,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.49:6833/4243939102","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":4243939102},{"type":"v1","addr":"172.21.15.49:6833","nonce":4243939102}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"backup_fs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4506,"qdb_cluster":[4506]},"id":3}]} 2024-03-16T07:26:48.103 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 25 2024-03-16T07:26:48.116 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T07:26:48.423 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:26:48.423 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":35,"fsid":"f91af061-9eac-4793-87fa-8d27ae3d242f","created":"2024-03-16T07:24:20.357868+0000","modified":"2024-03-16T07:26:43.706628+0000","last_up_change":"2024-03-16T07:24:27.474980+0000","last_in_change":"2024-03-16T07:24:21.254179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T07:24:28.947521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-03-16T07:25:24.035315+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-03-16T07:25:25.110355+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.0800000429153442,"score_stable":1.0800000429153442,"optimal_score":1,"raw_score_acting":1.0800000429153442,"raw_score_stable":1.0800000429153442,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"backup_fs_metadata","create_time":"2024-03-16T07:25:38.710921+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"backup_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.2200000286102295,"score_stable":1.2200000286102295,"optimal_score":1,"raw_score_acting":1.2200000286102295,"raw_score_stable":1.2200000286102295,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"backup_fs_data","create_time":"2024-03-16T07:25:39.142890+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"backup_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.2200000286102295,"score_stable":1.2200000286102295,"optimal_score":1,"raw_score_acting":1.2200000286102295,"raw_score_stable":1.2200000286102295,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2df14aac-98dc-4e3c-ae7e-9eb677aa30be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6801","nonce":2744935777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6803","nonce":2744935777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6807","nonce":2744935777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6805","nonce":2744935777}]},"public_addr":"172.21.15.49:6801/2744935777","cluster_addr":"172.21.15.49:6803/2744935777","heartbeat_back_addr":"172.21.15.49:6807/2744935777","heartbeat_front_addr":"172.21.15.49:6805/2744935777","state":["exists","up"]},{"osd":1,"uuid":"80461bd9-59ef-46df-9eea-bad92d960c57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6811","nonce":1655120118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6815","nonce":1655120118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6821","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6823","nonce":1655120118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6817","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6819","nonce":1655120118}]},"public_addr":"172.21.15.49:6811/1655120118","cluster_addr":"172.21.15.49:6815/1655120118","heartbeat_back_addr":"172.21.15.49:6823/1655120118","heartbeat_front_addr":"172.21.15.49:6819/1655120118","state":["exists","up"]},{"osd":2,"uuid":"d6bf40eb-6e42-4ec9-8b3d-0b6c5a6def79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6810","nonce":3815472376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6814","nonce":3815472376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6822","nonce":3815472376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6818","nonce":3815472376}]},"public_addr":"172.21.15.49:6810/3815472376","cluster_addr":"172.21.15.49:6814/3815472376","heartbeat_back_addr":"172.21.15.49:6822/3815472376","heartbeat_front_addr":"172.21.15.49:6818/3815472376","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.641492+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.668598+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.614940+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.49:0/3811452563":"2024-03-17T07:26:43.706557+0000","172.21.15.49:0/1835107982":"2024-03-17T07:26:43.706557+0000","172.21.15.49:6825/1628852325":"2024-03-17T07:26:43.706557+0000","172.21.15.49:0/2278133012":"2024-03-17T07:25:51.170804+0000","172.21.15.49:6824/1628852325":"2024-03-17T07:26:43.706557+0000","172.21.15.49:0/3939719787":"2024-03-17T07:26:43.706557+0000","172.21.15.49:0/2280956996":"2024-03-17T07:25:51.170804+0000","172.21.15.49:0/417307946":"2024-03-17T07:26:43.706557+0000","172.21.15.49:0/992397985":"2024-03-17T07:26:43.706557+0000","172.21.15.49:6824/3723994962":"2024-03-17T07:25:51.170804+0000","172.21.15.49:0/3175975684":"2024-03-17T07:26:43.706557+0000","172.21.15.49:0/227725099":"2024-03-17T07:26:43.706557+0000","172.21.15.49:0/2404418359":"2024-03-17T07:26:43.706557+0000","172.21.15.49:6825/3723994962":"2024-03-17T07:25:51.170804+0000","172.21.15.49:0/3295617512":"2024-03-16T08:26:30.316835+0000","172.21.15.49:0/1600139833":"2024-03-17T07:25:51.170804+0000","172.21.15.49:0/1380123362":"2024-03-17T07:25:51.170804+0000","172.21.15.49:0/1982487108":"2024-03-17T07:26:43.706557+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T07:26:48.441 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-03-16T07:26:48.441 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T07:26:48.866 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:26:48.866 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":25,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4497,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6827/2700845528","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":2700845528},{"type":"v1","addr":"172.21.15.49:6827","nonce":2700845528}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4502,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6830/1983317600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":1983317600},{"type":"v1","addr":"172.21.15.49:6830","nonce":1983317600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4503,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6831/1363178912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6829","nonce":1363178912},{"type":"v1","addr":"172.21.15.49:6831","nonce":1363178912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-16T07:25:26.124693+0000","modified":"2024-03-16T07:26:27.259642+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4509},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4509":{"gid":4509,"name":"e","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6835/3541821089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":3541821089},{"type":"v1","addr":"172.21.15.49:6835","nonce":3541821089}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4509,"qdb_cluster":[4509]},"id":2},{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-16T07:25:40.160397+0000","modified":"2024-03-16T07:25:43.171652+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4506},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4506":{"gid":4506,"name":"c","rank":0,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.49:6833/4243939102","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":4243939102},{"type":"v1","addr":"172.21.15.49:6833","nonce":4243939102}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"backup_fs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4506,"qdb_cluster":[4506]},"id":3}]} 2024-03-16T07:26:48.866 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 25 2024-03-16T07:26:48.880 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T07:26:49.243 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:26:49.243 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":25,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4497,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6827/2700845528","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":2700845528},{"type":"v1","addr":"172.21.15.49:6827","nonce":2700845528}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4502,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6830/1983317600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":1983317600},{"type":"v1","addr":"172.21.15.49:6830","nonce":1983317600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4503,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6831/1363178912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6829","nonce":1363178912},{"type":"v1","addr":"172.21.15.49:6831","nonce":1363178912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-16T07:25:26.124693+0000","modified":"2024-03-16T07:26:27.259642+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4509},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4509":{"gid":4509,"name":"e","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6835/3541821089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":3541821089},{"type":"v1","addr":"172.21.15.49:6835","nonce":3541821089}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4509,"qdb_cluster":[4509]},"id":2},{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-16T07:25:40.160397+0000","modified":"2024-03-16T07:25:43.171652+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4506},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4506":{"gid":4506,"name":"c","rank":0,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.49:6833/4243939102","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":4243939102},{"type":"v1","addr":"172.21.15.49:6833","nonce":4243939102}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"backup_fs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4506,"qdb_cluster":[4506]},"id":3}]} 2024-03-16T07:26:49.244 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 25 2024-03-16T07:26:49.256 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T07:26:49.593 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:26:49.593 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":35,"fsid":"f91af061-9eac-4793-87fa-8d27ae3d242f","created":"2024-03-16T07:24:20.357868+0000","modified":"2024-03-16T07:26:43.706628+0000","last_up_change":"2024-03-16T07:24:27.474980+0000","last_in_change":"2024-03-16T07:24:21.254179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T07:24:28.947521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-03-16T07:25:24.035315+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-03-16T07:25:25.110355+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.0800000429153442,"score_stable":1.0800000429153442,"optimal_score":1,"raw_score_acting":1.0800000429153442,"raw_score_stable":1.0800000429153442,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"backup_fs_metadata","create_time":"2024-03-16T07:25:38.710921+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"backup_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.2200000286102295,"score_stable":1.2200000286102295,"optimal_score":1,"raw_score_acting":1.2200000286102295,"raw_score_stable":1.2200000286102295,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"backup_fs_data","create_time":"2024-03-16T07:25:39.142890+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"backup_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.2200000286102295,"score_stable":1.2200000286102295,"optimal_score":1,"raw_score_acting":1.2200000286102295,"raw_score_stable":1.2200000286102295,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2df14aac-98dc-4e3c-ae7e-9eb677aa30be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6801","nonce":2744935777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6803","nonce":2744935777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6807","nonce":2744935777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6805","nonce":2744935777}]},"public_addr":"172.21.15.49:6801/2744935777","cluster_addr":"172.21.15.49:6803/2744935777","heartbeat_back_addr":"172.21.15.49:6807/2744935777","heartbeat_front_addr":"172.21.15.49:6805/2744935777","state":["exists","up"]},{"osd":1,"uuid":"80461bd9-59ef-46df-9eea-bad92d960c57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6811","nonce":1655120118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6815","nonce":1655120118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6821","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6823","nonce":1655120118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6817","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6819","nonce":1655120118}]},"public_addr":"172.21.15.49:6811/1655120118","cluster_addr":"172.21.15.49:6815/1655120118","heartbeat_back_addr":"172.21.15.49:6823/1655120118","heartbeat_front_addr":"172.21.15.49:6819/1655120118","state":["exists","up"]},{"osd":2,"uuid":"d6bf40eb-6e42-4ec9-8b3d-0b6c5a6def79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6810","nonce":3815472376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6814","nonce":3815472376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6822","nonce":3815472376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6818","nonce":3815472376}]},"public_addr":"172.21.15.49:6810/3815472376","cluster_addr":"172.21.15.49:6814/3815472376","heartbeat_back_addr":"172.21.15.49:6822/3815472376","heartbeat_front_addr":"172.21.15.49:6818/3815472376","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.641492+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.668598+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.614940+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.49:0/3811452563":"2024-03-17T07:26:43.706557+0000","172.21.15.49:0/1835107982":"2024-03-17T07:26:43.706557+0000","172.21.15.49:6825/1628852325":"2024-03-17T07:26:43.706557+0000","172.21.15.49:0/2278133012":"2024-03-17T07:25:51.170804+0000","172.21.15.49:6824/1628852325":"2024-03-17T07:26:43.706557+0000","172.21.15.49:0/3939719787":"2024-03-17T07:26:43.706557+0000","172.21.15.49:0/2280956996":"2024-03-17T07:25:51.170804+0000","172.21.15.49:0/417307946":"2024-03-17T07:26:43.706557+0000","172.21.15.49:0/992397985":"2024-03-17T07:26:43.706557+0000","172.21.15.49:6824/3723994962":"2024-03-17T07:25:51.170804+0000","172.21.15.49:0/3175975684":"2024-03-17T07:26:43.706557+0000","172.21.15.49:0/227725099":"2024-03-17T07:26:43.706557+0000","172.21.15.49:0/2404418359":"2024-03-17T07:26:43.706557+0000","172.21.15.49:6825/3723994962":"2024-03-17T07:25:51.170804+0000","172.21.15.49:0/3295617512":"2024-03-16T08:26:30.316835+0000","172.21.15.49:0/1600139833":"2024-03-17T07:25:51.170804+0000","172.21.15.49:0/1380123362":"2024-03-17T07:25:51.170804+0000","172.21.15.49:0/1982487108":"2024-03-17T07:26:43.706557+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T07:26:49.606 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-03-16T07:26:49.975 INFO:tasks.ceph.mon.a.smithi049.stderr:2024-03-16T07:26:49.977+0000 7feb67011640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-03-16T07:26:49.976 INFO:teuthology.orchestra.run.smithi049.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-03-16T07:26:49.977 INFO:tasks.ceph.mds.e.smithi049.stderr: -574> 2024-03-16T07:25:31.052+0000 7fe501dbd640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-03-16T07:26:49.993 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-03-16T07:26:50.004 INFO:tasks.ceph.mds.e.smithi049.stdout:starting mds.e at 2024-03-16T07:26:50.997 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-03-16T07:26:52.266 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_metadata' removed 2024-03-16T07:26:52.288 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-03-16T07:26:53.269 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_data' removed 2024-03-16T07:26:53.290 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T07:26:53.591 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:26:53.591 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":38,"fsid":"f91af061-9eac-4793-87fa-8d27ae3d242f","created":"2024-03-16T07:24:20.357868+0000","modified":"2024-03-16T07:26:53.268348+0000","last_up_change":"2024-03-16T07:24:27.474980+0000","last_in_change":"2024-03-16T07:24:21.254179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T07:24:28.947521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"backup_fs_metadata","create_time":"2024-03-16T07:25:38.710921+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"backup_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.2200000286102295,"score_stable":1.2200000286102295,"optimal_score":1,"raw_score_acting":1.2200000286102295,"raw_score_stable":1.2200000286102295,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"backup_fs_data","create_time":"2024-03-16T07:25:39.142890+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"backup_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.2200000286102295,"score_stable":1.2200000286102295,"optimal_score":1,"raw_score_acting":1.2200000286102295,"raw_score_stable":1.2200000286102295,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2df14aac-98dc-4e3c-ae7e-9eb677aa30be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6801","nonce":2744935777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6803","nonce":2744935777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6807","nonce":2744935777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6805","nonce":2744935777}]},"public_addr":"172.21.15.49:6801/2744935777","cluster_addr":"172.21.15.49:6803/2744935777","heartbeat_back_addr":"172.21.15.49:6807/2744935777","heartbeat_front_addr":"172.21.15.49:6805/2744935777","state":["exists","up"]},{"osd":1,"uuid":"80461bd9-59ef-46df-9eea-bad92d960c57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6811","nonce":1655120118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6815","nonce":1655120118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6821","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6823","nonce":1655120118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6817","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6819","nonce":1655120118}]},"public_addr":"172.21.15.49:6811/1655120118","cluster_addr":"172.21.15.49:6815/1655120118","heartbeat_back_addr":"172.21.15.49:6823/1655120118","heartbeat_front_addr":"172.21.15.49:6819/1655120118","state":["exists","up"]},{"osd":2,"uuid":"d6bf40eb-6e42-4ec9-8b3d-0b6c5a6def79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6810","nonce":3815472376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6814","nonce":3815472376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6822","nonce":3815472376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6818","nonce":3815472376}]},"public_addr":"172.21.15.49:6810/3815472376","cluster_addr":"172.21.15.49:6814/3815472376","heartbeat_back_addr":"172.21.15.49:6822/3815472376","heartbeat_front_addr":"172.21.15.49:6818/3815472376","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.641492+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.668598+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.614940+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.49:0/3811452563":"2024-03-17T07:26:43.706557+0000","172.21.15.49:0/1835107982":"2024-03-17T07:26:43.706557+0000","172.21.15.49:6825/1628852325":"2024-03-17T07:26:43.706557+0000","172.21.15.49:0/2278133012":"2024-03-17T07:25:51.170804+0000","172.21.15.49:6835/3541821089":"2024-03-17T07:26:49.977573+0000","172.21.15.49:6824/1628852325":"2024-03-17T07:26:43.706557+0000","172.21.15.49:0/3939719787":"2024-03-17T07:26:43.706557+0000","172.21.15.49:0/2280956996":"2024-03-17T07:25:51.170804+0000","172.21.15.49:0/417307946":"2024-03-17T07:26:43.706557+0000","172.21.15.49:0/992397985":"2024-03-17T07:26:43.706557+0000","172.21.15.49:6824/3723994962":"2024-03-17T07:25:51.170804+0000","172.21.15.49:0/3175975684":"2024-03-17T07:26:43.706557+0000","172.21.15.49:0/227725099":"2024-03-17T07:26:43.706557+0000","172.21.15.49:0/2404418359":"2024-03-17T07:26:43.706557+0000","172.21.15.49:6825/3723994962":"2024-03-17T07:25:51.170804+0000","172.21.15.49:6834/3541821089":"2024-03-17T07:26:49.977573+0000","172.21.15.49:0/3295617512":"2024-03-16T08:26:30.316835+0000","172.21.15.49:0/1600139833":"2024-03-17T07:25:51.170804+0000","172.21.15.49:0/1380123362":"2024-03-17T07:25:51.170804+0000","172.21.15.49:0/1982487108":"2024-03-17T07:26:43.706557+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T07:26:53.608 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-16T07:24:28.947521+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'backup_fs_metadata', 'create_time': '2024-03-16T07:25:38.710921+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '31', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'backup_fs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.2200000286102295, 'score_stable': 1.2200000286102295, 'optimal_score': 1, 'raw_score_acting': 1.2200000286102295, 'raw_score_stable': 1.2200000286102295, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'backup_fs_data', 'create_time': '2024-03-16T07:25:39.142890+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '32', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'backup_fs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.2200000286102295, 'score_stable': 1.2200000286102295, 'optimal_score': 1, 'raw_score_acting': 1.2200000286102295, 'raw_score_stable': 1.2200000286102295, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-16T07:26:53.609 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-16T07:26:54.045 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2024-03-16T07:26:54.058 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get backup_fs_metadata pg_num 2024-03-16T07:26:54.364 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2024-03-16T07:26:54.377 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get backup_fs_data pg_num 2024-03-16T07:26:54.703 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2024-03-16T07:26:54.718 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T07:26:55.062 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:26:55.062 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":27,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4497,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6827/2700845528","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":2700845528},{"type":"v1","addr":"172.21.15.49:6827","nonce":2700845528}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4502,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6830/1983317600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":1983317600},{"type":"v1","addr":"172.21.15.49:6830","nonce":1983317600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4503,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6831/1363178912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6829","nonce":1363178912},{"type":"v1","addr":"172.21.15.49:6831","nonce":1363178912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4812,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/969825603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":969825603},{"type":"v1","addr":"172.21.15.49:6835","nonce":969825603}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-16T07:25:40.160397+0000","modified":"2024-03-16T07:25:43.171652+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4506},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4506":{"gid":4506,"name":"c","rank":0,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.49:6833/4243939102","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":4243939102},{"type":"v1","addr":"172.21.15.49:6833","nonce":4243939102}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"backup_fs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4506,"qdb_cluster":[4506]},"id":3}]} 2024-03-16T07:26:55.063 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 27 2024-03-16T07:26:55.075 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T07:26:55.377 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:26:55.377 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":38,"fsid":"f91af061-9eac-4793-87fa-8d27ae3d242f","created":"2024-03-16T07:24:20.357868+0000","modified":"2024-03-16T07:26:53.268348+0000","last_up_change":"2024-03-16T07:24:27.474980+0000","last_in_change":"2024-03-16T07:24:21.254179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T07:24:28.947521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"backup_fs_metadata","create_time":"2024-03-16T07:25:38.710921+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"backup_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.2200000286102295,"score_stable":1.2200000286102295,"optimal_score":1,"raw_score_acting":1.2200000286102295,"raw_score_stable":1.2200000286102295,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"backup_fs_data","create_time":"2024-03-16T07:25:39.142890+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"backup_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.2200000286102295,"score_stable":1.2200000286102295,"optimal_score":1,"raw_score_acting":1.2200000286102295,"raw_score_stable":1.2200000286102295,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2df14aac-98dc-4e3c-ae7e-9eb677aa30be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6801","nonce":2744935777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6803","nonce":2744935777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6807","nonce":2744935777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6805","nonce":2744935777}]},"public_addr":"172.21.15.49:6801/2744935777","cluster_addr":"172.21.15.49:6803/2744935777","heartbeat_back_addr":"172.21.15.49:6807/2744935777","heartbeat_front_addr":"172.21.15.49:6805/2744935777","state":["exists","up"]},{"osd":1,"uuid":"80461bd9-59ef-46df-9eea-bad92d960c57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6811","nonce":1655120118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6815","nonce":1655120118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6821","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6823","nonce":1655120118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6817","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6819","nonce":1655120118}]},"public_addr":"172.21.15.49:6811/1655120118","cluster_addr":"172.21.15.49:6815/1655120118","heartbeat_back_addr":"172.21.15.49:6823/1655120118","heartbeat_front_addr":"172.21.15.49:6819/1655120118","state":["exists","up"]},{"osd":2,"uuid":"d6bf40eb-6e42-4ec9-8b3d-0b6c5a6def79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6810","nonce":3815472376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6814","nonce":3815472376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6822","nonce":3815472376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6818","nonce":3815472376}]},"public_addr":"172.21.15.49:6810/3815472376","cluster_addr":"172.21.15.49:6814/3815472376","heartbeat_back_addr":"172.21.15.49:6822/3815472376","heartbeat_front_addr":"172.21.15.49:6818/3815472376","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.641492+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.668598+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.614940+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.49:0/3811452563":"2024-03-17T07:26:43.706557+0000","172.21.15.49:0/1835107982":"2024-03-17T07:26:43.706557+0000","172.21.15.49:6825/1628852325":"2024-03-17T07:26:43.706557+0000","172.21.15.49:0/2278133012":"2024-03-17T07:25:51.170804+0000","172.21.15.49:6835/3541821089":"2024-03-17T07:26:49.977573+0000","172.21.15.49:6824/1628852325":"2024-03-17T07:26:43.706557+0000","172.21.15.49:0/3939719787":"2024-03-17T07:26:43.706557+0000","172.21.15.49:0/2280956996":"2024-03-17T07:25:51.170804+0000","172.21.15.49:0/417307946":"2024-03-17T07:26:43.706557+0000","172.21.15.49:0/992397985":"2024-03-17T07:26:43.706557+0000","172.21.15.49:6824/3723994962":"2024-03-17T07:25:51.170804+0000","172.21.15.49:0/3175975684":"2024-03-17T07:26:43.706557+0000","172.21.15.49:0/227725099":"2024-03-17T07:26:43.706557+0000","172.21.15.49:0/2404418359":"2024-03-17T07:26:43.706557+0000","172.21.15.49:6825/3723994962":"2024-03-17T07:25:51.170804+0000","172.21.15.49:6834/3541821089":"2024-03-17T07:26:49.977573+0000","172.21.15.49:0/3295617512":"2024-03-16T08:26:30.316835+0000","172.21.15.49:0/1600139833":"2024-03-17T07:25:51.170804+0000","172.21.15.49:0/1380123362":"2024-03-17T07:25:51.170804+0000","172.21.15.49:0/1982487108":"2024-03-17T07:26:43.706557+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T07:26:55.390 INFO:tasks.cephfs.filesystem:Destroying file system backup_fs and related pools 2024-03-16T07:26:55.390 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T07:26:55.728 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:26:55.729 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":27,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4497,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6827/2700845528","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":2700845528},{"type":"v1","addr":"172.21.15.49:6827","nonce":2700845528}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4502,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6830/1983317600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":1983317600},{"type":"v1","addr":"172.21.15.49:6830","nonce":1983317600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4503,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6831/1363178912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6829","nonce":1363178912},{"type":"v1","addr":"172.21.15.49:6831","nonce":1363178912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4812,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/969825603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":969825603},{"type":"v1","addr":"172.21.15.49:6835","nonce":969825603}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-16T07:25:40.160397+0000","modified":"2024-03-16T07:25:43.171652+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4506},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4506":{"gid":4506,"name":"c","rank":0,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.49:6833/4243939102","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":4243939102},{"type":"v1","addr":"172.21.15.49:6833","nonce":4243939102}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"backup_fs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4506,"qdb_cluster":[4506]},"id":3}]} 2024-03-16T07:26:55.729 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 27 2024-03-16T07:26:55.741 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T07:26:56.202 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:26:56.203 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":27,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4497,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6827/2700845528","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":2700845528},{"type":"v1","addr":"172.21.15.49:6827","nonce":2700845528}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4502,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6830/1983317600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":1983317600},{"type":"v1","addr":"172.21.15.49:6830","nonce":1983317600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4503,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6831/1363178912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6829","nonce":1363178912},{"type":"v1","addr":"172.21.15.49:6831","nonce":1363178912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4812,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/969825603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":969825603},{"type":"v1","addr":"172.21.15.49:6835","nonce":969825603}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-16T07:25:40.160397+0000","modified":"2024-03-16T07:25:43.171652+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4506},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4506":{"gid":4506,"name":"c","rank":0,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.49:6833/4243939102","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":4243939102},{"type":"v1","addr":"172.21.15.49:6833","nonce":4243939102}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"backup_fs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4506,"qdb_cluster":[4506]},"id":3}]} 2024-03-16T07:26:56.203 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 27 2024-03-16T07:26:56.215 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T07:26:56.520 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:26:56.521 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":38,"fsid":"f91af061-9eac-4793-87fa-8d27ae3d242f","created":"2024-03-16T07:24:20.357868+0000","modified":"2024-03-16T07:26:53.268348+0000","last_up_change":"2024-03-16T07:24:27.474980+0000","last_in_change":"2024-03-16T07:24:21.254179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T07:24:28.947521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"backup_fs_metadata","create_time":"2024-03-16T07:25:38.710921+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"backup_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.2200000286102295,"score_stable":1.2200000286102295,"optimal_score":1,"raw_score_acting":1.2200000286102295,"raw_score_stable":1.2200000286102295,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"backup_fs_data","create_time":"2024-03-16T07:25:39.142890+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"backup_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.2200000286102295,"score_stable":1.2200000286102295,"optimal_score":1,"raw_score_acting":1.2200000286102295,"raw_score_stable":1.2200000286102295,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2df14aac-98dc-4e3c-ae7e-9eb677aa30be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6801","nonce":2744935777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6803","nonce":2744935777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6807","nonce":2744935777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6805","nonce":2744935777}]},"public_addr":"172.21.15.49:6801/2744935777","cluster_addr":"172.21.15.49:6803/2744935777","heartbeat_back_addr":"172.21.15.49:6807/2744935777","heartbeat_front_addr":"172.21.15.49:6805/2744935777","state":["exists","up"]},{"osd":1,"uuid":"80461bd9-59ef-46df-9eea-bad92d960c57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6811","nonce":1655120118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6815","nonce":1655120118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6821","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6823","nonce":1655120118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6817","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6819","nonce":1655120118}]},"public_addr":"172.21.15.49:6811/1655120118","cluster_addr":"172.21.15.49:6815/1655120118","heartbeat_back_addr":"172.21.15.49:6823/1655120118","heartbeat_front_addr":"172.21.15.49:6819/1655120118","state":["exists","up"]},{"osd":2,"uuid":"d6bf40eb-6e42-4ec9-8b3d-0b6c5a6def79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6810","nonce":3815472376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6814","nonce":3815472376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6822","nonce":3815472376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6818","nonce":3815472376}]},"public_addr":"172.21.15.49:6810/3815472376","cluster_addr":"172.21.15.49:6814/3815472376","heartbeat_back_addr":"172.21.15.49:6822/3815472376","heartbeat_front_addr":"172.21.15.49:6818/3815472376","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.641492+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.668598+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.614940+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.49:0/3811452563":"2024-03-17T07:26:43.706557+0000","172.21.15.49:0/1835107982":"2024-03-17T07:26:43.706557+0000","172.21.15.49:6825/1628852325":"2024-03-17T07:26:43.706557+0000","172.21.15.49:0/2278133012":"2024-03-17T07:25:51.170804+0000","172.21.15.49:6835/3541821089":"2024-03-17T07:26:49.977573+0000","172.21.15.49:6824/1628852325":"2024-03-17T07:26:43.706557+0000","172.21.15.49:0/3939719787":"2024-03-17T07:26:43.706557+0000","172.21.15.49:0/2280956996":"2024-03-17T07:25:51.170804+0000","172.21.15.49:0/417307946":"2024-03-17T07:26:43.706557+0000","172.21.15.49:0/992397985":"2024-03-17T07:26:43.706557+0000","172.21.15.49:6824/3723994962":"2024-03-17T07:25:51.170804+0000","172.21.15.49:0/3175975684":"2024-03-17T07:26:43.706557+0000","172.21.15.49:0/227725099":"2024-03-17T07:26:43.706557+0000","172.21.15.49:0/2404418359":"2024-03-17T07:26:43.706557+0000","172.21.15.49:6825/3723994962":"2024-03-17T07:25:51.170804+0000","172.21.15.49:6834/3541821089":"2024-03-17T07:26:49.977573+0000","172.21.15.49:0/3295617512":"2024-03-16T08:26:30.316835+0000","172.21.15.49:0/1600139833":"2024-03-17T07:25:51.170804+0000","172.21.15.49:0/1380123362":"2024-03-17T07:25:51.170804+0000","172.21.15.49:0/1982487108":"2024-03-17T07:26:43.706557+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T07:26:56.538 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail backup_fs 2024-03-16T07:26:56.877 INFO:tasks.ceph.mon.a.smithi049.stderr:2024-03-16T07:26:56.879+0000 7feb67011640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-03-16T07:26:56.878 INFO:teuthology.orchestra.run.smithi049.stderr:backup_fs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-03-16T07:26:56.879 INFO:tasks.ceph.mds.c.smithi049.stderr: -437> 2024-03-16T07:25:46.051+0000 7f1d4955b640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-03-16T07:26:56.894 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm backup_fs --yes-i-really-mean-it 2024-03-16T07:26:56.905 INFO:tasks.ceph.mds.c.smithi049.stdout:starting mds.c at 2024-03-16T07:26:57.896 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm backup_fs_metadata backup_fs_metadata --yes-i-really-really-mean-it 2024-03-16T07:26:58.879 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'backup_fs_metadata' removed 2024-03-16T07:26:58.899 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm backup_fs_data backup_fs_data --yes-i-really-really-mean-it 2024-03-16T07:26:59.880 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'backup_fs_data' removed 2024-03-16T07:26:59.900 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-03-16T07:27:00.223 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_mirroring.TestMirroring.test_add_ancestor_and_child_directory' 2024-03-16T07:27:00.894 INFO:tasks.cephfs_test_runner:test_add_ancestor_and_child_directory (tasks.cephfs.test_mirroring.TestMirroring) ... ok 2024-03-16T07:27:00.894 INFO:tasks.cephfs_test_runner:Starting test: test_add_directory_path_normalization (tasks.cephfs.test_mirroring.TestMirroring) 2024-03-16T07:27:00.895 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T07:27:01.198 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:27:01.199 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":41,"fsid":"f91af061-9eac-4793-87fa-8d27ae3d242f","created":"2024-03-16T07:24:20.357868+0000","modified":"2024-03-16T07:26:59.881879+0000","last_up_change":"2024-03-16T07:24:27.474980+0000","last_in_change":"2024-03-16T07:24:21.254179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T07:24:28.947521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2df14aac-98dc-4e3c-ae7e-9eb677aa30be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6801","nonce":2744935777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6803","nonce":2744935777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6807","nonce":2744935777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6805","nonce":2744935777}]},"public_addr":"172.21.15.49:6801/2744935777","cluster_addr":"172.21.15.49:6803/2744935777","heartbeat_back_addr":"172.21.15.49:6807/2744935777","heartbeat_front_addr":"172.21.15.49:6805/2744935777","state":["exists","up"]},{"osd":1,"uuid":"80461bd9-59ef-46df-9eea-bad92d960c57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6811","nonce":1655120118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6815","nonce":1655120118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6821","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6823","nonce":1655120118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6817","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6819","nonce":1655120118}]},"public_addr":"172.21.15.49:6811/1655120118","cluster_addr":"172.21.15.49:6815/1655120118","heartbeat_back_addr":"172.21.15.49:6823/1655120118","heartbeat_front_addr":"172.21.15.49:6819/1655120118","state":["exists","up"]},{"osd":2,"uuid":"d6bf40eb-6e42-4ec9-8b3d-0b6c5a6def79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6810","nonce":3815472376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6814","nonce":3815472376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6822","nonce":3815472376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6818","nonce":3815472376}]},"public_addr":"172.21.15.49:6810/3815472376","cluster_addr":"172.21.15.49:6814/3815472376","heartbeat_back_addr":"172.21.15.49:6822/3815472376","heartbeat_front_addr":"172.21.15.49:6818/3815472376","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.641492+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.668598+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.614940+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.49:6833/4243939102":"2024-03-17T07:26:56.879759+0000","172.21.15.49:0/3811452563":"2024-03-17T07:26:43.706557+0000","172.21.15.49:0/1835107982":"2024-03-17T07:26:43.706557+0000","172.21.15.49:6825/1628852325":"2024-03-17T07:26:43.706557+0000","172.21.15.49:0/2278133012":"2024-03-17T07:25:51.170804+0000","172.21.15.49:6835/3541821089":"2024-03-17T07:26:49.977573+0000","172.21.15.49:6824/1628852325":"2024-03-17T07:26:43.706557+0000","172.21.15.49:6832/4243939102":"2024-03-17T07:26:56.879759+0000","172.21.15.49:0/3939719787":"2024-03-17T07:26:43.706557+0000","172.21.15.49:0/2280956996":"2024-03-17T07:25:51.170804+0000","172.21.15.49:0/417307946":"2024-03-17T07:26:43.706557+0000","172.21.15.49:0/992397985":"2024-03-17T07:26:43.706557+0000","172.21.15.49:6824/3723994962":"2024-03-17T07:25:51.170804+0000","172.21.15.49:0/3175975684":"2024-03-17T07:26:43.706557+0000","172.21.15.49:0/227725099":"2024-03-17T07:26:43.706557+0000","172.21.15.49:0/2404418359":"2024-03-17T07:26:43.706557+0000","172.21.15.49:6825/3723994962":"2024-03-17T07:25:51.170804+0000","172.21.15.49:6834/3541821089":"2024-03-17T07:26:49.977573+0000","172.21.15.49:0/3295617512":"2024-03-16T08:26:30.316835+0000","172.21.15.49:0/1600139833":"2024-03-17T07:25:51.170804+0000","172.21.15.49:0/1380123362":"2024-03-17T07:25:51.170804+0000","172.21.15.49:0/1982487108":"2024-03-17T07:26:43.706557+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T07:27:01.211 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-16T07:24:28.947521+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-16T07:27:01.211 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-16T07:27:01.512 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2024-03-16T07:27:01.525 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_mirroring.TestMirroring.test_add_directory_path_normalization' 2024-03-16T07:27:02.899 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-03-16T07:27:03.224 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-03-16T07:27:03.225 DEBUG:teuthology.orchestra.run.smithi049:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-03-16T07:27:03.268 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-03-16T07:27:03.269 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-03-16T07:27:03.269 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-16T07:27:03.324 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056354,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497664k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=13886 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248828k,nr_inodes=812207,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497664k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2024-03-16T07:27:03.325 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-03-16T07:27:03.325 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-16T07:27:03.380 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056354,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497664k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=13886 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248828k,nr_inodes=812207,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497664k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2024-03-16T07:27:03.380 INFO:tasks.cephfs.cephfs_test_case:[, ] 2024-03-16T07:27:03.380 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T07:27:03.762 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:27:03.762 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":29,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4497,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6827/2700845528","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":2700845528},{"type":"v1","addr":"172.21.15.49:6827","nonce":2700845528}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4502,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6830/1983317600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":1983317600},{"type":"v1","addr":"172.21.15.49:6830","nonce":1983317600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4503,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6831/1363178912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6829","nonce":1363178912},{"type":"v1","addr":"172.21.15.49:6831","nonce":1363178912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4812,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/969825603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":969825603},{"type":"v1","addr":"172.21.15.49:6835","nonce":969825603}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":27},{"gid":4853,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6833/3090833878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":3090833878},{"type":"v1","addr":"172.21.15.49:6833","nonce":3090833878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29}],"filesystems":[]} 2024-03-16T07:27:03.762 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 29 2024-03-16T07:27:03.774 INFO:tasks.ceph.mds.a:Restarting daemon 2024-03-16T07:27:03.775 INFO:tasks.ceph.mds.a:Stopping old one... 2024-03-16T07:27:03.775 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-03-16T07:27:03.775 INFO:teuthology.orchestra.run:waiting for 300 2024-03-16T07:27:03.775 INFO:tasks.ceph.mds.b:Restarting daemon 2024-03-16T07:27:03.775 INFO:tasks.ceph.mds.b:Stopping old one... 2024-03-16T07:27:03.775 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-03-16T07:27:03.775 INFO:teuthology.orchestra.run:waiting for 300 2024-03-16T07:27:03.776 INFO:tasks.ceph.mds.c:Restarting daemon 2024-03-16T07:27:03.776 INFO:tasks.ceph.mds.c:Stopping old one... 2024-03-16T07:27:03.776 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-03-16T07:27:03.776 INFO:teuthology.orchestra.run:waiting for 300 2024-03-16T07:27:03.776 INFO:tasks.ceph.mds.d:Restarting daemon 2024-03-16T07:27:03.776 INFO:tasks.ceph.mds.d:Stopping old one... 2024-03-16T07:27:03.776 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-03-16T07:27:03.777 INFO:teuthology.orchestra.run:waiting for 300 2024-03-16T07:27:03.777 INFO:tasks.ceph.mds.e:Restarting daemon 2024-03-16T07:27:03.777 INFO:tasks.ceph.mds.e:Stopping old one... 2024-03-16T07:27:03.777 DEBUG:tasks.ceph.mds.e:waiting for process to exit 2024-03-16T07:27:03.777 INFO:teuthology.orchestra.run:waiting for 300 2024-03-16T07:27:03.786 INFO:tasks.ceph.mds.a:Stopped 2024-03-16T07:27:03.786 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-03-16T07:27:03.791 INFO:tasks.ceph.mds.b:Stopped 2024-03-16T07:27:03.791 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-03-16T07:27:03.792 INFO:tasks.ceph.mds.c:Stopped 2024-03-16T07:27:03.792 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-03-16T07:27:03.793 INFO:tasks.ceph.mds.d:Stopped 2024-03-16T07:27:03.793 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-03-16T07:27:03.794 INFO:tasks.ceph.mds.e:Stopped 2024-03-16T07:27:03.794 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i e 2024-03-16T07:27:03.833 INFO:tasks.ceph.mds.a:Started 2024-03-16T07:27:03.834 DEBUG:teuthology.parallel:result is None 2024-03-16T07:27:03.834 INFO:tasks.ceph.mds.b:Started 2024-03-16T07:27:03.835 INFO:tasks.ceph.mds.c:Started 2024-03-16T07:27:03.835 DEBUG:teuthology.parallel:result is None 2024-03-16T07:27:03.835 DEBUG:teuthology.parallel:result is None 2024-03-16T07:27:03.836 INFO:tasks.ceph.mds.d:Started 2024-03-16T07:27:03.836 INFO:tasks.ceph.mds.e:Started 2024-03-16T07:27:03.836 DEBUG:teuthology.parallel:result is None 2024-03-16T07:27:03.837 DEBUG:teuthology.parallel:result is None 2024-03-16T07:27:03.837 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-03-16T07:27:03.935 INFO:tasks.ceph.mds.c.smithi049.stdout:starting mds.c at 2024-03-16T07:27:03.939 INFO:tasks.ceph.mds.e.smithi049.stdout:starting mds.e at 2024-03-16T07:27:03.945 INFO:tasks.ceph.mds.a.smithi049.stdout:starting mds.a at 2024-03-16T07:27:03.946 INFO:tasks.ceph.mds.b.smithi049.stdout:starting mds.b at 2024-03-16T07:27:03.953 INFO:tasks.ceph.mds.d.smithi049.stdout:starting mds.d at 2024-03-16T07:27:05.218 INFO:teuthology.orchestra.run.smithi049.stderr: removed all blocklist entries 2024-03-16T07:27:05.234 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-03-16T07:27:05.611 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:27:05.612 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-03-16T07:27:05.612 INFO:teuthology.orchestra.run.smithi049.stdout: "auth_dump": [ 2024-03-16T07:27:05.612 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:27:05.612 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.a", 2024-03-16T07:27:05.612 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAZSfVlKDkWLhAAVo2ZJMZSwTGLhocUPcHaUw==", 2024-03-16T07:27:05.612 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-03-16T07:27:05.612 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2024-03-16T07:27:05.612 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2024-03-16T07:27:05.612 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2024-03-16T07:27:05.612 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-03-16T07:27:05.612 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:05.612 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:27:05.612 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:27:05.613 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.b", 2024-03-16T07:27:05.613 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAZSfVl53IaNhAATOLh8Lzad03tyKQph1oowQ==", 2024-03-16T07:27:05.613 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-03-16T07:27:05.613 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2024-03-16T07:27:05.613 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2024-03-16T07:27:05.613 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2024-03-16T07:27:05.613 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-03-16T07:27:05.613 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:05.613 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:27:05.613 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:27:05.613 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.c", 2024-03-16T07:27:05.613 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAaSfVlI3p/AhAAZEetRkGlMLMEI7hMN7pS5w==", 2024-03-16T07:27:05.613 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-03-16T07:27:05.613 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2024-03-16T07:27:05.613 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2024-03-16T07:27:05.614 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2024-03-16T07:27:05.614 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-03-16T07:27:05.614 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:05.614 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:27:05.614 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:27:05.614 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.d", 2024-03-16T07:27:05.614 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAaSfVl3ueIChAA640lcZj8yUgH9jq7r7B+bA==", 2024-03-16T07:27:05.614 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-03-16T07:27:05.614 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2024-03-16T07:27:05.614 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2024-03-16T07:27:05.614 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2024-03-16T07:27:05.614 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-03-16T07:27:05.614 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:05.614 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:27:05.615 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:27:05.615 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.e", 2024-03-16T07:27:05.615 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAaSfVl8OySEhAAyF3ScxdSuQ0jhZhRbJ2gEg==", 2024-03-16T07:27:05.615 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-03-16T07:27:05.615 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2024-03-16T07:27:05.615 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2024-03-16T07:27:05.615 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2024-03-16T07:27:05.615 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-03-16T07:27:05.615 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:05.615 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:27:05.615 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:27:05.615 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.0", 2024-03-16T07:27:05.615 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAbSfVlNhmeKBAAVnxZbeNKU/kVViG2vb2+tQ==", 2024-03-16T07:27:05.615 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-03-16T07:27:05.615 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2024-03-16T07:27:05.616 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2024-03-16T07:27:05.616 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-03-16T07:27:05.616 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:05.616 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:27:05.616 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:27:05.616 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.1", 2024-03-16T07:27:05.616 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAdSfVlNNNkNhAAKhYH9tWxFT8HH6ZLMnaK7A==", 2024-03-16T07:27:05.616 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-03-16T07:27:05.616 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2024-03-16T07:27:05.616 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2024-03-16T07:27:05.616 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-03-16T07:27:05.616 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:05.616 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:27:05.616 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:27:05.616 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.2", 2024-03-16T07:27:05.617 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAgSfVlXJh1BxAAEOX+brDLOLTkp0thYQgMrw==", 2024-03-16T07:27:05.617 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-03-16T07:27:05.617 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2024-03-16T07:27:05.617 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2024-03-16T07:27:05.617 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-03-16T07:27:05.617 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:05.617 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:27:05.617 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:27:05.617 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.0", 2024-03-16T07:27:05.617 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAaSfVlmBmvGRAAaxdhkajaioVlq23dyv/g4g==", 2024-03-16T07:27:05.617 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-03-16T07:27:05.617 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2024-03-16T07:27:05.617 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow r", 2024-03-16T07:27:05.617 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-03-16T07:27:05.617 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:05.618 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:27:05.618 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:27:05.618 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.1", 2024-03-16T07:27:05.618 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAaSfVlCp2DHRAAdVsc+jh/QA74EBwffEqP5g==", 2024-03-16T07:27:05.618 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-03-16T07:27:05.618 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2024-03-16T07:27:05.618 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow r", 2024-03-16T07:27:05.618 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow rw", 2024-03-16T07:27:05.618 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rwx" 2024-03-16T07:27:05.618 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:05.618 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:27:05.618 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:27:05.618 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.admin", 2024-03-16T07:27:05.618 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAZSfVl0iRiFxAArXglVmR8MpJZNrXNv5tS7A==", 2024-03-16T07:27:05.619 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-03-16T07:27:05.619 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow *", 2024-03-16T07:27:05.619 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2024-03-16T07:27:05.619 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2024-03-16T07:27:05.619 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-03-16T07:27:05.619 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:05.619 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:27:05.619 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:27:05.619 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.mirror", 2024-03-16T07:27:05.619 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAaSfVldspUIRAAa1kAy23ZdMBfbhy+7HMVqA==", 2024-03-16T07:27:05.619 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-03-16T07:27:05.619 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow r", 2024-03-16T07:27:05.619 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow r", 2024-03-16T07:27:05.619 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "profile cephfs-mirror", 2024-03-16T07:27:05.619 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rw tag cephfs metadata=*, allow r tag cephfs data=*" 2024-03-16T07:27:05.620 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:05.620 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:27:05.620 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:27:05.620 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.mirror_remote", 2024-03-16T07:27:05.620 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAaSfVlaygzJRAAJVP9XACdC2Wikb4ZtKci9g==", 2024-03-16T07:27:05.620 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-03-16T07:27:05.620 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow rwps", 2024-03-16T07:27:05.620 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow r", 2024-03-16T07:27:05.620 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow r", 2024-03-16T07:27:05.620 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rw tag cephfs *=*" 2024-03-16T07:27:05.620 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:05.620 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:27:05.620 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:27:05.620 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mgr.x", 2024-03-16T07:27:05.621 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAZSfVlX9BEKhAAftDfT7+IPsQFhrTPl2h0SQ==", 2024-03-16T07:27:05.621 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-03-16T07:27:05.621 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow *", 2024-03-16T07:27:05.621 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile mgr", 2024-03-16T07:27:05.621 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-03-16T07:27:05.621 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:05.621 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:05.621 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2024-03-16T07:27:05.621 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-03-16T07:27:05.624 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T07:27:05.925 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:27:05.925 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":47,"fsid":"f91af061-9eac-4793-87fa-8d27ae3d242f","created":"2024-03-16T07:24:20.357868+0000","modified":"2024-03-16T07:27:05.219868+0000","last_up_change":"2024-03-16T07:24:27.474980+0000","last_in_change":"2024-03-16T07:24:21.254179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T07:24:28.947521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2df14aac-98dc-4e3c-ae7e-9eb677aa30be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6801","nonce":2744935777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6803","nonce":2744935777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6807","nonce":2744935777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6805","nonce":2744935777}]},"public_addr":"172.21.15.49:6801/2744935777","cluster_addr":"172.21.15.49:6803/2744935777","heartbeat_back_addr":"172.21.15.49:6807/2744935777","heartbeat_front_addr":"172.21.15.49:6805/2744935777","state":["exists","up"]},{"osd":1,"uuid":"80461bd9-59ef-46df-9eea-bad92d960c57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6811","nonce":1655120118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6815","nonce":1655120118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6821","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6823","nonce":1655120118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6817","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6819","nonce":1655120118}]},"public_addr":"172.21.15.49:6811/1655120118","cluster_addr":"172.21.15.49:6815/1655120118","heartbeat_back_addr":"172.21.15.49:6823/1655120118","heartbeat_front_addr":"172.21.15.49:6819/1655120118","state":["exists","up"]},{"osd":2,"uuid":"d6bf40eb-6e42-4ec9-8b3d-0b6c5a6def79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6810","nonce":3815472376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6814","nonce":3815472376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6822","nonce":3815472376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6818","nonce":3815472376}]},"public_addr":"172.21.15.49:6810/3815472376","cluster_addr":"172.21.15.49:6814/3815472376","heartbeat_back_addr":"172.21.15.49:6822/3815472376","heartbeat_front_addr":"172.21.15.49:6818/3815472376","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.641492+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.668598+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.614940+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T07:27:05.938 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-16T07:24:28.947521+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-16T07:27:05.938 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-16T07:27:06.240 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2024-03-16T07:27:06.253 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-03-16T07:27:06.556 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:27:06.556 INFO:teuthology.orchestra.run.smithi049.stdout:[ 2024-03-16T07:27:06.556 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:27:06.557 INFO:teuthology.orchestra.run.smithi049.stdout: "poolnum": 1, 2024-03-16T07:27:06.557 INFO:teuthology.orchestra.run.smithi049.stdout: "poolname": ".mgr" 2024-03-16T07:27:06.557 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:06.557 INFO:teuthology.orchestra.run.smithi049.stdout:] 2024-03-16T07:27:06.569 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-03-16T07:27:06.569 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-03-16T07:27:07.219 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_metadata' created 2024-03-16T07:27:07.238 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-03-16T07:27:08.222 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_data' created 2024-03-16T07:27:08.258 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-03-16T07:27:08.289 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T07:27:09.223 INFO:teuthology.orchestra.run.smithi049.stderr:new fs with metadata pool 8 and data pool 9 2024-03-16T07:27:09.243 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T07:27:09.546 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:27:09.547 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":50,"fsid":"f91af061-9eac-4793-87fa-8d27ae3d242f","created":"2024-03-16T07:24:20.357868+0000","modified":"2024-03-16T07:27:08.607155+0000","last_up_change":"2024-03-16T07:24:27.474980+0000","last_in_change":"2024-03-16T07:24:21.254179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T07:24:28.947521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-03-16T07:27:06.904626+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-03-16T07:27:07.577125+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2df14aac-98dc-4e3c-ae7e-9eb677aa30be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6801","nonce":2744935777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6803","nonce":2744935777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6807","nonce":2744935777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6805","nonce":2744935777}]},"public_addr":"172.21.15.49:6801/2744935777","cluster_addr":"172.21.15.49:6803/2744935777","heartbeat_back_addr":"172.21.15.49:6807/2744935777","heartbeat_front_addr":"172.21.15.49:6805/2744935777","state":["exists","up"]},{"osd":1,"uuid":"80461bd9-59ef-46df-9eea-bad92d960c57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6811","nonce":1655120118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6815","nonce":1655120118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6821","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6823","nonce":1655120118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6817","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6819","nonce":1655120118}]},"public_addr":"172.21.15.49:6811/1655120118","cluster_addr":"172.21.15.49:6815/1655120118","heartbeat_back_addr":"172.21.15.49:6823/1655120118","heartbeat_front_addr":"172.21.15.49:6819/1655120118","state":["exists","up"]},{"osd":2,"uuid":"d6bf40eb-6e42-4ec9-8b3d-0b6c5a6def79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6810","nonce":3815472376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6814","nonce":3815472376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6822","nonce":3815472376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6818","nonce":3815472376}]},"public_addr":"172.21.15.49:6810/3815472376","cluster_addr":"172.21.15.49:6814/3815472376","heartbeat_back_addr":"172.21.15.49:6822/3815472376","heartbeat_front_addr":"172.21.15.49:6818/3815472376","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.641492+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.668598+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.614940+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T07:27:09.559 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T07:27:09.861 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:27:09.861 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":50,"fsid":"f91af061-9eac-4793-87fa-8d27ae3d242f","created":"2024-03-16T07:24:20.357868+0000","modified":"2024-03-16T07:27:08.607155+0000","last_up_change":"2024-03-16T07:24:27.474980+0000","last_in_change":"2024-03-16T07:24:21.254179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T07:24:28.947521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-03-16T07:27:06.904626+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-03-16T07:27:07.577125+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2df14aac-98dc-4e3c-ae7e-9eb677aa30be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6801","nonce":2744935777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6803","nonce":2744935777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6807","nonce":2744935777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6805","nonce":2744935777}]},"public_addr":"172.21.15.49:6801/2744935777","cluster_addr":"172.21.15.49:6803/2744935777","heartbeat_back_addr":"172.21.15.49:6807/2744935777","heartbeat_front_addr":"172.21.15.49:6805/2744935777","state":["exists","up"]},{"osd":1,"uuid":"80461bd9-59ef-46df-9eea-bad92d960c57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6811","nonce":1655120118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6815","nonce":1655120118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6821","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6823","nonce":1655120118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6817","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6819","nonce":1655120118}]},"public_addr":"172.21.15.49:6811/1655120118","cluster_addr":"172.21.15.49:6815/1655120118","heartbeat_back_addr":"172.21.15.49:6823/1655120118","heartbeat_front_addr":"172.21.15.49:6819/1655120118","state":["exists","up"]},{"osd":2,"uuid":"d6bf40eb-6e42-4ec9-8b3d-0b6c5a6def79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6810","nonce":3815472376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6814","nonce":3815472376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6822","nonce":3815472376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6818","nonce":3815472376}]},"public_addr":"172.21.15.49:6810/3815472376","cluster_addr":"172.21.15.49:6814/3815472376","heartbeat_back_addr":"172.21.15.49:6822/3815472376","heartbeat_front_addr":"172.21.15.49:6818/3815472376","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.641492+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.668598+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.614940+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T07:27:09.874 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-03-16T07:27:10.239 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-03-16T07:27:10.239 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-03-16T07:27:11.239 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-03-16T07:27:11.239 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T07:27:11.581 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:27:11.581 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":33,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4888,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6827/1901069637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":1901069637},{"type":"v1","addr":"172.21.15.49:6827","nonce":1901069637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30},{"gid":4891,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6829/512304085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":512304085},{"type":"v1","addr":"172.21.15.49:6829","nonce":512304085}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30},{"gid":4894,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6833/2341714657","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":2341714657},{"type":"v1","addr":"172.21.15.49:6833","nonce":2341714657}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30},{"gid":4895,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6832/849811345","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6831","nonce":849811345},{"type":"v1","addr":"172.21.15.49:6832","nonce":849811345}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-16T07:27:08.607433+0000","modified":"2024-03-16T07:27:10.583409+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4898},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4898":{"gid":4898,"name":"d","rank":0,"incarnation":31,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6835/3239577766","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":3239577766},{"type":"v1","addr":"172.21.15.49:6835","nonce":3239577766}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4898,"qdb_cluster":[4898]},"id":4}]} 2024-03-16T07:27:11.581 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 33 2024-03-16T07:27:11.593 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T07:27:11.900 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:27:11.900 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":51,"fsid":"f91af061-9eac-4793-87fa-8d27ae3d242f","created":"2024-03-16T07:24:20.357868+0000","modified":"2024-03-16T07:27:09.906624+0000","last_up_change":"2024-03-16T07:24:27.474980+0000","last_in_change":"2024-03-16T07:24:21.254179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T07:24:28.947521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-03-16T07:27:06.904626+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-03-16T07:27:07.577125+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2df14aac-98dc-4e3c-ae7e-9eb677aa30be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6801","nonce":2744935777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6803","nonce":2744935777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6807","nonce":2744935777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6805","nonce":2744935777}]},"public_addr":"172.21.15.49:6801/2744935777","cluster_addr":"172.21.15.49:6803/2744935777","heartbeat_back_addr":"172.21.15.49:6807/2744935777","heartbeat_front_addr":"172.21.15.49:6805/2744935777","state":["exists","up"]},{"osd":1,"uuid":"80461bd9-59ef-46df-9eea-bad92d960c57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6811","nonce":1655120118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6815","nonce":1655120118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6821","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6823","nonce":1655120118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6817","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6819","nonce":1655120118}]},"public_addr":"172.21.15.49:6811/1655120118","cluster_addr":"172.21.15.49:6815/1655120118","heartbeat_back_addr":"172.21.15.49:6823/1655120118","heartbeat_front_addr":"172.21.15.49:6819/1655120118","state":["exists","up"]},{"osd":2,"uuid":"d6bf40eb-6e42-4ec9-8b3d-0b6c5a6def79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6810","nonce":3815472376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6814","nonce":3815472376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6822","nonce":3815472376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6818","nonce":3815472376}]},"public_addr":"172.21.15.49:6810/3815472376","cluster_addr":"172.21.15.49:6814/3815472376","heartbeat_back_addr":"172.21.15.49:6822/3815472376","heartbeat_front_addr":"172.21.15.49:6818/3815472376","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.641492+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.668598+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.614940+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T07:27:11.912 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-03-16T07:27:11.913 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-16T07:27:12.219 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:27:12.220 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2024-03-16T07:27:12.231 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":33,"stamp":"2024-03-16T07:27:11.735880+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":298,"num_read_kb":503,"num_write":221,"num_write_kb":1908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":115,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":314572800,"kb_used":96168,"kb_used_data":2640,"kb_used_omap":4,"kb_used_meta":93499,"kb_avail":314476632,"statfs":{"total":322122547200,"available":322024071168,"internally_reserved":0,"allocated":2703360,"data_stored":1732117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":95743311},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.513719"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:08.933278+0000","last_change":"2024-03-16T07:27:08.932788+0000","last_active":"2024-03-16T07:27:08.933278+0000","last_peered":"2024-03-16T07:27:08.933278+0000","last_clean":"2024-03-16T07:27:08.933278+0000","last_became_active":"2024-03-16T07:27:08.932342+0000","last_became_peered":"2024-03-16T07:27:08.932342+0000","last_unstale":"2024-03-16T07:27:08.933278+0000","last_undegraded":"2024-03-16T07:27:08.933278+0000","last_fullsized":"2024-03-16T07:27:08.933278+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:02:20.716747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:08.932338+0000","last_change":"2024-03-16T07:27:08.930178+0000","last_active":"2024-03-16T07:27:08.932338+0000","last_peered":"2024-03-16T07:27:08.932338+0000","last_clean":"2024-03-16T07:27:08.932338+0000","last_became_active":"2024-03-16T07:27:08.929644+0000","last_became_peered":"2024-03-16T07:27:08.929644+0000","last_unstale":"2024-03-16T07:27:08.932338+0000","last_undegraded":"2024-03-16T07:27:08.932338+0000","last_fullsized":"2024-03-16T07:27:08.932338+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:19:02.211067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:08.933351+0000","last_change":"2024-03-16T07:27:08.932882+0000","last_active":"2024-03-16T07:27:08.933351+0000","last_peered":"2024-03-16T07:27:08.933351+0000","last_clean":"2024-03-16T07:27:08.933351+0000","last_became_active":"2024-03-16T07:27:08.932495+0000","last_became_peered":"2024-03-16T07:27:08.932495+0000","last_unstale":"2024-03-16T07:27:08.933351+0000","last_undegraded":"2024-03-16T07:27:08.933351+0000","last_fullsized":"2024-03-16T07:27:08.933351+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:51:42.057650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:08.929816+0000","last_change":"2024-03-16T07:27:08.928677+0000","last_active":"2024-03-16T07:27:08.929816+0000","last_peered":"2024-03-16T07:27:08.929816+0000","last_clean":"2024-03-16T07:27:08.929816+0000","last_became_active":"2024-03-16T07:27:08.928373+0000","last_became_peered":"2024-03-16T07:27:08.928373+0000","last_unstale":"2024-03-16T07:27:08.929816+0000","last_undegraded":"2024-03-16T07:27:08.929816+0000","last_fullsized":"2024-03-16T07:27:08.929816+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:12:34.140930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:08.932057+0000","last_change":"2024-03-16T07:27:08.930652+0000","last_active":"2024-03-16T07:27:08.932057+0000","last_peered":"2024-03-16T07:27:08.932057+0000","last_clean":"2024-03-16T07:27:08.932057+0000","last_became_active":"2024-03-16T07:27:08.929994+0000","last_became_peered":"2024-03-16T07:27:08.929994+0000","last_unstale":"2024-03-16T07:27:08.932057+0000","last_undegraded":"2024-03-16T07:27:08.932057+0000","last_fullsized":"2024-03-16T07:27:08.932057+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:34:51.595067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:08.927831+0000","last_change":"2024-03-16T07:27:08.927116+0000","last_active":"2024-03-16T07:27:08.927831+0000","last_peered":"2024-03-16T07:27:08.927831+0000","last_clean":"2024-03-16T07:27:08.927831+0000","last_became_active":"2024-03-16T07:27:08.926871+0000","last_became_peered":"2024-03-16T07:27:08.926871+0000","last_unstale":"2024-03-16T07:27:08.927831+0000","last_undegraded":"2024-03-16T07:27:08.927831+0000","last_fullsized":"2024-03-16T07:27:08.927831+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:22:50.135140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:08.927750+0000","last_change":"2024-03-16T07:27:08.927253+0000","last_active":"2024-03-16T07:27:08.927750+0000","last_peered":"2024-03-16T07:27:08.927750+0000","last_clean":"2024-03-16T07:27:08.927750+0000","last_became_active":"2024-03-16T07:27:08.926863+0000","last_became_peered":"2024-03-16T07:27:08.926863+0000","last_unstale":"2024-03-16T07:27:08.927750+0000","last_undegraded":"2024-03-16T07:27:08.927750+0000","last_fullsized":"2024-03-16T07:27:08.927750+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:44:52.890649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:08.933649+0000","last_change":"2024-03-16T07:27:08.933312+0000","last_active":"2024-03-16T07:27:08.933649+0000","last_peered":"2024-03-16T07:27:08.933649+0000","last_clean":"2024-03-16T07:27:08.933649+0000","last_became_active":"2024-03-16T07:27:08.932097+0000","last_became_peered":"2024-03-16T07:27:08.932097+0000","last_unstale":"2024-03-16T07:27:08.933649+0000","last_undegraded":"2024-03-16T07:27:08.933649+0000","last_fullsized":"2024-03-16T07:27:08.933649+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:09:07.519545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:08.925754+0000","last_change":"2024-03-16T07:27:08.924310+0000","last_active":"2024-03-16T07:27:08.925754+0000","last_peered":"2024-03-16T07:27:08.925754+0000","last_clean":"2024-03-16T07:27:08.925754+0000","last_became_active":"2024-03-16T07:27:08.924068+0000","last_became_peered":"2024-03-16T07:27:08.924068+0000","last_unstale":"2024-03-16T07:27:08.925754+0000","last_undegraded":"2024-03-16T07:27:08.925754+0000","last_fullsized":"2024-03-16T07:27:08.925754+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:37:45.745502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:08.923330+0000","last_change":"2024-03-16T07:27:08.920122+0000","last_active":"2024-03-16T07:27:08.923330+0000","last_peered":"2024-03-16T07:27:08.923330+0000","last_clean":"2024-03-16T07:27:08.923330+0000","last_became_active":"2024-03-16T07:27:08.919879+0000","last_became_peered":"2024-03-16T07:27:08.919879+0000","last_unstale":"2024-03-16T07:27:08.923330+0000","last_undegraded":"2024-03-16T07:27:08.923330+0000","last_fullsized":"2024-03-16T07:27:08.923330+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:32:41.295680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:08.918480+0000","last_change":"2024-03-16T07:27:08.917382+0000","last_active":"2024-03-16T07:27:08.918480+0000","last_peered":"2024-03-16T07:27:08.918480+0000","last_clean":"2024-03-16T07:27:08.918480+0000","last_became_active":"2024-03-16T07:27:08.917137+0000","last_became_peered":"2024-03-16T07:27:08.917137+0000","last_unstale":"2024-03-16T07:27:08.918480+0000","last_undegraded":"2024-03-16T07:27:08.918480+0000","last_fullsized":"2024-03-16T07:27:08.918480+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:45:35.249889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:08.925019+0000","last_change":"2024-03-16T07:27:08.922563+0000","last_active":"2024-03-16T07:27:08.925019+0000","last_peered":"2024-03-16T07:27:08.925019+0000","last_clean":"2024-03-16T07:27:08.925019+0000","last_became_active":"2024-03-16T07:27:08.922314+0000","last_became_peered":"2024-03-16T07:27:08.922314+0000","last_unstale":"2024-03-16T07:27:08.925019+0000","last_undegraded":"2024-03-16T07:27:08.925019+0000","last_fullsized":"2024-03-16T07:27:08.925019+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:34:51.595067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:08.928664+0000","last_change":"2024-03-16T07:27:08.927980+0000","last_active":"2024-03-16T07:27:08.928664+0000","last_peered":"2024-03-16T07:27:08.928664+0000","last_clean":"2024-03-16T07:27:08.928664+0000","last_became_active":"2024-03-16T07:27:08.927737+0000","last_became_peered":"2024-03-16T07:27:08.927737+0000","last_unstale":"2024-03-16T07:27:08.928664+0000","last_undegraded":"2024-03-16T07:27:08.928664+0000","last_fullsized":"2024-03-16T07:27:08.928664+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:53:16.953055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:08.931164+0000","last_change":"2024-03-16T07:27:08.930010+0000","last_active":"2024-03-16T07:27:08.931164+0000","last_peered":"2024-03-16T07:27:08.931164+0000","last_clean":"2024-03-16T07:27:08.931164+0000","last_became_active":"2024-03-16T07:27:08.928878+0000","last_became_peered":"2024-03-16T07:27:08.928878+0000","last_unstale":"2024-03-16T07:27:08.931164+0000","last_undegraded":"2024-03-16T07:27:08.931164+0000","last_fullsized":"2024-03-16T07:27:08.931164+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:45:35.249889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:08.923302+0000","last_change":"2024-03-16T07:27:08.921298+0000","last_active":"2024-03-16T07:27:08.923302+0000","last_peered":"2024-03-16T07:27:08.923302+0000","last_clean":"2024-03-16T07:27:08.923302+0000","last_became_active":"2024-03-16T07:27:08.921040+0000","last_became_peered":"2024-03-16T07:27:08.921040+0000","last_unstale":"2024-03-16T07:27:08.923302+0000","last_undegraded":"2024-03-16T07:27:08.923302+0000","last_fullsized":"2024-03-16T07:27:08.923302+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:39:45.497783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:08.923101+0000","last_change":"2024-03-16T07:27:08.920197+0000","last_active":"2024-03-16T07:27:08.923101+0000","last_peered":"2024-03-16T07:27:08.923101+0000","last_clean":"2024-03-16T07:27:08.923101+0000","last_became_active":"2024-03-16T07:27:08.919784+0000","last_became_peered":"2024-03-16T07:27:08.919784+0000","last_unstale":"2024-03-16T07:27:08.923101+0000","last_undegraded":"2024-03-16T07:27:08.923101+0000","last_fullsized":"2024-03-16T07:27:08.923101+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:21:22.002204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:08.935326+0000","last_change":"2024-03-16T07:27:08.934550+0000","last_active":"2024-03-16T07:27:08.935326+0000","last_peered":"2024-03-16T07:27:08.935326+0000","last_clean":"2024-03-16T07:27:08.935326+0000","last_became_active":"2024-03-16T07:27:08.934318+0000","last_became_peered":"2024-03-16T07:27:08.934318+0000","last_unstale":"2024-03-16T07:27:08.935326+0000","last_undegraded":"2024-03-16T07:27:08.935326+0000","last_fullsized":"2024-03-16T07:27:08.935326+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:19:36.463344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:08.930602+0000","last_change":"2024-03-16T07:27:08.929576+0000","last_active":"2024-03-16T07:27:08.930602+0000","last_peered":"2024-03-16T07:27:08.930602+0000","last_clean":"2024-03-16T07:27:08.930602+0000","last_became_active":"2024-03-16T07:27:08.929323+0000","last_became_peered":"2024-03-16T07:27:08.929323+0000","last_unstale":"2024-03-16T07:27:08.930602+0000","last_undegraded":"2024-03-16T07:27:08.930602+0000","last_fullsized":"2024-03-16T07:27:08.930602+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:06:17.182914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:08.929765+0000","last_change":"2024-03-16T07:27:08.929159+0000","last_active":"2024-03-16T07:27:08.929765+0000","last_peered":"2024-03-16T07:27:08.929765+0000","last_clean":"2024-03-16T07:27:08.929765+0000","last_became_active":"2024-03-16T07:27:08.928915+0000","last_became_peered":"2024-03-16T07:27:08.928915+0000","last_unstale":"2024-03-16T07:27:08.929765+0000","last_undegraded":"2024-03-16T07:27:08.929765+0000","last_fullsized":"2024-03-16T07:27:08.929765+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:16:32.978295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:08.923573+0000","last_change":"2024-03-16T07:27:08.921817+0000","last_active":"2024-03-16T07:27:08.923573+0000","last_peered":"2024-03-16T07:27:08.923573+0000","last_clean":"2024-03-16T07:27:08.923573+0000","last_became_active":"2024-03-16T07:27:08.921104+0000","last_became_peered":"2024-03-16T07:27:08.921104+0000","last_unstale":"2024-03-16T07:27:08.923573+0000","last_undegraded":"2024-03-16T07:27:08.923573+0000","last_fullsized":"2024-03-16T07:27:08.923573+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:49:56.246128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:08.923200+0000","last_change":"2024-03-16T07:27:08.920639+0000","last_active":"2024-03-16T07:27:08.923200+0000","last_peered":"2024-03-16T07:27:08.923200+0000","last_clean":"2024-03-16T07:27:08.923200+0000","last_became_active":"2024-03-16T07:27:08.918624+0000","last_became_peered":"2024-03-16T07:27:08.918624+0000","last_unstale":"2024-03-16T07:27:08.923200+0000","last_undegraded":"2024-03-16T07:27:08.923200+0000","last_fullsized":"2024-03-16T07:27:08.923200+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:20:50.717929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:08.931954+0000","last_change":"2024-03-16T07:27:08.931009+0000","last_active":"2024-03-16T07:27:08.931954+0000","last_peered":"2024-03-16T07:27:08.931954+0000","last_clean":"2024-03-16T07:27:08.931954+0000","last_became_active":"2024-03-16T07:27:08.930742+0000","last_became_peered":"2024-03-16T07:27:08.930742+0000","last_unstale":"2024-03-16T07:27:08.931954+0000","last_undegraded":"2024-03-16T07:27:08.931954+0000","last_fullsized":"2024-03-16T07:27:08.931954+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:16:37.230966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:08.928961+0000","last_change":"2024-03-16T07:27:08.928135+0000","last_active":"2024-03-16T07:27:08.928961+0000","last_peered":"2024-03-16T07:27:08.928961+0000","last_clean":"2024-03-16T07:27:08.928961+0000","last_became_active":"2024-03-16T07:27:08.927873+0000","last_became_peered":"2024-03-16T07:27:08.927873+0000","last_unstale":"2024-03-16T07:27:08.928961+0000","last_undegraded":"2024-03-16T07:27:08.928961+0000","last_fullsized":"2024-03-16T07:27:08.928961+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:02:20.716747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:08.926709+0000","last_change":"2024-03-16T07:27:08.923796+0000","last_active":"2024-03-16T07:27:08.926709+0000","last_peered":"2024-03-16T07:27:08.926709+0000","last_clean":"2024-03-16T07:27:08.926709+0000","last_became_active":"2024-03-16T07:27:08.922862+0000","last_became_peered":"2024-03-16T07:27:08.922862+0000","last_unstale":"2024-03-16T07:27:08.926709+0000","last_undegraded":"2024-03-16T07:27:08.926709+0000","last_fullsized":"2024-03-16T07:27:08.926709+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:16:37.230966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:08.933986+0000","last_change":"2024-03-16T07:27:08.933535+0000","last_active":"2024-03-16T07:27:08.933986+0000","last_peered":"2024-03-16T07:27:08.933986+0000","last_clean":"2024-03-16T07:27:08.933986+0000","last_became_active":"2024-03-16T07:27:08.932851+0000","last_became_peered":"2024-03-16T07:27:08.932851+0000","last_unstale":"2024-03-16T07:27:08.933986+0000","last_undegraded":"2024-03-16T07:27:08.933986+0000","last_fullsized":"2024-03-16T07:27:08.933986+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:10:10.255379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:08.923546+0000","last_change":"2024-03-16T07:27:08.917214+0000","last_active":"2024-03-16T07:27:08.923546+0000","last_peered":"2024-03-16T07:27:08.923546+0000","last_clean":"2024-03-16T07:27:08.923546+0000","last_became_active":"2024-03-16T07:27:08.916970+0000","last_became_peered":"2024-03-16T07:27:08.916970+0000","last_unstale":"2024-03-16T07:27:08.923546+0000","last_undegraded":"2024-03-16T07:27:08.923546+0000","last_fullsized":"2024-03-16T07:27:08.923546+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:05:56.498565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:08.922470+0000","last_change":"2024-03-16T07:27:08.918832+0000","last_active":"2024-03-16T07:27:08.922470+0000","last_peered":"2024-03-16T07:27:08.922470+0000","last_clean":"2024-03-16T07:27:08.922470+0000","last_became_active":"2024-03-16T07:27:08.917629+0000","last_became_peered":"2024-03-16T07:27:08.917629+0000","last_unstale":"2024-03-16T07:27:08.922470+0000","last_undegraded":"2024-03-16T07:27:08.922470+0000","last_fullsized":"2024-03-16T07:27:08.922470+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:59:26.308863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:08.933677+0000","last_change":"2024-03-16T07:27:08.932888+0000","last_active":"2024-03-16T07:27:08.933677+0000","last_peered":"2024-03-16T07:27:08.933677+0000","last_clean":"2024-03-16T07:27:08.933677+0000","last_became_active":"2024-03-16T07:27:08.932595+0000","last_became_peered":"2024-03-16T07:27:08.932595+0000","last_unstale":"2024-03-16T07:27:08.933677+0000","last_undegraded":"2024-03-16T07:27:08.933677+0000","last_fullsized":"2024-03-16T07:27:08.933677+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:42:41.885383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:08.932077+0000","last_change":"2024-03-16T07:27:08.930920+0000","last_active":"2024-03-16T07:27:08.932077+0000","last_peered":"2024-03-16T07:27:08.932077+0000","last_clean":"2024-03-16T07:27:08.932077+0000","last_became_active":"2024-03-16T07:27:08.930391+0000","last_became_peered":"2024-03-16T07:27:08.930391+0000","last_unstale":"2024-03-16T07:27:08.932077+0000","last_undegraded":"2024-03-16T07:27:08.932077+0000","last_fullsized":"2024-03-16T07:27:08.932077+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:13:55.490732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:08.931039+0000","last_change":"2024-03-16T07:27:08.930429+0000","last_active":"2024-03-16T07:27:08.931039+0000","last_peered":"2024-03-16T07:27:08.931039+0000","last_clean":"2024-03-16T07:27:08.931039+0000","last_became_active":"2024-03-16T07:27:08.930100+0000","last_became_peered":"2024-03-16T07:27:08.930100+0000","last_unstale":"2024-03-16T07:27:08.931039+0000","last_undegraded":"2024-03-16T07:27:08.931039+0000","last_fullsized":"2024-03-16T07:27:08.931039+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:10:10.255379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:08.931941+0000","last_change":"2024-03-16T07:27:08.930019+0000","last_active":"2024-03-16T07:27:08.931941+0000","last_peered":"2024-03-16T07:27:08.931941+0000","last_clean":"2024-03-16T07:27:08.931941+0000","last_became_active":"2024-03-16T07:27:08.929748+0000","last_became_peered":"2024-03-16T07:27:08.929748+0000","last_unstale":"2024-03-16T07:27:08.931941+0000","last_undegraded":"2024-03-16T07:27:08.931941+0000","last_fullsized":"2024-03-16T07:27:08.931941+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:32:41.295680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:08.922293+0000","last_change":"2024-03-16T07:27:08.917968+0000","last_active":"2024-03-16T07:27:08.922293+0000","last_peered":"2024-03-16T07:27:08.922293+0000","last_clean":"2024-03-16T07:27:08.922293+0000","last_became_active":"2024-03-16T07:27:08.917728+0000","last_became_peered":"2024-03-16T07:27:08.917728+0000","last_unstale":"2024-03-16T07:27:08.922293+0000","last_undegraded":"2024-03-16T07:27:08.922293+0000","last_fullsized":"2024-03-16T07:27:08.922293+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:30:30.334015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:08.924559+0000","last_change":"2024-03-16T07:27:08.923456+0000","last_active":"2024-03-16T07:27:08.924559+0000","last_peered":"2024-03-16T07:27:08.924559+0000","last_clean":"2024-03-16T07:27:08.924559+0000","last_became_active":"2024-03-16T07:27:08.923199+0000","last_became_peered":"2024-03-16T07:27:08.923199+0000","last_unstale":"2024-03-16T07:27:08.924559+0000","last_undegraded":"2024-03-16T07:27:08.924559+0000","last_fullsized":"2024-03-16T07:27:08.924559+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:53:05.188117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"50'4","reported_seq":16,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:09.235870+0000","last_change":"2024-03-16T07:27:08.238783+0000","last_active":"2024-03-16T07:27:09.235870+0000","last_peered":"2024-03-16T07:27:09.235870+0000","last_clean":"2024-03-16T07:27:09.235870+0000","last_became_active":"2024-03-16T07:27:08.238514+0000","last_became_peered":"2024-03-16T07:27:08.238514+0000","last_unstale":"2024-03-16T07:27:09.235870+0000","last_undegraded":"2024-03-16T07:27:09.235870+0000","last_fullsized":"2024-03-16T07:27:09.235870+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_clean_scrub_stamp":"2024-03-16T07:27:07.221025+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:50:54.465358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:08.928993+0000","last_change":"2024-03-16T07:27:08.927216+0000","last_active":"2024-03-16T07:27:08.928993+0000","last_peered":"2024-03-16T07:27:08.928993+0000","last_clean":"2024-03-16T07:27:08.928993+0000","last_became_active":"2024-03-16T07:27:08.926974+0000","last_became_peered":"2024-03-16T07:27:08.926974+0000","last_unstale":"2024-03-16T07:27:08.928993+0000","last_undegraded":"2024-03-16T07:27:08.928993+0000","last_fullsized":"2024-03-16T07:27:08.928993+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:17:38.662498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"50'1","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:09.235209+0000","last_change":"2024-03-16T07:27:08.243342+0000","last_active":"2024-03-16T07:27:09.235209+0000","last_peered":"2024-03-16T07:27:09.235209+0000","last_clean":"2024-03-16T07:27:09.235209+0000","last_became_active":"2024-03-16T07:27:08.243089+0000","last_became_peered":"2024-03-16T07:27:08.243089+0000","last_unstale":"2024-03-16T07:27:09.235209+0000","last_undegraded":"2024-03-16T07:27:09.235209+0000","last_fullsized":"2024-03-16T07:27:09.235209+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_clean_scrub_stamp":"2024-03-16T07:27:07.221025+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:24:56.759854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:08.923145+0000","last_change":"2024-03-16T07:27:08.920357+0000","last_active":"2024-03-16T07:27:08.923145+0000","last_peered":"2024-03-16T07:27:08.923145+0000","last_clean":"2024-03-16T07:27:08.923145+0000","last_became_active":"2024-03-16T07:27:08.920136+0000","last_became_peered":"2024-03-16T07:27:08.920136+0000","last_unstale":"2024-03-16T07:27:08.923145+0000","last_undegraded":"2024-03-16T07:27:08.923145+0000","last_fullsized":"2024-03-16T07:27:08.923145+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:40:34.948715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"50'2","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:09.235768+0000","last_change":"2024-03-16T07:27:08.238987+0000","last_active":"2024-03-16T07:27:09.235768+0000","last_peered":"2024-03-16T07:27:09.235768+0000","last_clean":"2024-03-16T07:27:09.235768+0000","last_became_active":"2024-03-16T07:27:08.238719+0000","last_became_peered":"2024-03-16T07:27:08.238719+0000","last_unstale":"2024-03-16T07:27:09.235768+0000","last_undegraded":"2024-03-16T07:27:09.235768+0000","last_fullsized":"2024-03-16T07:27:09.235768+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_clean_scrub_stamp":"2024-03-16T07:27:07.221025+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:41:53.144945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:08.922489+0000","last_change":"2024-03-16T07:27:08.919220+0000","last_active":"2024-03-16T07:27:08.922489+0000","last_peered":"2024-03-16T07:27:08.922489+0000","last_clean":"2024-03-16T07:27:08.922489+0000","last_became_active":"2024-03-16T07:27:08.918442+0000","last_became_peered":"2024-03-16T07:27:08.918442+0000","last_unstale":"2024-03-16T07:27:08.922489+0000","last_undegraded":"2024-03-16T07:27:08.922489+0000","last_fullsized":"2024-03-16T07:27:08.922489+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:48:06.707550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"50'2","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:09.236855+0000","last_change":"2024-03-16T07:27:08.251673+0000","last_active":"2024-03-16T07:27:09.236855+0000","last_peered":"2024-03-16T07:27:09.236855+0000","last_clean":"2024-03-16T07:27:09.236855+0000","last_became_active":"2024-03-16T07:27:08.251104+0000","last_became_peered":"2024-03-16T07:27:08.251104+0000","last_unstale":"2024-03-16T07:27:09.236855+0000","last_undegraded":"2024-03-16T07:27:09.236855+0000","last_fullsized":"2024-03-16T07:27:09.236855+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_clean_scrub_stamp":"2024-03-16T07:27:07.221025+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:49:03.362326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:08.930293+0000","last_change":"2024-03-16T07:27:08.928496+0000","last_active":"2024-03-16T07:27:08.930293+0000","last_peered":"2024-03-16T07:27:08.930293+0000","last_clean":"2024-03-16T07:27:08.930293+0000","last_became_active":"2024-03-16T07:27:08.927127+0000","last_became_peered":"2024-03-16T07:27:08.927127+0000","last_unstale":"2024-03-16T07:27:08.930293+0000","last_undegraded":"2024-03-16T07:27:08.930293+0000","last_fullsized":"2024-03-16T07:27:08.930293+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:09:07.519545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1b","version":"50'1","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:09.236167+0000","last_change":"2024-03-16T07:27:08.250216+0000","last_active":"2024-03-16T07:27:09.236167+0000","last_peered":"2024-03-16T07:27:09.236167+0000","last_clean":"2024-03-16T07:27:09.236167+0000","last_became_active":"2024-03-16T07:27:08.249406+0000","last_became_peered":"2024-03-16T07:27:08.249406+0000","last_unstale":"2024-03-16T07:27:09.236167+0000","last_undegraded":"2024-03-16T07:27:09.236167+0000","last_fullsized":"2024-03-16T07:27:09.236167+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_clean_scrub_stamp":"2024-03-16T07:27:07.221025+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:47:11.940256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:08.923217+0000","last_change":"2024-03-16T07:27:08.921380+0000","last_active":"2024-03-16T07:27:08.923217+0000","last_peered":"2024-03-16T07:27:08.923217+0000","last_clean":"2024-03-16T07:27:08.923217+0000","last_became_active":"2024-03-16T07:27:08.917937+0000","last_became_peered":"2024-03-16T07:27:08.917937+0000","last_unstale":"2024-03-16T07:27:08.923217+0000","last_undegraded":"2024-03-16T07:27:08.923217+0000","last_fullsized":"2024-03-16T07:27:08.923217+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:42:15.574955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1a","version":"50'1","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:09.235600+0000","last_change":"2024-03-16T07:27:08.245016+0000","last_active":"2024-03-16T07:27:09.235600+0000","last_peered":"2024-03-16T07:27:09.235600+0000","last_clean":"2024-03-16T07:27:09.235600+0000","last_became_active":"2024-03-16T07:27:08.243158+0000","last_became_peered":"2024-03-16T07:27:08.243158+0000","last_unstale":"2024-03-16T07:27:09.235600+0000","last_undegraded":"2024-03-16T07:27:09.235600+0000","last_fullsized":"2024-03-16T07:27:09.235600+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_clean_scrub_stamp":"2024-03-16T07:27:07.221025+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:57:34.038940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:08.933417+0000","last_change":"2024-03-16T07:27:08.931567+0000","last_active":"2024-03-16T07:27:08.933417+0000","last_peered":"2024-03-16T07:27:08.933417+0000","last_clean":"2024-03-16T07:27:08.933417+0000","last_became_active":"2024-03-16T07:27:08.929182+0000","last_became_peered":"2024-03-16T07:27:08.929182+0000","last_unstale":"2024-03-16T07:27:08.933417+0000","last_undegraded":"2024-03-16T07:27:08.933417+0000","last_fullsized":"2024-03-16T07:27:08.933417+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:17:38.662498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:08.912969+0000","last_change":"2024-03-16T07:27:08.245798+0000","last_active":"2024-03-16T07:27:08.912969+0000","last_peered":"2024-03-16T07:27:08.912969+0000","last_clean":"2024-03-16T07:27:08.912969+0000","last_became_active":"2024-03-16T07:27:08.245428+0000","last_became_peered":"2024-03-16T07:27:08.245428+0000","last_unstale":"2024-03-16T07:27:08.912969+0000","last_undegraded":"2024-03-16T07:27:08.912969+0000","last_fullsized":"2024-03-16T07:27:08.912969+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_clean_scrub_stamp":"2024-03-16T07:27:07.221025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:04:40.243410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:08.930520+0000","last_change":"2024-03-16T07:27:08.929543+0000","last_active":"2024-03-16T07:27:08.930520+0000","last_peered":"2024-03-16T07:27:08.930520+0000","last_clean":"2024-03-16T07:27:08.930520+0000","last_became_active":"2024-03-16T07:27:08.929296+0000","last_became_peered":"2024-03-16T07:27:08.929296+0000","last_unstale":"2024-03-16T07:27:08.930520+0000","last_undegraded":"2024-03-16T07:27:08.930520+0000","last_fullsized":"2024-03-16T07:27:08.930520+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:59:10.396139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:08.908136+0000","last_change":"2024-03-16T07:27:08.244309+0000","last_active":"2024-03-16T07:27:08.908136+0000","last_peered":"2024-03-16T07:27:08.908136+0000","last_clean":"2024-03-16T07:27:08.908136+0000","last_became_active":"2024-03-16T07:27:08.244038+0000","last_became_peered":"2024-03-16T07:27:08.244038+0000","last_unstale":"2024-03-16T07:27:08.908136+0000","last_undegraded":"2024-03-16T07:27:08.908136+0000","last_fullsized":"2024-03-16T07:27:08.908136+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_clean_scrub_stamp":"2024-03-16T07:27:07.221025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:19:01.607856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:08.924540+0000","last_change":"2024-03-16T07:27:08.923413+0000","last_active":"2024-03-16T07:27:08.924540+0000","last_peered":"2024-03-16T07:27:08.924540+0000","last_clean":"2024-03-16T07:27:08.924540+0000","last_became_active":"2024-03-16T07:27:08.922819+0000","last_became_peered":"2024-03-16T07:27:08.922819+0000","last_unstale":"2024-03-16T07:27:08.924540+0000","last_undegraded":"2024-03-16T07:27:08.924540+0000","last_fullsized":"2024-03-16T07:27:08.924540+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:22:44.713849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:08.913270+0000","last_change":"2024-03-16T07:27:08.245187+0000","last_active":"2024-03-16T07:27:08.913270+0000","last_peered":"2024-03-16T07:27:08.913270+0000","last_clean":"2024-03-16T07:27:08.913270+0000","last_became_active":"2024-03-16T07:27:08.244487+0000","last_became_peered":"2024-03-16T07:27:08.244487+0000","last_unstale":"2024-03-16T07:27:08.913270+0000","last_undegraded":"2024-03-16T07:27:08.913270+0000","last_fullsized":"2024-03-16T07:27:08.913270+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_clean_scrub_stamp":"2024-03-16T07:27:07.221025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:49:03.362326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:08.932592+0000","last_change":"2024-03-16T07:27:08.931465+0000","last_active":"2024-03-16T07:27:08.932592+0000","last_peered":"2024-03-16T07:27:08.932592+0000","last_clean":"2024-03-16T07:27:08.932592+0000","last_became_active":"2024-03-16T07:27:08.930807+0000","last_became_peered":"2024-03-16T07:27:08.930807+0000","last_unstale":"2024-03-16T07:27:08.932592+0000","last_undegraded":"2024-03-16T07:27:08.932592+0000","last_fullsized":"2024-03-16T07:27:08.932592+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:37:45.745502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:08.913541+0000","last_change":"2024-03-16T07:27:08.247276+0000","last_active":"2024-03-16T07:27:08.913541+0000","last_peered":"2024-03-16T07:27:08.913541+0000","last_clean":"2024-03-16T07:27:08.913541+0000","last_became_active":"2024-03-16T07:27:08.246996+0000","last_became_peered":"2024-03-16T07:27:08.246996+0000","last_unstale":"2024-03-16T07:27:08.913541+0000","last_undegraded":"2024-03-16T07:27:08.913541+0000","last_fullsized":"2024-03-16T07:27:08.913541+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_clean_scrub_stamp":"2024-03-16T07:27:07.221025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:16:31.977141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:08.931228+0000","last_change":"2024-03-16T07:27:08.927907+0000","last_active":"2024-03-16T07:27:08.931228+0000","last_peered":"2024-03-16T07:27:08.931228+0000","last_clean":"2024-03-16T07:27:08.931228+0000","last_became_active":"2024-03-16T07:27:08.927028+0000","last_became_peered":"2024-03-16T07:27:08.927028+0000","last_unstale":"2024-03-16T07:27:08.931228+0000","last_undegraded":"2024-03-16T07:27:08.931228+0000","last_fullsized":"2024-03-16T07:27:08.931228+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:53:13.011941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"50'3","reported_seq":15,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:09.236685+0000","last_change":"2024-03-16T07:27:08.251102+0000","last_active":"2024-03-16T07:27:09.236685+0000","last_peered":"2024-03-16T07:27:09.236685+0000","last_clean":"2024-03-16T07:27:09.236685+0000","last_became_active":"2024-03-16T07:27:08.250854+0000","last_became_peered":"2024-03-16T07:27:08.250854+0000","last_unstale":"2024-03-16T07:27:09.236685+0000","last_undegraded":"2024-03-16T07:27:09.236685+0000","last_fullsized":"2024-03-16T07:27:09.236685+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_clean_scrub_stamp":"2024-03-16T07:27:07.221025+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:24:56.759854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:08.923444+0000","last_change":"2024-03-16T07:27:08.921393+0000","last_active":"2024-03-16T07:27:08.923444+0000","last_peered":"2024-03-16T07:27:08.923444+0000","last_clean":"2024-03-16T07:27:08.923444+0000","last_became_active":"2024-03-16T07:27:08.921149+0000","last_became_peered":"2024-03-16T07:27:08.921149+0000","last_unstale":"2024-03-16T07:27:08.923444+0000","last_undegraded":"2024-03-16T07:27:08.923444+0000","last_fullsized":"2024-03-16T07:27:08.923444+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:19:02.211067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.14","version":"50'6","reported_seq":18,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:09.238486+0000","last_change":"2024-03-16T07:27:08.244864+0000","last_active":"2024-03-16T07:27:09.238486+0000","last_peered":"2024-03-16T07:27:09.238486+0000","last_clean":"2024-03-16T07:27:09.238486+0000","last_became_active":"2024-03-16T07:27:08.244060+0000","last_became_peered":"2024-03-16T07:27:08.244060+0000","last_unstale":"2024-03-16T07:27:09.238486+0000","last_undegraded":"2024-03-16T07:27:09.238486+0000","last_fullsized":"2024-03-16T07:27:09.238486+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_clean_scrub_stamp":"2024-03-16T07:27:07.221025+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:54:48.471326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:08.930277+0000","last_change":"2024-03-16T07:27:08.928325+0000","last_active":"2024-03-16T07:27:08.930277+0000","last_peered":"2024-03-16T07:27:08.930277+0000","last_clean":"2024-03-16T07:27:08.930277+0000","last_became_active":"2024-03-16T07:27:08.927710+0000","last_became_peered":"2024-03-16T07:27:08.927710+0000","last_unstale":"2024-03-16T07:27:08.930277+0000","last_undegraded":"2024-03-16T07:27:08.930277+0000","last_fullsized":"2024-03-16T07:27:08.930277+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:42:41.885383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"50'2","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:09.237077+0000","last_change":"2024-03-16T07:27:08.246435+0000","last_active":"2024-03-16T07:27:09.237077+0000","last_peered":"2024-03-16T07:27:09.237077+0000","last_clean":"2024-03-16T07:27:09.237077+0000","last_became_active":"2024-03-16T07:27:08.246149+0000","last_became_peered":"2024-03-16T07:27:08.246149+0000","last_unstale":"2024-03-16T07:27:09.237077+0000","last_undegraded":"2024-03-16T07:27:09.237077+0000","last_fullsized":"2024-03-16T07:27:09.237077+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_clean_scrub_stamp":"2024-03-16T07:27:07.221025+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:37:36.164804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:08.932094+0000","last_change":"2024-03-16T07:27:08.931009+0000","last_active":"2024-03-16T07:27:08.932094+0000","last_peered":"2024-03-16T07:27:08.932094+0000","last_clean":"2024-03-16T07:27:08.932094+0000","last_became_active":"2024-03-16T07:27:08.930682+0000","last_became_peered":"2024-03-16T07:27:08.930682+0000","last_unstale":"2024-03-16T07:27:08.932094+0000","last_undegraded":"2024-03-16T07:27:08.932094+0000","last_fullsized":"2024-03-16T07:27:08.932094+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:50:22.397494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:08.919388+0000","last_change":"2024-03-16T07:27:08.249638+0000","last_active":"2024-03-16T07:27:08.919388+0000","last_peered":"2024-03-16T07:27:08.919388+0000","last_clean":"2024-03-16T07:27:08.919388+0000","last_became_active":"2024-03-16T07:27:08.249343+0000","last_became_peered":"2024-03-16T07:27:08.249343+0000","last_unstale":"2024-03-16T07:27:08.919388+0000","last_undegraded":"2024-03-16T07:27:08.919388+0000","last_fullsized":"2024-03-16T07:27:08.919388+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_clean_scrub_stamp":"2024-03-16T07:27:07.221025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:47:23.821578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:08.926730+0000","last_change":"2024-03-16T07:27:08.923986+0000","last_active":"2024-03-16T07:27:08.926730+0000","last_peered":"2024-03-16T07:27:08.926730+0000","last_clean":"2024-03-16T07:27:08.926730+0000","last_became_active":"2024-03-16T07:27:08.922698+0000","last_became_peered":"2024-03-16T07:27:08.922698+0000","last_unstale":"2024-03-16T07:27:08.926730+0000","last_undegraded":"2024-03-16T07:27:08.926730+0000","last_fullsized":"2024-03-16T07:27:08.926730+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:50:22.397494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:08.919058+0000","last_change":"2024-03-16T07:27:08.250046+0000","last_active":"2024-03-16T07:27:08.919058+0000","last_peered":"2024-03-16T07:27:08.919058+0000","last_clean":"2024-03-16T07:27:08.919058+0000","last_became_active":"2024-03-16T07:27:08.249650+0000","last_became_peered":"2024-03-16T07:27:08.249650+0000","last_unstale":"2024-03-16T07:27:08.919058+0000","last_undegraded":"2024-03-16T07:27:08.919058+0000","last_fullsized":"2024-03-16T07:27:08.919058+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_clean_scrub_stamp":"2024-03-16T07:27:07.221025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:37:36.164804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:08.928008+0000","last_change":"2024-03-16T07:27:08.927562+0000","last_active":"2024-03-16T07:27:08.928008+0000","last_peered":"2024-03-16T07:27:08.928008+0000","last_clean":"2024-03-16T07:27:08.928008+0000","last_became_active":"2024-03-16T07:27:08.927206+0000","last_became_peered":"2024-03-16T07:27:08.927206+0000","last_unstale":"2024-03-16T07:27:08.928008+0000","last_undegraded":"2024-03-16T07:27:08.928008+0000","last_fullsized":"2024-03-16T07:27:08.928008+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:44:59.574947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"50'8","reported_seq":20,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:09.237247+0000","last_change":"2024-03-16T07:27:08.238193+0000","last_active":"2024-03-16T07:27:09.237247+0000","last_peered":"2024-03-16T07:27:09.237247+0000","last_clean":"2024-03-16T07:27:09.237247+0000","last_became_active":"2024-03-16T07:27:08.237926+0000","last_became_peered":"2024-03-16T07:27:08.237926+0000","last_unstale":"2024-03-16T07:27:09.237247+0000","last_undegraded":"2024-03-16T07:27:09.237247+0000","last_fullsized":"2024-03-16T07:27:09.237247+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_clean_scrub_stamp":"2024-03-16T07:27:07.221025+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:20:22.062889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:08.932356+0000","last_change":"2024-03-16T07:27:08.930378+0000","last_active":"2024-03-16T07:27:08.932356+0000","last_peered":"2024-03-16T07:27:08.932356+0000","last_clean":"2024-03-16T07:27:08.932356+0000","last_became_active":"2024-03-16T07:27:08.929970+0000","last_became_peered":"2024-03-16T07:27:08.929970+0000","last_unstale":"2024-03-16T07:27:08.932356+0000","last_undegraded":"2024-03-16T07:27:08.932356+0000","last_fullsized":"2024-03-16T07:27:08.932356+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:49:56.246128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.f","version":"50'1","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:09.235487+0000","last_change":"2024-03-16T07:27:08.244995+0000","last_active":"2024-03-16T07:27:09.235487+0000","last_peered":"2024-03-16T07:27:09.235487+0000","last_clean":"2024-03-16T07:27:09.235487+0000","last_became_active":"2024-03-16T07:27:08.244700+0000","last_became_peered":"2024-03-16T07:27:08.244700+0000","last_unstale":"2024-03-16T07:27:09.235487+0000","last_undegraded":"2024-03-16T07:27:09.235487+0000","last_fullsized":"2024-03-16T07:27:09.235487+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_clean_scrub_stamp":"2024-03-16T07:27:07.221025+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:07:09.331421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:08.932627+0000","last_change":"2024-03-16T07:27:08.931661+0000","last_active":"2024-03-16T07:27:08.932627+0000","last_peered":"2024-03-16T07:27:08.932627+0000","last_clean":"2024-03-16T07:27:08.932627+0000","last_became_active":"2024-03-16T07:27:08.931137+0000","last_became_peered":"2024-03-16T07:27:08.931137+0000","last_unstale":"2024-03-16T07:27:08.932627+0000","last_undegraded":"2024-03-16T07:27:08.932627+0000","last_fullsized":"2024-03-16T07:27:08.932627+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:51:10.574665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"50'2","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:09.235462+0000","last_change":"2024-03-16T07:27:08.243152+0000","last_active":"2024-03-16T07:27:09.235462+0000","last_peered":"2024-03-16T07:27:09.235462+0000","last_clean":"2024-03-16T07:27:09.235462+0000","last_became_active":"2024-03-16T07:27:08.242667+0000","last_became_peered":"2024-03-16T07:27:08.242667+0000","last_unstale":"2024-03-16T07:27:09.235462+0000","last_undegraded":"2024-03-16T07:27:09.235462+0000","last_fullsized":"2024-03-16T07:27:09.235462+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_clean_scrub_stamp":"2024-03-16T07:27:07.221025+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:18:38.969631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:08.934628+0000","last_change":"2024-03-16T07:27:08.934193+0000","last_active":"2024-03-16T07:27:08.934628+0000","last_peered":"2024-03-16T07:27:08.934628+0000","last_clean":"2024-03-16T07:27:08.934628+0000","last_became_active":"2024-03-16T07:27:08.933927+0000","last_became_peered":"2024-03-16T07:27:08.933927+0000","last_unstale":"2024-03-16T07:27:08.934628+0000","last_undegraded":"2024-03-16T07:27:08.934628+0000","last_fullsized":"2024-03-16T07:27:08.934628+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:49:03.915540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.d","version":"50'1","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:09.236748+0000","last_change":"2024-03-16T07:27:08.251729+0000","last_active":"2024-03-16T07:27:09.236748+0000","last_peered":"2024-03-16T07:27:09.236748+0000","last_clean":"2024-03-16T07:27:09.236748+0000","last_became_active":"2024-03-16T07:27:08.251457+0000","last_became_peered":"2024-03-16T07:27:08.251457+0000","last_unstale":"2024-03-16T07:27:09.236748+0000","last_undegraded":"2024-03-16T07:27:09.236748+0000","last_fullsized":"2024-03-16T07:27:09.236748+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_clean_scrub_stamp":"2024-03-16T07:27:07.221025+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:46:43.084148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:08.923344+0000","last_change":"2024-03-16T07:27:08.921973+0000","last_active":"2024-03-16T07:27:08.923344+0000","last_peered":"2024-03-16T07:27:08.923344+0000","last_clean":"2024-03-16T07:27:08.923344+0000","last_became_active":"2024-03-16T07:27:08.921742+0000","last_became_peered":"2024-03-16T07:27:08.921742+0000","last_unstale":"2024-03-16T07:27:08.923344+0000","last_undegraded":"2024-03-16T07:27:08.923344+0000","last_fullsized":"2024-03-16T07:27:08.923344+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:10:50.344934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:08.908505+0000","last_change":"2024-03-16T07:27:08.244296+0000","last_active":"2024-03-16T07:27:08.908505+0000","last_peered":"2024-03-16T07:27:08.908505+0000","last_clean":"2024-03-16T07:27:08.908505+0000","last_became_active":"2024-03-16T07:27:08.243822+0000","last_became_peered":"2024-03-16T07:27:08.243822+0000","last_unstale":"2024-03-16T07:27:08.908505+0000","last_undegraded":"2024-03-16T07:27:08.908505+0000","last_fullsized":"2024-03-16T07:27:08.908505+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_clean_scrub_stamp":"2024-03-16T07:27:07.221025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:10:55.596764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:08.925386+0000","last_change":"2024-03-16T07:27:08.923667+0000","last_active":"2024-03-16T07:27:08.925386+0000","last_peered":"2024-03-16T07:27:08.925386+0000","last_clean":"2024-03-16T07:27:08.925386+0000","last_became_active":"2024-03-16T07:27:08.923410+0000","last_became_peered":"2024-03-16T07:27:08.923410+0000","last_unstale":"2024-03-16T07:27:08.925386+0000","last_undegraded":"2024-03-16T07:27:08.925386+0000","last_fullsized":"2024-03-16T07:27:08.925386+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:13:55.490732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.b","version":"50'2","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:09.235678+0000","last_change":"2024-03-16T07:27:08.235239+0000","last_active":"2024-03-16T07:27:09.235678+0000","last_peered":"2024-03-16T07:27:09.235678+0000","last_clean":"2024-03-16T07:27:09.235678+0000","last_became_active":"2024-03-16T07:27:08.234873+0000","last_became_peered":"2024-03-16T07:27:08.234873+0000","last_unstale":"2024-03-16T07:27:09.235678+0000","last_undegraded":"2024-03-16T07:27:09.235678+0000","last_fullsized":"2024-03-16T07:27:09.235678+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_clean_scrub_stamp":"2024-03-16T07:27:07.221025+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:30:53.914463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:08.923183+0000","last_change":"2024-03-16T07:27:08.920383+0000","last_active":"2024-03-16T07:27:08.923183+0000","last_peered":"2024-03-16T07:27:08.923183+0000","last_clean":"2024-03-16T07:27:08.923183+0000","last_became_active":"2024-03-16T07:27:08.918297+0000","last_became_peered":"2024-03-16T07:27:08.918297+0000","last_unstale":"2024-03-16T07:27:08.923183+0000","last_undegraded":"2024-03-16T07:27:08.923183+0000","last_fullsized":"2024-03-16T07:27:08.923183+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:16:51.000948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:08.913536+0000","last_change":"2024-03-16T07:27:08.246964+0000","last_active":"2024-03-16T07:27:08.913536+0000","last_peered":"2024-03-16T07:27:08.913536+0000","last_clean":"2024-03-16T07:27:08.913536+0000","last_became_active":"2024-03-16T07:27:08.246688+0000","last_became_peered":"2024-03-16T07:27:08.246688+0000","last_unstale":"2024-03-16T07:27:08.913536+0000","last_undegraded":"2024-03-16T07:27:08.913536+0000","last_fullsized":"2024-03-16T07:27:08.913536+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_clean_scrub_stamp":"2024-03-16T07:27:07.221025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:47:11.940256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:08.921197+0000","last_change":"2024-03-16T07:27:08.917472+0000","last_active":"2024-03-16T07:27:08.921197+0000","last_peered":"2024-03-16T07:27:08.921197+0000","last_clean":"2024-03-16T07:27:08.921197+0000","last_became_active":"2024-03-16T07:27:08.917235+0000","last_became_peered":"2024-03-16T07:27:08.917235+0000","last_unstale":"2024-03-16T07:27:08.921197+0000","last_undegraded":"2024-03-16T07:27:08.921197+0000","last_fullsized":"2024-03-16T07:27:08.921197+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:43:52.645660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:08.915060+0000","last_change":"2024-03-16T07:27:08.247978+0000","last_active":"2024-03-16T07:27:08.915060+0000","last_peered":"2024-03-16T07:27:08.915060+0000","last_clean":"2024-03-16T07:27:08.915060+0000","last_became_active":"2024-03-16T07:27:08.247725+0000","last_became_peered":"2024-03-16T07:27:08.247725+0000","last_unstale":"2024-03-16T07:27:08.915060+0000","last_undegraded":"2024-03-16T07:27:08.915060+0000","last_fullsized":"2024-03-16T07:27:08.915060+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_clean_scrub_stamp":"2024-03-16T07:27:07.221025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:06:16.181760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:08.932374+0000","last_change":"2024-03-16T07:27:08.930514+0000","last_active":"2024-03-16T07:27:08.932374+0000","last_peered":"2024-03-16T07:27:08.932374+0000","last_clean":"2024-03-16T07:27:08.932374+0000","last_became_active":"2024-03-16T07:27:08.930278+0000","last_became_peered":"2024-03-16T07:27:08.930278+0000","last_unstale":"2024-03-16T07:27:08.932374+0000","last_undegraded":"2024-03-16T07:27:08.932374+0000","last_fullsized":"2024-03-16T07:27:08.932374+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:23:14.216212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"50'2","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:09.237069+0000","last_change":"2024-03-16T07:27:08.242744+0000","last_active":"2024-03-16T07:27:09.237069+0000","last_peered":"2024-03-16T07:27:09.237069+0000","last_clean":"2024-03-16T07:27:09.237069+0000","last_became_active":"2024-03-16T07:27:08.242491+0000","last_became_peered":"2024-03-16T07:27:08.242491+0000","last_unstale":"2024-03-16T07:27:09.237069+0000","last_undegraded":"2024-03-16T07:27:09.237069+0000","last_fullsized":"2024-03-16T07:27:09.237069+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_clean_scrub_stamp":"2024-03-16T07:27:07.221025+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:16:47.057318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:08.933259+0000","last_change":"2024-03-16T07:27:08.932487+0000","last_active":"2024-03-16T07:27:08.933259+0000","last_peered":"2024-03-16T07:27:08.933259+0000","last_clean":"2024-03-16T07:27:08.933259+0000","last_became_active":"2024-03-16T07:27:08.932022+0000","last_became_peered":"2024-03-16T07:27:08.932022+0000","last_unstale":"2024-03-16T07:27:08.933259+0000","last_undegraded":"2024-03-16T07:27:08.933259+0000","last_fullsized":"2024-03-16T07:27:08.933259+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:53:13.011941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:08.909943+0000","last_change":"2024-03-16T07:27:08.242924+0000","last_active":"2024-03-16T07:27:08.909943+0000","last_peered":"2024-03-16T07:27:08.909943+0000","last_clean":"2024-03-16T07:27:08.909943+0000","last_became_active":"2024-03-16T07:27:08.242277+0000","last_became_peered":"2024-03-16T07:27:08.242277+0000","last_unstale":"2024-03-16T07:27:08.909943+0000","last_undegraded":"2024-03-16T07:27:08.909943+0000","last_fullsized":"2024-03-16T07:27:08.909943+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_clean_scrub_stamp":"2024-03-16T07:27:07.221025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:40:23.474145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:08.923593+0000","last_change":"2024-03-16T07:27:08.922001+0000","last_active":"2024-03-16T07:27:08.923593+0000","last_peered":"2024-03-16T07:27:08.923593+0000","last_clean":"2024-03-16T07:27:08.923593+0000","last_became_active":"2024-03-16T07:27:08.921584+0000","last_became_peered":"2024-03-16T07:27:08.921584+0000","last_unstale":"2024-03-16T07:27:08.923593+0000","last_undegraded":"2024-03-16T07:27:08.923593+0000","last_fullsized":"2024-03-16T07:27:08.923593+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:23:14.216212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:08.914108+0000","last_change":"2024-03-16T07:27:08.248496+0000","last_active":"2024-03-16T07:27:08.914108+0000","last_peered":"2024-03-16T07:27:08.914108+0000","last_clean":"2024-03-16T07:27:08.914108+0000","last_became_active":"2024-03-16T07:27:08.247244+0000","last_became_peered":"2024-03-16T07:27:08.247244+0000","last_unstale":"2024-03-16T07:27:08.914108+0000","last_undegraded":"2024-03-16T07:27:08.914108+0000","last_fullsized":"2024-03-16T07:27:08.914108+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_clean_scrub_stamp":"2024-03-16T07:27:07.221025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:59:09.394985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:08.923326+0000","last_change":"2024-03-16T07:27:08.918934+0000","last_active":"2024-03-16T07:27:08.923326+0000","last_peered":"2024-03-16T07:27:08.923326+0000","last_clean":"2024-03-16T07:27:08.923326+0000","last_became_active":"2024-03-16T07:27:08.917309+0000","last_became_peered":"2024-03-16T07:27:08.917309+0000","last_unstale":"2024-03-16T07:27:08.923326+0000","last_undegraded":"2024-03-16T07:27:08.923326+0000","last_fullsized":"2024-03-16T07:27:08.923326+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:13:32.367215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:08.923151+0000","last_change":"2024-03-16T07:27:08.251830+0000","last_active":"2024-03-16T07:27:08.923151+0000","last_peered":"2024-03-16T07:27:08.923151+0000","last_clean":"2024-03-16T07:27:08.923151+0000","last_became_active":"2024-03-16T07:27:08.251478+0000","last_became_peered":"2024-03-16T07:27:08.251478+0000","last_unstale":"2024-03-16T07:27:08.923151+0000","last_undegraded":"2024-03-16T07:27:08.923151+0000","last_fullsized":"2024-03-16T07:27:08.923151+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_clean_scrub_stamp":"2024-03-16T07:27:07.221025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:16:47.057318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:08.930259+0000","last_change":"2024-03-16T07:27:08.928147+0000","last_active":"2024-03-16T07:27:08.930259+0000","last_peered":"2024-03-16T07:27:08.930259+0000","last_clean":"2024-03-16T07:27:08.930259+0000","last_became_active":"2024-03-16T07:27:08.927393+0000","last_became_peered":"2024-03-16T07:27:08.927393+0000","last_unstale":"2024-03-16T07:27:08.930259+0000","last_undegraded":"2024-03-16T07:27:08.930259+0000","last_fullsized":"2024-03-16T07:27:08.930259+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:51:42.057650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:08.911716+0000","last_change":"2024-03-16T07:27:08.240204+0000","last_active":"2024-03-16T07:27:08.911716+0000","last_peered":"2024-03-16T07:27:08.911716+0000","last_clean":"2024-03-16T07:27:08.911716+0000","last_became_active":"2024-03-16T07:27:08.239950+0000","last_became_peered":"2024-03-16T07:27:08.239950+0000","last_unstale":"2024-03-16T07:27:08.911716+0000","last_undegraded":"2024-03-16T07:27:08.911716+0000","last_fullsized":"2024-03-16T07:27:08.911716+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_clean_scrub_stamp":"2024-03-16T07:27:07.221025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:47:23.821578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:08.923233+0000","last_change":"2024-03-16T07:27:08.920819+0000","last_active":"2024-03-16T07:27:08.923233+0000","last_peered":"2024-03-16T07:27:08.923233+0000","last_clean":"2024-03-16T07:27:08.923233+0000","last_became_active":"2024-03-16T07:27:08.918934+0000","last_became_peered":"2024-03-16T07:27:08.918934+0000","last_unstale":"2024-03-16T07:27:08.923233+0000","last_undegraded":"2024-03-16T07:27:08.923233+0000","last_fullsized":"2024-03-16T07:27:08.923233+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:30:52.728668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:08.919521+0000","last_change":"2024-03-16T07:27:08.250052+0000","last_active":"2024-03-16T07:27:08.919521+0000","last_peered":"2024-03-16T07:27:08.919521+0000","last_clean":"2024-03-16T07:27:08.919521+0000","last_became_active":"2024-03-16T07:27:08.249750+0000","last_became_peered":"2024-03-16T07:27:08.249750+0000","last_unstale":"2024-03-16T07:27:08.919521+0000","last_undegraded":"2024-03-16T07:27:08.919521+0000","last_fullsized":"2024-03-16T07:27:08.919521+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_clean_scrub_stamp":"2024-03-16T07:27:07.221025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:04:40.243410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:08.930420+0000","last_change":"2024-03-16T07:27:08.927243+0000","last_active":"2024-03-16T07:27:08.930420+0000","last_peered":"2024-03-16T07:27:08.930420+0000","last_clean":"2024-03-16T07:27:08.930420+0000","last_became_active":"2024-03-16T07:27:08.926939+0000","last_became_peered":"2024-03-16T07:27:08.926939+0000","last_unstale":"2024-03-16T07:27:08.930420+0000","last_undegraded":"2024-03-16T07:27:08.930420+0000","last_fullsized":"2024-03-16T07:27:08.930420+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:51:10.574665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:08.912995+0000","last_change":"2024-03-16T07:27:08.241445+0000","last_active":"2024-03-16T07:27:08.912995+0000","last_peered":"2024-03-16T07:27:08.912995+0000","last_clean":"2024-03-16T07:27:08.912995+0000","last_became_active":"2024-03-16T07:27:08.241129+0000","last_became_peered":"2024-03-16T07:27:08.241129+0000","last_unstale":"2024-03-16T07:27:08.912995+0000","last_undegraded":"2024-03-16T07:27:08.912995+0000","last_fullsized":"2024-03-16T07:27:08.912995+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_clean_scrub_stamp":"2024-03-16T07:27:07.221025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:46:43.084148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:08.922414+0000","last_change":"2024-03-16T07:27:08.918028+0000","last_active":"2024-03-16T07:27:08.922414+0000","last_peered":"2024-03-16T07:27:08.922414+0000","last_clean":"2024-03-16T07:27:08.922414+0000","last_became_active":"2024-03-16T07:27:08.917397+0000","last_became_peered":"2024-03-16T07:27:08.917397+0000","last_unstale":"2024-03-16T07:27:08.922414+0000","last_undegraded":"2024-03-16T07:27:08.922414+0000","last_fullsized":"2024-03-16T07:27:08.922414+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:06:07.410185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:08.915199+0000","last_change":"2024-03-16T07:27:08.239510+0000","last_active":"2024-03-16T07:27:08.915199+0000","last_peered":"2024-03-16T07:27:08.915199+0000","last_clean":"2024-03-16T07:27:08.915199+0000","last_became_active":"2024-03-16T07:27:08.239209+0000","last_became_peered":"2024-03-16T07:27:08.239209+0000","last_unstale":"2024-03-16T07:27:08.915199+0000","last_undegraded":"2024-03-16T07:27:08.915199+0000","last_fullsized":"2024-03-16T07:27:08.915199+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_clean_scrub_stamp":"2024-03-16T07:27:07.221025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:08:11.994734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:08.931461+0000","last_change":"2024-03-16T07:27:08.929726+0000","last_active":"2024-03-16T07:27:08.931461+0000","last_peered":"2024-03-16T07:27:08.931461+0000","last_clean":"2024-03-16T07:27:08.931461+0000","last_became_active":"2024-03-16T07:27:08.929485+0000","last_became_peered":"2024-03-16T07:27:08.929485+0000","last_unstale":"2024-03-16T07:27:08.931461+0000","last_undegraded":"2024-03-16T07:27:08.931461+0000","last_fullsized":"2024-03-16T07:27:08.931461+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:08:12.995888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:08.910808+0000","last_change":"2024-03-16T07:27:08.247274+0000","last_active":"2024-03-16T07:27:08.910808+0000","last_peered":"2024-03-16T07:27:08.910808+0000","last_clean":"2024-03-16T07:27:08.910808+0000","last_became_active":"2024-03-16T07:27:08.243679+0000","last_became_peered":"2024-03-16T07:27:08.243679+0000","last_unstale":"2024-03-16T07:27:08.910808+0000","last_undegraded":"2024-03-16T07:27:08.910808+0000","last_fullsized":"2024-03-16T07:27:08.910808+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_clean_scrub_stamp":"2024-03-16T07:27:07.221025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:17:46.854764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"35'119","reported_seq":289,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:08.915252+0000","last_change":"2024-03-16T07:24:31.650537+0000","last_active":"2024-03-16T07:27:08.915252+0000","last_peered":"2024-03-16T07:27:08.915252+0000","last_clean":"2024-03-16T07:27:08.915252+0000","last_became_active":"2024-03-16T07:24:31.649574+0000","last_became_peered":"2024-03-16T07:24:31.649574+0000","last_unstale":"2024-03-16T07:27:08.915252+0000","last_undegraded":"2024-03-16T07:27:08.915252+0000","last_fullsized":"2024-03-16T07:27:08.915252+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:29.719970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:29.719970+0000","last_clean_scrub_stamp":"2024-03-16T07:24:29.719970+0000","objects_scrubbed":0,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:31:35.774554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":298,"num_read_kb":503,"num_write":177,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":298,"num_read_kb":503,"num_write":177,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738402,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":31676,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":104825924,"statfs":{"total":107374182400,"available":107341746176,"internally_reserved":0,"allocated":512000,"data_stored":184015,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738402,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":32244,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":104825356,"statfs":{"total":107374182400,"available":107341164544,"internally_reserved":0,"allocated":1093632,"data_stored":773331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738402,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":32248,"kb_used_data":1072,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":104825352,"statfs":{"total":107374182400,"available":107341160448,"internally_reserved":0,"allocated":1097728,"data_stored":774771,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-16T07:27:12.235 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-16T07:27:12.579 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:27:12.580 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2024-03-16T07:27:12.590 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":33,"stamp":"2024-03-16T07:27:11.735880+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":298,"num_read_kb":503,"num_write":221,"num_write_kb":1908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":115,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":314572800,"kb_used":96168,"kb_used_data":2640,"kb_used_omap":4,"kb_used_meta":93499,"kb_avail":314476632,"statfs":{"total":322122547200,"available":322024071168,"internally_reserved":0,"allocated":2703360,"data_stored":1732117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":95743311},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.513719"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:08.933278+0000","last_change":"2024-03-16T07:27:08.932788+0000","last_active":"2024-03-16T07:27:08.933278+0000","last_peered":"2024-03-16T07:27:08.933278+0000","last_clean":"2024-03-16T07:27:08.933278+0000","last_became_active":"2024-03-16T07:27:08.932342+0000","last_became_peered":"2024-03-16T07:27:08.932342+0000","last_unstale":"2024-03-16T07:27:08.933278+0000","last_undegraded":"2024-03-16T07:27:08.933278+0000","last_fullsized":"2024-03-16T07:27:08.933278+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:02:20.716747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:08.932338+0000","last_change":"2024-03-16T07:27:08.930178+0000","last_active":"2024-03-16T07:27:08.932338+0000","last_peered":"2024-03-16T07:27:08.932338+0000","last_clean":"2024-03-16T07:27:08.932338+0000","last_became_active":"2024-03-16T07:27:08.929644+0000","last_became_peered":"2024-03-16T07:27:08.929644+0000","last_unstale":"2024-03-16T07:27:08.932338+0000","last_undegraded":"2024-03-16T07:27:08.932338+0000","last_fullsized":"2024-03-16T07:27:08.932338+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:19:02.211067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:08.933351+0000","last_change":"2024-03-16T07:27:08.932882+0000","last_active":"2024-03-16T07:27:08.933351+0000","last_peered":"2024-03-16T07:27:08.933351+0000","last_clean":"2024-03-16T07:27:08.933351+0000","last_became_active":"2024-03-16T07:27:08.932495+0000","last_became_peered":"2024-03-16T07:27:08.932495+0000","last_unstale":"2024-03-16T07:27:08.933351+0000","last_undegraded":"2024-03-16T07:27:08.933351+0000","last_fullsized":"2024-03-16T07:27:08.933351+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:51:42.057650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:08.929816+0000","last_change":"2024-03-16T07:27:08.928677+0000","last_active":"2024-03-16T07:27:08.929816+0000","last_peered":"2024-03-16T07:27:08.929816+0000","last_clean":"2024-03-16T07:27:08.929816+0000","last_became_active":"2024-03-16T07:27:08.928373+0000","last_became_peered":"2024-03-16T07:27:08.928373+0000","last_unstale":"2024-03-16T07:27:08.929816+0000","last_undegraded":"2024-03-16T07:27:08.929816+0000","last_fullsized":"2024-03-16T07:27:08.929816+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:12:34.140930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:08.932057+0000","last_change":"2024-03-16T07:27:08.930652+0000","last_active":"2024-03-16T07:27:08.932057+0000","last_peered":"2024-03-16T07:27:08.932057+0000","last_clean":"2024-03-16T07:27:08.932057+0000","last_became_active":"2024-03-16T07:27:08.929994+0000","last_became_peered":"2024-03-16T07:27:08.929994+0000","last_unstale":"2024-03-16T07:27:08.932057+0000","last_undegraded":"2024-03-16T07:27:08.932057+0000","last_fullsized":"2024-03-16T07:27:08.932057+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:34:51.595067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:08.927831+0000","last_change":"2024-03-16T07:27:08.927116+0000","last_active":"2024-03-16T07:27:08.927831+0000","last_peered":"2024-03-16T07:27:08.927831+0000","last_clean":"2024-03-16T07:27:08.927831+0000","last_became_active":"2024-03-16T07:27:08.926871+0000","last_became_peered":"2024-03-16T07:27:08.926871+0000","last_unstale":"2024-03-16T07:27:08.927831+0000","last_undegraded":"2024-03-16T07:27:08.927831+0000","last_fullsized":"2024-03-16T07:27:08.927831+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:22:50.135140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:08.927750+0000","last_change":"2024-03-16T07:27:08.927253+0000","last_active":"2024-03-16T07:27:08.927750+0000","last_peered":"2024-03-16T07:27:08.927750+0000","last_clean":"2024-03-16T07:27:08.927750+0000","last_became_active":"2024-03-16T07:27:08.926863+0000","last_became_peered":"2024-03-16T07:27:08.926863+0000","last_unstale":"2024-03-16T07:27:08.927750+0000","last_undegraded":"2024-03-16T07:27:08.927750+0000","last_fullsized":"2024-03-16T07:27:08.927750+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:44:52.890649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:08.933649+0000","last_change":"2024-03-16T07:27:08.933312+0000","last_active":"2024-03-16T07:27:08.933649+0000","last_peered":"2024-03-16T07:27:08.933649+0000","last_clean":"2024-03-16T07:27:08.933649+0000","last_became_active":"2024-03-16T07:27:08.932097+0000","last_became_peered":"2024-03-16T07:27:08.932097+0000","last_unstale":"2024-03-16T07:27:08.933649+0000","last_undegraded":"2024-03-16T07:27:08.933649+0000","last_fullsized":"2024-03-16T07:27:08.933649+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:09:07.519545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:08.925754+0000","last_change":"2024-03-16T07:27:08.924310+0000","last_active":"2024-03-16T07:27:08.925754+0000","last_peered":"2024-03-16T07:27:08.925754+0000","last_clean":"2024-03-16T07:27:08.925754+0000","last_became_active":"2024-03-16T07:27:08.924068+0000","last_became_peered":"2024-03-16T07:27:08.924068+0000","last_unstale":"2024-03-16T07:27:08.925754+0000","last_undegraded":"2024-03-16T07:27:08.925754+0000","last_fullsized":"2024-03-16T07:27:08.925754+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:37:45.745502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:08.923330+0000","last_change":"2024-03-16T07:27:08.920122+0000","last_active":"2024-03-16T07:27:08.923330+0000","last_peered":"2024-03-16T07:27:08.923330+0000","last_clean":"2024-03-16T07:27:08.923330+0000","last_became_active":"2024-03-16T07:27:08.919879+0000","last_became_peered":"2024-03-16T07:27:08.919879+0000","last_unstale":"2024-03-16T07:27:08.923330+0000","last_undegraded":"2024-03-16T07:27:08.923330+0000","last_fullsized":"2024-03-16T07:27:08.923330+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:32:41.295680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:08.918480+0000","last_change":"2024-03-16T07:27:08.917382+0000","last_active":"2024-03-16T07:27:08.918480+0000","last_peered":"2024-03-16T07:27:08.918480+0000","last_clean":"2024-03-16T07:27:08.918480+0000","last_became_active":"2024-03-16T07:27:08.917137+0000","last_became_peered":"2024-03-16T07:27:08.917137+0000","last_unstale":"2024-03-16T07:27:08.918480+0000","last_undegraded":"2024-03-16T07:27:08.918480+0000","last_fullsized":"2024-03-16T07:27:08.918480+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:45:35.249889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:08.925019+0000","last_change":"2024-03-16T07:27:08.922563+0000","last_active":"2024-03-16T07:27:08.925019+0000","last_peered":"2024-03-16T07:27:08.925019+0000","last_clean":"2024-03-16T07:27:08.925019+0000","last_became_active":"2024-03-16T07:27:08.922314+0000","last_became_peered":"2024-03-16T07:27:08.922314+0000","last_unstale":"2024-03-16T07:27:08.925019+0000","last_undegraded":"2024-03-16T07:27:08.925019+0000","last_fullsized":"2024-03-16T07:27:08.925019+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:34:51.595067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:08.928664+0000","last_change":"2024-03-16T07:27:08.927980+0000","last_active":"2024-03-16T07:27:08.928664+0000","last_peered":"2024-03-16T07:27:08.928664+0000","last_clean":"2024-03-16T07:27:08.928664+0000","last_became_active":"2024-03-16T07:27:08.927737+0000","last_became_peered":"2024-03-16T07:27:08.927737+0000","last_unstale":"2024-03-16T07:27:08.928664+0000","last_undegraded":"2024-03-16T07:27:08.928664+0000","last_fullsized":"2024-03-16T07:27:08.928664+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:53:16.953055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:08.931164+0000","last_change":"2024-03-16T07:27:08.930010+0000","last_active":"2024-03-16T07:27:08.931164+0000","last_peered":"2024-03-16T07:27:08.931164+0000","last_clean":"2024-03-16T07:27:08.931164+0000","last_became_active":"2024-03-16T07:27:08.928878+0000","last_became_peered":"2024-03-16T07:27:08.928878+0000","last_unstale":"2024-03-16T07:27:08.931164+0000","last_undegraded":"2024-03-16T07:27:08.931164+0000","last_fullsized":"2024-03-16T07:27:08.931164+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:45:35.249889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:08.923302+0000","last_change":"2024-03-16T07:27:08.921298+0000","last_active":"2024-03-16T07:27:08.923302+0000","last_peered":"2024-03-16T07:27:08.923302+0000","last_clean":"2024-03-16T07:27:08.923302+0000","last_became_active":"2024-03-16T07:27:08.921040+0000","last_became_peered":"2024-03-16T07:27:08.921040+0000","last_unstale":"2024-03-16T07:27:08.923302+0000","last_undegraded":"2024-03-16T07:27:08.923302+0000","last_fullsized":"2024-03-16T07:27:08.923302+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:39:45.497783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:08.923101+0000","last_change":"2024-03-16T07:27:08.920197+0000","last_active":"2024-03-16T07:27:08.923101+0000","last_peered":"2024-03-16T07:27:08.923101+0000","last_clean":"2024-03-16T07:27:08.923101+0000","last_became_active":"2024-03-16T07:27:08.919784+0000","last_became_peered":"2024-03-16T07:27:08.919784+0000","last_unstale":"2024-03-16T07:27:08.923101+0000","last_undegraded":"2024-03-16T07:27:08.923101+0000","last_fullsized":"2024-03-16T07:27:08.923101+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:21:22.002204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:08.935326+0000","last_change":"2024-03-16T07:27:08.934550+0000","last_active":"2024-03-16T07:27:08.935326+0000","last_peered":"2024-03-16T07:27:08.935326+0000","last_clean":"2024-03-16T07:27:08.935326+0000","last_became_active":"2024-03-16T07:27:08.934318+0000","last_became_peered":"2024-03-16T07:27:08.934318+0000","last_unstale":"2024-03-16T07:27:08.935326+0000","last_undegraded":"2024-03-16T07:27:08.935326+0000","last_fullsized":"2024-03-16T07:27:08.935326+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:19:36.463344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:08.930602+0000","last_change":"2024-03-16T07:27:08.929576+0000","last_active":"2024-03-16T07:27:08.930602+0000","last_peered":"2024-03-16T07:27:08.930602+0000","last_clean":"2024-03-16T07:27:08.930602+0000","last_became_active":"2024-03-16T07:27:08.929323+0000","last_became_peered":"2024-03-16T07:27:08.929323+0000","last_unstale":"2024-03-16T07:27:08.930602+0000","last_undegraded":"2024-03-16T07:27:08.930602+0000","last_fullsized":"2024-03-16T07:27:08.930602+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:06:17.182914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:08.929765+0000","last_change":"2024-03-16T07:27:08.929159+0000","last_active":"2024-03-16T07:27:08.929765+0000","last_peered":"2024-03-16T07:27:08.929765+0000","last_clean":"2024-03-16T07:27:08.929765+0000","last_became_active":"2024-03-16T07:27:08.928915+0000","last_became_peered":"2024-03-16T07:27:08.928915+0000","last_unstale":"2024-03-16T07:27:08.929765+0000","last_undegraded":"2024-03-16T07:27:08.929765+0000","last_fullsized":"2024-03-16T07:27:08.929765+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:16:32.978295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:08.923573+0000","last_change":"2024-03-16T07:27:08.921817+0000","last_active":"2024-03-16T07:27:08.923573+0000","last_peered":"2024-03-16T07:27:08.923573+0000","last_clean":"2024-03-16T07:27:08.923573+0000","last_became_active":"2024-03-16T07:27:08.921104+0000","last_became_peered":"2024-03-16T07:27:08.921104+0000","last_unstale":"2024-03-16T07:27:08.923573+0000","last_undegraded":"2024-03-16T07:27:08.923573+0000","last_fullsized":"2024-03-16T07:27:08.923573+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:49:56.246128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:08.923200+0000","last_change":"2024-03-16T07:27:08.920639+0000","last_active":"2024-03-16T07:27:08.923200+0000","last_peered":"2024-03-16T07:27:08.923200+0000","last_clean":"2024-03-16T07:27:08.923200+0000","last_became_active":"2024-03-16T07:27:08.918624+0000","last_became_peered":"2024-03-16T07:27:08.918624+0000","last_unstale":"2024-03-16T07:27:08.923200+0000","last_undegraded":"2024-03-16T07:27:08.923200+0000","last_fullsized":"2024-03-16T07:27:08.923200+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:20:50.717929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:08.931954+0000","last_change":"2024-03-16T07:27:08.931009+0000","last_active":"2024-03-16T07:27:08.931954+0000","last_peered":"2024-03-16T07:27:08.931954+0000","last_clean":"2024-03-16T07:27:08.931954+0000","last_became_active":"2024-03-16T07:27:08.930742+0000","last_became_peered":"2024-03-16T07:27:08.930742+0000","last_unstale":"2024-03-16T07:27:08.931954+0000","last_undegraded":"2024-03-16T07:27:08.931954+0000","last_fullsized":"2024-03-16T07:27:08.931954+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:16:37.230966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:08.928961+0000","last_change":"2024-03-16T07:27:08.928135+0000","last_active":"2024-03-16T07:27:08.928961+0000","last_peered":"2024-03-16T07:27:08.928961+0000","last_clean":"2024-03-16T07:27:08.928961+0000","last_became_active":"2024-03-16T07:27:08.927873+0000","last_became_peered":"2024-03-16T07:27:08.927873+0000","last_unstale":"2024-03-16T07:27:08.928961+0000","last_undegraded":"2024-03-16T07:27:08.928961+0000","last_fullsized":"2024-03-16T07:27:08.928961+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:02:20.716747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:08.926709+0000","last_change":"2024-03-16T07:27:08.923796+0000","last_active":"2024-03-16T07:27:08.926709+0000","last_peered":"2024-03-16T07:27:08.926709+0000","last_clean":"2024-03-16T07:27:08.926709+0000","last_became_active":"2024-03-16T07:27:08.922862+0000","last_became_peered":"2024-03-16T07:27:08.922862+0000","last_unstale":"2024-03-16T07:27:08.926709+0000","last_undegraded":"2024-03-16T07:27:08.926709+0000","last_fullsized":"2024-03-16T07:27:08.926709+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:16:37.230966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:08.933986+0000","last_change":"2024-03-16T07:27:08.933535+0000","last_active":"2024-03-16T07:27:08.933986+0000","last_peered":"2024-03-16T07:27:08.933986+0000","last_clean":"2024-03-16T07:27:08.933986+0000","last_became_active":"2024-03-16T07:27:08.932851+0000","last_became_peered":"2024-03-16T07:27:08.932851+0000","last_unstale":"2024-03-16T07:27:08.933986+0000","last_undegraded":"2024-03-16T07:27:08.933986+0000","last_fullsized":"2024-03-16T07:27:08.933986+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:10:10.255379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:08.923546+0000","last_change":"2024-03-16T07:27:08.917214+0000","last_active":"2024-03-16T07:27:08.923546+0000","last_peered":"2024-03-16T07:27:08.923546+0000","last_clean":"2024-03-16T07:27:08.923546+0000","last_became_active":"2024-03-16T07:27:08.916970+0000","last_became_peered":"2024-03-16T07:27:08.916970+0000","last_unstale":"2024-03-16T07:27:08.923546+0000","last_undegraded":"2024-03-16T07:27:08.923546+0000","last_fullsized":"2024-03-16T07:27:08.923546+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:05:56.498565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:08.922470+0000","last_change":"2024-03-16T07:27:08.918832+0000","last_active":"2024-03-16T07:27:08.922470+0000","last_peered":"2024-03-16T07:27:08.922470+0000","last_clean":"2024-03-16T07:27:08.922470+0000","last_became_active":"2024-03-16T07:27:08.917629+0000","last_became_peered":"2024-03-16T07:27:08.917629+0000","last_unstale":"2024-03-16T07:27:08.922470+0000","last_undegraded":"2024-03-16T07:27:08.922470+0000","last_fullsized":"2024-03-16T07:27:08.922470+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:59:26.308863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:08.933677+0000","last_change":"2024-03-16T07:27:08.932888+0000","last_active":"2024-03-16T07:27:08.933677+0000","last_peered":"2024-03-16T07:27:08.933677+0000","last_clean":"2024-03-16T07:27:08.933677+0000","last_became_active":"2024-03-16T07:27:08.932595+0000","last_became_peered":"2024-03-16T07:27:08.932595+0000","last_unstale":"2024-03-16T07:27:08.933677+0000","last_undegraded":"2024-03-16T07:27:08.933677+0000","last_fullsized":"2024-03-16T07:27:08.933677+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:42:41.885383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:08.932077+0000","last_change":"2024-03-16T07:27:08.930920+0000","last_active":"2024-03-16T07:27:08.932077+0000","last_peered":"2024-03-16T07:27:08.932077+0000","last_clean":"2024-03-16T07:27:08.932077+0000","last_became_active":"2024-03-16T07:27:08.930391+0000","last_became_peered":"2024-03-16T07:27:08.930391+0000","last_unstale":"2024-03-16T07:27:08.932077+0000","last_undegraded":"2024-03-16T07:27:08.932077+0000","last_fullsized":"2024-03-16T07:27:08.932077+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:13:55.490732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:08.931039+0000","last_change":"2024-03-16T07:27:08.930429+0000","last_active":"2024-03-16T07:27:08.931039+0000","last_peered":"2024-03-16T07:27:08.931039+0000","last_clean":"2024-03-16T07:27:08.931039+0000","last_became_active":"2024-03-16T07:27:08.930100+0000","last_became_peered":"2024-03-16T07:27:08.930100+0000","last_unstale":"2024-03-16T07:27:08.931039+0000","last_undegraded":"2024-03-16T07:27:08.931039+0000","last_fullsized":"2024-03-16T07:27:08.931039+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:10:10.255379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:08.931941+0000","last_change":"2024-03-16T07:27:08.930019+0000","last_active":"2024-03-16T07:27:08.931941+0000","last_peered":"2024-03-16T07:27:08.931941+0000","last_clean":"2024-03-16T07:27:08.931941+0000","last_became_active":"2024-03-16T07:27:08.929748+0000","last_became_peered":"2024-03-16T07:27:08.929748+0000","last_unstale":"2024-03-16T07:27:08.931941+0000","last_undegraded":"2024-03-16T07:27:08.931941+0000","last_fullsized":"2024-03-16T07:27:08.931941+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:32:41.295680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:08.922293+0000","last_change":"2024-03-16T07:27:08.917968+0000","last_active":"2024-03-16T07:27:08.922293+0000","last_peered":"2024-03-16T07:27:08.922293+0000","last_clean":"2024-03-16T07:27:08.922293+0000","last_became_active":"2024-03-16T07:27:08.917728+0000","last_became_peered":"2024-03-16T07:27:08.917728+0000","last_unstale":"2024-03-16T07:27:08.922293+0000","last_undegraded":"2024-03-16T07:27:08.922293+0000","last_fullsized":"2024-03-16T07:27:08.922293+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:30:30.334015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:08.924559+0000","last_change":"2024-03-16T07:27:08.923456+0000","last_active":"2024-03-16T07:27:08.924559+0000","last_peered":"2024-03-16T07:27:08.924559+0000","last_clean":"2024-03-16T07:27:08.924559+0000","last_became_active":"2024-03-16T07:27:08.923199+0000","last_became_peered":"2024-03-16T07:27:08.923199+0000","last_unstale":"2024-03-16T07:27:08.924559+0000","last_undegraded":"2024-03-16T07:27:08.924559+0000","last_fullsized":"2024-03-16T07:27:08.924559+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:53:05.188117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"50'4","reported_seq":16,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:09.235870+0000","last_change":"2024-03-16T07:27:08.238783+0000","last_active":"2024-03-16T07:27:09.235870+0000","last_peered":"2024-03-16T07:27:09.235870+0000","last_clean":"2024-03-16T07:27:09.235870+0000","last_became_active":"2024-03-16T07:27:08.238514+0000","last_became_peered":"2024-03-16T07:27:08.238514+0000","last_unstale":"2024-03-16T07:27:09.235870+0000","last_undegraded":"2024-03-16T07:27:09.235870+0000","last_fullsized":"2024-03-16T07:27:09.235870+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_clean_scrub_stamp":"2024-03-16T07:27:07.221025+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:50:54.465358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:08.928993+0000","last_change":"2024-03-16T07:27:08.927216+0000","last_active":"2024-03-16T07:27:08.928993+0000","last_peered":"2024-03-16T07:27:08.928993+0000","last_clean":"2024-03-16T07:27:08.928993+0000","last_became_active":"2024-03-16T07:27:08.926974+0000","last_became_peered":"2024-03-16T07:27:08.926974+0000","last_unstale":"2024-03-16T07:27:08.928993+0000","last_undegraded":"2024-03-16T07:27:08.928993+0000","last_fullsized":"2024-03-16T07:27:08.928993+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:17:38.662498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"50'1","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:09.235209+0000","last_change":"2024-03-16T07:27:08.243342+0000","last_active":"2024-03-16T07:27:09.235209+0000","last_peered":"2024-03-16T07:27:09.235209+0000","last_clean":"2024-03-16T07:27:09.235209+0000","last_became_active":"2024-03-16T07:27:08.243089+0000","last_became_peered":"2024-03-16T07:27:08.243089+0000","last_unstale":"2024-03-16T07:27:09.235209+0000","last_undegraded":"2024-03-16T07:27:09.235209+0000","last_fullsized":"2024-03-16T07:27:09.235209+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_clean_scrub_stamp":"2024-03-16T07:27:07.221025+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:24:56.759854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:08.923145+0000","last_change":"2024-03-16T07:27:08.920357+0000","last_active":"2024-03-16T07:27:08.923145+0000","last_peered":"2024-03-16T07:27:08.923145+0000","last_clean":"2024-03-16T07:27:08.923145+0000","last_became_active":"2024-03-16T07:27:08.920136+0000","last_became_peered":"2024-03-16T07:27:08.920136+0000","last_unstale":"2024-03-16T07:27:08.923145+0000","last_undegraded":"2024-03-16T07:27:08.923145+0000","last_fullsized":"2024-03-16T07:27:08.923145+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:40:34.948715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"50'2","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:09.235768+0000","last_change":"2024-03-16T07:27:08.238987+0000","last_active":"2024-03-16T07:27:09.235768+0000","last_peered":"2024-03-16T07:27:09.235768+0000","last_clean":"2024-03-16T07:27:09.235768+0000","last_became_active":"2024-03-16T07:27:08.238719+0000","last_became_peered":"2024-03-16T07:27:08.238719+0000","last_unstale":"2024-03-16T07:27:09.235768+0000","last_undegraded":"2024-03-16T07:27:09.235768+0000","last_fullsized":"2024-03-16T07:27:09.235768+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_clean_scrub_stamp":"2024-03-16T07:27:07.221025+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:41:53.144945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:08.922489+0000","last_change":"2024-03-16T07:27:08.919220+0000","last_active":"2024-03-16T07:27:08.922489+0000","last_peered":"2024-03-16T07:27:08.922489+0000","last_clean":"2024-03-16T07:27:08.922489+0000","last_became_active":"2024-03-16T07:27:08.918442+0000","last_became_peered":"2024-03-16T07:27:08.918442+0000","last_unstale":"2024-03-16T07:27:08.922489+0000","last_undegraded":"2024-03-16T07:27:08.922489+0000","last_fullsized":"2024-03-16T07:27:08.922489+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:48:06.707550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"50'2","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:09.236855+0000","last_change":"2024-03-16T07:27:08.251673+0000","last_active":"2024-03-16T07:27:09.236855+0000","last_peered":"2024-03-16T07:27:09.236855+0000","last_clean":"2024-03-16T07:27:09.236855+0000","last_became_active":"2024-03-16T07:27:08.251104+0000","last_became_peered":"2024-03-16T07:27:08.251104+0000","last_unstale":"2024-03-16T07:27:09.236855+0000","last_undegraded":"2024-03-16T07:27:09.236855+0000","last_fullsized":"2024-03-16T07:27:09.236855+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_clean_scrub_stamp":"2024-03-16T07:27:07.221025+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:49:03.362326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:08.930293+0000","last_change":"2024-03-16T07:27:08.928496+0000","last_active":"2024-03-16T07:27:08.930293+0000","last_peered":"2024-03-16T07:27:08.930293+0000","last_clean":"2024-03-16T07:27:08.930293+0000","last_became_active":"2024-03-16T07:27:08.927127+0000","last_became_peered":"2024-03-16T07:27:08.927127+0000","last_unstale":"2024-03-16T07:27:08.930293+0000","last_undegraded":"2024-03-16T07:27:08.930293+0000","last_fullsized":"2024-03-16T07:27:08.930293+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:09:07.519545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1b","version":"50'1","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:09.236167+0000","last_change":"2024-03-16T07:27:08.250216+0000","last_active":"2024-03-16T07:27:09.236167+0000","last_peered":"2024-03-16T07:27:09.236167+0000","last_clean":"2024-03-16T07:27:09.236167+0000","last_became_active":"2024-03-16T07:27:08.249406+0000","last_became_peered":"2024-03-16T07:27:08.249406+0000","last_unstale":"2024-03-16T07:27:09.236167+0000","last_undegraded":"2024-03-16T07:27:09.236167+0000","last_fullsized":"2024-03-16T07:27:09.236167+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_clean_scrub_stamp":"2024-03-16T07:27:07.221025+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:47:11.940256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:08.923217+0000","last_change":"2024-03-16T07:27:08.921380+0000","last_active":"2024-03-16T07:27:08.923217+0000","last_peered":"2024-03-16T07:27:08.923217+0000","last_clean":"2024-03-16T07:27:08.923217+0000","last_became_active":"2024-03-16T07:27:08.917937+0000","last_became_peered":"2024-03-16T07:27:08.917937+0000","last_unstale":"2024-03-16T07:27:08.923217+0000","last_undegraded":"2024-03-16T07:27:08.923217+0000","last_fullsized":"2024-03-16T07:27:08.923217+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:42:15.574955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1a","version":"50'1","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:09.235600+0000","last_change":"2024-03-16T07:27:08.245016+0000","last_active":"2024-03-16T07:27:09.235600+0000","last_peered":"2024-03-16T07:27:09.235600+0000","last_clean":"2024-03-16T07:27:09.235600+0000","last_became_active":"2024-03-16T07:27:08.243158+0000","last_became_peered":"2024-03-16T07:27:08.243158+0000","last_unstale":"2024-03-16T07:27:09.235600+0000","last_undegraded":"2024-03-16T07:27:09.235600+0000","last_fullsized":"2024-03-16T07:27:09.235600+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_clean_scrub_stamp":"2024-03-16T07:27:07.221025+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:57:34.038940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:08.933417+0000","last_change":"2024-03-16T07:27:08.931567+0000","last_active":"2024-03-16T07:27:08.933417+0000","last_peered":"2024-03-16T07:27:08.933417+0000","last_clean":"2024-03-16T07:27:08.933417+0000","last_became_active":"2024-03-16T07:27:08.929182+0000","last_became_peered":"2024-03-16T07:27:08.929182+0000","last_unstale":"2024-03-16T07:27:08.933417+0000","last_undegraded":"2024-03-16T07:27:08.933417+0000","last_fullsized":"2024-03-16T07:27:08.933417+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:17:38.662498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:08.912969+0000","last_change":"2024-03-16T07:27:08.245798+0000","last_active":"2024-03-16T07:27:08.912969+0000","last_peered":"2024-03-16T07:27:08.912969+0000","last_clean":"2024-03-16T07:27:08.912969+0000","last_became_active":"2024-03-16T07:27:08.245428+0000","last_became_peered":"2024-03-16T07:27:08.245428+0000","last_unstale":"2024-03-16T07:27:08.912969+0000","last_undegraded":"2024-03-16T07:27:08.912969+0000","last_fullsized":"2024-03-16T07:27:08.912969+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_clean_scrub_stamp":"2024-03-16T07:27:07.221025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:04:40.243410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:08.930520+0000","last_change":"2024-03-16T07:27:08.929543+0000","last_active":"2024-03-16T07:27:08.930520+0000","last_peered":"2024-03-16T07:27:08.930520+0000","last_clean":"2024-03-16T07:27:08.930520+0000","last_became_active":"2024-03-16T07:27:08.929296+0000","last_became_peered":"2024-03-16T07:27:08.929296+0000","last_unstale":"2024-03-16T07:27:08.930520+0000","last_undegraded":"2024-03-16T07:27:08.930520+0000","last_fullsized":"2024-03-16T07:27:08.930520+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:59:10.396139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:08.908136+0000","last_change":"2024-03-16T07:27:08.244309+0000","last_active":"2024-03-16T07:27:08.908136+0000","last_peered":"2024-03-16T07:27:08.908136+0000","last_clean":"2024-03-16T07:27:08.908136+0000","last_became_active":"2024-03-16T07:27:08.244038+0000","last_became_peered":"2024-03-16T07:27:08.244038+0000","last_unstale":"2024-03-16T07:27:08.908136+0000","last_undegraded":"2024-03-16T07:27:08.908136+0000","last_fullsized":"2024-03-16T07:27:08.908136+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_clean_scrub_stamp":"2024-03-16T07:27:07.221025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:19:01.607856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:08.924540+0000","last_change":"2024-03-16T07:27:08.923413+0000","last_active":"2024-03-16T07:27:08.924540+0000","last_peered":"2024-03-16T07:27:08.924540+0000","last_clean":"2024-03-16T07:27:08.924540+0000","last_became_active":"2024-03-16T07:27:08.922819+0000","last_became_peered":"2024-03-16T07:27:08.922819+0000","last_unstale":"2024-03-16T07:27:08.924540+0000","last_undegraded":"2024-03-16T07:27:08.924540+0000","last_fullsized":"2024-03-16T07:27:08.924540+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:22:44.713849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:08.913270+0000","last_change":"2024-03-16T07:27:08.245187+0000","last_active":"2024-03-16T07:27:08.913270+0000","last_peered":"2024-03-16T07:27:08.913270+0000","last_clean":"2024-03-16T07:27:08.913270+0000","last_became_active":"2024-03-16T07:27:08.244487+0000","last_became_peered":"2024-03-16T07:27:08.244487+0000","last_unstale":"2024-03-16T07:27:08.913270+0000","last_undegraded":"2024-03-16T07:27:08.913270+0000","last_fullsized":"2024-03-16T07:27:08.913270+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_clean_scrub_stamp":"2024-03-16T07:27:07.221025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:49:03.362326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:08.932592+0000","last_change":"2024-03-16T07:27:08.931465+0000","last_active":"2024-03-16T07:27:08.932592+0000","last_peered":"2024-03-16T07:27:08.932592+0000","last_clean":"2024-03-16T07:27:08.932592+0000","last_became_active":"2024-03-16T07:27:08.930807+0000","last_became_peered":"2024-03-16T07:27:08.930807+0000","last_unstale":"2024-03-16T07:27:08.932592+0000","last_undegraded":"2024-03-16T07:27:08.932592+0000","last_fullsized":"2024-03-16T07:27:08.932592+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:37:45.745502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:08.913541+0000","last_change":"2024-03-16T07:27:08.247276+0000","last_active":"2024-03-16T07:27:08.913541+0000","last_peered":"2024-03-16T07:27:08.913541+0000","last_clean":"2024-03-16T07:27:08.913541+0000","last_became_active":"2024-03-16T07:27:08.246996+0000","last_became_peered":"2024-03-16T07:27:08.246996+0000","last_unstale":"2024-03-16T07:27:08.913541+0000","last_undegraded":"2024-03-16T07:27:08.913541+0000","last_fullsized":"2024-03-16T07:27:08.913541+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_clean_scrub_stamp":"2024-03-16T07:27:07.221025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:16:31.977141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:08.931228+0000","last_change":"2024-03-16T07:27:08.927907+0000","last_active":"2024-03-16T07:27:08.931228+0000","last_peered":"2024-03-16T07:27:08.931228+0000","last_clean":"2024-03-16T07:27:08.931228+0000","last_became_active":"2024-03-16T07:27:08.927028+0000","last_became_peered":"2024-03-16T07:27:08.927028+0000","last_unstale":"2024-03-16T07:27:08.931228+0000","last_undegraded":"2024-03-16T07:27:08.931228+0000","last_fullsized":"2024-03-16T07:27:08.931228+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:53:13.011941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"50'3","reported_seq":15,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:09.236685+0000","last_change":"2024-03-16T07:27:08.251102+0000","last_active":"2024-03-16T07:27:09.236685+0000","last_peered":"2024-03-16T07:27:09.236685+0000","last_clean":"2024-03-16T07:27:09.236685+0000","last_became_active":"2024-03-16T07:27:08.250854+0000","last_became_peered":"2024-03-16T07:27:08.250854+0000","last_unstale":"2024-03-16T07:27:09.236685+0000","last_undegraded":"2024-03-16T07:27:09.236685+0000","last_fullsized":"2024-03-16T07:27:09.236685+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_clean_scrub_stamp":"2024-03-16T07:27:07.221025+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:24:56.759854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:08.923444+0000","last_change":"2024-03-16T07:27:08.921393+0000","last_active":"2024-03-16T07:27:08.923444+0000","last_peered":"2024-03-16T07:27:08.923444+0000","last_clean":"2024-03-16T07:27:08.923444+0000","last_became_active":"2024-03-16T07:27:08.921149+0000","last_became_peered":"2024-03-16T07:27:08.921149+0000","last_unstale":"2024-03-16T07:27:08.923444+0000","last_undegraded":"2024-03-16T07:27:08.923444+0000","last_fullsized":"2024-03-16T07:27:08.923444+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:19:02.211067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.14","version":"50'6","reported_seq":18,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:09.238486+0000","last_change":"2024-03-16T07:27:08.244864+0000","last_active":"2024-03-16T07:27:09.238486+0000","last_peered":"2024-03-16T07:27:09.238486+0000","last_clean":"2024-03-16T07:27:09.238486+0000","last_became_active":"2024-03-16T07:27:08.244060+0000","last_became_peered":"2024-03-16T07:27:08.244060+0000","last_unstale":"2024-03-16T07:27:09.238486+0000","last_undegraded":"2024-03-16T07:27:09.238486+0000","last_fullsized":"2024-03-16T07:27:09.238486+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_clean_scrub_stamp":"2024-03-16T07:27:07.221025+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:54:48.471326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:08.930277+0000","last_change":"2024-03-16T07:27:08.928325+0000","last_active":"2024-03-16T07:27:08.930277+0000","last_peered":"2024-03-16T07:27:08.930277+0000","last_clean":"2024-03-16T07:27:08.930277+0000","last_became_active":"2024-03-16T07:27:08.927710+0000","last_became_peered":"2024-03-16T07:27:08.927710+0000","last_unstale":"2024-03-16T07:27:08.930277+0000","last_undegraded":"2024-03-16T07:27:08.930277+0000","last_fullsized":"2024-03-16T07:27:08.930277+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:42:41.885383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"50'2","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:09.237077+0000","last_change":"2024-03-16T07:27:08.246435+0000","last_active":"2024-03-16T07:27:09.237077+0000","last_peered":"2024-03-16T07:27:09.237077+0000","last_clean":"2024-03-16T07:27:09.237077+0000","last_became_active":"2024-03-16T07:27:08.246149+0000","last_became_peered":"2024-03-16T07:27:08.246149+0000","last_unstale":"2024-03-16T07:27:09.237077+0000","last_undegraded":"2024-03-16T07:27:09.237077+0000","last_fullsized":"2024-03-16T07:27:09.237077+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_clean_scrub_stamp":"2024-03-16T07:27:07.221025+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:37:36.164804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:08.932094+0000","last_change":"2024-03-16T07:27:08.931009+0000","last_active":"2024-03-16T07:27:08.932094+0000","last_peered":"2024-03-16T07:27:08.932094+0000","last_clean":"2024-03-16T07:27:08.932094+0000","last_became_active":"2024-03-16T07:27:08.930682+0000","last_became_peered":"2024-03-16T07:27:08.930682+0000","last_unstale":"2024-03-16T07:27:08.932094+0000","last_undegraded":"2024-03-16T07:27:08.932094+0000","last_fullsized":"2024-03-16T07:27:08.932094+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:50:22.397494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:08.919388+0000","last_change":"2024-03-16T07:27:08.249638+0000","last_active":"2024-03-16T07:27:08.919388+0000","last_peered":"2024-03-16T07:27:08.919388+0000","last_clean":"2024-03-16T07:27:08.919388+0000","last_became_active":"2024-03-16T07:27:08.249343+0000","last_became_peered":"2024-03-16T07:27:08.249343+0000","last_unstale":"2024-03-16T07:27:08.919388+0000","last_undegraded":"2024-03-16T07:27:08.919388+0000","last_fullsized":"2024-03-16T07:27:08.919388+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_clean_scrub_stamp":"2024-03-16T07:27:07.221025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:47:23.821578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:08.926730+0000","last_change":"2024-03-16T07:27:08.923986+0000","last_active":"2024-03-16T07:27:08.926730+0000","last_peered":"2024-03-16T07:27:08.926730+0000","last_clean":"2024-03-16T07:27:08.926730+0000","last_became_active":"2024-03-16T07:27:08.922698+0000","last_became_peered":"2024-03-16T07:27:08.922698+0000","last_unstale":"2024-03-16T07:27:08.926730+0000","last_undegraded":"2024-03-16T07:27:08.926730+0000","last_fullsized":"2024-03-16T07:27:08.926730+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:50:22.397494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:08.919058+0000","last_change":"2024-03-16T07:27:08.250046+0000","last_active":"2024-03-16T07:27:08.919058+0000","last_peered":"2024-03-16T07:27:08.919058+0000","last_clean":"2024-03-16T07:27:08.919058+0000","last_became_active":"2024-03-16T07:27:08.249650+0000","last_became_peered":"2024-03-16T07:27:08.249650+0000","last_unstale":"2024-03-16T07:27:08.919058+0000","last_undegraded":"2024-03-16T07:27:08.919058+0000","last_fullsized":"2024-03-16T07:27:08.919058+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_clean_scrub_stamp":"2024-03-16T07:27:07.221025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:37:36.164804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:08.928008+0000","last_change":"2024-03-16T07:27:08.927562+0000","last_active":"2024-03-16T07:27:08.928008+0000","last_peered":"2024-03-16T07:27:08.928008+0000","last_clean":"2024-03-16T07:27:08.928008+0000","last_became_active":"2024-03-16T07:27:08.927206+0000","last_became_peered":"2024-03-16T07:27:08.927206+0000","last_unstale":"2024-03-16T07:27:08.928008+0000","last_undegraded":"2024-03-16T07:27:08.928008+0000","last_fullsized":"2024-03-16T07:27:08.928008+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:44:59.574947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"50'8","reported_seq":20,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:09.237247+0000","last_change":"2024-03-16T07:27:08.238193+0000","last_active":"2024-03-16T07:27:09.237247+0000","last_peered":"2024-03-16T07:27:09.237247+0000","last_clean":"2024-03-16T07:27:09.237247+0000","last_became_active":"2024-03-16T07:27:08.237926+0000","last_became_peered":"2024-03-16T07:27:08.237926+0000","last_unstale":"2024-03-16T07:27:09.237247+0000","last_undegraded":"2024-03-16T07:27:09.237247+0000","last_fullsized":"2024-03-16T07:27:09.237247+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_clean_scrub_stamp":"2024-03-16T07:27:07.221025+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:20:22.062889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:08.932356+0000","last_change":"2024-03-16T07:27:08.930378+0000","last_active":"2024-03-16T07:27:08.932356+0000","last_peered":"2024-03-16T07:27:08.932356+0000","last_clean":"2024-03-16T07:27:08.932356+0000","last_became_active":"2024-03-16T07:27:08.929970+0000","last_became_peered":"2024-03-16T07:27:08.929970+0000","last_unstale":"2024-03-16T07:27:08.932356+0000","last_undegraded":"2024-03-16T07:27:08.932356+0000","last_fullsized":"2024-03-16T07:27:08.932356+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:49:56.246128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.f","version":"50'1","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:09.235487+0000","last_change":"2024-03-16T07:27:08.244995+0000","last_active":"2024-03-16T07:27:09.235487+0000","last_peered":"2024-03-16T07:27:09.235487+0000","last_clean":"2024-03-16T07:27:09.235487+0000","last_became_active":"2024-03-16T07:27:08.244700+0000","last_became_peered":"2024-03-16T07:27:08.244700+0000","last_unstale":"2024-03-16T07:27:09.235487+0000","last_undegraded":"2024-03-16T07:27:09.235487+0000","last_fullsized":"2024-03-16T07:27:09.235487+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_clean_scrub_stamp":"2024-03-16T07:27:07.221025+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:07:09.331421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:08.932627+0000","last_change":"2024-03-16T07:27:08.931661+0000","last_active":"2024-03-16T07:27:08.932627+0000","last_peered":"2024-03-16T07:27:08.932627+0000","last_clean":"2024-03-16T07:27:08.932627+0000","last_became_active":"2024-03-16T07:27:08.931137+0000","last_became_peered":"2024-03-16T07:27:08.931137+0000","last_unstale":"2024-03-16T07:27:08.932627+0000","last_undegraded":"2024-03-16T07:27:08.932627+0000","last_fullsized":"2024-03-16T07:27:08.932627+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:51:10.574665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"50'2","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:09.235462+0000","last_change":"2024-03-16T07:27:08.243152+0000","last_active":"2024-03-16T07:27:09.235462+0000","last_peered":"2024-03-16T07:27:09.235462+0000","last_clean":"2024-03-16T07:27:09.235462+0000","last_became_active":"2024-03-16T07:27:08.242667+0000","last_became_peered":"2024-03-16T07:27:08.242667+0000","last_unstale":"2024-03-16T07:27:09.235462+0000","last_undegraded":"2024-03-16T07:27:09.235462+0000","last_fullsized":"2024-03-16T07:27:09.235462+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_clean_scrub_stamp":"2024-03-16T07:27:07.221025+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:18:38.969631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:08.934628+0000","last_change":"2024-03-16T07:27:08.934193+0000","last_active":"2024-03-16T07:27:08.934628+0000","last_peered":"2024-03-16T07:27:08.934628+0000","last_clean":"2024-03-16T07:27:08.934628+0000","last_became_active":"2024-03-16T07:27:08.933927+0000","last_became_peered":"2024-03-16T07:27:08.933927+0000","last_unstale":"2024-03-16T07:27:08.934628+0000","last_undegraded":"2024-03-16T07:27:08.934628+0000","last_fullsized":"2024-03-16T07:27:08.934628+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:49:03.915540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.d","version":"50'1","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:09.236748+0000","last_change":"2024-03-16T07:27:08.251729+0000","last_active":"2024-03-16T07:27:09.236748+0000","last_peered":"2024-03-16T07:27:09.236748+0000","last_clean":"2024-03-16T07:27:09.236748+0000","last_became_active":"2024-03-16T07:27:08.251457+0000","last_became_peered":"2024-03-16T07:27:08.251457+0000","last_unstale":"2024-03-16T07:27:09.236748+0000","last_undegraded":"2024-03-16T07:27:09.236748+0000","last_fullsized":"2024-03-16T07:27:09.236748+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_clean_scrub_stamp":"2024-03-16T07:27:07.221025+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:46:43.084148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:08.923344+0000","last_change":"2024-03-16T07:27:08.921973+0000","last_active":"2024-03-16T07:27:08.923344+0000","last_peered":"2024-03-16T07:27:08.923344+0000","last_clean":"2024-03-16T07:27:08.923344+0000","last_became_active":"2024-03-16T07:27:08.921742+0000","last_became_peered":"2024-03-16T07:27:08.921742+0000","last_unstale":"2024-03-16T07:27:08.923344+0000","last_undegraded":"2024-03-16T07:27:08.923344+0000","last_fullsized":"2024-03-16T07:27:08.923344+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:10:50.344934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:08.908505+0000","last_change":"2024-03-16T07:27:08.244296+0000","last_active":"2024-03-16T07:27:08.908505+0000","last_peered":"2024-03-16T07:27:08.908505+0000","last_clean":"2024-03-16T07:27:08.908505+0000","last_became_active":"2024-03-16T07:27:08.243822+0000","last_became_peered":"2024-03-16T07:27:08.243822+0000","last_unstale":"2024-03-16T07:27:08.908505+0000","last_undegraded":"2024-03-16T07:27:08.908505+0000","last_fullsized":"2024-03-16T07:27:08.908505+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_clean_scrub_stamp":"2024-03-16T07:27:07.221025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:10:55.596764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:08.925386+0000","last_change":"2024-03-16T07:27:08.923667+0000","last_active":"2024-03-16T07:27:08.925386+0000","last_peered":"2024-03-16T07:27:08.925386+0000","last_clean":"2024-03-16T07:27:08.925386+0000","last_became_active":"2024-03-16T07:27:08.923410+0000","last_became_peered":"2024-03-16T07:27:08.923410+0000","last_unstale":"2024-03-16T07:27:08.925386+0000","last_undegraded":"2024-03-16T07:27:08.925386+0000","last_fullsized":"2024-03-16T07:27:08.925386+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:13:55.490732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.b","version":"50'2","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:09.235678+0000","last_change":"2024-03-16T07:27:08.235239+0000","last_active":"2024-03-16T07:27:09.235678+0000","last_peered":"2024-03-16T07:27:09.235678+0000","last_clean":"2024-03-16T07:27:09.235678+0000","last_became_active":"2024-03-16T07:27:08.234873+0000","last_became_peered":"2024-03-16T07:27:08.234873+0000","last_unstale":"2024-03-16T07:27:09.235678+0000","last_undegraded":"2024-03-16T07:27:09.235678+0000","last_fullsized":"2024-03-16T07:27:09.235678+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_clean_scrub_stamp":"2024-03-16T07:27:07.221025+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:30:53.914463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:08.923183+0000","last_change":"2024-03-16T07:27:08.920383+0000","last_active":"2024-03-16T07:27:08.923183+0000","last_peered":"2024-03-16T07:27:08.923183+0000","last_clean":"2024-03-16T07:27:08.923183+0000","last_became_active":"2024-03-16T07:27:08.918297+0000","last_became_peered":"2024-03-16T07:27:08.918297+0000","last_unstale":"2024-03-16T07:27:08.923183+0000","last_undegraded":"2024-03-16T07:27:08.923183+0000","last_fullsized":"2024-03-16T07:27:08.923183+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:16:51.000948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:08.913536+0000","last_change":"2024-03-16T07:27:08.246964+0000","last_active":"2024-03-16T07:27:08.913536+0000","last_peered":"2024-03-16T07:27:08.913536+0000","last_clean":"2024-03-16T07:27:08.913536+0000","last_became_active":"2024-03-16T07:27:08.246688+0000","last_became_peered":"2024-03-16T07:27:08.246688+0000","last_unstale":"2024-03-16T07:27:08.913536+0000","last_undegraded":"2024-03-16T07:27:08.913536+0000","last_fullsized":"2024-03-16T07:27:08.913536+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_clean_scrub_stamp":"2024-03-16T07:27:07.221025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:47:11.940256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:08.921197+0000","last_change":"2024-03-16T07:27:08.917472+0000","last_active":"2024-03-16T07:27:08.921197+0000","last_peered":"2024-03-16T07:27:08.921197+0000","last_clean":"2024-03-16T07:27:08.921197+0000","last_became_active":"2024-03-16T07:27:08.917235+0000","last_became_peered":"2024-03-16T07:27:08.917235+0000","last_unstale":"2024-03-16T07:27:08.921197+0000","last_undegraded":"2024-03-16T07:27:08.921197+0000","last_fullsized":"2024-03-16T07:27:08.921197+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:43:52.645660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:08.915060+0000","last_change":"2024-03-16T07:27:08.247978+0000","last_active":"2024-03-16T07:27:08.915060+0000","last_peered":"2024-03-16T07:27:08.915060+0000","last_clean":"2024-03-16T07:27:08.915060+0000","last_became_active":"2024-03-16T07:27:08.247725+0000","last_became_peered":"2024-03-16T07:27:08.247725+0000","last_unstale":"2024-03-16T07:27:08.915060+0000","last_undegraded":"2024-03-16T07:27:08.915060+0000","last_fullsized":"2024-03-16T07:27:08.915060+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_clean_scrub_stamp":"2024-03-16T07:27:07.221025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:06:16.181760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:08.932374+0000","last_change":"2024-03-16T07:27:08.930514+0000","last_active":"2024-03-16T07:27:08.932374+0000","last_peered":"2024-03-16T07:27:08.932374+0000","last_clean":"2024-03-16T07:27:08.932374+0000","last_became_active":"2024-03-16T07:27:08.930278+0000","last_became_peered":"2024-03-16T07:27:08.930278+0000","last_unstale":"2024-03-16T07:27:08.932374+0000","last_undegraded":"2024-03-16T07:27:08.932374+0000","last_fullsized":"2024-03-16T07:27:08.932374+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:23:14.216212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"50'2","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:09.237069+0000","last_change":"2024-03-16T07:27:08.242744+0000","last_active":"2024-03-16T07:27:09.237069+0000","last_peered":"2024-03-16T07:27:09.237069+0000","last_clean":"2024-03-16T07:27:09.237069+0000","last_became_active":"2024-03-16T07:27:08.242491+0000","last_became_peered":"2024-03-16T07:27:08.242491+0000","last_unstale":"2024-03-16T07:27:09.237069+0000","last_undegraded":"2024-03-16T07:27:09.237069+0000","last_fullsized":"2024-03-16T07:27:09.237069+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_clean_scrub_stamp":"2024-03-16T07:27:07.221025+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:16:47.057318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:08.933259+0000","last_change":"2024-03-16T07:27:08.932487+0000","last_active":"2024-03-16T07:27:08.933259+0000","last_peered":"2024-03-16T07:27:08.933259+0000","last_clean":"2024-03-16T07:27:08.933259+0000","last_became_active":"2024-03-16T07:27:08.932022+0000","last_became_peered":"2024-03-16T07:27:08.932022+0000","last_unstale":"2024-03-16T07:27:08.933259+0000","last_undegraded":"2024-03-16T07:27:08.933259+0000","last_fullsized":"2024-03-16T07:27:08.933259+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:53:13.011941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:08.909943+0000","last_change":"2024-03-16T07:27:08.242924+0000","last_active":"2024-03-16T07:27:08.909943+0000","last_peered":"2024-03-16T07:27:08.909943+0000","last_clean":"2024-03-16T07:27:08.909943+0000","last_became_active":"2024-03-16T07:27:08.242277+0000","last_became_peered":"2024-03-16T07:27:08.242277+0000","last_unstale":"2024-03-16T07:27:08.909943+0000","last_undegraded":"2024-03-16T07:27:08.909943+0000","last_fullsized":"2024-03-16T07:27:08.909943+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_clean_scrub_stamp":"2024-03-16T07:27:07.221025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:40:23.474145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:08.923593+0000","last_change":"2024-03-16T07:27:08.922001+0000","last_active":"2024-03-16T07:27:08.923593+0000","last_peered":"2024-03-16T07:27:08.923593+0000","last_clean":"2024-03-16T07:27:08.923593+0000","last_became_active":"2024-03-16T07:27:08.921584+0000","last_became_peered":"2024-03-16T07:27:08.921584+0000","last_unstale":"2024-03-16T07:27:08.923593+0000","last_undegraded":"2024-03-16T07:27:08.923593+0000","last_fullsized":"2024-03-16T07:27:08.923593+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:23:14.216212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:08.914108+0000","last_change":"2024-03-16T07:27:08.248496+0000","last_active":"2024-03-16T07:27:08.914108+0000","last_peered":"2024-03-16T07:27:08.914108+0000","last_clean":"2024-03-16T07:27:08.914108+0000","last_became_active":"2024-03-16T07:27:08.247244+0000","last_became_peered":"2024-03-16T07:27:08.247244+0000","last_unstale":"2024-03-16T07:27:08.914108+0000","last_undegraded":"2024-03-16T07:27:08.914108+0000","last_fullsized":"2024-03-16T07:27:08.914108+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_clean_scrub_stamp":"2024-03-16T07:27:07.221025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:59:09.394985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:08.923326+0000","last_change":"2024-03-16T07:27:08.918934+0000","last_active":"2024-03-16T07:27:08.923326+0000","last_peered":"2024-03-16T07:27:08.923326+0000","last_clean":"2024-03-16T07:27:08.923326+0000","last_became_active":"2024-03-16T07:27:08.917309+0000","last_became_peered":"2024-03-16T07:27:08.917309+0000","last_unstale":"2024-03-16T07:27:08.923326+0000","last_undegraded":"2024-03-16T07:27:08.923326+0000","last_fullsized":"2024-03-16T07:27:08.923326+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:13:32.367215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:08.923151+0000","last_change":"2024-03-16T07:27:08.251830+0000","last_active":"2024-03-16T07:27:08.923151+0000","last_peered":"2024-03-16T07:27:08.923151+0000","last_clean":"2024-03-16T07:27:08.923151+0000","last_became_active":"2024-03-16T07:27:08.251478+0000","last_became_peered":"2024-03-16T07:27:08.251478+0000","last_unstale":"2024-03-16T07:27:08.923151+0000","last_undegraded":"2024-03-16T07:27:08.923151+0000","last_fullsized":"2024-03-16T07:27:08.923151+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_clean_scrub_stamp":"2024-03-16T07:27:07.221025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:16:47.057318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:08.930259+0000","last_change":"2024-03-16T07:27:08.928147+0000","last_active":"2024-03-16T07:27:08.930259+0000","last_peered":"2024-03-16T07:27:08.930259+0000","last_clean":"2024-03-16T07:27:08.930259+0000","last_became_active":"2024-03-16T07:27:08.927393+0000","last_became_peered":"2024-03-16T07:27:08.927393+0000","last_unstale":"2024-03-16T07:27:08.930259+0000","last_undegraded":"2024-03-16T07:27:08.930259+0000","last_fullsized":"2024-03-16T07:27:08.930259+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:51:42.057650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:08.911716+0000","last_change":"2024-03-16T07:27:08.240204+0000","last_active":"2024-03-16T07:27:08.911716+0000","last_peered":"2024-03-16T07:27:08.911716+0000","last_clean":"2024-03-16T07:27:08.911716+0000","last_became_active":"2024-03-16T07:27:08.239950+0000","last_became_peered":"2024-03-16T07:27:08.239950+0000","last_unstale":"2024-03-16T07:27:08.911716+0000","last_undegraded":"2024-03-16T07:27:08.911716+0000","last_fullsized":"2024-03-16T07:27:08.911716+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_clean_scrub_stamp":"2024-03-16T07:27:07.221025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:47:23.821578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:08.923233+0000","last_change":"2024-03-16T07:27:08.920819+0000","last_active":"2024-03-16T07:27:08.923233+0000","last_peered":"2024-03-16T07:27:08.923233+0000","last_clean":"2024-03-16T07:27:08.923233+0000","last_became_active":"2024-03-16T07:27:08.918934+0000","last_became_peered":"2024-03-16T07:27:08.918934+0000","last_unstale":"2024-03-16T07:27:08.923233+0000","last_undegraded":"2024-03-16T07:27:08.923233+0000","last_fullsized":"2024-03-16T07:27:08.923233+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:30:52.728668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:08.919521+0000","last_change":"2024-03-16T07:27:08.250052+0000","last_active":"2024-03-16T07:27:08.919521+0000","last_peered":"2024-03-16T07:27:08.919521+0000","last_clean":"2024-03-16T07:27:08.919521+0000","last_became_active":"2024-03-16T07:27:08.249750+0000","last_became_peered":"2024-03-16T07:27:08.249750+0000","last_unstale":"2024-03-16T07:27:08.919521+0000","last_undegraded":"2024-03-16T07:27:08.919521+0000","last_fullsized":"2024-03-16T07:27:08.919521+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_clean_scrub_stamp":"2024-03-16T07:27:07.221025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:04:40.243410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:08.930420+0000","last_change":"2024-03-16T07:27:08.927243+0000","last_active":"2024-03-16T07:27:08.930420+0000","last_peered":"2024-03-16T07:27:08.930420+0000","last_clean":"2024-03-16T07:27:08.930420+0000","last_became_active":"2024-03-16T07:27:08.926939+0000","last_became_peered":"2024-03-16T07:27:08.926939+0000","last_unstale":"2024-03-16T07:27:08.930420+0000","last_undegraded":"2024-03-16T07:27:08.930420+0000","last_fullsized":"2024-03-16T07:27:08.930420+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:51:10.574665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:08.912995+0000","last_change":"2024-03-16T07:27:08.241445+0000","last_active":"2024-03-16T07:27:08.912995+0000","last_peered":"2024-03-16T07:27:08.912995+0000","last_clean":"2024-03-16T07:27:08.912995+0000","last_became_active":"2024-03-16T07:27:08.241129+0000","last_became_peered":"2024-03-16T07:27:08.241129+0000","last_unstale":"2024-03-16T07:27:08.912995+0000","last_undegraded":"2024-03-16T07:27:08.912995+0000","last_fullsized":"2024-03-16T07:27:08.912995+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_clean_scrub_stamp":"2024-03-16T07:27:07.221025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:46:43.084148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:08.922414+0000","last_change":"2024-03-16T07:27:08.918028+0000","last_active":"2024-03-16T07:27:08.922414+0000","last_peered":"2024-03-16T07:27:08.922414+0000","last_clean":"2024-03-16T07:27:08.922414+0000","last_became_active":"2024-03-16T07:27:08.917397+0000","last_became_peered":"2024-03-16T07:27:08.917397+0000","last_unstale":"2024-03-16T07:27:08.922414+0000","last_undegraded":"2024-03-16T07:27:08.922414+0000","last_fullsized":"2024-03-16T07:27:08.922414+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:06:07.410185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:08.915199+0000","last_change":"2024-03-16T07:27:08.239510+0000","last_active":"2024-03-16T07:27:08.915199+0000","last_peered":"2024-03-16T07:27:08.915199+0000","last_clean":"2024-03-16T07:27:08.915199+0000","last_became_active":"2024-03-16T07:27:08.239209+0000","last_became_peered":"2024-03-16T07:27:08.239209+0000","last_unstale":"2024-03-16T07:27:08.915199+0000","last_undegraded":"2024-03-16T07:27:08.915199+0000","last_fullsized":"2024-03-16T07:27:08.915199+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_clean_scrub_stamp":"2024-03-16T07:27:07.221025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:08:11.994734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:08.931461+0000","last_change":"2024-03-16T07:27:08.929726+0000","last_active":"2024-03-16T07:27:08.931461+0000","last_peered":"2024-03-16T07:27:08.931461+0000","last_clean":"2024-03-16T07:27:08.931461+0000","last_became_active":"2024-03-16T07:27:08.929485+0000","last_became_peered":"2024-03-16T07:27:08.929485+0000","last_unstale":"2024-03-16T07:27:08.931461+0000","last_undegraded":"2024-03-16T07:27:08.931461+0000","last_fullsized":"2024-03-16T07:27:08.931461+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:08:12.995888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:08.910808+0000","last_change":"2024-03-16T07:27:08.247274+0000","last_active":"2024-03-16T07:27:08.910808+0000","last_peered":"2024-03-16T07:27:08.910808+0000","last_clean":"2024-03-16T07:27:08.910808+0000","last_became_active":"2024-03-16T07:27:08.243679+0000","last_became_peered":"2024-03-16T07:27:08.243679+0000","last_unstale":"2024-03-16T07:27:08.910808+0000","last_undegraded":"2024-03-16T07:27:08.910808+0000","last_fullsized":"2024-03-16T07:27:08.910808+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_clean_scrub_stamp":"2024-03-16T07:27:07.221025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:17:46.854764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"35'119","reported_seq":289,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-16T07:27:08.915252+0000","last_change":"2024-03-16T07:24:31.650537+0000","last_active":"2024-03-16T07:27:08.915252+0000","last_peered":"2024-03-16T07:27:08.915252+0000","last_clean":"2024-03-16T07:27:08.915252+0000","last_became_active":"2024-03-16T07:24:31.649574+0000","last_became_peered":"2024-03-16T07:24:31.649574+0000","last_unstale":"2024-03-16T07:27:08.915252+0000","last_undegraded":"2024-03-16T07:27:08.915252+0000","last_fullsized":"2024-03-16T07:27:08.915252+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:29.719970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:29.719970+0000","last_clean_scrub_stamp":"2024-03-16T07:24:29.719970+0000","objects_scrubbed":0,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:31:35.774554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":298,"num_read_kb":503,"num_write":177,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":298,"num_read_kb":503,"num_write":177,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738402,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":31676,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":104825924,"statfs":{"total":107374182400,"available":107341746176,"internally_reserved":0,"allocated":512000,"data_stored":184015,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738402,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":32244,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":104825356,"statfs":{"total":107374182400,"available":107341164544,"internally_reserved":0,"allocated":1093632,"data_stored":773331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738402,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":32248,"kb_used_data":1072,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":104825352,"statfs":{"total":107374182400,"available":107341160448,"internally_reserved":0,"allocated":1097728,"data_stored":774771,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-16T07:27:12.594 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-03-16T07:27:12.594 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-03-16T07:27:13.007 INFO:teuthology.orchestra.run.smithi049.stdout:[client.0] 2024-03-16T07:27:13.008 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQAaSfVlmBmvGRAAaxdhkajaioVlq23dyv/g4g== 2024-03-16T07:27:13.008 INFO:teuthology.orchestra.run.smithi049.stdout: caps mds = "allow" 2024-03-16T07:27:13.008 INFO:teuthology.orchestra.run.smithi049.stdout: caps mon = "allow r" 2024-03-16T07:27:13.008 INFO:teuthology.orchestra.run.smithi049.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-03-16T07:27:13.008 INFO:teuthology.orchestra.run.smithi049.stderr:updated caps for client.0 2024-03-16T07:27:13.020 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T07:27:13.440 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:27:13.440 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":33,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4888,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6827/1901069637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":1901069637},{"type":"v1","addr":"172.21.15.49:6827","nonce":1901069637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30},{"gid":4891,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6829/512304085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":512304085},{"type":"v1","addr":"172.21.15.49:6829","nonce":512304085}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30},{"gid":4894,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6833/2341714657","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":2341714657},{"type":"v1","addr":"172.21.15.49:6833","nonce":2341714657}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30},{"gid":4895,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6832/849811345","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6831","nonce":849811345},{"type":"v1","addr":"172.21.15.49:6832","nonce":849811345}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-16T07:27:08.607433+0000","modified":"2024-03-16T07:27:10.583409+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4898},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4898":{"gid":4898,"name":"d","rank":0,"incarnation":31,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6835/3239577766","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":3239577766},{"type":"v1","addr":"172.21.15.49:6835","nonce":3239577766}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4898,"qdb_cluster":[4898]},"id":4}]} 2024-03-16T07:27:13.440 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 33 2024-03-16T07:27:13.955 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 33, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-03-16T07:27:08.607433+0000', 'modified': '2024-03-16T07:27:10.583409+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4898}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4898': {'gid': 4898, 'name': 'd', 'rank': 0, 'incarnation': 31, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.49:6835/3239577766', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.49:6834', 'nonce': 3239577766}, {'type': 'v1', 'addr': '172.21.15.49:6835', 'nonce': 3239577766}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [9], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4898, 'qdb_cluster': [4898]} 2024-03-16T07:27:13.955 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-03-16T07:27:13.956 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-03-16T07:27:14.077 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-16T07:27:14.079+0000 7efdd7fff640 0 client.4957 ms_handle_reset on v2:172.21.15.49:6834/3239577766 2024-03-16T07:27:14.121 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-16T07:27:14.123+0000 7efdd7fff640 0 client.4959 ms_handle_reset on v2:172.21.15.49:6834/3239577766 2024-03-16T07:27:14.121 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-03-16T07:27:14.121 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_fsid": "f91af061-9eac-4793-87fa-8d27ae3d242f", 2024-03-16T07:27:14.121 INFO:teuthology.orchestra.run.smithi049.stdout: "whoami": 0, 2024-03-16T07:27:14.121 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 4898, 2024-03-16T07:27:14.121 INFO:teuthology.orchestra.run.smithi049.stdout: "want_state": "up:active", 2024-03-16T07:27:14.121 INFO:teuthology.orchestra.run.smithi049.stdout: "state": "up:active", 2024-03-16T07:27:14.122 INFO:teuthology.orchestra.run.smithi049.stdout: "fs_name": "cephfs", 2024-03-16T07:27:14.122 INFO:teuthology.orchestra.run.smithi049.stdout: "rank_uptime": 4.8975546699999999, 2024-03-16T07:27:14.122 INFO:teuthology.orchestra.run.smithi049.stdout: "mdsmap_epoch": 33, 2024-03-16T07:27:14.122 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch": 51, 2024-03-16T07:27:14.122 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch_barrier": 51, 2024-03-16T07:27:14.122 INFO:teuthology.orchestra.run.smithi049.stdout: "uptime": 10.16551095 2024-03-16T07:27:14.122 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-03-16T07:27:14.133 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-03-16T07:27:14.475 INFO:teuthology.orchestra.run.smithi049.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-03-16T07:27:14.488 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-03-16T07:27:14.489 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-03-16T07:27:14.489 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi049.front.sepia.ceph.com 2024-03-16T07:27:14.489 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-03-16T07:27:14.489 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-03-16T07:27:14.489 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-03-16T07:27:14.489 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-03-16T07:27:14.489 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-03-16T07:27:14.489 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-03-16T07:27:14.489 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:27:14.489 DEBUG:teuthology.orchestra.run.smithi049:> ip addr 2024-03-16T07:27:14.505 INFO:teuthology.orchestra.run.smithi049.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-16T07:27:14.505 INFO:teuthology.orchestra.run.smithi049.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-16T07:27:14.505 INFO:teuthology.orchestra.run.smithi049.stdout: inet 127.0.0.1/8 scope host lo 2024-03-16T07:27:14.505 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-03-16T07:27:14.505 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 ::1/128 scope host 2024-03-16T07:27:14.505 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-03-16T07:27:14.505 INFO:teuthology.orchestra.run.smithi049.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-16T07:27:14.505 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:6b:ff:84 brd ff:ff:ff:ff:ff:ff 2024-03-16T07:27:14.506 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp7s0f0 2024-03-16T07:27:14.506 INFO:teuthology.orchestra.run.smithi049.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-16T07:27:14.506 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:6b:ff:85 brd ff:ff:ff:ff:ff:ff 2024-03-16T07:27:14.506 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp7s0f1 2024-03-16T07:27:14.506 INFO:teuthology.orchestra.run.smithi049.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-03-16T07:27:14.506 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:bd:15:66 brd ff:ff:ff:ff:ff:ff 2024-03-16T07:27:14.506 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp1s0f0 2024-03-16T07:27:14.506 INFO:teuthology.orchestra.run.smithi049.stdout: inet 172.21.15.49/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-03-16T07:27:14.506 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft 42273sec preferred_lft 42273sec 2024-03-16T07:27:14.506 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::ec4:7aff:febd:1566/64 scope link noprefixroute 2024-03-16T07:27:14.506 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-03-16T07:27:14.506 INFO:teuthology.orchestra.run.smithi049.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-16T07:27:14.506 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:bd:15:67 brd ff:ff:ff:ff:ff:ff 2024-03-16T07:27:14.507 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp1s0f1 2024-03-16T07:27:14.507 INFO:teuthology.orchestra.run.smithi049.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-03-16T07:27:14.507 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether a2:f1:88:c1:22:e7 brd ff:ff:ff:ff:ff:ff 2024-03-16T07:27:14.507 INFO:teuthology.orchestra.run.smithi049.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-03-16T07:27:14.507 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-03-16T07:27:14.507 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::e0e6:55ff:fe4d:1d68/64 scope link 2024-03-16T07:27:14.507 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-03-16T07:27:14.507 INFO:teuthology.orchestra.run.smithi049.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-03-16T07:27:14.507 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether ee:10:71:d7:68:c4 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-16T07:27:14.507 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::ec10:71ff:fed7:68c4/64 scope link 2024-03-16T07:27:14.507 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-03-16T07:27:14.507 INFO:teuthology.orchestra.run.smithi049.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-03-16T07:27:14.507 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether a2:f1:88:c1:22:e7 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-16T07:27:14.507 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::a0f1:88ff:fec1:22e7/64 scope link 2024-03-16T07:27:14.507 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-03-16T07:27:14.508 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:27:14.508 DEBUG:teuthology.orchestra.run.smithi049:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-03-16T07:27:14.575 INFO:teuthology.orchestra.run.smithi049.stdout:1 2024-03-16T07:27:14.577 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:27:14.577 DEBUG:teuthology.orchestra.run.smithi049:> route 2024-03-16T07:27:14.633 INFO:teuthology.orchestra.run.smithi049.stdout:Kernel IP routing table 2024-03-16T07:27:14.633 INFO:teuthology.orchestra.run.smithi049.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-03-16T07:27:14.633 INFO:teuthology.orchestra.run.smithi049.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-03-16T07:27:14.633 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-03-16T07:27:14.633 INFO:teuthology.orchestra.run.smithi049.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-03-16T07:27:14.633 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-16T07:27:14.634 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-03-16T07:27:14.634 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-03-16T07:27:14.634 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-03-16T07:27:14.634 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-03-16T07:27:14.634 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-03-16T07:27:14.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-16T07:27:14 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-16T07:27:14.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-16T07:27:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-16T07:27:14.780 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:27:14.780 DEBUG:teuthology.orchestra.run.smithi049:> ip netns list 2024-03-16T07:27:14.795 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 1) 2024-03-16T07:27:14.795 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-03-16T07:27:14.795 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-03-16T07:27:14.795 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:27:14.795 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link set brx.0 up 2024-03-16T07:27:14.865 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-03-16T07:27:14.865 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-16T07:27:14.866 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-03-16T07:27:14.892 INFO:tasks.ceph.mds.d.smithi049.stderr:2024-03-16T07:27:14.894+0000 7f7d29740640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-03-16T07:27:14.907 INFO:teuthology.orchestra.run.smithi049.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-03-16T07:27:14.907 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-16T07:27:14.907 DEBUG:teuthology.orchestra.run.smithi049:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-03-16T07:27:14.961 DEBUG:teuthology.orchestra.run.smithi049:> sudo modprobe fuse 2024-03-16T07:27:15.033 DEBUG:teuthology.orchestra.run.smithi049:> cat /proc/self/mounts | awk '{print $2}' 2024-03-16T07:27:15.090 INFO:teuthology.orchestra.run.smithi049.stdout:/proc 2024-03-16T07:27:15.090 INFO:teuthology.orchestra.run.smithi049.stdout:/sys 2024-03-16T07:27:15.090 INFO:teuthology.orchestra.run.smithi049.stdout:/dev 2024-03-16T07:27:15.090 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/security 2024-03-16T07:27:15.090 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/shm 2024-03-16T07:27:15.090 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/pts 2024-03-16T07:27:15.090 INFO:teuthology.orchestra.run.smithi049.stdout:/run 2024-03-16T07:27:15.090 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/cgroup 2024-03-16T07:27:15.090 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/pstore 2024-03-16T07:27:15.090 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/bpf 2024-03-16T07:27:15.090 INFO:teuthology.orchestra.run.smithi049.stdout:/ 2024-03-16T07:27:15.091 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/selinux 2024-03-16T07:27:15.091 INFO:teuthology.orchestra.run.smithi049.stdout:/proc/sys/fs/binfmt_misc 2024-03-16T07:27:15.091 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/mqueue 2024-03-16T07:27:15.091 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/hugepages 2024-03-16T07:27:15.091 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/debug 2024-03-16T07:27:15.091 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/tracing 2024-03-16T07:27:15.091 INFO:teuthology.orchestra.run.smithi049.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-03-16T07:27:15.091 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/fuse/connections 2024-03-16T07:27:15.091 INFO:teuthology.orchestra.run.smithi049.stdout:/run/credentials/systemd-sysctl.service 2024-03-16T07:27:15.091 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/config 2024-03-16T07:27:15.091 INFO:teuthology.orchestra.run.smithi049.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-03-16T07:27:15.091 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/nfs/rpc_pipefs 2024-03-16T07:27:15.091 INFO:teuthology.orchestra.run.smithi049.stdout:/run/user/1000 2024-03-16T07:27:15.091 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph 2024-03-16T07:27:15.092 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-0 2024-03-16T07:27:15.092 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-1 2024-03-16T07:27:15.092 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-2 2024-03-16T07:27:15.092 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns 2024-03-16T07:27:15.092 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-16T07:27:15.092 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-16T07:27:15.092 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-16T07:27:15.092 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-16T07:27:15.092 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:27:15.092 DEBUG:teuthology.orchestra.run.smithi049:> ls /sys/fs/fuse/connections 2024-03-16T07:27:15.145 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-03-16T07:27:15.145 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-03-16T07:27:15.187 DEBUG:teuthology.orchestra.run.smithi049:> sudo modprobe fuse 2024-03-16T07:27:15.218 DEBUG:teuthology.orchestra.run.smithi049:> cat /proc/self/mounts | awk '{print $2}' 2024-03-16T07:27:15.274 INFO:teuthology.orchestra.run.smithi049.stdout:/proc 2024-03-16T07:27:15.274 INFO:teuthology.orchestra.run.smithi049.stdout:/sys 2024-03-16T07:27:15.274 INFO:teuthology.orchestra.run.smithi049.stdout:/dev 2024-03-16T07:27:15.274 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/security 2024-03-16T07:27:15.274 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/shm 2024-03-16T07:27:15.274 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/pts 2024-03-16T07:27:15.274 INFO:teuthology.orchestra.run.smithi049.stdout:/run 2024-03-16T07:27:15.274 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/cgroup 2024-03-16T07:27:15.275 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/pstore 2024-03-16T07:27:15.275 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/bpf 2024-03-16T07:27:15.275 INFO:teuthology.orchestra.run.smithi049.stdout:/ 2024-03-16T07:27:15.275 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/selinux 2024-03-16T07:27:15.275 INFO:teuthology.orchestra.run.smithi049.stdout:/proc/sys/fs/binfmt_misc 2024-03-16T07:27:15.275 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/mqueue 2024-03-16T07:27:15.275 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/hugepages 2024-03-16T07:27:15.275 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/debug 2024-03-16T07:27:15.275 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/tracing 2024-03-16T07:27:15.275 INFO:teuthology.orchestra.run.smithi049.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-03-16T07:27:15.275 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/fuse/connections 2024-03-16T07:27:15.276 INFO:teuthology.orchestra.run.smithi049.stdout:/run/credentials/systemd-sysctl.service 2024-03-16T07:27:15.276 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/config 2024-03-16T07:27:15.276 INFO:teuthology.orchestra.run.smithi049.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-03-16T07:27:15.276 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/nfs/rpc_pipefs 2024-03-16T07:27:15.276 INFO:teuthology.orchestra.run.smithi049.stdout:/run/user/1000 2024-03-16T07:27:15.276 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph 2024-03-16T07:27:15.276 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-0 2024-03-16T07:27:15.276 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-1 2024-03-16T07:27:15.276 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-2 2024-03-16T07:27:15.276 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns 2024-03-16T07:27:15.276 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-16T07:27:15.276 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-16T07:27:15.276 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-16T07:27:15.277 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-16T07:27:15.277 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:27:15.277 DEBUG:teuthology.orchestra.run.smithi049:> ls /sys/fs/fuse/connections 2024-03-16T07:27:15.284 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi049.stderr:2024-03-16T07:27:15.286+0000 7f394b039480 -1 init, newargv = 0x55636035b010 newargc=15 2024-03-16T07:27:15.284 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi049.stderr:ceph-fuse[52705]: starting ceph client 2024-03-16T07:27:15.288 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi049.stderr:ceph-fuse[52705]: starting fuse 2024-03-16T07:27:15.299 INFO:teuthology.orchestra.run.smithi049.stdout:41 2024-03-16T07:27:15.299 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2024-03-16T07:27:15.300 DEBUG:teuthology.orchestra.run.smithi049:> sudo stdin-killer -- python3 -c ' 2024-03-16T07:27:15.300 DEBUG:teuthology.orchestra.run.smithi049:> import glob 2024-03-16T07:27:15.300 DEBUG:teuthology.orchestra.run.smithi049:> import re 2024-03-16T07:27:15.300 DEBUG:teuthology.orchestra.run.smithi049:> import os 2024-03-16T07:27:15.300 DEBUG:teuthology.orchestra.run.smithi049:> import subprocess 2024-03-16T07:27:15.300 DEBUG:teuthology.orchestra.run.smithi049:> 2024-03-16T07:27:15.300 DEBUG:teuthology.orchestra.run.smithi049:> def _find_admin_socket(client_name): 2024-03-16T07:27:15.300 DEBUG:teuthology.orchestra.run.smithi049:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-03-16T07:27:15.300 DEBUG:teuthology.orchestra.run.smithi049:> files = glob.glob(asok_path) 2024-03-16T07:27:15.300 DEBUG:teuthology.orchestra.run.smithi049:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-03-16T07:27:15.300 DEBUG:teuthology.orchestra.run.smithi049:> 2024-03-16T07:27:15.300 DEBUG:teuthology.orchestra.run.smithi049:> # Given a non-glob path, it better be there 2024-03-16T07:27:15.300 DEBUG:teuthology.orchestra.run.smithi049:> if "*" not in asok_path: 2024-03-16T07:27:15.300 DEBUG:teuthology.orchestra.run.smithi049:> assert(len(files) == 1) 2024-03-16T07:27:15.301 DEBUG:teuthology.orchestra.run.smithi049:> return files[0] 2024-03-16T07:27:15.301 DEBUG:teuthology.orchestra.run.smithi049:> 2024-03-16T07:27:15.301 DEBUG:teuthology.orchestra.run.smithi049:> for f in files: 2024-03-16T07:27:15.301 DEBUG:teuthology.orchestra.run.smithi049:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-03-16T07:27:15.301 DEBUG:teuthology.orchestra.run.smithi049:> if os.path.exists("/proc/{0}".format(pid)): 2024-03-16T07:27:15.301 DEBUG:teuthology.orchestra.run.smithi049:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-03-16T07:27:15.301 DEBUG:teuthology.orchestra.run.smithi049:> contents = proc_f.read() 2024-03-16T07:27:15.301 DEBUG:teuthology.orchestra.run.smithi049:> if mountpoint in contents: 2024-03-16T07:27:15.301 DEBUG:teuthology.orchestra.run.smithi049:> return f 2024-03-16T07:27:15.301 DEBUG:teuthology.orchestra.run.smithi049:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-03-16T07:27:15.301 DEBUG:teuthology.orchestra.run.smithi049:> 2024-03-16T07:27:15.301 DEBUG:teuthology.orchestra.run.smithi049:> print(_find_admin_socket("client.0")) 2024-03-16T07:27:15.301 DEBUG:teuthology.orchestra.run.smithi049:> ' 2024-03-16T07:27:15.424 INFO:teuthology.orchestra.run.smithi049.stdout:/var/run/ceph/ceph-client.0.52705.asok 2024-03-16T07:27:15.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-16T07:27:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-16T07:27:15.434 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.52705.asok 2024-03-16T07:27:15.435 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:27:15.435 DEBUG:teuthology.orchestra.run.smithi049:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.52705.asok status 2024-03-16T07:27:15.621 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-03-16T07:27:15.621 INFO:teuthology.orchestra.run.smithi049.stdout: "metadata": { 2024-03-16T07:27:15.621 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph_sha1": "3d78f5ba07bf18880172c07d4d7b4ac00c9d30af", 2024-03-16T07:27:15.621 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph_version": "ceph version 19.0.0-2162-g3d78f5ba (3d78f5ba07bf18880172c07d4d7b4ac00c9d30af) squid (dev)", 2024-03-16T07:27:15.621 INFO:teuthology.orchestra.run.smithi049.stdout: "entity_id": "0", 2024-03-16T07:27:15.621 INFO:teuthology.orchestra.run.smithi049.stdout: "hostname": "smithi049", 2024-03-16T07:27:15.622 INFO:teuthology.orchestra.run.smithi049.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-03-16T07:27:15.622 INFO:teuthology.orchestra.run.smithi049.stdout: "pid": "52705", 2024-03-16T07:27:15.622 INFO:teuthology.orchestra.run.smithi049.stdout: "root": "/" 2024-03-16T07:27:15.622 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:27:15.622 INFO:teuthology.orchestra.run.smithi049.stdout: "dentry_count": 0, 2024-03-16T07:27:15.622 INFO:teuthology.orchestra.run.smithi049.stdout: "dentry_pinned_count": 0, 2024-03-16T07:27:15.622 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 4965, 2024-03-16T07:27:15.622 INFO:teuthology.orchestra.run.smithi049.stdout: "inst": { 2024-03-16T07:27:15.622 INFO:teuthology.orchestra.run.smithi049.stdout: "name": { 2024-03-16T07:27:15.622 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "client", 2024-03-16T07:27:15.622 INFO:teuthology.orchestra.run.smithi049.stdout: "num": 4965 2024-03-16T07:27:15.622 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:27:15.622 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": { 2024-03-16T07:27:15.622 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2024-03-16T07:27:15.623 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "192.168.0.1:0", 2024-03-16T07:27:15.623 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 906867694 2024-03-16T07:27:15.623 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:15.623 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:27:15.623 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": { 2024-03-16T07:27:15.623 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2024-03-16T07:27:15.623 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "192.168.0.1:0", 2024-03-16T07:27:15.623 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 906867694 2024-03-16T07:27:15.623 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:27:15.623 INFO:teuthology.orchestra.run.smithi049.stdout: "inst_str": "client.4965 192.168.0.1:0/906867694", 2024-03-16T07:27:15.623 INFO:teuthology.orchestra.run.smithi049.stdout: "addr_str": "192.168.0.1:0/906867694", 2024-03-16T07:27:15.623 INFO:teuthology.orchestra.run.smithi049.stdout: "inode_count": 1, 2024-03-16T07:27:15.623 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_epoch": 33, 2024-03-16T07:27:15.623 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_epoch": 51, 2024-03-16T07:27:15.623 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_epoch_barrier": 0, 2024-03-16T07:27:15.623 INFO:teuthology.orchestra.run.smithi049.stdout: "blocklisted": false, 2024-03-16T07:27:15.623 INFO:teuthology.orchestra.run.smithi049.stdout: "fs_name": "cephfs" 2024-03-16T07:27:15.624 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-03-16T07:27:15.633 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:27:15.633 DEBUG:teuthology.orchestra.run.smithi049:> stat --file-system '--printf=%T 2024-03-16T07:27:15.633 DEBUG:teuthology.orchestra.run.smithi049:> ' -- /home/ubuntu/cephtest/mnt.0 2024-03-16T07:27:15.649 INFO:teuthology.orchestra.run.smithi049.stdout:fuseblk 2024-03-16T07:27:15.650 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-03-16T07:27:15.650 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:27:15.650 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-03-16T07:27:15.720 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-03-16T07:27:16.103 INFO:teuthology.orchestra.run.smithi049.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-03-16T07:27:16.115 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-03-16T07:27:16.116 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-03-16T07:27:16.116 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi049.front.sepia.ceph.com 2024-03-16T07:27:16.116 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-03-16T07:27:16.116 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-03-16T07:27:16.116 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-03-16T07:27:16.116 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-03-16T07:27:16.116 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-03-16T07:27:16.116 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-03-16T07:27:16.116 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:27:16.116 DEBUG:teuthology.orchestra.run.smithi049:> ip addr 2024-03-16T07:27:16.132 INFO:teuthology.orchestra.run.smithi049.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-16T07:27:16.132 INFO:teuthology.orchestra.run.smithi049.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-16T07:27:16.132 INFO:teuthology.orchestra.run.smithi049.stdout: inet 127.0.0.1/8 scope host lo 2024-03-16T07:27:16.132 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-03-16T07:27:16.132 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 ::1/128 scope host 2024-03-16T07:27:16.132 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-03-16T07:27:16.132 INFO:teuthology.orchestra.run.smithi049.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-16T07:27:16.132 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:6b:ff:84 brd ff:ff:ff:ff:ff:ff 2024-03-16T07:27:16.133 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp7s0f0 2024-03-16T07:27:16.133 INFO:teuthology.orchestra.run.smithi049.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-16T07:27:16.133 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:6b:ff:85 brd ff:ff:ff:ff:ff:ff 2024-03-16T07:27:16.133 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp7s0f1 2024-03-16T07:27:16.133 INFO:teuthology.orchestra.run.smithi049.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-03-16T07:27:16.133 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:bd:15:66 brd ff:ff:ff:ff:ff:ff 2024-03-16T07:27:16.133 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp1s0f0 2024-03-16T07:27:16.133 INFO:teuthology.orchestra.run.smithi049.stdout: inet 172.21.15.49/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-03-16T07:27:16.133 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft 42271sec preferred_lft 42271sec 2024-03-16T07:27:16.133 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::ec4:7aff:febd:1566/64 scope link noprefixroute 2024-03-16T07:27:16.133 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-03-16T07:27:16.133 INFO:teuthology.orchestra.run.smithi049.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-16T07:27:16.133 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:bd:15:67 brd ff:ff:ff:ff:ff:ff 2024-03-16T07:27:16.133 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp1s0f1 2024-03-16T07:27:16.133 INFO:teuthology.orchestra.run.smithi049.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-03-16T07:27:16.133 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether a2:f1:88:c1:22:e7 brd ff:ff:ff:ff:ff:ff 2024-03-16T07:27:16.134 INFO:teuthology.orchestra.run.smithi049.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-03-16T07:27:16.134 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-03-16T07:27:16.134 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::e0e6:55ff:fe4d:1d68/64 scope link 2024-03-16T07:27:16.134 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-03-16T07:27:16.134 INFO:teuthology.orchestra.run.smithi049.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-03-16T07:27:16.134 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether ee:10:71:d7:68:c4 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-16T07:27:16.134 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::ec10:71ff:fed7:68c4/64 scope link 2024-03-16T07:27:16.134 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-03-16T07:27:16.134 INFO:teuthology.orchestra.run.smithi049.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-03-16T07:27:16.134 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether a2:f1:88:c1:22:e7 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-16T07:27:16.134 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::a0f1:88ff:fec1:22e7/64 scope link 2024-03-16T07:27:16.134 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-03-16T07:27:16.135 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:27:16.135 DEBUG:teuthology.orchestra.run.smithi049:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-03-16T07:27:16.201 INFO:teuthology.orchestra.run.smithi049.stdout:1 2024-03-16T07:27:16.202 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:27:16.203 DEBUG:teuthology.orchestra.run.smithi049:> route 2024-03-16T07:27:16.262 INFO:teuthology.orchestra.run.smithi049.stdout:Kernel IP routing table 2024-03-16T07:27:16.262 INFO:teuthology.orchestra.run.smithi049.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-03-16T07:27:16.262 INFO:teuthology.orchestra.run.smithi049.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-03-16T07:27:16.262 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-03-16T07:27:16.262 INFO:teuthology.orchestra.run.smithi049.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-03-16T07:27:16.262 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-16T07:27:16.263 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-03-16T07:27:16.263 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-03-16T07:27:16.263 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-03-16T07:27:16.263 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-03-16T07:27:16.263 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-03-16T07:27:16.351 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-16T07:27:16 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-16T07:27:16.403 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-16T07:27:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-16T07:27:16.409 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:27:16.409 DEBUG:teuthology.orchestra.run.smithi049:> ip netns list 2024-03-16T07:27:16.424 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 1) 2024-03-16T07:27:16.424 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-03-16T07:27:16.424 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-03-16T07:27:16.425 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:27:16.425 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link set brx.1 up 2024-03-16T07:27:16.496 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-03-16T07:27:16.496 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-16T07:27:16.496 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-03-16T07:27:16.551 INFO:teuthology.orchestra.run.smithi049.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-03-16T07:27:16.551 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-16T07:27:16.551 DEBUG:teuthology.orchestra.run.smithi049:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-03-16T07:27:16.607 DEBUG:teuthology.orchestra.run.smithi049:> sudo modprobe fuse 2024-03-16T07:27:16.678 DEBUG:teuthology.orchestra.run.smithi049:> cat /proc/self/mounts | awk '{print $2}' 2024-03-16T07:27:16.734 INFO:teuthology.orchestra.run.smithi049.stdout:/proc 2024-03-16T07:27:16.734 INFO:teuthology.orchestra.run.smithi049.stdout:/sys 2024-03-16T07:27:16.734 INFO:teuthology.orchestra.run.smithi049.stdout:/dev 2024-03-16T07:27:16.734 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/security 2024-03-16T07:27:16.734 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/shm 2024-03-16T07:27:16.734 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/pts 2024-03-16T07:27:16.734 INFO:teuthology.orchestra.run.smithi049.stdout:/run 2024-03-16T07:27:16.734 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/cgroup 2024-03-16T07:27:16.734 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/pstore 2024-03-16T07:27:16.735 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/bpf 2024-03-16T07:27:16.735 INFO:teuthology.orchestra.run.smithi049.stdout:/ 2024-03-16T07:27:16.735 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/selinux 2024-03-16T07:27:16.735 INFO:teuthology.orchestra.run.smithi049.stdout:/proc/sys/fs/binfmt_misc 2024-03-16T07:27:16.735 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/mqueue 2024-03-16T07:27:16.735 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/hugepages 2024-03-16T07:27:16.735 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/debug 2024-03-16T07:27:16.735 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/tracing 2024-03-16T07:27:16.735 INFO:teuthology.orchestra.run.smithi049.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-03-16T07:27:16.735 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/fuse/connections 2024-03-16T07:27:16.735 INFO:teuthology.orchestra.run.smithi049.stdout:/run/credentials/systemd-sysctl.service 2024-03-16T07:27:16.735 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/config 2024-03-16T07:27:16.735 INFO:teuthology.orchestra.run.smithi049.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-03-16T07:27:16.735 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/nfs/rpc_pipefs 2024-03-16T07:27:16.735 INFO:teuthology.orchestra.run.smithi049.stdout:/run/user/1000 2024-03-16T07:27:16.735 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph 2024-03-16T07:27:16.736 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-0 2024-03-16T07:27:16.736 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-1 2024-03-16T07:27:16.736 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-2 2024-03-16T07:27:16.736 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns 2024-03-16T07:27:16.736 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-16T07:27:16.736 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-16T07:27:16.736 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-16T07:27:16.736 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-16T07:27:16.736 INFO:teuthology.orchestra.run.smithi049.stdout:/home/ubuntu/cephtest/mnt.0 2024-03-16T07:27:16.736 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:27:16.736 DEBUG:teuthology.orchestra.run.smithi049:> ls /sys/fs/fuse/connections 2024-03-16T07:27:16.789 INFO:teuthology.orchestra.run.smithi049.stdout:41 2024-03-16T07:27:16.790 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [41] 2024-03-16T07:27:16.790 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-03-16T07:27:16.832 DEBUG:teuthology.orchestra.run.smithi049:> sudo modprobe fuse 2024-03-16T07:27:16.864 DEBUG:teuthology.orchestra.run.smithi049:> cat /proc/self/mounts | awk '{print $2}' 2024-03-16T07:27:16.920 INFO:teuthology.orchestra.run.smithi049.stdout:/proc 2024-03-16T07:27:16.921 INFO:teuthology.orchestra.run.smithi049.stdout:/sys 2024-03-16T07:27:16.921 INFO:teuthology.orchestra.run.smithi049.stdout:/dev 2024-03-16T07:27:16.921 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/security 2024-03-16T07:27:16.921 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/shm 2024-03-16T07:27:16.921 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/pts 2024-03-16T07:27:16.921 INFO:teuthology.orchestra.run.smithi049.stdout:/run 2024-03-16T07:27:16.921 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/cgroup 2024-03-16T07:27:16.921 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/pstore 2024-03-16T07:27:16.921 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/bpf 2024-03-16T07:27:16.921 INFO:teuthology.orchestra.run.smithi049.stdout:/ 2024-03-16T07:27:16.921 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/selinux 2024-03-16T07:27:16.921 INFO:teuthology.orchestra.run.smithi049.stdout:/proc/sys/fs/binfmt_misc 2024-03-16T07:27:16.921 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/mqueue 2024-03-16T07:27:16.921 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/hugepages 2024-03-16T07:27:16.922 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/debug 2024-03-16T07:27:16.922 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/tracing 2024-03-16T07:27:16.922 INFO:teuthology.orchestra.run.smithi049.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-03-16T07:27:16.922 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/fuse/connections 2024-03-16T07:27:16.922 INFO:teuthology.orchestra.run.smithi049.stdout:/run/credentials/systemd-sysctl.service 2024-03-16T07:27:16.922 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/config 2024-03-16T07:27:16.922 INFO:teuthology.orchestra.run.smithi049.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-03-16T07:27:16.922 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/nfs/rpc_pipefs 2024-03-16T07:27:16.922 INFO:teuthology.orchestra.run.smithi049.stdout:/run/user/1000 2024-03-16T07:27:16.922 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph 2024-03-16T07:27:16.922 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-0 2024-03-16T07:27:16.922 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-1 2024-03-16T07:27:16.922 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-2 2024-03-16T07:27:16.923 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns 2024-03-16T07:27:16.923 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-16T07:27:16.923 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-16T07:27:16.923 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-16T07:27:16.923 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-16T07:27:16.923 INFO:teuthology.orchestra.run.smithi049.stdout:/home/ubuntu/cephtest/mnt.0 2024-03-16T07:27:16.924 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:27:16.924 DEBUG:teuthology.orchestra.run.smithi049:> ls /sys/fs/fuse/connections 2024-03-16T07:27:16.929 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi049.stderr:2024-03-16T07:27:16.931+0000 7f9a24a41480 -1 init, newargv = 0x55dfad03bf60 newargc=15 2024-03-16T07:27:16.929 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi049.stderr:ceph-fuse[53119]: starting ceph client 2024-03-16T07:27:16.933 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi049.stderr:ceph-fuse[53119]: starting fuse 2024-03-16T07:27:16.945 INFO:teuthology.orchestra.run.smithi049.stdout:41 2024-03-16T07:27:16.945 INFO:teuthology.orchestra.run.smithi049.stdout:44 2024-03-16T07:27:16.945 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41, 44] 2024-03-16T07:27:16.946 DEBUG:teuthology.orchestra.run.smithi049:> sudo stdin-killer -- python3 -c ' 2024-03-16T07:27:16.946 DEBUG:teuthology.orchestra.run.smithi049:> import glob 2024-03-16T07:27:16.946 DEBUG:teuthology.orchestra.run.smithi049:> import re 2024-03-16T07:27:16.946 DEBUG:teuthology.orchestra.run.smithi049:> import os 2024-03-16T07:27:16.946 DEBUG:teuthology.orchestra.run.smithi049:> import subprocess 2024-03-16T07:27:16.946 DEBUG:teuthology.orchestra.run.smithi049:> 2024-03-16T07:27:16.946 DEBUG:teuthology.orchestra.run.smithi049:> def _find_admin_socket(client_name): 2024-03-16T07:27:16.946 DEBUG:teuthology.orchestra.run.smithi049:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-03-16T07:27:16.946 DEBUG:teuthology.orchestra.run.smithi049:> files = glob.glob(asok_path) 2024-03-16T07:27:16.946 DEBUG:teuthology.orchestra.run.smithi049:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-03-16T07:27:16.946 DEBUG:teuthology.orchestra.run.smithi049:> 2024-03-16T07:27:16.946 DEBUG:teuthology.orchestra.run.smithi049:> # Given a non-glob path, it better be there 2024-03-16T07:27:16.946 DEBUG:teuthology.orchestra.run.smithi049:> if "*" not in asok_path: 2024-03-16T07:27:16.947 DEBUG:teuthology.orchestra.run.smithi049:> assert(len(files) == 1) 2024-03-16T07:27:16.947 DEBUG:teuthology.orchestra.run.smithi049:> return files[0] 2024-03-16T07:27:16.947 DEBUG:teuthology.orchestra.run.smithi049:> 2024-03-16T07:27:16.947 DEBUG:teuthology.orchestra.run.smithi049:> for f in files: 2024-03-16T07:27:16.947 DEBUG:teuthology.orchestra.run.smithi049:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-03-16T07:27:16.947 DEBUG:teuthology.orchestra.run.smithi049:> if os.path.exists("/proc/{0}".format(pid)): 2024-03-16T07:27:16.947 DEBUG:teuthology.orchestra.run.smithi049:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-03-16T07:27:16.947 DEBUG:teuthology.orchestra.run.smithi049:> contents = proc_f.read() 2024-03-16T07:27:16.947 DEBUG:teuthology.orchestra.run.smithi049:> if mountpoint in contents: 2024-03-16T07:27:16.947 DEBUG:teuthology.orchestra.run.smithi049:> return f 2024-03-16T07:27:16.947 DEBUG:teuthology.orchestra.run.smithi049:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-03-16T07:27:16.947 DEBUG:teuthology.orchestra.run.smithi049:> 2024-03-16T07:27:16.947 DEBUG:teuthology.orchestra.run.smithi049:> print(_find_admin_socket("client.1")) 2024-03-16T07:27:16.947 DEBUG:teuthology.orchestra.run.smithi049:> ' 2024-03-16T07:27:17.070 INFO:teuthology.orchestra.run.smithi049.stdout:/var/run/ceph/ceph-client.1.53119.asok 2024-03-16T07:27:17.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-16T07:27:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-16T07:27:17.080 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.53119.asok 2024-03-16T07:27:17.080 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:27:17.080 DEBUG:teuthology.orchestra.run.smithi049:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.53119.asok status 2024-03-16T07:27:17.240 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-03-16T07:27:17.240 INFO:teuthology.orchestra.run.smithi049.stdout: "metadata": { 2024-03-16T07:27:17.240 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph_sha1": "3d78f5ba07bf18880172c07d4d7b4ac00c9d30af", 2024-03-16T07:27:17.240 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph_version": "ceph version 19.0.0-2162-g3d78f5ba (3d78f5ba07bf18880172c07d4d7b4ac00c9d30af) squid (dev)", 2024-03-16T07:27:17.240 INFO:teuthology.orchestra.run.smithi049.stdout: "entity_id": "1", 2024-03-16T07:27:17.240 INFO:teuthology.orchestra.run.smithi049.stdout: "hostname": "smithi049", 2024-03-16T07:27:17.240 INFO:teuthology.orchestra.run.smithi049.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-03-16T07:27:17.240 INFO:teuthology.orchestra.run.smithi049.stdout: "pid": "53119", 2024-03-16T07:27:17.240 INFO:teuthology.orchestra.run.smithi049.stdout: "root": "/" 2024-03-16T07:27:17.241 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:27:17.241 INFO:teuthology.orchestra.run.smithi049.stdout: "dentry_count": 0, 2024-03-16T07:27:17.241 INFO:teuthology.orchestra.run.smithi049.stdout: "dentry_pinned_count": 0, 2024-03-16T07:27:17.241 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 4971, 2024-03-16T07:27:17.241 INFO:teuthology.orchestra.run.smithi049.stdout: "inst": { 2024-03-16T07:27:17.241 INFO:teuthology.orchestra.run.smithi049.stdout: "name": { 2024-03-16T07:27:17.241 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "client", 2024-03-16T07:27:17.241 INFO:teuthology.orchestra.run.smithi049.stdout: "num": 4971 2024-03-16T07:27:17.241 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:27:17.241 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": { 2024-03-16T07:27:17.241 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2024-03-16T07:27:17.241 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "192.168.0.2:0", 2024-03-16T07:27:17.241 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 1808082091 2024-03-16T07:27:17.241 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:17.241 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:27:17.242 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": { 2024-03-16T07:27:17.242 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2024-03-16T07:27:17.242 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "192.168.0.2:0", 2024-03-16T07:27:17.242 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 1808082091 2024-03-16T07:27:17.242 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:27:17.242 INFO:teuthology.orchestra.run.smithi049.stdout: "inst_str": "client.4971 192.168.0.2:0/1808082091", 2024-03-16T07:27:17.242 INFO:teuthology.orchestra.run.smithi049.stdout: "addr_str": "192.168.0.2:0/1808082091", 2024-03-16T07:27:17.242 INFO:teuthology.orchestra.run.smithi049.stdout: "inode_count": 1, 2024-03-16T07:27:17.242 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_epoch": 33, 2024-03-16T07:27:17.242 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_epoch": 51, 2024-03-16T07:27:17.242 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_epoch_barrier": 0, 2024-03-16T07:27:17.243 INFO:teuthology.orchestra.run.smithi049.stdout: "blocklisted": false, 2024-03-16T07:27:17.243 INFO:teuthology.orchestra.run.smithi049.stdout: "fs_name": "cephfs" 2024-03-16T07:27:17.243 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-03-16T07:27:17.248 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:27:17.249 DEBUG:teuthology.orchestra.run.smithi049:> stat --file-system '--printf=%T 2024-03-16T07:27:17.249 DEBUG:teuthology.orchestra.run.smithi049:> ' -- /home/ubuntu/cephtest/mnt.1 2024-03-16T07:27:17.264 INFO:teuthology.orchestra.run.smithi049.stdout:fuseblk 2024-03-16T07:27:17.264 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-03-16T07:27:17.264 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:27:17.264 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-03-16T07:27:17.337 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2024-03-16T07:27:18.250 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T07:27:18.555 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:27:18.555 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":51,"fsid":"f91af061-9eac-4793-87fa-8d27ae3d242f","created":"2024-03-16T07:24:20.357868+0000","modified":"2024-03-16T07:27:09.906624+0000","last_up_change":"2024-03-16T07:24:27.474980+0000","last_in_change":"2024-03-16T07:24:21.254179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T07:24:28.947521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-03-16T07:27:06.904626+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-03-16T07:27:07.577125+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2df14aac-98dc-4e3c-ae7e-9eb677aa30be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6801","nonce":2744935777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6803","nonce":2744935777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6807","nonce":2744935777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6805","nonce":2744935777}]},"public_addr":"172.21.15.49:6801/2744935777","cluster_addr":"172.21.15.49:6803/2744935777","heartbeat_back_addr":"172.21.15.49:6807/2744935777","heartbeat_front_addr":"172.21.15.49:6805/2744935777","state":["exists","up"]},{"osd":1,"uuid":"80461bd9-59ef-46df-9eea-bad92d960c57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6811","nonce":1655120118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6815","nonce":1655120118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6821","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6823","nonce":1655120118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6817","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6819","nonce":1655120118}]},"public_addr":"172.21.15.49:6811/1655120118","cluster_addr":"172.21.15.49:6815/1655120118","heartbeat_back_addr":"172.21.15.49:6823/1655120118","heartbeat_front_addr":"172.21.15.49:6819/1655120118","state":["exists","up"]},{"osd":2,"uuid":"d6bf40eb-6e42-4ec9-8b3d-0b6c5a6def79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6810","nonce":3815472376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6814","nonce":3815472376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6822","nonce":3815472376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6818","nonce":3815472376}]},"public_addr":"172.21.15.49:6810/3815472376","cluster_addr":"172.21.15.49:6814/3815472376","heartbeat_back_addr":"172.21.15.49:6822/3815472376","heartbeat_front_addr":"172.21.15.49:6818/3815472376","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.641492+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.668598+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.614940+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T07:27:18.568 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-16T07:24:28.947521+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-16T07:27:06.904626+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '50', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2024-03-16T07:27:07.577125+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '51', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-16T07:27:18.568 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-16T07:27:18.876 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2024-03-16T07:27:18.889 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-16T07:27:19.190 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2024-03-16T07:27:19.207 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-16T07:27:19.515 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2024-03-16T07:27:19.528 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-03-16T07:27:19.839 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:27:19.839 INFO:teuthology.orchestra.run.smithi049.stdout:[ 2024-03-16T07:27:19.839 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:27:19.840 INFO:teuthology.orchestra.run.smithi049.stdout: "poolnum": 1, 2024-03-16T07:27:19.840 INFO:teuthology.orchestra.run.smithi049.stdout: "poolname": ".mgr" 2024-03-16T07:27:19.840 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:27:19.840 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:27:19.840 INFO:teuthology.orchestra.run.smithi049.stdout: "poolnum": 8, 2024-03-16T07:27:19.840 INFO:teuthology.orchestra.run.smithi049.stdout: "poolname": "cephfs_metadata" 2024-03-16T07:27:19.840 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:27:19.840 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:27:19.841 INFO:teuthology.orchestra.run.smithi049.stdout: "poolnum": 9, 2024-03-16T07:27:19.841 INFO:teuthology.orchestra.run.smithi049.stdout: "poolname": "cephfs_data" 2024-03-16T07:27:19.841 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:19.841 INFO:teuthology.orchestra.run.smithi049.stdout:] 2024-03-16T07:27:19.851 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'backup_fs' 2024-03-16T07:27:19.852 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create backup_fs_metadata --pg_num_min 64 2024-03-16T07:27:20.239 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'backup_fs_metadata' created 2024-03-16T07:27:20.259 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create backup_fs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-03-16T07:27:21.240 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'backup_fs_data' created 2024-03-16T07:27:21.266 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new backup_fs backup_fs_metadata backup_fs_data 2024-03-16T07:27:22.253 INFO:teuthology.orchestra.run.smithi049.stderr:new fs with metadata pool 10 and data pool 11 2024-03-16T07:27:22.285 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T07:27:22.594 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:27:22.594 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":54,"fsid":"f91af061-9eac-4793-87fa-8d27ae3d242f","created":"2024-03-16T07:24:20.357868+0000","modified":"2024-03-16T07:27:21.615103+0000","last_up_change":"2024-03-16T07:24:27.474980+0000","last_in_change":"2024-03-16T07:24:21.254179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T07:24:28.947521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-03-16T07:27:06.904626+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-03-16T07:27:07.577125+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"backup_fs_metadata","create_time":"2024-03-16T07:27:20.203959+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"backup_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.0299999713897705,"score_stable":1.0299999713897705,"optimal_score":1,"raw_score_acting":1.0299999713897705,"raw_score_stable":1.0299999713897705,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"backup_fs_data","create_time":"2024-03-16T07:27:20.598983+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"backup_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2df14aac-98dc-4e3c-ae7e-9eb677aa30be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6801","nonce":2744935777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6803","nonce":2744935777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6807","nonce":2744935777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6805","nonce":2744935777}]},"public_addr":"172.21.15.49:6801/2744935777","cluster_addr":"172.21.15.49:6803/2744935777","heartbeat_back_addr":"172.21.15.49:6807/2744935777","heartbeat_front_addr":"172.21.15.49:6805/2744935777","state":["exists","up"]},{"osd":1,"uuid":"80461bd9-59ef-46df-9eea-bad92d960c57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6811","nonce":1655120118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6815","nonce":1655120118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6821","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6823","nonce":1655120118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6817","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6819","nonce":1655120118}]},"public_addr":"172.21.15.49:6811/1655120118","cluster_addr":"172.21.15.49:6815/1655120118","heartbeat_back_addr":"172.21.15.49:6823/1655120118","heartbeat_front_addr":"172.21.15.49:6819/1655120118","state":["exists","up"]},{"osd":2,"uuid":"d6bf40eb-6e42-4ec9-8b3d-0b6c5a6def79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6810","nonce":3815472376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6814","nonce":3815472376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6822","nonce":3815472376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6818","nonce":3815472376}]},"public_addr":"172.21.15.49:6810/3815472376","cluster_addr":"172.21.15.49:6814/3815472376","heartbeat_back_addr":"172.21.15.49:6822/3815472376","heartbeat_front_addr":"172.21.15.49:6818/3815472376","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.641492+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.668598+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.614940+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T07:27:22.607 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T07:27:22.908 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:27:22.909 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":54,"fsid":"f91af061-9eac-4793-87fa-8d27ae3d242f","created":"2024-03-16T07:24:20.357868+0000","modified":"2024-03-16T07:27:21.615103+0000","last_up_change":"2024-03-16T07:24:27.474980+0000","last_in_change":"2024-03-16T07:24:21.254179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T07:24:28.947521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-03-16T07:27:06.904626+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-03-16T07:27:07.577125+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"backup_fs_metadata","create_time":"2024-03-16T07:27:20.203959+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"backup_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.0299999713897705,"score_stable":1.0299999713897705,"optimal_score":1,"raw_score_acting":1.0299999713897705,"raw_score_stable":1.0299999713897705,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"backup_fs_data","create_time":"2024-03-16T07:27:20.598983+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"backup_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2df14aac-98dc-4e3c-ae7e-9eb677aa30be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6801","nonce":2744935777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6803","nonce":2744935777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6807","nonce":2744935777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6805","nonce":2744935777}]},"public_addr":"172.21.15.49:6801/2744935777","cluster_addr":"172.21.15.49:6803/2744935777","heartbeat_back_addr":"172.21.15.49:6807/2744935777","heartbeat_front_addr":"172.21.15.49:6805/2744935777","state":["exists","up"]},{"osd":1,"uuid":"80461bd9-59ef-46df-9eea-bad92d960c57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6811","nonce":1655120118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6815","nonce":1655120118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6821","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6823","nonce":1655120118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6817","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6819","nonce":1655120118}]},"public_addr":"172.21.15.49:6811/1655120118","cluster_addr":"172.21.15.49:6815/1655120118","heartbeat_back_addr":"172.21.15.49:6823/1655120118","heartbeat_front_addr":"172.21.15.49:6819/1655120118","state":["exists","up"]},{"osd":2,"uuid":"d6bf40eb-6e42-4ec9-8b3d-0b6c5a6def79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6810","nonce":3815472376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6814","nonce":3815472376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6822","nonce":3815472376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6818","nonce":3815472376}]},"public_addr":"172.21.15.49:6810/3815472376","cluster_addr":"172.21.15.49:6814/3815472376","heartbeat_back_addr":"172.21.15.49:6822/3815472376","heartbeat_front_addr":"172.21.15.49:6818/3815472376","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.641492+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.668598+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.614940+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T07:27:22.924 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set backup_fs standby_count_wanted 0 2024-03-16T07:27:24.274 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-03-16T07:27:24.274 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set backup_fs allow_standby_replay false 2024-03-16T07:27:25.276 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'backup_fs' 2024-03-16T07:27:25.276 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T07:27:25.651 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:27:25.651 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":39,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4888,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6827/1901069637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":1901069637},{"type":"v1","addr":"172.21.15.49:6827","nonce":1901069637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30},{"gid":4891,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6829/512304085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":512304085},{"type":"v1","addr":"172.21.15.49:6829","nonce":512304085}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30},{"gid":4894,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6833/2341714657","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":2341714657},{"type":"v1","addr":"172.21.15.49:6833","nonce":2341714657}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-16T07:27:08.607433+0000","modified":"2024-03-16T07:27:10.583409+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4898},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4898":{"gid":4898,"name":"d","rank":0,"incarnation":31,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6835/3239577766","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":3239577766},{"type":"v1","addr":"172.21.15.49:6835","nonce":3239577766}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4898,"qdb_cluster":[4898]},"id":4},{"mdsmap":{"epoch":39,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-16T07:27:21.615388+0000","modified":"2024-03-16T07:27:24.746731+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4895},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4895":{"gid":4895,"name":"b","rank":0,"incarnation":35,"state":"up:active","state_seq":6,"addr":"172.21.15.49:6832/849811345","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6831","nonce":849811345},{"type":"v1","addr":"172.21.15.49:6832","nonce":849811345}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"backup_fs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4895,"qdb_cluster":[4895]},"id":5}]} 2024-03-16T07:27:25.651 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 39 2024-03-16T07:27:25.664 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T07:27:25.969 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:27:25.969 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":55,"fsid":"f91af061-9eac-4793-87fa-8d27ae3d242f","created":"2024-03-16T07:24:20.357868+0000","modified":"2024-03-16T07:27:23.254593+0000","last_up_change":"2024-03-16T07:24:27.474980+0000","last_in_change":"2024-03-16T07:24:21.254179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T07:24:28.947521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-03-16T07:27:06.904626+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-03-16T07:27:07.577125+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"backup_fs_metadata","create_time":"2024-03-16T07:27:20.203959+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"backup_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.0299999713897705,"score_stable":1.0299999713897705,"optimal_score":1,"raw_score_acting":1.0299999713897705,"raw_score_stable":1.0299999713897705,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"backup_fs_data","create_time":"2024-03-16T07:27:20.598983+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"backup_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2df14aac-98dc-4e3c-ae7e-9eb677aa30be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6801","nonce":2744935777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6803","nonce":2744935777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6807","nonce":2744935777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6805","nonce":2744935777}]},"public_addr":"172.21.15.49:6801/2744935777","cluster_addr":"172.21.15.49:6803/2744935777","heartbeat_back_addr":"172.21.15.49:6807/2744935777","heartbeat_front_addr":"172.21.15.49:6805/2744935777","state":["exists","up"]},{"osd":1,"uuid":"80461bd9-59ef-46df-9eea-bad92d960c57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6811","nonce":1655120118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6815","nonce":1655120118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6821","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6823","nonce":1655120118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6817","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6819","nonce":1655120118}]},"public_addr":"172.21.15.49:6811/1655120118","cluster_addr":"172.21.15.49:6815/1655120118","heartbeat_back_addr":"172.21.15.49:6823/1655120118","heartbeat_front_addr":"172.21.15.49:6819/1655120118","state":["exists","up"]},{"osd":2,"uuid":"d6bf40eb-6e42-4ec9-8b3d-0b6c5a6def79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6810","nonce":3815472376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6814","nonce":3815472376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6822","nonce":3815472376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6818","nonce":3815472376}]},"public_addr":"172.21.15.49:6810/3815472376","cluster_addr":"172.21.15.49:6814/3815472376","heartbeat_back_addr":"172.21.15.49:6822/3815472376","heartbeat_front_addr":"172.21.15.49:6818/3815472376","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.641492+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.668598+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.614940+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T07:27:25.983 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-03-16T07:27:25.983 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-16T07:27:26.334 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:27:26.337 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2024-03-16T07:27:26.348 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":44,"stamp":"2024-03-16T07:27:25.738342+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596885,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":298,"num_read_kb":503,"num_write":269,"num_write_kb":1925,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":199,"ondisk_log_size":199,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":386,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":314572800,"kb_used":96424,"kb_used_data":2860,"kb_used_omap":4,"kb_used_meta":93499,"kb_avail":314476376,"statfs":{"total":322122547200,"available":322023809024,"internally_reserved":0,"allocated":2928640,"data_stored":1810810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":95743311},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.496648"},"pg_stats":[{"pgid":"11.3d","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.261677+0000","last_change":"2024-03-16T07:27:22.283631+0000","last_active":"2024-03-16T07:27:23.261677+0000","last_peered":"2024-03-16T07:27:23.261677+0000","last_clean":"2024-03-16T07:27:23.261677+0000","last_became_active":"2024-03-16T07:27:22.283370+0000","last_became_peered":"2024-03-16T07:27:22.283370+0000","last_unstale":"2024-03-16T07:27:23.261677+0000","last_undegraded":"2024-03-16T07:27:23.261677+0000","last_fullsized":"2024-03-16T07:27:23.261677+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_clean_scrub_stamp":"2024-03-16T07:27:21.241337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:33:03.088727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3f","version":"0'0","reported_seq":20,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.263675+0000","last_change":"2024-03-16T07:27:08.932788+0000","last_active":"2024-03-16T07:27:23.263675+0000","last_peered":"2024-03-16T07:27:23.263675+0000","last_clean":"2024-03-16T07:27:23.263675+0000","last_became_active":"2024-03-16T07:27:08.932342+0000","last_became_peered":"2024-03-16T07:27:08.932342+0000","last_unstale":"2024-03-16T07:27:23.263675+0000","last_undegraded":"2024-03-16T07:27:23.263675+0000","last_fullsized":"2024-03-16T07:27:23.263675+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:43:52.645660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.266438+0000","last_change":"2024-03-16T07:27:22.286745+0000","last_active":"2024-03-16T07:27:23.266438+0000","last_peered":"2024-03-16T07:27:23.266438+0000","last_clean":"2024-03-16T07:27:23.266438+0000","last_became_active":"2024-03-16T07:27:22.286145+0000","last_became_peered":"2024-03-16T07:27:22.286145+0000","last_unstale":"2024-03-16T07:27:23.266438+0000","last_undegraded":"2024-03-16T07:27:23.266438+0000","last_fullsized":"2024-03-16T07:27:23.266438+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_clean_scrub_stamp":"2024-03-16T07:27:21.241337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:53:21.015589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":20,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.262943+0000","last_change":"2024-03-16T07:27:08.930178+0000","last_active":"2024-03-16T07:27:23.262943+0000","last_peered":"2024-03-16T07:27:23.262943+0000","last_clean":"2024-03-16T07:27:23.262943+0000","last_became_active":"2024-03-16T07:27:08.929644+0000","last_became_peered":"2024-03-16T07:27:08.929644+0000","last_unstale":"2024-03-16T07:27:23.262943+0000","last_undegraded":"2024-03-16T07:27:23.262943+0000","last_fullsized":"2024-03-16T07:27:23.262943+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:19:02.609010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3f","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.267993+0000","last_change":"2024-03-16T07:27:22.274449+0000","last_active":"2024-03-16T07:27:23.267993+0000","last_peered":"2024-03-16T07:27:23.267993+0000","last_clean":"2024-03-16T07:27:23.267993+0000","last_became_active":"2024-03-16T07:27:22.274193+0000","last_became_peered":"2024-03-16T07:27:22.274193+0000","last_unstale":"2024-03-16T07:27:23.267993+0000","last_undegraded":"2024-03-16T07:27:23.267993+0000","last_fullsized":"2024-03-16T07:27:23.267993+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_clean_scrub_stamp":"2024-03-16T07:27:21.241337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:48:12.221166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":20,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.262190+0000","last_change":"2024-03-16T07:27:08.932882+0000","last_active":"2024-03-16T07:27:23.262190+0000","last_peered":"2024-03-16T07:27:23.262190+0000","last_clean":"2024-03-16T07:27:23.262190+0000","last_became_active":"2024-03-16T07:27:08.932495+0000","last_became_peered":"2024-03-16T07:27:08.932495+0000","last_unstale":"2024-03-16T07:27:23.262190+0000","last_undegraded":"2024-03-16T07:27:23.262190+0000","last_fullsized":"2024-03-16T07:27:23.262190+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:10:56.597918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.269641+0000","last_change":"2024-03-16T07:27:22.278034+0000","last_active":"2024-03-16T07:27:23.269641+0000","last_peered":"2024-03-16T07:27:23.269641+0000","last_clean":"2024-03-16T07:27:23.269641+0000","last_became_active":"2024-03-16T07:27:22.277810+0000","last_became_peered":"2024-03-16T07:27:22.277810+0000","last_unstale":"2024-03-16T07:27:23.269641+0000","last_undegraded":"2024-03-16T07:27:23.269641+0000","last_fullsized":"2024-03-16T07:27:23.269641+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_clean_scrub_stamp":"2024-03-16T07:27:21.241337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:06:31.293964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":20,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.273260+0000","last_change":"2024-03-16T07:27:08.928677+0000","last_active":"2024-03-16T07:27:23.273260+0000","last_peered":"2024-03-16T07:27:23.273260+0000","last_clean":"2024-03-16T07:27:23.273260+0000","last_became_active":"2024-03-16T07:27:08.928373+0000","last_became_peered":"2024-03-16T07:27:08.928373+0000","last_unstale":"2024-03-16T07:27:23.273260+0000","last_undegraded":"2024-03-16T07:27:23.273260+0000","last_fullsized":"2024-03-16T07:27:23.273260+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:03:40.156407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.265018+0000","last_change":"2024-03-16T07:27:22.270283+0000","last_active":"2024-03-16T07:27:23.265018+0000","last_peered":"2024-03-16T07:27:23.265018+0000","last_clean":"2024-03-16T07:27:23.265018+0000","last_became_active":"2024-03-16T07:27:22.270030+0000","last_became_peered":"2024-03-16T07:27:22.270030+0000","last_unstale":"2024-03-16T07:27:23.265018+0000","last_undegraded":"2024-03-16T07:27:23.265018+0000","last_fullsized":"2024-03-16T07:27:23.265018+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_clean_scrub_stamp":"2024-03-16T07:27:21.241337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:07:01.750870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":20,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.261204+0000","last_change":"2024-03-16T07:27:08.930652+0000","last_active":"2024-03-16T07:27:23.261204+0000","last_peered":"2024-03-16T07:27:23.261204+0000","last_clean":"2024-03-16T07:27:23.261204+0000","last_became_active":"2024-03-16T07:27:08.929994+0000","last_became_peered":"2024-03-16T07:27:08.929994+0000","last_unstale":"2024-03-16T07:27:23.261204+0000","last_undegraded":"2024-03-16T07:27:23.261204+0000","last_fullsized":"2024-03-16T07:27:23.261204+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:49:16.398980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.268725+0000","last_change":"2024-03-16T07:27:22.273842+0000","last_active":"2024-03-16T07:27:23.268725+0000","last_peered":"2024-03-16T07:27:23.268725+0000","last_clean":"2024-03-16T07:27:23.268725+0000","last_became_active":"2024-03-16T07:27:22.273619+0000","last_became_peered":"2024-03-16T07:27:22.273619+0000","last_unstale":"2024-03-16T07:27:23.268725+0000","last_undegraded":"2024-03-16T07:27:23.268725+0000","last_fullsized":"2024-03-16T07:27:23.268725+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_clean_scrub_stamp":"2024-03-16T07:27:21.241337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:45:15.388417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":20,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.271057+0000","last_change":"2024-03-16T07:27:08.927116+0000","last_active":"2024-03-16T07:27:23.271057+0000","last_peered":"2024-03-16T07:27:23.271057+0000","last_clean":"2024-03-16T07:27:23.271057+0000","last_became_active":"2024-03-16T07:27:08.926871+0000","last_became_peered":"2024-03-16T07:27:08.926871+0000","last_unstale":"2024-03-16T07:27:23.271057+0000","last_undegraded":"2024-03-16T07:27:23.271057+0000","last_fullsized":"2024-03-16T07:27:23.271057+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:06:16.049198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.261759+0000","last_change":"2024-03-16T07:27:22.283501+0000","last_active":"2024-03-16T07:27:23.261759+0000","last_peered":"2024-03-16T07:27:23.261759+0000","last_clean":"2024-03-16T07:27:23.261759+0000","last_became_active":"2024-03-16T07:27:22.283260+0000","last_became_peered":"2024-03-16T07:27:22.283260+0000","last_unstale":"2024-03-16T07:27:23.261759+0000","last_undegraded":"2024-03-16T07:27:23.261759+0000","last_fullsized":"2024-03-16T07:27:23.261759+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_clean_scrub_stamp":"2024-03-16T07:27:21.241337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:11:11.164011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":20,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.270119+0000","last_change":"2024-03-16T07:27:08.927253+0000","last_active":"2024-03-16T07:27:23.270119+0000","last_peered":"2024-03-16T07:27:23.270119+0000","last_clean":"2024-03-16T07:27:23.270119+0000","last_became_active":"2024-03-16T07:27:08.926863+0000","last_became_peered":"2024-03-16T07:27:08.926863+0000","last_unstale":"2024-03-16T07:27:23.270119+0000","last_undegraded":"2024-03-16T07:27:23.270119+0000","last_fullsized":"2024-03-16T07:27:23.270119+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:36:21.385242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.259650+0000","last_change":"2024-03-16T07:27:22.274635+0000","last_active":"2024-03-16T07:27:23.259650+0000","last_peered":"2024-03-16T07:27:23.259650+0000","last_clean":"2024-03-16T07:27:23.259650+0000","last_became_active":"2024-03-16T07:27:22.274122+0000","last_became_peered":"2024-03-16T07:27:22.274122+0000","last_unstale":"2024-03-16T07:27:23.259650+0000","last_undegraded":"2024-03-16T07:27:23.259650+0000","last_fullsized":"2024-03-16T07:27:23.259650+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_clean_scrub_stamp":"2024-03-16T07:27:21.241337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:53:21.015589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":20,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.260236+0000","last_change":"2024-03-16T07:27:08.933312+0000","last_active":"2024-03-16T07:27:23.260236+0000","last_peered":"2024-03-16T07:27:23.260236+0000","last_clean":"2024-03-16T07:27:23.260236+0000","last_became_active":"2024-03-16T07:27:08.932097+0000","last_became_peered":"2024-03-16T07:27:08.932097+0000","last_unstale":"2024-03-16T07:27:23.260236+0000","last_undegraded":"2024-03-16T07:27:23.260236+0000","last_fullsized":"2024-03-16T07:27:23.260236+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:26:36.937904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.270642+0000","last_change":"2024-03-16T07:27:22.286894+0000","last_active":"2024-03-16T07:27:23.270642+0000","last_peered":"2024-03-16T07:27:23.270642+0000","last_clean":"2024-03-16T07:27:23.270642+0000","last_became_active":"2024-03-16T07:27:22.286552+0000","last_became_peered":"2024-03-16T07:27:22.286552+0000","last_unstale":"2024-03-16T07:27:23.270642+0000","last_undegraded":"2024-03-16T07:27:23.270642+0000","last_fullsized":"2024-03-16T07:27:23.270642+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_clean_scrub_stamp":"2024-03-16T07:27:21.241337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:40:27.506465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":20,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.267736+0000","last_change":"2024-03-16T07:27:08.924310+0000","last_active":"2024-03-16T07:27:23.267736+0000","last_peered":"2024-03-16T07:27:23.267736+0000","last_clean":"2024-03-16T07:27:23.267736+0000","last_became_active":"2024-03-16T07:27:08.924068+0000","last_became_peered":"2024-03-16T07:27:08.924068+0000","last_unstale":"2024-03-16T07:27:23.267736+0000","last_undegraded":"2024-03-16T07:27:23.267736+0000","last_fullsized":"2024-03-16T07:27:23.267736+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:20:23.064044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.266802+0000","last_change":"2024-03-16T07:27:22.286548+0000","last_active":"2024-03-16T07:27:23.266802+0000","last_peered":"2024-03-16T07:27:23.266802+0000","last_clean":"2024-03-16T07:27:23.266802+0000","last_became_active":"2024-03-16T07:27:22.285800+0000","last_became_peered":"2024-03-16T07:27:22.285800+0000","last_unstale":"2024-03-16T07:27:23.266802+0000","last_undegraded":"2024-03-16T07:27:23.266802+0000","last_fullsized":"2024-03-16T07:27:23.266802+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_clean_scrub_stamp":"2024-03-16T07:27:21.241337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:05:00.308806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":20,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.266163+0000","last_change":"2024-03-16T07:27:08.920122+0000","last_active":"2024-03-16T07:27:23.266163+0000","last_peered":"2024-03-16T07:27:23.266163+0000","last_clean":"2024-03-16T07:27:23.266163+0000","last_became_active":"2024-03-16T07:27:08.919879+0000","last_became_peered":"2024-03-16T07:27:08.919879+0000","last_unstale":"2024-03-16T07:27:23.266163+0000","last_undegraded":"2024-03-16T07:27:23.266163+0000","last_fullsized":"2024-03-16T07:27:23.266163+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:50:55.466512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.264332+0000","last_change":"2024-03-16T07:27:22.283865+0000","last_active":"2024-03-16T07:27:23.264332+0000","last_peered":"2024-03-16T07:27:23.264332+0000","last_clean":"2024-03-16T07:27:23.264332+0000","last_became_active":"2024-03-16T07:27:22.283630+0000","last_became_peered":"2024-03-16T07:27:22.283630+0000","last_unstale":"2024-03-16T07:27:23.264332+0000","last_undegraded":"2024-03-16T07:27:23.264332+0000","last_fullsized":"2024-03-16T07:27:23.264332+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_clean_scrub_stamp":"2024-03-16T07:27:21.241337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:11:36.873806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":20,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.266616+0000","last_change":"2024-03-16T07:27:08.917382+0000","last_active":"2024-03-16T07:27:23.266616+0000","last_peered":"2024-03-16T07:27:23.266616+0000","last_clean":"2024-03-16T07:27:23.266616+0000","last_became_active":"2024-03-16T07:27:08.917137+0000","last_became_peered":"2024-03-16T07:27:08.917137+0000","last_unstale":"2024-03-16T07:27:23.266616+0000","last_undegraded":"2024-03-16T07:27:23.266616+0000","last_fullsized":"2024-03-16T07:27:23.266616+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:10:56.597918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.265549+0000","last_change":"2024-03-16T07:27:22.273849+0000","last_active":"2024-03-16T07:27:23.265549+0000","last_peered":"2024-03-16T07:27:23.265549+0000","last_clean":"2024-03-16T07:27:23.265549+0000","last_became_active":"2024-03-16T07:27:22.273195+0000","last_became_peered":"2024-03-16T07:27:22.273195+0000","last_unstale":"2024-03-16T07:27:23.265549+0000","last_undegraded":"2024-03-16T07:27:23.265549+0000","last_fullsized":"2024-03-16T07:27:23.265549+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_clean_scrub_stamp":"2024-03-16T07:27:21.241337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:06:13.229917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":20,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.267655+0000","last_change":"2024-03-16T07:27:08.922563+0000","last_active":"2024-03-16T07:27:23.267655+0000","last_peered":"2024-03-16T07:27:23.267655+0000","last_clean":"2024-03-16T07:27:23.267655+0000","last_became_active":"2024-03-16T07:27:08.922314+0000","last_became_peered":"2024-03-16T07:27:08.922314+0000","last_unstale":"2024-03-16T07:27:23.267655+0000","last_undegraded":"2024-03-16T07:27:23.267655+0000","last_fullsized":"2024-03-16T07:27:23.267655+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:50:02.719035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.270987+0000","last_change":"2024-03-16T07:27:22.292570+0000","last_active":"2024-03-16T07:27:23.270987+0000","last_peered":"2024-03-16T07:27:23.270987+0000","last_clean":"2024-03-16T07:27:23.270987+0000","last_became_active":"2024-03-16T07:27:22.292332+0000","last_became_peered":"2024-03-16T07:27:22.292332+0000","last_unstale":"2024-03-16T07:27:23.270987+0000","last_undegraded":"2024-03-16T07:27:23.270987+0000","last_fullsized":"2024-03-16T07:27:23.270987+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_clean_scrub_stamp":"2024-03-16T07:27:21.241337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:06:23.016709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":20,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.270660+0000","last_change":"2024-03-16T07:27:08.927980+0000","last_active":"2024-03-16T07:27:23.270660+0000","last_peered":"2024-03-16T07:27:23.270660+0000","last_clean":"2024-03-16T07:27:23.270660+0000","last_became_active":"2024-03-16T07:27:08.927737+0000","last_became_peered":"2024-03-16T07:27:08.927737+0000","last_unstale":"2024-03-16T07:27:23.270660+0000","last_undegraded":"2024-03-16T07:27:23.270660+0000","last_fullsized":"2024-03-16T07:27:23.270660+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:13:53.899556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.260505+0000","last_change":"2024-03-16T07:27:22.281426+0000","last_active":"2024-03-16T07:27:23.260505+0000","last_peered":"2024-03-16T07:27:23.260505+0000","last_clean":"2024-03-16T07:27:23.260505+0000","last_became_active":"2024-03-16T07:27:22.280652+0000","last_became_peered":"2024-03-16T07:27:22.280652+0000","last_unstale":"2024-03-16T07:27:23.260505+0000","last_undegraded":"2024-03-16T07:27:23.260505+0000","last_fullsized":"2024-03-16T07:27:23.260505+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_clean_scrub_stamp":"2024-03-16T07:27:21.241337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:42:55.299515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":20,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.261070+0000","last_change":"2024-03-16T07:27:08.930010+0000","last_active":"2024-03-16T07:27:23.261070+0000","last_peered":"2024-03-16T07:27:23.261070+0000","last_clean":"2024-03-16T07:27:23.261070+0000","last_became_active":"2024-03-16T07:27:08.928878+0000","last_became_peered":"2024-03-16T07:27:08.928878+0000","last_unstale":"2024-03-16T07:27:23.261070+0000","last_undegraded":"2024-03-16T07:27:23.261070+0000","last_fullsized":"2024-03-16T07:27:23.261070+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:10:07.438245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.270230+0000","last_change":"2024-03-16T07:27:22.272091+0000","last_active":"2024-03-16T07:27:23.270230+0000","last_peered":"2024-03-16T07:27:23.270230+0000","last_clean":"2024-03-16T07:27:23.270230+0000","last_became_active":"2024-03-16T07:27:22.271850+0000","last_became_peered":"2024-03-16T07:27:22.271850+0000","last_unstale":"2024-03-16T07:27:23.270230+0000","last_undegraded":"2024-03-16T07:27:23.270230+0000","last_fullsized":"2024-03-16T07:27:23.270230+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_clean_scrub_stamp":"2024-03-16T07:27:21.241337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:56:11.873996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":20,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.270265+0000","last_change":"2024-03-16T07:27:08.921298+0000","last_active":"2024-03-16T07:27:23.270265+0000","last_peered":"2024-03-16T07:27:23.270265+0000","last_clean":"2024-03-16T07:27:23.270265+0000","last_became_active":"2024-03-16T07:27:08.921040+0000","last_became_peered":"2024-03-16T07:27:08.921040+0000","last_unstale":"2024-03-16T07:27:23.270265+0000","last_undegraded":"2024-03-16T07:27:23.270265+0000","last_fullsized":"2024-03-16T07:27:23.270265+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:20:19.699271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.259813+0000","last_change":"2024-03-16T07:27:22.267372+0000","last_active":"2024-03-16T07:27:23.259813+0000","last_peered":"2024-03-16T07:27:23.259813+0000","last_clean":"2024-03-16T07:27:23.259813+0000","last_became_active":"2024-03-16T07:27:22.267086+0000","last_became_peered":"2024-03-16T07:27:22.267086+0000","last_unstale":"2024-03-16T07:27:23.259813+0000","last_undegraded":"2024-03-16T07:27:23.259813+0000","last_fullsized":"2024-03-16T07:27:23.259813+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_clean_scrub_stamp":"2024-03-16T07:27:21.241337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:35:42.596648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":20,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.269303+0000","last_change":"2024-03-16T07:27:08.920197+0000","last_active":"2024-03-16T07:27:23.269303+0000","last_peered":"2024-03-16T07:27:23.269303+0000","last_clean":"2024-03-16T07:27:23.269303+0000","last_became_active":"2024-03-16T07:27:08.919784+0000","last_became_peered":"2024-03-16T07:27:08.919784+0000","last_unstale":"2024-03-16T07:27:23.269303+0000","last_undegraded":"2024-03-16T07:27:23.269303+0000","last_fullsized":"2024-03-16T07:27:23.269303+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:28:47.950665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.261825+0000","last_change":"2024-03-16T07:27:22.268379+0000","last_active":"2024-03-16T07:27:23.261825+0000","last_peered":"2024-03-16T07:27:23.261825+0000","last_clean":"2024-03-16T07:27:23.261825+0000","last_became_active":"2024-03-16T07:27:22.267941+0000","last_became_peered":"2024-03-16T07:27:22.267941+0000","last_unstale":"2024-03-16T07:27:23.261825+0000","last_undegraded":"2024-03-16T07:27:23.261825+0000","last_fullsized":"2024-03-16T07:27:23.261825+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_clean_scrub_stamp":"2024-03-16T07:27:21.241337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:34:28.078295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":20,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.264039+0000","last_change":"2024-03-16T07:27:08.934550+0000","last_active":"2024-03-16T07:27:23.264039+0000","last_peered":"2024-03-16T07:27:23.264039+0000","last_clean":"2024-03-16T07:27:23.264039+0000","last_became_active":"2024-03-16T07:27:08.934318+0000","last_became_peered":"2024-03-16T07:27:08.934318+0000","last_unstale":"2024-03-16T07:27:23.264039+0000","last_undegraded":"2024-03-16T07:27:23.264039+0000","last_fullsized":"2024-03-16T07:27:23.264039+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:07:10.332576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.270563+0000","last_change":"2024-03-16T07:27:22.289852+0000","last_active":"2024-03-16T07:27:23.270563+0000","last_peered":"2024-03-16T07:27:23.270563+0000","last_clean":"2024-03-16T07:27:23.270563+0000","last_became_active":"2024-03-16T07:27:22.289259+0000","last_became_peered":"2024-03-16T07:27:22.289259+0000","last_unstale":"2024-03-16T07:27:23.270563+0000","last_undegraded":"2024-03-16T07:27:23.270563+0000","last_fullsized":"2024-03-16T07:27:23.270563+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_clean_scrub_stamp":"2024-03-16T07:27:21.241337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:57:13.570155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":20,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.262944+0000","last_change":"2024-03-16T07:27:08.929576+0000","last_active":"2024-03-16T07:27:23.262944+0000","last_peered":"2024-03-16T07:27:23.262944+0000","last_clean":"2024-03-16T07:27:23.262944+0000","last_became_active":"2024-03-16T07:27:08.929323+0000","last_became_peered":"2024-03-16T07:27:08.929323+0000","last_unstale":"2024-03-16T07:27:23.262944+0000","last_undegraded":"2024-03-16T07:27:23.262944+0000","last_fullsized":"2024-03-16T07:27:23.262944+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:41:54.146099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.264508+0000","last_change":"2024-03-16T07:27:22.268911+0000","last_active":"2024-03-16T07:27:23.264508+0000","last_peered":"2024-03-16T07:27:23.264508+0000","last_clean":"2024-03-16T07:27:23.264508+0000","last_became_active":"2024-03-16T07:27:22.268654+0000","last_became_peered":"2024-03-16T07:27:22.268654+0000","last_unstale":"2024-03-16T07:27:23.264508+0000","last_undegraded":"2024-03-16T07:27:23.264508+0000","last_fullsized":"2024-03-16T07:27:23.264508+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_clean_scrub_stamp":"2024-03-16T07:27:21.241337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:57:33.603849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":20,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.262434+0000","last_change":"2024-03-16T07:27:08.929159+0000","last_active":"2024-03-16T07:27:23.262434+0000","last_peered":"2024-03-16T07:27:23.262434+0000","last_clean":"2024-03-16T07:27:23.262434+0000","last_became_active":"2024-03-16T07:27:08.928915+0000","last_became_peered":"2024-03-16T07:27:08.928915+0000","last_unstale":"2024-03-16T07:27:23.262434+0000","last_undegraded":"2024-03-16T07:27:23.262434+0000","last_fullsized":"2024-03-16T07:27:23.262434+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:50:55.466512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.265716+0000","last_change":"2024-03-16T07:27:22.273655+0000","last_active":"2024-03-16T07:27:23.265716+0000","last_peered":"2024-03-16T07:27:23.265716+0000","last_clean":"2024-03-16T07:27:23.265716+0000","last_became_active":"2024-03-16T07:27:22.272843+0000","last_became_peered":"2024-03-16T07:27:22.272843+0000","last_unstale":"2024-03-16T07:27:23.265716+0000","last_undegraded":"2024-03-16T07:27:23.265716+0000","last_fullsized":"2024-03-16T07:27:23.265716+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_clean_scrub_stamp":"2024-03-16T07:27:21.241337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:09:32.696904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":20,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.267438+0000","last_change":"2024-03-16T07:27:08.921817+0000","last_active":"2024-03-16T07:27:23.267438+0000","last_peered":"2024-03-16T07:27:23.267438+0000","last_clean":"2024-03-16T07:27:23.267438+0000","last_became_active":"2024-03-16T07:27:08.921104+0000","last_became_peered":"2024-03-16T07:27:08.921104+0000","last_unstale":"2024-03-16T07:27:23.267438+0000","last_undegraded":"2024-03-16T07:27:23.267438+0000","last_fullsized":"2024-03-16T07:27:23.267438+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:07:05.838425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.265033+0000","last_change":"2024-03-16T07:27:22.280587+0000","last_active":"2024-03-16T07:27:23.265033+0000","last_peered":"2024-03-16T07:27:23.265033+0000","last_clean":"2024-03-16T07:27:23.265033+0000","last_became_active":"2024-03-16T07:27:22.280309+0000","last_became_peered":"2024-03-16T07:27:22.280309+0000","last_unstale":"2024-03-16T07:27:23.265033+0000","last_undegraded":"2024-03-16T07:27:23.265033+0000","last_fullsized":"2024-03-16T07:27:23.265033+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_clean_scrub_stamp":"2024-03-16T07:27:21.241337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:53:35.954333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":20,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.270751+0000","last_change":"2024-03-16T07:27:08.920639+0000","last_active":"2024-03-16T07:27:23.270751+0000","last_peered":"2024-03-16T07:27:23.270751+0000","last_clean":"2024-03-16T07:27:23.270751+0000","last_became_active":"2024-03-16T07:27:08.918624+0000","last_became_peered":"2024-03-16T07:27:08.918624+0000","last_unstale":"2024-03-16T07:27:23.270751+0000","last_undegraded":"2024-03-16T07:27:23.270751+0000","last_fullsized":"2024-03-16T07:27:23.270751+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:17:16.011392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.268813+0000","last_change":"2024-03-16T07:27:22.285698+0000","last_active":"2024-03-16T07:27:23.268813+0000","last_peered":"2024-03-16T07:27:23.268813+0000","last_clean":"2024-03-16T07:27:23.268813+0000","last_became_active":"2024-03-16T07:27:22.285442+0000","last_became_peered":"2024-03-16T07:27:22.285442+0000","last_unstale":"2024-03-16T07:27:23.268813+0000","last_undegraded":"2024-03-16T07:27:23.268813+0000","last_fullsized":"2024-03-16T07:27:23.268813+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_clean_scrub_stamp":"2024-03-16T07:27:21.241337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:50:28.325970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":20,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.261069+0000","last_change":"2024-03-16T07:27:08.931009+0000","last_active":"2024-03-16T07:27:23.261069+0000","last_peered":"2024-03-16T07:27:23.261069+0000","last_clean":"2024-03-16T07:27:23.261069+0000","last_became_active":"2024-03-16T07:27:08.930742+0000","last_became_peered":"2024-03-16T07:27:08.930742+0000","last_unstale":"2024-03-16T07:27:23.261069+0000","last_undegraded":"2024-03-16T07:27:23.261069+0000","last_fullsized":"2024-03-16T07:27:23.261069+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:37:57.835321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.273080+0000","last_change":"2024-03-16T07:27:22.295522+0000","last_active":"2024-03-16T07:27:23.273080+0000","last_peered":"2024-03-16T07:27:23.273080+0000","last_clean":"2024-03-16T07:27:23.273080+0000","last_became_active":"2024-03-16T07:27:22.295024+0000","last_became_peered":"2024-03-16T07:27:22.295024+0000","last_unstale":"2024-03-16T07:27:23.273080+0000","last_undegraded":"2024-03-16T07:27:23.273080+0000","last_fullsized":"2024-03-16T07:27:23.273080+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_clean_scrub_stamp":"2024-03-16T07:27:21.241337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:13:21.708658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":20,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.265243+0000","last_change":"2024-03-16T07:27:08.928135+0000","last_active":"2024-03-16T07:27:23.265243+0000","last_peered":"2024-03-16T07:27:23.265243+0000","last_clean":"2024-03-16T07:27:23.265243+0000","last_became_active":"2024-03-16T07:27:08.927873+0000","last_became_peered":"2024-03-16T07:27:08.927873+0000","last_unstale":"2024-03-16T07:27:23.265243+0000","last_undegraded":"2024-03-16T07:27:23.265243+0000","last_fullsized":"2024-03-16T07:27:23.265243+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:30:26.855912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.259962+0000","last_change":"2024-03-16T07:27:22.267818+0000","last_active":"2024-03-16T07:27:23.259962+0000","last_peered":"2024-03-16T07:27:23.259962+0000","last_clean":"2024-03-16T07:27:23.259962+0000","last_became_active":"2024-03-16T07:27:22.267557+0000","last_became_peered":"2024-03-16T07:27:22.267557+0000","last_unstale":"2024-03-16T07:27:23.259962+0000","last_undegraded":"2024-03-16T07:27:23.259962+0000","last_fullsized":"2024-03-16T07:27:23.259962+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_clean_scrub_stamp":"2024-03-16T07:27:21.241337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:48:12.221166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":20,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.266217+0000","last_change":"2024-03-16T07:27:08.923796+0000","last_active":"2024-03-16T07:27:23.266217+0000","last_peered":"2024-03-16T07:27:23.266217+0000","last_clean":"2024-03-16T07:27:23.266217+0000","last_became_active":"2024-03-16T07:27:08.922862+0000","last_became_peered":"2024-03-16T07:27:08.922862+0000","last_unstale":"2024-03-16T07:27:23.266217+0000","last_undegraded":"2024-03-16T07:27:23.266217+0000","last_fullsized":"2024-03-16T07:27:23.266217+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:57:35.040095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.269720+0000","last_change":"2024-03-16T07:27:22.277157+0000","last_active":"2024-03-16T07:27:23.269720+0000","last_peered":"2024-03-16T07:27:23.269720+0000","last_clean":"2024-03-16T07:27:23.269720+0000","last_became_active":"2024-03-16T07:27:22.276930+0000","last_became_peered":"2024-03-16T07:27:22.276930+0000","last_unstale":"2024-03-16T07:27:23.269720+0000","last_undegraded":"2024-03-16T07:27:23.269720+0000","last_fullsized":"2024-03-16T07:27:23.269720+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_clean_scrub_stamp":"2024-03-16T07:27:21.241337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:39:00.344300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":20,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.263472+0000","last_change":"2024-03-16T07:27:08.933535+0000","last_active":"2024-03-16T07:27:23.263472+0000","last_peered":"2024-03-16T07:27:23.263472+0000","last_clean":"2024-03-16T07:27:23.263472+0000","last_became_active":"2024-03-16T07:27:08.932851+0000","last_became_peered":"2024-03-16T07:27:08.932851+0000","last_unstale":"2024-03-16T07:27:23.263472+0000","last_undegraded":"2024-03-16T07:27:23.263472+0000","last_fullsized":"2024-03-16T07:27:23.263472+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:06:07.410185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.270888+0000","last_change":"2024-03-16T07:27:22.289637+0000","last_active":"2024-03-16T07:27:23.270888+0000","last_peered":"2024-03-16T07:27:23.270888+0000","last_clean":"2024-03-16T07:27:23.270888+0000","last_became_active":"2024-03-16T07:27:22.288926+0000","last_became_peered":"2024-03-16T07:27:22.288926+0000","last_unstale":"2024-03-16T07:27:23.270888+0000","last_undegraded":"2024-03-16T07:27:23.270888+0000","last_fullsized":"2024-03-16T07:27:23.270888+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_clean_scrub_stamp":"2024-03-16T07:27:21.241337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:44:34.053308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":20,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.271082+0000","last_change":"2024-03-16T07:27:08.917214+0000","last_active":"2024-03-16T07:27:23.271082+0000","last_peered":"2024-03-16T07:27:23.271082+0000","last_clean":"2024-03-16T07:27:23.271082+0000","last_became_active":"2024-03-16T07:27:08.916970+0000","last_became_peered":"2024-03-16T07:27:08.916970+0000","last_unstale":"2024-03-16T07:27:23.271082+0000","last_undegraded":"2024-03-16T07:27:23.271082+0000","last_fullsized":"2024-03-16T07:27:23.271082+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:26:33.905315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.268134+0000","last_change":"2024-03-16T07:27:22.292302+0000","last_active":"2024-03-16T07:27:23.268134+0000","last_peered":"2024-03-16T07:27:23.268134+0000","last_clean":"2024-03-16T07:27:23.268134+0000","last_became_active":"2024-03-16T07:27:22.292063+0000","last_became_peered":"2024-03-16T07:27:22.292063+0000","last_unstale":"2024-03-16T07:27:23.268134+0000","last_undegraded":"2024-03-16T07:27:23.268134+0000","last_fullsized":"2024-03-16T07:27:23.268134+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_clean_scrub_stamp":"2024-03-16T07:27:21.241337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:35:08.279783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":20,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.270172+0000","last_change":"2024-03-16T07:27:08.918832+0000","last_active":"2024-03-16T07:27:23.270172+0000","last_peered":"2024-03-16T07:27:23.270172+0000","last_clean":"2024-03-16T07:27:23.270172+0000","last_became_active":"2024-03-16T07:27:08.917629+0000","last_became_peered":"2024-03-16T07:27:08.917629+0000","last_unstale":"2024-03-16T07:27:23.270172+0000","last_undegraded":"2024-03-16T07:27:23.270172+0000","last_fullsized":"2024-03-16T07:27:23.270172+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:00:29.829222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.265796+0000","last_change":"2024-03-16T07:27:22.273455+0000","last_active":"2024-03-16T07:27:23.265796+0000","last_peered":"2024-03-16T07:27:23.265796+0000","last_clean":"2024-03-16T07:27:23.265796+0000","last_became_active":"2024-03-16T07:27:22.272849+0000","last_became_peered":"2024-03-16T07:27:22.272849+0000","last_unstale":"2024-03-16T07:27:23.265796+0000","last_undegraded":"2024-03-16T07:27:23.265796+0000","last_fullsized":"2024-03-16T07:27:23.265796+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_clean_scrub_stamp":"2024-03-16T07:27:21.241337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:54:28.380093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":20,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.261984+0000","last_change":"2024-03-16T07:27:08.932888+0000","last_active":"2024-03-16T07:27:23.261984+0000","last_peered":"2024-03-16T07:27:23.261984+0000","last_clean":"2024-03-16T07:27:23.261984+0000","last_became_active":"2024-03-16T07:27:08.932595+0000","last_became_peered":"2024-03-16T07:27:08.932595+0000","last_unstale":"2024-03-16T07:27:23.261984+0000","last_undegraded":"2024-03-16T07:27:23.261984+0000","last_fullsized":"2024-03-16T07:27:23.261984+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:57:35.040095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.270921+0000","last_change":"2024-03-16T07:27:22.292135+0000","last_active":"2024-03-16T07:27:23.270921+0000","last_peered":"2024-03-16T07:27:23.270921+0000","last_clean":"2024-03-16T07:27:23.270921+0000","last_became_active":"2024-03-16T07:27:22.289649+0000","last_became_peered":"2024-03-16T07:27:22.289649+0000","last_unstale":"2024-03-16T07:27:23.270921+0000","last_undegraded":"2024-03-16T07:27:23.270921+0000","last_fullsized":"2024-03-16T07:27:23.270921+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_clean_scrub_stamp":"2024-03-16T07:27:21.241337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:53:13.155674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":20,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.261495+0000","last_change":"2024-03-16T07:27:08.930920+0000","last_active":"2024-03-16T07:27:23.261495+0000","last_peered":"2024-03-16T07:27:23.261495+0000","last_clean":"2024-03-16T07:27:23.261495+0000","last_became_active":"2024-03-16T07:27:08.930391+0000","last_became_peered":"2024-03-16T07:27:08.930391+0000","last_unstale":"2024-03-16T07:27:23.261495+0000","last_undegraded":"2024-03-16T07:27:23.261495+0000","last_fullsized":"2024-03-16T07:27:23.261495+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:39:08.012405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.268879+0000","last_change":"2024-03-16T07:27:22.285226+0000","last_active":"2024-03-16T07:27:23.268879+0000","last_peered":"2024-03-16T07:27:23.268879+0000","last_clean":"2024-03-16T07:27:23.268879+0000","last_became_active":"2024-03-16T07:27:22.284969+0000","last_became_peered":"2024-03-16T07:27:22.284969+0000","last_unstale":"2024-03-16T07:27:23.268879+0000","last_undegraded":"2024-03-16T07:27:23.268879+0000","last_fullsized":"2024-03-16T07:27:23.268879+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_clean_scrub_stamp":"2024-03-16T07:27:21.241337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:50:54.054485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":20,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.265541+0000","last_change":"2024-03-16T07:27:08.930429+0000","last_active":"2024-03-16T07:27:23.265541+0000","last_peered":"2024-03-16T07:27:23.265541+0000","last_clean":"2024-03-16T07:27:23.265541+0000","last_became_active":"2024-03-16T07:27:08.930100+0000","last_became_peered":"2024-03-16T07:27:08.930100+0000","last_unstale":"2024-03-16T07:27:23.265541+0000","last_undegraded":"2024-03-16T07:27:23.265541+0000","last_fullsized":"2024-03-16T07:27:23.265541+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:19:36.463344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.267089+0000","last_change":"2024-03-16T07:27:22.272954+0000","last_active":"2024-03-16T07:27:23.267089+0000","last_peered":"2024-03-16T07:27:23.267089+0000","last_clean":"2024-03-16T07:27:23.267089+0000","last_became_active":"2024-03-16T07:27:22.270983+0000","last_became_peered":"2024-03-16T07:27:22.270983+0000","last_unstale":"2024-03-16T07:27:23.267089+0000","last_undegraded":"2024-03-16T07:27:23.267089+0000","last_fullsized":"2024-03-16T07:27:23.267089+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_clean_scrub_stamp":"2024-03-16T07:27:21.241337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:35:42.596648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":20,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.260067+0000","last_change":"2024-03-16T07:27:08.930019+0000","last_active":"2024-03-16T07:27:23.260067+0000","last_peered":"2024-03-16T07:27:23.260067+0000","last_clean":"2024-03-16T07:27:23.260067+0000","last_became_active":"2024-03-16T07:27:08.929748+0000","last_became_peered":"2024-03-16T07:27:08.929748+0000","last_unstale":"2024-03-16T07:27:23.260067+0000","last_undegraded":"2024-03-16T07:27:23.260067+0000","last_fullsized":"2024-03-16T07:27:23.260067+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:48:33.079226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.265199+0000","last_change":"2024-03-16T07:27:22.280054+0000","last_active":"2024-03-16T07:27:23.265199+0000","last_peered":"2024-03-16T07:27:23.265199+0000","last_clean":"2024-03-16T07:27:23.265199+0000","last_became_active":"2024-03-16T07:27:22.279819+0000","last_became_peered":"2024-03-16T07:27:22.279819+0000","last_unstale":"2024-03-16T07:27:23.265199+0000","last_undegraded":"2024-03-16T07:27:23.265199+0000","last_fullsized":"2024-03-16T07:27:23.265199+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_clean_scrub_stamp":"2024-03-16T07:27:21.241337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:54:25.344109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":20,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.269208+0000","last_change":"2024-03-16T07:27:08.917968+0000","last_active":"2024-03-16T07:27:23.269208+0000","last_peered":"2024-03-16T07:27:23.269208+0000","last_clean":"2024-03-16T07:27:23.269208+0000","last_became_active":"2024-03-16T07:27:08.917728+0000","last_became_peered":"2024-03-16T07:27:08.917728+0000","last_unstale":"2024-03-16T07:27:23.269208+0000","last_undegraded":"2024-03-16T07:27:23.269208+0000","last_fullsized":"2024-03-16T07:27:23.269208+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:46:31.794919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.261597+0000","last_change":"2024-03-16T07:27:22.279744+0000","last_active":"2024-03-16T07:27:23.261597+0000","last_peered":"2024-03-16T07:27:23.261597+0000","last_clean":"2024-03-16T07:27:23.261597+0000","last_became_active":"2024-03-16T07:27:22.279520+0000","last_became_peered":"2024-03-16T07:27:22.279520+0000","last_unstale":"2024-03-16T07:27:23.261597+0000","last_undegraded":"2024-03-16T07:27:23.261597+0000","last_fullsized":"2024-03-16T07:27:23.261597+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_clean_scrub_stamp":"2024-03-16T07:27:21.241337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:08:14.295318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1d","version":"54'2","reported_seq":16,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.262180+0000","last_change":"2024-03-16T07:27:21.274518+0000","last_active":"2024-03-16T07:27:23.262180+0000","last_peered":"2024-03-16T07:27:23.262180+0000","last_clean":"2024-03-16T07:27:23.262180+0000","last_became_active":"2024-03-16T07:27:21.274268+0000","last_became_peered":"2024-03-16T07:27:21.274268+0000","last_unstale":"2024-03-16T07:27:23.262180+0000","last_undegraded":"2024-03-16T07:27:23.262180+0000","last_fullsized":"2024-03-16T07:27:23.262180+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:20.238871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:20.238871+0000","last_clean_scrub_stamp":"2024-03-16T07:27:20.238871+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:45:11.591639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":20,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.271194+0000","last_change":"2024-03-16T07:27:08.923456+0000","last_active":"2024-03-16T07:27:23.271194+0000","last_peered":"2024-03-16T07:27:23.271194+0000","last_clean":"2024-03-16T07:27:23.271194+0000","last_became_active":"2024-03-16T07:27:08.923199+0000","last_became_peered":"2024-03-16T07:27:08.923199+0000","last_unstale":"2024-03-16T07:27:23.271194+0000","last_undegraded":"2024-03-16T07:27:23.271194+0000","last_fullsized":"2024-03-16T07:27:23.271194+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:35:05.623171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"50'4","reported_seq":26,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.270602+0000","last_change":"2024-03-16T07:27:08.238783+0000","last_active":"2024-03-16T07:27:23.270602+0000","last_peered":"2024-03-16T07:27:23.270602+0000","last_clean":"2024-03-16T07:27:23.270602+0000","last_became_active":"2024-03-16T07:27:08.238514+0000","last_became_peered":"2024-03-16T07:27:08.238514+0000","last_unstale":"2024-03-16T07:27:23.270602+0000","last_undegraded":"2024-03-16T07:27:23.270602+0000","last_fullsized":"2024-03-16T07:27:23.270602+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_clean_scrub_stamp":"2024-03-16T07:27:07.221025+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:50:54.465358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.266124+0000","last_change":"2024-03-16T07:27:22.281324+0000","last_active":"2024-03-16T07:27:23.266124+0000","last_peered":"2024-03-16T07:27:23.266124+0000","last_clean":"2024-03-16T07:27:23.266124+0000","last_became_active":"2024-03-16T07:27:22.281111+0000","last_became_peered":"2024-03-16T07:27:22.281111+0000","last_unstale":"2024-03-16T07:27:23.266124+0000","last_undegraded":"2024-03-16T07:27:23.266124+0000","last_fullsized":"2024-03-16T07:27:23.266124+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_clean_scrub_stamp":"2024-03-16T07:27:21.241337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:50:10.293053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1c","version":"54'2","reported_seq":16,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.261764+0000","last_change":"2024-03-16T07:27:21.275728+0000","last_active":"2024-03-16T07:27:23.261764+0000","last_peered":"2024-03-16T07:27:23.261764+0000","last_clean":"2024-03-16T07:27:23.261764+0000","last_became_active":"2024-03-16T07:27:21.275460+0000","last_became_peered":"2024-03-16T07:27:21.275460+0000","last_unstale":"2024-03-16T07:27:23.261764+0000","last_undegraded":"2024-03-16T07:27:23.261764+0000","last_fullsized":"2024-03-16T07:27:23.261764+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:20.238871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:20.238871+0000","last_clean_scrub_stamp":"2024-03-16T07:27:20.238871+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:23:02.151831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":20,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.267840+0000","last_change":"2024-03-16T07:27:08.927216+0000","last_active":"2024-03-16T07:27:23.267840+0000","last_peered":"2024-03-16T07:27:23.267840+0000","last_clean":"2024-03-16T07:27:23.267840+0000","last_became_active":"2024-03-16T07:27:08.926974+0000","last_became_peered":"2024-03-16T07:27:08.926974+0000","last_unstale":"2024-03-16T07:27:23.267840+0000","last_undegraded":"2024-03-16T07:27:23.267840+0000","last_fullsized":"2024-03-16T07:27:23.267840+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:18:39.970785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"50'1","reported_seq":23,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.266258+0000","last_change":"2024-03-16T07:27:08.243342+0000","last_active":"2024-03-16T07:27:23.266258+0000","last_peered":"2024-03-16T07:27:23.266258+0000","last_clean":"2024-03-16T07:27:23.266258+0000","last_became_active":"2024-03-16T07:27:08.243089+0000","last_became_peered":"2024-03-16T07:27:08.243089+0000","last_unstale":"2024-03-16T07:27:23.266258+0000","last_undegraded":"2024-03-16T07:27:23.266258+0000","last_fullsized":"2024-03-16T07:27:23.266258+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_clean_scrub_stamp":"2024-03-16T07:27:07.221025+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:24:56.759854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.262800+0000","last_change":"2024-03-16T07:27:22.283534+0000","last_active":"2024-03-16T07:27:23.262800+0000","last_peered":"2024-03-16T07:27:23.262800+0000","last_clean":"2024-03-16T07:27:23.262800+0000","last_became_active":"2024-03-16T07:27:22.283306+0000","last_became_peered":"2024-03-16T07:27:22.283306+0000","last_unstale":"2024-03-16T07:27:23.262800+0000","last_undegraded":"2024-03-16T07:27:23.262800+0000","last_fullsized":"2024-03-16T07:27:23.262800+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_clean_scrub_stamp":"2024-03-16T07:27:21.241337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:14:08.587828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1f","version":"54'4","reported_seq":18,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.264202+0000","last_change":"2024-03-16T07:27:21.275772+0000","last_active":"2024-03-16T07:27:23.264202+0000","last_peered":"2024-03-16T07:27:23.264202+0000","last_clean":"2024-03-16T07:27:23.264202+0000","last_became_active":"2024-03-16T07:27:21.275507+0000","last_became_peered":"2024-03-16T07:27:21.275507+0000","last_unstale":"2024-03-16T07:27:23.264202+0000","last_undegraded":"2024-03-16T07:27:23.264202+0000","last_fullsized":"2024-03-16T07:27:23.264202+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:20.238871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:20.238871+0000","last_clean_scrub_stamp":"2024-03-16T07:27:20.238871+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:12:46.157621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":20,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.273302+0000","last_change":"2024-03-16T07:27:08.920357+0000","last_active":"2024-03-16T07:27:23.273302+0000","last_peered":"2024-03-16T07:27:23.273302+0000","last_clean":"2024-03-16T07:27:23.273302+0000","last_became_active":"2024-03-16T07:27:08.920136+0000","last_became_peered":"2024-03-16T07:27:08.920136+0000","last_unstale":"2024-03-16T07:27:23.273302+0000","last_undegraded":"2024-03-16T07:27:23.273302+0000","last_fullsized":"2024-03-16T07:27:23.273302+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:33:57.962534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"50'2","reported_seq":24,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.273239+0000","last_change":"2024-03-16T07:27:08.238987+0000","last_active":"2024-03-16T07:27:23.273239+0000","last_peered":"2024-03-16T07:27:23.273239+0000","last_clean":"2024-03-16T07:27:23.273239+0000","last_became_active":"2024-03-16T07:27:08.238719+0000","last_became_peered":"2024-03-16T07:27:08.238719+0000","last_unstale":"2024-03-16T07:27:23.273239+0000","last_undegraded":"2024-03-16T07:27:23.273239+0000","last_fullsized":"2024-03-16T07:27:23.273239+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_clean_scrub_stamp":"2024-03-16T07:27:07.221025+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:41:53.144945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.263633+0000","last_change":"2024-03-16T07:27:22.268781+0000","last_active":"2024-03-16T07:27:23.263633+0000","last_peered":"2024-03-16T07:27:23.263633+0000","last_clean":"2024-03-16T07:27:23.263633+0000","last_became_active":"2024-03-16T07:27:22.268322+0000","last_became_peered":"2024-03-16T07:27:22.268322+0000","last_unstale":"2024-03-16T07:27:23.263633+0000","last_undegraded":"2024-03-16T07:27:23.263633+0000","last_fullsized":"2024-03-16T07:27:23.263633+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_clean_scrub_stamp":"2024-03-16T07:27:21.241337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:35:49.735931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"54'1","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.269932+0000","last_change":"2024-03-16T07:27:21.271493+0000","last_active":"2024-03-16T07:27:23.269932+0000","last_peered":"2024-03-16T07:27:23.269932+0000","last_clean":"2024-03-16T07:27:23.269932+0000","last_became_active":"2024-03-16T07:27:21.271067+0000","last_became_peered":"2024-03-16T07:27:21.271067+0000","last_unstale":"2024-03-16T07:27:23.269932+0000","last_undegraded":"2024-03-16T07:27:23.269932+0000","last_fullsized":"2024-03-16T07:27:23.269932+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:20.238871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:20.238871+0000","last_clean_scrub_stamp":"2024-03-16T07:27:20.238871+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:25:12.594192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":20,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.270265+0000","last_change":"2024-03-16T07:27:08.919220+0000","last_active":"2024-03-16T07:27:23.270265+0000","last_peered":"2024-03-16T07:27:23.270265+0000","last_clean":"2024-03-16T07:27:23.270265+0000","last_became_active":"2024-03-16T07:27:08.918442+0000","last_became_peered":"2024-03-16T07:27:08.918442+0000","last_unstale":"2024-03-16T07:27:23.270265+0000","last_undegraded":"2024-03-16T07:27:23.270265+0000","last_fullsized":"2024-03-16T07:27:23.270265+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:06:48.731712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"50'2","reported_seq":24,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.262319+0000","last_change":"2024-03-16T07:27:08.251673+0000","last_active":"2024-03-16T07:27:23.262319+0000","last_peered":"2024-03-16T07:27:23.262319+0000","last_clean":"2024-03-16T07:27:23.262319+0000","last_became_active":"2024-03-16T07:27:08.251104+0000","last_became_peered":"2024-03-16T07:27:08.251104+0000","last_unstale":"2024-03-16T07:27:23.262319+0000","last_undegraded":"2024-03-16T07:27:23.262319+0000","last_fullsized":"2024-03-16T07:27:23.262319+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_clean_scrub_stamp":"2024-03-16T07:27:07.221025+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:49:03.362326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.259647+0000","last_change":"2024-03-16T07:27:22.266291+0000","last_active":"2024-03-16T07:27:23.259647+0000","last_peered":"2024-03-16T07:27:23.259647+0000","last_clean":"2024-03-16T07:27:23.259647+0000","last_became_active":"2024-03-16T07:27:22.264299+0000","last_became_peered":"2024-03-16T07:27:22.264299+0000","last_unstale":"2024-03-16T07:27:23.259647+0000","last_undegraded":"2024-03-16T07:27:23.259647+0000","last_fullsized":"2024-03-16T07:27:23.259647+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_clean_scrub_stamp":"2024-03-16T07:27:21.241337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:16:19.023929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.265107+0000","last_change":"2024-03-16T07:27:21.262820+0000","last_active":"2024-03-16T07:27:23.265107+0000","last_peered":"2024-03-16T07:27:23.265107+0000","last_clean":"2024-03-16T07:27:23.265107+0000","last_became_active":"2024-03-16T07:27:21.262567+0000","last_became_peered":"2024-03-16T07:27:21.262567+0000","last_unstale":"2024-03-16T07:27:23.265107+0000","last_undegraded":"2024-03-16T07:27:23.265107+0000","last_fullsized":"2024-03-16T07:27:23.265107+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:20.238871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:20.238871+0000","last_clean_scrub_stamp":"2024-03-16T07:27:20.238871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:39:57.514475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":20,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.265746+0000","last_change":"2024-03-16T07:27:08.928496+0000","last_active":"2024-03-16T07:27:23.265746+0000","last_peered":"2024-03-16T07:27:23.265746+0000","last_clean":"2024-03-16T07:27:23.265746+0000","last_became_active":"2024-03-16T07:27:08.927127+0000","last_became_peered":"2024-03-16T07:27:08.927127+0000","last_unstale":"2024-03-16T07:27:23.265746+0000","last_undegraded":"2024-03-16T07:27:23.265746+0000","last_fullsized":"2024-03-16T07:27:23.265746+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:17:26.002153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1b","version":"50'1","reported_seq":23,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.261808+0000","last_change":"2024-03-16T07:27:08.250216+0000","last_active":"2024-03-16T07:27:23.261808+0000","last_peered":"2024-03-16T07:27:23.261808+0000","last_clean":"2024-03-16T07:27:23.261808+0000","last_became_active":"2024-03-16T07:27:08.249406+0000","last_became_peered":"2024-03-16T07:27:08.249406+0000","last_unstale":"2024-03-16T07:27:23.261808+0000","last_undegraded":"2024-03-16T07:27:23.261808+0000","last_fullsized":"2024-03-16T07:27:23.261808+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_clean_scrub_stamp":"2024-03-16T07:27:07.221025+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:47:11.940256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.269043+0000","last_change":"2024-03-16T07:27:22.277190+0000","last_active":"2024-03-16T07:27:23.269043+0000","last_peered":"2024-03-16T07:27:23.269043+0000","last_clean":"2024-03-16T07:27:23.269043+0000","last_became_active":"2024-03-16T07:27:22.276763+0000","last_became_peered":"2024-03-16T07:27:22.276763+0000","last_unstale":"2024-03-16T07:27:23.269043+0000","last_undegraded":"2024-03-16T07:27:23.269043+0000","last_fullsized":"2024-03-16T07:27:23.269043+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_clean_scrub_stamp":"2024-03-16T07:27:21.241337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:55:10.421646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.259968+0000","last_change":"2024-03-16T07:27:21.275113+0000","last_active":"2024-03-16T07:27:23.259968+0000","last_peered":"2024-03-16T07:27:23.259968+0000","last_clean":"2024-03-16T07:27:23.259968+0000","last_became_active":"2024-03-16T07:27:21.274876+0000","last_became_peered":"2024-03-16T07:27:21.274876+0000","last_unstale":"2024-03-16T07:27:23.259968+0000","last_undegraded":"2024-03-16T07:27:23.259968+0000","last_fullsized":"2024-03-16T07:27:23.259968+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:20.238871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:20.238871+0000","last_clean_scrub_stamp":"2024-03-16T07:27:20.238871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:22:56.730540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":20,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.270835+0000","last_change":"2024-03-16T07:27:08.921380+0000","last_active":"2024-03-16T07:27:23.270835+0000","last_peered":"2024-03-16T07:27:23.270835+0000","last_clean":"2024-03-16T07:27:23.270835+0000","last_became_active":"2024-03-16T07:27:08.917937+0000","last_became_peered":"2024-03-16T07:27:08.917937+0000","last_unstale":"2024-03-16T07:27:23.270835+0000","last_undegraded":"2024-03-16T07:27:23.270835+0000","last_fullsized":"2024-03-16T07:27:23.270835+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:06:00.210759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1a","version":"50'1","reported_seq":23,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.271126+0000","last_change":"2024-03-16T07:27:08.245016+0000","last_active":"2024-03-16T07:27:23.271126+0000","last_peered":"2024-03-16T07:27:23.271126+0000","last_clean":"2024-03-16T07:27:23.271126+0000","last_became_active":"2024-03-16T07:27:08.243158+0000","last_became_peered":"2024-03-16T07:27:08.243158+0000","last_unstale":"2024-03-16T07:27:23.271126+0000","last_undegraded":"2024-03-16T07:27:23.271126+0000","last_fullsized":"2024-03-16T07:27:23.271126+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_clean_scrub_stamp":"2024-03-16T07:27:07.221025+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:57:34.038940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.260122+0000","last_change":"2024-03-16T07:27:22.274833+0000","last_active":"2024-03-16T07:27:23.260122+0000","last_peered":"2024-03-16T07:27:23.260122+0000","last_clean":"2024-03-16T07:27:23.260122+0000","last_became_active":"2024-03-16T07:27:22.274411+0000","last_became_peered":"2024-03-16T07:27:22.274411+0000","last_unstale":"2024-03-16T07:27:23.260122+0000","last_undegraded":"2024-03-16T07:27:23.260122+0000","last_fullsized":"2024-03-16T07:27:23.260122+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_clean_scrub_stamp":"2024-03-16T07:27:21.241337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:35:08.279783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1b","version":"54'1","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.260641+0000","last_change":"2024-03-16T07:27:21.275027+0000","last_active":"2024-03-16T07:27:23.260641+0000","last_peered":"2024-03-16T07:27:23.260641+0000","last_clean":"2024-03-16T07:27:23.260641+0000","last_became_active":"2024-03-16T07:27:21.274747+0000","last_became_peered":"2024-03-16T07:27:21.274747+0000","last_unstale":"2024-03-16T07:27:23.260641+0000","last_undegraded":"2024-03-16T07:27:23.260641+0000","last_fullsized":"2024-03-16T07:27:23.260641+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:20.238871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:20.238871+0000","last_clean_scrub_stamp":"2024-03-16T07:27:20.238871+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:46:43.811611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":20,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.260330+0000","last_change":"2024-03-16T07:27:08.931567+0000","last_active":"2024-03-16T07:27:23.260330+0000","last_peered":"2024-03-16T07:27:23.260330+0000","last_clean":"2024-03-16T07:27:23.260330+0000","last_became_active":"2024-03-16T07:27:08.929182+0000","last_became_peered":"2024-03-16T07:27:08.929182+0000","last_unstale":"2024-03-16T07:27:23.260330+0000","last_undegraded":"2024-03-16T07:27:23.260330+0000","last_fullsized":"2024-03-16T07:27:23.260330+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:17:26.002153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":22,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.265261+0000","last_change":"2024-03-16T07:27:08.245798+0000","last_active":"2024-03-16T07:27:23.265261+0000","last_peered":"2024-03-16T07:27:23.265261+0000","last_clean":"2024-03-16T07:27:23.265261+0000","last_became_active":"2024-03-16T07:27:08.245428+0000","last_became_peered":"2024-03-16T07:27:08.245428+0000","last_unstale":"2024-03-16T07:27:23.265261+0000","last_undegraded":"2024-03-16T07:27:23.265261+0000","last_fullsized":"2024-03-16T07:27:23.265261+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_clean_scrub_stamp":"2024-03-16T07:27:07.221025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:04:40.243410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.260343+0000","last_change":"2024-03-16T07:27:22.269788+0000","last_active":"2024-03-16T07:27:23.260343+0000","last_peered":"2024-03-16T07:27:23.260343+0000","last_clean":"2024-03-16T07:27:23.260343+0000","last_became_active":"2024-03-16T07:27:22.269288+0000","last_became_peered":"2024-03-16T07:27:22.269288+0000","last_unstale":"2024-03-16T07:27:23.260343+0000","last_undegraded":"2024-03-16T07:27:23.260343+0000","last_fullsized":"2024-03-16T07:27:23.260343+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_clean_scrub_stamp":"2024-03-16T07:27:21.241337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:56:09.622158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1a","version":"54'1","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.265465+0000","last_change":"2024-03-16T07:27:21.265488+0000","last_active":"2024-03-16T07:27:23.265465+0000","last_peered":"2024-03-16T07:27:23.265465+0000","last_clean":"2024-03-16T07:27:23.265465+0000","last_became_active":"2024-03-16T07:27:21.265246+0000","last_became_peered":"2024-03-16T07:27:21.265246+0000","last_unstale":"2024-03-16T07:27:23.265465+0000","last_undegraded":"2024-03-16T07:27:23.265465+0000","last_fullsized":"2024-03-16T07:27:23.265465+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:20.238871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:20.238871+0000","last_clean_scrub_stamp":"2024-03-16T07:27:20.238871+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:42:27.591646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":20,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.260170+0000","last_change":"2024-03-16T07:27:08.929543+0000","last_active":"2024-03-16T07:27:23.260170+0000","last_peered":"2024-03-16T07:27:23.260170+0000","last_clean":"2024-03-16T07:27:23.260170+0000","last_became_active":"2024-03-16T07:27:08.929296+0000","last_became_peered":"2024-03-16T07:27:08.929296+0000","last_unstale":"2024-03-16T07:27:23.260170+0000","last_undegraded":"2024-03-16T07:27:23.260170+0000","last_fullsized":"2024-03-16T07:27:23.260170+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:07:05.838425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":22,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.269096+0000","last_change":"2024-03-16T07:27:08.244309+0000","last_active":"2024-03-16T07:27:23.269096+0000","last_peered":"2024-03-16T07:27:23.269096+0000","last_clean":"2024-03-16T07:27:23.269096+0000","last_became_active":"2024-03-16T07:27:08.244038+0000","last_became_peered":"2024-03-16T07:27:08.244038+0000","last_unstale":"2024-03-16T07:27:23.269096+0000","last_undegraded":"2024-03-16T07:27:23.269096+0000","last_fullsized":"2024-03-16T07:27:23.269096+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_clean_scrub_stamp":"2024-03-16T07:27:07.221025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:19:01.607856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.270929+0000","last_change":"2024-03-16T07:27:22.276148+0000","last_active":"2024-03-16T07:27:23.270929+0000","last_peered":"2024-03-16T07:27:23.270929+0000","last_clean":"2024-03-16T07:27:23.270929+0000","last_became_active":"2024-03-16T07:27:22.275898+0000","last_became_peered":"2024-03-16T07:27:22.275898+0000","last_unstale":"2024-03-16T07:27:23.270929+0000","last_undegraded":"2024-03-16T07:27:23.270929+0000","last_fullsized":"2024-03-16T07:27:23.270929+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_clean_scrub_stamp":"2024-03-16T07:27:21.241337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:06:54.594481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.15","version":"54'3","reported_seq":17,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.269817+0000","last_change":"2024-03-16T07:27:21.272649+0000","last_active":"2024-03-16T07:27:23.269817+0000","last_peered":"2024-03-16T07:27:23.269817+0000","last_clean":"2024-03-16T07:27:23.269817+0000","last_became_active":"2024-03-16T07:27:21.272346+0000","last_became_peered":"2024-03-16T07:27:21.272346+0000","last_unstale":"2024-03-16T07:27:23.269817+0000","last_undegraded":"2024-03-16T07:27:23.269817+0000","last_fullsized":"2024-03-16T07:27:23.269817+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:20.238871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:20.238871+0000","last_clean_scrub_stamp":"2024-03-16T07:27:20.238871+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:36:41.885605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":20,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.273082+0000","last_change":"2024-03-16T07:27:08.923413+0000","last_active":"2024-03-16T07:27:23.273082+0000","last_peered":"2024-03-16T07:27:23.273082+0000","last_clean":"2024-03-16T07:27:23.273082+0000","last_became_active":"2024-03-16T07:27:08.922819+0000","last_became_peered":"2024-03-16T07:27:08.922819+0000","last_unstale":"2024-03-16T07:27:23.273082+0000","last_undegraded":"2024-03-16T07:27:23.273082+0000","last_fullsized":"2024-03-16T07:27:23.273082+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:32:23.519806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":22,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.267996+0000","last_change":"2024-03-16T07:27:08.245187+0000","last_active":"2024-03-16T07:27:23.267996+0000","last_peered":"2024-03-16T07:27:23.267996+0000","last_clean":"2024-03-16T07:27:23.267996+0000","last_became_active":"2024-03-16T07:27:08.244487+0000","last_became_peered":"2024-03-16T07:27:08.244487+0000","last_unstale":"2024-03-16T07:27:23.267996+0000","last_undegraded":"2024-03-16T07:27:23.267996+0000","last_fullsized":"2024-03-16T07:27:23.267996+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_clean_scrub_stamp":"2024-03-16T07:27:07.221025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:49:03.362326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.261960+0000","last_change":"2024-03-16T07:27:22.268572+0000","last_active":"2024-03-16T07:27:23.261960+0000","last_peered":"2024-03-16T07:27:23.261960+0000","last_clean":"2024-03-16T07:27:23.261960+0000","last_became_active":"2024-03-16T07:27:22.267573+0000","last_became_peered":"2024-03-16T07:27:22.267573+0000","last_unstale":"2024-03-16T07:27:23.261960+0000","last_undegraded":"2024-03-16T07:27:23.261960+0000","last_fullsized":"2024-03-16T07:27:23.261960+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_clean_scrub_stamp":"2024-03-16T07:27:21.241337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:09:35.022955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"54'6","reported_seq":20,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.267112+0000","last_change":"2024-03-16T07:27:21.269957+0000","last_active":"2024-03-16T07:27:23.267112+0000","last_peered":"2024-03-16T07:27:23.267112+0000","last_clean":"2024-03-16T07:27:23.267112+0000","last_became_active":"2024-03-16T07:27:21.269654+0000","last_became_peered":"2024-03-16T07:27:21.269654+0000","last_unstale":"2024-03-16T07:27:23.267112+0000","last_undegraded":"2024-03-16T07:27:23.267112+0000","last_fullsized":"2024-03-16T07:27:23.267112+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:20.238871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:20.238871+0000","last_clean_scrub_stamp":"2024-03-16T07:27:20.238871+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:23:02.151831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":20,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.263966+0000","last_change":"2024-03-16T07:27:08.931465+0000","last_active":"2024-03-16T07:27:23.263966+0000","last_peered":"2024-03-16T07:27:23.263966+0000","last_clean":"2024-03-16T07:27:23.263966+0000","last_became_active":"2024-03-16T07:27:08.930807+0000","last_became_peered":"2024-03-16T07:27:08.930807+0000","last_unstale":"2024-03-16T07:27:23.263966+0000","last_undegraded":"2024-03-16T07:27:23.263966+0000","last_fullsized":"2024-03-16T07:27:23.263966+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:40:24.475299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":22,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.266351+0000","last_change":"2024-03-16T07:27:08.247276+0000","last_active":"2024-03-16T07:27:23.266351+0000","last_peered":"2024-03-16T07:27:23.266351+0000","last_clean":"2024-03-16T07:27:23.266351+0000","last_became_active":"2024-03-16T07:27:08.246996+0000","last_became_peered":"2024-03-16T07:27:08.246996+0000","last_unstale":"2024-03-16T07:27:23.266351+0000","last_undegraded":"2024-03-16T07:27:23.266351+0000","last_fullsized":"2024-03-16T07:27:23.266351+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_clean_scrub_stamp":"2024-03-16T07:27:07.221025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:16:31.977141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.265874+0000","last_change":"2024-03-16T07:27:22.279144+0000","last_active":"2024-03-16T07:27:23.265874+0000","last_peered":"2024-03-16T07:27:23.265874+0000","last_clean":"2024-03-16T07:27:23.265874+0000","last_became_active":"2024-03-16T07:27:22.278898+0000","last_became_peered":"2024-03-16T07:27:22.278898+0000","last_unstale":"2024-03-16T07:27:23.265874+0000","last_undegraded":"2024-03-16T07:27:23.265874+0000","last_fullsized":"2024-03-16T07:27:23.265874+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_clean_scrub_stamp":"2024-03-16T07:27:21.241337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:01:49.721586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.270006+0000","last_change":"2024-03-16T07:27:21.262798+0000","last_active":"2024-03-16T07:27:23.270006+0000","last_peered":"2024-03-16T07:27:23.270006+0000","last_clean":"2024-03-16T07:27:23.270006+0000","last_became_active":"2024-03-16T07:27:21.262521+0000","last_became_peered":"2024-03-16T07:27:21.262521+0000","last_unstale":"2024-03-16T07:27:23.270006+0000","last_undegraded":"2024-03-16T07:27:23.270006+0000","last_fullsized":"2024-03-16T07:27:23.270006+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:20.238871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:20.238871+0000","last_clean_scrub_stamp":"2024-03-16T07:27:20.238871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:11:10.161545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":20,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.267683+0000","last_change":"2024-03-16T07:27:08.927907+0000","last_active":"2024-03-16T07:27:23.267683+0000","last_peered":"2024-03-16T07:27:23.267683+0000","last_clean":"2024-03-16T07:27:23.267683+0000","last_became_active":"2024-03-16T07:27:08.927028+0000","last_became_peered":"2024-03-16T07:27:08.927028+0000","last_unstale":"2024-03-16T07:27:23.267683+0000","last_undegraded":"2024-03-16T07:27:23.267683+0000","last_fullsized":"2024-03-16T07:27:23.267683+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:49:16.398980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"50'3","reported_seq":25,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.262090+0000","last_change":"2024-03-16T07:27:08.251102+0000","last_active":"2024-03-16T07:27:23.262090+0000","last_peered":"2024-03-16T07:27:23.262090+0000","last_clean":"2024-03-16T07:27:23.262090+0000","last_became_active":"2024-03-16T07:27:08.250854+0000","last_became_peered":"2024-03-16T07:27:08.250854+0000","last_unstale":"2024-03-16T07:27:23.262090+0000","last_undegraded":"2024-03-16T07:27:23.262090+0000","last_fullsized":"2024-03-16T07:27:23.262090+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_clean_scrub_stamp":"2024-03-16T07:27:07.221025+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:24:56.759854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.269912+0000","last_change":"2024-03-16T07:27:22.282996+0000","last_active":"2024-03-16T07:27:23.269912+0000","last_peered":"2024-03-16T07:27:23.269912+0000","last_clean":"2024-03-16T07:27:23.269912+0000","last_became_active":"2024-03-16T07:27:22.282763+0000","last_became_peered":"2024-03-16T07:27:22.282763+0000","last_unstale":"2024-03-16T07:27:23.269912+0000","last_undegraded":"2024-03-16T07:27:23.269912+0000","last_fullsized":"2024-03-16T07:27:23.269912+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_clean_scrub_stamp":"2024-03-16T07:27:21.241337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:48:45.075561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.271238+0000","last_change":"2024-03-16T07:27:21.267334+0000","last_active":"2024-03-16T07:27:23.271238+0000","last_peered":"2024-03-16T07:27:23.271238+0000","last_clean":"2024-03-16T07:27:23.271238+0000","last_became_active":"2024-03-16T07:27:21.266070+0000","last_became_peered":"2024-03-16T07:27:21.266070+0000","last_unstale":"2024-03-16T07:27:23.271238+0000","last_undegraded":"2024-03-16T07:27:23.271238+0000","last_fullsized":"2024-03-16T07:27:23.271238+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:20.238871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:20.238871+0000","last_clean_scrub_stamp":"2024-03-16T07:27:20.238871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:02:57.995226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":20,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.266667+0000","last_change":"2024-03-16T07:27:08.921393+0000","last_active":"2024-03-16T07:27:23.266667+0000","last_peered":"2024-03-16T07:27:23.266667+0000","last_clean":"2024-03-16T07:27:23.266667+0000","last_became_active":"2024-03-16T07:27:08.921149+0000","last_became_peered":"2024-03-16T07:27:08.921149+0000","last_unstale":"2024-03-16T07:27:23.266667+0000","last_undegraded":"2024-03-16T07:27:23.266667+0000","last_fullsized":"2024-03-16T07:27:23.266667+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:54:49.472480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.14","version":"51'8","reported_seq":30,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.273356+0000","last_change":"2024-03-16T07:27:08.244864+0000","last_active":"2024-03-16T07:27:23.273356+0000","last_peered":"2024-03-16T07:27:23.273356+0000","last_clean":"2024-03-16T07:27:23.273356+0000","last_became_active":"2024-03-16T07:27:08.244060+0000","last_became_peered":"2024-03-16T07:27:08.244060+0000","last_unstale":"2024-03-16T07:27:23.273356+0000","last_undegraded":"2024-03-16T07:27:23.273356+0000","last_fullsized":"2024-03-16T07:27:23.273356+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_clean_scrub_stamp":"2024-03-16T07:27:07.221025+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:54:48.471326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3309,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.268951+0000","last_change":"2024-03-16T07:27:22.289567+0000","last_active":"2024-03-16T07:27:23.268951+0000","last_peered":"2024-03-16T07:27:23.268951+0000","last_clean":"2024-03-16T07:27:23.268951+0000","last_became_active":"2024-03-16T07:27:22.289088+0000","last_became_peered":"2024-03-16T07:27:22.289088+0000","last_unstale":"2024-03-16T07:27:23.268951+0000","last_undegraded":"2024-03-16T07:27:23.268951+0000","last_fullsized":"2024-03-16T07:27:23.268951+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_clean_scrub_stamp":"2024-03-16T07:27:21.241337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:00:49.446594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.265197+0000","last_change":"2024-03-16T07:27:21.263582+0000","last_active":"2024-03-16T07:27:23.265197+0000","last_peered":"2024-03-16T07:27:23.265197+0000","last_clean":"2024-03-16T07:27:23.265197+0000","last_became_active":"2024-03-16T07:27:21.263335+0000","last_became_peered":"2024-03-16T07:27:21.263335+0000","last_unstale":"2024-03-16T07:27:23.265197+0000","last_undegraded":"2024-03-16T07:27:23.265197+0000","last_fullsized":"2024-03-16T07:27:23.265197+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:20.238871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:20.238871+0000","last_clean_scrub_stamp":"2024-03-16T07:27:20.238871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:21:02.734620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":20,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.265638+0000","last_change":"2024-03-16T07:27:08.928325+0000","last_active":"2024-03-16T07:27:23.265638+0000","last_peered":"2024-03-16T07:27:23.265638+0000","last_clean":"2024-03-16T07:27:23.265638+0000","last_became_active":"2024-03-16T07:27:08.927710+0000","last_became_peered":"2024-03-16T07:27:08.927710+0000","last_unstale":"2024-03-16T07:27:23.265638+0000","last_undegraded":"2024-03-16T07:27:23.265638+0000","last_fullsized":"2024-03-16T07:27:23.265638+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:26:36.937904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"50'2","reported_seq":24,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.267539+0000","last_change":"2024-03-16T07:27:08.246435+0000","last_active":"2024-03-16T07:27:23.267539+0000","last_peered":"2024-03-16T07:27:23.267539+0000","last_clean":"2024-03-16T07:27:23.267539+0000","last_became_active":"2024-03-16T07:27:08.246149+0000","last_became_peered":"2024-03-16T07:27:08.246149+0000","last_unstale":"2024-03-16T07:27:23.267539+0000","last_undegraded":"2024-03-16T07:27:23.267539+0000","last_fullsized":"2024-03-16T07:27:23.267539+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_clean_scrub_stamp":"2024-03-16T07:27:07.221025+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:37:36.164804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.259864+0000","last_change":"2024-03-16T07:27:22.278437+0000","last_active":"2024-03-16T07:27:23.259864+0000","last_peered":"2024-03-16T07:27:23.259864+0000","last_clean":"2024-03-16T07:27:23.259864+0000","last_became_active":"2024-03-16T07:27:22.278151+0000","last_became_peered":"2024-03-16T07:27:22.278151+0000","last_unstale":"2024-03-16T07:27:23.259864+0000","last_undegraded":"2024-03-16T07:27:23.259864+0000","last_fullsized":"2024-03-16T07:27:23.259864+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_clean_scrub_stamp":"2024-03-16T07:27:21.241337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:14:13.471869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"54'8","reported_seq":22,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.266052+0000","last_change":"2024-03-16T07:27:21.269333+0000","last_active":"2024-03-16T07:27:23.266052+0000","last_peered":"2024-03-16T07:27:23.266052+0000","last_clean":"2024-03-16T07:27:23.266052+0000","last_became_active":"2024-03-16T07:27:21.269100+0000","last_became_peered":"2024-03-16T07:27:21.269100+0000","last_unstale":"2024-03-16T07:27:23.266052+0000","last_undegraded":"2024-03-16T07:27:23.266052+0000","last_fullsized":"2024-03-16T07:27:23.266052+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:20.238871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:20.238871+0000","last_clean_scrub_stamp":"2024-03-16T07:27:20.238871+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:40:46.965407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":20,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.261583+0000","last_change":"2024-03-16T07:27:08.931009+0000","last_active":"2024-03-16T07:27:23.261583+0000","last_peered":"2024-03-16T07:27:23.261583+0000","last_clean":"2024-03-16T07:27:23.261583+0000","last_became_active":"2024-03-16T07:27:08.930682+0000","last_became_peered":"2024-03-16T07:27:08.930682+0000","last_unstale":"2024-03-16T07:27:23.261583+0000","last_undegraded":"2024-03-16T07:27:23.261583+0000","last_fullsized":"2024-03-16T07:27:23.261583+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:20:23.064044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":22,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.261192+0000","last_change":"2024-03-16T07:27:08.249638+0000","last_active":"2024-03-16T07:27:23.261192+0000","last_peered":"2024-03-16T07:27:23.261192+0000","last_clean":"2024-03-16T07:27:23.261192+0000","last_became_active":"2024-03-16T07:27:08.249343+0000","last_became_peered":"2024-03-16T07:27:08.249343+0000","last_unstale":"2024-03-16T07:27:23.261192+0000","last_undegraded":"2024-03-16T07:27:23.261192+0000","last_fullsized":"2024-03-16T07:27:23.261192+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_clean_scrub_stamp":"2024-03-16T07:27:07.221025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:47:23.821578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.260275+0000","last_change":"2024-03-16T07:27:22.280856+0000","last_active":"2024-03-16T07:27:23.260275+0000","last_peered":"2024-03-16T07:27:23.260275+0000","last_clean":"2024-03-16T07:27:23.260275+0000","last_became_active":"2024-03-16T07:27:22.275095+0000","last_became_peered":"2024-03-16T07:27:22.275095+0000","last_unstale":"2024-03-16T07:27:23.260275+0000","last_undegraded":"2024-03-16T07:27:23.260275+0000","last_fullsized":"2024-03-16T07:27:23.260275+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_clean_scrub_stamp":"2024-03-16T07:27:21.241337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:36:42.888071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.13","version":"54'2","reported_seq":16,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.267711+0000","last_change":"2024-03-16T07:27:21.265811+0000","last_active":"2024-03-16T07:27:23.267711+0000","last_peered":"2024-03-16T07:27:23.267711+0000","last_clean":"2024-03-16T07:27:23.267711+0000","last_became_active":"2024-03-16T07:27:21.265576+0000","last_became_peered":"2024-03-16T07:27:21.265576+0000","last_unstale":"2024-03-16T07:27:23.267711+0000","last_undegraded":"2024-03-16T07:27:23.267711+0000","last_fullsized":"2024-03-16T07:27:23.267711+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:20.238871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:20.238871+0000","last_clean_scrub_stamp":"2024-03-16T07:27:20.238871+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:31:04.745360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":20,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.266296+0000","last_change":"2024-03-16T07:27:08.923986+0000","last_active":"2024-03-16T07:27:23.266296+0000","last_peered":"2024-03-16T07:27:23.266296+0000","last_clean":"2024-03-16T07:27:23.266296+0000","last_became_active":"2024-03-16T07:27:08.922698+0000","last_became_peered":"2024-03-16T07:27:08.922698+0000","last_unstale":"2024-03-16T07:27:23.266296+0000","last_undegraded":"2024-03-16T07:27:23.266296+0000","last_fullsized":"2024-03-16T07:27:23.266296+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:48:33.079226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":22,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.260286+0000","last_change":"2024-03-16T07:27:08.250046+0000","last_active":"2024-03-16T07:27:23.260286+0000","last_peered":"2024-03-16T07:27:23.260286+0000","last_clean":"2024-03-16T07:27:23.260286+0000","last_became_active":"2024-03-16T07:27:08.249650+0000","last_became_peered":"2024-03-16T07:27:08.249650+0000","last_unstale":"2024-03-16T07:27:23.260286+0000","last_undegraded":"2024-03-16T07:27:23.260286+0000","last_fullsized":"2024-03-16T07:27:23.260286+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_clean_scrub_stamp":"2024-03-16T07:27:07.221025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:37:36.164804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.266761+0000","last_change":"2024-03-16T07:27:22.291589+0000","last_active":"2024-03-16T07:27:23.266761+0000","last_peered":"2024-03-16T07:27:23.266761+0000","last_clean":"2024-03-16T07:27:23.266761+0000","last_became_active":"2024-03-16T07:27:22.291322+0000","last_became_peered":"2024-03-16T07:27:22.291322+0000","last_unstale":"2024-03-16T07:27:23.266761+0000","last_undegraded":"2024-03-16T07:27:23.266761+0000","last_fullsized":"2024-03-16T07:27:23.266761+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_clean_scrub_stamp":"2024-03-16T07:27:21.241337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:16:19.023929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.265493+0000","last_change":"2024-03-16T07:27:21.269104+0000","last_active":"2024-03-16T07:27:23.265493+0000","last_peered":"2024-03-16T07:27:23.265493+0000","last_clean":"2024-03-16T07:27:23.265493+0000","last_became_active":"2024-03-16T07:27:21.268830+0000","last_became_peered":"2024-03-16T07:27:21.268830+0000","last_unstale":"2024-03-16T07:27:23.265493+0000","last_undegraded":"2024-03-16T07:27:23.265493+0000","last_fullsized":"2024-03-16T07:27:23.265493+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:20.238871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:20.238871+0000","last_clean_scrub_stamp":"2024-03-16T07:27:20.238871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:22:56.730540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":20,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.270584+0000","last_change":"2024-03-16T07:27:08.927562+0000","last_active":"2024-03-16T07:27:23.270584+0000","last_peered":"2024-03-16T07:27:23.270584+0000","last_clean":"2024-03-16T07:27:23.270584+0000","last_became_active":"2024-03-16T07:27:08.927206+0000","last_became_peered":"2024-03-16T07:27:08.927206+0000","last_unstale":"2024-03-16T07:27:23.270584+0000","last_undegraded":"2024-03-16T07:27:23.270584+0000","last_fullsized":"2024-03-16T07:27:23.270584+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:49:37.638362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"50'8","reported_seq":30,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.269089+0000","last_change":"2024-03-16T07:27:08.238193+0000","last_active":"2024-03-16T07:27:23.269089+0000","last_peered":"2024-03-16T07:27:23.269089+0000","last_clean":"2024-03-16T07:27:23.269089+0000","last_became_active":"2024-03-16T07:27:08.237926+0000","last_became_peered":"2024-03-16T07:27:08.237926+0000","last_unstale":"2024-03-16T07:27:23.269089+0000","last_undegraded":"2024-03-16T07:27:23.269089+0000","last_fullsized":"2024-03-16T07:27:23.269089+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_clean_scrub_stamp":"2024-03-16T07:27:07.221025+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:20:22.062889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.267019+0000","last_change":"2024-03-16T07:27:22.270109+0000","last_active":"2024-03-16T07:27:23.267019+0000","last_peered":"2024-03-16T07:27:23.267019+0000","last_clean":"2024-03-16T07:27:23.267019+0000","last_became_active":"2024-03-16T07:27:22.269865+0000","last_became_peered":"2024-03-16T07:27:22.269865+0000","last_unstale":"2024-03-16T07:27:23.267019+0000","last_undegraded":"2024-03-16T07:27:23.267019+0000","last_fullsized":"2024-03-16T07:27:23.267019+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_clean_scrub_stamp":"2024-03-16T07:27:21.241337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:55:00.744075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"54'1","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.269928+0000","last_change":"2024-03-16T07:27:21.269885+0000","last_active":"2024-03-16T07:27:23.269928+0000","last_peered":"2024-03-16T07:27:23.269928+0000","last_clean":"2024-03-16T07:27:23.269928+0000","last_became_active":"2024-03-16T07:27:21.269600+0000","last_became_peered":"2024-03-16T07:27:21.269600+0000","last_unstale":"2024-03-16T07:27:23.269928+0000","last_undegraded":"2024-03-16T07:27:23.269928+0000","last_fullsized":"2024-03-16T07:27:23.269928+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:20.238871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:20.238871+0000","last_clean_scrub_stamp":"2024-03-16T07:27:20.238871+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:56:08.619692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":20,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.263031+0000","last_change":"2024-03-16T07:27:08.930378+0000","last_active":"2024-03-16T07:27:23.263031+0000","last_peered":"2024-03-16T07:27:23.263031+0000","last_clean":"2024-03-16T07:27:23.263031+0000","last_became_active":"2024-03-16T07:27:08.929970+0000","last_became_peered":"2024-03-16T07:27:08.929970+0000","last_unstale":"2024-03-16T07:27:23.263031+0000","last_undegraded":"2024-03-16T07:27:23.263031+0000","last_fullsized":"2024-03-16T07:27:23.263031+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:18:39.970785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.f","version":"50'1","reported_seq":23,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.270611+0000","last_change":"2024-03-16T07:27:08.244995+0000","last_active":"2024-03-16T07:27:23.270611+0000","last_peered":"2024-03-16T07:27:23.270611+0000","last_clean":"2024-03-16T07:27:23.270611+0000","last_became_active":"2024-03-16T07:27:08.244700+0000","last_became_peered":"2024-03-16T07:27:08.244700+0000","last_unstale":"2024-03-16T07:27:23.270611+0000","last_undegraded":"2024-03-16T07:27:23.270611+0000","last_fullsized":"2024-03-16T07:27:23.270611+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_clean_scrub_stamp":"2024-03-16T07:27:07.221025+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:07:09.331421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.262041+0000","last_change":"2024-03-16T07:27:22.267153+0000","last_active":"2024-03-16T07:27:23.262041+0000","last_peered":"2024-03-16T07:27:23.262041+0000","last_clean":"2024-03-16T07:27:23.262041+0000","last_became_active":"2024-03-16T07:27:22.266913+0000","last_became_peered":"2024-03-16T07:27:22.266913+0000","last_unstale":"2024-03-16T07:27:23.262041+0000","last_undegraded":"2024-03-16T07:27:23.262041+0000","last_fullsized":"2024-03-16T07:27:23.262041+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_clean_scrub_stamp":"2024-03-16T07:27:21.241337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:44:32.771034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.261845+0000","last_change":"2024-03-16T07:27:21.275446+0000","last_active":"2024-03-16T07:27:23.261845+0000","last_peered":"2024-03-16T07:27:23.261845+0000","last_clean":"2024-03-16T07:27:23.261845+0000","last_became_active":"2024-03-16T07:27:21.275172+0000","last_became_peered":"2024-03-16T07:27:21.275172+0000","last_unstale":"2024-03-16T07:27:23.261845+0000","last_undegraded":"2024-03-16T07:27:23.261845+0000","last_fullsized":"2024-03-16T07:27:23.261845+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:20.238871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:20.238871+0000","last_clean_scrub_stamp":"2024-03-16T07:27:20.238871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:45:04.907341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":20,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.263892+0000","last_change":"2024-03-16T07:27:08.931661+0000","last_active":"2024-03-16T07:27:23.263892+0000","last_peered":"2024-03-16T07:27:23.263892+0000","last_clean":"2024-03-16T07:27:23.263892+0000","last_became_active":"2024-03-16T07:27:08.931137+0000","last_became_peered":"2024-03-16T07:27:08.931137+0000","last_unstale":"2024-03-16T07:27:23.263892+0000","last_undegraded":"2024-03-16T07:27:23.263892+0000","last_fullsized":"2024-03-16T07:27:23.263892+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:30:54.915617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"50'2","reported_seq":24,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.271311+0000","last_change":"2024-03-16T07:27:08.243152+0000","last_active":"2024-03-16T07:27:23.271311+0000","last_peered":"2024-03-16T07:27:23.271311+0000","last_clean":"2024-03-16T07:27:23.271311+0000","last_became_active":"2024-03-16T07:27:08.242667+0000","last_became_peered":"2024-03-16T07:27:08.242667+0000","last_unstale":"2024-03-16T07:27:23.271311+0000","last_undegraded":"2024-03-16T07:27:23.271311+0000","last_fullsized":"2024-03-16T07:27:23.271311+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_clean_scrub_stamp":"2024-03-16T07:27:07.221025+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:18:38.969631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.270883+0000","last_change":"2024-03-16T07:27:22.295507+0000","last_active":"2024-03-16T07:27:23.270883+0000","last_peered":"2024-03-16T07:27:23.270883+0000","last_clean":"2024-03-16T07:27:23.270883+0000","last_became_active":"2024-03-16T07:27:22.295159+0000","last_became_peered":"2024-03-16T07:27:22.295159+0000","last_unstale":"2024-03-16T07:27:23.270883+0000","last_undegraded":"2024-03-16T07:27:23.270883+0000","last_fullsized":"2024-03-16T07:27:23.270883+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_clean_scrub_stamp":"2024-03-16T07:27:21.241337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:55:53.654406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.f","version":"54'1","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.267540+0000","last_change":"2024-03-16T07:27:21.272042+0000","last_active":"2024-03-16T07:27:23.267540+0000","last_peered":"2024-03-16T07:27:23.267540+0000","last_clean":"2024-03-16T07:27:23.267540+0000","last_became_active":"2024-03-16T07:27:21.271805+0000","last_became_peered":"2024-03-16T07:27:21.271805+0000","last_unstale":"2024-03-16T07:27:23.267540+0000","last_undegraded":"2024-03-16T07:27:23.267540+0000","last_fullsized":"2024-03-16T07:27:23.267540+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:20.238871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:20.238871+0000","last_clean_scrub_stamp":"2024-03-16T07:27:20.238871+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:45:04.907341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":20,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.262127+0000","last_change":"2024-03-16T07:27:08.934193+0000","last_active":"2024-03-16T07:27:23.262127+0000","last_peered":"2024-03-16T07:27:23.262127+0000","last_clean":"2024-03-16T07:27:23.262127+0000","last_became_active":"2024-03-16T07:27:08.933927+0000","last_became_peered":"2024-03-16T07:27:08.933927+0000","last_unstale":"2024-03-16T07:27:23.262127+0000","last_undegraded":"2024-03-16T07:27:23.262127+0000","last_fullsized":"2024-03-16T07:27:23.262127+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:54:49.472480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.d","version":"50'1","reported_seq":23,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.262017+0000","last_change":"2024-03-16T07:27:08.251729+0000","last_active":"2024-03-16T07:27:23.262017+0000","last_peered":"2024-03-16T07:27:23.262017+0000","last_clean":"2024-03-16T07:27:23.262017+0000","last_became_active":"2024-03-16T07:27:08.251457+0000","last_became_peered":"2024-03-16T07:27:08.251457+0000","last_unstale":"2024-03-16T07:27:23.262017+0000","last_undegraded":"2024-03-16T07:27:23.262017+0000","last_fullsized":"2024-03-16T07:27:23.262017+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_clean_scrub_stamp":"2024-03-16T07:27:07.221025+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:46:43.084148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.270312+0000","last_change":"2024-03-16T07:27:22.283522+0000","last_active":"2024-03-16T07:27:23.270312+0000","last_peered":"2024-03-16T07:27:23.270312+0000","last_clean":"2024-03-16T07:27:23.270312+0000","last_became_active":"2024-03-16T07:27:22.283301+0000","last_became_peered":"2024-03-16T07:27:22.283301+0000","last_unstale":"2024-03-16T07:27:23.270312+0000","last_undegraded":"2024-03-16T07:27:23.270312+0000","last_fullsized":"2024-03-16T07:27:23.270312+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_clean_scrub_stamp":"2024-03-16T07:27:21.241337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:25:41.291894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.e","version":"54'2","reported_seq":16,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.270581+0000","last_change":"2024-03-16T07:27:21.265339+0000","last_active":"2024-03-16T07:27:23.270581+0000","last_peered":"2024-03-16T07:27:23.270581+0000","last_clean":"2024-03-16T07:27:23.270581+0000","last_became_active":"2024-03-16T07:27:21.265129+0000","last_became_peered":"2024-03-16T07:27:21.265129+0000","last_unstale":"2024-03-16T07:27:23.270581+0000","last_undegraded":"2024-03-16T07:27:23.270581+0000","last_fullsized":"2024-03-16T07:27:23.270581+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:20.238871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:20.238871+0000","last_clean_scrub_stamp":"2024-03-16T07:27:20.238871+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:42:54.297049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":20,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.273139+0000","last_change":"2024-03-16T07:27:08.921973+0000","last_active":"2024-03-16T07:27:23.273139+0000","last_peered":"2024-03-16T07:27:23.273139+0000","last_clean":"2024-03-16T07:27:23.273139+0000","last_became_active":"2024-03-16T07:27:08.921742+0000","last_became_peered":"2024-03-16T07:27:08.921742+0000","last_unstale":"2024-03-16T07:27:23.273139+0000","last_undegraded":"2024-03-16T07:27:23.273139+0000","last_fullsized":"2024-03-16T07:27:23.273139+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:54:12.324951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":22,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.273398+0000","last_change":"2024-03-16T07:27:08.244296+0000","last_active":"2024-03-16T07:27:23.273398+0000","last_peered":"2024-03-16T07:27:23.273398+0000","last_clean":"2024-03-16T07:27:23.273398+0000","last_became_active":"2024-03-16T07:27:08.243822+0000","last_became_peered":"2024-03-16T07:27:08.243822+0000","last_unstale":"2024-03-16T07:27:23.273398+0000","last_undegraded":"2024-03-16T07:27:23.273398+0000","last_fullsized":"2024-03-16T07:27:23.273398+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_clean_scrub_stamp":"2024-03-16T07:27:07.221025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:10:55.596764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.259797+0000","last_change":"2024-03-16T07:27:22.265726+0000","last_active":"2024-03-16T07:27:23.259797+0000","last_peered":"2024-03-16T07:27:23.259797+0000","last_clean":"2024-03-16T07:27:23.259797+0000","last_became_active":"2024-03-16T07:27:22.263998+0000","last_became_peered":"2024-03-16T07:27:22.263998+0000","last_unstale":"2024-03-16T07:27:23.259797+0000","last_undegraded":"2024-03-16T07:27:23.259797+0000","last_fullsized":"2024-03-16T07:27:23.259797+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_clean_scrub_stamp":"2024-03-16T07:27:21.241337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:55:00.744075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.269918+0000","last_change":"2024-03-16T07:27:21.271974+0000","last_active":"2024-03-16T07:27:23.269918+0000","last_peered":"2024-03-16T07:27:23.269918+0000","last_clean":"2024-03-16T07:27:23.269918+0000","last_became_active":"2024-03-16T07:27:21.271724+0000","last_became_peered":"2024-03-16T07:27:21.271724+0000","last_unstale":"2024-03-16T07:27:23.269918+0000","last_undegraded":"2024-03-16T07:27:23.269918+0000","last_fullsized":"2024-03-16T07:27:23.269918+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:20.238871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:20.238871+0000","last_clean_scrub_stamp":"2024-03-16T07:27:20.238871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:33:02.086261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":20,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.265756+0000","last_change":"2024-03-16T07:27:08.923667+0000","last_active":"2024-03-16T07:27:23.265756+0000","last_peered":"2024-03-16T07:27:23.265756+0000","last_clean":"2024-03-16T07:27:23.265756+0000","last_became_active":"2024-03-16T07:27:08.923410+0000","last_became_peered":"2024-03-16T07:27:08.923410+0000","last_unstale":"2024-03-16T07:27:23.265756+0000","last_undegraded":"2024-03-16T07:27:23.265756+0000","last_fullsized":"2024-03-16T07:27:23.265756+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:10:07.438245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.b","version":"50'2","reported_seq":24,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.271229+0000","last_change":"2024-03-16T07:27:08.235239+0000","last_active":"2024-03-16T07:27:23.271229+0000","last_peered":"2024-03-16T07:27:23.271229+0000","last_clean":"2024-03-16T07:27:23.271229+0000","last_became_active":"2024-03-16T07:27:08.234873+0000","last_became_peered":"2024-03-16T07:27:08.234873+0000","last_unstale":"2024-03-16T07:27:23.271229+0000","last_undegraded":"2024-03-16T07:27:23.271229+0000","last_fullsized":"2024-03-16T07:27:23.271229+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_clean_scrub_stamp":"2024-03-16T07:27:07.221025+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:30:53.914463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.259697+0000","last_change":"2024-03-16T07:27:22.263699+0000","last_active":"2024-03-16T07:27:23.259697+0000","last_peered":"2024-03-16T07:27:23.259697+0000","last_clean":"2024-03-16T07:27:23.259697+0000","last_became_active":"2024-03-16T07:27:22.263003+0000","last_became_peered":"2024-03-16T07:27:22.263003+0000","last_unstale":"2024-03-16T07:27:23.259697+0000","last_undegraded":"2024-03-16T07:27:23.259697+0000","last_fullsized":"2024-03-16T07:27:23.259697+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_clean_scrub_stamp":"2024-03-16T07:27:21.241337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:05:00.308806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.269309+0000","last_change":"2024-03-16T07:27:21.271597+0000","last_active":"2024-03-16T07:27:23.269309+0000","last_peered":"2024-03-16T07:27:23.269309+0000","last_clean":"2024-03-16T07:27:23.269309+0000","last_became_active":"2024-03-16T07:27:21.271351+0000","last_became_peered":"2024-03-16T07:27:21.271351+0000","last_unstale":"2024-03-16T07:27:23.269309+0000","last_undegraded":"2024-03-16T07:27:23.269309+0000","last_fullsized":"2024-03-16T07:27:23.269309+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:20.238871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:20.238871+0000","last_clean_scrub_stamp":"2024-03-16T07:27:20.238871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:32:02.334526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":20,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.270930+0000","last_change":"2024-03-16T07:27:08.920383+0000","last_active":"2024-03-16T07:27:23.270930+0000","last_peered":"2024-03-16T07:27:23.270930+0000","last_clean":"2024-03-16T07:27:23.270930+0000","last_became_active":"2024-03-16T07:27:08.918297+0000","last_became_peered":"2024-03-16T07:27:08.918297+0000","last_unstale":"2024-03-16T07:27:23.270930+0000","last_undegraded":"2024-03-16T07:27:23.270930+0000","last_fullsized":"2024-03-16T07:27:23.270930+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:53:22.005176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":22,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.266175+0000","last_change":"2024-03-16T07:27:08.246964+0000","last_active":"2024-03-16T07:27:23.266175+0000","last_peered":"2024-03-16T07:27:23.266175+0000","last_clean":"2024-03-16T07:27:23.266175+0000","last_became_active":"2024-03-16T07:27:08.246688+0000","last_became_peered":"2024-03-16T07:27:08.246688+0000","last_unstale":"2024-03-16T07:27:23.266175+0000","last_undegraded":"2024-03-16T07:27:23.266175+0000","last_fullsized":"2024-03-16T07:27:23.266175+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_clean_scrub_stamp":"2024-03-16T07:27:07.221025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:47:11.940256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.260909+0000","last_change":"2024-03-16T07:27:22.270013+0000","last_active":"2024-03-16T07:27:23.260909+0000","last_peered":"2024-03-16T07:27:23.260909+0000","last_clean":"2024-03-16T07:27:23.260909+0000","last_became_active":"2024-03-16T07:27:22.269543+0000","last_became_peered":"2024-03-16T07:27:22.269543+0000","last_unstale":"2024-03-16T07:27:23.260909+0000","last_undegraded":"2024-03-16T07:27:23.260909+0000","last_fullsized":"2024-03-16T07:27:23.260909+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_clean_scrub_stamp":"2024-03-16T07:27:21.241337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:32:03.336993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.260721+0000","last_change":"2024-03-16T07:27:21.267414+0000","last_active":"2024-03-16T07:27:23.260721+0000","last_peered":"2024-03-16T07:27:23.260721+0000","last_clean":"2024-03-16T07:27:23.260721+0000","last_became_active":"2024-03-16T07:27:21.267182+0000","last_became_peered":"2024-03-16T07:27:21.267182+0000","last_unstale":"2024-03-16T07:27:23.260721+0000","last_undegraded":"2024-03-16T07:27:23.260721+0000","last_fullsized":"2024-03-16T07:27:23.260721+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:20.238871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:20.238871+0000","last_clean_scrub_stamp":"2024-03-16T07:27:20.238871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:36:33.401934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":20,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.270979+0000","last_change":"2024-03-16T07:27:08.917472+0000","last_active":"2024-03-16T07:27:23.270979+0000","last_peered":"2024-03-16T07:27:23.270979+0000","last_clean":"2024-03-16T07:27:23.270979+0000","last_became_active":"2024-03-16T07:27:08.917235+0000","last_became_peered":"2024-03-16T07:27:08.917235+0000","last_unstale":"2024-03-16T07:27:23.270979+0000","last_undegraded":"2024-03-16T07:27:23.270979+0000","last_fullsized":"2024-03-16T07:27:23.270979+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:17:13.539054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":22,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.266526+0000","last_change":"2024-03-16T07:27:08.247978+0000","last_active":"2024-03-16T07:27:23.266526+0000","last_peered":"2024-03-16T07:27:23.266526+0000","last_clean":"2024-03-16T07:27:23.266526+0000","last_became_active":"2024-03-16T07:27:08.247725+0000","last_became_peered":"2024-03-16T07:27:08.247725+0000","last_unstale":"2024-03-16T07:27:23.266526+0000","last_undegraded":"2024-03-16T07:27:23.266526+0000","last_fullsized":"2024-03-16T07:27:23.266526+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_clean_scrub_stamp":"2024-03-16T07:27:07.221025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:06:16.181760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.271101+0000","last_change":"2024-03-16T07:27:22.284995+0000","last_active":"2024-03-16T07:27:23.271101+0000","last_peered":"2024-03-16T07:27:23.271101+0000","last_clean":"2024-03-16T07:27:23.271101+0000","last_became_active":"2024-03-16T07:27:22.284758+0000","last_became_peered":"2024-03-16T07:27:22.284758+0000","last_unstale":"2024-03-16T07:27:23.271101+0000","last_undegraded":"2024-03-16T07:27:23.271101+0000","last_fullsized":"2024-03-16T07:27:23.271101+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_clean_scrub_stamp":"2024-03-16T07:27:21.241337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:41:30.103982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.262751+0000","last_change":"2024-03-16T07:27:21.270847+0000","last_active":"2024-03-16T07:27:23.262751+0000","last_peered":"2024-03-16T07:27:23.262751+0000","last_clean":"2024-03-16T07:27:23.262751+0000","last_became_active":"2024-03-16T07:27:21.270592+0000","last_became_peered":"2024-03-16T07:27:21.270592+0000","last_unstale":"2024-03-16T07:27:23.262751+0000","last_undegraded":"2024-03-16T07:27:23.262751+0000","last_fullsized":"2024-03-16T07:27:23.262751+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:20.238871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:20.238871+0000","last_clean_scrub_stamp":"2024-03-16T07:27:20.238871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:28:59.967357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":20,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.263105+0000","last_change":"2024-03-16T07:27:08.930514+0000","last_active":"2024-03-16T07:27:23.263105+0000","last_peered":"2024-03-16T07:27:23.263105+0000","last_clean":"2024-03-16T07:27:23.263105+0000","last_became_active":"2024-03-16T07:27:08.930278+0000","last_became_peered":"2024-03-16T07:27:08.930278+0000","last_unstale":"2024-03-16T07:27:23.263105+0000","last_undegraded":"2024-03-16T07:27:23.263105+0000","last_fullsized":"2024-03-16T07:27:23.263105+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:17:47.855918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"50'2","reported_seq":24,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.268093+0000","last_change":"2024-03-16T07:27:08.242744+0000","last_active":"2024-03-16T07:27:23.268093+0000","last_peered":"2024-03-16T07:27:23.268093+0000","last_clean":"2024-03-16T07:27:23.268093+0000","last_became_active":"2024-03-16T07:27:08.242491+0000","last_became_peered":"2024-03-16T07:27:08.242491+0000","last_unstale":"2024-03-16T07:27:23.268093+0000","last_undegraded":"2024-03-16T07:27:23.268093+0000","last_fullsized":"2024-03-16T07:27:23.268093+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_clean_scrub_stamp":"2024-03-16T07:27:07.221025+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:16:47.057318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.266284+0000","last_change":"2024-03-16T07:27:22.273286+0000","last_active":"2024-03-16T07:27:23.266284+0000","last_peered":"2024-03-16T07:27:23.266284+0000","last_clean":"2024-03-16T07:27:23.266284+0000","last_became_active":"2024-03-16T07:27:22.271299+0000","last_became_peered":"2024-03-16T07:27:22.271299+0000","last_unstale":"2024-03-16T07:27:23.266284+0000","last_undegraded":"2024-03-16T07:27:23.266284+0000","last_fullsized":"2024-03-16T07:27:23.266284+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_clean_scrub_stamp":"2024-03-16T07:27:21.241337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:19:34.390055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.271203+0000","last_change":"2024-03-16T07:27:21.265961+0000","last_active":"2024-03-16T07:27:23.271203+0000","last_peered":"2024-03-16T07:27:23.271203+0000","last_clean":"2024-03-16T07:27:23.271203+0000","last_became_active":"2024-03-16T07:27:21.265596+0000","last_became_peered":"2024-03-16T07:27:21.265596+0000","last_unstale":"2024-03-16T07:27:23.271203+0000","last_undegraded":"2024-03-16T07:27:23.271203+0000","last_fullsized":"2024-03-16T07:27:23.271203+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:20.238871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:20.238871+0000","last_clean_scrub_stamp":"2024-03-16T07:27:20.238871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:08:13.292852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":20,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.263814+0000","last_change":"2024-03-16T07:27:08.932487+0000","last_active":"2024-03-16T07:27:23.263814+0000","last_peered":"2024-03-16T07:27:23.263814+0000","last_clean":"2024-03-16T07:27:23.263814+0000","last_became_active":"2024-03-16T07:27:08.932022+0000","last_became_peered":"2024-03-16T07:27:08.932022+0000","last_unstale":"2024-03-16T07:27:23.263814+0000","last_undegraded":"2024-03-16T07:27:23.263814+0000","last_fullsized":"2024-03-16T07:27:23.263814+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:05:56.498565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.6","version":"51'1","reported_seq":23,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.273168+0000","last_change":"2024-03-16T07:27:08.242924+0000","last_active":"2024-03-16T07:27:23.273168+0000","last_peered":"2024-03-16T07:27:23.273168+0000","last_clean":"2024-03-16T07:27:23.273168+0000","last_became_active":"2024-03-16T07:27:08.242277+0000","last_became_peered":"2024-03-16T07:27:08.242277+0000","last_unstale":"2024-03-16T07:27:23.273168+0000","last_undegraded":"2024-03-16T07:27:23.273168+0000","last_fullsized":"2024-03-16T07:27:23.273168+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_clean_scrub_stamp":"2024-03-16T07:27:07.221025+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:40:23.474145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.269774+0000","last_change":"2024-03-16T07:27:22.286070+0000","last_active":"2024-03-16T07:27:23.269774+0000","last_peered":"2024-03-16T07:27:23.269774+0000","last_clean":"2024-03-16T07:27:23.269774+0000","last_became_active":"2024-03-16T07:27:22.285838+0000","last_became_peered":"2024-03-16T07:27:22.285838+0000","last_unstale":"2024-03-16T07:27:23.269774+0000","last_undegraded":"2024-03-16T07:27:23.269774+0000","last_fullsized":"2024-03-16T07:27:23.269774+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_clean_scrub_stamp":"2024-03-16T07:27:21.241337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:38:53.945424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"54'2","reported_seq":16,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.270116+0000","last_change":"2024-03-16T07:27:21.264843+0000","last_active":"2024-03-16T07:27:23.270116+0000","last_peered":"2024-03-16T07:27:23.270116+0000","last_clean":"2024-03-16T07:27:23.270116+0000","last_became_active":"2024-03-16T07:27:21.264601+0000","last_became_peered":"2024-03-16T07:27:21.264601+0000","last_unstale":"2024-03-16T07:27:23.270116+0000","last_undegraded":"2024-03-16T07:27:23.270116+0000","last_fullsized":"2024-03-16T07:27:23.270116+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:20.238871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:20.238871+0000","last_clean_scrub_stamp":"2024-03-16T07:27:20.238871+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:34:27.075829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":20,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.267805+0000","last_change":"2024-03-16T07:27:08.922001+0000","last_active":"2024-03-16T07:27:23.267805+0000","last_peered":"2024-03-16T07:27:23.267805+0000","last_clean":"2024-03-16T07:27:23.267805+0000","last_became_active":"2024-03-16T07:27:08.921584+0000","last_became_peered":"2024-03-16T07:27:08.921584+0000","last_unstale":"2024-03-16T07:27:23.267805+0000","last_undegraded":"2024-03-16T07:27:23.267805+0000","last_fullsized":"2024-03-16T07:27:23.267805+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:19:02.609010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":22,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.266761+0000","last_change":"2024-03-16T07:27:08.248496+0000","last_active":"2024-03-16T07:27:23.266761+0000","last_peered":"2024-03-16T07:27:23.266761+0000","last_clean":"2024-03-16T07:27:23.266761+0000","last_became_active":"2024-03-16T07:27:08.247244+0000","last_became_peered":"2024-03-16T07:27:08.247244+0000","last_unstale":"2024-03-16T07:27:23.266761+0000","last_undegraded":"2024-03-16T07:27:23.266761+0000","last_fullsized":"2024-03-16T07:27:23.266761+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_clean_scrub_stamp":"2024-03-16T07:27:07.221025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:59:09.394985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.267528+0000","last_change":"2024-03-16T07:27:22.292293+0000","last_active":"2024-03-16T07:27:23.267528+0000","last_peered":"2024-03-16T07:27:23.267528+0000","last_clean":"2024-03-16T07:27:23.267528+0000","last_became_active":"2024-03-16T07:27:22.291730+0000","last_became_peered":"2024-03-16T07:27:22.291730+0000","last_unstale":"2024-03-16T07:27:23.267528+0000","last_undegraded":"2024-03-16T07:27:23.267528+0000","last_fullsized":"2024-03-16T07:27:23.267528+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_clean_scrub_stamp":"2024-03-16T07:27:21.241337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:14:13.471869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.6","version":"55'1","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.268032+0000","last_change":"2024-03-16T07:27:21.263333+0000","last_active":"2024-03-16T07:27:23.268032+0000","last_peered":"2024-03-16T07:27:23.268032+0000","last_clean":"2024-03-16T07:27:23.268032+0000","last_became_active":"2024-03-16T07:27:21.263108+0000","last_became_peered":"2024-03-16T07:27:21.263108+0000","last_unstale":"2024-03-16T07:27:23.268032+0000","last_undegraded":"2024-03-16T07:27:23.268032+0000","last_fullsized":"2024-03-16T07:27:23.268032+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:20.238871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:20.238871+0000","last_clean_scrub_stamp":"2024-03-16T07:27:20.238871+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:11:02.361626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":20,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.273146+0000","last_change":"2024-03-16T07:27:08.918934+0000","last_active":"2024-03-16T07:27:23.273146+0000","last_peered":"2024-03-16T07:27:23.273146+0000","last_clean":"2024-03-16T07:27:23.273146+0000","last_became_active":"2024-03-16T07:27:08.917309+0000","last_became_peered":"2024-03-16T07:27:08.917309+0000","last_unstale":"2024-03-16T07:27:23.273146+0000","last_undegraded":"2024-03-16T07:27:23.273146+0000","last_fullsized":"2024-03-16T07:27:23.273146+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:10:33.238201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":22,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.262405+0000","last_change":"2024-03-16T07:27:08.251830+0000","last_active":"2024-03-16T07:27:23.262405+0000","last_peered":"2024-03-16T07:27:23.262405+0000","last_clean":"2024-03-16T07:27:23.262405+0000","last_became_active":"2024-03-16T07:27:08.251478+0000","last_became_peered":"2024-03-16T07:27:08.251478+0000","last_unstale":"2024-03-16T07:27:23.262405+0000","last_undegraded":"2024-03-16T07:27:23.262405+0000","last_fullsized":"2024-03-16T07:27:23.262405+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_clean_scrub_stamp":"2024-03-16T07:27:07.221025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:16:47.057318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.265948+0000","last_change":"2024-03-16T07:27:22.281804+0000","last_active":"2024-03-16T07:27:23.265948+0000","last_peered":"2024-03-16T07:27:23.265948+0000","last_clean":"2024-03-16T07:27:23.265948+0000","last_became_active":"2024-03-16T07:27:22.281439+0000","last_became_peered":"2024-03-16T07:27:22.281439+0000","last_unstale":"2024-03-16T07:27:23.265948+0000","last_undegraded":"2024-03-16T07:27:23.265948+0000","last_fullsized":"2024-03-16T07:27:23.265948+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_clean_scrub_stamp":"2024-03-16T07:27:21.241337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:35:29.662821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.269291+0000","last_change":"2024-03-16T07:27:21.270079+0000","last_active":"2024-03-16T07:27:23.269291+0000","last_peered":"2024-03-16T07:27:23.269291+0000","last_clean":"2024-03-16T07:27:23.269291+0000","last_became_active":"2024-03-16T07:27:21.269588+0000","last_became_peered":"2024-03-16T07:27:21.269588+0000","last_unstale":"2024-03-16T07:27:23.269291+0000","last_undegraded":"2024-03-16T07:27:23.269291+0000","last_fullsized":"2024-03-16T07:27:23.269291+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:20.238871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:20.238871+0000","last_clean_scrub_stamp":"2024-03-16T07:27:20.238871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:35:07.277317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":20,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.266106+0000","last_change":"2024-03-16T07:27:08.928147+0000","last_active":"2024-03-16T07:27:23.266106+0000","last_peered":"2024-03-16T07:27:23.266106+0000","last_clean":"2024-03-16T07:27:23.266106+0000","last_became_active":"2024-03-16T07:27:08.927393+0000","last_became_peered":"2024-03-16T07:27:08.927393+0000","last_unstale":"2024-03-16T07:27:23.266106+0000","last_undegraded":"2024-03-16T07:27:23.266106+0000","last_fullsized":"2024-03-16T07:27:23.266106+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:39:08.012405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":22,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.266916+0000","last_change":"2024-03-16T07:27:08.240204+0000","last_active":"2024-03-16T07:27:23.266916+0000","last_peered":"2024-03-16T07:27:23.266916+0000","last_clean":"2024-03-16T07:27:23.266916+0000","last_became_active":"2024-03-16T07:27:08.239950+0000","last_became_peered":"2024-03-16T07:27:08.239950+0000","last_unstale":"2024-03-16T07:27:23.266916+0000","last_undegraded":"2024-03-16T07:27:23.266916+0000","last_fullsized":"2024-03-16T07:27:23.266916+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_clean_scrub_stamp":"2024-03-16T07:27:07.221025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:47:23.821578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.269195+0000","last_change":"2024-03-16T07:27:22.276979+0000","last_active":"2024-03-16T07:27:23.269195+0000","last_peered":"2024-03-16T07:27:23.269195+0000","last_clean":"2024-03-16T07:27:23.269195+0000","last_became_active":"2024-03-16T07:27:22.276453+0000","last_became_peered":"2024-03-16T07:27:22.276453+0000","last_unstale":"2024-03-16T07:27:23.269195+0000","last_undegraded":"2024-03-16T07:27:23.269195+0000","last_fullsized":"2024-03-16T07:27:23.269195+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_clean_scrub_stamp":"2024-03-16T07:27:21.241337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:31:47.108446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.260060+0000","last_change":"2024-03-16T07:27:21.275143+0000","last_active":"2024-03-16T07:27:23.260060+0000","last_peered":"2024-03-16T07:27:23.260060+0000","last_clean":"2024-03-16T07:27:23.260060+0000","last_became_active":"2024-03-16T07:27:21.274890+0000","last_became_peered":"2024-03-16T07:27:21.274890+0000","last_unstale":"2024-03-16T07:27:23.260060+0000","last_undegraded":"2024-03-16T07:27:23.260060+0000","last_fullsized":"2024-03-16T07:27:23.260060+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:20.238871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:20.238871+0000","last_clean_scrub_stamp":"2024-03-16T07:27:20.238871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:53:17.204808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":20,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.271022+0000","last_change":"2024-03-16T07:27:08.920819+0000","last_active":"2024-03-16T07:27:23.271022+0000","last_peered":"2024-03-16T07:27:23.271022+0000","last_clean":"2024-03-16T07:27:23.271022+0000","last_became_active":"2024-03-16T07:27:08.918934+0000","last_became_peered":"2024-03-16T07:27:08.918934+0000","last_unstale":"2024-03-16T07:27:23.271022+0000","last_undegraded":"2024-03-16T07:27:23.271022+0000","last_fullsized":"2024-03-16T07:27:23.271022+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:53:22.935175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":22,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.261266+0000","last_change":"2024-03-16T07:27:08.250052+0000","last_active":"2024-03-16T07:27:23.261266+0000","last_peered":"2024-03-16T07:27:23.261266+0000","last_clean":"2024-03-16T07:27:23.261266+0000","last_became_active":"2024-03-16T07:27:08.249750+0000","last_became_peered":"2024-03-16T07:27:08.249750+0000","last_unstale":"2024-03-16T07:27:23.261266+0000","last_undegraded":"2024-03-16T07:27:23.261266+0000","last_fullsized":"2024-03-16T07:27:23.261266+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_clean_scrub_stamp":"2024-03-16T07:27:07.221025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:04:40.243410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.260421+0000","last_change":"2024-03-16T07:27:22.279020+0000","last_active":"2024-03-16T07:27:23.260421+0000","last_peered":"2024-03-16T07:27:23.260421+0000","last_clean":"2024-03-16T07:27:23.260421+0000","last_became_active":"2024-03-16T07:27:22.275392+0000","last_became_peered":"2024-03-16T07:27:22.275392+0000","last_unstale":"2024-03-16T07:27:23.260421+0000","last_undegraded":"2024-03-16T07:27:23.260421+0000","last_fullsized":"2024-03-16T07:27:23.260421+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_clean_scrub_stamp":"2024-03-16T07:27:21.241337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:25:13.596658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.260725+0000","last_change":"2024-03-16T07:27:21.275300+0000","last_active":"2024-03-16T07:27:23.260725+0000","last_peered":"2024-03-16T07:27:23.260725+0000","last_clean":"2024-03-16T07:27:23.260725+0000","last_became_active":"2024-03-16T07:27:21.275036+0000","last_became_peered":"2024-03-16T07:27:21.275036+0000","last_unstale":"2024-03-16T07:27:23.260725+0000","last_undegraded":"2024-03-16T07:27:23.260725+0000","last_fullsized":"2024-03-16T07:27:23.260725+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:20.238871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:20.238871+0000","last_clean_scrub_stamp":"2024-03-16T07:27:20.238871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:53:28.969746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":20,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.266378+0000","last_change":"2024-03-16T07:27:08.927243+0000","last_active":"2024-03-16T07:27:23.266378+0000","last_peered":"2024-03-16T07:27:23.266378+0000","last_clean":"2024-03-16T07:27:23.266378+0000","last_became_active":"2024-03-16T07:27:08.926939+0000","last_became_peered":"2024-03-16T07:27:08.926939+0000","last_unstale":"2024-03-16T07:27:23.266378+0000","last_undegraded":"2024-03-16T07:27:23.266378+0000","last_fullsized":"2024-03-16T07:27:23.266378+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:37:57.835321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":22,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.265326+0000","last_change":"2024-03-16T07:27:08.241445+0000","last_active":"2024-03-16T07:27:23.265326+0000","last_peered":"2024-03-16T07:27:23.265326+0000","last_clean":"2024-03-16T07:27:23.265326+0000","last_became_active":"2024-03-16T07:27:08.241129+0000","last_became_peered":"2024-03-16T07:27:08.241129+0000","last_unstale":"2024-03-16T07:27:23.265326+0000","last_undegraded":"2024-03-16T07:27:23.265326+0000","last_fullsized":"2024-03-16T07:27:23.265326+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_clean_scrub_stamp":"2024-03-16T07:27:07.221025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:46:43.084148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.260482+0000","last_change":"2024-03-16T07:27:22.282426+0000","last_active":"2024-03-16T07:27:23.260482+0000","last_peered":"2024-03-16T07:27:23.260482+0000","last_clean":"2024-03-16T07:27:23.260482+0000","last_became_active":"2024-03-16T07:27:22.281277+0000","last_became_peered":"2024-03-16T07:27:22.281277+0000","last_unstale":"2024-03-16T07:27:23.260482+0000","last_undegraded":"2024-03-16T07:27:23.260482+0000","last_fullsized":"2024-03-16T07:27:23.260482+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_clean_scrub_stamp":"2024-03-16T07:27:21.241337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:02:58.997692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.265564+0000","last_change":"2024-03-16T07:27:21.266121+0000","last_active":"2024-03-16T07:27:23.265564+0000","last_peered":"2024-03-16T07:27:23.265564+0000","last_clean":"2024-03-16T07:27:23.265564+0000","last_became_active":"2024-03-16T07:27:21.265892+0000","last_became_peered":"2024-03-16T07:27:21.265892+0000","last_unstale":"2024-03-16T07:27:23.265564+0000","last_undegraded":"2024-03-16T07:27:23.265564+0000","last_fullsized":"2024-03-16T07:27:23.265564+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:20.238871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:20.238871+0000","last_clean_scrub_stamp":"2024-03-16T07:27:20.238871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:53:17.204808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":20,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.271230+0000","last_change":"2024-03-16T07:27:08.918028+0000","last_active":"2024-03-16T07:27:23.271230+0000","last_peered":"2024-03-16T07:27:23.271230+0000","last_clean":"2024-03-16T07:27:23.271230+0000","last_became_active":"2024-03-16T07:27:08.917397+0000","last_became_peered":"2024-03-16T07:27:08.917397+0000","last_unstale":"2024-03-16T07:27:23.271230+0000","last_undegraded":"2024-03-16T07:27:23.271230+0000","last_fullsized":"2024-03-16T07:27:23.271230+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:53:24.331820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":22,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.266617+0000","last_change":"2024-03-16T07:27:08.239510+0000","last_active":"2024-03-16T07:27:23.266617+0000","last_peered":"2024-03-16T07:27:23.266617+0000","last_clean":"2024-03-16T07:27:23.266617+0000","last_became_active":"2024-03-16T07:27:08.239209+0000","last_became_peered":"2024-03-16T07:27:08.239209+0000","last_unstale":"2024-03-16T07:27:23.266617+0000","last_undegraded":"2024-03-16T07:27:23.266617+0000","last_fullsized":"2024-03-16T07:27:23.266617+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_clean_scrub_stamp":"2024-03-16T07:27:07.221025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:08:11.994734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.265351+0000","last_change":"2024-03-16T07:27:22.277358+0000","last_active":"2024-03-16T07:27:23.265351+0000","last_peered":"2024-03-16T07:27:23.265351+0000","last_clean":"2024-03-16T07:27:23.265351+0000","last_became_active":"2024-03-16T07:27:22.276938+0000","last_became_peered":"2024-03-16T07:27:22.276938+0000","last_unstale":"2024-03-16T07:27:23.265351+0000","last_undegraded":"2024-03-16T07:27:23.265351+0000","last_fullsized":"2024-03-16T07:27:23.265351+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_clean_scrub_stamp":"2024-03-16T07:27:21.241337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:10:46.257358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"54'2","reported_seq":16,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.266866+0000","last_change":"2024-03-16T07:27:21.263898+0000","last_active":"2024-03-16T07:27:23.266866+0000","last_peered":"2024-03-16T07:27:23.266866+0000","last_clean":"2024-03-16T07:27:23.266866+0000","last_became_active":"2024-03-16T07:27:21.263684+0000","last_became_peered":"2024-03-16T07:27:21.263684+0000","last_unstale":"2024-03-16T07:27:23.266866+0000","last_undegraded":"2024-03-16T07:27:23.266866+0000","last_fullsized":"2024-03-16T07:27:23.266866+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:20.238871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:20.238871+0000","last_clean_scrub_stamp":"2024-03-16T07:27:20.238871+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:17:03.017639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":20,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.260554+0000","last_change":"2024-03-16T07:27:08.929726+0000","last_active":"2024-03-16T07:27:23.260554+0000","last_peered":"2024-03-16T07:27:23.260554+0000","last_clean":"2024-03-16T07:27:23.260554+0000","last_became_active":"2024-03-16T07:27:08.929485+0000","last_became_peered":"2024-03-16T07:27:08.929485+0000","last_unstale":"2024-03-16T07:27:23.260554+0000","last_undegraded":"2024-03-16T07:27:23.260554+0000","last_fullsized":"2024-03-16T07:27:23.260554+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:50:02.719035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":22,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.271108+0000","last_change":"2024-03-16T07:27:08.247274+0000","last_active":"2024-03-16T07:27:23.271108+0000","last_peered":"2024-03-16T07:27:23.271108+0000","last_clean":"2024-03-16T07:27:23.271108+0000","last_became_active":"2024-03-16T07:27:08.243679+0000","last_became_peered":"2024-03-16T07:27:08.243679+0000","last_unstale":"2024-03-16T07:27:23.271108+0000","last_undegraded":"2024-03-16T07:27:23.271108+0000","last_fullsized":"2024-03-16T07:27:23.271108+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_clean_scrub_stamp":"2024-03-16T07:27:07.221025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:17:46.854764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"35'119","reported_seq":299,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.266850+0000","last_change":"2024-03-16T07:24:31.650537+0000","last_active":"2024-03-16T07:27:23.266850+0000","last_peered":"2024-03-16T07:27:23.266850+0000","last_clean":"2024-03-16T07:27:23.266850+0000","last_became_active":"2024-03-16T07:24:31.649574+0000","last_became_peered":"2024-03-16T07:24:31.649574+0000","last_unstale":"2024-03-16T07:27:23.266850+0000","last_undegraded":"2024-03-16T07:27:23.266850+0000","last_fullsized":"2024-03-16T07:27:23.266850+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:29.719970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:29.719970+0000","last_clean_scrub_stamp":"2024-03-16T07:24:29.719970+0000","objects_scrubbed":0,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:31:35.774554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":298,"num_read_kb":503,"num_write":177,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":4107,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":8214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":298,"num_read_kb":503,"num_write":177,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738405,"num_pgs":138,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":31772,"kb_used_data":584,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":104825828,"statfs":{"total":107374182400,"available":107341647872,"internally_reserved":0,"allocated":598016,"data_stored":211615,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738405,"num_pgs":122,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":32332,"kb_used_data":1144,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":104825268,"statfs":{"total":107374182400,"available":107341074432,"internally_reserved":0,"allocated":1171456,"data_stored":799074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738405,"num_pgs":126,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":32320,"kb_used_data":1132,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":104825280,"statfs":{"total":107374182400,"available":107341086720,"internally_reserved":0,"allocated":1159168,"data_stored":800121,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3913,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":3525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-16T07:27:26.355 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-16T07:27:26.827 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:27:26.830 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2024-03-16T07:27:26.842 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":44,"stamp":"2024-03-16T07:27:25.738342+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596885,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":298,"num_read_kb":503,"num_write":269,"num_write_kb":1925,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":199,"ondisk_log_size":199,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":386,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":314572800,"kb_used":96424,"kb_used_data":2860,"kb_used_omap":4,"kb_used_meta":93499,"kb_avail":314476376,"statfs":{"total":322122547200,"available":322023809024,"internally_reserved":0,"allocated":2928640,"data_stored":1810810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":95743311},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.496648"},"pg_stats":[{"pgid":"11.3d","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.261677+0000","last_change":"2024-03-16T07:27:22.283631+0000","last_active":"2024-03-16T07:27:23.261677+0000","last_peered":"2024-03-16T07:27:23.261677+0000","last_clean":"2024-03-16T07:27:23.261677+0000","last_became_active":"2024-03-16T07:27:22.283370+0000","last_became_peered":"2024-03-16T07:27:22.283370+0000","last_unstale":"2024-03-16T07:27:23.261677+0000","last_undegraded":"2024-03-16T07:27:23.261677+0000","last_fullsized":"2024-03-16T07:27:23.261677+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_clean_scrub_stamp":"2024-03-16T07:27:21.241337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:33:03.088727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3f","version":"0'0","reported_seq":20,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.263675+0000","last_change":"2024-03-16T07:27:08.932788+0000","last_active":"2024-03-16T07:27:23.263675+0000","last_peered":"2024-03-16T07:27:23.263675+0000","last_clean":"2024-03-16T07:27:23.263675+0000","last_became_active":"2024-03-16T07:27:08.932342+0000","last_became_peered":"2024-03-16T07:27:08.932342+0000","last_unstale":"2024-03-16T07:27:23.263675+0000","last_undegraded":"2024-03-16T07:27:23.263675+0000","last_fullsized":"2024-03-16T07:27:23.263675+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:43:52.645660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.266438+0000","last_change":"2024-03-16T07:27:22.286745+0000","last_active":"2024-03-16T07:27:23.266438+0000","last_peered":"2024-03-16T07:27:23.266438+0000","last_clean":"2024-03-16T07:27:23.266438+0000","last_became_active":"2024-03-16T07:27:22.286145+0000","last_became_peered":"2024-03-16T07:27:22.286145+0000","last_unstale":"2024-03-16T07:27:23.266438+0000","last_undegraded":"2024-03-16T07:27:23.266438+0000","last_fullsized":"2024-03-16T07:27:23.266438+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_clean_scrub_stamp":"2024-03-16T07:27:21.241337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:53:21.015589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":20,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.262943+0000","last_change":"2024-03-16T07:27:08.930178+0000","last_active":"2024-03-16T07:27:23.262943+0000","last_peered":"2024-03-16T07:27:23.262943+0000","last_clean":"2024-03-16T07:27:23.262943+0000","last_became_active":"2024-03-16T07:27:08.929644+0000","last_became_peered":"2024-03-16T07:27:08.929644+0000","last_unstale":"2024-03-16T07:27:23.262943+0000","last_undegraded":"2024-03-16T07:27:23.262943+0000","last_fullsized":"2024-03-16T07:27:23.262943+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:19:02.609010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3f","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.267993+0000","last_change":"2024-03-16T07:27:22.274449+0000","last_active":"2024-03-16T07:27:23.267993+0000","last_peered":"2024-03-16T07:27:23.267993+0000","last_clean":"2024-03-16T07:27:23.267993+0000","last_became_active":"2024-03-16T07:27:22.274193+0000","last_became_peered":"2024-03-16T07:27:22.274193+0000","last_unstale":"2024-03-16T07:27:23.267993+0000","last_undegraded":"2024-03-16T07:27:23.267993+0000","last_fullsized":"2024-03-16T07:27:23.267993+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_clean_scrub_stamp":"2024-03-16T07:27:21.241337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:48:12.221166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":20,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.262190+0000","last_change":"2024-03-16T07:27:08.932882+0000","last_active":"2024-03-16T07:27:23.262190+0000","last_peered":"2024-03-16T07:27:23.262190+0000","last_clean":"2024-03-16T07:27:23.262190+0000","last_became_active":"2024-03-16T07:27:08.932495+0000","last_became_peered":"2024-03-16T07:27:08.932495+0000","last_unstale":"2024-03-16T07:27:23.262190+0000","last_undegraded":"2024-03-16T07:27:23.262190+0000","last_fullsized":"2024-03-16T07:27:23.262190+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:10:56.597918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.269641+0000","last_change":"2024-03-16T07:27:22.278034+0000","last_active":"2024-03-16T07:27:23.269641+0000","last_peered":"2024-03-16T07:27:23.269641+0000","last_clean":"2024-03-16T07:27:23.269641+0000","last_became_active":"2024-03-16T07:27:22.277810+0000","last_became_peered":"2024-03-16T07:27:22.277810+0000","last_unstale":"2024-03-16T07:27:23.269641+0000","last_undegraded":"2024-03-16T07:27:23.269641+0000","last_fullsized":"2024-03-16T07:27:23.269641+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_clean_scrub_stamp":"2024-03-16T07:27:21.241337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:06:31.293964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":20,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.273260+0000","last_change":"2024-03-16T07:27:08.928677+0000","last_active":"2024-03-16T07:27:23.273260+0000","last_peered":"2024-03-16T07:27:23.273260+0000","last_clean":"2024-03-16T07:27:23.273260+0000","last_became_active":"2024-03-16T07:27:08.928373+0000","last_became_peered":"2024-03-16T07:27:08.928373+0000","last_unstale":"2024-03-16T07:27:23.273260+0000","last_undegraded":"2024-03-16T07:27:23.273260+0000","last_fullsized":"2024-03-16T07:27:23.273260+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:03:40.156407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.265018+0000","last_change":"2024-03-16T07:27:22.270283+0000","last_active":"2024-03-16T07:27:23.265018+0000","last_peered":"2024-03-16T07:27:23.265018+0000","last_clean":"2024-03-16T07:27:23.265018+0000","last_became_active":"2024-03-16T07:27:22.270030+0000","last_became_peered":"2024-03-16T07:27:22.270030+0000","last_unstale":"2024-03-16T07:27:23.265018+0000","last_undegraded":"2024-03-16T07:27:23.265018+0000","last_fullsized":"2024-03-16T07:27:23.265018+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_clean_scrub_stamp":"2024-03-16T07:27:21.241337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:07:01.750870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":20,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.261204+0000","last_change":"2024-03-16T07:27:08.930652+0000","last_active":"2024-03-16T07:27:23.261204+0000","last_peered":"2024-03-16T07:27:23.261204+0000","last_clean":"2024-03-16T07:27:23.261204+0000","last_became_active":"2024-03-16T07:27:08.929994+0000","last_became_peered":"2024-03-16T07:27:08.929994+0000","last_unstale":"2024-03-16T07:27:23.261204+0000","last_undegraded":"2024-03-16T07:27:23.261204+0000","last_fullsized":"2024-03-16T07:27:23.261204+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:49:16.398980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.268725+0000","last_change":"2024-03-16T07:27:22.273842+0000","last_active":"2024-03-16T07:27:23.268725+0000","last_peered":"2024-03-16T07:27:23.268725+0000","last_clean":"2024-03-16T07:27:23.268725+0000","last_became_active":"2024-03-16T07:27:22.273619+0000","last_became_peered":"2024-03-16T07:27:22.273619+0000","last_unstale":"2024-03-16T07:27:23.268725+0000","last_undegraded":"2024-03-16T07:27:23.268725+0000","last_fullsized":"2024-03-16T07:27:23.268725+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_clean_scrub_stamp":"2024-03-16T07:27:21.241337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:45:15.388417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":20,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.271057+0000","last_change":"2024-03-16T07:27:08.927116+0000","last_active":"2024-03-16T07:27:23.271057+0000","last_peered":"2024-03-16T07:27:23.271057+0000","last_clean":"2024-03-16T07:27:23.271057+0000","last_became_active":"2024-03-16T07:27:08.926871+0000","last_became_peered":"2024-03-16T07:27:08.926871+0000","last_unstale":"2024-03-16T07:27:23.271057+0000","last_undegraded":"2024-03-16T07:27:23.271057+0000","last_fullsized":"2024-03-16T07:27:23.271057+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:06:16.049198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.261759+0000","last_change":"2024-03-16T07:27:22.283501+0000","last_active":"2024-03-16T07:27:23.261759+0000","last_peered":"2024-03-16T07:27:23.261759+0000","last_clean":"2024-03-16T07:27:23.261759+0000","last_became_active":"2024-03-16T07:27:22.283260+0000","last_became_peered":"2024-03-16T07:27:22.283260+0000","last_unstale":"2024-03-16T07:27:23.261759+0000","last_undegraded":"2024-03-16T07:27:23.261759+0000","last_fullsized":"2024-03-16T07:27:23.261759+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_clean_scrub_stamp":"2024-03-16T07:27:21.241337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:11:11.164011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":20,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.270119+0000","last_change":"2024-03-16T07:27:08.927253+0000","last_active":"2024-03-16T07:27:23.270119+0000","last_peered":"2024-03-16T07:27:23.270119+0000","last_clean":"2024-03-16T07:27:23.270119+0000","last_became_active":"2024-03-16T07:27:08.926863+0000","last_became_peered":"2024-03-16T07:27:08.926863+0000","last_unstale":"2024-03-16T07:27:23.270119+0000","last_undegraded":"2024-03-16T07:27:23.270119+0000","last_fullsized":"2024-03-16T07:27:23.270119+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:36:21.385242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.259650+0000","last_change":"2024-03-16T07:27:22.274635+0000","last_active":"2024-03-16T07:27:23.259650+0000","last_peered":"2024-03-16T07:27:23.259650+0000","last_clean":"2024-03-16T07:27:23.259650+0000","last_became_active":"2024-03-16T07:27:22.274122+0000","last_became_peered":"2024-03-16T07:27:22.274122+0000","last_unstale":"2024-03-16T07:27:23.259650+0000","last_undegraded":"2024-03-16T07:27:23.259650+0000","last_fullsized":"2024-03-16T07:27:23.259650+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_clean_scrub_stamp":"2024-03-16T07:27:21.241337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:53:21.015589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":20,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.260236+0000","last_change":"2024-03-16T07:27:08.933312+0000","last_active":"2024-03-16T07:27:23.260236+0000","last_peered":"2024-03-16T07:27:23.260236+0000","last_clean":"2024-03-16T07:27:23.260236+0000","last_became_active":"2024-03-16T07:27:08.932097+0000","last_became_peered":"2024-03-16T07:27:08.932097+0000","last_unstale":"2024-03-16T07:27:23.260236+0000","last_undegraded":"2024-03-16T07:27:23.260236+0000","last_fullsized":"2024-03-16T07:27:23.260236+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:26:36.937904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.270642+0000","last_change":"2024-03-16T07:27:22.286894+0000","last_active":"2024-03-16T07:27:23.270642+0000","last_peered":"2024-03-16T07:27:23.270642+0000","last_clean":"2024-03-16T07:27:23.270642+0000","last_became_active":"2024-03-16T07:27:22.286552+0000","last_became_peered":"2024-03-16T07:27:22.286552+0000","last_unstale":"2024-03-16T07:27:23.270642+0000","last_undegraded":"2024-03-16T07:27:23.270642+0000","last_fullsized":"2024-03-16T07:27:23.270642+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_clean_scrub_stamp":"2024-03-16T07:27:21.241337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:40:27.506465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":20,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.267736+0000","last_change":"2024-03-16T07:27:08.924310+0000","last_active":"2024-03-16T07:27:23.267736+0000","last_peered":"2024-03-16T07:27:23.267736+0000","last_clean":"2024-03-16T07:27:23.267736+0000","last_became_active":"2024-03-16T07:27:08.924068+0000","last_became_peered":"2024-03-16T07:27:08.924068+0000","last_unstale":"2024-03-16T07:27:23.267736+0000","last_undegraded":"2024-03-16T07:27:23.267736+0000","last_fullsized":"2024-03-16T07:27:23.267736+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:20:23.064044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.266802+0000","last_change":"2024-03-16T07:27:22.286548+0000","last_active":"2024-03-16T07:27:23.266802+0000","last_peered":"2024-03-16T07:27:23.266802+0000","last_clean":"2024-03-16T07:27:23.266802+0000","last_became_active":"2024-03-16T07:27:22.285800+0000","last_became_peered":"2024-03-16T07:27:22.285800+0000","last_unstale":"2024-03-16T07:27:23.266802+0000","last_undegraded":"2024-03-16T07:27:23.266802+0000","last_fullsized":"2024-03-16T07:27:23.266802+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_clean_scrub_stamp":"2024-03-16T07:27:21.241337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:05:00.308806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":20,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.266163+0000","last_change":"2024-03-16T07:27:08.920122+0000","last_active":"2024-03-16T07:27:23.266163+0000","last_peered":"2024-03-16T07:27:23.266163+0000","last_clean":"2024-03-16T07:27:23.266163+0000","last_became_active":"2024-03-16T07:27:08.919879+0000","last_became_peered":"2024-03-16T07:27:08.919879+0000","last_unstale":"2024-03-16T07:27:23.266163+0000","last_undegraded":"2024-03-16T07:27:23.266163+0000","last_fullsized":"2024-03-16T07:27:23.266163+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:50:55.466512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.264332+0000","last_change":"2024-03-16T07:27:22.283865+0000","last_active":"2024-03-16T07:27:23.264332+0000","last_peered":"2024-03-16T07:27:23.264332+0000","last_clean":"2024-03-16T07:27:23.264332+0000","last_became_active":"2024-03-16T07:27:22.283630+0000","last_became_peered":"2024-03-16T07:27:22.283630+0000","last_unstale":"2024-03-16T07:27:23.264332+0000","last_undegraded":"2024-03-16T07:27:23.264332+0000","last_fullsized":"2024-03-16T07:27:23.264332+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_clean_scrub_stamp":"2024-03-16T07:27:21.241337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:11:36.873806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":20,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.266616+0000","last_change":"2024-03-16T07:27:08.917382+0000","last_active":"2024-03-16T07:27:23.266616+0000","last_peered":"2024-03-16T07:27:23.266616+0000","last_clean":"2024-03-16T07:27:23.266616+0000","last_became_active":"2024-03-16T07:27:08.917137+0000","last_became_peered":"2024-03-16T07:27:08.917137+0000","last_unstale":"2024-03-16T07:27:23.266616+0000","last_undegraded":"2024-03-16T07:27:23.266616+0000","last_fullsized":"2024-03-16T07:27:23.266616+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:10:56.597918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.265549+0000","last_change":"2024-03-16T07:27:22.273849+0000","last_active":"2024-03-16T07:27:23.265549+0000","last_peered":"2024-03-16T07:27:23.265549+0000","last_clean":"2024-03-16T07:27:23.265549+0000","last_became_active":"2024-03-16T07:27:22.273195+0000","last_became_peered":"2024-03-16T07:27:22.273195+0000","last_unstale":"2024-03-16T07:27:23.265549+0000","last_undegraded":"2024-03-16T07:27:23.265549+0000","last_fullsized":"2024-03-16T07:27:23.265549+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_clean_scrub_stamp":"2024-03-16T07:27:21.241337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:06:13.229917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":20,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.267655+0000","last_change":"2024-03-16T07:27:08.922563+0000","last_active":"2024-03-16T07:27:23.267655+0000","last_peered":"2024-03-16T07:27:23.267655+0000","last_clean":"2024-03-16T07:27:23.267655+0000","last_became_active":"2024-03-16T07:27:08.922314+0000","last_became_peered":"2024-03-16T07:27:08.922314+0000","last_unstale":"2024-03-16T07:27:23.267655+0000","last_undegraded":"2024-03-16T07:27:23.267655+0000","last_fullsized":"2024-03-16T07:27:23.267655+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:50:02.719035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.270987+0000","last_change":"2024-03-16T07:27:22.292570+0000","last_active":"2024-03-16T07:27:23.270987+0000","last_peered":"2024-03-16T07:27:23.270987+0000","last_clean":"2024-03-16T07:27:23.270987+0000","last_became_active":"2024-03-16T07:27:22.292332+0000","last_became_peered":"2024-03-16T07:27:22.292332+0000","last_unstale":"2024-03-16T07:27:23.270987+0000","last_undegraded":"2024-03-16T07:27:23.270987+0000","last_fullsized":"2024-03-16T07:27:23.270987+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_clean_scrub_stamp":"2024-03-16T07:27:21.241337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:06:23.016709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":20,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.270660+0000","last_change":"2024-03-16T07:27:08.927980+0000","last_active":"2024-03-16T07:27:23.270660+0000","last_peered":"2024-03-16T07:27:23.270660+0000","last_clean":"2024-03-16T07:27:23.270660+0000","last_became_active":"2024-03-16T07:27:08.927737+0000","last_became_peered":"2024-03-16T07:27:08.927737+0000","last_unstale":"2024-03-16T07:27:23.270660+0000","last_undegraded":"2024-03-16T07:27:23.270660+0000","last_fullsized":"2024-03-16T07:27:23.270660+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:13:53.899556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.260505+0000","last_change":"2024-03-16T07:27:22.281426+0000","last_active":"2024-03-16T07:27:23.260505+0000","last_peered":"2024-03-16T07:27:23.260505+0000","last_clean":"2024-03-16T07:27:23.260505+0000","last_became_active":"2024-03-16T07:27:22.280652+0000","last_became_peered":"2024-03-16T07:27:22.280652+0000","last_unstale":"2024-03-16T07:27:23.260505+0000","last_undegraded":"2024-03-16T07:27:23.260505+0000","last_fullsized":"2024-03-16T07:27:23.260505+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_clean_scrub_stamp":"2024-03-16T07:27:21.241337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:42:55.299515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":20,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.261070+0000","last_change":"2024-03-16T07:27:08.930010+0000","last_active":"2024-03-16T07:27:23.261070+0000","last_peered":"2024-03-16T07:27:23.261070+0000","last_clean":"2024-03-16T07:27:23.261070+0000","last_became_active":"2024-03-16T07:27:08.928878+0000","last_became_peered":"2024-03-16T07:27:08.928878+0000","last_unstale":"2024-03-16T07:27:23.261070+0000","last_undegraded":"2024-03-16T07:27:23.261070+0000","last_fullsized":"2024-03-16T07:27:23.261070+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:10:07.438245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.270230+0000","last_change":"2024-03-16T07:27:22.272091+0000","last_active":"2024-03-16T07:27:23.270230+0000","last_peered":"2024-03-16T07:27:23.270230+0000","last_clean":"2024-03-16T07:27:23.270230+0000","last_became_active":"2024-03-16T07:27:22.271850+0000","last_became_peered":"2024-03-16T07:27:22.271850+0000","last_unstale":"2024-03-16T07:27:23.270230+0000","last_undegraded":"2024-03-16T07:27:23.270230+0000","last_fullsized":"2024-03-16T07:27:23.270230+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_clean_scrub_stamp":"2024-03-16T07:27:21.241337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:56:11.873996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":20,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.270265+0000","last_change":"2024-03-16T07:27:08.921298+0000","last_active":"2024-03-16T07:27:23.270265+0000","last_peered":"2024-03-16T07:27:23.270265+0000","last_clean":"2024-03-16T07:27:23.270265+0000","last_became_active":"2024-03-16T07:27:08.921040+0000","last_became_peered":"2024-03-16T07:27:08.921040+0000","last_unstale":"2024-03-16T07:27:23.270265+0000","last_undegraded":"2024-03-16T07:27:23.270265+0000","last_fullsized":"2024-03-16T07:27:23.270265+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:20:19.699271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.259813+0000","last_change":"2024-03-16T07:27:22.267372+0000","last_active":"2024-03-16T07:27:23.259813+0000","last_peered":"2024-03-16T07:27:23.259813+0000","last_clean":"2024-03-16T07:27:23.259813+0000","last_became_active":"2024-03-16T07:27:22.267086+0000","last_became_peered":"2024-03-16T07:27:22.267086+0000","last_unstale":"2024-03-16T07:27:23.259813+0000","last_undegraded":"2024-03-16T07:27:23.259813+0000","last_fullsized":"2024-03-16T07:27:23.259813+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_clean_scrub_stamp":"2024-03-16T07:27:21.241337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:35:42.596648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":20,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.269303+0000","last_change":"2024-03-16T07:27:08.920197+0000","last_active":"2024-03-16T07:27:23.269303+0000","last_peered":"2024-03-16T07:27:23.269303+0000","last_clean":"2024-03-16T07:27:23.269303+0000","last_became_active":"2024-03-16T07:27:08.919784+0000","last_became_peered":"2024-03-16T07:27:08.919784+0000","last_unstale":"2024-03-16T07:27:23.269303+0000","last_undegraded":"2024-03-16T07:27:23.269303+0000","last_fullsized":"2024-03-16T07:27:23.269303+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:28:47.950665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.261825+0000","last_change":"2024-03-16T07:27:22.268379+0000","last_active":"2024-03-16T07:27:23.261825+0000","last_peered":"2024-03-16T07:27:23.261825+0000","last_clean":"2024-03-16T07:27:23.261825+0000","last_became_active":"2024-03-16T07:27:22.267941+0000","last_became_peered":"2024-03-16T07:27:22.267941+0000","last_unstale":"2024-03-16T07:27:23.261825+0000","last_undegraded":"2024-03-16T07:27:23.261825+0000","last_fullsized":"2024-03-16T07:27:23.261825+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_clean_scrub_stamp":"2024-03-16T07:27:21.241337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:34:28.078295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":20,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.264039+0000","last_change":"2024-03-16T07:27:08.934550+0000","last_active":"2024-03-16T07:27:23.264039+0000","last_peered":"2024-03-16T07:27:23.264039+0000","last_clean":"2024-03-16T07:27:23.264039+0000","last_became_active":"2024-03-16T07:27:08.934318+0000","last_became_peered":"2024-03-16T07:27:08.934318+0000","last_unstale":"2024-03-16T07:27:23.264039+0000","last_undegraded":"2024-03-16T07:27:23.264039+0000","last_fullsized":"2024-03-16T07:27:23.264039+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:07:10.332576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.270563+0000","last_change":"2024-03-16T07:27:22.289852+0000","last_active":"2024-03-16T07:27:23.270563+0000","last_peered":"2024-03-16T07:27:23.270563+0000","last_clean":"2024-03-16T07:27:23.270563+0000","last_became_active":"2024-03-16T07:27:22.289259+0000","last_became_peered":"2024-03-16T07:27:22.289259+0000","last_unstale":"2024-03-16T07:27:23.270563+0000","last_undegraded":"2024-03-16T07:27:23.270563+0000","last_fullsized":"2024-03-16T07:27:23.270563+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_clean_scrub_stamp":"2024-03-16T07:27:21.241337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:57:13.570155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":20,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.262944+0000","last_change":"2024-03-16T07:27:08.929576+0000","last_active":"2024-03-16T07:27:23.262944+0000","last_peered":"2024-03-16T07:27:23.262944+0000","last_clean":"2024-03-16T07:27:23.262944+0000","last_became_active":"2024-03-16T07:27:08.929323+0000","last_became_peered":"2024-03-16T07:27:08.929323+0000","last_unstale":"2024-03-16T07:27:23.262944+0000","last_undegraded":"2024-03-16T07:27:23.262944+0000","last_fullsized":"2024-03-16T07:27:23.262944+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:41:54.146099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.264508+0000","last_change":"2024-03-16T07:27:22.268911+0000","last_active":"2024-03-16T07:27:23.264508+0000","last_peered":"2024-03-16T07:27:23.264508+0000","last_clean":"2024-03-16T07:27:23.264508+0000","last_became_active":"2024-03-16T07:27:22.268654+0000","last_became_peered":"2024-03-16T07:27:22.268654+0000","last_unstale":"2024-03-16T07:27:23.264508+0000","last_undegraded":"2024-03-16T07:27:23.264508+0000","last_fullsized":"2024-03-16T07:27:23.264508+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_clean_scrub_stamp":"2024-03-16T07:27:21.241337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:57:33.603849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":20,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.262434+0000","last_change":"2024-03-16T07:27:08.929159+0000","last_active":"2024-03-16T07:27:23.262434+0000","last_peered":"2024-03-16T07:27:23.262434+0000","last_clean":"2024-03-16T07:27:23.262434+0000","last_became_active":"2024-03-16T07:27:08.928915+0000","last_became_peered":"2024-03-16T07:27:08.928915+0000","last_unstale":"2024-03-16T07:27:23.262434+0000","last_undegraded":"2024-03-16T07:27:23.262434+0000","last_fullsized":"2024-03-16T07:27:23.262434+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:50:55.466512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.265716+0000","last_change":"2024-03-16T07:27:22.273655+0000","last_active":"2024-03-16T07:27:23.265716+0000","last_peered":"2024-03-16T07:27:23.265716+0000","last_clean":"2024-03-16T07:27:23.265716+0000","last_became_active":"2024-03-16T07:27:22.272843+0000","last_became_peered":"2024-03-16T07:27:22.272843+0000","last_unstale":"2024-03-16T07:27:23.265716+0000","last_undegraded":"2024-03-16T07:27:23.265716+0000","last_fullsized":"2024-03-16T07:27:23.265716+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_clean_scrub_stamp":"2024-03-16T07:27:21.241337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:09:32.696904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":20,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.267438+0000","last_change":"2024-03-16T07:27:08.921817+0000","last_active":"2024-03-16T07:27:23.267438+0000","last_peered":"2024-03-16T07:27:23.267438+0000","last_clean":"2024-03-16T07:27:23.267438+0000","last_became_active":"2024-03-16T07:27:08.921104+0000","last_became_peered":"2024-03-16T07:27:08.921104+0000","last_unstale":"2024-03-16T07:27:23.267438+0000","last_undegraded":"2024-03-16T07:27:23.267438+0000","last_fullsized":"2024-03-16T07:27:23.267438+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:07:05.838425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.265033+0000","last_change":"2024-03-16T07:27:22.280587+0000","last_active":"2024-03-16T07:27:23.265033+0000","last_peered":"2024-03-16T07:27:23.265033+0000","last_clean":"2024-03-16T07:27:23.265033+0000","last_became_active":"2024-03-16T07:27:22.280309+0000","last_became_peered":"2024-03-16T07:27:22.280309+0000","last_unstale":"2024-03-16T07:27:23.265033+0000","last_undegraded":"2024-03-16T07:27:23.265033+0000","last_fullsized":"2024-03-16T07:27:23.265033+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_clean_scrub_stamp":"2024-03-16T07:27:21.241337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:53:35.954333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":20,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.270751+0000","last_change":"2024-03-16T07:27:08.920639+0000","last_active":"2024-03-16T07:27:23.270751+0000","last_peered":"2024-03-16T07:27:23.270751+0000","last_clean":"2024-03-16T07:27:23.270751+0000","last_became_active":"2024-03-16T07:27:08.918624+0000","last_became_peered":"2024-03-16T07:27:08.918624+0000","last_unstale":"2024-03-16T07:27:23.270751+0000","last_undegraded":"2024-03-16T07:27:23.270751+0000","last_fullsized":"2024-03-16T07:27:23.270751+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:17:16.011392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.268813+0000","last_change":"2024-03-16T07:27:22.285698+0000","last_active":"2024-03-16T07:27:23.268813+0000","last_peered":"2024-03-16T07:27:23.268813+0000","last_clean":"2024-03-16T07:27:23.268813+0000","last_became_active":"2024-03-16T07:27:22.285442+0000","last_became_peered":"2024-03-16T07:27:22.285442+0000","last_unstale":"2024-03-16T07:27:23.268813+0000","last_undegraded":"2024-03-16T07:27:23.268813+0000","last_fullsized":"2024-03-16T07:27:23.268813+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_clean_scrub_stamp":"2024-03-16T07:27:21.241337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:50:28.325970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":20,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.261069+0000","last_change":"2024-03-16T07:27:08.931009+0000","last_active":"2024-03-16T07:27:23.261069+0000","last_peered":"2024-03-16T07:27:23.261069+0000","last_clean":"2024-03-16T07:27:23.261069+0000","last_became_active":"2024-03-16T07:27:08.930742+0000","last_became_peered":"2024-03-16T07:27:08.930742+0000","last_unstale":"2024-03-16T07:27:23.261069+0000","last_undegraded":"2024-03-16T07:27:23.261069+0000","last_fullsized":"2024-03-16T07:27:23.261069+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:37:57.835321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.273080+0000","last_change":"2024-03-16T07:27:22.295522+0000","last_active":"2024-03-16T07:27:23.273080+0000","last_peered":"2024-03-16T07:27:23.273080+0000","last_clean":"2024-03-16T07:27:23.273080+0000","last_became_active":"2024-03-16T07:27:22.295024+0000","last_became_peered":"2024-03-16T07:27:22.295024+0000","last_unstale":"2024-03-16T07:27:23.273080+0000","last_undegraded":"2024-03-16T07:27:23.273080+0000","last_fullsized":"2024-03-16T07:27:23.273080+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_clean_scrub_stamp":"2024-03-16T07:27:21.241337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:13:21.708658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":20,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.265243+0000","last_change":"2024-03-16T07:27:08.928135+0000","last_active":"2024-03-16T07:27:23.265243+0000","last_peered":"2024-03-16T07:27:23.265243+0000","last_clean":"2024-03-16T07:27:23.265243+0000","last_became_active":"2024-03-16T07:27:08.927873+0000","last_became_peered":"2024-03-16T07:27:08.927873+0000","last_unstale":"2024-03-16T07:27:23.265243+0000","last_undegraded":"2024-03-16T07:27:23.265243+0000","last_fullsized":"2024-03-16T07:27:23.265243+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:30:26.855912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.259962+0000","last_change":"2024-03-16T07:27:22.267818+0000","last_active":"2024-03-16T07:27:23.259962+0000","last_peered":"2024-03-16T07:27:23.259962+0000","last_clean":"2024-03-16T07:27:23.259962+0000","last_became_active":"2024-03-16T07:27:22.267557+0000","last_became_peered":"2024-03-16T07:27:22.267557+0000","last_unstale":"2024-03-16T07:27:23.259962+0000","last_undegraded":"2024-03-16T07:27:23.259962+0000","last_fullsized":"2024-03-16T07:27:23.259962+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_clean_scrub_stamp":"2024-03-16T07:27:21.241337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:48:12.221166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":20,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.266217+0000","last_change":"2024-03-16T07:27:08.923796+0000","last_active":"2024-03-16T07:27:23.266217+0000","last_peered":"2024-03-16T07:27:23.266217+0000","last_clean":"2024-03-16T07:27:23.266217+0000","last_became_active":"2024-03-16T07:27:08.922862+0000","last_became_peered":"2024-03-16T07:27:08.922862+0000","last_unstale":"2024-03-16T07:27:23.266217+0000","last_undegraded":"2024-03-16T07:27:23.266217+0000","last_fullsized":"2024-03-16T07:27:23.266217+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:57:35.040095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.269720+0000","last_change":"2024-03-16T07:27:22.277157+0000","last_active":"2024-03-16T07:27:23.269720+0000","last_peered":"2024-03-16T07:27:23.269720+0000","last_clean":"2024-03-16T07:27:23.269720+0000","last_became_active":"2024-03-16T07:27:22.276930+0000","last_became_peered":"2024-03-16T07:27:22.276930+0000","last_unstale":"2024-03-16T07:27:23.269720+0000","last_undegraded":"2024-03-16T07:27:23.269720+0000","last_fullsized":"2024-03-16T07:27:23.269720+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_clean_scrub_stamp":"2024-03-16T07:27:21.241337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:39:00.344300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":20,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.263472+0000","last_change":"2024-03-16T07:27:08.933535+0000","last_active":"2024-03-16T07:27:23.263472+0000","last_peered":"2024-03-16T07:27:23.263472+0000","last_clean":"2024-03-16T07:27:23.263472+0000","last_became_active":"2024-03-16T07:27:08.932851+0000","last_became_peered":"2024-03-16T07:27:08.932851+0000","last_unstale":"2024-03-16T07:27:23.263472+0000","last_undegraded":"2024-03-16T07:27:23.263472+0000","last_fullsized":"2024-03-16T07:27:23.263472+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:06:07.410185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.270888+0000","last_change":"2024-03-16T07:27:22.289637+0000","last_active":"2024-03-16T07:27:23.270888+0000","last_peered":"2024-03-16T07:27:23.270888+0000","last_clean":"2024-03-16T07:27:23.270888+0000","last_became_active":"2024-03-16T07:27:22.288926+0000","last_became_peered":"2024-03-16T07:27:22.288926+0000","last_unstale":"2024-03-16T07:27:23.270888+0000","last_undegraded":"2024-03-16T07:27:23.270888+0000","last_fullsized":"2024-03-16T07:27:23.270888+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_clean_scrub_stamp":"2024-03-16T07:27:21.241337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:44:34.053308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":20,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.271082+0000","last_change":"2024-03-16T07:27:08.917214+0000","last_active":"2024-03-16T07:27:23.271082+0000","last_peered":"2024-03-16T07:27:23.271082+0000","last_clean":"2024-03-16T07:27:23.271082+0000","last_became_active":"2024-03-16T07:27:08.916970+0000","last_became_peered":"2024-03-16T07:27:08.916970+0000","last_unstale":"2024-03-16T07:27:23.271082+0000","last_undegraded":"2024-03-16T07:27:23.271082+0000","last_fullsized":"2024-03-16T07:27:23.271082+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:26:33.905315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.268134+0000","last_change":"2024-03-16T07:27:22.292302+0000","last_active":"2024-03-16T07:27:23.268134+0000","last_peered":"2024-03-16T07:27:23.268134+0000","last_clean":"2024-03-16T07:27:23.268134+0000","last_became_active":"2024-03-16T07:27:22.292063+0000","last_became_peered":"2024-03-16T07:27:22.292063+0000","last_unstale":"2024-03-16T07:27:23.268134+0000","last_undegraded":"2024-03-16T07:27:23.268134+0000","last_fullsized":"2024-03-16T07:27:23.268134+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_clean_scrub_stamp":"2024-03-16T07:27:21.241337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:35:08.279783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":20,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.270172+0000","last_change":"2024-03-16T07:27:08.918832+0000","last_active":"2024-03-16T07:27:23.270172+0000","last_peered":"2024-03-16T07:27:23.270172+0000","last_clean":"2024-03-16T07:27:23.270172+0000","last_became_active":"2024-03-16T07:27:08.917629+0000","last_became_peered":"2024-03-16T07:27:08.917629+0000","last_unstale":"2024-03-16T07:27:23.270172+0000","last_undegraded":"2024-03-16T07:27:23.270172+0000","last_fullsized":"2024-03-16T07:27:23.270172+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:00:29.829222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.265796+0000","last_change":"2024-03-16T07:27:22.273455+0000","last_active":"2024-03-16T07:27:23.265796+0000","last_peered":"2024-03-16T07:27:23.265796+0000","last_clean":"2024-03-16T07:27:23.265796+0000","last_became_active":"2024-03-16T07:27:22.272849+0000","last_became_peered":"2024-03-16T07:27:22.272849+0000","last_unstale":"2024-03-16T07:27:23.265796+0000","last_undegraded":"2024-03-16T07:27:23.265796+0000","last_fullsized":"2024-03-16T07:27:23.265796+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_clean_scrub_stamp":"2024-03-16T07:27:21.241337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:54:28.380093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":20,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.261984+0000","last_change":"2024-03-16T07:27:08.932888+0000","last_active":"2024-03-16T07:27:23.261984+0000","last_peered":"2024-03-16T07:27:23.261984+0000","last_clean":"2024-03-16T07:27:23.261984+0000","last_became_active":"2024-03-16T07:27:08.932595+0000","last_became_peered":"2024-03-16T07:27:08.932595+0000","last_unstale":"2024-03-16T07:27:23.261984+0000","last_undegraded":"2024-03-16T07:27:23.261984+0000","last_fullsized":"2024-03-16T07:27:23.261984+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:57:35.040095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.270921+0000","last_change":"2024-03-16T07:27:22.292135+0000","last_active":"2024-03-16T07:27:23.270921+0000","last_peered":"2024-03-16T07:27:23.270921+0000","last_clean":"2024-03-16T07:27:23.270921+0000","last_became_active":"2024-03-16T07:27:22.289649+0000","last_became_peered":"2024-03-16T07:27:22.289649+0000","last_unstale":"2024-03-16T07:27:23.270921+0000","last_undegraded":"2024-03-16T07:27:23.270921+0000","last_fullsized":"2024-03-16T07:27:23.270921+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_clean_scrub_stamp":"2024-03-16T07:27:21.241337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:53:13.155674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":20,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.261495+0000","last_change":"2024-03-16T07:27:08.930920+0000","last_active":"2024-03-16T07:27:23.261495+0000","last_peered":"2024-03-16T07:27:23.261495+0000","last_clean":"2024-03-16T07:27:23.261495+0000","last_became_active":"2024-03-16T07:27:08.930391+0000","last_became_peered":"2024-03-16T07:27:08.930391+0000","last_unstale":"2024-03-16T07:27:23.261495+0000","last_undegraded":"2024-03-16T07:27:23.261495+0000","last_fullsized":"2024-03-16T07:27:23.261495+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:39:08.012405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.268879+0000","last_change":"2024-03-16T07:27:22.285226+0000","last_active":"2024-03-16T07:27:23.268879+0000","last_peered":"2024-03-16T07:27:23.268879+0000","last_clean":"2024-03-16T07:27:23.268879+0000","last_became_active":"2024-03-16T07:27:22.284969+0000","last_became_peered":"2024-03-16T07:27:22.284969+0000","last_unstale":"2024-03-16T07:27:23.268879+0000","last_undegraded":"2024-03-16T07:27:23.268879+0000","last_fullsized":"2024-03-16T07:27:23.268879+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_clean_scrub_stamp":"2024-03-16T07:27:21.241337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:50:54.054485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":20,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.265541+0000","last_change":"2024-03-16T07:27:08.930429+0000","last_active":"2024-03-16T07:27:23.265541+0000","last_peered":"2024-03-16T07:27:23.265541+0000","last_clean":"2024-03-16T07:27:23.265541+0000","last_became_active":"2024-03-16T07:27:08.930100+0000","last_became_peered":"2024-03-16T07:27:08.930100+0000","last_unstale":"2024-03-16T07:27:23.265541+0000","last_undegraded":"2024-03-16T07:27:23.265541+0000","last_fullsized":"2024-03-16T07:27:23.265541+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:19:36.463344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.267089+0000","last_change":"2024-03-16T07:27:22.272954+0000","last_active":"2024-03-16T07:27:23.267089+0000","last_peered":"2024-03-16T07:27:23.267089+0000","last_clean":"2024-03-16T07:27:23.267089+0000","last_became_active":"2024-03-16T07:27:22.270983+0000","last_became_peered":"2024-03-16T07:27:22.270983+0000","last_unstale":"2024-03-16T07:27:23.267089+0000","last_undegraded":"2024-03-16T07:27:23.267089+0000","last_fullsized":"2024-03-16T07:27:23.267089+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_clean_scrub_stamp":"2024-03-16T07:27:21.241337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:35:42.596648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":20,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.260067+0000","last_change":"2024-03-16T07:27:08.930019+0000","last_active":"2024-03-16T07:27:23.260067+0000","last_peered":"2024-03-16T07:27:23.260067+0000","last_clean":"2024-03-16T07:27:23.260067+0000","last_became_active":"2024-03-16T07:27:08.929748+0000","last_became_peered":"2024-03-16T07:27:08.929748+0000","last_unstale":"2024-03-16T07:27:23.260067+0000","last_undegraded":"2024-03-16T07:27:23.260067+0000","last_fullsized":"2024-03-16T07:27:23.260067+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:48:33.079226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.265199+0000","last_change":"2024-03-16T07:27:22.280054+0000","last_active":"2024-03-16T07:27:23.265199+0000","last_peered":"2024-03-16T07:27:23.265199+0000","last_clean":"2024-03-16T07:27:23.265199+0000","last_became_active":"2024-03-16T07:27:22.279819+0000","last_became_peered":"2024-03-16T07:27:22.279819+0000","last_unstale":"2024-03-16T07:27:23.265199+0000","last_undegraded":"2024-03-16T07:27:23.265199+0000","last_fullsized":"2024-03-16T07:27:23.265199+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_clean_scrub_stamp":"2024-03-16T07:27:21.241337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:54:25.344109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":20,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.269208+0000","last_change":"2024-03-16T07:27:08.917968+0000","last_active":"2024-03-16T07:27:23.269208+0000","last_peered":"2024-03-16T07:27:23.269208+0000","last_clean":"2024-03-16T07:27:23.269208+0000","last_became_active":"2024-03-16T07:27:08.917728+0000","last_became_peered":"2024-03-16T07:27:08.917728+0000","last_unstale":"2024-03-16T07:27:23.269208+0000","last_undegraded":"2024-03-16T07:27:23.269208+0000","last_fullsized":"2024-03-16T07:27:23.269208+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:46:31.794919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.261597+0000","last_change":"2024-03-16T07:27:22.279744+0000","last_active":"2024-03-16T07:27:23.261597+0000","last_peered":"2024-03-16T07:27:23.261597+0000","last_clean":"2024-03-16T07:27:23.261597+0000","last_became_active":"2024-03-16T07:27:22.279520+0000","last_became_peered":"2024-03-16T07:27:22.279520+0000","last_unstale":"2024-03-16T07:27:23.261597+0000","last_undegraded":"2024-03-16T07:27:23.261597+0000","last_fullsized":"2024-03-16T07:27:23.261597+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_clean_scrub_stamp":"2024-03-16T07:27:21.241337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:08:14.295318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1d","version":"54'2","reported_seq":16,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.262180+0000","last_change":"2024-03-16T07:27:21.274518+0000","last_active":"2024-03-16T07:27:23.262180+0000","last_peered":"2024-03-16T07:27:23.262180+0000","last_clean":"2024-03-16T07:27:23.262180+0000","last_became_active":"2024-03-16T07:27:21.274268+0000","last_became_peered":"2024-03-16T07:27:21.274268+0000","last_unstale":"2024-03-16T07:27:23.262180+0000","last_undegraded":"2024-03-16T07:27:23.262180+0000","last_fullsized":"2024-03-16T07:27:23.262180+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:20.238871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:20.238871+0000","last_clean_scrub_stamp":"2024-03-16T07:27:20.238871+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:45:11.591639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":20,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.271194+0000","last_change":"2024-03-16T07:27:08.923456+0000","last_active":"2024-03-16T07:27:23.271194+0000","last_peered":"2024-03-16T07:27:23.271194+0000","last_clean":"2024-03-16T07:27:23.271194+0000","last_became_active":"2024-03-16T07:27:08.923199+0000","last_became_peered":"2024-03-16T07:27:08.923199+0000","last_unstale":"2024-03-16T07:27:23.271194+0000","last_undegraded":"2024-03-16T07:27:23.271194+0000","last_fullsized":"2024-03-16T07:27:23.271194+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:35:05.623171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"50'4","reported_seq":26,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.270602+0000","last_change":"2024-03-16T07:27:08.238783+0000","last_active":"2024-03-16T07:27:23.270602+0000","last_peered":"2024-03-16T07:27:23.270602+0000","last_clean":"2024-03-16T07:27:23.270602+0000","last_became_active":"2024-03-16T07:27:08.238514+0000","last_became_peered":"2024-03-16T07:27:08.238514+0000","last_unstale":"2024-03-16T07:27:23.270602+0000","last_undegraded":"2024-03-16T07:27:23.270602+0000","last_fullsized":"2024-03-16T07:27:23.270602+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_clean_scrub_stamp":"2024-03-16T07:27:07.221025+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:50:54.465358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.266124+0000","last_change":"2024-03-16T07:27:22.281324+0000","last_active":"2024-03-16T07:27:23.266124+0000","last_peered":"2024-03-16T07:27:23.266124+0000","last_clean":"2024-03-16T07:27:23.266124+0000","last_became_active":"2024-03-16T07:27:22.281111+0000","last_became_peered":"2024-03-16T07:27:22.281111+0000","last_unstale":"2024-03-16T07:27:23.266124+0000","last_undegraded":"2024-03-16T07:27:23.266124+0000","last_fullsized":"2024-03-16T07:27:23.266124+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_clean_scrub_stamp":"2024-03-16T07:27:21.241337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:50:10.293053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1c","version":"54'2","reported_seq":16,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.261764+0000","last_change":"2024-03-16T07:27:21.275728+0000","last_active":"2024-03-16T07:27:23.261764+0000","last_peered":"2024-03-16T07:27:23.261764+0000","last_clean":"2024-03-16T07:27:23.261764+0000","last_became_active":"2024-03-16T07:27:21.275460+0000","last_became_peered":"2024-03-16T07:27:21.275460+0000","last_unstale":"2024-03-16T07:27:23.261764+0000","last_undegraded":"2024-03-16T07:27:23.261764+0000","last_fullsized":"2024-03-16T07:27:23.261764+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:20.238871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:20.238871+0000","last_clean_scrub_stamp":"2024-03-16T07:27:20.238871+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:23:02.151831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":20,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.267840+0000","last_change":"2024-03-16T07:27:08.927216+0000","last_active":"2024-03-16T07:27:23.267840+0000","last_peered":"2024-03-16T07:27:23.267840+0000","last_clean":"2024-03-16T07:27:23.267840+0000","last_became_active":"2024-03-16T07:27:08.926974+0000","last_became_peered":"2024-03-16T07:27:08.926974+0000","last_unstale":"2024-03-16T07:27:23.267840+0000","last_undegraded":"2024-03-16T07:27:23.267840+0000","last_fullsized":"2024-03-16T07:27:23.267840+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:18:39.970785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"50'1","reported_seq":23,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.266258+0000","last_change":"2024-03-16T07:27:08.243342+0000","last_active":"2024-03-16T07:27:23.266258+0000","last_peered":"2024-03-16T07:27:23.266258+0000","last_clean":"2024-03-16T07:27:23.266258+0000","last_became_active":"2024-03-16T07:27:08.243089+0000","last_became_peered":"2024-03-16T07:27:08.243089+0000","last_unstale":"2024-03-16T07:27:23.266258+0000","last_undegraded":"2024-03-16T07:27:23.266258+0000","last_fullsized":"2024-03-16T07:27:23.266258+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_clean_scrub_stamp":"2024-03-16T07:27:07.221025+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:24:56.759854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.262800+0000","last_change":"2024-03-16T07:27:22.283534+0000","last_active":"2024-03-16T07:27:23.262800+0000","last_peered":"2024-03-16T07:27:23.262800+0000","last_clean":"2024-03-16T07:27:23.262800+0000","last_became_active":"2024-03-16T07:27:22.283306+0000","last_became_peered":"2024-03-16T07:27:22.283306+0000","last_unstale":"2024-03-16T07:27:23.262800+0000","last_undegraded":"2024-03-16T07:27:23.262800+0000","last_fullsized":"2024-03-16T07:27:23.262800+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_clean_scrub_stamp":"2024-03-16T07:27:21.241337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:14:08.587828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1f","version":"54'4","reported_seq":18,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.264202+0000","last_change":"2024-03-16T07:27:21.275772+0000","last_active":"2024-03-16T07:27:23.264202+0000","last_peered":"2024-03-16T07:27:23.264202+0000","last_clean":"2024-03-16T07:27:23.264202+0000","last_became_active":"2024-03-16T07:27:21.275507+0000","last_became_peered":"2024-03-16T07:27:21.275507+0000","last_unstale":"2024-03-16T07:27:23.264202+0000","last_undegraded":"2024-03-16T07:27:23.264202+0000","last_fullsized":"2024-03-16T07:27:23.264202+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:20.238871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:20.238871+0000","last_clean_scrub_stamp":"2024-03-16T07:27:20.238871+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:12:46.157621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":20,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.273302+0000","last_change":"2024-03-16T07:27:08.920357+0000","last_active":"2024-03-16T07:27:23.273302+0000","last_peered":"2024-03-16T07:27:23.273302+0000","last_clean":"2024-03-16T07:27:23.273302+0000","last_became_active":"2024-03-16T07:27:08.920136+0000","last_became_peered":"2024-03-16T07:27:08.920136+0000","last_unstale":"2024-03-16T07:27:23.273302+0000","last_undegraded":"2024-03-16T07:27:23.273302+0000","last_fullsized":"2024-03-16T07:27:23.273302+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:33:57.962534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"50'2","reported_seq":24,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.273239+0000","last_change":"2024-03-16T07:27:08.238987+0000","last_active":"2024-03-16T07:27:23.273239+0000","last_peered":"2024-03-16T07:27:23.273239+0000","last_clean":"2024-03-16T07:27:23.273239+0000","last_became_active":"2024-03-16T07:27:08.238719+0000","last_became_peered":"2024-03-16T07:27:08.238719+0000","last_unstale":"2024-03-16T07:27:23.273239+0000","last_undegraded":"2024-03-16T07:27:23.273239+0000","last_fullsized":"2024-03-16T07:27:23.273239+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_clean_scrub_stamp":"2024-03-16T07:27:07.221025+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:41:53.144945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.263633+0000","last_change":"2024-03-16T07:27:22.268781+0000","last_active":"2024-03-16T07:27:23.263633+0000","last_peered":"2024-03-16T07:27:23.263633+0000","last_clean":"2024-03-16T07:27:23.263633+0000","last_became_active":"2024-03-16T07:27:22.268322+0000","last_became_peered":"2024-03-16T07:27:22.268322+0000","last_unstale":"2024-03-16T07:27:23.263633+0000","last_undegraded":"2024-03-16T07:27:23.263633+0000","last_fullsized":"2024-03-16T07:27:23.263633+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_clean_scrub_stamp":"2024-03-16T07:27:21.241337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:35:49.735931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"54'1","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.269932+0000","last_change":"2024-03-16T07:27:21.271493+0000","last_active":"2024-03-16T07:27:23.269932+0000","last_peered":"2024-03-16T07:27:23.269932+0000","last_clean":"2024-03-16T07:27:23.269932+0000","last_became_active":"2024-03-16T07:27:21.271067+0000","last_became_peered":"2024-03-16T07:27:21.271067+0000","last_unstale":"2024-03-16T07:27:23.269932+0000","last_undegraded":"2024-03-16T07:27:23.269932+0000","last_fullsized":"2024-03-16T07:27:23.269932+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:20.238871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:20.238871+0000","last_clean_scrub_stamp":"2024-03-16T07:27:20.238871+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:25:12.594192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":20,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.270265+0000","last_change":"2024-03-16T07:27:08.919220+0000","last_active":"2024-03-16T07:27:23.270265+0000","last_peered":"2024-03-16T07:27:23.270265+0000","last_clean":"2024-03-16T07:27:23.270265+0000","last_became_active":"2024-03-16T07:27:08.918442+0000","last_became_peered":"2024-03-16T07:27:08.918442+0000","last_unstale":"2024-03-16T07:27:23.270265+0000","last_undegraded":"2024-03-16T07:27:23.270265+0000","last_fullsized":"2024-03-16T07:27:23.270265+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:06:48.731712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"50'2","reported_seq":24,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.262319+0000","last_change":"2024-03-16T07:27:08.251673+0000","last_active":"2024-03-16T07:27:23.262319+0000","last_peered":"2024-03-16T07:27:23.262319+0000","last_clean":"2024-03-16T07:27:23.262319+0000","last_became_active":"2024-03-16T07:27:08.251104+0000","last_became_peered":"2024-03-16T07:27:08.251104+0000","last_unstale":"2024-03-16T07:27:23.262319+0000","last_undegraded":"2024-03-16T07:27:23.262319+0000","last_fullsized":"2024-03-16T07:27:23.262319+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_clean_scrub_stamp":"2024-03-16T07:27:07.221025+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:49:03.362326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.259647+0000","last_change":"2024-03-16T07:27:22.266291+0000","last_active":"2024-03-16T07:27:23.259647+0000","last_peered":"2024-03-16T07:27:23.259647+0000","last_clean":"2024-03-16T07:27:23.259647+0000","last_became_active":"2024-03-16T07:27:22.264299+0000","last_became_peered":"2024-03-16T07:27:22.264299+0000","last_unstale":"2024-03-16T07:27:23.259647+0000","last_undegraded":"2024-03-16T07:27:23.259647+0000","last_fullsized":"2024-03-16T07:27:23.259647+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_clean_scrub_stamp":"2024-03-16T07:27:21.241337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:16:19.023929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.265107+0000","last_change":"2024-03-16T07:27:21.262820+0000","last_active":"2024-03-16T07:27:23.265107+0000","last_peered":"2024-03-16T07:27:23.265107+0000","last_clean":"2024-03-16T07:27:23.265107+0000","last_became_active":"2024-03-16T07:27:21.262567+0000","last_became_peered":"2024-03-16T07:27:21.262567+0000","last_unstale":"2024-03-16T07:27:23.265107+0000","last_undegraded":"2024-03-16T07:27:23.265107+0000","last_fullsized":"2024-03-16T07:27:23.265107+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:20.238871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:20.238871+0000","last_clean_scrub_stamp":"2024-03-16T07:27:20.238871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:39:57.514475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":20,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.265746+0000","last_change":"2024-03-16T07:27:08.928496+0000","last_active":"2024-03-16T07:27:23.265746+0000","last_peered":"2024-03-16T07:27:23.265746+0000","last_clean":"2024-03-16T07:27:23.265746+0000","last_became_active":"2024-03-16T07:27:08.927127+0000","last_became_peered":"2024-03-16T07:27:08.927127+0000","last_unstale":"2024-03-16T07:27:23.265746+0000","last_undegraded":"2024-03-16T07:27:23.265746+0000","last_fullsized":"2024-03-16T07:27:23.265746+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:17:26.002153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1b","version":"50'1","reported_seq":23,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.261808+0000","last_change":"2024-03-16T07:27:08.250216+0000","last_active":"2024-03-16T07:27:23.261808+0000","last_peered":"2024-03-16T07:27:23.261808+0000","last_clean":"2024-03-16T07:27:23.261808+0000","last_became_active":"2024-03-16T07:27:08.249406+0000","last_became_peered":"2024-03-16T07:27:08.249406+0000","last_unstale":"2024-03-16T07:27:23.261808+0000","last_undegraded":"2024-03-16T07:27:23.261808+0000","last_fullsized":"2024-03-16T07:27:23.261808+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_clean_scrub_stamp":"2024-03-16T07:27:07.221025+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:47:11.940256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.269043+0000","last_change":"2024-03-16T07:27:22.277190+0000","last_active":"2024-03-16T07:27:23.269043+0000","last_peered":"2024-03-16T07:27:23.269043+0000","last_clean":"2024-03-16T07:27:23.269043+0000","last_became_active":"2024-03-16T07:27:22.276763+0000","last_became_peered":"2024-03-16T07:27:22.276763+0000","last_unstale":"2024-03-16T07:27:23.269043+0000","last_undegraded":"2024-03-16T07:27:23.269043+0000","last_fullsized":"2024-03-16T07:27:23.269043+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_clean_scrub_stamp":"2024-03-16T07:27:21.241337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:55:10.421646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.259968+0000","last_change":"2024-03-16T07:27:21.275113+0000","last_active":"2024-03-16T07:27:23.259968+0000","last_peered":"2024-03-16T07:27:23.259968+0000","last_clean":"2024-03-16T07:27:23.259968+0000","last_became_active":"2024-03-16T07:27:21.274876+0000","last_became_peered":"2024-03-16T07:27:21.274876+0000","last_unstale":"2024-03-16T07:27:23.259968+0000","last_undegraded":"2024-03-16T07:27:23.259968+0000","last_fullsized":"2024-03-16T07:27:23.259968+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:20.238871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:20.238871+0000","last_clean_scrub_stamp":"2024-03-16T07:27:20.238871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:22:56.730540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":20,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.270835+0000","last_change":"2024-03-16T07:27:08.921380+0000","last_active":"2024-03-16T07:27:23.270835+0000","last_peered":"2024-03-16T07:27:23.270835+0000","last_clean":"2024-03-16T07:27:23.270835+0000","last_became_active":"2024-03-16T07:27:08.917937+0000","last_became_peered":"2024-03-16T07:27:08.917937+0000","last_unstale":"2024-03-16T07:27:23.270835+0000","last_undegraded":"2024-03-16T07:27:23.270835+0000","last_fullsized":"2024-03-16T07:27:23.270835+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:06:00.210759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1a","version":"50'1","reported_seq":23,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.271126+0000","last_change":"2024-03-16T07:27:08.245016+0000","last_active":"2024-03-16T07:27:23.271126+0000","last_peered":"2024-03-16T07:27:23.271126+0000","last_clean":"2024-03-16T07:27:23.271126+0000","last_became_active":"2024-03-16T07:27:08.243158+0000","last_became_peered":"2024-03-16T07:27:08.243158+0000","last_unstale":"2024-03-16T07:27:23.271126+0000","last_undegraded":"2024-03-16T07:27:23.271126+0000","last_fullsized":"2024-03-16T07:27:23.271126+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_clean_scrub_stamp":"2024-03-16T07:27:07.221025+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:57:34.038940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.260122+0000","last_change":"2024-03-16T07:27:22.274833+0000","last_active":"2024-03-16T07:27:23.260122+0000","last_peered":"2024-03-16T07:27:23.260122+0000","last_clean":"2024-03-16T07:27:23.260122+0000","last_became_active":"2024-03-16T07:27:22.274411+0000","last_became_peered":"2024-03-16T07:27:22.274411+0000","last_unstale":"2024-03-16T07:27:23.260122+0000","last_undegraded":"2024-03-16T07:27:23.260122+0000","last_fullsized":"2024-03-16T07:27:23.260122+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_clean_scrub_stamp":"2024-03-16T07:27:21.241337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:35:08.279783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1b","version":"54'1","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.260641+0000","last_change":"2024-03-16T07:27:21.275027+0000","last_active":"2024-03-16T07:27:23.260641+0000","last_peered":"2024-03-16T07:27:23.260641+0000","last_clean":"2024-03-16T07:27:23.260641+0000","last_became_active":"2024-03-16T07:27:21.274747+0000","last_became_peered":"2024-03-16T07:27:21.274747+0000","last_unstale":"2024-03-16T07:27:23.260641+0000","last_undegraded":"2024-03-16T07:27:23.260641+0000","last_fullsized":"2024-03-16T07:27:23.260641+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:20.238871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:20.238871+0000","last_clean_scrub_stamp":"2024-03-16T07:27:20.238871+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:46:43.811611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":20,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.260330+0000","last_change":"2024-03-16T07:27:08.931567+0000","last_active":"2024-03-16T07:27:23.260330+0000","last_peered":"2024-03-16T07:27:23.260330+0000","last_clean":"2024-03-16T07:27:23.260330+0000","last_became_active":"2024-03-16T07:27:08.929182+0000","last_became_peered":"2024-03-16T07:27:08.929182+0000","last_unstale":"2024-03-16T07:27:23.260330+0000","last_undegraded":"2024-03-16T07:27:23.260330+0000","last_fullsized":"2024-03-16T07:27:23.260330+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:17:26.002153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":22,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.265261+0000","last_change":"2024-03-16T07:27:08.245798+0000","last_active":"2024-03-16T07:27:23.265261+0000","last_peered":"2024-03-16T07:27:23.265261+0000","last_clean":"2024-03-16T07:27:23.265261+0000","last_became_active":"2024-03-16T07:27:08.245428+0000","last_became_peered":"2024-03-16T07:27:08.245428+0000","last_unstale":"2024-03-16T07:27:23.265261+0000","last_undegraded":"2024-03-16T07:27:23.265261+0000","last_fullsized":"2024-03-16T07:27:23.265261+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_clean_scrub_stamp":"2024-03-16T07:27:07.221025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:04:40.243410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.260343+0000","last_change":"2024-03-16T07:27:22.269788+0000","last_active":"2024-03-16T07:27:23.260343+0000","last_peered":"2024-03-16T07:27:23.260343+0000","last_clean":"2024-03-16T07:27:23.260343+0000","last_became_active":"2024-03-16T07:27:22.269288+0000","last_became_peered":"2024-03-16T07:27:22.269288+0000","last_unstale":"2024-03-16T07:27:23.260343+0000","last_undegraded":"2024-03-16T07:27:23.260343+0000","last_fullsized":"2024-03-16T07:27:23.260343+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_clean_scrub_stamp":"2024-03-16T07:27:21.241337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:56:09.622158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1a","version":"54'1","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.265465+0000","last_change":"2024-03-16T07:27:21.265488+0000","last_active":"2024-03-16T07:27:23.265465+0000","last_peered":"2024-03-16T07:27:23.265465+0000","last_clean":"2024-03-16T07:27:23.265465+0000","last_became_active":"2024-03-16T07:27:21.265246+0000","last_became_peered":"2024-03-16T07:27:21.265246+0000","last_unstale":"2024-03-16T07:27:23.265465+0000","last_undegraded":"2024-03-16T07:27:23.265465+0000","last_fullsized":"2024-03-16T07:27:23.265465+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:20.238871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:20.238871+0000","last_clean_scrub_stamp":"2024-03-16T07:27:20.238871+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:42:27.591646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":20,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.260170+0000","last_change":"2024-03-16T07:27:08.929543+0000","last_active":"2024-03-16T07:27:23.260170+0000","last_peered":"2024-03-16T07:27:23.260170+0000","last_clean":"2024-03-16T07:27:23.260170+0000","last_became_active":"2024-03-16T07:27:08.929296+0000","last_became_peered":"2024-03-16T07:27:08.929296+0000","last_unstale":"2024-03-16T07:27:23.260170+0000","last_undegraded":"2024-03-16T07:27:23.260170+0000","last_fullsized":"2024-03-16T07:27:23.260170+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:07:05.838425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":22,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.269096+0000","last_change":"2024-03-16T07:27:08.244309+0000","last_active":"2024-03-16T07:27:23.269096+0000","last_peered":"2024-03-16T07:27:23.269096+0000","last_clean":"2024-03-16T07:27:23.269096+0000","last_became_active":"2024-03-16T07:27:08.244038+0000","last_became_peered":"2024-03-16T07:27:08.244038+0000","last_unstale":"2024-03-16T07:27:23.269096+0000","last_undegraded":"2024-03-16T07:27:23.269096+0000","last_fullsized":"2024-03-16T07:27:23.269096+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_clean_scrub_stamp":"2024-03-16T07:27:07.221025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:19:01.607856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.270929+0000","last_change":"2024-03-16T07:27:22.276148+0000","last_active":"2024-03-16T07:27:23.270929+0000","last_peered":"2024-03-16T07:27:23.270929+0000","last_clean":"2024-03-16T07:27:23.270929+0000","last_became_active":"2024-03-16T07:27:22.275898+0000","last_became_peered":"2024-03-16T07:27:22.275898+0000","last_unstale":"2024-03-16T07:27:23.270929+0000","last_undegraded":"2024-03-16T07:27:23.270929+0000","last_fullsized":"2024-03-16T07:27:23.270929+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_clean_scrub_stamp":"2024-03-16T07:27:21.241337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:06:54.594481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.15","version":"54'3","reported_seq":17,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.269817+0000","last_change":"2024-03-16T07:27:21.272649+0000","last_active":"2024-03-16T07:27:23.269817+0000","last_peered":"2024-03-16T07:27:23.269817+0000","last_clean":"2024-03-16T07:27:23.269817+0000","last_became_active":"2024-03-16T07:27:21.272346+0000","last_became_peered":"2024-03-16T07:27:21.272346+0000","last_unstale":"2024-03-16T07:27:23.269817+0000","last_undegraded":"2024-03-16T07:27:23.269817+0000","last_fullsized":"2024-03-16T07:27:23.269817+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:20.238871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:20.238871+0000","last_clean_scrub_stamp":"2024-03-16T07:27:20.238871+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:36:41.885605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":20,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.273082+0000","last_change":"2024-03-16T07:27:08.923413+0000","last_active":"2024-03-16T07:27:23.273082+0000","last_peered":"2024-03-16T07:27:23.273082+0000","last_clean":"2024-03-16T07:27:23.273082+0000","last_became_active":"2024-03-16T07:27:08.922819+0000","last_became_peered":"2024-03-16T07:27:08.922819+0000","last_unstale":"2024-03-16T07:27:23.273082+0000","last_undegraded":"2024-03-16T07:27:23.273082+0000","last_fullsized":"2024-03-16T07:27:23.273082+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:32:23.519806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":22,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.267996+0000","last_change":"2024-03-16T07:27:08.245187+0000","last_active":"2024-03-16T07:27:23.267996+0000","last_peered":"2024-03-16T07:27:23.267996+0000","last_clean":"2024-03-16T07:27:23.267996+0000","last_became_active":"2024-03-16T07:27:08.244487+0000","last_became_peered":"2024-03-16T07:27:08.244487+0000","last_unstale":"2024-03-16T07:27:23.267996+0000","last_undegraded":"2024-03-16T07:27:23.267996+0000","last_fullsized":"2024-03-16T07:27:23.267996+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_clean_scrub_stamp":"2024-03-16T07:27:07.221025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:49:03.362326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.261960+0000","last_change":"2024-03-16T07:27:22.268572+0000","last_active":"2024-03-16T07:27:23.261960+0000","last_peered":"2024-03-16T07:27:23.261960+0000","last_clean":"2024-03-16T07:27:23.261960+0000","last_became_active":"2024-03-16T07:27:22.267573+0000","last_became_peered":"2024-03-16T07:27:22.267573+0000","last_unstale":"2024-03-16T07:27:23.261960+0000","last_undegraded":"2024-03-16T07:27:23.261960+0000","last_fullsized":"2024-03-16T07:27:23.261960+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_clean_scrub_stamp":"2024-03-16T07:27:21.241337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:09:35.022955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"54'6","reported_seq":20,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.267112+0000","last_change":"2024-03-16T07:27:21.269957+0000","last_active":"2024-03-16T07:27:23.267112+0000","last_peered":"2024-03-16T07:27:23.267112+0000","last_clean":"2024-03-16T07:27:23.267112+0000","last_became_active":"2024-03-16T07:27:21.269654+0000","last_became_peered":"2024-03-16T07:27:21.269654+0000","last_unstale":"2024-03-16T07:27:23.267112+0000","last_undegraded":"2024-03-16T07:27:23.267112+0000","last_fullsized":"2024-03-16T07:27:23.267112+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:20.238871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:20.238871+0000","last_clean_scrub_stamp":"2024-03-16T07:27:20.238871+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:23:02.151831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":20,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.263966+0000","last_change":"2024-03-16T07:27:08.931465+0000","last_active":"2024-03-16T07:27:23.263966+0000","last_peered":"2024-03-16T07:27:23.263966+0000","last_clean":"2024-03-16T07:27:23.263966+0000","last_became_active":"2024-03-16T07:27:08.930807+0000","last_became_peered":"2024-03-16T07:27:08.930807+0000","last_unstale":"2024-03-16T07:27:23.263966+0000","last_undegraded":"2024-03-16T07:27:23.263966+0000","last_fullsized":"2024-03-16T07:27:23.263966+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:40:24.475299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":22,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.266351+0000","last_change":"2024-03-16T07:27:08.247276+0000","last_active":"2024-03-16T07:27:23.266351+0000","last_peered":"2024-03-16T07:27:23.266351+0000","last_clean":"2024-03-16T07:27:23.266351+0000","last_became_active":"2024-03-16T07:27:08.246996+0000","last_became_peered":"2024-03-16T07:27:08.246996+0000","last_unstale":"2024-03-16T07:27:23.266351+0000","last_undegraded":"2024-03-16T07:27:23.266351+0000","last_fullsized":"2024-03-16T07:27:23.266351+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_clean_scrub_stamp":"2024-03-16T07:27:07.221025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:16:31.977141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.265874+0000","last_change":"2024-03-16T07:27:22.279144+0000","last_active":"2024-03-16T07:27:23.265874+0000","last_peered":"2024-03-16T07:27:23.265874+0000","last_clean":"2024-03-16T07:27:23.265874+0000","last_became_active":"2024-03-16T07:27:22.278898+0000","last_became_peered":"2024-03-16T07:27:22.278898+0000","last_unstale":"2024-03-16T07:27:23.265874+0000","last_undegraded":"2024-03-16T07:27:23.265874+0000","last_fullsized":"2024-03-16T07:27:23.265874+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_clean_scrub_stamp":"2024-03-16T07:27:21.241337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:01:49.721586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.270006+0000","last_change":"2024-03-16T07:27:21.262798+0000","last_active":"2024-03-16T07:27:23.270006+0000","last_peered":"2024-03-16T07:27:23.270006+0000","last_clean":"2024-03-16T07:27:23.270006+0000","last_became_active":"2024-03-16T07:27:21.262521+0000","last_became_peered":"2024-03-16T07:27:21.262521+0000","last_unstale":"2024-03-16T07:27:23.270006+0000","last_undegraded":"2024-03-16T07:27:23.270006+0000","last_fullsized":"2024-03-16T07:27:23.270006+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:20.238871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:20.238871+0000","last_clean_scrub_stamp":"2024-03-16T07:27:20.238871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:11:10.161545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":20,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.267683+0000","last_change":"2024-03-16T07:27:08.927907+0000","last_active":"2024-03-16T07:27:23.267683+0000","last_peered":"2024-03-16T07:27:23.267683+0000","last_clean":"2024-03-16T07:27:23.267683+0000","last_became_active":"2024-03-16T07:27:08.927028+0000","last_became_peered":"2024-03-16T07:27:08.927028+0000","last_unstale":"2024-03-16T07:27:23.267683+0000","last_undegraded":"2024-03-16T07:27:23.267683+0000","last_fullsized":"2024-03-16T07:27:23.267683+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:49:16.398980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"50'3","reported_seq":25,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.262090+0000","last_change":"2024-03-16T07:27:08.251102+0000","last_active":"2024-03-16T07:27:23.262090+0000","last_peered":"2024-03-16T07:27:23.262090+0000","last_clean":"2024-03-16T07:27:23.262090+0000","last_became_active":"2024-03-16T07:27:08.250854+0000","last_became_peered":"2024-03-16T07:27:08.250854+0000","last_unstale":"2024-03-16T07:27:23.262090+0000","last_undegraded":"2024-03-16T07:27:23.262090+0000","last_fullsized":"2024-03-16T07:27:23.262090+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_clean_scrub_stamp":"2024-03-16T07:27:07.221025+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:24:56.759854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.269912+0000","last_change":"2024-03-16T07:27:22.282996+0000","last_active":"2024-03-16T07:27:23.269912+0000","last_peered":"2024-03-16T07:27:23.269912+0000","last_clean":"2024-03-16T07:27:23.269912+0000","last_became_active":"2024-03-16T07:27:22.282763+0000","last_became_peered":"2024-03-16T07:27:22.282763+0000","last_unstale":"2024-03-16T07:27:23.269912+0000","last_undegraded":"2024-03-16T07:27:23.269912+0000","last_fullsized":"2024-03-16T07:27:23.269912+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_clean_scrub_stamp":"2024-03-16T07:27:21.241337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:48:45.075561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.271238+0000","last_change":"2024-03-16T07:27:21.267334+0000","last_active":"2024-03-16T07:27:23.271238+0000","last_peered":"2024-03-16T07:27:23.271238+0000","last_clean":"2024-03-16T07:27:23.271238+0000","last_became_active":"2024-03-16T07:27:21.266070+0000","last_became_peered":"2024-03-16T07:27:21.266070+0000","last_unstale":"2024-03-16T07:27:23.271238+0000","last_undegraded":"2024-03-16T07:27:23.271238+0000","last_fullsized":"2024-03-16T07:27:23.271238+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:20.238871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:20.238871+0000","last_clean_scrub_stamp":"2024-03-16T07:27:20.238871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:02:57.995226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":20,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.266667+0000","last_change":"2024-03-16T07:27:08.921393+0000","last_active":"2024-03-16T07:27:23.266667+0000","last_peered":"2024-03-16T07:27:23.266667+0000","last_clean":"2024-03-16T07:27:23.266667+0000","last_became_active":"2024-03-16T07:27:08.921149+0000","last_became_peered":"2024-03-16T07:27:08.921149+0000","last_unstale":"2024-03-16T07:27:23.266667+0000","last_undegraded":"2024-03-16T07:27:23.266667+0000","last_fullsized":"2024-03-16T07:27:23.266667+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:54:49.472480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.14","version":"51'8","reported_seq":30,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.273356+0000","last_change":"2024-03-16T07:27:08.244864+0000","last_active":"2024-03-16T07:27:23.273356+0000","last_peered":"2024-03-16T07:27:23.273356+0000","last_clean":"2024-03-16T07:27:23.273356+0000","last_became_active":"2024-03-16T07:27:08.244060+0000","last_became_peered":"2024-03-16T07:27:08.244060+0000","last_unstale":"2024-03-16T07:27:23.273356+0000","last_undegraded":"2024-03-16T07:27:23.273356+0000","last_fullsized":"2024-03-16T07:27:23.273356+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_clean_scrub_stamp":"2024-03-16T07:27:07.221025+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:54:48.471326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3309,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.268951+0000","last_change":"2024-03-16T07:27:22.289567+0000","last_active":"2024-03-16T07:27:23.268951+0000","last_peered":"2024-03-16T07:27:23.268951+0000","last_clean":"2024-03-16T07:27:23.268951+0000","last_became_active":"2024-03-16T07:27:22.289088+0000","last_became_peered":"2024-03-16T07:27:22.289088+0000","last_unstale":"2024-03-16T07:27:23.268951+0000","last_undegraded":"2024-03-16T07:27:23.268951+0000","last_fullsized":"2024-03-16T07:27:23.268951+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_clean_scrub_stamp":"2024-03-16T07:27:21.241337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:00:49.446594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.265197+0000","last_change":"2024-03-16T07:27:21.263582+0000","last_active":"2024-03-16T07:27:23.265197+0000","last_peered":"2024-03-16T07:27:23.265197+0000","last_clean":"2024-03-16T07:27:23.265197+0000","last_became_active":"2024-03-16T07:27:21.263335+0000","last_became_peered":"2024-03-16T07:27:21.263335+0000","last_unstale":"2024-03-16T07:27:23.265197+0000","last_undegraded":"2024-03-16T07:27:23.265197+0000","last_fullsized":"2024-03-16T07:27:23.265197+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:20.238871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:20.238871+0000","last_clean_scrub_stamp":"2024-03-16T07:27:20.238871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:21:02.734620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":20,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.265638+0000","last_change":"2024-03-16T07:27:08.928325+0000","last_active":"2024-03-16T07:27:23.265638+0000","last_peered":"2024-03-16T07:27:23.265638+0000","last_clean":"2024-03-16T07:27:23.265638+0000","last_became_active":"2024-03-16T07:27:08.927710+0000","last_became_peered":"2024-03-16T07:27:08.927710+0000","last_unstale":"2024-03-16T07:27:23.265638+0000","last_undegraded":"2024-03-16T07:27:23.265638+0000","last_fullsized":"2024-03-16T07:27:23.265638+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:26:36.937904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"50'2","reported_seq":24,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.267539+0000","last_change":"2024-03-16T07:27:08.246435+0000","last_active":"2024-03-16T07:27:23.267539+0000","last_peered":"2024-03-16T07:27:23.267539+0000","last_clean":"2024-03-16T07:27:23.267539+0000","last_became_active":"2024-03-16T07:27:08.246149+0000","last_became_peered":"2024-03-16T07:27:08.246149+0000","last_unstale":"2024-03-16T07:27:23.267539+0000","last_undegraded":"2024-03-16T07:27:23.267539+0000","last_fullsized":"2024-03-16T07:27:23.267539+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_clean_scrub_stamp":"2024-03-16T07:27:07.221025+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:37:36.164804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.259864+0000","last_change":"2024-03-16T07:27:22.278437+0000","last_active":"2024-03-16T07:27:23.259864+0000","last_peered":"2024-03-16T07:27:23.259864+0000","last_clean":"2024-03-16T07:27:23.259864+0000","last_became_active":"2024-03-16T07:27:22.278151+0000","last_became_peered":"2024-03-16T07:27:22.278151+0000","last_unstale":"2024-03-16T07:27:23.259864+0000","last_undegraded":"2024-03-16T07:27:23.259864+0000","last_fullsized":"2024-03-16T07:27:23.259864+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_clean_scrub_stamp":"2024-03-16T07:27:21.241337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:14:13.471869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"54'8","reported_seq":22,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.266052+0000","last_change":"2024-03-16T07:27:21.269333+0000","last_active":"2024-03-16T07:27:23.266052+0000","last_peered":"2024-03-16T07:27:23.266052+0000","last_clean":"2024-03-16T07:27:23.266052+0000","last_became_active":"2024-03-16T07:27:21.269100+0000","last_became_peered":"2024-03-16T07:27:21.269100+0000","last_unstale":"2024-03-16T07:27:23.266052+0000","last_undegraded":"2024-03-16T07:27:23.266052+0000","last_fullsized":"2024-03-16T07:27:23.266052+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:20.238871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:20.238871+0000","last_clean_scrub_stamp":"2024-03-16T07:27:20.238871+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:40:46.965407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":20,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.261583+0000","last_change":"2024-03-16T07:27:08.931009+0000","last_active":"2024-03-16T07:27:23.261583+0000","last_peered":"2024-03-16T07:27:23.261583+0000","last_clean":"2024-03-16T07:27:23.261583+0000","last_became_active":"2024-03-16T07:27:08.930682+0000","last_became_peered":"2024-03-16T07:27:08.930682+0000","last_unstale":"2024-03-16T07:27:23.261583+0000","last_undegraded":"2024-03-16T07:27:23.261583+0000","last_fullsized":"2024-03-16T07:27:23.261583+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:20:23.064044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":22,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.261192+0000","last_change":"2024-03-16T07:27:08.249638+0000","last_active":"2024-03-16T07:27:23.261192+0000","last_peered":"2024-03-16T07:27:23.261192+0000","last_clean":"2024-03-16T07:27:23.261192+0000","last_became_active":"2024-03-16T07:27:08.249343+0000","last_became_peered":"2024-03-16T07:27:08.249343+0000","last_unstale":"2024-03-16T07:27:23.261192+0000","last_undegraded":"2024-03-16T07:27:23.261192+0000","last_fullsized":"2024-03-16T07:27:23.261192+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_clean_scrub_stamp":"2024-03-16T07:27:07.221025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:47:23.821578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.260275+0000","last_change":"2024-03-16T07:27:22.280856+0000","last_active":"2024-03-16T07:27:23.260275+0000","last_peered":"2024-03-16T07:27:23.260275+0000","last_clean":"2024-03-16T07:27:23.260275+0000","last_became_active":"2024-03-16T07:27:22.275095+0000","last_became_peered":"2024-03-16T07:27:22.275095+0000","last_unstale":"2024-03-16T07:27:23.260275+0000","last_undegraded":"2024-03-16T07:27:23.260275+0000","last_fullsized":"2024-03-16T07:27:23.260275+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_clean_scrub_stamp":"2024-03-16T07:27:21.241337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:36:42.888071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.13","version":"54'2","reported_seq":16,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.267711+0000","last_change":"2024-03-16T07:27:21.265811+0000","last_active":"2024-03-16T07:27:23.267711+0000","last_peered":"2024-03-16T07:27:23.267711+0000","last_clean":"2024-03-16T07:27:23.267711+0000","last_became_active":"2024-03-16T07:27:21.265576+0000","last_became_peered":"2024-03-16T07:27:21.265576+0000","last_unstale":"2024-03-16T07:27:23.267711+0000","last_undegraded":"2024-03-16T07:27:23.267711+0000","last_fullsized":"2024-03-16T07:27:23.267711+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:20.238871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:20.238871+0000","last_clean_scrub_stamp":"2024-03-16T07:27:20.238871+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:31:04.745360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":20,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.266296+0000","last_change":"2024-03-16T07:27:08.923986+0000","last_active":"2024-03-16T07:27:23.266296+0000","last_peered":"2024-03-16T07:27:23.266296+0000","last_clean":"2024-03-16T07:27:23.266296+0000","last_became_active":"2024-03-16T07:27:08.922698+0000","last_became_peered":"2024-03-16T07:27:08.922698+0000","last_unstale":"2024-03-16T07:27:23.266296+0000","last_undegraded":"2024-03-16T07:27:23.266296+0000","last_fullsized":"2024-03-16T07:27:23.266296+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:48:33.079226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":22,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.260286+0000","last_change":"2024-03-16T07:27:08.250046+0000","last_active":"2024-03-16T07:27:23.260286+0000","last_peered":"2024-03-16T07:27:23.260286+0000","last_clean":"2024-03-16T07:27:23.260286+0000","last_became_active":"2024-03-16T07:27:08.249650+0000","last_became_peered":"2024-03-16T07:27:08.249650+0000","last_unstale":"2024-03-16T07:27:23.260286+0000","last_undegraded":"2024-03-16T07:27:23.260286+0000","last_fullsized":"2024-03-16T07:27:23.260286+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_clean_scrub_stamp":"2024-03-16T07:27:07.221025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:37:36.164804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.266761+0000","last_change":"2024-03-16T07:27:22.291589+0000","last_active":"2024-03-16T07:27:23.266761+0000","last_peered":"2024-03-16T07:27:23.266761+0000","last_clean":"2024-03-16T07:27:23.266761+0000","last_became_active":"2024-03-16T07:27:22.291322+0000","last_became_peered":"2024-03-16T07:27:22.291322+0000","last_unstale":"2024-03-16T07:27:23.266761+0000","last_undegraded":"2024-03-16T07:27:23.266761+0000","last_fullsized":"2024-03-16T07:27:23.266761+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_clean_scrub_stamp":"2024-03-16T07:27:21.241337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:16:19.023929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.265493+0000","last_change":"2024-03-16T07:27:21.269104+0000","last_active":"2024-03-16T07:27:23.265493+0000","last_peered":"2024-03-16T07:27:23.265493+0000","last_clean":"2024-03-16T07:27:23.265493+0000","last_became_active":"2024-03-16T07:27:21.268830+0000","last_became_peered":"2024-03-16T07:27:21.268830+0000","last_unstale":"2024-03-16T07:27:23.265493+0000","last_undegraded":"2024-03-16T07:27:23.265493+0000","last_fullsized":"2024-03-16T07:27:23.265493+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:20.238871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:20.238871+0000","last_clean_scrub_stamp":"2024-03-16T07:27:20.238871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:22:56.730540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":20,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.270584+0000","last_change":"2024-03-16T07:27:08.927562+0000","last_active":"2024-03-16T07:27:23.270584+0000","last_peered":"2024-03-16T07:27:23.270584+0000","last_clean":"2024-03-16T07:27:23.270584+0000","last_became_active":"2024-03-16T07:27:08.927206+0000","last_became_peered":"2024-03-16T07:27:08.927206+0000","last_unstale":"2024-03-16T07:27:23.270584+0000","last_undegraded":"2024-03-16T07:27:23.270584+0000","last_fullsized":"2024-03-16T07:27:23.270584+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:49:37.638362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"50'8","reported_seq":30,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.269089+0000","last_change":"2024-03-16T07:27:08.238193+0000","last_active":"2024-03-16T07:27:23.269089+0000","last_peered":"2024-03-16T07:27:23.269089+0000","last_clean":"2024-03-16T07:27:23.269089+0000","last_became_active":"2024-03-16T07:27:08.237926+0000","last_became_peered":"2024-03-16T07:27:08.237926+0000","last_unstale":"2024-03-16T07:27:23.269089+0000","last_undegraded":"2024-03-16T07:27:23.269089+0000","last_fullsized":"2024-03-16T07:27:23.269089+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_clean_scrub_stamp":"2024-03-16T07:27:07.221025+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:20:22.062889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.267019+0000","last_change":"2024-03-16T07:27:22.270109+0000","last_active":"2024-03-16T07:27:23.267019+0000","last_peered":"2024-03-16T07:27:23.267019+0000","last_clean":"2024-03-16T07:27:23.267019+0000","last_became_active":"2024-03-16T07:27:22.269865+0000","last_became_peered":"2024-03-16T07:27:22.269865+0000","last_unstale":"2024-03-16T07:27:23.267019+0000","last_undegraded":"2024-03-16T07:27:23.267019+0000","last_fullsized":"2024-03-16T07:27:23.267019+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_clean_scrub_stamp":"2024-03-16T07:27:21.241337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:55:00.744075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"54'1","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.269928+0000","last_change":"2024-03-16T07:27:21.269885+0000","last_active":"2024-03-16T07:27:23.269928+0000","last_peered":"2024-03-16T07:27:23.269928+0000","last_clean":"2024-03-16T07:27:23.269928+0000","last_became_active":"2024-03-16T07:27:21.269600+0000","last_became_peered":"2024-03-16T07:27:21.269600+0000","last_unstale":"2024-03-16T07:27:23.269928+0000","last_undegraded":"2024-03-16T07:27:23.269928+0000","last_fullsized":"2024-03-16T07:27:23.269928+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:20.238871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:20.238871+0000","last_clean_scrub_stamp":"2024-03-16T07:27:20.238871+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:56:08.619692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":20,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.263031+0000","last_change":"2024-03-16T07:27:08.930378+0000","last_active":"2024-03-16T07:27:23.263031+0000","last_peered":"2024-03-16T07:27:23.263031+0000","last_clean":"2024-03-16T07:27:23.263031+0000","last_became_active":"2024-03-16T07:27:08.929970+0000","last_became_peered":"2024-03-16T07:27:08.929970+0000","last_unstale":"2024-03-16T07:27:23.263031+0000","last_undegraded":"2024-03-16T07:27:23.263031+0000","last_fullsized":"2024-03-16T07:27:23.263031+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:18:39.970785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.f","version":"50'1","reported_seq":23,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.270611+0000","last_change":"2024-03-16T07:27:08.244995+0000","last_active":"2024-03-16T07:27:23.270611+0000","last_peered":"2024-03-16T07:27:23.270611+0000","last_clean":"2024-03-16T07:27:23.270611+0000","last_became_active":"2024-03-16T07:27:08.244700+0000","last_became_peered":"2024-03-16T07:27:08.244700+0000","last_unstale":"2024-03-16T07:27:23.270611+0000","last_undegraded":"2024-03-16T07:27:23.270611+0000","last_fullsized":"2024-03-16T07:27:23.270611+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_clean_scrub_stamp":"2024-03-16T07:27:07.221025+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:07:09.331421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.262041+0000","last_change":"2024-03-16T07:27:22.267153+0000","last_active":"2024-03-16T07:27:23.262041+0000","last_peered":"2024-03-16T07:27:23.262041+0000","last_clean":"2024-03-16T07:27:23.262041+0000","last_became_active":"2024-03-16T07:27:22.266913+0000","last_became_peered":"2024-03-16T07:27:22.266913+0000","last_unstale":"2024-03-16T07:27:23.262041+0000","last_undegraded":"2024-03-16T07:27:23.262041+0000","last_fullsized":"2024-03-16T07:27:23.262041+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_clean_scrub_stamp":"2024-03-16T07:27:21.241337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:44:32.771034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.261845+0000","last_change":"2024-03-16T07:27:21.275446+0000","last_active":"2024-03-16T07:27:23.261845+0000","last_peered":"2024-03-16T07:27:23.261845+0000","last_clean":"2024-03-16T07:27:23.261845+0000","last_became_active":"2024-03-16T07:27:21.275172+0000","last_became_peered":"2024-03-16T07:27:21.275172+0000","last_unstale":"2024-03-16T07:27:23.261845+0000","last_undegraded":"2024-03-16T07:27:23.261845+0000","last_fullsized":"2024-03-16T07:27:23.261845+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:20.238871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:20.238871+0000","last_clean_scrub_stamp":"2024-03-16T07:27:20.238871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:45:04.907341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":20,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.263892+0000","last_change":"2024-03-16T07:27:08.931661+0000","last_active":"2024-03-16T07:27:23.263892+0000","last_peered":"2024-03-16T07:27:23.263892+0000","last_clean":"2024-03-16T07:27:23.263892+0000","last_became_active":"2024-03-16T07:27:08.931137+0000","last_became_peered":"2024-03-16T07:27:08.931137+0000","last_unstale":"2024-03-16T07:27:23.263892+0000","last_undegraded":"2024-03-16T07:27:23.263892+0000","last_fullsized":"2024-03-16T07:27:23.263892+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:30:54.915617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"50'2","reported_seq":24,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.271311+0000","last_change":"2024-03-16T07:27:08.243152+0000","last_active":"2024-03-16T07:27:23.271311+0000","last_peered":"2024-03-16T07:27:23.271311+0000","last_clean":"2024-03-16T07:27:23.271311+0000","last_became_active":"2024-03-16T07:27:08.242667+0000","last_became_peered":"2024-03-16T07:27:08.242667+0000","last_unstale":"2024-03-16T07:27:23.271311+0000","last_undegraded":"2024-03-16T07:27:23.271311+0000","last_fullsized":"2024-03-16T07:27:23.271311+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_clean_scrub_stamp":"2024-03-16T07:27:07.221025+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:18:38.969631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.270883+0000","last_change":"2024-03-16T07:27:22.295507+0000","last_active":"2024-03-16T07:27:23.270883+0000","last_peered":"2024-03-16T07:27:23.270883+0000","last_clean":"2024-03-16T07:27:23.270883+0000","last_became_active":"2024-03-16T07:27:22.295159+0000","last_became_peered":"2024-03-16T07:27:22.295159+0000","last_unstale":"2024-03-16T07:27:23.270883+0000","last_undegraded":"2024-03-16T07:27:23.270883+0000","last_fullsized":"2024-03-16T07:27:23.270883+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_clean_scrub_stamp":"2024-03-16T07:27:21.241337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:55:53.654406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.f","version":"54'1","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.267540+0000","last_change":"2024-03-16T07:27:21.272042+0000","last_active":"2024-03-16T07:27:23.267540+0000","last_peered":"2024-03-16T07:27:23.267540+0000","last_clean":"2024-03-16T07:27:23.267540+0000","last_became_active":"2024-03-16T07:27:21.271805+0000","last_became_peered":"2024-03-16T07:27:21.271805+0000","last_unstale":"2024-03-16T07:27:23.267540+0000","last_undegraded":"2024-03-16T07:27:23.267540+0000","last_fullsized":"2024-03-16T07:27:23.267540+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:20.238871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:20.238871+0000","last_clean_scrub_stamp":"2024-03-16T07:27:20.238871+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:45:04.907341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":20,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.262127+0000","last_change":"2024-03-16T07:27:08.934193+0000","last_active":"2024-03-16T07:27:23.262127+0000","last_peered":"2024-03-16T07:27:23.262127+0000","last_clean":"2024-03-16T07:27:23.262127+0000","last_became_active":"2024-03-16T07:27:08.933927+0000","last_became_peered":"2024-03-16T07:27:08.933927+0000","last_unstale":"2024-03-16T07:27:23.262127+0000","last_undegraded":"2024-03-16T07:27:23.262127+0000","last_fullsized":"2024-03-16T07:27:23.262127+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:54:49.472480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.d","version":"50'1","reported_seq":23,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.262017+0000","last_change":"2024-03-16T07:27:08.251729+0000","last_active":"2024-03-16T07:27:23.262017+0000","last_peered":"2024-03-16T07:27:23.262017+0000","last_clean":"2024-03-16T07:27:23.262017+0000","last_became_active":"2024-03-16T07:27:08.251457+0000","last_became_peered":"2024-03-16T07:27:08.251457+0000","last_unstale":"2024-03-16T07:27:23.262017+0000","last_undegraded":"2024-03-16T07:27:23.262017+0000","last_fullsized":"2024-03-16T07:27:23.262017+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_clean_scrub_stamp":"2024-03-16T07:27:07.221025+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:46:43.084148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.270312+0000","last_change":"2024-03-16T07:27:22.283522+0000","last_active":"2024-03-16T07:27:23.270312+0000","last_peered":"2024-03-16T07:27:23.270312+0000","last_clean":"2024-03-16T07:27:23.270312+0000","last_became_active":"2024-03-16T07:27:22.283301+0000","last_became_peered":"2024-03-16T07:27:22.283301+0000","last_unstale":"2024-03-16T07:27:23.270312+0000","last_undegraded":"2024-03-16T07:27:23.270312+0000","last_fullsized":"2024-03-16T07:27:23.270312+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_clean_scrub_stamp":"2024-03-16T07:27:21.241337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:25:41.291894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.e","version":"54'2","reported_seq":16,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.270581+0000","last_change":"2024-03-16T07:27:21.265339+0000","last_active":"2024-03-16T07:27:23.270581+0000","last_peered":"2024-03-16T07:27:23.270581+0000","last_clean":"2024-03-16T07:27:23.270581+0000","last_became_active":"2024-03-16T07:27:21.265129+0000","last_became_peered":"2024-03-16T07:27:21.265129+0000","last_unstale":"2024-03-16T07:27:23.270581+0000","last_undegraded":"2024-03-16T07:27:23.270581+0000","last_fullsized":"2024-03-16T07:27:23.270581+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:20.238871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:20.238871+0000","last_clean_scrub_stamp":"2024-03-16T07:27:20.238871+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:42:54.297049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":20,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.273139+0000","last_change":"2024-03-16T07:27:08.921973+0000","last_active":"2024-03-16T07:27:23.273139+0000","last_peered":"2024-03-16T07:27:23.273139+0000","last_clean":"2024-03-16T07:27:23.273139+0000","last_became_active":"2024-03-16T07:27:08.921742+0000","last_became_peered":"2024-03-16T07:27:08.921742+0000","last_unstale":"2024-03-16T07:27:23.273139+0000","last_undegraded":"2024-03-16T07:27:23.273139+0000","last_fullsized":"2024-03-16T07:27:23.273139+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:54:12.324951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":22,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.273398+0000","last_change":"2024-03-16T07:27:08.244296+0000","last_active":"2024-03-16T07:27:23.273398+0000","last_peered":"2024-03-16T07:27:23.273398+0000","last_clean":"2024-03-16T07:27:23.273398+0000","last_became_active":"2024-03-16T07:27:08.243822+0000","last_became_peered":"2024-03-16T07:27:08.243822+0000","last_unstale":"2024-03-16T07:27:23.273398+0000","last_undegraded":"2024-03-16T07:27:23.273398+0000","last_fullsized":"2024-03-16T07:27:23.273398+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_clean_scrub_stamp":"2024-03-16T07:27:07.221025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:10:55.596764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.259797+0000","last_change":"2024-03-16T07:27:22.265726+0000","last_active":"2024-03-16T07:27:23.259797+0000","last_peered":"2024-03-16T07:27:23.259797+0000","last_clean":"2024-03-16T07:27:23.259797+0000","last_became_active":"2024-03-16T07:27:22.263998+0000","last_became_peered":"2024-03-16T07:27:22.263998+0000","last_unstale":"2024-03-16T07:27:23.259797+0000","last_undegraded":"2024-03-16T07:27:23.259797+0000","last_fullsized":"2024-03-16T07:27:23.259797+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_clean_scrub_stamp":"2024-03-16T07:27:21.241337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:55:00.744075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.269918+0000","last_change":"2024-03-16T07:27:21.271974+0000","last_active":"2024-03-16T07:27:23.269918+0000","last_peered":"2024-03-16T07:27:23.269918+0000","last_clean":"2024-03-16T07:27:23.269918+0000","last_became_active":"2024-03-16T07:27:21.271724+0000","last_became_peered":"2024-03-16T07:27:21.271724+0000","last_unstale":"2024-03-16T07:27:23.269918+0000","last_undegraded":"2024-03-16T07:27:23.269918+0000","last_fullsized":"2024-03-16T07:27:23.269918+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:20.238871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:20.238871+0000","last_clean_scrub_stamp":"2024-03-16T07:27:20.238871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:33:02.086261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":20,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.265756+0000","last_change":"2024-03-16T07:27:08.923667+0000","last_active":"2024-03-16T07:27:23.265756+0000","last_peered":"2024-03-16T07:27:23.265756+0000","last_clean":"2024-03-16T07:27:23.265756+0000","last_became_active":"2024-03-16T07:27:08.923410+0000","last_became_peered":"2024-03-16T07:27:08.923410+0000","last_unstale":"2024-03-16T07:27:23.265756+0000","last_undegraded":"2024-03-16T07:27:23.265756+0000","last_fullsized":"2024-03-16T07:27:23.265756+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:10:07.438245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.b","version":"50'2","reported_seq":24,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.271229+0000","last_change":"2024-03-16T07:27:08.235239+0000","last_active":"2024-03-16T07:27:23.271229+0000","last_peered":"2024-03-16T07:27:23.271229+0000","last_clean":"2024-03-16T07:27:23.271229+0000","last_became_active":"2024-03-16T07:27:08.234873+0000","last_became_peered":"2024-03-16T07:27:08.234873+0000","last_unstale":"2024-03-16T07:27:23.271229+0000","last_undegraded":"2024-03-16T07:27:23.271229+0000","last_fullsized":"2024-03-16T07:27:23.271229+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_clean_scrub_stamp":"2024-03-16T07:27:07.221025+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:30:53.914463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.259697+0000","last_change":"2024-03-16T07:27:22.263699+0000","last_active":"2024-03-16T07:27:23.259697+0000","last_peered":"2024-03-16T07:27:23.259697+0000","last_clean":"2024-03-16T07:27:23.259697+0000","last_became_active":"2024-03-16T07:27:22.263003+0000","last_became_peered":"2024-03-16T07:27:22.263003+0000","last_unstale":"2024-03-16T07:27:23.259697+0000","last_undegraded":"2024-03-16T07:27:23.259697+0000","last_fullsized":"2024-03-16T07:27:23.259697+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_clean_scrub_stamp":"2024-03-16T07:27:21.241337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:05:00.308806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.269309+0000","last_change":"2024-03-16T07:27:21.271597+0000","last_active":"2024-03-16T07:27:23.269309+0000","last_peered":"2024-03-16T07:27:23.269309+0000","last_clean":"2024-03-16T07:27:23.269309+0000","last_became_active":"2024-03-16T07:27:21.271351+0000","last_became_peered":"2024-03-16T07:27:21.271351+0000","last_unstale":"2024-03-16T07:27:23.269309+0000","last_undegraded":"2024-03-16T07:27:23.269309+0000","last_fullsized":"2024-03-16T07:27:23.269309+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:20.238871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:20.238871+0000","last_clean_scrub_stamp":"2024-03-16T07:27:20.238871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:32:02.334526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":20,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.270930+0000","last_change":"2024-03-16T07:27:08.920383+0000","last_active":"2024-03-16T07:27:23.270930+0000","last_peered":"2024-03-16T07:27:23.270930+0000","last_clean":"2024-03-16T07:27:23.270930+0000","last_became_active":"2024-03-16T07:27:08.918297+0000","last_became_peered":"2024-03-16T07:27:08.918297+0000","last_unstale":"2024-03-16T07:27:23.270930+0000","last_undegraded":"2024-03-16T07:27:23.270930+0000","last_fullsized":"2024-03-16T07:27:23.270930+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:53:22.005176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":22,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.266175+0000","last_change":"2024-03-16T07:27:08.246964+0000","last_active":"2024-03-16T07:27:23.266175+0000","last_peered":"2024-03-16T07:27:23.266175+0000","last_clean":"2024-03-16T07:27:23.266175+0000","last_became_active":"2024-03-16T07:27:08.246688+0000","last_became_peered":"2024-03-16T07:27:08.246688+0000","last_unstale":"2024-03-16T07:27:23.266175+0000","last_undegraded":"2024-03-16T07:27:23.266175+0000","last_fullsized":"2024-03-16T07:27:23.266175+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_clean_scrub_stamp":"2024-03-16T07:27:07.221025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:47:11.940256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.260909+0000","last_change":"2024-03-16T07:27:22.270013+0000","last_active":"2024-03-16T07:27:23.260909+0000","last_peered":"2024-03-16T07:27:23.260909+0000","last_clean":"2024-03-16T07:27:23.260909+0000","last_became_active":"2024-03-16T07:27:22.269543+0000","last_became_peered":"2024-03-16T07:27:22.269543+0000","last_unstale":"2024-03-16T07:27:23.260909+0000","last_undegraded":"2024-03-16T07:27:23.260909+0000","last_fullsized":"2024-03-16T07:27:23.260909+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_clean_scrub_stamp":"2024-03-16T07:27:21.241337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:32:03.336993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.260721+0000","last_change":"2024-03-16T07:27:21.267414+0000","last_active":"2024-03-16T07:27:23.260721+0000","last_peered":"2024-03-16T07:27:23.260721+0000","last_clean":"2024-03-16T07:27:23.260721+0000","last_became_active":"2024-03-16T07:27:21.267182+0000","last_became_peered":"2024-03-16T07:27:21.267182+0000","last_unstale":"2024-03-16T07:27:23.260721+0000","last_undegraded":"2024-03-16T07:27:23.260721+0000","last_fullsized":"2024-03-16T07:27:23.260721+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:20.238871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:20.238871+0000","last_clean_scrub_stamp":"2024-03-16T07:27:20.238871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:36:33.401934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":20,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.270979+0000","last_change":"2024-03-16T07:27:08.917472+0000","last_active":"2024-03-16T07:27:23.270979+0000","last_peered":"2024-03-16T07:27:23.270979+0000","last_clean":"2024-03-16T07:27:23.270979+0000","last_became_active":"2024-03-16T07:27:08.917235+0000","last_became_peered":"2024-03-16T07:27:08.917235+0000","last_unstale":"2024-03-16T07:27:23.270979+0000","last_undegraded":"2024-03-16T07:27:23.270979+0000","last_fullsized":"2024-03-16T07:27:23.270979+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:17:13.539054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":22,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.266526+0000","last_change":"2024-03-16T07:27:08.247978+0000","last_active":"2024-03-16T07:27:23.266526+0000","last_peered":"2024-03-16T07:27:23.266526+0000","last_clean":"2024-03-16T07:27:23.266526+0000","last_became_active":"2024-03-16T07:27:08.247725+0000","last_became_peered":"2024-03-16T07:27:08.247725+0000","last_unstale":"2024-03-16T07:27:23.266526+0000","last_undegraded":"2024-03-16T07:27:23.266526+0000","last_fullsized":"2024-03-16T07:27:23.266526+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_clean_scrub_stamp":"2024-03-16T07:27:07.221025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:06:16.181760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.271101+0000","last_change":"2024-03-16T07:27:22.284995+0000","last_active":"2024-03-16T07:27:23.271101+0000","last_peered":"2024-03-16T07:27:23.271101+0000","last_clean":"2024-03-16T07:27:23.271101+0000","last_became_active":"2024-03-16T07:27:22.284758+0000","last_became_peered":"2024-03-16T07:27:22.284758+0000","last_unstale":"2024-03-16T07:27:23.271101+0000","last_undegraded":"2024-03-16T07:27:23.271101+0000","last_fullsized":"2024-03-16T07:27:23.271101+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_clean_scrub_stamp":"2024-03-16T07:27:21.241337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:41:30.103982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.262751+0000","last_change":"2024-03-16T07:27:21.270847+0000","last_active":"2024-03-16T07:27:23.262751+0000","last_peered":"2024-03-16T07:27:23.262751+0000","last_clean":"2024-03-16T07:27:23.262751+0000","last_became_active":"2024-03-16T07:27:21.270592+0000","last_became_peered":"2024-03-16T07:27:21.270592+0000","last_unstale":"2024-03-16T07:27:23.262751+0000","last_undegraded":"2024-03-16T07:27:23.262751+0000","last_fullsized":"2024-03-16T07:27:23.262751+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:20.238871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:20.238871+0000","last_clean_scrub_stamp":"2024-03-16T07:27:20.238871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:28:59.967357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":20,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.263105+0000","last_change":"2024-03-16T07:27:08.930514+0000","last_active":"2024-03-16T07:27:23.263105+0000","last_peered":"2024-03-16T07:27:23.263105+0000","last_clean":"2024-03-16T07:27:23.263105+0000","last_became_active":"2024-03-16T07:27:08.930278+0000","last_became_peered":"2024-03-16T07:27:08.930278+0000","last_unstale":"2024-03-16T07:27:23.263105+0000","last_undegraded":"2024-03-16T07:27:23.263105+0000","last_fullsized":"2024-03-16T07:27:23.263105+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:17:47.855918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"50'2","reported_seq":24,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.268093+0000","last_change":"2024-03-16T07:27:08.242744+0000","last_active":"2024-03-16T07:27:23.268093+0000","last_peered":"2024-03-16T07:27:23.268093+0000","last_clean":"2024-03-16T07:27:23.268093+0000","last_became_active":"2024-03-16T07:27:08.242491+0000","last_became_peered":"2024-03-16T07:27:08.242491+0000","last_unstale":"2024-03-16T07:27:23.268093+0000","last_undegraded":"2024-03-16T07:27:23.268093+0000","last_fullsized":"2024-03-16T07:27:23.268093+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_clean_scrub_stamp":"2024-03-16T07:27:07.221025+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:16:47.057318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.266284+0000","last_change":"2024-03-16T07:27:22.273286+0000","last_active":"2024-03-16T07:27:23.266284+0000","last_peered":"2024-03-16T07:27:23.266284+0000","last_clean":"2024-03-16T07:27:23.266284+0000","last_became_active":"2024-03-16T07:27:22.271299+0000","last_became_peered":"2024-03-16T07:27:22.271299+0000","last_unstale":"2024-03-16T07:27:23.266284+0000","last_undegraded":"2024-03-16T07:27:23.266284+0000","last_fullsized":"2024-03-16T07:27:23.266284+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_clean_scrub_stamp":"2024-03-16T07:27:21.241337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:19:34.390055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.271203+0000","last_change":"2024-03-16T07:27:21.265961+0000","last_active":"2024-03-16T07:27:23.271203+0000","last_peered":"2024-03-16T07:27:23.271203+0000","last_clean":"2024-03-16T07:27:23.271203+0000","last_became_active":"2024-03-16T07:27:21.265596+0000","last_became_peered":"2024-03-16T07:27:21.265596+0000","last_unstale":"2024-03-16T07:27:23.271203+0000","last_undegraded":"2024-03-16T07:27:23.271203+0000","last_fullsized":"2024-03-16T07:27:23.271203+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:20.238871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:20.238871+0000","last_clean_scrub_stamp":"2024-03-16T07:27:20.238871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:08:13.292852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":20,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.263814+0000","last_change":"2024-03-16T07:27:08.932487+0000","last_active":"2024-03-16T07:27:23.263814+0000","last_peered":"2024-03-16T07:27:23.263814+0000","last_clean":"2024-03-16T07:27:23.263814+0000","last_became_active":"2024-03-16T07:27:08.932022+0000","last_became_peered":"2024-03-16T07:27:08.932022+0000","last_unstale":"2024-03-16T07:27:23.263814+0000","last_undegraded":"2024-03-16T07:27:23.263814+0000","last_fullsized":"2024-03-16T07:27:23.263814+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:05:56.498565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.6","version":"51'1","reported_seq":23,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.273168+0000","last_change":"2024-03-16T07:27:08.242924+0000","last_active":"2024-03-16T07:27:23.273168+0000","last_peered":"2024-03-16T07:27:23.273168+0000","last_clean":"2024-03-16T07:27:23.273168+0000","last_became_active":"2024-03-16T07:27:08.242277+0000","last_became_peered":"2024-03-16T07:27:08.242277+0000","last_unstale":"2024-03-16T07:27:23.273168+0000","last_undegraded":"2024-03-16T07:27:23.273168+0000","last_fullsized":"2024-03-16T07:27:23.273168+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_clean_scrub_stamp":"2024-03-16T07:27:07.221025+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:40:23.474145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.269774+0000","last_change":"2024-03-16T07:27:22.286070+0000","last_active":"2024-03-16T07:27:23.269774+0000","last_peered":"2024-03-16T07:27:23.269774+0000","last_clean":"2024-03-16T07:27:23.269774+0000","last_became_active":"2024-03-16T07:27:22.285838+0000","last_became_peered":"2024-03-16T07:27:22.285838+0000","last_unstale":"2024-03-16T07:27:23.269774+0000","last_undegraded":"2024-03-16T07:27:23.269774+0000","last_fullsized":"2024-03-16T07:27:23.269774+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_clean_scrub_stamp":"2024-03-16T07:27:21.241337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:38:53.945424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"54'2","reported_seq":16,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.270116+0000","last_change":"2024-03-16T07:27:21.264843+0000","last_active":"2024-03-16T07:27:23.270116+0000","last_peered":"2024-03-16T07:27:23.270116+0000","last_clean":"2024-03-16T07:27:23.270116+0000","last_became_active":"2024-03-16T07:27:21.264601+0000","last_became_peered":"2024-03-16T07:27:21.264601+0000","last_unstale":"2024-03-16T07:27:23.270116+0000","last_undegraded":"2024-03-16T07:27:23.270116+0000","last_fullsized":"2024-03-16T07:27:23.270116+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:20.238871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:20.238871+0000","last_clean_scrub_stamp":"2024-03-16T07:27:20.238871+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:34:27.075829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":20,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.267805+0000","last_change":"2024-03-16T07:27:08.922001+0000","last_active":"2024-03-16T07:27:23.267805+0000","last_peered":"2024-03-16T07:27:23.267805+0000","last_clean":"2024-03-16T07:27:23.267805+0000","last_became_active":"2024-03-16T07:27:08.921584+0000","last_became_peered":"2024-03-16T07:27:08.921584+0000","last_unstale":"2024-03-16T07:27:23.267805+0000","last_undegraded":"2024-03-16T07:27:23.267805+0000","last_fullsized":"2024-03-16T07:27:23.267805+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:19:02.609010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":22,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.266761+0000","last_change":"2024-03-16T07:27:08.248496+0000","last_active":"2024-03-16T07:27:23.266761+0000","last_peered":"2024-03-16T07:27:23.266761+0000","last_clean":"2024-03-16T07:27:23.266761+0000","last_became_active":"2024-03-16T07:27:08.247244+0000","last_became_peered":"2024-03-16T07:27:08.247244+0000","last_unstale":"2024-03-16T07:27:23.266761+0000","last_undegraded":"2024-03-16T07:27:23.266761+0000","last_fullsized":"2024-03-16T07:27:23.266761+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_clean_scrub_stamp":"2024-03-16T07:27:07.221025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:59:09.394985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.267528+0000","last_change":"2024-03-16T07:27:22.292293+0000","last_active":"2024-03-16T07:27:23.267528+0000","last_peered":"2024-03-16T07:27:23.267528+0000","last_clean":"2024-03-16T07:27:23.267528+0000","last_became_active":"2024-03-16T07:27:22.291730+0000","last_became_peered":"2024-03-16T07:27:22.291730+0000","last_unstale":"2024-03-16T07:27:23.267528+0000","last_undegraded":"2024-03-16T07:27:23.267528+0000","last_fullsized":"2024-03-16T07:27:23.267528+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_clean_scrub_stamp":"2024-03-16T07:27:21.241337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:14:13.471869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.6","version":"55'1","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.268032+0000","last_change":"2024-03-16T07:27:21.263333+0000","last_active":"2024-03-16T07:27:23.268032+0000","last_peered":"2024-03-16T07:27:23.268032+0000","last_clean":"2024-03-16T07:27:23.268032+0000","last_became_active":"2024-03-16T07:27:21.263108+0000","last_became_peered":"2024-03-16T07:27:21.263108+0000","last_unstale":"2024-03-16T07:27:23.268032+0000","last_undegraded":"2024-03-16T07:27:23.268032+0000","last_fullsized":"2024-03-16T07:27:23.268032+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:20.238871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:20.238871+0000","last_clean_scrub_stamp":"2024-03-16T07:27:20.238871+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:11:02.361626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":20,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.273146+0000","last_change":"2024-03-16T07:27:08.918934+0000","last_active":"2024-03-16T07:27:23.273146+0000","last_peered":"2024-03-16T07:27:23.273146+0000","last_clean":"2024-03-16T07:27:23.273146+0000","last_became_active":"2024-03-16T07:27:08.917309+0000","last_became_peered":"2024-03-16T07:27:08.917309+0000","last_unstale":"2024-03-16T07:27:23.273146+0000","last_undegraded":"2024-03-16T07:27:23.273146+0000","last_fullsized":"2024-03-16T07:27:23.273146+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:10:33.238201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":22,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.262405+0000","last_change":"2024-03-16T07:27:08.251830+0000","last_active":"2024-03-16T07:27:23.262405+0000","last_peered":"2024-03-16T07:27:23.262405+0000","last_clean":"2024-03-16T07:27:23.262405+0000","last_became_active":"2024-03-16T07:27:08.251478+0000","last_became_peered":"2024-03-16T07:27:08.251478+0000","last_unstale":"2024-03-16T07:27:23.262405+0000","last_undegraded":"2024-03-16T07:27:23.262405+0000","last_fullsized":"2024-03-16T07:27:23.262405+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_clean_scrub_stamp":"2024-03-16T07:27:07.221025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:16:47.057318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.265948+0000","last_change":"2024-03-16T07:27:22.281804+0000","last_active":"2024-03-16T07:27:23.265948+0000","last_peered":"2024-03-16T07:27:23.265948+0000","last_clean":"2024-03-16T07:27:23.265948+0000","last_became_active":"2024-03-16T07:27:22.281439+0000","last_became_peered":"2024-03-16T07:27:22.281439+0000","last_unstale":"2024-03-16T07:27:23.265948+0000","last_undegraded":"2024-03-16T07:27:23.265948+0000","last_fullsized":"2024-03-16T07:27:23.265948+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_clean_scrub_stamp":"2024-03-16T07:27:21.241337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:35:29.662821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.269291+0000","last_change":"2024-03-16T07:27:21.270079+0000","last_active":"2024-03-16T07:27:23.269291+0000","last_peered":"2024-03-16T07:27:23.269291+0000","last_clean":"2024-03-16T07:27:23.269291+0000","last_became_active":"2024-03-16T07:27:21.269588+0000","last_became_peered":"2024-03-16T07:27:21.269588+0000","last_unstale":"2024-03-16T07:27:23.269291+0000","last_undegraded":"2024-03-16T07:27:23.269291+0000","last_fullsized":"2024-03-16T07:27:23.269291+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:20.238871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:20.238871+0000","last_clean_scrub_stamp":"2024-03-16T07:27:20.238871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:35:07.277317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":20,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.266106+0000","last_change":"2024-03-16T07:27:08.928147+0000","last_active":"2024-03-16T07:27:23.266106+0000","last_peered":"2024-03-16T07:27:23.266106+0000","last_clean":"2024-03-16T07:27:23.266106+0000","last_became_active":"2024-03-16T07:27:08.927393+0000","last_became_peered":"2024-03-16T07:27:08.927393+0000","last_unstale":"2024-03-16T07:27:23.266106+0000","last_undegraded":"2024-03-16T07:27:23.266106+0000","last_fullsized":"2024-03-16T07:27:23.266106+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:39:08.012405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":22,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.266916+0000","last_change":"2024-03-16T07:27:08.240204+0000","last_active":"2024-03-16T07:27:23.266916+0000","last_peered":"2024-03-16T07:27:23.266916+0000","last_clean":"2024-03-16T07:27:23.266916+0000","last_became_active":"2024-03-16T07:27:08.239950+0000","last_became_peered":"2024-03-16T07:27:08.239950+0000","last_unstale":"2024-03-16T07:27:23.266916+0000","last_undegraded":"2024-03-16T07:27:23.266916+0000","last_fullsized":"2024-03-16T07:27:23.266916+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_clean_scrub_stamp":"2024-03-16T07:27:07.221025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:47:23.821578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.269195+0000","last_change":"2024-03-16T07:27:22.276979+0000","last_active":"2024-03-16T07:27:23.269195+0000","last_peered":"2024-03-16T07:27:23.269195+0000","last_clean":"2024-03-16T07:27:23.269195+0000","last_became_active":"2024-03-16T07:27:22.276453+0000","last_became_peered":"2024-03-16T07:27:22.276453+0000","last_unstale":"2024-03-16T07:27:23.269195+0000","last_undegraded":"2024-03-16T07:27:23.269195+0000","last_fullsized":"2024-03-16T07:27:23.269195+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_clean_scrub_stamp":"2024-03-16T07:27:21.241337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:31:47.108446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.260060+0000","last_change":"2024-03-16T07:27:21.275143+0000","last_active":"2024-03-16T07:27:23.260060+0000","last_peered":"2024-03-16T07:27:23.260060+0000","last_clean":"2024-03-16T07:27:23.260060+0000","last_became_active":"2024-03-16T07:27:21.274890+0000","last_became_peered":"2024-03-16T07:27:21.274890+0000","last_unstale":"2024-03-16T07:27:23.260060+0000","last_undegraded":"2024-03-16T07:27:23.260060+0000","last_fullsized":"2024-03-16T07:27:23.260060+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:20.238871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:20.238871+0000","last_clean_scrub_stamp":"2024-03-16T07:27:20.238871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:53:17.204808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":20,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.271022+0000","last_change":"2024-03-16T07:27:08.920819+0000","last_active":"2024-03-16T07:27:23.271022+0000","last_peered":"2024-03-16T07:27:23.271022+0000","last_clean":"2024-03-16T07:27:23.271022+0000","last_became_active":"2024-03-16T07:27:08.918934+0000","last_became_peered":"2024-03-16T07:27:08.918934+0000","last_unstale":"2024-03-16T07:27:23.271022+0000","last_undegraded":"2024-03-16T07:27:23.271022+0000","last_fullsized":"2024-03-16T07:27:23.271022+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:53:22.935175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":22,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.261266+0000","last_change":"2024-03-16T07:27:08.250052+0000","last_active":"2024-03-16T07:27:23.261266+0000","last_peered":"2024-03-16T07:27:23.261266+0000","last_clean":"2024-03-16T07:27:23.261266+0000","last_became_active":"2024-03-16T07:27:08.249750+0000","last_became_peered":"2024-03-16T07:27:08.249750+0000","last_unstale":"2024-03-16T07:27:23.261266+0000","last_undegraded":"2024-03-16T07:27:23.261266+0000","last_fullsized":"2024-03-16T07:27:23.261266+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_clean_scrub_stamp":"2024-03-16T07:27:07.221025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:04:40.243410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.260421+0000","last_change":"2024-03-16T07:27:22.279020+0000","last_active":"2024-03-16T07:27:23.260421+0000","last_peered":"2024-03-16T07:27:23.260421+0000","last_clean":"2024-03-16T07:27:23.260421+0000","last_became_active":"2024-03-16T07:27:22.275392+0000","last_became_peered":"2024-03-16T07:27:22.275392+0000","last_unstale":"2024-03-16T07:27:23.260421+0000","last_undegraded":"2024-03-16T07:27:23.260421+0000","last_fullsized":"2024-03-16T07:27:23.260421+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_clean_scrub_stamp":"2024-03-16T07:27:21.241337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:25:13.596658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.260725+0000","last_change":"2024-03-16T07:27:21.275300+0000","last_active":"2024-03-16T07:27:23.260725+0000","last_peered":"2024-03-16T07:27:23.260725+0000","last_clean":"2024-03-16T07:27:23.260725+0000","last_became_active":"2024-03-16T07:27:21.275036+0000","last_became_peered":"2024-03-16T07:27:21.275036+0000","last_unstale":"2024-03-16T07:27:23.260725+0000","last_undegraded":"2024-03-16T07:27:23.260725+0000","last_fullsized":"2024-03-16T07:27:23.260725+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:20.238871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:20.238871+0000","last_clean_scrub_stamp":"2024-03-16T07:27:20.238871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:53:28.969746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":20,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.266378+0000","last_change":"2024-03-16T07:27:08.927243+0000","last_active":"2024-03-16T07:27:23.266378+0000","last_peered":"2024-03-16T07:27:23.266378+0000","last_clean":"2024-03-16T07:27:23.266378+0000","last_became_active":"2024-03-16T07:27:08.926939+0000","last_became_peered":"2024-03-16T07:27:08.926939+0000","last_unstale":"2024-03-16T07:27:23.266378+0000","last_undegraded":"2024-03-16T07:27:23.266378+0000","last_fullsized":"2024-03-16T07:27:23.266378+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:37:57.835321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":22,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.265326+0000","last_change":"2024-03-16T07:27:08.241445+0000","last_active":"2024-03-16T07:27:23.265326+0000","last_peered":"2024-03-16T07:27:23.265326+0000","last_clean":"2024-03-16T07:27:23.265326+0000","last_became_active":"2024-03-16T07:27:08.241129+0000","last_became_peered":"2024-03-16T07:27:08.241129+0000","last_unstale":"2024-03-16T07:27:23.265326+0000","last_undegraded":"2024-03-16T07:27:23.265326+0000","last_fullsized":"2024-03-16T07:27:23.265326+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_clean_scrub_stamp":"2024-03-16T07:27:07.221025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:46:43.084148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.260482+0000","last_change":"2024-03-16T07:27:22.282426+0000","last_active":"2024-03-16T07:27:23.260482+0000","last_peered":"2024-03-16T07:27:23.260482+0000","last_clean":"2024-03-16T07:27:23.260482+0000","last_became_active":"2024-03-16T07:27:22.281277+0000","last_became_peered":"2024-03-16T07:27:22.281277+0000","last_unstale":"2024-03-16T07:27:23.260482+0000","last_undegraded":"2024-03-16T07:27:23.260482+0000","last_fullsized":"2024-03-16T07:27:23.260482+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_clean_scrub_stamp":"2024-03-16T07:27:21.241337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:02:58.997692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.265564+0000","last_change":"2024-03-16T07:27:21.266121+0000","last_active":"2024-03-16T07:27:23.265564+0000","last_peered":"2024-03-16T07:27:23.265564+0000","last_clean":"2024-03-16T07:27:23.265564+0000","last_became_active":"2024-03-16T07:27:21.265892+0000","last_became_peered":"2024-03-16T07:27:21.265892+0000","last_unstale":"2024-03-16T07:27:23.265564+0000","last_undegraded":"2024-03-16T07:27:23.265564+0000","last_fullsized":"2024-03-16T07:27:23.265564+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:20.238871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:20.238871+0000","last_clean_scrub_stamp":"2024-03-16T07:27:20.238871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:53:17.204808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":20,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.271230+0000","last_change":"2024-03-16T07:27:08.918028+0000","last_active":"2024-03-16T07:27:23.271230+0000","last_peered":"2024-03-16T07:27:23.271230+0000","last_clean":"2024-03-16T07:27:23.271230+0000","last_became_active":"2024-03-16T07:27:08.917397+0000","last_became_peered":"2024-03-16T07:27:08.917397+0000","last_unstale":"2024-03-16T07:27:23.271230+0000","last_undegraded":"2024-03-16T07:27:23.271230+0000","last_fullsized":"2024-03-16T07:27:23.271230+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:53:24.331820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":22,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.266617+0000","last_change":"2024-03-16T07:27:08.239510+0000","last_active":"2024-03-16T07:27:23.266617+0000","last_peered":"2024-03-16T07:27:23.266617+0000","last_clean":"2024-03-16T07:27:23.266617+0000","last_became_active":"2024-03-16T07:27:08.239209+0000","last_became_peered":"2024-03-16T07:27:08.239209+0000","last_unstale":"2024-03-16T07:27:23.266617+0000","last_undegraded":"2024-03-16T07:27:23.266617+0000","last_fullsized":"2024-03-16T07:27:23.266617+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_clean_scrub_stamp":"2024-03-16T07:27:07.221025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:08:11.994734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.265351+0000","last_change":"2024-03-16T07:27:22.277358+0000","last_active":"2024-03-16T07:27:23.265351+0000","last_peered":"2024-03-16T07:27:23.265351+0000","last_clean":"2024-03-16T07:27:23.265351+0000","last_became_active":"2024-03-16T07:27:22.276938+0000","last_became_peered":"2024-03-16T07:27:22.276938+0000","last_unstale":"2024-03-16T07:27:23.265351+0000","last_undegraded":"2024-03-16T07:27:23.265351+0000","last_fullsized":"2024-03-16T07:27:23.265351+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:21.241337+0000","last_clean_scrub_stamp":"2024-03-16T07:27:21.241337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:10:46.257358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"54'2","reported_seq":16,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.266866+0000","last_change":"2024-03-16T07:27:21.263898+0000","last_active":"2024-03-16T07:27:23.266866+0000","last_peered":"2024-03-16T07:27:23.266866+0000","last_clean":"2024-03-16T07:27:23.266866+0000","last_became_active":"2024-03-16T07:27:21.263684+0000","last_became_peered":"2024-03-16T07:27:21.263684+0000","last_unstale":"2024-03-16T07:27:23.266866+0000","last_undegraded":"2024-03-16T07:27:23.266866+0000","last_fullsized":"2024-03-16T07:27:23.266866+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:20.238871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:20.238871+0000","last_clean_scrub_stamp":"2024-03-16T07:27:20.238871+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:17:03.017639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":20,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.260554+0000","last_change":"2024-03-16T07:27:08.929726+0000","last_active":"2024-03-16T07:27:23.260554+0000","last_peered":"2024-03-16T07:27:23.260554+0000","last_clean":"2024-03-16T07:27:23.260554+0000","last_became_active":"2024-03-16T07:27:08.929485+0000","last_became_peered":"2024-03-16T07:27:08.929485+0000","last_unstale":"2024-03-16T07:27:23.260554+0000","last_undegraded":"2024-03-16T07:27:23.260554+0000","last_fullsized":"2024-03-16T07:27:23.260554+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:08.222179+0000","last_clean_scrub_stamp":"2024-03-16T07:27:08.222179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:50:02.719035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":22,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.271108+0000","last_change":"2024-03-16T07:27:08.247274+0000","last_active":"2024-03-16T07:27:23.271108+0000","last_peered":"2024-03-16T07:27:23.271108+0000","last_clean":"2024-03-16T07:27:23.271108+0000","last_became_active":"2024-03-16T07:27:08.243679+0000","last_became_peered":"2024-03-16T07:27:08.243679+0000","last_unstale":"2024-03-16T07:27:23.271108+0000","last_undegraded":"2024-03-16T07:27:23.271108+0000","last_fullsized":"2024-03-16T07:27:23.271108+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:27:07.221025+0000","last_clean_scrub_stamp":"2024-03-16T07:27:07.221025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:17:46.854764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"35'119","reported_seq":299,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-16T07:27:23.266850+0000","last_change":"2024-03-16T07:24:31.650537+0000","last_active":"2024-03-16T07:27:23.266850+0000","last_peered":"2024-03-16T07:27:23.266850+0000","last_clean":"2024-03-16T07:27:23.266850+0000","last_became_active":"2024-03-16T07:24:31.649574+0000","last_became_peered":"2024-03-16T07:24:31.649574+0000","last_unstale":"2024-03-16T07:27:23.266850+0000","last_undegraded":"2024-03-16T07:27:23.266850+0000","last_fullsized":"2024-03-16T07:27:23.266850+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:29.719970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:29.719970+0000","last_clean_scrub_stamp":"2024-03-16T07:24:29.719970+0000","objects_scrubbed":0,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:31:35.774554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":298,"num_read_kb":503,"num_write":177,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":4107,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":8214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":298,"num_read_kb":503,"num_write":177,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738405,"num_pgs":138,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":31772,"kb_used_data":584,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":104825828,"statfs":{"total":107374182400,"available":107341647872,"internally_reserved":0,"allocated":598016,"data_stored":211615,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738405,"num_pgs":122,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":32332,"kb_used_data":1144,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":104825268,"statfs":{"total":107374182400,"available":107341074432,"internally_reserved":0,"allocated":1171456,"data_stored":799074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738405,"num_pgs":126,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":32320,"kb_used_data":1132,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":104825280,"statfs":{"total":107374182400,"available":107341086720,"internally_reserved":0,"allocated":1159168,"data_stored":800121,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3913,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":3525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-16T07:27:26.850 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-03-16T07:27:26.850 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T07:27:27.251 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:27:27.251 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":39,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4888,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6827/1901069637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":1901069637},{"type":"v1","addr":"172.21.15.49:6827","nonce":1901069637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30},{"gid":4891,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6829/512304085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":512304085},{"type":"v1","addr":"172.21.15.49:6829","nonce":512304085}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30},{"gid":4894,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6833/2341714657","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":2341714657},{"type":"v1","addr":"172.21.15.49:6833","nonce":2341714657}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-16T07:27:08.607433+0000","modified":"2024-03-16T07:27:10.583409+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4898},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4898":{"gid":4898,"name":"d","rank":0,"incarnation":31,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6835/3239577766","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":3239577766},{"type":"v1","addr":"172.21.15.49:6835","nonce":3239577766}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4898,"qdb_cluster":[4898]},"id":4},{"mdsmap":{"epoch":39,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-16T07:27:21.615388+0000","modified":"2024-03-16T07:27:24.746731+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4895},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4895":{"gid":4895,"name":"b","rank":0,"incarnation":35,"state":"up:active","state_seq":6,"addr":"172.21.15.49:6832/849811345","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6831","nonce":849811345},{"type":"v1","addr":"172.21.15.49:6832","nonce":849811345}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"backup_fs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4895,"qdb_cluster":[4895]},"id":5}]} 2024-03-16T07:27:27.251 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 39 2024-03-16T07:27:27.766 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 39, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-03-16T07:27:21.615388+0000', 'modified': '2024-03-16T07:27:24.746731+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4895}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4895': {'gid': 4895, 'name': 'b', 'rank': 0, 'incarnation': 35, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.49:6832/849811345', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.49:6831', 'nonce': 849811345}, {'type': 'v1', 'addr': '172.21.15.49:6832', 'nonce': 849811345}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [11], 'metadata_pool': 10, 'enabled': True, 'fs_name': 'backup_fs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4895, 'qdb_cluster': [4895]} 2024-03-16T07:27:27.766 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-03-16T07:27:27.767 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-03-16T07:27:27.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-16T07:27:27.940+0000 7fe6e4ff9640 0 client.5030 ms_handle_reset on v2:172.21.15.49:6831/849811345 2024-03-16T07:27:27.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-16T07:27:27.967+0000 7fe6e4ff9640 0 client.5032 ms_handle_reset on v2:172.21.15.49:6831/849811345 2024-03-16T07:27:27.965 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-03-16T07:27:27.966 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_fsid": "f91af061-9eac-4793-87fa-8d27ae3d242f", 2024-03-16T07:27:27.966 INFO:teuthology.orchestra.run.smithi049.stdout: "whoami": 0, 2024-03-16T07:27:27.966 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 4895, 2024-03-16T07:27:27.966 INFO:teuthology.orchestra.run.smithi049.stdout: "want_state": "up:active", 2024-03-16T07:27:27.966 INFO:teuthology.orchestra.run.smithi049.stdout: "state": "up:active", 2024-03-16T07:27:27.966 INFO:teuthology.orchestra.run.smithi049.stdout: "fs_name": "backup_fs", 2024-03-16T07:27:27.966 INFO:teuthology.orchestra.run.smithi049.stdout: "rank_uptime": 5.7123106650000004, 2024-03-16T07:27:27.966 INFO:teuthology.orchestra.run.smithi049.stdout: "mdsmap_epoch": 39, 2024-03-16T07:27:27.966 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch": 55, 2024-03-16T07:27:27.966 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch_barrier": 55, 2024-03-16T07:27:27.966 INFO:teuthology.orchestra.run.smithi049.stdout: "uptime": 24.017766752 2024-03-16T07:27:27.966 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-03-16T07:27:27.977 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable mirroring 2024-03-16T07:27:29.291 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:27:29.292 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p d1/d2/d3) 2024-03-16T07:27:29.312 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-03-16T07:27:29.312 DEBUG:teuthology.orchestra.run.smithi049:counter dump for fs: cephfs> ceph --admin-daemon /var/run/ceph/cephfs-mirror.asok counter dump 2024-03-16T07:27:29.456 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-03-16T07:27:29.456 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker": [ 2024-03-16T07:27:29.456 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:27:29.457 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:27:29.457 INFO:teuthology.orchestra.run.smithi049.stdout: "id": "0" 2024-03-16T07:27:29.457 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:27:29.457 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:27:29.457 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_ready_timeouts": 0, 2024-03-16T07:27:29.457 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_idle_timeouts": 0 2024-03-16T07:27:29.457 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:29.457 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:27:29.457 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:27:29.457 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:27:29.457 INFO:teuthology.orchestra.run.smithi049.stdout: "id": "1" 2024-03-16T07:27:29.457 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:27:29.457 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:27:29.457 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_ready_timeouts": 0, 2024-03-16T07:27:29.458 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_idle_timeouts": 0 2024-03-16T07:27:29.458 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:29.458 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:27:29.458 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:27:29.458 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:27:29.458 INFO:teuthology.orchestra.run.smithi049.stdout: "id": "2" 2024-03-16T07:27:29.458 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:27:29.458 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:27:29.458 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_ready_timeouts": 0, 2024-03-16T07:27:29.458 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_idle_timeouts": 0 2024-03-16T07:27:29.458 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:29.458 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:29.458 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:27:29.458 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-0": [ 2024-03-16T07:27:29.459 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:27:29.459 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:27:29.459 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:27:29.459 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 3, 2024-03-16T07:27:29.459 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 31, 2024-03-16T07:27:29.459 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 432, 2024-03-16T07:27:29.459 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 244560, 2024-03-16T07:27:29.459 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 7, 2024-03-16T07:27:29.459 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 3, 2024-03-16T07:27:29.459 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 0.189287637, 2024-03-16T07:27:29.459 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.046184014, 2024-03-16T07:27:29.459 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 0.125163038, 2024-03-16T07:27:29.459 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-03-16T07:27:29.459 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T07:27:29.459 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 28, 2024-03-16T07:27:29.460 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.128017942, 2024-03-16T07:27:29.460 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.004572069 2024-03-16T07:27:29.460 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:27:29.460 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-03-16T07:27:29.460 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:27:29.460 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:27:29.460 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:27:29.460 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:27:29.460 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 432, 2024-03-16T07:27:29.460 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 244560 2024-03-16T07:27:29.460 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:29.460 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:29.460 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:27:29.460 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-1": [ 2024-03-16T07:27:29.460 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:27:29.460 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:27:29.461 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:27:29.461 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 33, 2024-03-16T07:27:29.461 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 3, 2024-03-16T07:27:29.461 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 131808, 2024-03-16T07:27:29.461 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 464, 2024-03-16T07:27:29.461 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 3, 2024-03-16T07:27:29.461 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 0, 2024-03-16T07:27:29.461 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 0.259441949, 2024-03-16T07:27:29.461 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.001798943, 2024-03-16T07:27:29.461 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 0.170045701, 2024-03-16T07:27:29.461 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.083993176, 2024-03-16T07:27:29.461 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T07:27:29.461 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 3, 2024-03-16T07:27:29.461 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.054357270, 2024-03-16T07:27:29.461 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.018119090 2024-03-16T07:27:29.462 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:27:29.462 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-03-16T07:27:29.462 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:27:29.462 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:27:29.462 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:27:29.462 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:27:29.462 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 131808, 2024-03-16T07:27:29.462 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 464 2024-03-16T07:27:29.462 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:29.462 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:29.462 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:27:29.462 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-2": [ 2024-03-16T07:27:29.462 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:27:29.462 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:27:29.462 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:27:29.463 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 19, 2024-03-16T07:27:29.463 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 6, 2024-03-16T07:27:29.463 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 551984, 2024-03-16T07:27:29.463 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 928, 2024-03-16T07:27:29.463 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 2, 2024-03-16T07:27:29.463 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 1, 2024-03-16T07:27:29.463 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 0.328306985, 2024-03-16T07:27:29.463 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.004602564, 2024-03-16T07:27:29.463 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 0.649948418, 2024-03-16T07:27:29.463 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-03-16T07:27:29.463 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T07:27:29.463 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 6, 2024-03-16T07:27:29.463 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.158362306, 2024-03-16T07:27:29.463 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.026393717 2024-03-16T07:27:29.463 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:27:29.464 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-03-16T07:27:29.464 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:27:29.464 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:27:29.464 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:27:29.464 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:27:29.464 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 551984, 2024-03-16T07:27:29.464 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 928 2024-03-16T07:27:29.464 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:29.464 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:29.464 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:27:29.464 INFO:teuthology.orchestra.run.smithi049.stdout: "cct": [ 2024-03-16T07:27:29.464 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:27:29.464 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:27:29.464 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:27:29.464 INFO:teuthology.orchestra.run.smithi049.stdout: "total_workers": 0, 2024-03-16T07:27:29.464 INFO:teuthology.orchestra.run.smithi049.stdout: "unhealthy_workers": 0 2024-03-16T07:27:29.465 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:29.465 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:29.465 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:27:29.465 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs_mirror": [ 2024-03-16T07:27:29.465 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:27:29.465 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:27:29.465 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:27:29.465 INFO:teuthology.orchestra.run.smithi049.stdout: "mirrored_filesystems": 0, 2024-03-16T07:27:29.465 INFO:teuthology.orchestra.run.smithi049.stdout: "mirror_enable_failures": 0 2024-03-16T07:27:29.465 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:29.465 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:29.465 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:27:29.465 INFO:teuthology.orchestra.run.smithi049.stdout: "mempool": [ 2024-03-16T07:27:29.465 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:27:29.465 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:27:29.466 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:27:29.466 INFO:teuthology.orchestra.run.smithi049.stdout: "bloom_filter_bytes": 0, 2024-03-16T07:27:29.466 INFO:teuthology.orchestra.run.smithi049.stdout: "bloom_filter_items": 0, 2024-03-16T07:27:29.466 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_alloc_bytes": 0, 2024-03-16T07:27:29.466 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_alloc_items": 0, 2024-03-16T07:27:29.466 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_data_bytes": 0, 2024-03-16T07:27:29.466 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_data_items": 0, 2024-03-16T07:27:29.466 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_onode_bytes": 0, 2024-03-16T07:27:29.466 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_onode_items": 0, 2024-03-16T07:27:29.466 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_meta_bytes": 0, 2024-03-16T07:27:29.466 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_meta_items": 0, 2024-03-16T07:27:29.466 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_other_bytes": 0, 2024-03-16T07:27:29.466 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_other_items": 0, 2024-03-16T07:27:29.466 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_buffer_bytes": 0, 2024-03-16T07:27:29.466 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_buffer_items": 0, 2024-03-16T07:27:29.467 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_extent_bytes": 0, 2024-03-16T07:27:29.467 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_extent_items": 0, 2024-03-16T07:27:29.467 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_blob_bytes": 0, 2024-03-16T07:27:29.467 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_blob_items": 0, 2024-03-16T07:27:29.467 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_shared_blob_bytes": 0, 2024-03-16T07:27:29.467 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_shared_blob_items": 0, 2024-03-16T07:27:29.467 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_inline_bl_bytes": 0, 2024-03-16T07:27:29.467 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_inline_bl_items": 0, 2024-03-16T07:27:29.467 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_fsck_bytes": 0, 2024-03-16T07:27:29.467 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_fsck_items": 0, 2024-03-16T07:27:29.467 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_txc_bytes": 0, 2024-03-16T07:27:29.467 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_txc_items": 0, 2024-03-16T07:27:29.467 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_deferred_bytes": 0, 2024-03-16T07:27:29.467 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_deferred_items": 0, 2024-03-16T07:27:29.467 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_bytes": 0, 2024-03-16T07:27:29.468 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_items": 0, 2024-03-16T07:27:29.468 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_bytes": 0, 2024-03-16T07:27:29.468 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_items": 0, 2024-03-16T07:27:29.468 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_reader_bytes": 0, 2024-03-16T07:27:29.468 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_reader_items": 0, 2024-03-16T07:27:29.468 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_writer_bytes": 0, 2024-03-16T07:27:29.468 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_writer_items": 0, 2024-03-16T07:27:29.468 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_anon_bytes": 148386, 2024-03-16T07:27:29.468 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_anon_items": 24, 2024-03-16T07:27:29.468 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_meta_bytes": 0, 2024-03-16T07:27:29.468 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_meta_items": 0, 2024-03-16T07:27:29.468 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_bytes": 0, 2024-03-16T07:27:29.468 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_items": 0, 2024-03-16T07:27:29.468 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_mapbl_bytes": 0, 2024-03-16T07:27:29.468 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_mapbl_items": 0, 2024-03-16T07:27:29.469 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pglog_bytes": 0, 2024-03-16T07:27:29.469 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pglog_items": 0, 2024-03-16T07:27:29.469 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_bytes": 4824, 2024-03-16T07:27:29.469 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_items": 52, 2024-03-16T07:27:29.469 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_mapping_bytes": 0, 2024-03-16T07:27:29.469 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_mapping_items": 0, 2024-03-16T07:27:29.469 INFO:teuthology.orchestra.run.smithi049.stdout: "pgmap_bytes": 0, 2024-03-16T07:27:29.469 INFO:teuthology.orchestra.run.smithi049.stdout: "pgmap_items": 0, 2024-03-16T07:27:29.469 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_co_bytes": 0, 2024-03-16T07:27:29.469 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_co_items": 0, 2024-03-16T07:27:29.469 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_1_bytes": 0, 2024-03-16T07:27:29.469 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_1_items": 0, 2024-03-16T07:27:29.469 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_2_bytes": 0, 2024-03-16T07:27:29.469 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_2_items": 0 2024-03-16T07:27:29.469 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:29.469 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:29.470 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:27:29.470 INFO:teuthology.orchestra.run.smithi049.stdout: "objecter": [ 2024-03-16T07:27:29.470 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:27:29.470 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:27:29.470 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:27:29.470 INFO:teuthology.orchestra.run.smithi049.stdout: "op_active": 0, 2024-03-16T07:27:29.470 INFO:teuthology.orchestra.run.smithi049.stdout: "op_laggy": 0, 2024-03-16T07:27:29.470 INFO:teuthology.orchestra.run.smithi049.stdout: "op_send": 0, 2024-03-16T07:27:29.470 INFO:teuthology.orchestra.run.smithi049.stdout: "op_send_bytes": 0, 2024-03-16T07:27:29.470 INFO:teuthology.orchestra.run.smithi049.stdout: "op_resend": 0, 2024-03-16T07:27:29.470 INFO:teuthology.orchestra.run.smithi049.stdout: "op_reply": 0, 2024-03-16T07:27:29.470 INFO:teuthology.orchestra.run.smithi049.stdout: "op_latency": { 2024-03-16T07:27:29.470 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:27:29.470 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:27:29.470 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:27:29.471 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:27:29.471 INFO:teuthology.orchestra.run.smithi049.stdout: "op_inflight": 0, 2024-03-16T07:27:29.471 INFO:teuthology.orchestra.run.smithi049.stdout: "oplen_avg": { 2024-03-16T07:27:29.471 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:27:29.471 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0 2024-03-16T07:27:29.471 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:27:29.471 INFO:teuthology.orchestra.run.smithi049.stdout: "op": 0, 2024-03-16T07:27:29.471 INFO:teuthology.orchestra.run.smithi049.stdout: "op_r": 0, 2024-03-16T07:27:29.471 INFO:teuthology.orchestra.run.smithi049.stdout: "op_w": 0, 2024-03-16T07:27:29.471 INFO:teuthology.orchestra.run.smithi049.stdout: "op_rmw": 0, 2024-03-16T07:27:29.471 INFO:teuthology.orchestra.run.smithi049.stdout: "op_pg": 0, 2024-03-16T07:27:29.471 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_stat": 0, 2024-03-16T07:27:29.471 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_create": 0, 2024-03-16T07:27:29.471 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_read": 0, 2024-03-16T07:27:29.471 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_write": 0, 2024-03-16T07:27:29.472 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_writefull": 0, 2024-03-16T07:27:29.472 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_writesame": 0, 2024-03-16T07:27:29.472 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_append": 0, 2024-03-16T07:27:29.472 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_zero": 0, 2024-03-16T07:27:29.472 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_truncate": 0, 2024-03-16T07:27:29.472 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_delete": 0, 2024-03-16T07:27:29.472 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_mapext": 0, 2024-03-16T07:27:29.472 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_sparse_read": 0, 2024-03-16T07:27:29.472 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_clonerange": 0, 2024-03-16T07:27:29.472 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_getxattr": 0, 2024-03-16T07:27:29.472 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_setxattr": 0, 2024-03-16T07:27:29.472 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_cmpxattr": 0, 2024-03-16T07:27:29.472 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_rmxattr": 0, 2024-03-16T07:27:29.472 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_resetxattrs": 0, 2024-03-16T07:27:29.472 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_call": 0, 2024-03-16T07:27:29.472 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_watch": 0, 2024-03-16T07:27:29.473 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_notify": 0, 2024-03-16T07:27:29.473 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_src_cmpxattr": 0, 2024-03-16T07:27:29.473 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_pgls": 0, 2024-03-16T07:27:29.473 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_pgls_filter": 0, 2024-03-16T07:27:29.473 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_other": 0, 2024-03-16T07:27:29.473 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_active": 0, 2024-03-16T07:27:29.473 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_send": 0, 2024-03-16T07:27:29.473 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_resend": 0, 2024-03-16T07:27:29.473 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_ping": 0, 2024-03-16T07:27:29.473 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_active": 0, 2024-03-16T07:27:29.473 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_send": 0, 2024-03-16T07:27:29.473 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_resend": 0, 2024-03-16T07:27:29.473 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_active": 0, 2024-03-16T07:27:29.473 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_send": 0, 2024-03-16T07:27:29.473 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_resend": 0, 2024-03-16T07:27:29.474 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_active": 0, 2024-03-16T07:27:29.474 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_send": 0, 2024-03-16T07:27:29.474 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_resend": 0, 2024-03-16T07:27:29.474 INFO:teuthology.orchestra.run.smithi049.stdout: "command_active": 0, 2024-03-16T07:27:29.474 INFO:teuthology.orchestra.run.smithi049.stdout: "command_send": 0, 2024-03-16T07:27:29.474 INFO:teuthology.orchestra.run.smithi049.stdout: "command_resend": 0, 2024-03-16T07:27:29.474 INFO:teuthology.orchestra.run.smithi049.stdout: "map_epoch": 0, 2024-03-16T07:27:29.474 INFO:teuthology.orchestra.run.smithi049.stdout: "map_full": 0, 2024-03-16T07:27:29.474 INFO:teuthology.orchestra.run.smithi049.stdout: "map_inc": 0, 2024-03-16T07:27:29.474 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_sessions": 0, 2024-03-16T07:27:29.474 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_session_open": 0, 2024-03-16T07:27:29.474 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_session_close": 0, 2024-03-16T07:27:29.474 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_laggy": 0, 2024-03-16T07:27:29.474 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_wr": 0, 2024-03-16T07:27:29.474 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_rd": 0, 2024-03-16T07:27:29.475 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_del": 0 2024-03-16T07:27:29.475 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:29.475 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:29.475 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:27:29.475 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-msgr_dispatch_throttler-client": [ 2024-03-16T07:27:29.475 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:27:29.475 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:27:29.475 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:27:29.475 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:27:29.475 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-03-16T07:27:29.475 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:27:29.475 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 33, 2024-03-16T07:27:29.475 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 127331, 2024-03-16T07:27:29.475 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:27:29.475 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 33, 2024-03-16T07:27:29.476 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:27:29.476 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:27:29.476 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 33, 2024-03-16T07:27:29.476 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 127331, 2024-03-16T07:27:29.476 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:27:29.476 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:27:29.476 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:27:29.476 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:27:29.476 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:29.476 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:29.476 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:29.476 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:27:29.476 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-msgr_dispatch_throttler-radosclient": [ 2024-03-16T07:27:29.476 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:27:29.476 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:27:29.477 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:27:29.477 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:27:29.477 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-03-16T07:27:29.477 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:27:29.477 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 19, 2024-03-16T07:27:29.477 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 549009, 2024-03-16T07:27:29.477 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:27:29.477 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 19, 2024-03-16T07:27:29.477 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:27:29.477 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:27:29.477 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 19, 2024-03-16T07:27:29.477 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 549009, 2024-03-16T07:27:29.477 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:27:29.477 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:27:29.477 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:27:29.477 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:27:29.478 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:29.478 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:29.478 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:29.478 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:27:29.478 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-objecter_bytes": [ 2024-03-16T07:27:29.478 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:27:29.478 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:27:29.478 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:27:29.478 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:27:29.478 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-03-16T07:27:29.478 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:27:29.478 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 0, 2024-03-16T07:27:29.478 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 0, 2024-03-16T07:27:29.478 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:27:29.479 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 0, 2024-03-16T07:27:29.479 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:27:29.479 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:27:29.479 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 0, 2024-03-16T07:27:29.479 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 0, 2024-03-16T07:27:29.479 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:27:29.479 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:27:29.479 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:27:29.479 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:27:29.479 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:29.479 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:29.479 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:29.479 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:27:29.479 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-objecter_ops": [ 2024-03-16T07:27:29.479 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:27:29.479 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:27:29.480 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:27:29.480 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:27:29.480 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 1024, 2024-03-16T07:27:29.480 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:27:29.480 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 0, 2024-03-16T07:27:29.480 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 0, 2024-03-16T07:27:29.480 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:27:29.480 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 0, 2024-03-16T07:27:29.480 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:27:29.480 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:27:29.480 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 0, 2024-03-16T07:27:29.480 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 0, 2024-03-16T07:27:29.480 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:27:29.480 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:27:29.480 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:27:29.481 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:27:29.481 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:29.481 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:29.481 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:29.481 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2024-03-16T07:27:29.481 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-03-16T07:27:29.482 DEBUG:tasks.cephfs.test_mirroring:command returned={ "AsyncMessenger::Worker": [ { "labels": { "id": "0" }, "counters": { "msgr_connection_ready_timeouts": 0, "msgr_connection_idle_timeouts": 0 } }, { "labels": { "id": "1" }, "counters": { "msgr_connection_ready_timeouts": 0, "msgr_connection_idle_timeouts": 0 } }, { "labels": { "id": "2" }, "counters": { "msgr_connection_ready_timeouts": 0, "msgr_connection_idle_timeouts": 0 } } ], "AsyncMessenger::Worker-0": [ { "labels": {}, "counters": { "msgr_recv_messages": 3, "msgr_send_messages": 31, "msgr_recv_bytes": 432, "msgr_send_bytes": 244560, "msgr_created_connections": 7, "msgr_active_connections": 3, "msgr_running_total_time": 0.189287637, "msgr_running_send_time": 0.046184014, "msgr_running_recv_time": 0.125163038, "msgr_running_fast_dispatch_time": 0.000000000, "msgr_send_messages_queue_lat": { "avgcount": 28, "sum": 0.128017942, "avgtime": 0.004572069 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "msgr_recv_encrypted_bytes": 432, "msgr_send_encrypted_bytes": 244560 } } ], "AsyncMessenger::Worker-1": [ { "labels": {}, "counters": { "msgr_recv_messages": 33, "msgr_send_messages": 3, "msgr_recv_bytes": 131808, "msgr_send_bytes": 464, "msgr_created_connections": 3, "msgr_active_connections": 0, "msgr_running_total_time": 0.259441949, "msgr_running_send_time": 0.001798943, "msgr_running_recv_time": 0.170045701, "msgr_running_fast_dispatch_time": 0.083993176, "msgr_send_messages_queue_lat": { "avgcount": 3, "sum": 0.054357270, "avgtime": 0.018119090 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "msgr_recv_encrypted_bytes": 131808, "msgr_send_encrypted_bytes": 464 } } ], "AsyncMessenger::Worker-2": [ { "labels": {}, "counters": { "msgr_recv_messages": 19, "msgr_send_messages": 6, "msgr_recv_bytes": 551984, "msgr_send_bytes": 928, "msgr_created_connections": 2, "msgr_active_connections": 1, "msgr_running_total_time": 0.328306985, "msgr_running_send_time": 0.004602564, "msgr_running_recv_time": 0.649948418, "msgr_running_fast_dispatch_time": 0.000000000, "msgr_send_messages_queue_lat": { "avgcount": 6, "sum": 0.158362306, "avgtime": 0.026393717 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "msgr_recv_encrypted_bytes": 551984, "msgr_send_encrypted_bytes": 928 } } ], "cct": [ { "labels": {}, "counters": { "total_workers": 0, "unhealthy_workers": 0 } } ], "cephfs_mirror": [ { "labels": {}, "counters": { "mirrored_filesystems": 0, "mirror_enable_failures": 0 } } ], "mempool": [ { "labels": {}, "counters": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_cache_buffer_bytes": 0, "bluestore_cache_buffer_items": 0, "bluestore_extent_bytes": 0, "bluestore_extent_items": 0, "bluestore_blob_bytes": 0, "bluestore_blob_items": 0, "bluestore_shared_blob_bytes": 0, "bluestore_shared_blob_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_items": 0, "bluefs_bytes": 0, "bluefs_items": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "buffer_anon_bytes": 148386, "buffer_anon_items": 24, "buffer_meta_bytes": 0, "buffer_meta_items": 0, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 4824, "osdmap_items": 52, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "mds_co_bytes": 0, "mds_co_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 } } ], "objecter": [ { "labels": {}, "counters": { "op_active": 0, "op_laggy": 0, "op_send": 0, "op_send_bytes": 0, "op_resend": 0, "op_reply": 0, "op_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "op_inflight": 0, "oplen_avg": { "avgcount": 0, "sum": 0 }, "op": 0, "op_r": 0, "op_w": 0, "op_rmw": 0, "op_pg": 0, "osdop_stat": 0, "osdop_create": 0, "osdop_read": 0, "osdop_write": 0, "osdop_writefull": 0, "osdop_writesame": 0, "osdop_append": 0, "osdop_zero": 0, "osdop_truncate": 0, "osdop_delete": 0, "osdop_mapext": 0, "osdop_sparse_read": 0, "osdop_clonerange": 0, "osdop_getxattr": 0, "osdop_setxattr": 0, "osdop_cmpxattr": 0, "osdop_rmxattr": 0, "osdop_resetxattrs": 0, "osdop_call": 0, "osdop_watch": 0, "osdop_notify": 0, "osdop_src_cmpxattr": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_other": 0, "linger_active": 0, "linger_send": 0, "linger_resend": 0, "linger_ping": 0, "poolop_active": 0, "poolop_send": 0, "poolop_resend": 0, "poolstat_active": 0, "poolstat_send": 0, "poolstat_resend": 0, "statfs_active": 0, "statfs_send": 0, "statfs_resend": 0, "command_active": 0, "command_send": 0, "command_resend": 0, "map_epoch": 0, "map_full": 0, "map_inc": 0, "osd_sessions": 0, "osd_session_open": 0, "osd_session_close": 0, "osd_laggy": 0, "omap_wr": 0, "omap_rd": 0, "omap_del": 0 } } ], "throttle-msgr_dispatch_throttler-client": [ { "labels": {}, "counters": { "val": 0, "max": 104857600, "get_started": 0, "get": 33, "get_sum": 127331, "get_or_fail_fail": 0, "get_or_fail_success": 33, "take": 0, "take_sum": 0, "put": 33, "put_sum": 127331, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ], "throttle-msgr_dispatch_throttler-radosclient": [ { "labels": {}, "counters": { "val": 0, "max": 104857600, "get_started": 0, "get": 19, "get_sum": 549009, "get_or_fail_fail": 0, "get_or_fail_success": 19, "take": 0, "take_sum": 0, "put": 19, "put_sum": 549009, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ], "throttle-objecter_bytes": [ { "labels": {}, "counters": { "val": 0, "max": 104857600, "get_started": 0, "get": 0, "get_sum": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "take": 0, "take_sum": 0, "put": 0, "put_sum": 0, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ], "throttle-objecter_ops": [ { "labels": {}, "counters": { "val": 0, "max": 1024, "get_started": 0, "get": 0, "get_sum": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "take": 0, "take_sum": 0, "put": 0, "put_sum": 0, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ] } 2024-03-16T07:27:29.482 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snapshot mirror enable cephfs 2024-03-16T07:27:29.748 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:27:29.750+0000 7f2a64c2b040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-16T07:27:29.798 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:27:29.800+0000 7f2a64c2b040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-16T07:27:30.216 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:27:30.218+0000 7f2a64c2b040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-16T07:27:30.265 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:27:30.267+0000 7f2a64c2b040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-16T07:27:30.319 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:27:30.320+0000 7f2a64c2b040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-16T07:27:30.373 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:27:30.375+0000 7f2a64c2b040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-16T07:27:30.417 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:27:30.419+0000 7f2a64c2b040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-16T07:27:30.536 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:27:30.538+0000 7f2a64c2b040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-16T07:27:30.592 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:27:30.594+0000 7f2a64c2b040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-16T07:27:30.637 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:27:30.638+0000 7f2a64c2b040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-16T07:27:30.709 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:27:30.711+0000 7f2a64c2b040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-16T07:27:30.770 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:27:30.772+0000 7f2a64c2b040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-16T07:27:31.105 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:27:31.107+0000 7f2a64c2b040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-16T07:27:31.244 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:27:31.246+0000 7f2a64c2b040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-16T07:27:31.341 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:27:31.343+0000 7f2a64c2b040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-16T07:27:31.386 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:27:31.388+0000 7f2a64c2b040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-16T07:27:31.503 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:27:31.504+0000 7f2a64c2b040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-16T07:27:31.615 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:27:31.617+0000 7f2a64c2b040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-16T07:27:31.838 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:27:31.840+0000 7f2a64c2b040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-16T07:27:31.889 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:27:31.891+0000 7f2a64c2b040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-16T07:27:32.047 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:27:32.048+0000 7f2a64c2b040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-16T07:27:32.923 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:27:32.924+0000 7f2a64c2b040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-16T07:27:33.208 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:27:33.209+0000 7f2a64c2b040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-16T07:27:33.259 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:27:33.261+0000 7f2a64c2b040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-16T07:27:33.380 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:27:33.382+0000 7f2a64c2b040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-16T07:27:33.472 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:27:33.473+0000 7f29e0f37640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:27:33.472 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:27:33.473+0000 7f29e0f37640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:27:33.472 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:27:33.473+0000 7f29e0f37640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:27:33.473 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:27:33.473+0000 7f29e0f37640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:27:33.473 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:27:33.473+0000 7f29e0f37640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:27:33.474 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:27:33.474+0000 7f29e3f3d640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:27:33.474 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:27:33.474+0000 7f29e3f3d640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:27:33.475 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:27:33.474+0000 7f29e3f3d640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:27:33.475 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:27:33.474+0000 7f29e3f3d640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:27:33.475 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:27:33.474+0000 7f29e3f3d640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:27:33.486 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:27:33.487+0000 7f29e3f3d640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:27:33.486 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:27:33.487+0000 7f29e3f3d640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:27:33.486 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:27:33.487+0000 7f29e3f3d640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:27:33.486 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:27:33.487+0000 7f29e3f3d640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:27:33.486 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:27:33.487+0000 7f29e3f3d640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:27:33.486 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:27:33.487+0000 7f29e0f37640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:27:33.486 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:27:33.487+0000 7f29e0f37640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:27:33.486 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:27:33.487+0000 7f29e0f37640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:27:33.486 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:27:33.487+0000 7f29e0f37640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:27:33.486 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:27:33.487+0000 7f29e0f37640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:27:35.405 INFO:teuthology.orchestra.run.smithi049.stdout:{} 2024-03-16T07:27:38.357 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T07:27:45.420 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-03-16T07:27:45.420 DEBUG:teuthology.orchestra.run.smithi049:mirror status for fs: cephfs> ceph --admin-daemon /var/run/ceph/cephfs-mirror.asok fs mirror status cephfs@4 2024-03-16T07:27:45.517 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-03-16T07:27:45.517 INFO:teuthology.orchestra.run.smithi049.stdout: "rados_inst": "172.21.15.49:0/2180583115", 2024-03-16T07:27:45.517 INFO:teuthology.orchestra.run.smithi049.stdout: "peers": {}, 2024-03-16T07:27:45.517 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_dirs": { 2024-03-16T07:27:45.517 INFO:teuthology.orchestra.run.smithi049.stdout: "dir_count": 0 2024-03-16T07:27:45.518 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:45.518 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-03-16T07:27:45.524 DEBUG:tasks.cephfs.test_mirroring:command returned={ "rados_inst": "172.21.15.49:0/2180583115", "peers": {}, "snap_dirs": { "dir_count": 0 } } 2024-03-16T07:27:45.524 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-03-16T07:27:45.525 DEBUG:teuthology.orchestra.run.smithi049:counter dump for fs: cephfs> ceph --admin-daemon /var/run/ceph/cephfs-mirror.asok counter dump 2024-03-16T07:27:45.628 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-03-16T07:27:45.628 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker": [ 2024-03-16T07:27:45.629 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:27:45.629 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:27:45.629 INFO:teuthology.orchestra.run.smithi049.stdout: "id": "0" 2024-03-16T07:27:45.629 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:27:45.629 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:27:45.629 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_ready_timeouts": 0, 2024-03-16T07:27:45.629 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_idle_timeouts": 0 2024-03-16T07:27:45.629 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:45.629 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:27:45.629 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:27:45.629 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:27:45.629 INFO:teuthology.orchestra.run.smithi049.stdout: "id": "1" 2024-03-16T07:27:45.629 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:27:45.629 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:27:45.630 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_ready_timeouts": 0, 2024-03-16T07:27:45.630 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_idle_timeouts": 0 2024-03-16T07:27:45.630 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:45.630 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:27:45.630 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:27:45.630 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:27:45.630 INFO:teuthology.orchestra.run.smithi049.stdout: "id": "2" 2024-03-16T07:27:45.630 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:27:45.630 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:27:45.630 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_ready_timeouts": 0, 2024-03-16T07:27:45.630 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_idle_timeouts": 0 2024-03-16T07:27:45.630 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:45.630 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:45.631 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:27:45.631 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-0": [ 2024-03-16T07:27:45.631 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:27:45.631 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:27:45.631 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:27:45.631 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 4, 2024-03-16T07:27:45.631 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 35, 2024-03-16T07:27:45.631 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 576, 2024-03-16T07:27:45.631 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 324240, 2024-03-16T07:27:45.631 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 8, 2024-03-16T07:27:45.631 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 4, 2024-03-16T07:27:45.631 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 0.200245766, 2024-03-16T07:27:45.631 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.052536230, 2024-03-16T07:27:45.632 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 0.128515061, 2024-03-16T07:27:45.632 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-03-16T07:27:45.632 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T07:27:45.632 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 32, 2024-03-16T07:27:45.632 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.133497159, 2024-03-16T07:27:45.632 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.004171786 2024-03-16T07:27:45.632 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:27:45.632 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-03-16T07:27:45.632 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:27:45.632 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:27:45.632 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:27:45.632 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:27:45.632 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 576, 2024-03-16T07:27:45.632 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 324240 2024-03-16T07:27:45.633 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:45.633 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:45.633 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:27:45.633 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-1": [ 2024-03-16T07:27:45.633 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:27:45.633 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:27:45.633 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:27:45.633 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 34, 2024-03-16T07:27:45.633 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 3, 2024-03-16T07:27:45.633 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 136688, 2024-03-16T07:27:45.633 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 464, 2024-03-16T07:27:45.633 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 3, 2024-03-16T07:27:45.633 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 0, 2024-03-16T07:27:45.633 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 0.264629193, 2024-03-16T07:27:45.634 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.001903003, 2024-03-16T07:27:45.634 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 0.173214183, 2024-03-16T07:27:45.634 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.085501363, 2024-03-16T07:27:45.634 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T07:27:45.634 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 3, 2024-03-16T07:27:45.634 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.054357270, 2024-03-16T07:27:45.634 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.018119090 2024-03-16T07:27:45.634 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:27:45.634 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-03-16T07:27:45.634 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:27:45.634 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:27:45.634 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:27:45.634 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:27:45.635 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 136688, 2024-03-16T07:27:45.635 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 464 2024-03-16T07:27:45.635 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:45.635 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:45.635 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:27:45.635 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-2": [ 2024-03-16T07:27:45.635 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:27:45.635 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:27:45.635 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:27:45.635 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 23, 2024-03-16T07:27:45.635 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 6, 2024-03-16T07:27:45.635 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 734128, 2024-03-16T07:27:45.635 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 928, 2024-03-16T07:27:45.635 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 2, 2024-03-16T07:27:45.635 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 1, 2024-03-16T07:27:45.636 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 0.420345742, 2024-03-16T07:27:45.636 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.004765872, 2024-03-16T07:27:45.636 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 0.828077674, 2024-03-16T07:27:45.636 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-03-16T07:27:45.636 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T07:27:45.636 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 6, 2024-03-16T07:27:45.636 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.158362306, 2024-03-16T07:27:45.636 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.026393717 2024-03-16T07:27:45.636 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:27:45.636 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-03-16T07:27:45.636 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:27:45.636 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:27:45.636 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:27:45.636 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:27:45.637 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 734128, 2024-03-16T07:27:45.637 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 928 2024-03-16T07:27:45.637 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:45.637 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:45.637 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:27:45.637 INFO:teuthology.orchestra.run.smithi049.stdout: "cct": [ 2024-03-16T07:27:45.637 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:27:45.637 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:27:45.637 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:27:45.637 INFO:teuthology.orchestra.run.smithi049.stdout: "total_workers": 0, 2024-03-16T07:27:45.637 INFO:teuthology.orchestra.run.smithi049.stdout: "unhealthy_workers": 0 2024-03-16T07:27:45.637 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:45.637 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:45.637 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:27:45.637 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs_mirror": [ 2024-03-16T07:27:45.638 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:27:45.638 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:27:45.638 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:27:45.638 INFO:teuthology.orchestra.run.smithi049.stdout: "mirrored_filesystems": 1, 2024-03-16T07:27:45.638 INFO:teuthology.orchestra.run.smithi049.stdout: "mirror_enable_failures": 0 2024-03-16T07:27:45.638 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:45.638 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:45.638 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:27:45.638 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs_mirror_mirrored_filesystems": [ 2024-03-16T07:27:45.638 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:27:45.638 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:27:45.638 INFO:teuthology.orchestra.run.smithi049.stdout: "filesystem": "cephfs" 2024-03-16T07:27:45.638 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:27:45.638 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:27:45.638 INFO:teuthology.orchestra.run.smithi049.stdout: "mirroring_peers": 0, 2024-03-16T07:27:45.639 INFO:teuthology.orchestra.run.smithi049.stdout: "directory_count": 0 2024-03-16T07:27:45.639 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:45.639 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:45.639 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:27:45.639 INFO:teuthology.orchestra.run.smithi049.stdout: "mempool": [ 2024-03-16T07:27:45.639 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:27:45.639 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:27:45.639 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:27:45.639 INFO:teuthology.orchestra.run.smithi049.stdout: "bloom_filter_bytes": 0, 2024-03-16T07:27:45.639 INFO:teuthology.orchestra.run.smithi049.stdout: "bloom_filter_items": 0, 2024-03-16T07:27:45.639 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_alloc_bytes": 0, 2024-03-16T07:27:45.639 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_alloc_items": 0, 2024-03-16T07:27:45.639 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_data_bytes": 0, 2024-03-16T07:27:45.639 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_data_items": 0, 2024-03-16T07:27:45.639 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_onode_bytes": 0, 2024-03-16T07:27:45.640 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_onode_items": 0, 2024-03-16T07:27:45.640 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_meta_bytes": 0, 2024-03-16T07:27:45.640 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_meta_items": 0, 2024-03-16T07:27:45.640 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_other_bytes": 0, 2024-03-16T07:27:45.640 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_other_items": 0, 2024-03-16T07:27:45.640 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_buffer_bytes": 0, 2024-03-16T07:27:45.640 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_buffer_items": 0, 2024-03-16T07:27:45.640 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_extent_bytes": 0, 2024-03-16T07:27:45.640 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_extent_items": 0, 2024-03-16T07:27:45.640 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_blob_bytes": 0, 2024-03-16T07:27:45.640 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_blob_items": 0, 2024-03-16T07:27:45.640 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_shared_blob_bytes": 0, 2024-03-16T07:27:45.640 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_shared_blob_items": 0, 2024-03-16T07:27:45.640 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_inline_bl_bytes": 0, 2024-03-16T07:27:45.640 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_inline_bl_items": 0, 2024-03-16T07:27:45.640 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_fsck_bytes": 0, 2024-03-16T07:27:45.641 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_fsck_items": 0, 2024-03-16T07:27:45.641 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_txc_bytes": 0, 2024-03-16T07:27:45.641 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_txc_items": 0, 2024-03-16T07:27:45.641 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_deferred_bytes": 0, 2024-03-16T07:27:45.641 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_deferred_items": 0, 2024-03-16T07:27:45.641 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_bytes": 0, 2024-03-16T07:27:45.641 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_items": 0, 2024-03-16T07:27:45.641 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_bytes": 0, 2024-03-16T07:27:45.641 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_items": 0, 2024-03-16T07:27:45.641 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_reader_bytes": 0, 2024-03-16T07:27:45.641 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_reader_items": 0, 2024-03-16T07:27:45.641 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_writer_bytes": 0, 2024-03-16T07:27:45.641 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_writer_items": 0, 2024-03-16T07:27:45.641 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_anon_bytes": 182719, 2024-03-16T07:27:45.642 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_anon_items": 53, 2024-03-16T07:27:45.642 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_meta_bytes": 0, 2024-03-16T07:27:45.642 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_meta_items": 0, 2024-03-16T07:27:45.642 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_bytes": 0, 2024-03-16T07:27:45.642 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_items": 0, 2024-03-16T07:27:45.642 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_mapbl_bytes": 0, 2024-03-16T07:27:45.642 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_mapbl_items": 0, 2024-03-16T07:27:45.642 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pglog_bytes": 0, 2024-03-16T07:27:45.642 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pglog_items": 0, 2024-03-16T07:27:45.642 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_bytes": 18952, 2024-03-16T07:27:45.642 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_items": 184, 2024-03-16T07:27:45.642 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_mapping_bytes": 0, 2024-03-16T07:27:45.642 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_mapping_items": 0, 2024-03-16T07:27:45.642 INFO:teuthology.orchestra.run.smithi049.stdout: "pgmap_bytes": 0, 2024-03-16T07:27:45.642 INFO:teuthology.orchestra.run.smithi049.stdout: "pgmap_items": 0, 2024-03-16T07:27:45.643 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_co_bytes": 0, 2024-03-16T07:27:45.643 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_co_items": 0, 2024-03-16T07:27:45.643 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_1_bytes": 0, 2024-03-16T07:27:45.643 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_1_items": 0, 2024-03-16T07:27:45.643 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_2_bytes": 0, 2024-03-16T07:27:45.643 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_2_items": 0 2024-03-16T07:27:45.643 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:45.643 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:45.643 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:27:45.643 INFO:teuthology.orchestra.run.smithi049.stdout: "objecter": [ 2024-03-16T07:27:45.643 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:27:45.643 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:27:45.643 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:27:45.643 INFO:teuthology.orchestra.run.smithi049.stdout: "op_active": 0, 2024-03-16T07:27:45.644 INFO:teuthology.orchestra.run.smithi049.stdout: "op_laggy": 0, 2024-03-16T07:27:45.644 INFO:teuthology.orchestra.run.smithi049.stdout: "op_send": 0, 2024-03-16T07:27:45.644 INFO:teuthology.orchestra.run.smithi049.stdout: "op_send_bytes": 0, 2024-03-16T07:27:45.644 INFO:teuthology.orchestra.run.smithi049.stdout: "op_resend": 0, 2024-03-16T07:27:45.644 INFO:teuthology.orchestra.run.smithi049.stdout: "op_reply": 0, 2024-03-16T07:27:45.644 INFO:teuthology.orchestra.run.smithi049.stdout: "op_latency": { 2024-03-16T07:27:45.644 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:27:45.644 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:27:45.644 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:27:45.644 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:27:45.644 INFO:teuthology.orchestra.run.smithi049.stdout: "op_inflight": 0, 2024-03-16T07:27:45.644 INFO:teuthology.orchestra.run.smithi049.stdout: "oplen_avg": { 2024-03-16T07:27:45.644 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:27:45.644 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0 2024-03-16T07:27:45.645 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:27:45.645 INFO:teuthology.orchestra.run.smithi049.stdout: "op": 0, 2024-03-16T07:27:45.645 INFO:teuthology.orchestra.run.smithi049.stdout: "op_r": 0, 2024-03-16T07:27:45.645 INFO:teuthology.orchestra.run.smithi049.stdout: "op_w": 0, 2024-03-16T07:27:45.645 INFO:teuthology.orchestra.run.smithi049.stdout: "op_rmw": 0, 2024-03-16T07:27:45.645 INFO:teuthology.orchestra.run.smithi049.stdout: "op_pg": 0, 2024-03-16T07:27:45.645 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_stat": 0, 2024-03-16T07:27:45.645 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_create": 0, 2024-03-16T07:27:45.645 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_read": 0, 2024-03-16T07:27:45.645 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_write": 0, 2024-03-16T07:27:45.645 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_writefull": 0, 2024-03-16T07:27:45.645 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_writesame": 0, 2024-03-16T07:27:45.645 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_append": 0, 2024-03-16T07:27:45.645 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_zero": 0, 2024-03-16T07:27:45.645 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_truncate": 0, 2024-03-16T07:27:45.646 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_delete": 0, 2024-03-16T07:27:45.646 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_mapext": 0, 2024-03-16T07:27:45.646 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_sparse_read": 0, 2024-03-16T07:27:45.646 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_clonerange": 0, 2024-03-16T07:27:45.646 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_getxattr": 0, 2024-03-16T07:27:45.646 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_setxattr": 0, 2024-03-16T07:27:45.646 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_cmpxattr": 0, 2024-03-16T07:27:45.646 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_rmxattr": 0, 2024-03-16T07:27:45.646 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_resetxattrs": 0, 2024-03-16T07:27:45.646 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_call": 0, 2024-03-16T07:27:45.646 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_watch": 0, 2024-03-16T07:27:45.646 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_notify": 0, 2024-03-16T07:27:45.646 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_src_cmpxattr": 0, 2024-03-16T07:27:45.646 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_pgls": 0, 2024-03-16T07:27:45.647 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_pgls_filter": 0, 2024-03-16T07:27:45.647 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_other": 0, 2024-03-16T07:27:45.647 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_active": 0, 2024-03-16T07:27:45.647 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_send": 0, 2024-03-16T07:27:45.647 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_resend": 0, 2024-03-16T07:27:45.647 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_ping": 0, 2024-03-16T07:27:45.647 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_active": 0, 2024-03-16T07:27:45.647 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_send": 0, 2024-03-16T07:27:45.647 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_resend": 0, 2024-03-16T07:27:45.647 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_active": 0, 2024-03-16T07:27:45.647 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_send": 0, 2024-03-16T07:27:45.647 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_resend": 0, 2024-03-16T07:27:45.647 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_active": 0, 2024-03-16T07:27:45.647 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_send": 0, 2024-03-16T07:27:45.647 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_resend": 0, 2024-03-16T07:27:45.648 INFO:teuthology.orchestra.run.smithi049.stdout: "command_active": 0, 2024-03-16T07:27:45.648 INFO:teuthology.orchestra.run.smithi049.stdout: "command_send": 0, 2024-03-16T07:27:45.648 INFO:teuthology.orchestra.run.smithi049.stdout: "command_resend": 0, 2024-03-16T07:27:45.648 INFO:teuthology.orchestra.run.smithi049.stdout: "map_epoch": 0, 2024-03-16T07:27:45.648 INFO:teuthology.orchestra.run.smithi049.stdout: "map_full": 0, 2024-03-16T07:27:45.648 INFO:teuthology.orchestra.run.smithi049.stdout: "map_inc": 0, 2024-03-16T07:27:45.648 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_sessions": 0, 2024-03-16T07:27:45.648 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_session_open": 0, 2024-03-16T07:27:45.648 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_session_close": 0, 2024-03-16T07:27:45.648 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_laggy": 0, 2024-03-16T07:27:45.648 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_wr": 0, 2024-03-16T07:27:45.648 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_rd": 0, 2024-03-16T07:27:45.648 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_del": 0 2024-03-16T07:27:45.648 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:45.649 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:45.649 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:27:45.649 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-msgr_dispatch_throttler-client": [ 2024-03-16T07:27:45.649 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:27:45.649 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:27:45.649 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:27:45.649 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:27:45.649 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-03-16T07:27:45.649 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:27:45.649 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 34, 2024-03-16T07:27:45.649 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 132077, 2024-03-16T07:27:45.649 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:27:45.649 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 34, 2024-03-16T07:27:45.649 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:27:45.649 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:27:45.649 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 34, 2024-03-16T07:27:45.650 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 132077, 2024-03-16T07:27:45.650 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:27:45.650 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:27:45.650 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:27:45.650 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:27:45.650 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:45.650 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:45.650 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:45.650 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:27:45.650 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-msgr_dispatch_throttler-radosclient": [ 2024-03-16T07:27:45.650 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:27:45.650 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:27:45.650 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:27:45.650 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:27:45.650 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-03-16T07:27:45.651 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:27:45.651 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 24, 2024-03-16T07:27:45.651 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 730609, 2024-03-16T07:27:45.651 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:27:45.651 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 24, 2024-03-16T07:27:45.651 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:27:45.651 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:27:45.651 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 24, 2024-03-16T07:27:45.651 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 730609, 2024-03-16T07:27:45.651 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:27:45.651 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:27:45.651 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:27:45.651 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:27:45.651 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:45.651 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:45.651 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:45.652 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:27:45.652 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-objecter_bytes": [ 2024-03-16T07:27:45.652 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:27:45.652 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:27:45.652 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:27:45.652 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:27:45.652 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-03-16T07:27:45.652 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:27:45.652 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 0, 2024-03-16T07:27:45.652 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 0, 2024-03-16T07:27:45.652 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:27:45.652 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 0, 2024-03-16T07:27:45.652 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:27:45.652 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:27:45.652 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 0, 2024-03-16T07:27:45.652 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 0, 2024-03-16T07:27:45.653 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:27:45.653 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:27:45.653 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:27:45.653 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:27:45.653 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:45.653 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:45.653 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:45.653 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:27:45.653 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-objecter_ops": [ 2024-03-16T07:27:45.653 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:27:45.653 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:27:45.653 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:27:45.653 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:27:45.653 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 1024, 2024-03-16T07:27:45.653 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:27:45.653 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 0, 2024-03-16T07:27:45.653 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 0, 2024-03-16T07:27:45.654 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:27:45.654 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 0, 2024-03-16T07:27:45.654 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:27:45.654 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:27:45.654 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 0, 2024-03-16T07:27:45.654 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 0, 2024-03-16T07:27:45.654 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:27:45.654 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:27:45.654 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:27:45.654 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:27:45.654 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:45.654 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:45.654 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:45.654 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2024-03-16T07:27:45.654 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-03-16T07:27:45.655 DEBUG:tasks.cephfs.test_mirroring:command returned={ "AsyncMessenger::Worker": [ { "labels": { "id": "0" }, "counters": { "msgr_connection_ready_timeouts": 0, "msgr_connection_idle_timeouts": 0 } }, { "labels": { "id": "1" }, "counters": { "msgr_connection_ready_timeouts": 0, "msgr_connection_idle_timeouts": 0 } }, { "labels": { "id": "2" }, "counters": { "msgr_connection_ready_timeouts": 0, "msgr_connection_idle_timeouts": 0 } } ], "AsyncMessenger::Worker-0": [ { "labels": {}, "counters": { "msgr_recv_messages": 4, "msgr_send_messages": 35, "msgr_recv_bytes": 576, "msgr_send_bytes": 324240, "msgr_created_connections": 8, "msgr_active_connections": 4, "msgr_running_total_time": 0.200245766, "msgr_running_send_time": 0.052536230, "msgr_running_recv_time": 0.128515061, "msgr_running_fast_dispatch_time": 0.000000000, "msgr_send_messages_queue_lat": { "avgcount": 32, "sum": 0.133497159, "avgtime": 0.004171786 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "msgr_recv_encrypted_bytes": 576, "msgr_send_encrypted_bytes": 324240 } } ], "AsyncMessenger::Worker-1": [ { "labels": {}, "counters": { "msgr_recv_messages": 34, "msgr_send_messages": 3, "msgr_recv_bytes": 136688, "msgr_send_bytes": 464, "msgr_created_connections": 3, "msgr_active_connections": 0, "msgr_running_total_time": 0.264629193, "msgr_running_send_time": 0.001903003, "msgr_running_recv_time": 0.173214183, "msgr_running_fast_dispatch_time": 0.085501363, "msgr_send_messages_queue_lat": { "avgcount": 3, "sum": 0.054357270, "avgtime": 0.018119090 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "msgr_recv_encrypted_bytes": 136688, "msgr_send_encrypted_bytes": 464 } } ], "AsyncMessenger::Worker-2": [ { "labels": {}, "counters": { "msgr_recv_messages": 23, "msgr_send_messages": 6, "msgr_recv_bytes": 734128, "msgr_send_bytes": 928, "msgr_created_connections": 2, "msgr_active_connections": 1, "msgr_running_total_time": 0.420345742, "msgr_running_send_time": 0.004765872, "msgr_running_recv_time": 0.828077674, "msgr_running_fast_dispatch_time": 0.000000000, "msgr_send_messages_queue_lat": { "avgcount": 6, "sum": 0.158362306, "avgtime": 0.026393717 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "msgr_recv_encrypted_bytes": 734128, "msgr_send_encrypted_bytes": 928 } } ], "cct": [ { "labels": {}, "counters": { "total_workers": 0, "unhealthy_workers": 0 } } ], "cephfs_mirror": [ { "labels": {}, "counters": { "mirrored_filesystems": 1, "mirror_enable_failures": 0 } } ], "cephfs_mirror_mirrored_filesystems": [ { "labels": { "filesystem": "cephfs" }, "counters": { "mirroring_peers": 0, "directory_count": 0 } } ], "mempool": [ { "labels": {}, "counters": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_cache_buffer_bytes": 0, "bluestore_cache_buffer_items": 0, "bluestore_extent_bytes": 0, "bluestore_extent_items": 0, "bluestore_blob_bytes": 0, "bluestore_blob_items": 0, "bluestore_shared_blob_bytes": 0, "bluestore_shared_blob_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_items": 0, "bluefs_bytes": 0, "bluefs_items": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "buffer_anon_bytes": 182719, "buffer_anon_items": 53, "buffer_meta_bytes": 0, "buffer_meta_items": 0, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 18952, "osdmap_items": 184, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "mds_co_bytes": 0, "mds_co_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 } } ], "objecter": [ { "labels": {}, "counters": { "op_active": 0, "op_laggy": 0, "op_send": 0, "op_send_bytes": 0, "op_resend": 0, "op_reply": 0, "op_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "op_inflight": 0, "oplen_avg": { "avgcount": 0, "sum": 0 }, "op": 0, "op_r": 0, "op_w": 0, "op_rmw": 0, "op_pg": 0, "osdop_stat": 0, "osdop_create": 0, "osdop_read": 0, "osdop_write": 0, "osdop_writefull": 0, "osdop_writesame": 0, "osdop_append": 0, "osdop_zero": 0, "osdop_truncate": 0, "osdop_delete": 0, "osdop_mapext": 0, "osdop_sparse_read": 0, "osdop_clonerange": 0, "osdop_getxattr": 0, "osdop_setxattr": 0, "osdop_cmpxattr": 0, "osdop_rmxattr": 0, "osdop_resetxattrs": 0, "osdop_call": 0, "osdop_watch": 0, "osdop_notify": 0, "osdop_src_cmpxattr": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_other": 0, "linger_active": 0, "linger_send": 0, "linger_resend": 0, "linger_ping": 0, "poolop_active": 0, "poolop_send": 0, "poolop_resend": 0, "poolstat_active": 0, "poolstat_send": 0, "poolstat_resend": 0, "statfs_active": 0, "statfs_send": 0, "statfs_resend": 0, "command_active": 0, "command_send": 0, "command_resend": 0, "map_epoch": 0, "map_full": 0, "map_inc": 0, "osd_sessions": 0, "osd_session_open": 0, "osd_session_close": 0, "osd_laggy": 0, "omap_wr": 0, "omap_rd": 0, "omap_del": 0 } } ], "throttle-msgr_dispatch_throttler-client": [ { "labels": {}, "counters": { "val": 0, "max": 104857600, "get_started": 0, "get": 34, "get_sum": 132077, "get_or_fail_fail": 0, "get_or_fail_success": 34, "take": 0, "take_sum": 0, "put": 34, "put_sum": 132077, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ], "throttle-msgr_dispatch_throttler-radosclient": [ { "labels": {}, "counters": { "val": 0, "max": 104857600, "get_started": 0, "get": 24, "get_sum": 730609, "get_or_fail_fail": 0, "get_or_fail_success": 24, "take": 0, "take_sum": 0, "put": 24, "put_sum": 730609, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ], "throttle-objecter_bytes": [ { "labels": {}, "counters": { "val": 0, "max": 104857600, "get_started": 0, "get": 0, "get_sum": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "take": 0, "take_sum": 0, "put": 0, "put_sum": 0, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ], "throttle-objecter_ops": [ { "labels": {}, "counters": { "val": 0, "max": 1024, "get_started": 0, "get": 0, "get_sum": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "take": 0, "take_sum": 0, "put": 0, "put_sum": 0, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ] } 2024-03-16T07:27:45.656 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-03-16T07:27:45.656 DEBUG:teuthology.orchestra.run.smithi049:counter dump for fs: cephfs> ceph --admin-daemon /var/run/ceph/cephfs-mirror.asok counter dump 2024-03-16T07:27:45.761 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-03-16T07:27:45.761 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker": [ 2024-03-16T07:27:45.761 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:27:45.761 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:27:45.761 INFO:teuthology.orchestra.run.smithi049.stdout: "id": "0" 2024-03-16T07:27:45.761 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:27:45.761 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:27:45.761 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_ready_timeouts": 0, 2024-03-16T07:27:45.761 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_idle_timeouts": 0 2024-03-16T07:27:45.761 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:45.761 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:27:45.761 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:27:45.761 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:27:45.762 INFO:teuthology.orchestra.run.smithi049.stdout: "id": "1" 2024-03-16T07:27:45.762 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:27:45.762 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:27:45.762 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_ready_timeouts": 0, 2024-03-16T07:27:45.762 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_idle_timeouts": 0 2024-03-16T07:27:45.762 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:45.762 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:27:45.762 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:27:45.762 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:27:45.762 INFO:teuthology.orchestra.run.smithi049.stdout: "id": "2" 2024-03-16T07:27:45.762 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:27:45.762 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:27:45.762 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_ready_timeouts": 0, 2024-03-16T07:27:45.762 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_idle_timeouts": 0 2024-03-16T07:27:45.762 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:45.763 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:45.763 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:27:45.763 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-0": [ 2024-03-16T07:27:45.763 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:27:45.763 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:27:45.763 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:27:45.763 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 4, 2024-03-16T07:27:45.763 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 35, 2024-03-16T07:27:45.763 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 576, 2024-03-16T07:27:45.763 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 324240, 2024-03-16T07:27:45.763 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 8, 2024-03-16T07:27:45.763 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 4, 2024-03-16T07:27:45.763 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 0.200245766, 2024-03-16T07:27:45.763 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.052536230, 2024-03-16T07:27:45.763 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 0.128515061, 2024-03-16T07:27:45.763 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-03-16T07:27:45.763 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T07:27:45.764 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 32, 2024-03-16T07:27:45.764 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.133497159, 2024-03-16T07:27:45.764 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.004171786 2024-03-16T07:27:45.764 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:27:45.764 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-03-16T07:27:45.764 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:27:45.764 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:27:45.764 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:27:45.764 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:27:45.764 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 576, 2024-03-16T07:27:45.764 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 324240 2024-03-16T07:27:45.764 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:45.764 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:45.764 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:27:45.764 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-1": [ 2024-03-16T07:27:45.764 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:27:45.764 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:27:45.765 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:27:45.765 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 34, 2024-03-16T07:27:45.765 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 3, 2024-03-16T07:27:45.765 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 136688, 2024-03-16T07:27:45.765 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 464, 2024-03-16T07:27:45.765 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 3, 2024-03-16T07:27:45.765 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 0, 2024-03-16T07:27:45.765 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 0.264629193, 2024-03-16T07:27:45.765 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.001903003, 2024-03-16T07:27:45.765 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 0.173214183, 2024-03-16T07:27:45.765 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.085501363, 2024-03-16T07:27:45.765 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T07:27:45.765 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 3, 2024-03-16T07:27:45.765 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.054357270, 2024-03-16T07:27:45.765 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.018119090 2024-03-16T07:27:45.765 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:27:45.766 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-03-16T07:27:45.766 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:27:45.766 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:27:45.766 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:27:45.766 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:27:45.766 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 136688, 2024-03-16T07:27:45.766 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 464 2024-03-16T07:27:45.766 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:45.766 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:45.766 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:27:45.766 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-2": [ 2024-03-16T07:27:45.766 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:27:45.766 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:27:45.766 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:27:45.767 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 23, 2024-03-16T07:27:45.767 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 6, 2024-03-16T07:27:45.767 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 734128, 2024-03-16T07:27:45.767 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 928, 2024-03-16T07:27:45.767 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 2, 2024-03-16T07:27:45.767 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 1, 2024-03-16T07:27:45.767 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 0.420345742, 2024-03-16T07:27:45.767 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.004765872, 2024-03-16T07:27:45.767 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 0.828077674, 2024-03-16T07:27:45.767 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-03-16T07:27:45.767 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T07:27:45.767 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 6, 2024-03-16T07:27:45.767 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.158362306, 2024-03-16T07:27:45.767 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.026393717 2024-03-16T07:27:45.767 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:27:45.767 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-03-16T07:27:45.767 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:27:45.767 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:27:45.768 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:27:45.768 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:27:45.768 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 734128, 2024-03-16T07:27:45.768 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 928 2024-03-16T07:27:45.768 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:45.768 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:45.768 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:27:45.768 INFO:teuthology.orchestra.run.smithi049.stdout: "cct": [ 2024-03-16T07:27:45.768 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:27:45.768 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:27:45.768 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:27:45.768 INFO:teuthology.orchestra.run.smithi049.stdout: "total_workers": 0, 2024-03-16T07:27:45.768 INFO:teuthology.orchestra.run.smithi049.stdout: "unhealthy_workers": 0 2024-03-16T07:27:45.768 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:45.768 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:45.768 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:27:45.768 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs_mirror": [ 2024-03-16T07:27:45.769 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:27:45.769 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:27:45.769 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:27:45.769 INFO:teuthology.orchestra.run.smithi049.stdout: "mirrored_filesystems": 1, 2024-03-16T07:27:45.769 INFO:teuthology.orchestra.run.smithi049.stdout: "mirror_enable_failures": 0 2024-03-16T07:27:45.769 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:45.769 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:45.769 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:27:45.769 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs_mirror_mirrored_filesystems": [ 2024-03-16T07:27:45.769 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:27:45.769 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:27:45.769 INFO:teuthology.orchestra.run.smithi049.stdout: "filesystem": "cephfs" 2024-03-16T07:27:45.769 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:27:45.769 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:27:45.769 INFO:teuthology.orchestra.run.smithi049.stdout: "mirroring_peers": 0, 2024-03-16T07:27:45.769 INFO:teuthology.orchestra.run.smithi049.stdout: "directory_count": 0 2024-03-16T07:27:45.769 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:45.770 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:45.770 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:27:45.770 INFO:teuthology.orchestra.run.smithi049.stdout: "mempool": [ 2024-03-16T07:27:45.770 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:27:45.770 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:27:45.770 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:27:45.770 INFO:teuthology.orchestra.run.smithi049.stdout: "bloom_filter_bytes": 0, 2024-03-16T07:27:45.770 INFO:teuthology.orchestra.run.smithi049.stdout: "bloom_filter_items": 0, 2024-03-16T07:27:45.770 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_alloc_bytes": 0, 2024-03-16T07:27:45.770 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_alloc_items": 0, 2024-03-16T07:27:45.770 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_data_bytes": 0, 2024-03-16T07:27:45.770 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_data_items": 0, 2024-03-16T07:27:45.770 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_onode_bytes": 0, 2024-03-16T07:27:45.770 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_onode_items": 0, 2024-03-16T07:27:45.770 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_meta_bytes": 0, 2024-03-16T07:27:45.770 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_meta_items": 0, 2024-03-16T07:27:45.771 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_other_bytes": 0, 2024-03-16T07:27:45.771 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_other_items": 0, 2024-03-16T07:27:45.771 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_buffer_bytes": 0, 2024-03-16T07:27:45.771 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_buffer_items": 0, 2024-03-16T07:27:45.771 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_extent_bytes": 0, 2024-03-16T07:27:45.771 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_extent_items": 0, 2024-03-16T07:27:45.771 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_blob_bytes": 0, 2024-03-16T07:27:45.771 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_blob_items": 0, 2024-03-16T07:27:45.771 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_shared_blob_bytes": 0, 2024-03-16T07:27:45.771 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_shared_blob_items": 0, 2024-03-16T07:27:45.771 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_inline_bl_bytes": 0, 2024-03-16T07:27:45.771 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_inline_bl_items": 0, 2024-03-16T07:27:45.771 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_fsck_bytes": 0, 2024-03-16T07:27:45.771 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_fsck_items": 0, 2024-03-16T07:27:45.771 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_txc_bytes": 0, 2024-03-16T07:27:45.771 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_txc_items": 0, 2024-03-16T07:27:45.771 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_deferred_bytes": 0, 2024-03-16T07:27:45.772 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_deferred_items": 0, 2024-03-16T07:27:45.772 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_bytes": 0, 2024-03-16T07:27:45.772 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_items": 0, 2024-03-16T07:27:45.772 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_bytes": 0, 2024-03-16T07:27:45.772 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_items": 0, 2024-03-16T07:27:45.772 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_reader_bytes": 0, 2024-03-16T07:27:45.772 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_reader_items": 0, 2024-03-16T07:27:45.772 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_writer_bytes": 0, 2024-03-16T07:27:45.772 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_writer_items": 0, 2024-03-16T07:27:45.772 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_anon_bytes": 182719, 2024-03-16T07:27:45.772 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_anon_items": 53, 2024-03-16T07:27:45.772 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_meta_bytes": 0, 2024-03-16T07:27:45.772 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_meta_items": 0, 2024-03-16T07:27:45.772 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_bytes": 0, 2024-03-16T07:27:45.772 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_items": 0, 2024-03-16T07:27:45.772 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_mapbl_bytes": 0, 2024-03-16T07:27:45.772 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_mapbl_items": 0, 2024-03-16T07:27:45.772 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pglog_bytes": 0, 2024-03-16T07:27:45.773 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pglog_items": 0, 2024-03-16T07:27:45.773 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_bytes": 18952, 2024-03-16T07:27:45.773 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_items": 184, 2024-03-16T07:27:45.773 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_mapping_bytes": 0, 2024-03-16T07:27:45.773 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_mapping_items": 0, 2024-03-16T07:27:45.773 INFO:teuthology.orchestra.run.smithi049.stdout: "pgmap_bytes": 0, 2024-03-16T07:27:45.773 INFO:teuthology.orchestra.run.smithi049.stdout: "pgmap_items": 0, 2024-03-16T07:27:45.773 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_co_bytes": 0, 2024-03-16T07:27:45.773 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_co_items": 0, 2024-03-16T07:27:45.773 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_1_bytes": 0, 2024-03-16T07:27:45.773 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_1_items": 0, 2024-03-16T07:27:45.773 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_2_bytes": 0, 2024-03-16T07:27:45.773 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_2_items": 0 2024-03-16T07:27:45.773 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:45.773 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:45.773 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:27:45.773 INFO:teuthology.orchestra.run.smithi049.stdout: "objecter": [ 2024-03-16T07:27:45.774 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:27:45.774 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:27:45.774 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:27:45.774 INFO:teuthology.orchestra.run.smithi049.stdout: "op_active": 0, 2024-03-16T07:27:45.774 INFO:teuthology.orchestra.run.smithi049.stdout: "op_laggy": 0, 2024-03-16T07:27:45.774 INFO:teuthology.orchestra.run.smithi049.stdout: "op_send": 0, 2024-03-16T07:27:45.774 INFO:teuthology.orchestra.run.smithi049.stdout: "op_send_bytes": 0, 2024-03-16T07:27:45.774 INFO:teuthology.orchestra.run.smithi049.stdout: "op_resend": 0, 2024-03-16T07:27:45.774 INFO:teuthology.orchestra.run.smithi049.stdout: "op_reply": 0, 2024-03-16T07:27:45.774 INFO:teuthology.orchestra.run.smithi049.stdout: "op_latency": { 2024-03-16T07:27:45.774 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:27:45.774 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:27:45.774 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:27:45.774 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:27:45.774 INFO:teuthology.orchestra.run.smithi049.stdout: "op_inflight": 0, 2024-03-16T07:27:45.774 INFO:teuthology.orchestra.run.smithi049.stdout: "oplen_avg": { 2024-03-16T07:27:45.774 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:27:45.775 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0 2024-03-16T07:27:45.775 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:27:45.775 INFO:teuthology.orchestra.run.smithi049.stdout: "op": 0, 2024-03-16T07:27:45.775 INFO:teuthology.orchestra.run.smithi049.stdout: "op_r": 0, 2024-03-16T07:27:45.775 INFO:teuthology.orchestra.run.smithi049.stdout: "op_w": 0, 2024-03-16T07:27:45.775 INFO:teuthology.orchestra.run.smithi049.stdout: "op_rmw": 0, 2024-03-16T07:27:45.775 INFO:teuthology.orchestra.run.smithi049.stdout: "op_pg": 0, 2024-03-16T07:27:45.775 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_stat": 0, 2024-03-16T07:27:45.775 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_create": 0, 2024-03-16T07:27:45.775 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_read": 0, 2024-03-16T07:27:45.775 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_write": 0, 2024-03-16T07:27:45.775 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_writefull": 0, 2024-03-16T07:27:45.775 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_writesame": 0, 2024-03-16T07:27:45.775 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_append": 0, 2024-03-16T07:27:45.775 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_zero": 0, 2024-03-16T07:27:45.775 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_truncate": 0, 2024-03-16T07:27:45.776 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_delete": 0, 2024-03-16T07:27:45.776 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_mapext": 0, 2024-03-16T07:27:45.776 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_sparse_read": 0, 2024-03-16T07:27:45.776 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_clonerange": 0, 2024-03-16T07:27:45.776 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_getxattr": 0, 2024-03-16T07:27:45.776 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_setxattr": 0, 2024-03-16T07:27:45.776 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_cmpxattr": 0, 2024-03-16T07:27:45.776 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_rmxattr": 0, 2024-03-16T07:27:45.776 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_resetxattrs": 0, 2024-03-16T07:27:45.776 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_call": 0, 2024-03-16T07:27:45.776 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_watch": 0, 2024-03-16T07:27:45.776 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_notify": 0, 2024-03-16T07:27:45.776 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_src_cmpxattr": 0, 2024-03-16T07:27:45.776 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_pgls": 0, 2024-03-16T07:27:45.776 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_pgls_filter": 0, 2024-03-16T07:27:45.776 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_other": 0, 2024-03-16T07:27:45.776 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_active": 0, 2024-03-16T07:27:45.777 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_send": 0, 2024-03-16T07:27:45.777 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_resend": 0, 2024-03-16T07:27:45.777 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_ping": 0, 2024-03-16T07:27:45.777 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_active": 0, 2024-03-16T07:27:45.777 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_send": 0, 2024-03-16T07:27:45.777 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_resend": 0, 2024-03-16T07:27:45.777 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_active": 0, 2024-03-16T07:27:45.777 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_send": 0, 2024-03-16T07:27:45.777 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_resend": 0, 2024-03-16T07:27:45.777 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_active": 0, 2024-03-16T07:27:45.777 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_send": 0, 2024-03-16T07:27:45.777 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_resend": 0, 2024-03-16T07:27:45.777 INFO:teuthology.orchestra.run.smithi049.stdout: "command_active": 0, 2024-03-16T07:27:45.777 INFO:teuthology.orchestra.run.smithi049.stdout: "command_send": 0, 2024-03-16T07:27:45.777 INFO:teuthology.orchestra.run.smithi049.stdout: "command_resend": 0, 2024-03-16T07:27:45.777 INFO:teuthology.orchestra.run.smithi049.stdout: "map_epoch": 0, 2024-03-16T07:27:45.777 INFO:teuthology.orchestra.run.smithi049.stdout: "map_full": 0, 2024-03-16T07:27:45.777 INFO:teuthology.orchestra.run.smithi049.stdout: "map_inc": 0, 2024-03-16T07:27:45.778 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_sessions": 0, 2024-03-16T07:27:45.778 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_session_open": 0, 2024-03-16T07:27:45.778 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_session_close": 0, 2024-03-16T07:27:45.778 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_laggy": 0, 2024-03-16T07:27:45.778 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_wr": 0, 2024-03-16T07:27:45.778 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_rd": 0, 2024-03-16T07:27:45.778 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_del": 0 2024-03-16T07:27:45.778 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:45.778 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:45.778 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:27:45.778 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-msgr_dispatch_throttler-client": [ 2024-03-16T07:27:45.778 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:27:45.778 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:27:45.778 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:27:45.778 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:27:45.778 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-03-16T07:27:45.779 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:27:45.779 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 34, 2024-03-16T07:27:45.779 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 132077, 2024-03-16T07:27:45.779 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:27:45.779 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 34, 2024-03-16T07:27:45.779 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:27:45.779 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:27:45.779 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 34, 2024-03-16T07:27:45.779 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 132077, 2024-03-16T07:27:45.779 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:27:45.779 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:27:45.779 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:27:45.779 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:27:45.779 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:45.779 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:45.779 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:45.779 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:27:45.779 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-msgr_dispatch_throttler-radosclient": [ 2024-03-16T07:27:45.780 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:27:45.780 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:27:45.780 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:27:45.780 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:27:45.780 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-03-16T07:27:45.780 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:27:45.780 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 24, 2024-03-16T07:27:45.780 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 730609, 2024-03-16T07:27:45.780 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:27:45.780 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 24, 2024-03-16T07:27:45.780 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:27:45.780 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:27:45.780 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 24, 2024-03-16T07:27:45.780 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 730609, 2024-03-16T07:27:45.780 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:27:45.780 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:27:45.781 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:27:45.781 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:27:45.781 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:45.781 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:45.781 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:45.781 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:27:45.781 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-objecter_bytes": [ 2024-03-16T07:27:45.781 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:27:45.781 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:27:45.781 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:27:45.781 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:27:45.781 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-03-16T07:27:45.781 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:27:45.781 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 0, 2024-03-16T07:27:45.781 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 0, 2024-03-16T07:27:45.781 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:27:45.781 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 0, 2024-03-16T07:27:45.781 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:27:45.782 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:27:45.782 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 0, 2024-03-16T07:27:45.782 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 0, 2024-03-16T07:27:45.782 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:27:45.782 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:27:45.782 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:27:45.782 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:27:45.782 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:45.782 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:45.782 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:45.782 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:27:45.782 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-objecter_ops": [ 2024-03-16T07:27:45.782 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:27:45.782 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:27:45.782 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:27:45.782 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:27:45.783 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 1024, 2024-03-16T07:27:45.783 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:27:45.783 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 0, 2024-03-16T07:27:45.783 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 0, 2024-03-16T07:27:45.783 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:27:45.783 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 0, 2024-03-16T07:27:45.783 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:27:45.783 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:27:45.783 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 0, 2024-03-16T07:27:45.783 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 0, 2024-03-16T07:27:45.783 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:27:45.783 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:27:45.783 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:27:45.783 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:27:45.783 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:45.783 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:45.784 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:45.784 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2024-03-16T07:27:45.784 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-03-16T07:27:45.784 DEBUG:tasks.cephfs.test_mirroring:command returned={ "AsyncMessenger::Worker": [ { "labels": { "id": "0" }, "counters": { "msgr_connection_ready_timeouts": 0, "msgr_connection_idle_timeouts": 0 } }, { "labels": { "id": "1" }, "counters": { "msgr_connection_ready_timeouts": 0, "msgr_connection_idle_timeouts": 0 } }, { "labels": { "id": "2" }, "counters": { "msgr_connection_ready_timeouts": 0, "msgr_connection_idle_timeouts": 0 } } ], "AsyncMessenger::Worker-0": [ { "labels": {}, "counters": { "msgr_recv_messages": 4, "msgr_send_messages": 35, "msgr_recv_bytes": 576, "msgr_send_bytes": 324240, "msgr_created_connections": 8, "msgr_active_connections": 4, "msgr_running_total_time": 0.200245766, "msgr_running_send_time": 0.052536230, "msgr_running_recv_time": 0.128515061, "msgr_running_fast_dispatch_time": 0.000000000, "msgr_send_messages_queue_lat": { "avgcount": 32, "sum": 0.133497159, "avgtime": 0.004171786 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "msgr_recv_encrypted_bytes": 576, "msgr_send_encrypted_bytes": 324240 } } ], "AsyncMessenger::Worker-1": [ { "labels": {}, "counters": { "msgr_recv_messages": 34, "msgr_send_messages": 3, "msgr_recv_bytes": 136688, "msgr_send_bytes": 464, "msgr_created_connections": 3, "msgr_active_connections": 0, "msgr_running_total_time": 0.264629193, "msgr_running_send_time": 0.001903003, "msgr_running_recv_time": 0.173214183, "msgr_running_fast_dispatch_time": 0.085501363, "msgr_send_messages_queue_lat": { "avgcount": 3, "sum": 0.054357270, "avgtime": 0.018119090 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "msgr_recv_encrypted_bytes": 136688, "msgr_send_encrypted_bytes": 464 } } ], "AsyncMessenger::Worker-2": [ { "labels": {}, "counters": { "msgr_recv_messages": 23, "msgr_send_messages": 6, "msgr_recv_bytes": 734128, "msgr_send_bytes": 928, "msgr_created_connections": 2, "msgr_active_connections": 1, "msgr_running_total_time": 0.420345742, "msgr_running_send_time": 0.004765872, "msgr_running_recv_time": 0.828077674, "msgr_running_fast_dispatch_time": 0.000000000, "msgr_send_messages_queue_lat": { "avgcount": 6, "sum": 0.158362306, "avgtime": 0.026393717 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "msgr_recv_encrypted_bytes": 734128, "msgr_send_encrypted_bytes": 928 } } ], "cct": [ { "labels": {}, "counters": { "total_workers": 0, "unhealthy_workers": 0 } } ], "cephfs_mirror": [ { "labels": {}, "counters": { "mirrored_filesystems": 1, "mirror_enable_failures": 0 } } ], "cephfs_mirror_mirrored_filesystems": [ { "labels": { "filesystem": "cephfs" }, "counters": { "mirroring_peers": 0, "directory_count": 0 } } ], "mempool": [ { "labels": {}, "counters": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_cache_buffer_bytes": 0, "bluestore_cache_buffer_items": 0, "bluestore_extent_bytes": 0, "bluestore_extent_items": 0, "bluestore_blob_bytes": 0, "bluestore_blob_items": 0, "bluestore_shared_blob_bytes": 0, "bluestore_shared_blob_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_items": 0, "bluefs_bytes": 0, "bluefs_items": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "buffer_anon_bytes": 182719, "buffer_anon_items": 53, "buffer_meta_bytes": 0, "buffer_meta_items": 0, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 18952, "osdmap_items": 184, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "mds_co_bytes": 0, "mds_co_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 } } ], "objecter": [ { "labels": {}, "counters": { "op_active": 0, "op_laggy": 0, "op_send": 0, "op_send_bytes": 0, "op_resend": 0, "op_reply": 0, "op_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "op_inflight": 0, "oplen_avg": { "avgcount": 0, "sum": 0 }, "op": 0, "op_r": 0, "op_w": 0, "op_rmw": 0, "op_pg": 0, "osdop_stat": 0, "osdop_create": 0, "osdop_read": 0, "osdop_write": 0, "osdop_writefull": 0, "osdop_writesame": 0, "osdop_append": 0, "osdop_zero": 0, "osdop_truncate": 0, "osdop_delete": 0, "osdop_mapext": 0, "osdop_sparse_read": 0, "osdop_clonerange": 0, "osdop_getxattr": 0, "osdop_setxattr": 0, "osdop_cmpxattr": 0, "osdop_rmxattr": 0, "osdop_resetxattrs": 0, "osdop_call": 0, "osdop_watch": 0, "osdop_notify": 0, "osdop_src_cmpxattr": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_other": 0, "linger_active": 0, "linger_send": 0, "linger_resend": 0, "linger_ping": 0, "poolop_active": 0, "poolop_send": 0, "poolop_resend": 0, "poolstat_active": 0, "poolstat_send": 0, "poolstat_resend": 0, "statfs_active": 0, "statfs_send": 0, "statfs_resend": 0, "command_active": 0, "command_send": 0, "command_resend": 0, "map_epoch": 0, "map_full": 0, "map_inc": 0, "osd_sessions": 0, "osd_session_open": 0, "osd_session_close": 0, "osd_laggy": 0, "omap_wr": 0, "omap_rd": 0, "omap_del": 0 } } ], "throttle-msgr_dispatch_throttler-client": [ { "labels": {}, "counters": { "val": 0, "max": 104857600, "get_started": 0, "get": 34, "get_sum": 132077, "get_or_fail_fail": 0, "get_or_fail_success": 34, "take": 0, "take_sum": 0, "put": 34, "put_sum": 132077, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ], "throttle-msgr_dispatch_throttler-radosclient": [ { "labels": {}, "counters": { "val": 0, "max": 104857600, "get_started": 0, "get": 24, "get_sum": 730609, "get_or_fail_fail": 0, "get_or_fail_success": 24, "take": 0, "take_sum": 0, "put": 24, "put_sum": 730609, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ], "throttle-objecter_bytes": [ { "labels": {}, "counters": { "val": 0, "max": 104857600, "get_started": 0, "get": 0, "get_sum": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "take": 0, "take_sum": 0, "put": 0, "put_sum": 0, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ], "throttle-objecter_ops": [ { "labels": {}, "counters": { "val": 0, "max": 1024, "get_started": 0, "get": 0, "get_sum": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "take": 0, "take_sum": 0, "put": 0, "put_sum": 0, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ] } 2024-03-16T07:27:45.785 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-03-16T07:27:45.785 DEBUG:teuthology.orchestra.run.smithi049:mirror status for fs: cephfs> ceph --admin-daemon /var/run/ceph/cephfs-mirror.asok fs mirror status cephfs@4 2024-03-16T07:27:45.879 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-03-16T07:27:45.879 INFO:teuthology.orchestra.run.smithi049.stdout: "rados_inst": "172.21.15.49:0/2180583115", 2024-03-16T07:27:45.879 INFO:teuthology.orchestra.run.smithi049.stdout: "peers": {}, 2024-03-16T07:27:45.879 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_dirs": { 2024-03-16T07:27:45.879 INFO:teuthology.orchestra.run.smithi049.stdout: "dir_count": 0 2024-03-16T07:27:45.879 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:45.879 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-03-16T07:27:45.887 DEBUG:tasks.cephfs.test_mirroring:command returned={ "rados_inst": "172.21.15.49:0/2180583115", "peers": {}, "snap_dirs": { "dir_count": 0 } } 2024-03-16T07:27:45.887 DEBUG:tasks.cephfs.test_mirroring:initial dir_count=0 2024-03-16T07:27:45.887 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snapshot mirror add cephfs /d1/d2/d3 2024-03-16T07:27:46.309 INFO:teuthology.orchestra.run.smithi049.stdout:{} 2024-03-16T07:27:56.323 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-03-16T07:27:56.324 DEBUG:teuthology.orchestra.run.smithi049:mirror status for fs: cephfs> ceph --admin-daemon /var/run/ceph/cephfs-mirror.asok fs mirror status cephfs@4 2024-03-16T07:27:56.419 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-03-16T07:27:56.420 INFO:teuthology.orchestra.run.smithi049.stdout: "rados_inst": "172.21.15.49:0/2180583115", 2024-03-16T07:27:56.420 INFO:teuthology.orchestra.run.smithi049.stdout: "peers": {}, 2024-03-16T07:27:56.420 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_dirs": { 2024-03-16T07:27:56.420 INFO:teuthology.orchestra.run.smithi049.stdout: "dir_count": 1 2024-03-16T07:27:56.421 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:56.421 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-03-16T07:27:56.429 DEBUG:tasks.cephfs.test_mirroring:command returned={ "rados_inst": "172.21.15.49:0/2180583115", "peers": {}, "snap_dirs": { "dir_count": 1 } } 2024-03-16T07:27:56.430 DEBUG:tasks.cephfs.test_mirroring:new dir_count=1 2024-03-16T07:27:56.430 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-03-16T07:27:56.430 DEBUG:teuthology.orchestra.run.smithi049:counter dump for fs: cephfs> ceph --admin-daemon /var/run/ceph/cephfs-mirror.asok counter dump 2024-03-16T07:27:56.544 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-03-16T07:27:56.544 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker": [ 2024-03-16T07:27:56.544 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:27:56.545 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:27:56.545 INFO:teuthology.orchestra.run.smithi049.stdout: "id": "0" 2024-03-16T07:27:56.545 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:27:56.545 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:27:56.545 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_ready_timeouts": 0, 2024-03-16T07:27:56.545 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_idle_timeouts": 0 2024-03-16T07:27:56.546 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:56.546 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:27:56.546 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:27:56.546 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:27:56.547 INFO:teuthology.orchestra.run.smithi049.stdout: "id": "1" 2024-03-16T07:27:56.547 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:27:56.547 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:27:56.547 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_ready_timeouts": 0, 2024-03-16T07:27:56.547 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_idle_timeouts": 0 2024-03-16T07:27:56.548 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:56.548 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:27:56.548 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:27:56.548 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:27:56.548 INFO:teuthology.orchestra.run.smithi049.stdout: "id": "2" 2024-03-16T07:27:56.548 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:27:56.549 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:27:56.549 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_ready_timeouts": 0, 2024-03-16T07:27:56.549 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_idle_timeouts": 0 2024-03-16T07:27:56.549 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:56.550 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:56.550 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:27:56.550 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-0": [ 2024-03-16T07:27:56.550 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:27:56.550 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:27:56.550 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:27:56.551 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 4, 2024-03-16T07:27:56.551 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 37, 2024-03-16T07:27:56.551 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 576, 2024-03-16T07:27:56.551 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 324800, 2024-03-16T07:27:56.551 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 8, 2024-03-16T07:27:56.552 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 4, 2024-03-16T07:27:56.552 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 0.201353349, 2024-03-16T07:27:56.552 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.053465126, 2024-03-16T07:27:56.552 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 0.128515061, 2024-03-16T07:27:56.552 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-03-16T07:27:56.553 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T07:27:56.553 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 34, 2024-03-16T07:27:56.553 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.134137945, 2024-03-16T07:27:56.553 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.003945233 2024-03-16T07:27:56.553 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:27:56.554 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-03-16T07:27:56.554 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:27:56.554 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:27:56.554 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:27:56.554 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:27:56.555 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 576, 2024-03-16T07:27:56.555 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 324800 2024-03-16T07:27:56.555 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:56.555 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:56.555 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:27:56.555 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-1": [ 2024-03-16T07:27:56.556 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:27:56.556 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:27:56.556 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:27:56.556 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 34, 2024-03-16T07:27:56.556 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 3, 2024-03-16T07:27:56.557 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 136688, 2024-03-16T07:27:56.557 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 464, 2024-03-16T07:27:56.557 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 3, 2024-03-16T07:27:56.557 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 0, 2024-03-16T07:27:56.557 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 0.264966970, 2024-03-16T07:27:56.557 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.001951181, 2024-03-16T07:27:56.558 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 0.173335830, 2024-03-16T07:27:56.558 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.085501363, 2024-03-16T07:27:56.558 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T07:27:56.558 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 3, 2024-03-16T07:27:56.558 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.054357270, 2024-03-16T07:27:56.559 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.018119090 2024-03-16T07:27:56.559 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:27:56.559 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-03-16T07:27:56.559 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:27:56.559 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:27:56.559 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:27:56.560 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:27:56.560 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 136688, 2024-03-16T07:27:56.560 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 464 2024-03-16T07:27:56.560 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:56.560 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:56.561 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:27:56.561 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-2": [ 2024-03-16T07:27:56.561 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:27:56.561 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:27:56.561 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:27:56.561 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 23, 2024-03-16T07:27:56.562 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 6, 2024-03-16T07:27:56.562 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 734128, 2024-03-16T07:27:56.562 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 928, 2024-03-16T07:27:56.562 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 2, 2024-03-16T07:27:56.562 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 1, 2024-03-16T07:27:56.563 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 0.421000478, 2024-03-16T07:27:56.563 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.004838986, 2024-03-16T07:27:56.563 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 0.828298034, 2024-03-16T07:27:56.563 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-03-16T07:27:56.563 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T07:27:56.563 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 6, 2024-03-16T07:27:56.564 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.158362306, 2024-03-16T07:27:56.564 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.026393717 2024-03-16T07:27:56.564 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:27:56.564 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-03-16T07:27:56.564 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:27:56.564 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:27:56.565 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:27:56.565 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:27:56.565 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 734128, 2024-03-16T07:27:56.565 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 928 2024-03-16T07:27:56.565 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:56.565 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:56.566 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:27:56.566 INFO:teuthology.orchestra.run.smithi049.stdout: "cct": [ 2024-03-16T07:27:56.566 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:27:56.566 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:27:56.566 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:27:56.567 INFO:teuthology.orchestra.run.smithi049.stdout: "total_workers": 0, 2024-03-16T07:27:56.567 INFO:teuthology.orchestra.run.smithi049.stdout: "unhealthy_workers": 0 2024-03-16T07:27:56.567 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:56.567 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:56.567 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:27:56.568 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs_mirror": [ 2024-03-16T07:27:56.568 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:27:56.568 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:27:56.568 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:27:56.568 INFO:teuthology.orchestra.run.smithi049.stdout: "mirrored_filesystems": 1, 2024-03-16T07:27:56.568 INFO:teuthology.orchestra.run.smithi049.stdout: "mirror_enable_failures": 0 2024-03-16T07:27:56.569 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:56.569 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:56.569 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:27:56.569 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs_mirror_mirrored_filesystems": [ 2024-03-16T07:27:56.569 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:27:56.570 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:27:56.570 INFO:teuthology.orchestra.run.smithi049.stdout: "filesystem": "cephfs" 2024-03-16T07:27:56.570 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:27:56.570 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:27:56.570 INFO:teuthology.orchestra.run.smithi049.stdout: "mirroring_peers": 0, 2024-03-16T07:27:56.571 INFO:teuthology.orchestra.run.smithi049.stdout: "directory_count": 1 2024-03-16T07:27:56.571 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:56.571 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:56.571 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:27:56.571 INFO:teuthology.orchestra.run.smithi049.stdout: "mempool": [ 2024-03-16T07:27:56.572 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:27:56.572 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:27:56.572 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:27:56.572 INFO:teuthology.orchestra.run.smithi049.stdout: "bloom_filter_bytes": 0, 2024-03-16T07:27:56.572 INFO:teuthology.orchestra.run.smithi049.stdout: "bloom_filter_items": 0, 2024-03-16T07:27:56.572 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_alloc_bytes": 0, 2024-03-16T07:27:56.573 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_alloc_items": 0, 2024-03-16T07:27:56.573 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_data_bytes": 0, 2024-03-16T07:27:56.573 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_data_items": 0, 2024-03-16T07:27:56.573 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_onode_bytes": 0, 2024-03-16T07:27:56.573 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_onode_items": 0, 2024-03-16T07:27:56.574 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_meta_bytes": 0, 2024-03-16T07:27:56.574 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_meta_items": 0, 2024-03-16T07:27:56.574 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_other_bytes": 0, 2024-03-16T07:27:56.574 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_other_items": 0, 2024-03-16T07:27:56.574 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_buffer_bytes": 0, 2024-03-16T07:27:56.575 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_buffer_items": 0, 2024-03-16T07:27:56.575 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_extent_bytes": 0, 2024-03-16T07:27:56.575 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_extent_items": 0, 2024-03-16T07:27:56.575 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_blob_bytes": 0, 2024-03-16T07:27:56.575 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_blob_items": 0, 2024-03-16T07:27:56.575 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_shared_blob_bytes": 0, 2024-03-16T07:27:56.576 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_shared_blob_items": 0, 2024-03-16T07:27:56.576 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_inline_bl_bytes": 0, 2024-03-16T07:27:56.576 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_inline_bl_items": 0, 2024-03-16T07:27:56.576 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_fsck_bytes": 0, 2024-03-16T07:27:56.576 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_fsck_items": 0, 2024-03-16T07:27:56.577 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_txc_bytes": 0, 2024-03-16T07:27:56.577 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_txc_items": 0, 2024-03-16T07:27:56.577 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_deferred_bytes": 0, 2024-03-16T07:27:56.577 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_deferred_items": 0, 2024-03-16T07:27:56.577 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_bytes": 0, 2024-03-16T07:27:56.577 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_items": 0, 2024-03-16T07:27:56.578 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_bytes": 0, 2024-03-16T07:27:56.578 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_items": 0, 2024-03-16T07:27:56.578 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_reader_bytes": 0, 2024-03-16T07:27:56.578 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_reader_items": 0, 2024-03-16T07:27:56.578 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_writer_bytes": 0, 2024-03-16T07:27:56.579 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_writer_items": 0, 2024-03-16T07:27:56.579 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_anon_bytes": 182719, 2024-03-16T07:27:56.579 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_anon_items": 53, 2024-03-16T07:27:56.579 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_meta_bytes": 0, 2024-03-16T07:27:56.579 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_meta_items": 0, 2024-03-16T07:27:56.579 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_bytes": 0, 2024-03-16T07:27:56.580 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_items": 0, 2024-03-16T07:27:56.580 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_mapbl_bytes": 0, 2024-03-16T07:27:56.580 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_mapbl_items": 0, 2024-03-16T07:27:56.580 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pglog_bytes": 0, 2024-03-16T07:27:56.580 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pglog_items": 0, 2024-03-16T07:27:56.581 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_bytes": 18952, 2024-03-16T07:27:56.581 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_items": 184, 2024-03-16T07:27:56.581 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_mapping_bytes": 0, 2024-03-16T07:27:56.581 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_mapping_items": 0, 2024-03-16T07:27:56.581 INFO:teuthology.orchestra.run.smithi049.stdout: "pgmap_bytes": 0, 2024-03-16T07:27:56.581 INFO:teuthology.orchestra.run.smithi049.stdout: "pgmap_items": 0, 2024-03-16T07:27:56.582 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_co_bytes": 0, 2024-03-16T07:27:56.582 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_co_items": 0, 2024-03-16T07:27:56.582 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_1_bytes": 0, 2024-03-16T07:27:56.582 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_1_items": 0, 2024-03-16T07:27:56.582 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_2_bytes": 0, 2024-03-16T07:27:56.583 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_2_items": 0 2024-03-16T07:27:56.583 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:56.583 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:56.583 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:27:56.583 INFO:teuthology.orchestra.run.smithi049.stdout: "objecter": [ 2024-03-16T07:27:56.583 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:27:56.584 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:27:56.584 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:27:56.584 INFO:teuthology.orchestra.run.smithi049.stdout: "op_active": 0, 2024-03-16T07:27:56.584 INFO:teuthology.orchestra.run.smithi049.stdout: "op_laggy": 0, 2024-03-16T07:27:56.584 INFO:teuthology.orchestra.run.smithi049.stdout: "op_send": 0, 2024-03-16T07:27:56.584 INFO:teuthology.orchestra.run.smithi049.stdout: "op_send_bytes": 0, 2024-03-16T07:27:56.585 INFO:teuthology.orchestra.run.smithi049.stdout: "op_resend": 0, 2024-03-16T07:27:56.585 INFO:teuthology.orchestra.run.smithi049.stdout: "op_reply": 0, 2024-03-16T07:27:56.585 INFO:teuthology.orchestra.run.smithi049.stdout: "op_latency": { 2024-03-16T07:27:56.585 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:27:56.586 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:27:56.586 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:27:56.586 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:27:56.586 INFO:teuthology.orchestra.run.smithi049.stdout: "op_inflight": 0, 2024-03-16T07:27:56.586 INFO:teuthology.orchestra.run.smithi049.stdout: "oplen_avg": { 2024-03-16T07:27:56.587 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:27:56.587 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0 2024-03-16T07:27:56.587 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:27:56.587 INFO:teuthology.orchestra.run.smithi049.stdout: "op": 0, 2024-03-16T07:27:56.587 INFO:teuthology.orchestra.run.smithi049.stdout: "op_r": 0, 2024-03-16T07:27:56.588 INFO:teuthology.orchestra.run.smithi049.stdout: "op_w": 0, 2024-03-16T07:27:56.588 INFO:teuthology.orchestra.run.smithi049.stdout: "op_rmw": 0, 2024-03-16T07:27:56.588 INFO:teuthology.orchestra.run.smithi049.stdout: "op_pg": 0, 2024-03-16T07:27:56.588 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_stat": 0, 2024-03-16T07:27:56.588 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_create": 0, 2024-03-16T07:27:56.588 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_read": 0, 2024-03-16T07:27:56.588 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_write": 0, 2024-03-16T07:27:56.588 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_writefull": 0, 2024-03-16T07:27:56.589 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_writesame": 0, 2024-03-16T07:27:56.589 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_append": 0, 2024-03-16T07:27:56.589 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_zero": 0, 2024-03-16T07:27:56.589 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_truncate": 0, 2024-03-16T07:27:56.589 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_delete": 0, 2024-03-16T07:27:56.589 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_mapext": 0, 2024-03-16T07:27:56.589 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_sparse_read": 0, 2024-03-16T07:27:56.589 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_clonerange": 0, 2024-03-16T07:27:56.589 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_getxattr": 0, 2024-03-16T07:27:56.589 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_setxattr": 0, 2024-03-16T07:27:56.589 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_cmpxattr": 0, 2024-03-16T07:27:56.589 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_rmxattr": 0, 2024-03-16T07:27:56.589 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_resetxattrs": 0, 2024-03-16T07:27:56.589 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_call": 0, 2024-03-16T07:27:56.590 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_watch": 0, 2024-03-16T07:27:56.590 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_notify": 0, 2024-03-16T07:27:56.590 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_src_cmpxattr": 0, 2024-03-16T07:27:56.590 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_pgls": 0, 2024-03-16T07:27:56.590 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_pgls_filter": 0, 2024-03-16T07:27:56.590 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_other": 0, 2024-03-16T07:27:56.590 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_active": 0, 2024-03-16T07:27:56.590 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_send": 0, 2024-03-16T07:27:56.590 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_resend": 0, 2024-03-16T07:27:56.590 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_ping": 0, 2024-03-16T07:27:56.590 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_active": 0, 2024-03-16T07:27:56.590 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_send": 0, 2024-03-16T07:27:56.590 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_resend": 0, 2024-03-16T07:27:56.590 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_active": 0, 2024-03-16T07:27:56.590 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_send": 0, 2024-03-16T07:27:56.591 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_resend": 0, 2024-03-16T07:27:56.591 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_active": 0, 2024-03-16T07:27:56.591 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_send": 0, 2024-03-16T07:27:56.591 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_resend": 0, 2024-03-16T07:27:56.591 INFO:teuthology.orchestra.run.smithi049.stdout: "command_active": 0, 2024-03-16T07:27:56.591 INFO:teuthology.orchestra.run.smithi049.stdout: "command_send": 0, 2024-03-16T07:27:56.591 INFO:teuthology.orchestra.run.smithi049.stdout: "command_resend": 0, 2024-03-16T07:27:56.591 INFO:teuthology.orchestra.run.smithi049.stdout: "map_epoch": 0, 2024-03-16T07:27:56.591 INFO:teuthology.orchestra.run.smithi049.stdout: "map_full": 0, 2024-03-16T07:27:56.591 INFO:teuthology.orchestra.run.smithi049.stdout: "map_inc": 0, 2024-03-16T07:27:56.591 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_sessions": 0, 2024-03-16T07:27:56.591 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_session_open": 0, 2024-03-16T07:27:56.591 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_session_close": 0, 2024-03-16T07:27:56.591 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_laggy": 0, 2024-03-16T07:27:56.591 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_wr": 0, 2024-03-16T07:27:56.592 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_rd": 0, 2024-03-16T07:27:56.592 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_del": 0 2024-03-16T07:27:56.592 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:56.592 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:56.592 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:27:56.592 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-msgr_dispatch_throttler-client": [ 2024-03-16T07:27:56.592 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:27:56.592 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:27:56.592 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:27:56.592 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:27:56.592 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-03-16T07:27:56.592 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:27:56.592 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 34, 2024-03-16T07:27:56.592 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 132077, 2024-03-16T07:27:56.592 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:27:56.593 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 34, 2024-03-16T07:27:56.593 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:27:56.593 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:27:56.593 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 34, 2024-03-16T07:27:56.593 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 132077, 2024-03-16T07:27:56.593 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:27:56.593 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:27:56.593 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:27:56.593 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:27:56.593 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:56.593 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:56.593 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:56.593 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:27:56.593 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-msgr_dispatch_throttler-radosclient": [ 2024-03-16T07:27:56.594 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:27:56.594 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:27:56.594 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:27:56.594 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:27:56.594 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-03-16T07:27:56.594 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:27:56.594 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 24, 2024-03-16T07:27:56.594 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 730609, 2024-03-16T07:27:56.594 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:27:56.594 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 24, 2024-03-16T07:27:56.594 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:27:56.594 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:27:56.594 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 24, 2024-03-16T07:27:56.594 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 730609, 2024-03-16T07:27:56.594 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:27:56.595 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:27:56.595 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:27:56.595 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:27:56.595 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:56.595 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:56.595 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:56.595 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:27:56.595 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-objecter_bytes": [ 2024-03-16T07:27:56.595 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:27:56.595 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:27:56.595 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:27:56.595 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:27:56.595 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-03-16T07:27:56.595 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:27:56.595 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 0, 2024-03-16T07:27:56.596 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 0, 2024-03-16T07:27:56.596 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:27:56.596 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 0, 2024-03-16T07:27:56.596 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:27:56.596 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:27:56.596 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 0, 2024-03-16T07:27:56.596 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 0, 2024-03-16T07:27:56.596 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:27:56.596 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:27:56.596 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:27:56.596 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:27:56.596 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:56.596 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:56.596 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:56.596 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:27:56.597 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-objecter_ops": [ 2024-03-16T07:27:56.597 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:27:56.597 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:27:56.597 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:27:56.597 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:27:56.597 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 1024, 2024-03-16T07:27:56.597 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:27:56.597 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 0, 2024-03-16T07:27:56.597 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 0, 2024-03-16T07:27:56.597 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:27:56.597 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 0, 2024-03-16T07:27:56.597 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:27:56.597 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:27:56.597 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 0, 2024-03-16T07:27:56.598 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 0, 2024-03-16T07:27:56.598 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:27:56.598 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:27:56.598 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:27:56.598 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:27:56.598 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:56.598 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:56.598 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:56.598 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2024-03-16T07:27:56.598 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-03-16T07:27:56.599 DEBUG:tasks.cephfs.test_mirroring:command returned={ "AsyncMessenger::Worker": [ { "labels": { "id": "0" }, "counters": { "msgr_connection_ready_timeouts": 0, "msgr_connection_idle_timeouts": 0 } }, { "labels": { "id": "1" }, "counters": { "msgr_connection_ready_timeouts": 0, "msgr_connection_idle_timeouts": 0 } }, { "labels": { "id": "2" }, "counters": { "msgr_connection_ready_timeouts": 0, "msgr_connection_idle_timeouts": 0 } } ], "AsyncMessenger::Worker-0": [ { "labels": {}, "counters": { "msgr_recv_messages": 4, "msgr_send_messages": 37, "msgr_recv_bytes": 576, "msgr_send_bytes": 324800, "msgr_created_connections": 8, "msgr_active_connections": 4, "msgr_running_total_time": 0.201353349, "msgr_running_send_time": 0.053465126, "msgr_running_recv_time": 0.128515061, "msgr_running_fast_dispatch_time": 0.000000000, "msgr_send_messages_queue_lat": { "avgcount": 34, "sum": 0.134137945, "avgtime": 0.003945233 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "msgr_recv_encrypted_bytes": 576, "msgr_send_encrypted_bytes": 324800 } } ], "AsyncMessenger::Worker-1": [ { "labels": {}, "counters": { "msgr_recv_messages": 34, "msgr_send_messages": 3, "msgr_recv_bytes": 136688, "msgr_send_bytes": 464, "msgr_created_connections": 3, "msgr_active_connections": 0, "msgr_running_total_time": 0.264966970, "msgr_running_send_time": 0.001951181, "msgr_running_recv_time": 0.173335830, "msgr_running_fast_dispatch_time": 0.085501363, "msgr_send_messages_queue_lat": { "avgcount": 3, "sum": 0.054357270, "avgtime": 0.018119090 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "msgr_recv_encrypted_bytes": 136688, "msgr_send_encrypted_bytes": 464 } } ], "AsyncMessenger::Worker-2": [ { "labels": {}, "counters": { "msgr_recv_messages": 23, "msgr_send_messages": 6, "msgr_recv_bytes": 734128, "msgr_send_bytes": 928, "msgr_created_connections": 2, "msgr_active_connections": 1, "msgr_running_total_time": 0.421000478, "msgr_running_send_time": 0.004838986, "msgr_running_recv_time": 0.828298034, "msgr_running_fast_dispatch_time": 0.000000000, "msgr_send_messages_queue_lat": { "avgcount": 6, "sum": 0.158362306, "avgtime": 0.026393717 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "msgr_recv_encrypted_bytes": 734128, "msgr_send_encrypted_bytes": 928 } } ], "cct": [ { "labels": {}, "counters": { "total_workers": 0, "unhealthy_workers": 0 } } ], "cephfs_mirror": [ { "labels": {}, "counters": { "mirrored_filesystems": 1, "mirror_enable_failures": 0 } } ], "cephfs_mirror_mirrored_filesystems": [ { "labels": { "filesystem": "cephfs" }, "counters": { "mirroring_peers": 0, "directory_count": 1 } } ], "mempool": [ { "labels": {}, "counters": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_cache_buffer_bytes": 0, "bluestore_cache_buffer_items": 0, "bluestore_extent_bytes": 0, "bluestore_extent_items": 0, "bluestore_blob_bytes": 0, "bluestore_blob_items": 0, "bluestore_shared_blob_bytes": 0, "bluestore_shared_blob_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_items": 0, "bluefs_bytes": 0, "bluefs_items": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "buffer_anon_bytes": 182719, "buffer_anon_items": 53, "buffer_meta_bytes": 0, "buffer_meta_items": 0, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 18952, "osdmap_items": 184, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "mds_co_bytes": 0, "mds_co_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 } } ], "objecter": [ { "labels": {}, "counters": { "op_active": 0, "op_laggy": 0, "op_send": 0, "op_send_bytes": 0, "op_resend": 0, "op_reply": 0, "op_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "op_inflight": 0, "oplen_avg": { "avgcount": 0, "sum": 0 }, "op": 0, "op_r": 0, "op_w": 0, "op_rmw": 0, "op_pg": 0, "osdop_stat": 0, "osdop_create": 0, "osdop_read": 0, "osdop_write": 0, "osdop_writefull": 0, "osdop_writesame": 0, "osdop_append": 0, "osdop_zero": 0, "osdop_truncate": 0, "osdop_delete": 0, "osdop_mapext": 0, "osdop_sparse_read": 0, "osdop_clonerange": 0, "osdop_getxattr": 0, "osdop_setxattr": 0, "osdop_cmpxattr": 0, "osdop_rmxattr": 0, "osdop_resetxattrs": 0, "osdop_call": 0, "osdop_watch": 0, "osdop_notify": 0, "osdop_src_cmpxattr": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_other": 0, "linger_active": 0, "linger_send": 0, "linger_resend": 0, "linger_ping": 0, "poolop_active": 0, "poolop_send": 0, "poolop_resend": 0, "poolstat_active": 0, "poolstat_send": 0, "poolstat_resend": 0, "statfs_active": 0, "statfs_send": 0, "statfs_resend": 0, "command_active": 0, "command_send": 0, "command_resend": 0, "map_epoch": 0, "map_full": 0, "map_inc": 0, "osd_sessions": 0, "osd_session_open": 0, "osd_session_close": 0, "osd_laggy": 0, "omap_wr": 0, "omap_rd": 0, "omap_del": 0 } } ], "throttle-msgr_dispatch_throttler-client": [ { "labels": {}, "counters": { "val": 0, "max": 104857600, "get_started": 0, "get": 34, "get_sum": 132077, "get_or_fail_fail": 0, "get_or_fail_success": 34, "take": 0, "take_sum": 0, "put": 34, "put_sum": 132077, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ], "throttle-msgr_dispatch_throttler-radosclient": [ { "labels": {}, "counters": { "val": 0, "max": 104857600, "get_started": 0, "get": 24, "get_sum": 730609, "get_or_fail_fail": 0, "get_or_fail_success": 24, "take": 0, "take_sum": 0, "put": 24, "put_sum": 730609, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ], "throttle-objecter_bytes": [ { "labels": {}, "counters": { "val": 0, "max": 104857600, "get_started": 0, "get": 0, "get_sum": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "take": 0, "take_sum": 0, "put": 0, "put_sum": 0, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ], "throttle-objecter_ops": [ { "labels": {}, "counters": { "val": 0, "max": 1024, "get_started": 0, "get": 0, "get_sum": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "take": 0, "take_sum": 0, "put": 0, "put_sum": 0, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ] } 2024-03-16T07:27:56.600 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-03-16T07:27:56.600 DEBUG:teuthology.orchestra.run.smithi049:mirror status for fs: cephfs> ceph --admin-daemon /var/run/ceph/cephfs-mirror.asok fs mirror status cephfs@4 2024-03-16T07:27:56.694 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-03-16T07:27:56.694 INFO:teuthology.orchestra.run.smithi049.stdout: "rados_inst": "172.21.15.49:0/2180583115", 2024-03-16T07:27:56.694 INFO:teuthology.orchestra.run.smithi049.stdout: "peers": {}, 2024-03-16T07:27:56.694 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_dirs": { 2024-03-16T07:27:56.694 INFO:teuthology.orchestra.run.smithi049.stdout: "dir_count": 1 2024-03-16T07:27:56.694 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:56.694 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-03-16T07:27:56.701 DEBUG:tasks.cephfs.test_mirroring:command returned={ "rados_inst": "172.21.15.49:0/2180583115", "peers": {}, "snap_dirs": { "dir_count": 1 } } 2024-03-16T07:27:56.701 DEBUG:tasks.cephfs.test_mirroring:initial dir_count=1 2024-03-16T07:27:56.701 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snapshot mirror add cephfs /d1/d2/././././././d3 2024-03-16T07:27:57.112 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:27:57.114+0000 7f29f6fe3640 -1 mgr.server reply reply (17) File exists directory /d1/d2/d3 is already tracked 2024-03-16T07:27:57.112 INFO:teuthology.orchestra.run.smithi049.stderr:Error EEXIST: directory /d1/d2/d3 is already tracked 2024-03-16T07:27:57.117 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-03-16T07:27:57.118 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-03-16T07:27:57.118 DEBUG:teuthology.orchestra.run.smithi049:mirror status for fs: cephfs> ceph --admin-daemon /var/run/ceph/cephfs-mirror.asok fs mirror status cephfs@4 2024-03-16T07:27:57.212 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-03-16T07:27:57.213 INFO:teuthology.orchestra.run.smithi049.stdout: "rados_inst": "172.21.15.49:0/2180583115", 2024-03-16T07:27:57.213 INFO:teuthology.orchestra.run.smithi049.stdout: "peers": {}, 2024-03-16T07:27:57.213 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_dirs": { 2024-03-16T07:27:57.213 INFO:teuthology.orchestra.run.smithi049.stdout: "dir_count": 1 2024-03-16T07:27:57.213 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:57.213 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-03-16T07:27:57.220 DEBUG:tasks.cephfs.test_mirroring:command returned={ "rados_inst": "172.21.15.49:0/2180583115", "peers": {}, "snap_dirs": { "dir_count": 1 } } 2024-03-16T07:27:57.220 DEBUG:tasks.cephfs.test_mirroring:initial dir_count=1 2024-03-16T07:27:57.221 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snapshot mirror add cephfs /d1/d2/././././././d3////// 2024-03-16T07:27:57.677 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:27:57.678+0000 7f29f6fe3640 -1 mgr.server reply reply (17) File exists directory /d1/d2/d3 is already tracked 2024-03-16T07:27:57.678 INFO:teuthology.orchestra.run.smithi049.stderr:Error EEXIST: directory /d1/d2/d3 is already tracked 2024-03-16T07:27:57.681 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-03-16T07:27:57.682 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-03-16T07:27:57.682 DEBUG:teuthology.orchestra.run.smithi049:mirror status for fs: cephfs> ceph --admin-daemon /var/run/ceph/cephfs-mirror.asok fs mirror status cephfs@4 2024-03-16T07:27:57.777 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-03-16T07:27:57.777 INFO:teuthology.orchestra.run.smithi049.stdout: "rados_inst": "172.21.15.49:0/2180583115", 2024-03-16T07:27:57.777 INFO:teuthology.orchestra.run.smithi049.stdout: "peers": {}, 2024-03-16T07:27:57.777 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_dirs": { 2024-03-16T07:27:57.777 INFO:teuthology.orchestra.run.smithi049.stdout: "dir_count": 1 2024-03-16T07:27:57.777 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:57.777 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-03-16T07:27:57.784 DEBUG:tasks.cephfs.test_mirroring:command returned={ "rados_inst": "172.21.15.49:0/2180583115", "peers": {}, "snap_dirs": { "dir_count": 1 } } 2024-03-16T07:27:57.784 DEBUG:tasks.cephfs.test_mirroring:initial dir_count=1 2024-03-16T07:27:57.784 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snapshot mirror add cephfs /d1/d2/../d2/././././d3 2024-03-16T07:27:58.114 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:27:58.116+0000 7f29f6fe3640 -1 mgr.server reply reply (17) File exists directory /d1/d2/d3 is already tracked 2024-03-16T07:27:58.115 INFO:teuthology.orchestra.run.smithi049.stderr:Error EEXIST: directory /d1/d2/d3 is already tracked 2024-03-16T07:27:58.120 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-03-16T07:27:58.121 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-03-16T07:27:58.121 DEBUG:teuthology.orchestra.run.smithi049:mirror status for fs: cephfs> ceph --admin-daemon /var/run/ceph/cephfs-mirror.asok fs mirror status cephfs@4 2024-03-16T07:27:58.222 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-03-16T07:27:58.222 INFO:teuthology.orchestra.run.smithi049.stdout: "rados_inst": "172.21.15.49:0/2180583115", 2024-03-16T07:27:58.222 INFO:teuthology.orchestra.run.smithi049.stdout: "peers": {}, 2024-03-16T07:27:58.222 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_dirs": { 2024-03-16T07:27:58.222 INFO:teuthology.orchestra.run.smithi049.stdout: "dir_count": 1 2024-03-16T07:27:58.223 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:58.223 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-03-16T07:27:58.229 DEBUG:tasks.cephfs.test_mirroring:command returned={ "rados_inst": "172.21.15.49:0/2180583115", "peers": {}, "snap_dirs": { "dir_count": 1 } } 2024-03-16T07:27:58.230 DEBUG:tasks.cephfs.test_mirroring:initial dir_count=1 2024-03-16T07:27:58.230 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snapshot mirror add cephfs /././././d1/./././d2/./././d3////// 2024-03-16T07:27:58.593 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:27:58.595+0000 7f29f6fe3640 -1 mgr.server reply reply (17) File exists directory /d1/d2/d3 is already tracked 2024-03-16T07:27:58.593 INFO:teuthology.orchestra.run.smithi049.stderr:Error EEXIST: directory /d1/d2/d3 is already tracked 2024-03-16T07:27:58.598 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-03-16T07:27:58.599 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-03-16T07:27:58.599 DEBUG:teuthology.orchestra.run.smithi049:mirror status for fs: cephfs> ceph --admin-daemon /var/run/ceph/cephfs-mirror.asok fs mirror status cephfs@4 2024-03-16T07:27:58.711 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-03-16T07:27:58.712 INFO:teuthology.orchestra.run.smithi049.stdout: "rados_inst": "172.21.15.49:0/2180583115", 2024-03-16T07:27:58.712 INFO:teuthology.orchestra.run.smithi049.stdout: "peers": {}, 2024-03-16T07:27:58.712 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_dirs": { 2024-03-16T07:27:58.712 INFO:teuthology.orchestra.run.smithi049.stdout: "dir_count": 1 2024-03-16T07:27:58.712 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:58.712 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-03-16T07:27:58.719 DEBUG:tasks.cephfs.test_mirroring:command returned={ "rados_inst": "172.21.15.49:0/2180583115", "peers": {}, "snap_dirs": { "dir_count": 1 } } 2024-03-16T07:27:58.719 DEBUG:tasks.cephfs.test_mirroring:initial dir_count=1 2024-03-16T07:27:58.719 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snapshot mirror add cephfs /./d1/./d2/./d3/../../../d1/d2/d3 2024-03-16T07:27:59.189 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:27:59.190+0000 7f29f6fe3640 -1 mgr.server reply reply (17) File exists directory /d1/d2/d3 is already tracked 2024-03-16T07:27:59.189 INFO:teuthology.orchestra.run.smithi049.stderr:Error EEXIST: directory /d1/d2/d3 is already tracked 2024-03-16T07:27:59.193 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-03-16T07:27:59.194 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-03-16T07:27:59.194 DEBUG:teuthology.orchestra.run.smithi049:counter dump for fs: cephfs> ceph --admin-daemon /var/run/ceph/cephfs-mirror.asok counter dump 2024-03-16T07:27:59.354 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-03-16T07:27:59.355 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker": [ 2024-03-16T07:27:59.355 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:27:59.355 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:27:59.355 INFO:teuthology.orchestra.run.smithi049.stdout: "id": "0" 2024-03-16T07:27:59.355 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:27:59.355 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:27:59.355 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_ready_timeouts": 0, 2024-03-16T07:27:59.355 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_idle_timeouts": 0 2024-03-16T07:27:59.355 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:59.355 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:27:59.355 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:27:59.355 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:27:59.355 INFO:teuthology.orchestra.run.smithi049.stdout: "id": "1" 2024-03-16T07:27:59.355 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:27:59.356 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:27:59.356 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_ready_timeouts": 0, 2024-03-16T07:27:59.356 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_idle_timeouts": 0 2024-03-16T07:27:59.356 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:59.356 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:27:59.356 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:27:59.356 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:27:59.356 INFO:teuthology.orchestra.run.smithi049.stdout: "id": "2" 2024-03-16T07:27:59.356 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:27:59.356 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:27:59.356 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_ready_timeouts": 0, 2024-03-16T07:27:59.356 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_idle_timeouts": 0 2024-03-16T07:27:59.356 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:59.356 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:59.356 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:27:59.356 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-0": [ 2024-03-16T07:27:59.357 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:27:59.357 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:27:59.357 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:27:59.357 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 4, 2024-03-16T07:27:59.357 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 37, 2024-03-16T07:27:59.357 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 576, 2024-03-16T07:27:59.357 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 324800, 2024-03-16T07:27:59.357 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 8, 2024-03-16T07:27:59.357 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 4, 2024-03-16T07:27:59.357 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 0.201353349, 2024-03-16T07:27:59.357 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.053465126, 2024-03-16T07:27:59.357 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 0.128515061, 2024-03-16T07:27:59.357 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-03-16T07:27:59.357 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T07:27:59.357 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 34, 2024-03-16T07:27:59.357 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.134137945, 2024-03-16T07:27:59.357 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.003945233 2024-03-16T07:27:59.358 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:27:59.358 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-03-16T07:27:59.358 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:27:59.358 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:27:59.358 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:27:59.358 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:27:59.358 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 576, 2024-03-16T07:27:59.358 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 324800 2024-03-16T07:27:59.358 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:59.358 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:59.358 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:27:59.358 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-1": [ 2024-03-16T07:27:59.358 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:27:59.358 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:27:59.359 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:27:59.359 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 34, 2024-03-16T07:27:59.359 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 3, 2024-03-16T07:27:59.359 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 136688, 2024-03-16T07:27:59.359 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 464, 2024-03-16T07:27:59.359 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 3, 2024-03-16T07:27:59.359 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 0, 2024-03-16T07:27:59.359 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 0.264966970, 2024-03-16T07:27:59.359 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.001951181, 2024-03-16T07:27:59.359 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 0.173335830, 2024-03-16T07:27:59.359 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.085501363, 2024-03-16T07:27:59.359 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T07:27:59.359 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 3, 2024-03-16T07:27:59.359 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.054357270, 2024-03-16T07:27:59.359 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.018119090 2024-03-16T07:27:59.360 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:27:59.360 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-03-16T07:27:59.360 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:27:59.360 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:27:59.360 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:27:59.360 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:27:59.360 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 136688, 2024-03-16T07:27:59.360 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 464 2024-03-16T07:27:59.360 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:59.360 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:59.360 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:27:59.360 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-2": [ 2024-03-16T07:27:59.360 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:27:59.360 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:27:59.360 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:27:59.361 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 23, 2024-03-16T07:27:59.361 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 6, 2024-03-16T07:27:59.361 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 734128, 2024-03-16T07:27:59.361 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 928, 2024-03-16T07:27:59.361 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 2, 2024-03-16T07:27:59.361 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 1, 2024-03-16T07:27:59.361 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 0.421000478, 2024-03-16T07:27:59.361 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.004838986, 2024-03-16T07:27:59.361 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 0.828298034, 2024-03-16T07:27:59.361 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-03-16T07:27:59.361 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T07:27:59.361 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 6, 2024-03-16T07:27:59.361 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.158362306, 2024-03-16T07:27:59.361 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.026393717 2024-03-16T07:27:59.361 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:27:59.361 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-03-16T07:27:59.362 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:27:59.362 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:27:59.362 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:27:59.362 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:27:59.362 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 734128, 2024-03-16T07:27:59.362 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 928 2024-03-16T07:27:59.362 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:59.362 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:59.362 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:27:59.362 INFO:teuthology.orchestra.run.smithi049.stdout: "cct": [ 2024-03-16T07:27:59.362 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:27:59.362 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:27:59.362 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:27:59.362 INFO:teuthology.orchestra.run.smithi049.stdout: "total_workers": 0, 2024-03-16T07:27:59.362 INFO:teuthology.orchestra.run.smithi049.stdout: "unhealthy_workers": 0 2024-03-16T07:27:59.363 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:59.363 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:59.363 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:27:59.363 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs_mirror": [ 2024-03-16T07:27:59.363 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:27:59.363 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:27:59.363 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:27:59.363 INFO:teuthology.orchestra.run.smithi049.stdout: "mirrored_filesystems": 1, 2024-03-16T07:27:59.363 INFO:teuthology.orchestra.run.smithi049.stdout: "mirror_enable_failures": 0 2024-03-16T07:27:59.363 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:59.363 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:59.363 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:27:59.363 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs_mirror_mirrored_filesystems": [ 2024-03-16T07:27:59.363 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:27:59.363 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:27:59.363 INFO:teuthology.orchestra.run.smithi049.stdout: "filesystem": "cephfs" 2024-03-16T07:27:59.363 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:27:59.364 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:27:59.364 INFO:teuthology.orchestra.run.smithi049.stdout: "mirroring_peers": 0, 2024-03-16T07:27:59.364 INFO:teuthology.orchestra.run.smithi049.stdout: "directory_count": 1 2024-03-16T07:27:59.364 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:59.364 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:59.364 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:27:59.364 INFO:teuthology.orchestra.run.smithi049.stdout: "mempool": [ 2024-03-16T07:27:59.364 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:27:59.364 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:27:59.364 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:27:59.364 INFO:teuthology.orchestra.run.smithi049.stdout: "bloom_filter_bytes": 0, 2024-03-16T07:27:59.364 INFO:teuthology.orchestra.run.smithi049.stdout: "bloom_filter_items": 0, 2024-03-16T07:27:59.364 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_alloc_bytes": 0, 2024-03-16T07:27:59.364 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_alloc_items": 0, 2024-03-16T07:27:59.364 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_data_bytes": 0, 2024-03-16T07:27:59.364 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_data_items": 0, 2024-03-16T07:27:59.364 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_onode_bytes": 0, 2024-03-16T07:27:59.365 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_onode_items": 0, 2024-03-16T07:27:59.365 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_meta_bytes": 0, 2024-03-16T07:27:59.365 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_meta_items": 0, 2024-03-16T07:27:59.365 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_other_bytes": 0, 2024-03-16T07:27:59.365 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_other_items": 0, 2024-03-16T07:27:59.365 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_buffer_bytes": 0, 2024-03-16T07:27:59.365 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_buffer_items": 0, 2024-03-16T07:27:59.365 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_extent_bytes": 0, 2024-03-16T07:27:59.365 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_extent_items": 0, 2024-03-16T07:27:59.365 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_blob_bytes": 0, 2024-03-16T07:27:59.365 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_blob_items": 0, 2024-03-16T07:27:59.365 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_shared_blob_bytes": 0, 2024-03-16T07:27:59.365 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_shared_blob_items": 0, 2024-03-16T07:27:59.365 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_inline_bl_bytes": 0, 2024-03-16T07:27:59.365 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_inline_bl_items": 0, 2024-03-16T07:27:59.365 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_fsck_bytes": 0, 2024-03-16T07:27:59.366 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_fsck_items": 0, 2024-03-16T07:27:59.366 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_txc_bytes": 0, 2024-03-16T07:27:59.366 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_txc_items": 0, 2024-03-16T07:27:59.366 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_deferred_bytes": 0, 2024-03-16T07:27:59.366 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_deferred_items": 0, 2024-03-16T07:27:59.366 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_bytes": 0, 2024-03-16T07:27:59.366 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_items": 0, 2024-03-16T07:27:59.366 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_bytes": 0, 2024-03-16T07:27:59.366 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_items": 0, 2024-03-16T07:27:59.366 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_reader_bytes": 0, 2024-03-16T07:27:59.366 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_reader_items": 0, 2024-03-16T07:27:59.367 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_writer_bytes": 0, 2024-03-16T07:27:59.367 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_writer_items": 0, 2024-03-16T07:27:59.367 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_anon_bytes": 182719, 2024-03-16T07:27:59.367 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_anon_items": 53, 2024-03-16T07:27:59.367 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_meta_bytes": 0, 2024-03-16T07:27:59.367 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_meta_items": 0, 2024-03-16T07:27:59.367 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_bytes": 0, 2024-03-16T07:27:59.367 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_items": 0, 2024-03-16T07:27:59.367 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_mapbl_bytes": 0, 2024-03-16T07:27:59.367 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_mapbl_items": 0, 2024-03-16T07:27:59.367 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pglog_bytes": 0, 2024-03-16T07:27:59.367 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pglog_items": 0, 2024-03-16T07:27:59.367 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_bytes": 18952, 2024-03-16T07:27:59.367 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_items": 184, 2024-03-16T07:27:59.367 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_mapping_bytes": 0, 2024-03-16T07:27:59.368 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_mapping_items": 0, 2024-03-16T07:27:59.368 INFO:teuthology.orchestra.run.smithi049.stdout: "pgmap_bytes": 0, 2024-03-16T07:27:59.368 INFO:teuthology.orchestra.run.smithi049.stdout: "pgmap_items": 0, 2024-03-16T07:27:59.368 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_co_bytes": 0, 2024-03-16T07:27:59.368 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_co_items": 0, 2024-03-16T07:27:59.368 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_1_bytes": 0, 2024-03-16T07:27:59.368 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_1_items": 0, 2024-03-16T07:27:59.368 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_2_bytes": 0, 2024-03-16T07:27:59.368 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_2_items": 0 2024-03-16T07:27:59.368 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:59.368 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:59.368 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:27:59.368 INFO:teuthology.orchestra.run.smithi049.stdout: "objecter": [ 2024-03-16T07:27:59.368 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:27:59.368 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:27:59.368 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:27:59.369 INFO:teuthology.orchestra.run.smithi049.stdout: "op_active": 0, 2024-03-16T07:27:59.369 INFO:teuthology.orchestra.run.smithi049.stdout: "op_laggy": 0, 2024-03-16T07:27:59.369 INFO:teuthology.orchestra.run.smithi049.stdout: "op_send": 0, 2024-03-16T07:27:59.369 INFO:teuthology.orchestra.run.smithi049.stdout: "op_send_bytes": 0, 2024-03-16T07:27:59.369 INFO:teuthology.orchestra.run.smithi049.stdout: "op_resend": 0, 2024-03-16T07:27:59.369 INFO:teuthology.orchestra.run.smithi049.stdout: "op_reply": 0, 2024-03-16T07:27:59.369 INFO:teuthology.orchestra.run.smithi049.stdout: "op_latency": { 2024-03-16T07:27:59.369 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:27:59.369 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:27:59.369 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:27:59.369 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:27:59.369 INFO:teuthology.orchestra.run.smithi049.stdout: "op_inflight": 0, 2024-03-16T07:27:59.369 INFO:teuthology.orchestra.run.smithi049.stdout: "oplen_avg": { 2024-03-16T07:27:59.369 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:27:59.369 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0 2024-03-16T07:27:59.370 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:27:59.370 INFO:teuthology.orchestra.run.smithi049.stdout: "op": 0, 2024-03-16T07:27:59.370 INFO:teuthology.orchestra.run.smithi049.stdout: "op_r": 0, 2024-03-16T07:27:59.370 INFO:teuthology.orchestra.run.smithi049.stdout: "op_w": 0, 2024-03-16T07:27:59.370 INFO:teuthology.orchestra.run.smithi049.stdout: "op_rmw": 0, 2024-03-16T07:27:59.370 INFO:teuthology.orchestra.run.smithi049.stdout: "op_pg": 0, 2024-03-16T07:27:59.370 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_stat": 0, 2024-03-16T07:27:59.370 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_create": 0, 2024-03-16T07:27:59.370 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_read": 0, 2024-03-16T07:27:59.370 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_write": 0, 2024-03-16T07:27:59.370 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_writefull": 0, 2024-03-16T07:27:59.370 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_writesame": 0, 2024-03-16T07:27:59.370 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_append": 0, 2024-03-16T07:27:59.370 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_zero": 0, 2024-03-16T07:27:59.371 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_truncate": 0, 2024-03-16T07:27:59.371 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_delete": 0, 2024-03-16T07:27:59.371 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_mapext": 0, 2024-03-16T07:27:59.371 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_sparse_read": 0, 2024-03-16T07:27:59.371 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_clonerange": 0, 2024-03-16T07:27:59.371 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_getxattr": 0, 2024-03-16T07:27:59.371 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_setxattr": 0, 2024-03-16T07:27:59.371 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_cmpxattr": 0, 2024-03-16T07:27:59.371 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_rmxattr": 0, 2024-03-16T07:27:59.371 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_resetxattrs": 0, 2024-03-16T07:27:59.371 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_call": 0, 2024-03-16T07:27:59.371 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_watch": 0, 2024-03-16T07:27:59.371 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_notify": 0, 2024-03-16T07:27:59.371 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_src_cmpxattr": 0, 2024-03-16T07:27:59.371 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_pgls": 0, 2024-03-16T07:27:59.371 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_pgls_filter": 0, 2024-03-16T07:27:59.372 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_other": 0, 2024-03-16T07:27:59.372 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_active": 0, 2024-03-16T07:27:59.372 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_send": 0, 2024-03-16T07:27:59.372 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_resend": 0, 2024-03-16T07:27:59.372 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_ping": 0, 2024-03-16T07:27:59.372 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_active": 0, 2024-03-16T07:27:59.372 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_send": 0, 2024-03-16T07:27:59.372 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_resend": 0, 2024-03-16T07:27:59.372 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_active": 0, 2024-03-16T07:27:59.372 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_send": 0, 2024-03-16T07:27:59.372 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_resend": 0, 2024-03-16T07:27:59.372 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_active": 0, 2024-03-16T07:27:59.372 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_send": 0, 2024-03-16T07:27:59.372 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_resend": 0, 2024-03-16T07:27:59.372 INFO:teuthology.orchestra.run.smithi049.stdout: "command_active": 0, 2024-03-16T07:27:59.372 INFO:teuthology.orchestra.run.smithi049.stdout: "command_send": 0, 2024-03-16T07:27:59.372 INFO:teuthology.orchestra.run.smithi049.stdout: "command_resend": 0, 2024-03-16T07:27:59.373 INFO:teuthology.orchestra.run.smithi049.stdout: "map_epoch": 0, 2024-03-16T07:27:59.373 INFO:teuthology.orchestra.run.smithi049.stdout: "map_full": 0, 2024-03-16T07:27:59.373 INFO:teuthology.orchestra.run.smithi049.stdout: "map_inc": 0, 2024-03-16T07:27:59.373 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_sessions": 0, 2024-03-16T07:27:59.373 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_session_open": 0, 2024-03-16T07:27:59.373 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_session_close": 0, 2024-03-16T07:27:59.373 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_laggy": 0, 2024-03-16T07:27:59.373 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_wr": 0, 2024-03-16T07:27:59.373 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_rd": 0, 2024-03-16T07:27:59.373 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_del": 0 2024-03-16T07:27:59.373 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:59.373 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:59.373 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:27:59.373 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-msgr_dispatch_throttler-client": [ 2024-03-16T07:27:59.373 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:27:59.373 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:27:59.374 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:27:59.374 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:27:59.374 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-03-16T07:27:59.374 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:27:59.374 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 34, 2024-03-16T07:27:59.374 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 132077, 2024-03-16T07:27:59.374 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:27:59.374 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 34, 2024-03-16T07:27:59.374 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:27:59.374 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:27:59.374 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 34, 2024-03-16T07:27:59.374 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 132077, 2024-03-16T07:27:59.374 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:27:59.374 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:27:59.374 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:27:59.374 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:27:59.375 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:59.375 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:59.375 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:59.375 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:27:59.375 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-msgr_dispatch_throttler-radosclient": [ 2024-03-16T07:27:59.375 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:27:59.375 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:27:59.375 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:27:59.375 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:27:59.375 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-03-16T07:27:59.375 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:27:59.375 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 24, 2024-03-16T07:27:59.375 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 730609, 2024-03-16T07:27:59.375 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:27:59.375 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 24, 2024-03-16T07:27:59.375 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:27:59.375 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:27:59.376 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 24, 2024-03-16T07:27:59.376 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 730609, 2024-03-16T07:27:59.376 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:27:59.376 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:27:59.376 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:27:59.376 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:27:59.376 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:59.376 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:59.376 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:59.376 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:27:59.376 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-objecter_bytes": [ 2024-03-16T07:27:59.376 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:27:59.376 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:27:59.376 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:27:59.376 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:27:59.376 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-03-16T07:27:59.377 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:27:59.377 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 0, 2024-03-16T07:27:59.377 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 0, 2024-03-16T07:27:59.377 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:27:59.377 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 0, 2024-03-16T07:27:59.377 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:27:59.377 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:27:59.377 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 0, 2024-03-16T07:27:59.377 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 0, 2024-03-16T07:27:59.377 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:27:59.377 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:27:59.377 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:27:59.377 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:27:59.377 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:59.377 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:59.377 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:59.377 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:27:59.378 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-objecter_ops": [ 2024-03-16T07:27:59.378 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:27:59.378 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:27:59.378 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:27:59.378 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:27:59.378 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 1024, 2024-03-16T07:27:59.378 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:27:59.378 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 0, 2024-03-16T07:27:59.378 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 0, 2024-03-16T07:27:59.378 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:27:59.378 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 0, 2024-03-16T07:27:59.378 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:27:59.378 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:27:59.378 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 0, 2024-03-16T07:27:59.378 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 0, 2024-03-16T07:27:59.379 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:27:59.379 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:27:59.379 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:27:59.379 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:27:59.379 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:59.379 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:59.379 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:27:59.379 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2024-03-16T07:27:59.379 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-03-16T07:27:59.380 DEBUG:tasks.cephfs.test_mirroring:command returned={ "AsyncMessenger::Worker": [ { "labels": { "id": "0" }, "counters": { "msgr_connection_ready_timeouts": 0, "msgr_connection_idle_timeouts": 0 } }, { "labels": { "id": "1" }, "counters": { "msgr_connection_ready_timeouts": 0, "msgr_connection_idle_timeouts": 0 } }, { "labels": { "id": "2" }, "counters": { "msgr_connection_ready_timeouts": 0, "msgr_connection_idle_timeouts": 0 } } ], "AsyncMessenger::Worker-0": [ { "labels": {}, "counters": { "msgr_recv_messages": 4, "msgr_send_messages": 37, "msgr_recv_bytes": 576, "msgr_send_bytes": 324800, "msgr_created_connections": 8, "msgr_active_connections": 4, "msgr_running_total_time": 0.201353349, "msgr_running_send_time": 0.053465126, "msgr_running_recv_time": 0.128515061, "msgr_running_fast_dispatch_time": 0.000000000, "msgr_send_messages_queue_lat": { "avgcount": 34, "sum": 0.134137945, "avgtime": 0.003945233 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "msgr_recv_encrypted_bytes": 576, "msgr_send_encrypted_bytes": 324800 } } ], "AsyncMessenger::Worker-1": [ { "labels": {}, "counters": { "msgr_recv_messages": 34, "msgr_send_messages": 3, "msgr_recv_bytes": 136688, "msgr_send_bytes": 464, "msgr_created_connections": 3, "msgr_active_connections": 0, "msgr_running_total_time": 0.264966970, "msgr_running_send_time": 0.001951181, "msgr_running_recv_time": 0.173335830, "msgr_running_fast_dispatch_time": 0.085501363, "msgr_send_messages_queue_lat": { "avgcount": 3, "sum": 0.054357270, "avgtime": 0.018119090 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "msgr_recv_encrypted_bytes": 136688, "msgr_send_encrypted_bytes": 464 } } ], "AsyncMessenger::Worker-2": [ { "labels": {}, "counters": { "msgr_recv_messages": 23, "msgr_send_messages": 6, "msgr_recv_bytes": 734128, "msgr_send_bytes": 928, "msgr_created_connections": 2, "msgr_active_connections": 1, "msgr_running_total_time": 0.421000478, "msgr_running_send_time": 0.004838986, "msgr_running_recv_time": 0.828298034, "msgr_running_fast_dispatch_time": 0.000000000, "msgr_send_messages_queue_lat": { "avgcount": 6, "sum": 0.158362306, "avgtime": 0.026393717 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "msgr_recv_encrypted_bytes": 734128, "msgr_send_encrypted_bytes": 928 } } ], "cct": [ { "labels": {}, "counters": { "total_workers": 0, "unhealthy_workers": 0 } } ], "cephfs_mirror": [ { "labels": {}, "counters": { "mirrored_filesystems": 1, "mirror_enable_failures": 0 } } ], "cephfs_mirror_mirrored_filesystems": [ { "labels": { "filesystem": "cephfs" }, "counters": { "mirroring_peers": 0, "directory_count": 1 } } ], "mempool": [ { "labels": {}, "counters": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_cache_buffer_bytes": 0, "bluestore_cache_buffer_items": 0, "bluestore_extent_bytes": 0, "bluestore_extent_items": 0, "bluestore_blob_bytes": 0, "bluestore_blob_items": 0, "bluestore_shared_blob_bytes": 0, "bluestore_shared_blob_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_items": 0, "bluefs_bytes": 0, "bluefs_items": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "buffer_anon_bytes": 182719, "buffer_anon_items": 53, "buffer_meta_bytes": 0, "buffer_meta_items": 0, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 18952, "osdmap_items": 184, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "mds_co_bytes": 0, "mds_co_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 } } ], "objecter": [ { "labels": {}, "counters": { "op_active": 0, "op_laggy": 0, "op_send": 0, "op_send_bytes": 0, "op_resend": 0, "op_reply": 0, "op_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "op_inflight": 0, "oplen_avg": { "avgcount": 0, "sum": 0 }, "op": 0, "op_r": 0, "op_w": 0, "op_rmw": 0, "op_pg": 0, "osdop_stat": 0, "osdop_create": 0, "osdop_read": 0, "osdop_write": 0, "osdop_writefull": 0, "osdop_writesame": 0, "osdop_append": 0, "osdop_zero": 0, "osdop_truncate": 0, "osdop_delete": 0, "osdop_mapext": 0, "osdop_sparse_read": 0, "osdop_clonerange": 0, "osdop_getxattr": 0, "osdop_setxattr": 0, "osdop_cmpxattr": 0, "osdop_rmxattr": 0, "osdop_resetxattrs": 0, "osdop_call": 0, "osdop_watch": 0, "osdop_notify": 0, "osdop_src_cmpxattr": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_other": 0, "linger_active": 0, "linger_send": 0, "linger_resend": 0, "linger_ping": 0, "poolop_active": 0, "poolop_send": 0, "poolop_resend": 0, "poolstat_active": 0, "poolstat_send": 0, "poolstat_resend": 0, "statfs_active": 0, "statfs_send": 0, "statfs_resend": 0, "command_active": 0, "command_send": 0, "command_resend": 0, "map_epoch": 0, "map_full": 0, "map_inc": 0, "osd_sessions": 0, "osd_session_open": 0, "osd_session_close": 0, "osd_laggy": 0, "omap_wr": 0, "omap_rd": 0, "omap_del": 0 } } ], "throttle-msgr_dispatch_throttler-client": [ { "labels": {}, "counters": { "val": 0, "max": 104857600, "get_started": 0, "get": 34, "get_sum": 132077, "get_or_fail_fail": 0, "get_or_fail_success": 34, "take": 0, "take_sum": 0, "put": 34, "put_sum": 132077, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ], "throttle-msgr_dispatch_throttler-radosclient": [ { "labels": {}, "counters": { "val": 0, "max": 104857600, "get_started": 0, "get": 24, "get_sum": 730609, "get_or_fail_fail": 0, "get_or_fail_success": 24, "take": 0, "take_sum": 0, "put": 24, "put_sum": 730609, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ], "throttle-objecter_bytes": [ { "labels": {}, "counters": { "val": 0, "max": 104857600, "get_started": 0, "get": 0, "get_sum": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "take": 0, "take_sum": 0, "put": 0, "put_sum": 0, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ], "throttle-objecter_ops": [ { "labels": {}, "counters": { "val": 0, "max": 1024, "get_started": 0, "get": 0, "get_sum": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "take": 0, "take_sum": 0, "put": 0, "put_sum": 0, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ] } 2024-03-16T07:27:59.380 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snapshot mirror disable cephfs 2024-03-16T07:28:00.466 INFO:teuthology.orchestra.run.smithi049.stdout:{} 2024-03-16T07:28:08.409 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T07:28:10.487 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-03-16T07:28:10.487 DEBUG:teuthology.orchestra.run.smithi049:mirror status for fs: cephfs> ceph --admin-daemon /var/run/ceph/cephfs-mirror.asok fs mirror status cephfs@4 2024-03-16T07:28:10.584 INFO:teuthology.orchestra.run.smithi049.stderr:no valid command found; 10 closest matches: 2024-03-16T07:28:10.584 INFO:teuthology.orchestra.run.smithi049.stderr:0 2024-03-16T07:28:10.585 INFO:teuthology.orchestra.run.smithi049.stderr:1 2024-03-16T07:28:10.585 INFO:teuthology.orchestra.run.smithi049.stderr:2 2024-03-16T07:28:10.585 INFO:teuthology.orchestra.run.smithi049.stderr:abort 2024-03-16T07:28:10.585 INFO:teuthology.orchestra.run.smithi049.stderr:assert 2024-03-16T07:28:10.585 INFO:teuthology.orchestra.run.smithi049.stderr:config diff 2024-03-16T07:28:10.585 INFO:teuthology.orchestra.run.smithi049.stderr:config diff get 2024-03-16T07:28:10.585 INFO:teuthology.orchestra.run.smithi049.stderr:config get 2024-03-16T07:28:10.585 INFO:teuthology.orchestra.run.smithi049.stderr:config help [] 2024-03-16T07:28:10.585 INFO:teuthology.orchestra.run.smithi049.stderr:config set ... 2024-03-16T07:28:10.585 INFO:teuthology.orchestra.run.smithi049.stderr:admin_socket: invalid command 2024-03-16T07:28:10.586 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-03-16T07:28:10.586 WARNING:tasks.cephfs.test_mirroring:mirror daemon command with label "mirror status for fs: cephfs" failed: Command failed (mirror status for fs: cephfs) on smithi049 with status 22: 'ceph --admin-daemon /var/run/ceph/cephfs-mirror.asok fs mirror status cephfs@4' 2024-03-16T07:28:10.586 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-03-16T07:28:10.587 DEBUG:teuthology.orchestra.run.smithi049:counter dump for fs: cephfs> ceph --admin-daemon /var/run/ceph/cephfs-mirror.asok counter dump 2024-03-16T07:28:10.705 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-03-16T07:28:10.705 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker": [ 2024-03-16T07:28:10.705 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:28:10.705 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:28:10.705 INFO:teuthology.orchestra.run.smithi049.stdout: "id": "0" 2024-03-16T07:28:10.705 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:28:10.705 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:28:10.705 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_ready_timeouts": 0, 2024-03-16T07:28:10.705 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_idle_timeouts": 0 2024-03-16T07:28:10.705 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:28:10.705 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:28:10.706 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:28:10.706 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:28:10.706 INFO:teuthology.orchestra.run.smithi049.stdout: "id": "1" 2024-03-16T07:28:10.706 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:28:10.706 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:28:10.706 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_ready_timeouts": 0, 2024-03-16T07:28:10.706 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_idle_timeouts": 0 2024-03-16T07:28:10.706 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:28:10.706 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:28:10.706 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:28:10.706 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:28:10.706 INFO:teuthology.orchestra.run.smithi049.stdout: "id": "2" 2024-03-16T07:28:10.706 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:28:10.706 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:28:10.707 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_ready_timeouts": 0, 2024-03-16T07:28:10.707 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_idle_timeouts": 0 2024-03-16T07:28:10.707 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:28:10.707 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:28:10.707 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:28:10.707 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-0": [ 2024-03-16T07:28:10.707 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:28:10.707 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:28:10.707 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:28:10.707 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 4, 2024-03-16T07:28:10.707 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 40, 2024-03-16T07:28:10.707 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 576, 2024-03-16T07:28:10.707 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 325552, 2024-03-16T07:28:10.707 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 8, 2024-03-16T07:28:10.707 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 4, 2024-03-16T07:28:10.707 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 0.202518529, 2024-03-16T07:28:10.708 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.054527187, 2024-03-16T07:28:10.708 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 0.128515061, 2024-03-16T07:28:10.708 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-03-16T07:28:10.708 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T07:28:10.708 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 37, 2024-03-16T07:28:10.708 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.134640787, 2024-03-16T07:28:10.708 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.003638940 2024-03-16T07:28:10.708 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:28:10.708 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-03-16T07:28:10.708 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:28:10.708 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:28:10.708 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:28:10.708 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:28:10.708 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 576, 2024-03-16T07:28:10.708 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 325552 2024-03-16T07:28:10.708 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:28:10.709 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:28:10.709 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:28:10.709 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-1": [ 2024-03-16T07:28:10.709 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:28:10.709 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:28:10.709 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:28:10.709 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 35, 2024-03-16T07:28:10.709 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 3, 2024-03-16T07:28:10.709 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 141568, 2024-03-16T07:28:10.709 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 464, 2024-03-16T07:28:10.709 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 3, 2024-03-16T07:28:10.709 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 0, 2024-03-16T07:28:10.709 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 0.270888795, 2024-03-16T07:28:10.709 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.002058671, 2024-03-16T07:28:10.709 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 0.176563427, 2024-03-16T07:28:10.710 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.087472511, 2024-03-16T07:28:10.710 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T07:28:10.710 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 3, 2024-03-16T07:28:10.710 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.054357270, 2024-03-16T07:28:10.710 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.018119090 2024-03-16T07:28:10.710 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:28:10.710 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-03-16T07:28:10.710 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:28:10.710 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:28:10.710 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:28:10.710 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:28:10.710 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 141568, 2024-03-16T07:28:10.710 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 464 2024-03-16T07:28:10.710 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:28:10.711 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:28:10.711 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:28:10.711 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-2": [ 2024-03-16T07:28:10.711 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:28:10.711 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:28:10.711 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:28:10.711 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 23, 2024-03-16T07:28:10.711 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 6, 2024-03-16T07:28:10.711 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 734128, 2024-03-16T07:28:10.711 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 928, 2024-03-16T07:28:10.711 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 2, 2024-03-16T07:28:10.711 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 1, 2024-03-16T07:28:10.711 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 0.421933316, 2024-03-16T07:28:10.711 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.004933297, 2024-03-16T07:28:10.711 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 0.828601213, 2024-03-16T07:28:10.712 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-03-16T07:28:10.712 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T07:28:10.712 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 6, 2024-03-16T07:28:10.712 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.158362306, 2024-03-16T07:28:10.712 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.026393717 2024-03-16T07:28:10.712 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:28:10.712 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-03-16T07:28:10.712 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:28:10.712 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:28:10.712 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:28:10.712 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:28:10.712 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 734128, 2024-03-16T07:28:10.713 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 928 2024-03-16T07:28:10.713 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:28:10.713 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:28:10.713 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:28:10.713 INFO:teuthology.orchestra.run.smithi049.stdout: "cct": [ 2024-03-16T07:28:10.713 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:28:10.713 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:28:10.713 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:28:10.713 INFO:teuthology.orchestra.run.smithi049.stdout: "total_workers": 0, 2024-03-16T07:28:10.713 INFO:teuthology.orchestra.run.smithi049.stdout: "unhealthy_workers": 0 2024-03-16T07:28:10.713 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:28:10.713 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:28:10.713 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:28:10.713 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs_mirror": [ 2024-03-16T07:28:10.713 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:28:10.714 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:28:10.714 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:28:10.714 INFO:teuthology.orchestra.run.smithi049.stdout: "mirrored_filesystems": 0, 2024-03-16T07:28:10.714 INFO:teuthology.orchestra.run.smithi049.stdout: "mirror_enable_failures": 0 2024-03-16T07:28:10.714 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:28:10.714 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:28:10.714 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:28:10.714 INFO:teuthology.orchestra.run.smithi049.stdout: "mempool": [ 2024-03-16T07:28:10.714 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:28:10.714 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:28:10.714 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:28:10.714 INFO:teuthology.orchestra.run.smithi049.stdout: "bloom_filter_bytes": 0, 2024-03-16T07:28:10.714 INFO:teuthology.orchestra.run.smithi049.stdout: "bloom_filter_items": 0, 2024-03-16T07:28:10.714 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_alloc_bytes": 0, 2024-03-16T07:28:10.715 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_alloc_items": 0, 2024-03-16T07:28:10.715 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_data_bytes": 0, 2024-03-16T07:28:10.715 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_data_items": 0, 2024-03-16T07:28:10.715 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_onode_bytes": 0, 2024-03-16T07:28:10.715 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_onode_items": 0, 2024-03-16T07:28:10.715 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_meta_bytes": 0, 2024-03-16T07:28:10.715 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_meta_items": 0, 2024-03-16T07:28:10.715 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_other_bytes": 0, 2024-03-16T07:28:10.715 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_other_items": 0, 2024-03-16T07:28:10.715 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_buffer_bytes": 0, 2024-03-16T07:28:10.715 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_buffer_items": 0, 2024-03-16T07:28:10.715 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_extent_bytes": 0, 2024-03-16T07:28:10.715 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_extent_items": 0, 2024-03-16T07:28:10.715 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_blob_bytes": 0, 2024-03-16T07:28:10.716 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_blob_items": 0, 2024-03-16T07:28:10.716 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_shared_blob_bytes": 0, 2024-03-16T07:28:10.716 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_shared_blob_items": 0, 2024-03-16T07:28:10.716 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_inline_bl_bytes": 0, 2024-03-16T07:28:10.716 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_inline_bl_items": 0, 2024-03-16T07:28:10.716 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_fsck_bytes": 0, 2024-03-16T07:28:10.716 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_fsck_items": 0, 2024-03-16T07:28:10.716 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_txc_bytes": 0, 2024-03-16T07:28:10.716 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_txc_items": 0, 2024-03-16T07:28:10.716 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_deferred_bytes": 0, 2024-03-16T07:28:10.716 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_deferred_items": 0, 2024-03-16T07:28:10.716 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_bytes": 0, 2024-03-16T07:28:10.716 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_items": 0, 2024-03-16T07:28:10.716 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_bytes": 0, 2024-03-16T07:28:10.716 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_items": 0, 2024-03-16T07:28:10.716 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_reader_bytes": 0, 2024-03-16T07:28:10.717 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_reader_items": 0, 2024-03-16T07:28:10.717 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_writer_bytes": 0, 2024-03-16T07:28:10.717 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_writer_items": 0, 2024-03-16T07:28:10.717 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_anon_bytes": 148386, 2024-03-16T07:28:10.717 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_anon_items": 24, 2024-03-16T07:28:10.717 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_meta_bytes": 0, 2024-03-16T07:28:10.717 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_meta_items": 0, 2024-03-16T07:28:10.717 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_bytes": 0, 2024-03-16T07:28:10.717 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_items": 0, 2024-03-16T07:28:10.717 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_mapbl_bytes": 0, 2024-03-16T07:28:10.717 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_mapbl_items": 0, 2024-03-16T07:28:10.717 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pglog_bytes": 0, 2024-03-16T07:28:10.717 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pglog_items": 0, 2024-03-16T07:28:10.717 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_bytes": 4824, 2024-03-16T07:28:10.718 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_items": 52, 2024-03-16T07:28:10.718 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_mapping_bytes": 0, 2024-03-16T07:28:10.718 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_mapping_items": 0, 2024-03-16T07:28:10.718 INFO:teuthology.orchestra.run.smithi049.stdout: "pgmap_bytes": 0, 2024-03-16T07:28:10.718 INFO:teuthology.orchestra.run.smithi049.stdout: "pgmap_items": 0, 2024-03-16T07:28:10.718 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_co_bytes": 0, 2024-03-16T07:28:10.718 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_co_items": 0, 2024-03-16T07:28:10.718 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_1_bytes": 0, 2024-03-16T07:28:10.718 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_1_items": 0, 2024-03-16T07:28:10.718 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_2_bytes": 0, 2024-03-16T07:28:10.718 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_2_items": 0 2024-03-16T07:28:10.718 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:28:10.718 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:28:10.718 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:28:10.718 INFO:teuthology.orchestra.run.smithi049.stdout: "objecter": [ 2024-03-16T07:28:10.719 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:28:10.719 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:28:10.719 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:28:10.719 INFO:teuthology.orchestra.run.smithi049.stdout: "op_active": 0, 2024-03-16T07:28:10.719 INFO:teuthology.orchestra.run.smithi049.stdout: "op_laggy": 0, 2024-03-16T07:28:10.719 INFO:teuthology.orchestra.run.smithi049.stdout: "op_send": 0, 2024-03-16T07:28:10.719 INFO:teuthology.orchestra.run.smithi049.stdout: "op_send_bytes": 0, 2024-03-16T07:28:10.719 INFO:teuthology.orchestra.run.smithi049.stdout: "op_resend": 0, 2024-03-16T07:28:10.719 INFO:teuthology.orchestra.run.smithi049.stdout: "op_reply": 0, 2024-03-16T07:28:10.719 INFO:teuthology.orchestra.run.smithi049.stdout: "op_latency": { 2024-03-16T07:28:10.719 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:28:10.719 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:28:10.719 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:28:10.719 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:28:10.720 INFO:teuthology.orchestra.run.smithi049.stdout: "op_inflight": 0, 2024-03-16T07:28:10.720 INFO:teuthology.orchestra.run.smithi049.stdout: "oplen_avg": { 2024-03-16T07:28:10.720 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:28:10.720 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0 2024-03-16T07:28:10.720 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:28:10.720 INFO:teuthology.orchestra.run.smithi049.stdout: "op": 0, 2024-03-16T07:28:10.720 INFO:teuthology.orchestra.run.smithi049.stdout: "op_r": 0, 2024-03-16T07:28:10.720 INFO:teuthology.orchestra.run.smithi049.stdout: "op_w": 0, 2024-03-16T07:28:10.720 INFO:teuthology.orchestra.run.smithi049.stdout: "op_rmw": 0, 2024-03-16T07:28:10.720 INFO:teuthology.orchestra.run.smithi049.stdout: "op_pg": 0, 2024-03-16T07:28:10.720 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_stat": 0, 2024-03-16T07:28:10.720 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_create": 0, 2024-03-16T07:28:10.720 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_read": 0, 2024-03-16T07:28:10.720 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_write": 0, 2024-03-16T07:28:10.720 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_writefull": 0, 2024-03-16T07:28:10.721 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_writesame": 0, 2024-03-16T07:28:10.721 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_append": 0, 2024-03-16T07:28:10.721 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_zero": 0, 2024-03-16T07:28:10.721 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_truncate": 0, 2024-03-16T07:28:10.721 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_delete": 0, 2024-03-16T07:28:10.721 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_mapext": 0, 2024-03-16T07:28:10.721 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_sparse_read": 0, 2024-03-16T07:28:10.721 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_clonerange": 0, 2024-03-16T07:28:10.721 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_getxattr": 0, 2024-03-16T07:28:10.721 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_setxattr": 0, 2024-03-16T07:28:10.721 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_cmpxattr": 0, 2024-03-16T07:28:10.721 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_rmxattr": 0, 2024-03-16T07:28:10.721 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_resetxattrs": 0, 2024-03-16T07:28:10.721 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_call": 0, 2024-03-16T07:28:10.722 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_watch": 0, 2024-03-16T07:28:10.722 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_notify": 0, 2024-03-16T07:28:10.722 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_src_cmpxattr": 0, 2024-03-16T07:28:10.722 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_pgls": 0, 2024-03-16T07:28:10.722 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_pgls_filter": 0, 2024-03-16T07:28:10.722 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_other": 0, 2024-03-16T07:28:10.722 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_active": 0, 2024-03-16T07:28:10.722 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_send": 0, 2024-03-16T07:28:10.722 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_resend": 0, 2024-03-16T07:28:10.722 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_ping": 0, 2024-03-16T07:28:10.722 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_active": 0, 2024-03-16T07:28:10.722 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_send": 0, 2024-03-16T07:28:10.722 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_resend": 0, 2024-03-16T07:28:10.723 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_active": 0, 2024-03-16T07:28:10.723 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_send": 0, 2024-03-16T07:28:10.723 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_resend": 0, 2024-03-16T07:28:10.723 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_active": 0, 2024-03-16T07:28:10.723 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_send": 0, 2024-03-16T07:28:10.723 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_resend": 0, 2024-03-16T07:28:10.723 INFO:teuthology.orchestra.run.smithi049.stdout: "command_active": 0, 2024-03-16T07:28:10.723 INFO:teuthology.orchestra.run.smithi049.stdout: "command_send": 0, 2024-03-16T07:28:10.723 INFO:teuthology.orchestra.run.smithi049.stdout: "command_resend": 0, 2024-03-16T07:28:10.723 INFO:teuthology.orchestra.run.smithi049.stdout: "map_epoch": 0, 2024-03-16T07:28:10.723 INFO:teuthology.orchestra.run.smithi049.stdout: "map_full": 0, 2024-03-16T07:28:10.723 INFO:teuthology.orchestra.run.smithi049.stdout: "map_inc": 0, 2024-03-16T07:28:10.723 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_sessions": 0, 2024-03-16T07:28:10.723 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_session_open": 0, 2024-03-16T07:28:10.723 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_session_close": 0, 2024-03-16T07:28:10.724 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_laggy": 0, 2024-03-16T07:28:10.724 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_wr": 0, 2024-03-16T07:28:10.724 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_rd": 0, 2024-03-16T07:28:10.724 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_del": 0 2024-03-16T07:28:10.724 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:28:10.724 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:28:10.724 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:28:10.724 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-msgr_dispatch_throttler-client": [ 2024-03-16T07:28:10.724 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:28:10.724 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:28:10.724 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:28:10.724 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:28:10.724 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-03-16T07:28:10.724 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:28:10.725 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 35, 2024-03-16T07:28:10.725 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 136823, 2024-03-16T07:28:10.725 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:28:10.725 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 35, 2024-03-16T07:28:10.725 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:28:10.725 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:28:10.725 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 35, 2024-03-16T07:28:10.725 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 136823, 2024-03-16T07:28:10.725 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:28:10.725 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:28:10.725 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:28:10.725 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:28:10.725 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:28:10.725 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:28:10.725 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:28:10.726 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:28:10.726 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-msgr_dispatch_throttler-radosclient": [ 2024-03-16T07:28:10.726 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:28:10.726 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:28:10.726 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:28:10.726 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:28:10.726 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-03-16T07:28:10.726 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:28:10.726 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 24, 2024-03-16T07:28:10.726 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 730609, 2024-03-16T07:28:10.726 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:28:10.726 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 24, 2024-03-16T07:28:10.726 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:28:10.726 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:28:10.726 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 24, 2024-03-16T07:28:10.727 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 730609, 2024-03-16T07:28:10.727 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:28:10.727 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:28:10.727 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:28:10.727 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:28:10.727 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:28:10.727 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:28:10.727 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:28:10.727 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:28:10.727 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-objecter_bytes": [ 2024-03-16T07:28:10.727 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:28:10.727 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:28:10.727 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:28:10.727 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:28:10.727 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-03-16T07:28:10.728 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:28:10.728 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 0, 2024-03-16T07:28:10.728 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 0, 2024-03-16T07:28:10.728 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:28:10.728 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 0, 2024-03-16T07:28:10.728 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:28:10.728 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:28:10.728 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 0, 2024-03-16T07:28:10.728 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 0, 2024-03-16T07:28:10.728 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:28:10.728 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:28:10.728 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:28:10.728 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:28:10.728 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:28:10.729 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:28:10.729 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:28:10.729 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:28:10.729 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-objecter_ops": [ 2024-03-16T07:28:10.729 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:28:10.729 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:28:10.729 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:28:10.729 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:28:10.729 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 1024, 2024-03-16T07:28:10.729 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:28:10.729 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 0, 2024-03-16T07:28:10.729 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 0, 2024-03-16T07:28:10.729 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:28:10.729 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 0, 2024-03-16T07:28:10.729 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:28:10.729 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:28:10.730 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 0, 2024-03-16T07:28:10.730 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 0, 2024-03-16T07:28:10.730 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:28:10.730 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:28:10.730 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:28:10.730 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:28:10.730 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:28:10.730 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:28:10.730 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:28:10.730 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2024-03-16T07:28:10.730 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-03-16T07:28:10.731 DEBUG:tasks.cephfs.test_mirroring:command returned={ "AsyncMessenger::Worker": [ { "labels": { "id": "0" }, "counters": { "msgr_connection_ready_timeouts": 0, "msgr_connection_idle_timeouts": 0 } }, { "labels": { "id": "1" }, "counters": { "msgr_connection_ready_timeouts": 0, "msgr_connection_idle_timeouts": 0 } }, { "labels": { "id": "2" }, "counters": { "msgr_connection_ready_timeouts": 0, "msgr_connection_idle_timeouts": 0 } } ], "AsyncMessenger::Worker-0": [ { "labels": {}, "counters": { "msgr_recv_messages": 4, "msgr_send_messages": 40, "msgr_recv_bytes": 576, "msgr_send_bytes": 325552, "msgr_created_connections": 8, "msgr_active_connections": 4, "msgr_running_total_time": 0.202518529, "msgr_running_send_time": 0.054527187, "msgr_running_recv_time": 0.128515061, "msgr_running_fast_dispatch_time": 0.000000000, "msgr_send_messages_queue_lat": { "avgcount": 37, "sum": 0.134640787, "avgtime": 0.003638940 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "msgr_recv_encrypted_bytes": 576, "msgr_send_encrypted_bytes": 325552 } } ], "AsyncMessenger::Worker-1": [ { "labels": {}, "counters": { "msgr_recv_messages": 35, "msgr_send_messages": 3, "msgr_recv_bytes": 141568, "msgr_send_bytes": 464, "msgr_created_connections": 3, "msgr_active_connections": 0, "msgr_running_total_time": 0.270888795, "msgr_running_send_time": 0.002058671, "msgr_running_recv_time": 0.176563427, "msgr_running_fast_dispatch_time": 0.087472511, "msgr_send_messages_queue_lat": { "avgcount": 3, "sum": 0.054357270, "avgtime": 0.018119090 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "msgr_recv_encrypted_bytes": 141568, "msgr_send_encrypted_bytes": 464 } } ], "AsyncMessenger::Worker-2": [ { "labels": {}, "counters": { "msgr_recv_messages": 23, "msgr_send_messages": 6, "msgr_recv_bytes": 734128, "msgr_send_bytes": 928, "msgr_created_connections": 2, "msgr_active_connections": 1, "msgr_running_total_time": 0.421933316, "msgr_running_send_time": 0.004933297, "msgr_running_recv_time": 0.828601213, "msgr_running_fast_dispatch_time": 0.000000000, "msgr_send_messages_queue_lat": { "avgcount": 6, "sum": 0.158362306, "avgtime": 0.026393717 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "msgr_recv_encrypted_bytes": 734128, "msgr_send_encrypted_bytes": 928 } } ], "cct": [ { "labels": {}, "counters": { "total_workers": 0, "unhealthy_workers": 0 } } ], "cephfs_mirror": [ { "labels": {}, "counters": { "mirrored_filesystems": 0, "mirror_enable_failures": 0 } } ], "mempool": [ { "labels": {}, "counters": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_cache_buffer_bytes": 0, "bluestore_cache_buffer_items": 0, "bluestore_extent_bytes": 0, "bluestore_extent_items": 0, "bluestore_blob_bytes": 0, "bluestore_blob_items": 0, "bluestore_shared_blob_bytes": 0, "bluestore_shared_blob_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_items": 0, "bluefs_bytes": 0, "bluefs_items": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "buffer_anon_bytes": 148386, "buffer_anon_items": 24, "buffer_meta_bytes": 0, "buffer_meta_items": 0, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 4824, "osdmap_items": 52, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "mds_co_bytes": 0, "mds_co_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 } } ], "objecter": [ { "labels": {}, "counters": { "op_active": 0, "op_laggy": 0, "op_send": 0, "op_send_bytes": 0, "op_resend": 0, "op_reply": 0, "op_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "op_inflight": 0, "oplen_avg": { "avgcount": 0, "sum": 0 }, "op": 0, "op_r": 0, "op_w": 0, "op_rmw": 0, "op_pg": 0, "osdop_stat": 0, "osdop_create": 0, "osdop_read": 0, "osdop_write": 0, "osdop_writefull": 0, "osdop_writesame": 0, "osdop_append": 0, "osdop_zero": 0, "osdop_truncate": 0, "osdop_delete": 0, "osdop_mapext": 0, "osdop_sparse_read": 0, "osdop_clonerange": 0, "osdop_getxattr": 0, "osdop_setxattr": 0, "osdop_cmpxattr": 0, "osdop_rmxattr": 0, "osdop_resetxattrs": 0, "osdop_call": 0, "osdop_watch": 0, "osdop_notify": 0, "osdop_src_cmpxattr": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_other": 0, "linger_active": 0, "linger_send": 0, "linger_resend": 0, "linger_ping": 0, "poolop_active": 0, "poolop_send": 0, "poolop_resend": 0, "poolstat_active": 0, "poolstat_send": 0, "poolstat_resend": 0, "statfs_active": 0, "statfs_send": 0, "statfs_resend": 0, "command_active": 0, "command_send": 0, "command_resend": 0, "map_epoch": 0, "map_full": 0, "map_inc": 0, "osd_sessions": 0, "osd_session_open": 0, "osd_session_close": 0, "osd_laggy": 0, "omap_wr": 0, "omap_rd": 0, "omap_del": 0 } } ], "throttle-msgr_dispatch_throttler-client": [ { "labels": {}, "counters": { "val": 0, "max": 104857600, "get_started": 0, "get": 35, "get_sum": 136823, "get_or_fail_fail": 0, "get_or_fail_success": 35, "take": 0, "take_sum": 0, "put": 35, "put_sum": 136823, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ], "throttle-msgr_dispatch_throttler-radosclient": [ { "labels": {}, "counters": { "val": 0, "max": 104857600, "get_started": 0, "get": 24, "get_sum": 730609, "get_or_fail_fail": 0, "get_or_fail_success": 24, "take": 0, "take_sum": 0, "put": 24, "put_sum": 730609, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ], "throttle-objecter_bytes": [ { "labels": {}, "counters": { "val": 0, "max": 104857600, "get_started": 0, "get": 0, "get_sum": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "take": 0, "take_sum": 0, "put": 0, "put_sum": 0, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ], "throttle-objecter_ops": [ { "labels": {}, "counters": { "val": 0, "max": 1024, "get_started": 0, "get": 0, "get_sum": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "take": 0, "take_sum": 0, "put": 0, "put_sum": 0, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ] } 2024-03-16T07:28:10.732 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:28:10.732 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -rf d1) 2024-03-16T07:28:10.757 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable mirroring 2024-03-16T07:28:11.498 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-03-16T07:28:11.499 DEBUG:teuthology.orchestra.run.smithi049:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-03-16T07:28:11.566 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-03-16T07:28:11.567 INFO:tasks.cephfs.mount:Terminating background process 2024-03-16T07:28:11.567 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-03-16T07:28:11.567 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-16T07:28:11.582 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T07:28:11.900 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:28:11.900+0000 7f5132c3e040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-16T07:28:11.949 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:28:11.950+0000 7f5132c3e040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-16T07:28:12.056 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:28:12.056 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":57,"fsid":"f91af061-9eac-4793-87fa-8d27ae3d242f","created":"2024-03-16T07:24:20.357868+0000","modified":"2024-03-16T07:28:02.469155+0000","last_up_change":"2024-03-16T07:24:27.474980+0000","last_in_change":"2024-03-16T07:24:21.254179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T07:24:28.947521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-03-16T07:27:06.904626+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-03-16T07:27:07.577125+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"backup_fs_metadata","create_time":"2024-03-16T07:27:20.203959+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"backup_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.0299999713897705,"score_stable":1.0299999713897705,"optimal_score":1,"raw_score_acting":1.0299999713897705,"raw_score_stable":1.0299999713897705,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"backup_fs_data","create_time":"2024-03-16T07:27:20.598983+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"backup_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2df14aac-98dc-4e3c-ae7e-9eb677aa30be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6801","nonce":2744935777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6803","nonce":2744935777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6807","nonce":2744935777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6805","nonce":2744935777}]},"public_addr":"172.21.15.49:6801/2744935777","cluster_addr":"172.21.15.49:6803/2744935777","heartbeat_back_addr":"172.21.15.49:6807/2744935777","heartbeat_front_addr":"172.21.15.49:6805/2744935777","state":["exists","up"]},{"osd":1,"uuid":"80461bd9-59ef-46df-9eea-bad92d960c57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6811","nonce":1655120118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6815","nonce":1655120118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6821","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6823","nonce":1655120118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6817","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6819","nonce":1655120118}]},"public_addr":"172.21.15.49:6811/1655120118","cluster_addr":"172.21.15.49:6815/1655120118","heartbeat_back_addr":"172.21.15.49:6823/1655120118","heartbeat_front_addr":"172.21.15.49:6819/1655120118","state":["exists","up"]},{"osd":2,"uuid":"d6bf40eb-6e42-4ec9-8b3d-0b6c5a6def79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6810","nonce":3815472376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6814","nonce":3815472376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6822","nonce":3815472376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6818","nonce":3815472376}]},"public_addr":"172.21.15.49:6810/3815472376","cluster_addr":"172.21.15.49:6814/3815472376","heartbeat_back_addr":"172.21.15.49:6822/3815472376","heartbeat_front_addr":"172.21.15.49:6818/3815472376","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.641492+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.668598+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.614940+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.49:0/2180583115":"2024-03-16T08:28:01.476474+0000","172.21.15.49:0/1962350817":"2024-03-17T07:27:33.395329+0000","172.21.15.49:0/1244850585":"2024-03-17T07:27:33.395329+0000","172.21.15.49:0/268018280":"2024-03-17T07:27:33.395329+0000","172.21.15.49:0/804373598":"2024-03-17T07:27:33.395329+0000","172.21.15.49:0/3829169982":"2024-03-17T07:27:33.395329+0000","172.21.15.49:0/3508188724":"2024-03-17T07:27:33.395329+0000","172.21.15.49:0/232434635":"2024-03-17T07:27:33.395329+0000","172.21.15.49:0/1033282597":"2024-03-17T07:27:33.395329+0000","172.21.15.49:6825/3780279566":"2024-03-17T07:27:33.395329+0000","172.21.15.49:6824/3780279566":"2024-03-17T07:27:33.395329+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T07:28:12.070 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-16T07:24:28.947521+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-16T07:27:06.904626+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '50', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2024-03-16T07:27:07.577125+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '51', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'backup_fs_metadata', 'create_time': '2024-03-16T07:27:20.203959+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '54', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'backup_fs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.0299999713897705, 'score_stable': 1.0299999713897705, 'optimal_score': 1, 'raw_score_acting': 1.0299999713897705, 'raw_score_stable': 1.0299999713897705, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'backup_fs_data', 'create_time': '2024-03-16T07:27:20.598983+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '55', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'backup_fs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-16T07:28:12.070 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-16T07:28:12.453 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2024-03-16T07:28:12.470 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-16T07:28:12.485 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:28:12.486+0000 7f5132c3e040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-16T07:28:12.533 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:28:12.534+0000 7f5132c3e040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-16T07:28:12.608 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:28:12.609+0000 7f5132c3e040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-16T07:28:12.700 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:28:12.701+0000 7f5132c3e040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-16T07:28:12.744 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:28:12.745+0000 7f5132c3e040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-16T07:28:12.806 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2024-03-16T07:28:12.820 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-16T07:28:12.864 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:28:12.865+0000 7f5132c3e040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-16T07:28:12.927 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:28:12.928+0000 7f5132c3e040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-16T07:28:12.974 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:28:12.975+0000 7f5132c3e040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-16T07:28:13.027 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:28:13.028+0000 7f5132c3e040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-16T07:28:13.075 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:28:13.076+0000 7f5132c3e040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-16T07:28:13.222 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2024-03-16T07:28:13.236 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get backup_fs_metadata pg_num 2024-03-16T07:28:13.510 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:28:13.511+0000 7f5132c3e040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-16T07:28:13.586 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2024-03-16T07:28:13.599 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get backup_fs_data pg_num 2024-03-16T07:28:13.729 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:28:13.730+0000 7f5132c3e040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-16T07:28:13.874 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:28:13.875+0000 7f5132c3e040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-16T07:28:13.938 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:28:13.938+0000 7f5132c3e040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-16T07:28:14.054 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2024-03-16T07:28:14.068 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-16T07:28:14.084 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:28:14.085+0000 7f5132c3e040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-16T07:28:14.224 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:28:14.225+0000 7f5132c3e040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-16T07:28:14.386 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:28:14.386+0000 7f5132c3e040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-16T07:28:14.430 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:28:14.431+0000 7f5132c3e040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-16T07:28:14.539 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/2180583115 2024-03-16T08:28:01.476474+0000 2024-03-16T07:28:14.539 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/1962350817 2024-03-17T07:27:33.395329+0000 2024-03-16T07:28:14.539 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/1244850585 2024-03-17T07:27:33.395329+0000 2024-03-16T07:28:14.539 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/268018280 2024-03-17T07:27:33.395329+0000 2024-03-16T07:28:14.540 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/804373598 2024-03-17T07:27:33.395329+0000 2024-03-16T07:28:14.540 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/3829169982 2024-03-17T07:27:33.395329+0000 2024-03-16T07:28:14.540 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/3508188724 2024-03-17T07:27:33.395329+0000 2024-03-16T07:28:14.540 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/232434635 2024-03-17T07:27:33.395329+0000 2024-03-16T07:28:14.540 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/1033282597 2024-03-17T07:27:33.395329+0000 2024-03-16T07:28:14.540 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:6825/3780279566 2024-03-17T07:27:33.395329+0000 2024-03-16T07:28:14.540 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:6824/3780279566 2024-03-17T07:27:33.395329+0000 2024-03-16T07:28:14.540 INFO:teuthology.orchestra.run.smithi049.stderr:listed 11 entries 2024-03-16T07:28:14.558 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi049.front.sepia.ceph.com... 2024-03-16T07:28:14.558 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:28:14.558 DEBUG:teuthology.orchestra.run.smithi049:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-03-16T07:28:14.565 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:28:14.566+0000 7f5132c3e040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-16T07:28:14.597 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi049.stderr:ceph-fuse[52705]: fuse finished with error 0 and tester_r 0 2024-03-16T07:28:14.599 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi049.front.sepia.ceph.com 2024-03-16T07:28:14.599 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:28:14.599 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-03-16T07:28:14.731 INFO:tasks.cephfs.mount:Terminating background process 2024-03-16T07:28:14.731 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-03-16T07:28:14.731 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-16T07:28:14.746 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T07:28:15.102 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:28:15.103 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":57,"fsid":"f91af061-9eac-4793-87fa-8d27ae3d242f","created":"2024-03-16T07:24:20.357868+0000","modified":"2024-03-16T07:28:02.469155+0000","last_up_change":"2024-03-16T07:24:27.474980+0000","last_in_change":"2024-03-16T07:24:21.254179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T07:24:28.947521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-03-16T07:27:06.904626+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-03-16T07:27:07.577125+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"backup_fs_metadata","create_time":"2024-03-16T07:27:20.203959+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"backup_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.0299999713897705,"score_stable":1.0299999713897705,"optimal_score":1,"raw_score_acting":1.0299999713897705,"raw_score_stable":1.0299999713897705,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"backup_fs_data","create_time":"2024-03-16T07:27:20.598983+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"backup_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2df14aac-98dc-4e3c-ae7e-9eb677aa30be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6801","nonce":2744935777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6803","nonce":2744935777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6807","nonce":2744935777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6805","nonce":2744935777}]},"public_addr":"172.21.15.49:6801/2744935777","cluster_addr":"172.21.15.49:6803/2744935777","heartbeat_back_addr":"172.21.15.49:6807/2744935777","heartbeat_front_addr":"172.21.15.49:6805/2744935777","state":["exists","up"]},{"osd":1,"uuid":"80461bd9-59ef-46df-9eea-bad92d960c57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6811","nonce":1655120118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6815","nonce":1655120118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6821","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6823","nonce":1655120118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6817","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6819","nonce":1655120118}]},"public_addr":"172.21.15.49:6811/1655120118","cluster_addr":"172.21.15.49:6815/1655120118","heartbeat_back_addr":"172.21.15.49:6823/1655120118","heartbeat_front_addr":"172.21.15.49:6819/1655120118","state":["exists","up"]},{"osd":2,"uuid":"d6bf40eb-6e42-4ec9-8b3d-0b6c5a6def79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6810","nonce":3815472376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6814","nonce":3815472376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6822","nonce":3815472376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6818","nonce":3815472376}]},"public_addr":"172.21.15.49:6810/3815472376","cluster_addr":"172.21.15.49:6814/3815472376","heartbeat_back_addr":"172.21.15.49:6822/3815472376","heartbeat_front_addr":"172.21.15.49:6818/3815472376","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.641492+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.668598+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.614940+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.49:0/2180583115":"2024-03-16T08:28:01.476474+0000","172.21.15.49:0/1962350817":"2024-03-17T07:27:33.395329+0000","172.21.15.49:0/1244850585":"2024-03-17T07:27:33.395329+0000","172.21.15.49:0/268018280":"2024-03-17T07:27:33.395329+0000","172.21.15.49:0/804373598":"2024-03-17T07:27:33.395329+0000","172.21.15.49:0/3829169982":"2024-03-17T07:27:33.395329+0000","172.21.15.49:0/3508188724":"2024-03-17T07:27:33.395329+0000","172.21.15.49:0/232434635":"2024-03-17T07:27:33.395329+0000","172.21.15.49:0/1033282597":"2024-03-17T07:27:33.395329+0000","172.21.15.49:6825/3780279566":"2024-03-17T07:27:33.395329+0000","172.21.15.49:6824/3780279566":"2024-03-17T07:27:33.395329+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T07:28:15.116 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-16T07:24:28.947521+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-16T07:27:06.904626+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '50', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2024-03-16T07:27:07.577125+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '51', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'backup_fs_metadata', 'create_time': '2024-03-16T07:27:20.203959+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '54', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'backup_fs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.0299999713897705, 'score_stable': 1.0299999713897705, 'optimal_score': 1, 'raw_score_acting': 1.0299999713897705, 'raw_score_stable': 1.0299999713897705, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'backup_fs_data', 'create_time': '2024-03-16T07:27:20.598983+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '55', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'backup_fs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-16T07:28:15.117 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-16T07:28:15.253 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:28:15.253+0000 7f5132c3e040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-16T07:28:15.435 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2024-03-16T07:28:15.448 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-16T07:28:15.553 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:28:15.554+0000 7f5132c3e040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-16T07:28:15.629 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:28:15.629+0000 7f5132c3e040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-16T07:28:15.756 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2024-03-16T07:28:15.770 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-16T07:28:15.846 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:28:15.847+0000 7f5132c3e040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-16T07:28:15.956 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:28:15.957+0000 7f50b47fa640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:28:15.957 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:28:15.957+0000 7f50b47fa640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:28:15.957 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:28:15.957+0000 7f50b47fa640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:28:15.957 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:28:15.957+0000 7f50b47fa640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:28:15.957 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:28:15.957+0000 7f50b47fa640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:28:15.960 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:28:15.958+0000 7f50b7800640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:28:15.960 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:28:15.958+0000 7f50b7800640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:28:15.960 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:28:15.958+0000 7f50b7800640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:28:15.960 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:28:15.958+0000 7f50b7800640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:28:15.960 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:28:15.958+0000 7f50b7800640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:28:15.968 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:28:15.968+0000 7f50b47fa640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:28:15.968 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:28:15.968+0000 7f50b47fa640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:28:15.968 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:28:15.968+0000 7f50b47fa640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:28:15.968 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:28:15.968+0000 7f50b47fa640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:28:15.968 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:28:15.968+0000 7f50b47fa640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:28:15.968 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:28:15.968+0000 7f50b7800640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:28:15.968 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:28:15.968+0000 7f50b7800640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:28:15.968 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:28:15.968+0000 7f50b7800640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:28:15.969 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:28:15.968+0000 7f50b7800640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:28:15.969 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:28:15.968+0000 7f50b7800640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:28:16.106 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2024-03-16T07:28:16.118 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get backup_fs_metadata pg_num 2024-03-16T07:28:16.534 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2024-03-16T07:28:16.553 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get backup_fs_data pg_num 2024-03-16T07:28:16.857 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2024-03-16T07:28:16.879 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-16T07:28:17.198 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/2432003460 2024-03-17T07:28:15.861656+0000 2024-03-16T07:28:17.199 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/1510307741 2024-03-17T07:28:15.861656+0000 2024-03-16T07:28:17.199 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/593428083 2024-03-17T07:28:15.861656+0000 2024-03-16T07:28:17.199 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/529298837 2024-03-17T07:28:15.861656+0000 2024-03-16T07:28:17.199 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:6825/358437171 2024-03-17T07:28:15.861656+0000 2024-03-16T07:28:17.199 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:6824/358437171 2024-03-17T07:28:15.861656+0000 2024-03-16T07:28:17.199 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/2180583115 2024-03-16T08:28:01.476474+0000 2024-03-16T07:28:17.199 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/4015132922 2024-03-17T07:28:15.861656+0000 2024-03-16T07:28:17.199 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/1962350817 2024-03-17T07:27:33.395329+0000 2024-03-16T07:28:17.199 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/1244850585 2024-03-17T07:27:33.395329+0000 2024-03-16T07:28:17.199 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/268018280 2024-03-17T07:27:33.395329+0000 2024-03-16T07:28:17.199 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/4164585190 2024-03-17T07:28:15.861656+0000 2024-03-16T07:28:17.199 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/804373598 2024-03-17T07:27:33.395329+0000 2024-03-16T07:28:17.199 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/2692794410 2024-03-17T07:28:15.861656+0000 2024-03-16T07:28:17.200 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/3829169982 2024-03-17T07:27:33.395329+0000 2024-03-16T07:28:17.200 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/3802825140 2024-03-17T07:28:15.861656+0000 2024-03-16T07:28:17.200 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/3508188724 2024-03-17T07:27:33.395329+0000 2024-03-16T07:28:17.200 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/2103632650 2024-03-17T07:28:15.861656+0000 2024-03-16T07:28:17.200 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/232434635 2024-03-17T07:27:33.395329+0000 2024-03-16T07:28:17.200 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/1033282597 2024-03-17T07:27:33.395329+0000 2024-03-16T07:28:17.200 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:6825/3780279566 2024-03-17T07:27:33.395329+0000 2024-03-16T07:28:17.200 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:6824/3780279566 2024-03-17T07:27:33.395329+0000 2024-03-16T07:28:17.201 INFO:teuthology.orchestra.run.smithi049.stderr:listed 22 entries 2024-03-16T07:28:17.211 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi049.front.sepia.ceph.com... 2024-03-16T07:28:17.211 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:28:17.211 DEBUG:teuthology.orchestra.run.smithi049:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2024-03-16T07:28:17.240 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi049.stderr:ceph-fuse[53119]: fuse finished with error 0 and tester_r 0 2024-03-16T07:28:17.242 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi049.front.sepia.ceph.com 2024-03-16T07:28:17.242 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:28:17.242 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-03-16T07:28:17.372 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T07:28:17.803 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:28:17.804 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":41,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4888,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6827/1901069637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":1901069637},{"type":"v1","addr":"172.21.15.49:6827","nonce":1901069637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30},{"gid":4891,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6829/512304085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":512304085},{"type":"v1","addr":"172.21.15.49:6829","nonce":512304085}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30},{"gid":4894,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6833/2341714657","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":2341714657},{"type":"v1","addr":"172.21.15.49:6833","nonce":2341714657}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":41,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-16T07:27:08.607433+0000","modified":"2024-03-16T07:27:59.728336+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4898},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4898":{"gid":4898,"name":"d","rank":0,"incarnation":31,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6835/3239577766","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":3239577766},{"type":"v1","addr":"172.21.15.49:6835","nonce":3239577766}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4898,"qdb_cluster":[4898]},"id":4},{"mdsmap":{"epoch":39,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-16T07:27:21.615388+0000","modified":"2024-03-16T07:27:24.746731+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4895},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4895":{"gid":4895,"name":"b","rank":0,"incarnation":35,"state":"up:active","state_seq":6,"addr":"172.21.15.49:6832/849811345","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6831","nonce":849811345},{"type":"v1","addr":"172.21.15.49:6832","nonce":849811345}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"backup_fs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4895,"qdb_cluster":[4895]},"id":5}]} 2024-03-16T07:28:17.804 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 41 2024-03-16T07:28:17.817 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T07:28:18.136 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:28:18.137 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":58,"fsid":"f91af061-9eac-4793-87fa-8d27ae3d242f","created":"2024-03-16T07:24:20.357868+0000","modified":"2024-03-16T07:28:15.861720+0000","last_up_change":"2024-03-16T07:24:27.474980+0000","last_in_change":"2024-03-16T07:24:21.254179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T07:24:28.947521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-03-16T07:27:06.904626+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-03-16T07:27:07.577125+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"backup_fs_metadata","create_time":"2024-03-16T07:27:20.203959+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"backup_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.0299999713897705,"score_stable":1.0299999713897705,"optimal_score":1,"raw_score_acting":1.0299999713897705,"raw_score_stable":1.0299999713897705,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"backup_fs_data","create_time":"2024-03-16T07:27:20.598983+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"backup_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2df14aac-98dc-4e3c-ae7e-9eb677aa30be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6801","nonce":2744935777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6803","nonce":2744935777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6807","nonce":2744935777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6805","nonce":2744935777}]},"public_addr":"172.21.15.49:6801/2744935777","cluster_addr":"172.21.15.49:6803/2744935777","heartbeat_back_addr":"172.21.15.49:6807/2744935777","heartbeat_front_addr":"172.21.15.49:6805/2744935777","state":["exists","up"]},{"osd":1,"uuid":"80461bd9-59ef-46df-9eea-bad92d960c57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6811","nonce":1655120118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6815","nonce":1655120118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6821","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6823","nonce":1655120118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6817","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6819","nonce":1655120118}]},"public_addr":"172.21.15.49:6811/1655120118","cluster_addr":"172.21.15.49:6815/1655120118","heartbeat_back_addr":"172.21.15.49:6823/1655120118","heartbeat_front_addr":"172.21.15.49:6819/1655120118","state":["exists","up"]},{"osd":2,"uuid":"d6bf40eb-6e42-4ec9-8b3d-0b6c5a6def79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6810","nonce":3815472376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6814","nonce":3815472376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6822","nonce":3815472376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6818","nonce":3815472376}]},"public_addr":"172.21.15.49:6810/3815472376","cluster_addr":"172.21.15.49:6814/3815472376","heartbeat_back_addr":"172.21.15.49:6822/3815472376","heartbeat_front_addr":"172.21.15.49:6818/3815472376","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.641492+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.668598+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.614940+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.49:0/2432003460":"2024-03-17T07:28:15.861656+0000","172.21.15.49:0/1510307741":"2024-03-17T07:28:15.861656+0000","172.21.15.49:0/593428083":"2024-03-17T07:28:15.861656+0000","172.21.15.49:0/529298837":"2024-03-17T07:28:15.861656+0000","172.21.15.49:6825/358437171":"2024-03-17T07:28:15.861656+0000","172.21.15.49:6824/358437171":"2024-03-17T07:28:15.861656+0000","172.21.15.49:0/2180583115":"2024-03-16T08:28:01.476474+0000","172.21.15.49:0/4015132922":"2024-03-17T07:28:15.861656+0000","172.21.15.49:0/1962350817":"2024-03-17T07:27:33.395329+0000","172.21.15.49:0/1244850585":"2024-03-17T07:27:33.395329+0000","172.21.15.49:0/268018280":"2024-03-17T07:27:33.395329+0000","172.21.15.49:0/4164585190":"2024-03-17T07:28:15.861656+0000","172.21.15.49:0/804373598":"2024-03-17T07:27:33.395329+0000","172.21.15.49:0/2692794410":"2024-03-17T07:28:15.861656+0000","172.21.15.49:0/3829169982":"2024-03-17T07:27:33.395329+0000","172.21.15.49:0/3802825140":"2024-03-17T07:28:15.861656+0000","172.21.15.49:0/3508188724":"2024-03-17T07:27:33.395329+0000","172.21.15.49:0/2103632650":"2024-03-17T07:28:15.861656+0000","172.21.15.49:0/232434635":"2024-03-17T07:27:33.395329+0000","172.21.15.49:0/1033282597":"2024-03-17T07:27:33.395329+0000","172.21.15.49:6825/3780279566":"2024-03-17T07:27:33.395329+0000","172.21.15.49:6824/3780279566":"2024-03-17T07:27:33.395329+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T07:28:18.155 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-16T07:24:28.947521+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-16T07:27:06.904626+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '50', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2024-03-16T07:27:07.577125+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '51', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'backup_fs_metadata', 'create_time': '2024-03-16T07:27:20.203959+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '54', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'backup_fs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.0299999713897705, 'score_stable': 1.0299999713897705, 'optimal_score': 1, 'raw_score_acting': 1.0299999713897705, 'raw_score_stable': 1.0299999713897705, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'backup_fs_data', 'create_time': '2024-03-16T07:27:20.598983+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '55', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'backup_fs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-16T07:28:18.155 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-16T07:28:18.510 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2024-03-16T07:28:18.523 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-16T07:28:18.827 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2024-03-16T07:28:18.840 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-16T07:28:19.198 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2024-03-16T07:28:19.212 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get backup_fs_metadata pg_num 2024-03-16T07:28:19.515 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2024-03-16T07:28:19.529 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get backup_fs_data pg_num 2024-03-16T07:28:19.834 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2024-03-16T07:28:19.847 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T07:28:20.284 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:28:20.284 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":41,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4888,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6827/1901069637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":1901069637},{"type":"v1","addr":"172.21.15.49:6827","nonce":1901069637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30},{"gid":4891,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6829/512304085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":512304085},{"type":"v1","addr":"172.21.15.49:6829","nonce":512304085}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30},{"gid":4894,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6833/2341714657","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":2341714657},{"type":"v1","addr":"172.21.15.49:6833","nonce":2341714657}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":41,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-16T07:27:08.607433+0000","modified":"2024-03-16T07:27:59.728336+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4898},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4898":{"gid":4898,"name":"d","rank":0,"incarnation":31,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6835/3239577766","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":3239577766},{"type":"v1","addr":"172.21.15.49:6835","nonce":3239577766}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4898,"qdb_cluster":[4898]},"id":4},{"mdsmap":{"epoch":39,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-16T07:27:21.615388+0000","modified":"2024-03-16T07:27:24.746731+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4895},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4895":{"gid":4895,"name":"b","rank":0,"incarnation":35,"state":"up:active","state_seq":6,"addr":"172.21.15.49:6832/849811345","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6831","nonce":849811345},{"type":"v1","addr":"172.21.15.49:6832","nonce":849811345}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"backup_fs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4895,"qdb_cluster":[4895]},"id":5}]} 2024-03-16T07:28:20.285 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 41 2024-03-16T07:28:20.297 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T07:28:20.602 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:28:20.602 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":58,"fsid":"f91af061-9eac-4793-87fa-8d27ae3d242f","created":"2024-03-16T07:24:20.357868+0000","modified":"2024-03-16T07:28:15.861720+0000","last_up_change":"2024-03-16T07:24:27.474980+0000","last_in_change":"2024-03-16T07:24:21.254179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T07:24:28.947521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-03-16T07:27:06.904626+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-03-16T07:27:07.577125+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"backup_fs_metadata","create_time":"2024-03-16T07:27:20.203959+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"backup_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.0299999713897705,"score_stable":1.0299999713897705,"optimal_score":1,"raw_score_acting":1.0299999713897705,"raw_score_stable":1.0299999713897705,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"backup_fs_data","create_time":"2024-03-16T07:27:20.598983+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"backup_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2df14aac-98dc-4e3c-ae7e-9eb677aa30be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6801","nonce":2744935777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6803","nonce":2744935777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6807","nonce":2744935777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6805","nonce":2744935777}]},"public_addr":"172.21.15.49:6801/2744935777","cluster_addr":"172.21.15.49:6803/2744935777","heartbeat_back_addr":"172.21.15.49:6807/2744935777","heartbeat_front_addr":"172.21.15.49:6805/2744935777","state":["exists","up"]},{"osd":1,"uuid":"80461bd9-59ef-46df-9eea-bad92d960c57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6811","nonce":1655120118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6815","nonce":1655120118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6821","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6823","nonce":1655120118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6817","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6819","nonce":1655120118}]},"public_addr":"172.21.15.49:6811/1655120118","cluster_addr":"172.21.15.49:6815/1655120118","heartbeat_back_addr":"172.21.15.49:6823/1655120118","heartbeat_front_addr":"172.21.15.49:6819/1655120118","state":["exists","up"]},{"osd":2,"uuid":"d6bf40eb-6e42-4ec9-8b3d-0b6c5a6def79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6810","nonce":3815472376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6814","nonce":3815472376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6822","nonce":3815472376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6818","nonce":3815472376}]},"public_addr":"172.21.15.49:6810/3815472376","cluster_addr":"172.21.15.49:6814/3815472376","heartbeat_back_addr":"172.21.15.49:6822/3815472376","heartbeat_front_addr":"172.21.15.49:6818/3815472376","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.641492+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.668598+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.614940+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.49:0/2432003460":"2024-03-17T07:28:15.861656+0000","172.21.15.49:0/1510307741":"2024-03-17T07:28:15.861656+0000","172.21.15.49:0/593428083":"2024-03-17T07:28:15.861656+0000","172.21.15.49:0/529298837":"2024-03-17T07:28:15.861656+0000","172.21.15.49:6825/358437171":"2024-03-17T07:28:15.861656+0000","172.21.15.49:6824/358437171":"2024-03-17T07:28:15.861656+0000","172.21.15.49:0/2180583115":"2024-03-16T08:28:01.476474+0000","172.21.15.49:0/4015132922":"2024-03-17T07:28:15.861656+0000","172.21.15.49:0/1962350817":"2024-03-17T07:27:33.395329+0000","172.21.15.49:0/1244850585":"2024-03-17T07:27:33.395329+0000","172.21.15.49:0/268018280":"2024-03-17T07:27:33.395329+0000","172.21.15.49:0/4164585190":"2024-03-17T07:28:15.861656+0000","172.21.15.49:0/804373598":"2024-03-17T07:27:33.395329+0000","172.21.15.49:0/2692794410":"2024-03-17T07:28:15.861656+0000","172.21.15.49:0/3829169982":"2024-03-17T07:27:33.395329+0000","172.21.15.49:0/3802825140":"2024-03-17T07:28:15.861656+0000","172.21.15.49:0/3508188724":"2024-03-17T07:27:33.395329+0000","172.21.15.49:0/2103632650":"2024-03-17T07:28:15.861656+0000","172.21.15.49:0/232434635":"2024-03-17T07:27:33.395329+0000","172.21.15.49:0/1033282597":"2024-03-17T07:27:33.395329+0000","172.21.15.49:6825/3780279566":"2024-03-17T07:27:33.395329+0000","172.21.15.49:6824/3780279566":"2024-03-17T07:27:33.395329+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T07:28:20.615 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-03-16T07:28:20.616 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T07:28:20.998 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:28:20.998 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":41,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4888,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6827/1901069637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":1901069637},{"type":"v1","addr":"172.21.15.49:6827","nonce":1901069637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30},{"gid":4891,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6829/512304085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":512304085},{"type":"v1","addr":"172.21.15.49:6829","nonce":512304085}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30},{"gid":4894,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6833/2341714657","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":2341714657},{"type":"v1","addr":"172.21.15.49:6833","nonce":2341714657}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":41,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-16T07:27:08.607433+0000","modified":"2024-03-16T07:27:59.728336+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4898},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4898":{"gid":4898,"name":"d","rank":0,"incarnation":31,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6835/3239577766","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":3239577766},{"type":"v1","addr":"172.21.15.49:6835","nonce":3239577766}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4898,"qdb_cluster":[4898]},"id":4},{"mdsmap":{"epoch":39,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-16T07:27:21.615388+0000","modified":"2024-03-16T07:27:24.746731+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4895},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4895":{"gid":4895,"name":"b","rank":0,"incarnation":35,"state":"up:active","state_seq":6,"addr":"172.21.15.49:6832/849811345","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6831","nonce":849811345},{"type":"v1","addr":"172.21.15.49:6832","nonce":849811345}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"backup_fs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4895,"qdb_cluster":[4895]},"id":5}]} 2024-03-16T07:28:20.998 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 41 2024-03-16T07:28:21.015 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T07:28:21.359 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:28:21.359 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":41,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4888,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6827/1901069637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":1901069637},{"type":"v1","addr":"172.21.15.49:6827","nonce":1901069637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30},{"gid":4891,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6829/512304085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":512304085},{"type":"v1","addr":"172.21.15.49:6829","nonce":512304085}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30},{"gid":4894,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6833/2341714657","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":2341714657},{"type":"v1","addr":"172.21.15.49:6833","nonce":2341714657}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":41,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-16T07:27:08.607433+0000","modified":"2024-03-16T07:27:59.728336+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4898},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4898":{"gid":4898,"name":"d","rank":0,"incarnation":31,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6835/3239577766","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":3239577766},{"type":"v1","addr":"172.21.15.49:6835","nonce":3239577766}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4898,"qdb_cluster":[4898]},"id":4},{"mdsmap":{"epoch":39,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-16T07:27:21.615388+0000","modified":"2024-03-16T07:27:24.746731+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4895},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4895":{"gid":4895,"name":"b","rank":0,"incarnation":35,"state":"up:active","state_seq":6,"addr":"172.21.15.49:6832/849811345","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6831","nonce":849811345},{"type":"v1","addr":"172.21.15.49:6832","nonce":849811345}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"backup_fs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4895,"qdb_cluster":[4895]},"id":5}]} 2024-03-16T07:28:21.359 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 41 2024-03-16T07:28:21.371 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T07:28:21.787 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:28:21.788 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":58,"fsid":"f91af061-9eac-4793-87fa-8d27ae3d242f","created":"2024-03-16T07:24:20.357868+0000","modified":"2024-03-16T07:28:15.861720+0000","last_up_change":"2024-03-16T07:24:27.474980+0000","last_in_change":"2024-03-16T07:24:21.254179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T07:24:28.947521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-03-16T07:27:06.904626+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-03-16T07:27:07.577125+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"backup_fs_metadata","create_time":"2024-03-16T07:27:20.203959+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"backup_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.0299999713897705,"score_stable":1.0299999713897705,"optimal_score":1,"raw_score_acting":1.0299999713897705,"raw_score_stable":1.0299999713897705,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"backup_fs_data","create_time":"2024-03-16T07:27:20.598983+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"backup_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2df14aac-98dc-4e3c-ae7e-9eb677aa30be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6801","nonce":2744935777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6803","nonce":2744935777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6807","nonce":2744935777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6805","nonce":2744935777}]},"public_addr":"172.21.15.49:6801/2744935777","cluster_addr":"172.21.15.49:6803/2744935777","heartbeat_back_addr":"172.21.15.49:6807/2744935777","heartbeat_front_addr":"172.21.15.49:6805/2744935777","state":["exists","up"]},{"osd":1,"uuid":"80461bd9-59ef-46df-9eea-bad92d960c57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6811","nonce":1655120118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6815","nonce":1655120118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6821","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6823","nonce":1655120118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6817","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6819","nonce":1655120118}]},"public_addr":"172.21.15.49:6811/1655120118","cluster_addr":"172.21.15.49:6815/1655120118","heartbeat_back_addr":"172.21.15.49:6823/1655120118","heartbeat_front_addr":"172.21.15.49:6819/1655120118","state":["exists","up"]},{"osd":2,"uuid":"d6bf40eb-6e42-4ec9-8b3d-0b6c5a6def79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6810","nonce":3815472376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6814","nonce":3815472376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6822","nonce":3815472376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6818","nonce":3815472376}]},"public_addr":"172.21.15.49:6810/3815472376","cluster_addr":"172.21.15.49:6814/3815472376","heartbeat_back_addr":"172.21.15.49:6822/3815472376","heartbeat_front_addr":"172.21.15.49:6818/3815472376","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.641492+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.668598+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.614940+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.49:0/2432003460":"2024-03-17T07:28:15.861656+0000","172.21.15.49:0/1510307741":"2024-03-17T07:28:15.861656+0000","172.21.15.49:0/593428083":"2024-03-17T07:28:15.861656+0000","172.21.15.49:0/529298837":"2024-03-17T07:28:15.861656+0000","172.21.15.49:6825/358437171":"2024-03-17T07:28:15.861656+0000","172.21.15.49:6824/358437171":"2024-03-17T07:28:15.861656+0000","172.21.15.49:0/2180583115":"2024-03-16T08:28:01.476474+0000","172.21.15.49:0/4015132922":"2024-03-17T07:28:15.861656+0000","172.21.15.49:0/1962350817":"2024-03-17T07:27:33.395329+0000","172.21.15.49:0/1244850585":"2024-03-17T07:27:33.395329+0000","172.21.15.49:0/268018280":"2024-03-17T07:27:33.395329+0000","172.21.15.49:0/4164585190":"2024-03-17T07:28:15.861656+0000","172.21.15.49:0/804373598":"2024-03-17T07:27:33.395329+0000","172.21.15.49:0/2692794410":"2024-03-17T07:28:15.861656+0000","172.21.15.49:0/3829169982":"2024-03-17T07:27:33.395329+0000","172.21.15.49:0/3802825140":"2024-03-17T07:28:15.861656+0000","172.21.15.49:0/3508188724":"2024-03-17T07:27:33.395329+0000","172.21.15.49:0/2103632650":"2024-03-17T07:28:15.861656+0000","172.21.15.49:0/232434635":"2024-03-17T07:27:33.395329+0000","172.21.15.49:0/1033282597":"2024-03-17T07:27:33.395329+0000","172.21.15.49:6825/3780279566":"2024-03-17T07:27:33.395329+0000","172.21.15.49:6824/3780279566":"2024-03-17T07:27:33.395329+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T07:28:21.802 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-03-16T07:28:22.220 INFO:tasks.ceph.mon.a.smithi049.stderr:2024-03-16T07:28:22.221+0000 7feb67011640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-03-16T07:28:22.221 INFO:teuthology.orchestra.run.smithi049.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-03-16T07:28:22.222 INFO:tasks.ceph.mds.d.smithi049.stderr: -503> 2024-03-16T07:27:14.894+0000 7f7d29740640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-03-16T07:28:22.237 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-03-16T07:28:22.249 INFO:tasks.ceph.mds.d.smithi049.stdout:starting mds.d at 2024-03-16T07:28:23.235 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-03-16T07:28:24.502 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_metadata' removed 2024-03-16T07:28:24.519 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-03-16T07:28:25.504 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_data' removed 2024-03-16T07:28:25.526 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T07:28:25.828 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:28:25.829 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":61,"fsid":"f91af061-9eac-4793-87fa-8d27ae3d242f","created":"2024-03-16T07:24:20.357868+0000","modified":"2024-03-16T07:28:25.504886+0000","last_up_change":"2024-03-16T07:24:27.474980+0000","last_in_change":"2024-03-16T07:24:21.254179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T07:24:28.947521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"backup_fs_metadata","create_time":"2024-03-16T07:27:20.203959+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"backup_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.0299999713897705,"score_stable":1.0299999713897705,"optimal_score":1,"raw_score_acting":1.0299999713897705,"raw_score_stable":1.0299999713897705,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"backup_fs_data","create_time":"2024-03-16T07:27:20.598983+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"backup_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2df14aac-98dc-4e3c-ae7e-9eb677aa30be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6801","nonce":2744935777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6803","nonce":2744935777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6807","nonce":2744935777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6805","nonce":2744935777}]},"public_addr":"172.21.15.49:6801/2744935777","cluster_addr":"172.21.15.49:6803/2744935777","heartbeat_back_addr":"172.21.15.49:6807/2744935777","heartbeat_front_addr":"172.21.15.49:6805/2744935777","state":["exists","up"]},{"osd":1,"uuid":"80461bd9-59ef-46df-9eea-bad92d960c57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6811","nonce":1655120118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6815","nonce":1655120118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6821","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6823","nonce":1655120118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6817","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6819","nonce":1655120118}]},"public_addr":"172.21.15.49:6811/1655120118","cluster_addr":"172.21.15.49:6815/1655120118","heartbeat_back_addr":"172.21.15.49:6823/1655120118","heartbeat_front_addr":"172.21.15.49:6819/1655120118","state":["exists","up"]},{"osd":2,"uuid":"d6bf40eb-6e42-4ec9-8b3d-0b6c5a6def79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6810","nonce":3815472376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6814","nonce":3815472376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6822","nonce":3815472376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6818","nonce":3815472376}]},"public_addr":"172.21.15.49:6810/3815472376","cluster_addr":"172.21.15.49:6814/3815472376","heartbeat_back_addr":"172.21.15.49:6822/3815472376","heartbeat_front_addr":"172.21.15.49:6818/3815472376","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.641492+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.668598+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.614940+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.49:0/2432003460":"2024-03-17T07:28:15.861656+0000","172.21.15.49:0/1510307741":"2024-03-17T07:28:15.861656+0000","172.21.15.49:0/593428083":"2024-03-17T07:28:15.861656+0000","172.21.15.49:0/529298837":"2024-03-17T07:28:15.861656+0000","172.21.15.49:6825/358437171":"2024-03-17T07:28:15.861656+0000","172.21.15.49:6824/358437171":"2024-03-17T07:28:15.861656+0000","172.21.15.49:0/2180583115":"2024-03-16T08:28:01.476474+0000","172.21.15.49:0/4015132922":"2024-03-17T07:28:15.861656+0000","172.21.15.49:0/1962350817":"2024-03-17T07:27:33.395329+0000","172.21.15.49:0/1244850585":"2024-03-17T07:27:33.395329+0000","172.21.15.49:0/268018280":"2024-03-17T07:27:33.395329+0000","172.21.15.49:0/4164585190":"2024-03-17T07:28:15.861656+0000","172.21.15.49:0/804373598":"2024-03-17T07:27:33.395329+0000","172.21.15.49:0/2692794410":"2024-03-17T07:28:15.861656+0000","172.21.15.49:0/3829169982":"2024-03-17T07:27:33.395329+0000","172.21.15.49:0/3802825140":"2024-03-17T07:28:15.861656+0000","172.21.15.49:0/3508188724":"2024-03-17T07:27:33.395329+0000","172.21.15.49:0/2103632650":"2024-03-17T07:28:15.861656+0000","172.21.15.49:0/232434635":"2024-03-17T07:27:33.395329+0000","172.21.15.49:0/1033282597":"2024-03-17T07:27:33.395329+0000","172.21.15.49:6825/3780279566":"2024-03-17T07:27:33.395329+0000","172.21.15.49:6835/3239577766":"2024-03-17T07:28:22.222594+0000","172.21.15.49:6834/3239577766":"2024-03-17T07:28:22.222594+0000","172.21.15.49:6824/3780279566":"2024-03-17T07:27:33.395329+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T07:28:25.841 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-16T07:24:28.947521+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'backup_fs_metadata', 'create_time': '2024-03-16T07:27:20.203959+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '54', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'backup_fs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.0299999713897705, 'score_stable': 1.0299999713897705, 'optimal_score': 1, 'raw_score_acting': 1.0299999713897705, 'raw_score_stable': 1.0299999713897705, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'backup_fs_data', 'create_time': '2024-03-16T07:27:20.598983+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '55', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'backup_fs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-16T07:28:25.842 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-16T07:28:26.230 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2024-03-16T07:28:26.242 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get backup_fs_metadata pg_num 2024-03-16T07:28:26.577 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2024-03-16T07:28:26.590 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get backup_fs_data pg_num 2024-03-16T07:28:26.973 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2024-03-16T07:28:26.986 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T07:28:27.432 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:28:27.432 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":43,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4888,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6827/1901069637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":1901069637},{"type":"v1","addr":"172.21.15.49:6827","nonce":1901069637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30},{"gid":4891,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6829/512304085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":512304085},{"type":"v1","addr":"172.21.15.49:6829","nonce":512304085}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30},{"gid":4894,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6833/2341714657","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":2341714657},{"type":"v1","addr":"172.21.15.49:6833","nonce":2341714657}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30},{"gid":5182,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/4243678105","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":4243678105},{"type":"v1","addr":"172.21.15.49:6835","nonce":4243678105}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-16T07:27:21.615388+0000","modified":"2024-03-16T07:27:24.746731+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4895},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4895":{"gid":4895,"name":"b","rank":0,"incarnation":35,"state":"up:active","state_seq":6,"addr":"172.21.15.49:6832/849811345","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6831","nonce":849811345},{"type":"v1","addr":"172.21.15.49:6832","nonce":849811345}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"backup_fs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4895,"qdb_cluster":[4895]},"id":5}]} 2024-03-16T07:28:27.432 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 43 2024-03-16T07:28:27.446 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T07:28:27.747 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:28:27.747 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":61,"fsid":"f91af061-9eac-4793-87fa-8d27ae3d242f","created":"2024-03-16T07:24:20.357868+0000","modified":"2024-03-16T07:28:25.504886+0000","last_up_change":"2024-03-16T07:24:27.474980+0000","last_in_change":"2024-03-16T07:24:21.254179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T07:24:28.947521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"backup_fs_metadata","create_time":"2024-03-16T07:27:20.203959+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"backup_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.0299999713897705,"score_stable":1.0299999713897705,"optimal_score":1,"raw_score_acting":1.0299999713897705,"raw_score_stable":1.0299999713897705,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"backup_fs_data","create_time":"2024-03-16T07:27:20.598983+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"backup_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2df14aac-98dc-4e3c-ae7e-9eb677aa30be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6801","nonce":2744935777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6803","nonce":2744935777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6807","nonce":2744935777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6805","nonce":2744935777}]},"public_addr":"172.21.15.49:6801/2744935777","cluster_addr":"172.21.15.49:6803/2744935777","heartbeat_back_addr":"172.21.15.49:6807/2744935777","heartbeat_front_addr":"172.21.15.49:6805/2744935777","state":["exists","up"]},{"osd":1,"uuid":"80461bd9-59ef-46df-9eea-bad92d960c57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6811","nonce":1655120118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6815","nonce":1655120118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6821","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6823","nonce":1655120118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6817","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6819","nonce":1655120118}]},"public_addr":"172.21.15.49:6811/1655120118","cluster_addr":"172.21.15.49:6815/1655120118","heartbeat_back_addr":"172.21.15.49:6823/1655120118","heartbeat_front_addr":"172.21.15.49:6819/1655120118","state":["exists","up"]},{"osd":2,"uuid":"d6bf40eb-6e42-4ec9-8b3d-0b6c5a6def79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6810","nonce":3815472376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6814","nonce":3815472376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6822","nonce":3815472376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6818","nonce":3815472376}]},"public_addr":"172.21.15.49:6810/3815472376","cluster_addr":"172.21.15.49:6814/3815472376","heartbeat_back_addr":"172.21.15.49:6822/3815472376","heartbeat_front_addr":"172.21.15.49:6818/3815472376","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.641492+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.668598+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.614940+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.49:0/2432003460":"2024-03-17T07:28:15.861656+0000","172.21.15.49:0/1510307741":"2024-03-17T07:28:15.861656+0000","172.21.15.49:0/593428083":"2024-03-17T07:28:15.861656+0000","172.21.15.49:0/529298837":"2024-03-17T07:28:15.861656+0000","172.21.15.49:6825/358437171":"2024-03-17T07:28:15.861656+0000","172.21.15.49:6824/358437171":"2024-03-17T07:28:15.861656+0000","172.21.15.49:0/2180583115":"2024-03-16T08:28:01.476474+0000","172.21.15.49:0/4015132922":"2024-03-17T07:28:15.861656+0000","172.21.15.49:0/1962350817":"2024-03-17T07:27:33.395329+0000","172.21.15.49:0/1244850585":"2024-03-17T07:27:33.395329+0000","172.21.15.49:0/268018280":"2024-03-17T07:27:33.395329+0000","172.21.15.49:0/4164585190":"2024-03-17T07:28:15.861656+0000","172.21.15.49:0/804373598":"2024-03-17T07:27:33.395329+0000","172.21.15.49:0/2692794410":"2024-03-17T07:28:15.861656+0000","172.21.15.49:0/3829169982":"2024-03-17T07:27:33.395329+0000","172.21.15.49:0/3802825140":"2024-03-17T07:28:15.861656+0000","172.21.15.49:0/3508188724":"2024-03-17T07:27:33.395329+0000","172.21.15.49:0/2103632650":"2024-03-17T07:28:15.861656+0000","172.21.15.49:0/232434635":"2024-03-17T07:27:33.395329+0000","172.21.15.49:0/1033282597":"2024-03-17T07:27:33.395329+0000","172.21.15.49:6825/3780279566":"2024-03-17T07:27:33.395329+0000","172.21.15.49:6835/3239577766":"2024-03-17T07:28:22.222594+0000","172.21.15.49:6834/3239577766":"2024-03-17T07:28:22.222594+0000","172.21.15.49:6824/3780279566":"2024-03-17T07:27:33.395329+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T07:28:27.760 INFO:tasks.cephfs.filesystem:Destroying file system backup_fs and related pools 2024-03-16T07:28:27.760 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T07:28:28.099 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:28:28.099 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":43,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4888,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6827/1901069637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":1901069637},{"type":"v1","addr":"172.21.15.49:6827","nonce":1901069637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30},{"gid":4891,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6829/512304085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":512304085},{"type":"v1","addr":"172.21.15.49:6829","nonce":512304085}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30},{"gid":4894,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6833/2341714657","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":2341714657},{"type":"v1","addr":"172.21.15.49:6833","nonce":2341714657}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30},{"gid":5182,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/4243678105","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":4243678105},{"type":"v1","addr":"172.21.15.49:6835","nonce":4243678105}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-16T07:27:21.615388+0000","modified":"2024-03-16T07:27:24.746731+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4895},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4895":{"gid":4895,"name":"b","rank":0,"incarnation":35,"state":"up:active","state_seq":6,"addr":"172.21.15.49:6832/849811345","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6831","nonce":849811345},{"type":"v1","addr":"172.21.15.49:6832","nonce":849811345}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"backup_fs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4895,"qdb_cluster":[4895]},"id":5}]} 2024-03-16T07:28:28.099 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 43 2024-03-16T07:28:28.111 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T07:28:28.516 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:28:28.516 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":43,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4888,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6827/1901069637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":1901069637},{"type":"v1","addr":"172.21.15.49:6827","nonce":1901069637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30},{"gid":4891,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6829/512304085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":512304085},{"type":"v1","addr":"172.21.15.49:6829","nonce":512304085}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30},{"gid":4894,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6833/2341714657","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":2341714657},{"type":"v1","addr":"172.21.15.49:6833","nonce":2341714657}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30},{"gid":5182,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/4243678105","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":4243678105},{"type":"v1","addr":"172.21.15.49:6835","nonce":4243678105}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-16T07:27:21.615388+0000","modified":"2024-03-16T07:27:24.746731+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4895},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4895":{"gid":4895,"name":"b","rank":0,"incarnation":35,"state":"up:active","state_seq":6,"addr":"172.21.15.49:6832/849811345","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6831","nonce":849811345},{"type":"v1","addr":"172.21.15.49:6832","nonce":849811345}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"backup_fs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4895,"qdb_cluster":[4895]},"id":5}]} 2024-03-16T07:28:28.517 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 43 2024-03-16T07:28:28.532 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T07:28:28.836 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:28:28.836 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":61,"fsid":"f91af061-9eac-4793-87fa-8d27ae3d242f","created":"2024-03-16T07:24:20.357868+0000","modified":"2024-03-16T07:28:25.504886+0000","last_up_change":"2024-03-16T07:24:27.474980+0000","last_in_change":"2024-03-16T07:24:21.254179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T07:24:28.947521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"backup_fs_metadata","create_time":"2024-03-16T07:27:20.203959+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"backup_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.0299999713897705,"score_stable":1.0299999713897705,"optimal_score":1,"raw_score_acting":1.0299999713897705,"raw_score_stable":1.0299999713897705,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"backup_fs_data","create_time":"2024-03-16T07:27:20.598983+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"backup_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2df14aac-98dc-4e3c-ae7e-9eb677aa30be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6801","nonce":2744935777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6803","nonce":2744935777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6807","nonce":2744935777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6805","nonce":2744935777}]},"public_addr":"172.21.15.49:6801/2744935777","cluster_addr":"172.21.15.49:6803/2744935777","heartbeat_back_addr":"172.21.15.49:6807/2744935777","heartbeat_front_addr":"172.21.15.49:6805/2744935777","state":["exists","up"]},{"osd":1,"uuid":"80461bd9-59ef-46df-9eea-bad92d960c57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6811","nonce":1655120118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6815","nonce":1655120118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6821","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6823","nonce":1655120118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6817","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6819","nonce":1655120118}]},"public_addr":"172.21.15.49:6811/1655120118","cluster_addr":"172.21.15.49:6815/1655120118","heartbeat_back_addr":"172.21.15.49:6823/1655120118","heartbeat_front_addr":"172.21.15.49:6819/1655120118","state":["exists","up"]},{"osd":2,"uuid":"d6bf40eb-6e42-4ec9-8b3d-0b6c5a6def79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6810","nonce":3815472376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6814","nonce":3815472376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6822","nonce":3815472376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6818","nonce":3815472376}]},"public_addr":"172.21.15.49:6810/3815472376","cluster_addr":"172.21.15.49:6814/3815472376","heartbeat_back_addr":"172.21.15.49:6822/3815472376","heartbeat_front_addr":"172.21.15.49:6818/3815472376","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.641492+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.668598+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.614940+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.49:0/2432003460":"2024-03-17T07:28:15.861656+0000","172.21.15.49:0/1510307741":"2024-03-17T07:28:15.861656+0000","172.21.15.49:0/593428083":"2024-03-17T07:28:15.861656+0000","172.21.15.49:0/529298837":"2024-03-17T07:28:15.861656+0000","172.21.15.49:6825/358437171":"2024-03-17T07:28:15.861656+0000","172.21.15.49:6824/358437171":"2024-03-17T07:28:15.861656+0000","172.21.15.49:0/2180583115":"2024-03-16T08:28:01.476474+0000","172.21.15.49:0/4015132922":"2024-03-17T07:28:15.861656+0000","172.21.15.49:0/1962350817":"2024-03-17T07:27:33.395329+0000","172.21.15.49:0/1244850585":"2024-03-17T07:27:33.395329+0000","172.21.15.49:0/268018280":"2024-03-17T07:27:33.395329+0000","172.21.15.49:0/4164585190":"2024-03-17T07:28:15.861656+0000","172.21.15.49:0/804373598":"2024-03-17T07:27:33.395329+0000","172.21.15.49:0/2692794410":"2024-03-17T07:28:15.861656+0000","172.21.15.49:0/3829169982":"2024-03-17T07:27:33.395329+0000","172.21.15.49:0/3802825140":"2024-03-17T07:28:15.861656+0000","172.21.15.49:0/3508188724":"2024-03-17T07:27:33.395329+0000","172.21.15.49:0/2103632650":"2024-03-17T07:28:15.861656+0000","172.21.15.49:0/232434635":"2024-03-17T07:27:33.395329+0000","172.21.15.49:0/1033282597":"2024-03-17T07:27:33.395329+0000","172.21.15.49:6825/3780279566":"2024-03-17T07:27:33.395329+0000","172.21.15.49:6835/3239577766":"2024-03-17T07:28:22.222594+0000","172.21.15.49:6834/3239577766":"2024-03-17T07:28:22.222594+0000","172.21.15.49:6824/3780279566":"2024-03-17T07:27:33.395329+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T07:28:28.849 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail backup_fs 2024-03-16T07:28:29.196 INFO:tasks.ceph.mon.a.smithi049.stderr:2024-03-16T07:28:29.198+0000 7feb67011640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-03-16T07:28:29.197 INFO:teuthology.orchestra.run.smithi049.stderr:backup_fs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-03-16T07:28:29.212 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm backup_fs --yes-i-really-mean-it 2024-03-16T07:28:29.224 INFO:tasks.ceph.mds.b.smithi049.stdout:starting mds.b at 2024-03-16T07:28:30.214 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm backup_fs_metadata backup_fs_metadata --yes-i-really-really-mean-it 2024-03-16T07:28:31.514 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'backup_fs_metadata' removed 2024-03-16T07:28:31.534 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm backup_fs_data backup_fs_data --yes-i-really-really-mean-it 2024-03-16T07:28:32.520 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'backup_fs_data' removed 2024-03-16T07:28:32.544 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-03-16T07:28:32.869 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_mirroring.TestMirroring.test_add_directory_path_normalization' 2024-03-16T07:28:33.534 INFO:tasks.cephfs_test_runner:test_add_directory_path_normalization (tasks.cephfs.test_mirroring.TestMirroring) ... ok 2024-03-16T07:28:33.534 INFO:tasks.cephfs_test_runner:Starting test: test_add_directory_with_mirroring_disabled (tasks.cephfs.test_mirroring.TestMirroring) 2024-03-16T07:28:33.534 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T07:28:33.842 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:28:33.842 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":64,"fsid":"f91af061-9eac-4793-87fa-8d27ae3d242f","created":"2024-03-16T07:24:20.357868+0000","modified":"2024-03-16T07:28:32.520215+0000","last_up_change":"2024-03-16T07:24:27.474980+0000","last_in_change":"2024-03-16T07:24:21.254179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T07:24:28.947521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2df14aac-98dc-4e3c-ae7e-9eb677aa30be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6801","nonce":2744935777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6803","nonce":2744935777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6807","nonce":2744935777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6805","nonce":2744935777}]},"public_addr":"172.21.15.49:6801/2744935777","cluster_addr":"172.21.15.49:6803/2744935777","heartbeat_back_addr":"172.21.15.49:6807/2744935777","heartbeat_front_addr":"172.21.15.49:6805/2744935777","state":["exists","up"]},{"osd":1,"uuid":"80461bd9-59ef-46df-9eea-bad92d960c57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6811","nonce":1655120118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6815","nonce":1655120118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6821","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6823","nonce":1655120118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6817","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6819","nonce":1655120118}]},"public_addr":"172.21.15.49:6811/1655120118","cluster_addr":"172.21.15.49:6815/1655120118","heartbeat_back_addr":"172.21.15.49:6823/1655120118","heartbeat_front_addr":"172.21.15.49:6819/1655120118","state":["exists","up"]},{"osd":2,"uuid":"d6bf40eb-6e42-4ec9-8b3d-0b6c5a6def79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6810","nonce":3815472376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6814","nonce":3815472376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6822","nonce":3815472376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6818","nonce":3815472376}]},"public_addr":"172.21.15.49:6810/3815472376","cluster_addr":"172.21.15.49:6814/3815472376","heartbeat_back_addr":"172.21.15.49:6822/3815472376","heartbeat_front_addr":"172.21.15.49:6818/3815472376","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.641492+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.668598+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.614940+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.49:6831/849811345":"2024-03-17T07:28:29.198869+0000","172.21.15.49:0/2432003460":"2024-03-17T07:28:15.861656+0000","172.21.15.49:0/1510307741":"2024-03-17T07:28:15.861656+0000","172.21.15.49:0/593428083":"2024-03-17T07:28:15.861656+0000","172.21.15.49:0/529298837":"2024-03-17T07:28:15.861656+0000","172.21.15.49:6825/358437171":"2024-03-17T07:28:15.861656+0000","172.21.15.49:6824/358437171":"2024-03-17T07:28:15.861656+0000","172.21.15.49:0/2180583115":"2024-03-16T08:28:01.476474+0000","172.21.15.49:0/4015132922":"2024-03-17T07:28:15.861656+0000","172.21.15.49:0/1962350817":"2024-03-17T07:27:33.395329+0000","172.21.15.49:0/1244850585":"2024-03-17T07:27:33.395329+0000","172.21.15.49:0/268018280":"2024-03-17T07:27:33.395329+0000","172.21.15.49:0/4164585190":"2024-03-17T07:28:15.861656+0000","172.21.15.49:0/804373598":"2024-03-17T07:27:33.395329+0000","172.21.15.49:0/2692794410":"2024-03-17T07:28:15.861656+0000","172.21.15.49:0/3829169982":"2024-03-17T07:27:33.395329+0000","172.21.15.49:0/3802825140":"2024-03-17T07:28:15.861656+0000","172.21.15.49:0/3508188724":"2024-03-17T07:27:33.395329+0000","172.21.15.49:6832/849811345":"2024-03-17T07:28:29.198869+0000","172.21.15.49:0/2103632650":"2024-03-17T07:28:15.861656+0000","172.21.15.49:0/232434635":"2024-03-17T07:27:33.395329+0000","172.21.15.49:0/1033282597":"2024-03-17T07:27:33.395329+0000","172.21.15.49:6825/3780279566":"2024-03-17T07:27:33.395329+0000","172.21.15.49:6835/3239577766":"2024-03-17T07:28:22.222594+0000","172.21.15.49:6834/3239577766":"2024-03-17T07:28:22.222594+0000","172.21.15.49:6824/3780279566":"2024-03-17T07:27:33.395329+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T07:28:33.856 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-16T07:24:28.947521+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-16T07:28:33.856 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-16T07:28:34.162 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2024-03-16T07:28:34.174 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_mirroring.TestMirroring.test_add_directory_with_mirroring_disabled' 2024-03-16T07:28:35.540 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-03-16T07:28:35.865 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-03-16T07:28:35.865 DEBUG:teuthology.orchestra.run.smithi049:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-03-16T07:28:35.907 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-03-16T07:28:35.907 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-03-16T07:28:35.907 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-16T07:28:35.963 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056354,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497664k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=13886 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248828k,nr_inodes=812207,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497664k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2024-03-16T07:28:35.963 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-03-16T07:28:35.963 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-16T07:28:36.018 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056354,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497664k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=13886 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248828k,nr_inodes=812207,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497664k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2024-03-16T07:28:36.019 INFO:tasks.cephfs.cephfs_test_case:[, ] 2024-03-16T07:28:36.019 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T07:28:36.397 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:28:36.398 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":45,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4888,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6827/1901069637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":1901069637},{"type":"v1","addr":"172.21.15.49:6827","nonce":1901069637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30},{"gid":4891,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6829/512304085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":512304085},{"type":"v1","addr":"172.21.15.49:6829","nonce":512304085}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30},{"gid":4894,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6833/2341714657","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":2341714657},{"type":"v1","addr":"172.21.15.49:6833","nonce":2341714657}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30},{"gid":5182,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/4243678105","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":4243678105},{"type":"v1","addr":"172.21.15.49:6835","nonce":4243678105}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43},{"gid":5224,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6832/505385437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6831","nonce":505385437},{"type":"v1","addr":"172.21.15.49:6832","nonce":505385437}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":45}],"filesystems":[]} 2024-03-16T07:28:36.398 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 45 2024-03-16T07:28:36.410 INFO:tasks.ceph.mds.a:Restarting daemon 2024-03-16T07:28:36.410 INFO:tasks.ceph.mds.a:Stopping old one... 2024-03-16T07:28:36.410 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-03-16T07:28:36.411 INFO:teuthology.orchestra.run:waiting for 300 2024-03-16T07:28:36.411 INFO:tasks.ceph.mds.b:Restarting daemon 2024-03-16T07:28:36.411 INFO:tasks.ceph.mds.b:Stopping old one... 2024-03-16T07:28:36.411 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-03-16T07:28:36.411 INFO:teuthology.orchestra.run:waiting for 300 2024-03-16T07:28:36.411 INFO:tasks.ceph.mds.c:Restarting daemon 2024-03-16T07:28:36.411 INFO:tasks.ceph.mds.c:Stopping old one... 2024-03-16T07:28:36.412 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-03-16T07:28:36.412 INFO:teuthology.orchestra.run:waiting for 300 2024-03-16T07:28:36.412 INFO:tasks.ceph.mds.d:Restarting daemon 2024-03-16T07:28:36.412 INFO:tasks.ceph.mds.d:Stopping old one... 2024-03-16T07:28:36.412 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-03-16T07:28:36.412 INFO:teuthology.orchestra.run:waiting for 300 2024-03-16T07:28:36.412 INFO:tasks.ceph.mds.e:Restarting daemon 2024-03-16T07:28:36.412 INFO:tasks.ceph.mds.e:Stopping old one... 2024-03-16T07:28:36.413 DEBUG:tasks.ceph.mds.e:waiting for process to exit 2024-03-16T07:28:36.413 INFO:teuthology.orchestra.run:waiting for 300 2024-03-16T07:28:36.423 INFO:tasks.ceph.mds.a:Stopped 2024-03-16T07:28:36.424 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-03-16T07:28:36.425 INFO:tasks.ceph.mds.c:Stopped 2024-03-16T07:28:36.425 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-03-16T07:28:36.426 INFO:tasks.ceph.mds.e:Stopped 2024-03-16T07:28:36.426 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i e 2024-03-16T07:28:36.427 INFO:tasks.ceph.mds.b:Stopped 2024-03-16T07:28:36.427 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-03-16T07:28:36.428 INFO:tasks.ceph.mds.d:Stopped 2024-03-16T07:28:36.429 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-03-16T07:28:36.469 INFO:tasks.ceph.mds.a:Started 2024-03-16T07:28:36.470 INFO:tasks.ceph.mds.c:Started 2024-03-16T07:28:36.470 DEBUG:teuthology.parallel:result is None 2024-03-16T07:28:36.470 DEBUG:teuthology.parallel:result is None 2024-03-16T07:28:36.471 INFO:tasks.ceph.mds.e:Started 2024-03-16T07:28:36.471 INFO:tasks.ceph.mds.b:Started 2024-03-16T07:28:36.471 DEBUG:teuthology.parallel:result is None 2024-03-16T07:28:36.471 DEBUG:teuthology.parallel:result is None 2024-03-16T07:28:36.472 INFO:tasks.ceph.mds.d:Started 2024-03-16T07:28:36.472 DEBUG:teuthology.parallel:result is None 2024-03-16T07:28:36.472 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-03-16T07:28:36.568 INFO:tasks.ceph.mds.b.smithi049.stdout:starting mds.b at 2024-03-16T07:28:36.569 INFO:tasks.ceph.mds.d.smithi049.stdout:starting mds.d at 2024-03-16T07:28:36.581 INFO:tasks.ceph.mds.c.smithi049.stdout:starting mds.c at 2024-03-16T07:28:36.582 INFO:tasks.ceph.mds.a.smithi049.stdout:starting mds.a at 2024-03-16T07:28:36.583 INFO:tasks.ceph.mds.e.smithi049.stdout:starting mds.e at 2024-03-16T07:28:37.858 INFO:teuthology.orchestra.run.smithi049.stderr: removed all blocklist entries 2024-03-16T07:28:37.875 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-03-16T07:28:38.249 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:28:38.250 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-03-16T07:28:38.250 INFO:teuthology.orchestra.run.smithi049.stdout: "auth_dump": [ 2024-03-16T07:28:38.250 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:28:38.250 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.a", 2024-03-16T07:28:38.250 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAZSfVlKDkWLhAAVo2ZJMZSwTGLhocUPcHaUw==", 2024-03-16T07:28:38.250 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-03-16T07:28:38.250 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2024-03-16T07:28:38.250 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2024-03-16T07:28:38.250 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2024-03-16T07:28:38.250 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-03-16T07:28:38.250 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:28:38.250 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:28:38.250 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:28:38.251 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.b", 2024-03-16T07:28:38.251 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAZSfVl53IaNhAATOLh8Lzad03tyKQph1oowQ==", 2024-03-16T07:28:38.251 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-03-16T07:28:38.251 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2024-03-16T07:28:38.251 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2024-03-16T07:28:38.251 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2024-03-16T07:28:38.251 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-03-16T07:28:38.251 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:28:38.251 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:28:38.251 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:28:38.251 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.c", 2024-03-16T07:28:38.251 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAaSfVlI3p/AhAAZEetRkGlMLMEI7hMN7pS5w==", 2024-03-16T07:28:38.251 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-03-16T07:28:38.251 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2024-03-16T07:28:38.251 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2024-03-16T07:28:38.252 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2024-03-16T07:28:38.252 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-03-16T07:28:38.252 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:28:38.252 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:28:38.252 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:28:38.252 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.d", 2024-03-16T07:28:38.252 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAaSfVl3ueIChAA640lcZj8yUgH9jq7r7B+bA==", 2024-03-16T07:28:38.252 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-03-16T07:28:38.252 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2024-03-16T07:28:38.252 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2024-03-16T07:28:38.252 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2024-03-16T07:28:38.252 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-03-16T07:28:38.252 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:28:38.252 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:28:38.252 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:28:38.252 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.e", 2024-03-16T07:28:38.253 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAaSfVl8OySEhAAyF3ScxdSuQ0jhZhRbJ2gEg==", 2024-03-16T07:28:38.253 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-03-16T07:28:38.253 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2024-03-16T07:28:38.253 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2024-03-16T07:28:38.253 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2024-03-16T07:28:38.253 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-03-16T07:28:38.253 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:28:38.253 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:28:38.253 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:28:38.253 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.0", 2024-03-16T07:28:38.253 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAbSfVlNhmeKBAAVnxZbeNKU/kVViG2vb2+tQ==", 2024-03-16T07:28:38.253 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-03-16T07:28:38.253 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2024-03-16T07:28:38.253 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2024-03-16T07:28:38.253 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-03-16T07:28:38.253 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:28:38.254 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:28:38.254 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:28:38.254 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.1", 2024-03-16T07:28:38.254 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAdSfVlNNNkNhAAKhYH9tWxFT8HH6ZLMnaK7A==", 2024-03-16T07:28:38.254 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-03-16T07:28:38.254 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2024-03-16T07:28:38.254 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2024-03-16T07:28:38.254 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-03-16T07:28:38.254 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:28:38.254 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:28:38.254 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:28:38.254 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.2", 2024-03-16T07:28:38.254 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAgSfVlXJh1BxAAEOX+brDLOLTkp0thYQgMrw==", 2024-03-16T07:28:38.254 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-03-16T07:28:38.254 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2024-03-16T07:28:38.255 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2024-03-16T07:28:38.255 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-03-16T07:28:38.255 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:28:38.255 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:28:38.255 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:28:38.255 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.0", 2024-03-16T07:28:38.255 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAaSfVlmBmvGRAAaxdhkajaioVlq23dyv/g4g==", 2024-03-16T07:28:38.255 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-03-16T07:28:38.255 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2024-03-16T07:28:38.255 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow r", 2024-03-16T07:28:38.255 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-03-16T07:28:38.255 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:28:38.255 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:28:38.255 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:28:38.255 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.1", 2024-03-16T07:28:38.255 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAaSfVlCp2DHRAAdVsc+jh/QA74EBwffEqP5g==", 2024-03-16T07:28:38.255 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-03-16T07:28:38.255 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2024-03-16T07:28:38.256 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow r", 2024-03-16T07:28:38.256 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow rw", 2024-03-16T07:28:38.256 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rwx" 2024-03-16T07:28:38.256 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:28:38.256 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:28:38.256 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:28:38.256 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.admin", 2024-03-16T07:28:38.256 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAZSfVl0iRiFxAArXglVmR8MpJZNrXNv5tS7A==", 2024-03-16T07:28:38.256 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-03-16T07:28:38.256 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow *", 2024-03-16T07:28:38.256 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2024-03-16T07:28:38.256 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2024-03-16T07:28:38.256 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-03-16T07:28:38.256 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:28:38.256 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:28:38.256 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:28:38.256 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.mirror", 2024-03-16T07:28:38.257 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAaSfVldspUIRAAa1kAy23ZdMBfbhy+7HMVqA==", 2024-03-16T07:28:38.257 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-03-16T07:28:38.257 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow r", 2024-03-16T07:28:38.257 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow r", 2024-03-16T07:28:38.257 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "profile cephfs-mirror", 2024-03-16T07:28:38.257 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rw tag cephfs metadata=*, allow r tag cephfs data=*" 2024-03-16T07:28:38.257 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:28:38.257 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:28:38.257 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:28:38.257 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.mirror_remote", 2024-03-16T07:28:38.257 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAaSfVlaygzJRAAJVP9XACdC2Wikb4ZtKci9g==", 2024-03-16T07:28:38.257 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-03-16T07:28:38.257 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow rwps", 2024-03-16T07:28:38.257 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow r", 2024-03-16T07:28:38.257 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow r", 2024-03-16T07:28:38.257 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rw tag cephfs *=*" 2024-03-16T07:28:38.258 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:28:38.258 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:28:38.258 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:28:38.258 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mgr.x", 2024-03-16T07:28:38.258 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAZSfVlX9BEKhAAftDfT7+IPsQFhrTPl2h0SQ==", 2024-03-16T07:28:38.258 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-03-16T07:28:38.258 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow *", 2024-03-16T07:28:38.258 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile mgr", 2024-03-16T07:28:38.258 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-03-16T07:28:38.258 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:28:38.258 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:28:38.258 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2024-03-16T07:28:38.258 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-03-16T07:28:38.263 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T07:28:38.473 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T07:28:38.567 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:28:38.568 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":70,"fsid":"f91af061-9eac-4793-87fa-8d27ae3d242f","created":"2024-03-16T07:24:20.357868+0000","modified":"2024-03-16T07:28:37.860184+0000","last_up_change":"2024-03-16T07:24:27.474980+0000","last_in_change":"2024-03-16T07:24:21.254179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T07:24:28.947521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2df14aac-98dc-4e3c-ae7e-9eb677aa30be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6801","nonce":2744935777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6803","nonce":2744935777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6807","nonce":2744935777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6805","nonce":2744935777}]},"public_addr":"172.21.15.49:6801/2744935777","cluster_addr":"172.21.15.49:6803/2744935777","heartbeat_back_addr":"172.21.15.49:6807/2744935777","heartbeat_front_addr":"172.21.15.49:6805/2744935777","state":["exists","up"]},{"osd":1,"uuid":"80461bd9-59ef-46df-9eea-bad92d960c57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6811","nonce":1655120118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6815","nonce":1655120118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6821","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6823","nonce":1655120118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6817","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6819","nonce":1655120118}]},"public_addr":"172.21.15.49:6811/1655120118","cluster_addr":"172.21.15.49:6815/1655120118","heartbeat_back_addr":"172.21.15.49:6823/1655120118","heartbeat_front_addr":"172.21.15.49:6819/1655120118","state":["exists","up"]},{"osd":2,"uuid":"d6bf40eb-6e42-4ec9-8b3d-0b6c5a6def79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6810","nonce":3815472376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6814","nonce":3815472376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6822","nonce":3815472376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6818","nonce":3815472376}]},"public_addr":"172.21.15.49:6810/3815472376","cluster_addr":"172.21.15.49:6814/3815472376","heartbeat_back_addr":"172.21.15.49:6822/3815472376","heartbeat_front_addr":"172.21.15.49:6818/3815472376","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.641492+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.668598+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.614940+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T07:28:38.580 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-16T07:24:28.947521+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-16T07:28:38.581 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-16T07:28:38.885 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2024-03-16T07:28:38.898 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-03-16T07:28:39.205 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:28:39.205 INFO:teuthology.orchestra.run.smithi049.stdout:[ 2024-03-16T07:28:39.205 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:28:39.205 INFO:teuthology.orchestra.run.smithi049.stdout: "poolnum": 1, 2024-03-16T07:28:39.205 INFO:teuthology.orchestra.run.smithi049.stdout: "poolname": ".mgr" 2024-03-16T07:28:39.205 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:28:39.205 INFO:teuthology.orchestra.run.smithi049.stdout:] 2024-03-16T07:28:39.217 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-03-16T07:28:39.218 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-03-16T07:28:39.859 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_metadata' created 2024-03-16T07:28:39.879 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-03-16T07:28:40.862 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_data' created 2024-03-16T07:28:40.894 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-03-16T07:28:41.863 INFO:teuthology.orchestra.run.smithi049.stderr:new fs with metadata pool 12 and data pool 13 2024-03-16T07:28:41.883 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T07:28:42.188 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:28:42.188 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":73,"fsid":"f91af061-9eac-4793-87fa-8d27ae3d242f","created":"2024-03-16T07:24:20.357868+0000","modified":"2024-03-16T07:28:41.244183+0000","last_up_change":"2024-03-16T07:24:27.474980+0000","last_in_change":"2024-03-16T07:24:21.254179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T07:24:28.947521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-03-16T07:28:39.556362+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.4099999666213989,"score_stable":1.4099999666213989,"optimal_score":1,"raw_score_acting":1.4099999666213989,"raw_score_stable":1.4099999666213989,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-03-16T07:28:40.220835+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2df14aac-98dc-4e3c-ae7e-9eb677aa30be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6801","nonce":2744935777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6803","nonce":2744935777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6807","nonce":2744935777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6805","nonce":2744935777}]},"public_addr":"172.21.15.49:6801/2744935777","cluster_addr":"172.21.15.49:6803/2744935777","heartbeat_back_addr":"172.21.15.49:6807/2744935777","heartbeat_front_addr":"172.21.15.49:6805/2744935777","state":["exists","up"]},{"osd":1,"uuid":"80461bd9-59ef-46df-9eea-bad92d960c57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6811","nonce":1655120118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6815","nonce":1655120118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6821","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6823","nonce":1655120118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6817","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6819","nonce":1655120118}]},"public_addr":"172.21.15.49:6811/1655120118","cluster_addr":"172.21.15.49:6815/1655120118","heartbeat_back_addr":"172.21.15.49:6823/1655120118","heartbeat_front_addr":"172.21.15.49:6819/1655120118","state":["exists","up"]},{"osd":2,"uuid":"d6bf40eb-6e42-4ec9-8b3d-0b6c5a6def79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6810","nonce":3815472376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6814","nonce":3815472376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6822","nonce":3815472376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6818","nonce":3815472376}]},"public_addr":"172.21.15.49:6810/3815472376","cluster_addr":"172.21.15.49:6814/3815472376","heartbeat_back_addr":"172.21.15.49:6822/3815472376","heartbeat_front_addr":"172.21.15.49:6818/3815472376","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.641492+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.668598+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.614940+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T07:28:42.200 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T07:28:42.504 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:28:42.504 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":73,"fsid":"f91af061-9eac-4793-87fa-8d27ae3d242f","created":"2024-03-16T07:24:20.357868+0000","modified":"2024-03-16T07:28:41.244183+0000","last_up_change":"2024-03-16T07:24:27.474980+0000","last_in_change":"2024-03-16T07:24:21.254179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T07:24:28.947521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-03-16T07:28:39.556362+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.4099999666213989,"score_stable":1.4099999666213989,"optimal_score":1,"raw_score_acting":1.4099999666213989,"raw_score_stable":1.4099999666213989,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-03-16T07:28:40.220835+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2df14aac-98dc-4e3c-ae7e-9eb677aa30be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6801","nonce":2744935777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6803","nonce":2744935777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6807","nonce":2744935777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6805","nonce":2744935777}]},"public_addr":"172.21.15.49:6801/2744935777","cluster_addr":"172.21.15.49:6803/2744935777","heartbeat_back_addr":"172.21.15.49:6807/2744935777","heartbeat_front_addr":"172.21.15.49:6805/2744935777","state":["exists","up"]},{"osd":1,"uuid":"80461bd9-59ef-46df-9eea-bad92d960c57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6811","nonce":1655120118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6815","nonce":1655120118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6821","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6823","nonce":1655120118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6817","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6819","nonce":1655120118}]},"public_addr":"172.21.15.49:6811/1655120118","cluster_addr":"172.21.15.49:6815/1655120118","heartbeat_back_addr":"172.21.15.49:6823/1655120118","heartbeat_front_addr":"172.21.15.49:6819/1655120118","state":["exists","up"]},{"osd":2,"uuid":"d6bf40eb-6e42-4ec9-8b3d-0b6c5a6def79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6810","nonce":3815472376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6814","nonce":3815472376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6822","nonce":3815472376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6818","nonce":3815472376}]},"public_addr":"172.21.15.49:6810/3815472376","cluster_addr":"172.21.15.49:6814/3815472376","heartbeat_back_addr":"172.21.15.49:6822/3815472376","heartbeat_front_addr":"172.21.15.49:6818/3815472376","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.641492+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.668598+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.614940+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T07:28:42.517 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-03-16T07:28:43.880 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-03-16T07:28:43.881 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-03-16T07:28:44.883 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-03-16T07:28:44.883 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T07:28:45.299 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:28:45.299 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":51,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5259,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6827/3159374847","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":3159374847},{"type":"v1","addr":"172.21.15.49:6827","nonce":3159374847}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":46},{"gid":5260,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6829/626442568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":626442568},{"type":"v1","addr":"172.21.15.49:6829","nonce":626442568}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":46},{"gid":5267,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6831/3455133872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":3455133872},{"type":"v1","addr":"172.21.15.49:6831","nonce":3455133872}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":46},{"gid":5268,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6833/1067362108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":1067362108},{"type":"v1","addr":"172.21.15.49:6833","nonce":1067362108}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":46}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-16T07:28:41.244463+0000","modified":"2024-03-16T07:28:44.360549+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5269":{"gid":5269,"name":"e","rank":0,"incarnation":47,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6835/647809721","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":647809721},{"type":"v1","addr":"172.21.15.49:6835","nonce":647809721}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5269,"qdb_cluster":[5269]},"id":6}]} 2024-03-16T07:28:45.299 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 51 2024-03-16T07:28:45.316 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T07:28:45.619 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:28:45.620 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":74,"fsid":"f91af061-9eac-4793-87fa-8d27ae3d242f","created":"2024-03-16T07:24:20.357868+0000","modified":"2024-03-16T07:28:42.558288+0000","last_up_change":"2024-03-16T07:24:27.474980+0000","last_in_change":"2024-03-16T07:24:21.254179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T07:24:28.947521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-03-16T07:28:39.556362+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.4099999666213989,"score_stable":1.4099999666213989,"optimal_score":1,"raw_score_acting":1.4099999666213989,"raw_score_stable":1.4099999666213989,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-03-16T07:28:40.220835+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2df14aac-98dc-4e3c-ae7e-9eb677aa30be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6801","nonce":2744935777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6803","nonce":2744935777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6807","nonce":2744935777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6805","nonce":2744935777}]},"public_addr":"172.21.15.49:6801/2744935777","cluster_addr":"172.21.15.49:6803/2744935777","heartbeat_back_addr":"172.21.15.49:6807/2744935777","heartbeat_front_addr":"172.21.15.49:6805/2744935777","state":["exists","up"]},{"osd":1,"uuid":"80461bd9-59ef-46df-9eea-bad92d960c57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6811","nonce":1655120118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6815","nonce":1655120118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6821","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6823","nonce":1655120118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6817","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6819","nonce":1655120118}]},"public_addr":"172.21.15.49:6811/1655120118","cluster_addr":"172.21.15.49:6815/1655120118","heartbeat_back_addr":"172.21.15.49:6823/1655120118","heartbeat_front_addr":"172.21.15.49:6819/1655120118","state":["exists","up"]},{"osd":2,"uuid":"d6bf40eb-6e42-4ec9-8b3d-0b6c5a6def79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6810","nonce":3815472376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6814","nonce":3815472376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6822","nonce":3815472376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6818","nonce":3815472376}]},"public_addr":"172.21.15.49:6810/3815472376","cluster_addr":"172.21.15.49:6814/3815472376","heartbeat_back_addr":"172.21.15.49:6822/3815472376","heartbeat_front_addr":"172.21.15.49:6818/3815472376","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.641492+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.668598+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.614940+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T07:28:45.636 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-03-16T07:28:45.636 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-16T07:28:45.946 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:28:45.948 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2024-03-16T07:28:45.960 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":34,"stamp":"2024-03-16T07:28:45.890215+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591166,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":490,"num_read_kb":915,"num_write":250,"num_write_kb":1905,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":170,"ondisk_log_size":170,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":314572800,"kb_used":96848,"kb_used_data":3288,"kb_used_omap":4,"kb_used_meta":93499,"kb_avail":314475952,"statfs":{"total":322122547200,"available":322023374848,"internally_reserved":0,"allocated":3366912,"data_stored":2038522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":95743311},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":798,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001054"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.586322+0000","last_change":"2024-03-16T07:28:41.584717+0000","last_active":"2024-03-16T07:28:41.586322+0000","last_peered":"2024-03-16T07:28:41.586322+0000","last_clean":"2024-03-16T07:28:41.586322+0000","last_became_active":"2024-03-16T07:28:41.582095+0000","last_became_peered":"2024-03-16T07:28:41.582095+0000","last_unstale":"2024-03-16T07:28:41.586322+0000","last_undegraded":"2024-03-16T07:28:41.586322+0000","last_fullsized":"2024-03-16T07:28:41.586322+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:41:15.356053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.582151+0000","last_change":"2024-03-16T07:28:41.581340+0000","last_active":"2024-03-16T07:28:41.582151+0000","last_peered":"2024-03-16T07:28:41.582151+0000","last_clean":"2024-03-16T07:28:41.582151+0000","last_became_active":"2024-03-16T07:28:41.580857+0000","last_became_peered":"2024-03-16T07:28:41.580857+0000","last_unstale":"2024-03-16T07:28:41.582151+0000","last_undegraded":"2024-03-16T07:28:41.582151+0000","last_fullsized":"2024-03-16T07:28:41.582151+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:08:14.215455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.575831+0000","last_change":"2024-03-16T07:28:41.571483+0000","last_active":"2024-03-16T07:28:41.575831+0000","last_peered":"2024-03-16T07:28:41.575831+0000","last_clean":"2024-03-16T07:28:41.575831+0000","last_became_active":"2024-03-16T07:28:41.571155+0000","last_became_peered":"2024-03-16T07:28:41.571155+0000","last_unstale":"2024-03-16T07:28:41.575831+0000","last_undegraded":"2024-03-16T07:28:41.575831+0000","last_fullsized":"2024-03-16T07:28:41.575831+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:06:30.085366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.575749+0000","last_change":"2024-03-16T07:28:41.573044+0000","last_active":"2024-03-16T07:28:41.575749+0000","last_peered":"2024-03-16T07:28:41.575749+0000","last_clean":"2024-03-16T07:28:41.575749+0000","last_became_active":"2024-03-16T07:28:41.572405+0000","last_became_peered":"2024-03-16T07:28:41.572405+0000","last_unstale":"2024-03-16T07:28:41.575749+0000","last_undegraded":"2024-03-16T07:28:41.575749+0000","last_fullsized":"2024-03-16T07:28:41.575749+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:03:27.209411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.576420+0000","last_change":"2024-03-16T07:28:41.574275+0000","last_active":"2024-03-16T07:28:41.576420+0000","last_peered":"2024-03-16T07:28:41.576420+0000","last_clean":"2024-03-16T07:28:41.576420+0000","last_became_active":"2024-03-16T07:28:41.572254+0000","last_became_peered":"2024-03-16T07:28:41.572254+0000","last_unstale":"2024-03-16T07:28:41.576420+0000","last_undegraded":"2024-03-16T07:28:41.576420+0000","last_fullsized":"2024-03-16T07:28:41.576420+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:37:56.085909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.575661+0000","last_change":"2024-03-16T07:28:41.571823+0000","last_active":"2024-03-16T07:28:41.575661+0000","last_peered":"2024-03-16T07:28:41.575661+0000","last_clean":"2024-03-16T07:28:41.575661+0000","last_became_active":"2024-03-16T07:28:41.571384+0000","last_became_peered":"2024-03-16T07:28:41.571384+0000","last_unstale":"2024-03-16T07:28:41.575661+0000","last_undegraded":"2024-03-16T07:28:41.575661+0000","last_fullsized":"2024-03-16T07:28:41.575661+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:18:39.708516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.577234+0000","last_change":"2024-03-16T07:28:41.575572+0000","last_active":"2024-03-16T07:28:41.577234+0000","last_peered":"2024-03-16T07:28:41.577234+0000","last_clean":"2024-03-16T07:28:41.577234+0000","last_became_active":"2024-03-16T07:28:41.574604+0000","last_became_peered":"2024-03-16T07:28:41.574604+0000","last_unstale":"2024-03-16T07:28:41.577234+0000","last_undegraded":"2024-03-16T07:28:41.577234+0000","last_fullsized":"2024-03-16T07:28:41.577234+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:22:34.129441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.588376+0000","last_change":"2024-03-16T07:28:41.587931+0000","last_active":"2024-03-16T07:28:41.588376+0000","last_peered":"2024-03-16T07:28:41.588376+0000","last_clean":"2024-03-16T07:28:41.588376+0000","last_became_active":"2024-03-16T07:28:41.587665+0000","last_became_peered":"2024-03-16T07:28:41.587665+0000","last_unstale":"2024-03-16T07:28:41.588376+0000","last_undegraded":"2024-03-16T07:28:41.588376+0000","last_fullsized":"2024-03-16T07:28:41.588376+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:28:19.073163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.588033+0000","last_change":"2024-03-16T07:28:41.586380+0000","last_active":"2024-03-16T07:28:41.588033+0000","last_peered":"2024-03-16T07:28:41.588033+0000","last_clean":"2024-03-16T07:28:41.588033+0000","last_became_active":"2024-03-16T07:28:41.586099+0000","last_became_peered":"2024-03-16T07:28:41.586099+0000","last_unstale":"2024-03-16T07:28:41.588033+0000","last_undegraded":"2024-03-16T07:28:41.588033+0000","last_fullsized":"2024-03-16T07:28:41.588033+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:52:07.913753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.575497+0000","last_change":"2024-03-16T07:28:41.573336+0000","last_active":"2024-03-16T07:28:41.575497+0000","last_peered":"2024-03-16T07:28:41.575497+0000","last_clean":"2024-03-16T07:28:41.575497+0000","last_became_active":"2024-03-16T07:28:41.573117+0000","last_became_peered":"2024-03-16T07:28:41.573117+0000","last_unstale":"2024-03-16T07:28:41.575497+0000","last_undegraded":"2024-03-16T07:28:41.575497+0000","last_fullsized":"2024-03-16T07:28:41.575497+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:31:17.966399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.582123+0000","last_change":"2024-03-16T07:28:41.581320+0000","last_active":"2024-03-16T07:28:41.582123+0000","last_peered":"2024-03-16T07:28:41.582123+0000","last_clean":"2024-03-16T07:28:41.582123+0000","last_became_active":"2024-03-16T07:28:41.581060+0000","last_became_peered":"2024-03-16T07:28:41.581060+0000","last_unstale":"2024-03-16T07:28:41.582123+0000","last_undegraded":"2024-03-16T07:28:41.582123+0000","last_fullsized":"2024-03-16T07:28:41.582123+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:45:53.674282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.587924+0000","last_change":"2024-03-16T07:28:41.587377+0000","last_active":"2024-03-16T07:28:41.587924+0000","last_peered":"2024-03-16T07:28:41.587924+0000","last_clean":"2024-03-16T07:28:41.587924+0000","last_became_active":"2024-03-16T07:28:41.586980+0000","last_became_peered":"2024-03-16T07:28:41.586980+0000","last_unstale":"2024-03-16T07:28:41.587924+0000","last_undegraded":"2024-03-16T07:28:41.587924+0000","last_fullsized":"2024-03-16T07:28:41.587924+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:49:39.237111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.579892+0000","last_change":"2024-03-16T07:28:41.579054+0000","last_active":"2024-03-16T07:28:41.579892+0000","last_peered":"2024-03-16T07:28:41.579892+0000","last_clean":"2024-03-16T07:28:41.579892+0000","last_became_active":"2024-03-16T07:28:41.578801+0000","last_became_peered":"2024-03-16T07:28:41.578801+0000","last_unstale":"2024-03-16T07:28:41.579892+0000","last_undegraded":"2024-03-16T07:28:41.579892+0000","last_fullsized":"2024-03-16T07:28:41.579892+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:20:11.138916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.576983+0000","last_change":"2024-03-16T07:28:41.576077+0000","last_active":"2024-03-16T07:28:41.576983+0000","last_peered":"2024-03-16T07:28:41.576983+0000","last_clean":"2024-03-16T07:28:41.576983+0000","last_became_active":"2024-03-16T07:28:41.575830+0000","last_became_peered":"2024-03-16T07:28:41.575830+0000","last_unstale":"2024-03-16T07:28:41.576983+0000","last_undegraded":"2024-03-16T07:28:41.576983+0000","last_fullsized":"2024-03-16T07:28:41.576983+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:51:02.351017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.585899+0000","last_change":"2024-03-16T07:28:41.585018+0000","last_active":"2024-03-16T07:28:41.585899+0000","last_peered":"2024-03-16T07:28:41.585899+0000","last_clean":"2024-03-16T07:28:41.585899+0000","last_became_active":"2024-03-16T07:28:41.584767+0000","last_became_peered":"2024-03-16T07:28:41.584767+0000","last_unstale":"2024-03-16T07:28:41.585899+0000","last_undegraded":"2024-03-16T07:28:41.585899+0000","last_fullsized":"2024-03-16T07:28:41.585899+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:06:30.085366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.580753+0000","last_change":"2024-03-16T07:28:41.579446+0000","last_active":"2024-03-16T07:28:41.580753+0000","last_peered":"2024-03-16T07:28:41.580753+0000","last_clean":"2024-03-16T07:28:41.580753+0000","last_became_active":"2024-03-16T07:28:41.579222+0000","last_became_peered":"2024-03-16T07:28:41.579222+0000","last_unstale":"2024-03-16T07:28:41.580753+0000","last_undegraded":"2024-03-16T07:28:41.580753+0000","last_fullsized":"2024-03-16T07:28:41.580753+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:12:10.158550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.576132+0000","last_change":"2024-03-16T07:28:41.575562+0000","last_active":"2024-03-16T07:28:41.576132+0000","last_peered":"2024-03-16T07:28:41.576132+0000","last_clean":"2024-03-16T07:28:41.576132+0000","last_became_active":"2024-03-16T07:28:41.574861+0000","last_became_peered":"2024-03-16T07:28:41.574861+0000","last_unstale":"2024-03-16T07:28:41.576132+0000","last_undegraded":"2024-03-16T07:28:41.576132+0000","last_fullsized":"2024-03-16T07:28:41.576132+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:27:19.086279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.575478+0000","last_change":"2024-03-16T07:28:41.573236+0000","last_active":"2024-03-16T07:28:41.575478+0000","last_peered":"2024-03-16T07:28:41.575478+0000","last_clean":"2024-03-16T07:28:41.575478+0000","last_became_active":"2024-03-16T07:28:41.572821+0000","last_became_peered":"2024-03-16T07:28:41.572821+0000","last_unstale":"2024-03-16T07:28:41.575478+0000","last_undegraded":"2024-03-16T07:28:41.575478+0000","last_fullsized":"2024-03-16T07:28:41.575478+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:57:26.350308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.578183+0000","last_change":"2024-03-16T07:28:41.576503+0000","last_active":"2024-03-16T07:28:41.578183+0000","last_peered":"2024-03-16T07:28:41.578183+0000","last_clean":"2024-03-16T07:28:41.578183+0000","last_became_active":"2024-03-16T07:28:41.576209+0000","last_became_peered":"2024-03-16T07:28:41.576209+0000","last_unstale":"2024-03-16T07:28:41.578183+0000","last_undegraded":"2024-03-16T07:28:41.578183+0000","last_fullsized":"2024-03-16T07:28:41.578183+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:26:04.808962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.582992+0000","last_change":"2024-03-16T07:28:41.580683+0000","last_active":"2024-03-16T07:28:41.582992+0000","last_peered":"2024-03-16T07:28:41.582992+0000","last_clean":"2024-03-16T07:28:41.582992+0000","last_became_active":"2024-03-16T07:28:41.580015+0000","last_became_peered":"2024-03-16T07:28:41.580015+0000","last_unstale":"2024-03-16T07:28:41.582992+0000","last_undegraded":"2024-03-16T07:28:41.582992+0000","last_fullsized":"2024-03-16T07:28:41.582992+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:44:44.566786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.575939+0000","last_change":"2024-03-16T07:28:41.574346+0000","last_active":"2024-03-16T07:28:41.575939+0000","last_peered":"2024-03-16T07:28:41.575939+0000","last_clean":"2024-03-16T07:28:41.575939+0000","last_became_active":"2024-03-16T07:28:41.572788+0000","last_became_peered":"2024-03-16T07:28:41.572788+0000","last_unstale":"2024-03-16T07:28:41.575939+0000","last_undegraded":"2024-03-16T07:28:41.575939+0000","last_fullsized":"2024-03-16T07:28:41.575939+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:19:25.780587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.586845+0000","last_change":"2024-03-16T07:28:41.585789+0000","last_active":"2024-03-16T07:28:41.586845+0000","last_peered":"2024-03-16T07:28:41.586845+0000","last_clean":"2024-03-16T07:28:41.586845+0000","last_became_active":"2024-03-16T07:28:41.585253+0000","last_became_peered":"2024-03-16T07:28:41.585253+0000","last_unstale":"2024-03-16T07:28:41.586845+0000","last_undegraded":"2024-03-16T07:28:41.586845+0000","last_fullsized":"2024-03-16T07:28:41.586845+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:29:37.170019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.583375+0000","last_change":"2024-03-16T07:28:41.580659+0000","last_active":"2024-03-16T07:28:41.583375+0000","last_peered":"2024-03-16T07:28:41.583375+0000","last_clean":"2024-03-16T07:28:41.583375+0000","last_became_active":"2024-03-16T07:28:41.580236+0000","last_became_peered":"2024-03-16T07:28:41.580236+0000","last_unstale":"2024-03-16T07:28:41.583375+0000","last_undegraded":"2024-03-16T07:28:41.583375+0000","last_fullsized":"2024-03-16T07:28:41.583375+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:52:07.322808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.578781+0000","last_change":"2024-03-16T07:28:41.578066+0000","last_active":"2024-03-16T07:28:41.578781+0000","last_peered":"2024-03-16T07:28:41.578781+0000","last_clean":"2024-03-16T07:28:41.578781+0000","last_became_active":"2024-03-16T07:28:41.577559+0000","last_became_peered":"2024-03-16T07:28:41.577559+0000","last_unstale":"2024-03-16T07:28:41.578781+0000","last_undegraded":"2024-03-16T07:28:41.578781+0000","last_fullsized":"2024-03-16T07:28:41.578781+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:30:35.704161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.587491+0000","last_change":"2024-03-16T07:28:41.586201+0000","last_active":"2024-03-16T07:28:41.587491+0000","last_peered":"2024-03-16T07:28:41.587491+0000","last_clean":"2024-03-16T07:28:41.587491+0000","last_became_active":"2024-03-16T07:28:41.585957+0000","last_became_peered":"2024-03-16T07:28:41.585957+0000","last_unstale":"2024-03-16T07:28:41.587491+0000","last_undegraded":"2024-03-16T07:28:41.587491+0000","last_fullsized":"2024-03-16T07:28:41.587491+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:03:27.209411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.585875+0000","last_change":"2024-03-16T07:28:41.584462+0000","last_active":"2024-03-16T07:28:41.585875+0000","last_peered":"2024-03-16T07:28:41.585875+0000","last_clean":"2024-03-16T07:28:41.585875+0000","last_became_active":"2024-03-16T07:28:41.583131+0000","last_became_peered":"2024-03-16T07:28:41.583131+0000","last_unstale":"2024-03-16T07:28:41.585875+0000","last_undegraded":"2024-03-16T07:28:41.585875+0000","last_fullsized":"2024-03-16T07:28:41.585875+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:43:25.008688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.575866+0000","last_change":"2024-03-16T07:28:41.574267+0000","last_active":"2024-03-16T07:28:41.575866+0000","last_peered":"2024-03-16T07:28:41.575866+0000","last_clean":"2024-03-16T07:28:41.575866+0000","last_became_active":"2024-03-16T07:28:41.573063+0000","last_became_peered":"2024-03-16T07:28:41.573063+0000","last_unstale":"2024-03-16T07:28:41.575866+0000","last_undegraded":"2024-03-16T07:28:41.575866+0000","last_fullsized":"2024-03-16T07:28:41.575866+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:09:05.453250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.582880+0000","last_change":"2024-03-16T07:28:41.581852+0000","last_active":"2024-03-16T07:28:41.582880+0000","last_peered":"2024-03-16T07:28:41.582880+0000","last_clean":"2024-03-16T07:28:41.582880+0000","last_became_active":"2024-03-16T07:28:41.581577+0000","last_became_peered":"2024-03-16T07:28:41.581577+0000","last_unstale":"2024-03-16T07:28:41.582880+0000","last_undegraded":"2024-03-16T07:28:41.582880+0000","last_fullsized":"2024-03-16T07:28:41.582880+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:54:32.776648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.584829+0000","last_change":"2024-03-16T07:28:41.582852+0000","last_active":"2024-03-16T07:28:41.584829+0000","last_peered":"2024-03-16T07:28:41.584829+0000","last_clean":"2024-03-16T07:28:41.584829+0000","last_became_active":"2024-03-16T07:28:41.582617+0000","last_became_peered":"2024-03-16T07:28:41.582617+0000","last_unstale":"2024-03-16T07:28:41.584829+0000","last_undegraded":"2024-03-16T07:28:41.584829+0000","last_fullsized":"2024-03-16T07:28:41.584829+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:07:42.637683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.585445+0000","last_change":"2024-03-16T07:28:41.583248+0000","last_active":"2024-03-16T07:28:41.585445+0000","last_peered":"2024-03-16T07:28:41.585445+0000","last_clean":"2024-03-16T07:28:41.585445+0000","last_became_active":"2024-03-16T07:28:41.582850+0000","last_became_peered":"2024-03-16T07:28:41.582850+0000","last_unstale":"2024-03-16T07:28:41.585445+0000","last_undegraded":"2024-03-16T07:28:41.585445+0000","last_fullsized":"2024-03-16T07:28:41.585445+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:21:44.749802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.577216+0000","last_change":"2024-03-16T07:28:41.574835+0000","last_active":"2024-03-16T07:28:41.577216+0000","last_peered":"2024-03-16T07:28:41.577216+0000","last_clean":"2024-03-16T07:28:41.577216+0000","last_became_active":"2024-03-16T07:28:41.574293+0000","last_became_peered":"2024-03-16T07:28:41.574293+0000","last_unstale":"2024-03-16T07:28:41.577216+0000","last_undegraded":"2024-03-16T07:28:41.577216+0000","last_fullsized":"2024-03-16T07:28:41.577216+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:17:45.831164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.578762+0000","last_change":"2024-03-16T07:28:41.577793+0000","last_active":"2024-03-16T07:28:41.578762+0000","last_peered":"2024-03-16T07:28:41.578762+0000","last_clean":"2024-03-16T07:28:41.578762+0000","last_became_active":"2024-03-16T07:28:41.577243+0000","last_became_peered":"2024-03-16T07:28:41.577243+0000","last_unstale":"2024-03-16T07:28:41.578762+0000","last_undegraded":"2024-03-16T07:28:41.578762+0000","last_fullsized":"2024-03-16T07:28:41.578762+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:39:46.941392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.581299+0000","last_change":"2024-03-16T07:28:41.579444+0000","last_active":"2024-03-16T07:28:41.581299+0000","last_peered":"2024-03-16T07:28:41.581299+0000","last_clean":"2024-03-16T07:28:41.581299+0000","last_became_active":"2024-03-16T07:28:41.579180+0000","last_became_peered":"2024-03-16T07:28:41.579180+0000","last_unstale":"2024-03-16T07:28:41.581299+0000","last_undegraded":"2024-03-16T07:28:41.581299+0000","last_fullsized":"2024-03-16T07:28:41.581299+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:27:57.425323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"73'4","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.875760+0000","last_change":"2024-03-16T07:28:40.884571+0000","last_active":"2024-03-16T07:28:41.875760+0000","last_peered":"2024-03-16T07:28:41.875760+0000","last_clean":"2024-03-16T07:28:41.875760+0000","last_became_active":"2024-03-16T07:28:40.884044+0000","last_became_peered":"2024-03-16T07:28:40.884044+0000","last_unstale":"2024-03-16T07:28:41.875760+0000","last_undegraded":"2024-03-16T07:28:41.875760+0000","last_fullsized":"2024-03-16T07:28:41.875760+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_clean_scrub_stamp":"2024-03-16T07:28:39.861342+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:05:55.028514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.586340+0000","last_change":"2024-03-16T07:28:41.584924+0000","last_active":"2024-03-16T07:28:41.586340+0000","last_peered":"2024-03-16T07:28:41.586340+0000","last_clean":"2024-03-16T07:28:41.586340+0000","last_became_active":"2024-03-16T07:28:41.583141+0000","last_became_peered":"2024-03-16T07:28:41.583141+0000","last_unstale":"2024-03-16T07:28:41.586340+0000","last_undegraded":"2024-03-16T07:28:41.586340+0000","last_fullsized":"2024-03-16T07:28:41.586340+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:00:45.561416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1e","version":"73'1","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.873315+0000","last_change":"2024-03-16T07:28:40.880780+0000","last_active":"2024-03-16T07:28:41.873315+0000","last_peered":"2024-03-16T07:28:41.873315+0000","last_clean":"2024-03-16T07:28:41.873315+0000","last_became_active":"2024-03-16T07:28:40.880529+0000","last_became_peered":"2024-03-16T07:28:40.880529+0000","last_unstale":"2024-03-16T07:28:41.873315+0000","last_undegraded":"2024-03-16T07:28:41.873315+0000","last_fullsized":"2024-03-16T07:28:41.873315+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_clean_scrub_stamp":"2024-03-16T07:28:39.861342+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:11:38.794188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.587905+0000","last_change":"2024-03-16T07:28:41.587228+0000","last_active":"2024-03-16T07:28:41.587905+0000","last_peered":"2024-03-16T07:28:41.587905+0000","last_clean":"2024-03-16T07:28:41.587905+0000","last_became_active":"2024-03-16T07:28:41.586930+0000","last_became_peered":"2024-03-16T07:28:41.586930+0000","last_unstale":"2024-03-16T07:28:41.587905+0000","last_undegraded":"2024-03-16T07:28:41.587905+0000","last_fullsized":"2024-03-16T07:28:41.587905+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:54:36.142881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1d","version":"73'2","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.873769+0000","last_change":"2024-03-16T07:28:40.889280+0000","last_active":"2024-03-16T07:28:41.873769+0000","last_peered":"2024-03-16T07:28:41.873769+0000","last_clean":"2024-03-16T07:28:41.873769+0000","last_became_active":"2024-03-16T07:28:40.889014+0000","last_became_peered":"2024-03-16T07:28:40.889014+0000","last_unstale":"2024-03-16T07:28:41.873769+0000","last_undegraded":"2024-03-16T07:28:41.873769+0000","last_fullsized":"2024-03-16T07:28:41.873769+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_clean_scrub_stamp":"2024-03-16T07:28:39.861342+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:30:34.345858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.574662+0000","last_change":"2024-03-16T07:28:41.574130+0000","last_active":"2024-03-16T07:28:41.574662+0000","last_peered":"2024-03-16T07:28:41.574662+0000","last_clean":"2024-03-16T07:28:41.574662+0000","last_became_active":"2024-03-16T07:28:41.573863+0000","last_became_peered":"2024-03-16T07:28:41.573863+0000","last_unstale":"2024-03-16T07:28:41.574662+0000","last_undegraded":"2024-03-16T07:28:41.574662+0000","last_fullsized":"2024-03-16T07:28:41.574662+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:41:47.127439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.574574+0000","last_change":"2024-03-16T07:28:40.890321+0000","last_active":"2024-03-16T07:28:41.574574+0000","last_peered":"2024-03-16T07:28:41.574574+0000","last_clean":"2024-03-16T07:28:41.574574+0000","last_became_active":"2024-03-16T07:28:40.888214+0000","last_became_peered":"2024-03-16T07:28:40.888214+0000","last_unstale":"2024-03-16T07:28:41.574574+0000","last_undegraded":"2024-03-16T07:28:41.574574+0000","last_fullsized":"2024-03-16T07:28:41.574574+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_clean_scrub_stamp":"2024-03-16T07:28:39.861342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:59:34.630341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.584530+0000","last_change":"2024-03-16T07:28:41.583111+0000","last_active":"2024-03-16T07:28:41.584530+0000","last_peered":"2024-03-16T07:28:41.584530+0000","last_clean":"2024-03-16T07:28:41.584530+0000","last_became_active":"2024-03-16T07:28:41.582554+0000","last_became_peered":"2024-03-16T07:28:41.582554+0000","last_unstale":"2024-03-16T07:28:41.584530+0000","last_undegraded":"2024-03-16T07:28:41.584530+0000","last_fullsized":"2024-03-16T07:28:41.584530+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:14:41.329632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"73'1","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.874365+0000","last_change":"2024-03-16T07:28:40.884283+0000","last_active":"2024-03-16T07:28:41.874365+0000","last_peered":"2024-03-16T07:28:41.874365+0000","last_clean":"2024-03-16T07:28:41.874365+0000","last_became_active":"2024-03-16T07:28:40.884015+0000","last_became_peered":"2024-03-16T07:28:40.884015+0000","last_unstale":"2024-03-16T07:28:41.874365+0000","last_undegraded":"2024-03-16T07:28:41.874365+0000","last_fullsized":"2024-03-16T07:28:41.874365+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_clean_scrub_stamp":"2024-03-16T07:28:39.861342+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:27:57.241790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.575922+0000","last_change":"2024-03-16T07:28:41.573219+0000","last_active":"2024-03-16T07:28:41.575922+0000","last_peered":"2024-03-16T07:28:41.575922+0000","last_clean":"2024-03-16T07:28:41.575922+0000","last_became_active":"2024-03-16T07:28:41.572483+0000","last_became_peered":"2024-03-16T07:28:41.572483+0000","last_unstale":"2024-03-16T07:28:41.575922+0000","last_undegraded":"2024-03-16T07:28:41.575922+0000","last_fullsized":"2024-03-16T07:28:41.575922+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:52:07.913753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.1a","version":"73'1","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.873085+0000","last_change":"2024-03-16T07:28:40.878927+0000","last_active":"2024-03-16T07:28:41.873085+0000","last_peered":"2024-03-16T07:28:41.873085+0000","last_clean":"2024-03-16T07:28:41.873085+0000","last_became_active":"2024-03-16T07:28:40.878669+0000","last_became_peered":"2024-03-16T07:28:40.878669+0000","last_unstale":"2024-03-16T07:28:41.873085+0000","last_undegraded":"2024-03-16T07:28:41.873085+0000","last_fullsized":"2024-03-16T07:28:41.873085+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_clean_scrub_stamp":"2024-03-16T07:28:39.861342+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:51:58.338500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.585928+0000","last_change":"2024-03-16T07:28:41.585134+0000","last_active":"2024-03-16T07:28:41.585928+0000","last_peered":"2024-03-16T07:28:41.585928+0000","last_clean":"2024-03-16T07:28:41.585928+0000","last_became_active":"2024-03-16T07:28:41.584887+0000","last_became_peered":"2024-03-16T07:28:41.584887+0000","last_unstale":"2024-03-16T07:28:41.585928+0000","last_undegraded":"2024-03-16T07:28:41.585928+0000","last_fullsized":"2024-03-16T07:28:41.585928+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:39:54.396263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.569735+0000","last_change":"2024-03-16T07:28:40.890932+0000","last_active":"2024-03-16T07:28:41.569735+0000","last_peered":"2024-03-16T07:28:41.569735+0000","last_clean":"2024-03-16T07:28:41.569735+0000","last_became_active":"2024-03-16T07:28:40.890340+0000","last_became_peered":"2024-03-16T07:28:40.890340+0000","last_unstale":"2024-03-16T07:28:41.569735+0000","last_undegraded":"2024-03-16T07:28:41.569735+0000","last_fullsized":"2024-03-16T07:28:41.569735+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_clean_scrub_stamp":"2024-03-16T07:28:39.861342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:54:35.284150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.577837+0000","last_change":"2024-03-16T07:28:41.577102+0000","last_active":"2024-03-16T07:28:41.577837+0000","last_peered":"2024-03-16T07:28:41.577837+0000","last_clean":"2024-03-16T07:28:41.577837+0000","last_became_active":"2024-03-16T07:28:41.576845+0000","last_became_peered":"2024-03-16T07:28:41.576845+0000","last_unstale":"2024-03-16T07:28:41.577837+0000","last_undegraded":"2024-03-16T07:28:41.577837+0000","last_fullsized":"2024-03-16T07:28:41.577837+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:46:18.244213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.565580+0000","last_change":"2024-03-16T07:28:40.883138+0000","last_active":"2024-03-16T07:28:41.565580+0000","last_peered":"2024-03-16T07:28:41.565580+0000","last_clean":"2024-03-16T07:28:41.565580+0000","last_became_active":"2024-03-16T07:28:40.882873+0000","last_became_peered":"2024-03-16T07:28:40.882873+0000","last_unstale":"2024-03-16T07:28:41.565580+0000","last_undegraded":"2024-03-16T07:28:41.565580+0000","last_fullsized":"2024-03-16T07:28:41.565580+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_clean_scrub_stamp":"2024-03-16T07:28:39.861342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:50:03.695566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.587446+0000","last_change":"2024-03-16T07:28:41.586728+0000","last_active":"2024-03-16T07:28:41.587446+0000","last_peered":"2024-03-16T07:28:41.587446+0000","last_clean":"2024-03-16T07:28:41.587446+0000","last_became_active":"2024-03-16T07:28:41.586429+0000","last_became_peered":"2024-03-16T07:28:41.586429+0000","last_unstale":"2024-03-16T07:28:41.587446+0000","last_undegraded":"2024-03-16T07:28:41.587446+0000","last_fullsized":"2024-03-16T07:28:41.587446+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:13:48.908105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.566967+0000","last_change":"2024-03-16T07:28:40.887890+0000","last_active":"2024-03-16T07:28:41.566967+0000","last_peered":"2024-03-16T07:28:41.566967+0000","last_clean":"2024-03-16T07:28:41.566967+0000","last_became_active":"2024-03-16T07:28:40.887271+0000","last_became_peered":"2024-03-16T07:28:40.887271+0000","last_unstale":"2024-03-16T07:28:41.566967+0000","last_undegraded":"2024-03-16T07:28:41.566967+0000","last_fullsized":"2024-03-16T07:28:41.566967+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_clean_scrub_stamp":"2024-03-16T07:28:39.861342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:57:30.494001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.586304+0000","last_change":"2024-03-16T07:28:41.584498+0000","last_active":"2024-03-16T07:28:41.586304+0000","last_peered":"2024-03-16T07:28:41.586304+0000","last_clean":"2024-03-16T07:28:41.586304+0000","last_became_active":"2024-03-16T07:28:41.581697+0000","last_became_peered":"2024-03-16T07:28:41.581697+0000","last_unstale":"2024-03-16T07:28:41.586304+0000","last_undegraded":"2024-03-16T07:28:41.586304+0000","last_fullsized":"2024-03-16T07:28:41.586304+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:23:47.665187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.560534+0000","last_change":"2024-03-16T07:28:40.886362+0000","last_active":"2024-03-16T07:28:41.560534+0000","last_peered":"2024-03-16T07:28:41.560534+0000","last_clean":"2024-03-16T07:28:41.560534+0000","last_became_active":"2024-03-16T07:28:40.886129+0000","last_became_peered":"2024-03-16T07:28:40.886129+0000","last_unstale":"2024-03-16T07:28:41.560534+0000","last_undegraded":"2024-03-16T07:28:41.560534+0000","last_fullsized":"2024-03-16T07:28:41.560534+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_clean_scrub_stamp":"2024-03-16T07:28:39.861342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:42:48.723986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.587660+0000","last_change":"2024-03-16T07:28:41.587165+0000","last_active":"2024-03-16T07:28:41.587660+0000","last_peered":"2024-03-16T07:28:41.587660+0000","last_clean":"2024-03-16T07:28:41.587660+0000","last_became_active":"2024-03-16T07:28:41.586578+0000","last_became_peered":"2024-03-16T07:28:41.586578+0000","last_unstale":"2024-03-16T07:28:41.587660+0000","last_undegraded":"2024-03-16T07:28:41.587660+0000","last_fullsized":"2024-03-16T07:28:41.587660+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:12:22.482264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"73'3","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.875371+0000","last_change":"2024-03-16T07:28:40.885939+0000","last_active":"2024-03-16T07:28:41.875371+0000","last_peered":"2024-03-16T07:28:41.875371+0000","last_clean":"2024-03-16T07:28:41.875371+0000","last_became_active":"2024-03-16T07:28:40.885668+0000","last_became_peered":"2024-03-16T07:28:40.885668+0000","last_unstale":"2024-03-16T07:28:41.875371+0000","last_undegraded":"2024-03-16T07:28:41.875371+0000","last_fullsized":"2024-03-16T07:28:41.875371+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_clean_scrub_stamp":"2024-03-16T07:28:39.861342+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:33:05.728451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.575882+0000","last_change":"2024-03-16T07:28:41.574377+0000","last_active":"2024-03-16T07:28:41.575882+0000","last_peered":"2024-03-16T07:28:41.575882+0000","last_clean":"2024-03-16T07:28:41.575882+0000","last_became_active":"2024-03-16T07:28:41.572757+0000","last_became_peered":"2024-03-16T07:28:41.572757+0000","last_unstale":"2024-03-16T07:28:41.575882+0000","last_undegraded":"2024-03-16T07:28:41.575882+0000","last_fullsized":"2024-03-16T07:28:41.575882+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:52:41.800604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.14","version":"73'2","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.572780+0000","last_change":"2024-03-16T07:28:40.890793+0000","last_active":"2024-03-16T07:28:41.572780+0000","last_peered":"2024-03-16T07:28:41.572780+0000","last_clean":"2024-03-16T07:28:41.572780+0000","last_became_active":"2024-03-16T07:28:40.889033+0000","last_became_peered":"2024-03-16T07:28:40.889033+0000","last_unstale":"2024-03-16T07:28:41.572780+0000","last_undegraded":"2024-03-16T07:28:41.572780+0000","last_fullsized":"2024-03-16T07:28:41.572780+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_clean_scrub_stamp":"2024-03-16T07:28:39.861342+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:25:23.243480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.578086+0000","last_change":"2024-03-16T07:28:41.576721+0000","last_active":"2024-03-16T07:28:41.578086+0000","last_peered":"2024-03-16T07:28:41.578086+0000","last_clean":"2024-03-16T07:28:41.578086+0000","last_became_active":"2024-03-16T07:28:41.576367+0000","last_became_peered":"2024-03-16T07:28:41.576367+0000","last_unstale":"2024-03-16T07:28:41.578086+0000","last_undegraded":"2024-03-16T07:28:41.578086+0000","last_fullsized":"2024-03-16T07:28:41.578086+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:43:22.790774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"73'2","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.875258+0000","last_change":"2024-03-16T07:28:40.883154+0000","last_active":"2024-03-16T07:28:41.875258+0000","last_peered":"2024-03-16T07:28:41.875258+0000","last_clean":"2024-03-16T07:28:41.875258+0000","last_became_active":"2024-03-16T07:28:40.882887+0000","last_became_peered":"2024-03-16T07:28:40.882887+0000","last_unstale":"2024-03-16T07:28:41.875258+0000","last_undegraded":"2024-03-16T07:28:41.875258+0000","last_fullsized":"2024-03-16T07:28:41.875258+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_clean_scrub_stamp":"2024-03-16T07:28:39.861342+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:40:18.964304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.585832+0000","last_change":"2024-03-16T07:28:41.584733+0000","last_active":"2024-03-16T07:28:41.585832+0000","last_peered":"2024-03-16T07:28:41.585832+0000","last_clean":"2024-03-16T07:28:41.585832+0000","last_became_active":"2024-03-16T07:28:41.584482+0000","last_became_peered":"2024-03-16T07:28:41.584482+0000","last_unstale":"2024-03-16T07:28:41.585832+0000","last_undegraded":"2024-03-16T07:28:41.585832+0000","last_fullsized":"2024-03-16T07:28:41.585832+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:51:59.339470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.566732+0000","last_change":"2024-03-16T07:28:40.884089+0000","last_active":"2024-03-16T07:28:41.566732+0000","last_peered":"2024-03-16T07:28:41.566732+0000","last_clean":"2024-03-16T07:28:41.566732+0000","last_became_active":"2024-03-16T07:28:40.883831+0000","last_became_peered":"2024-03-16T07:28:40.883831+0000","last_unstale":"2024-03-16T07:28:41.566732+0000","last_undegraded":"2024-03-16T07:28:41.566732+0000","last_fullsized":"2024-03-16T07:28:41.566732+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_clean_scrub_stamp":"2024-03-16T07:28:39.861342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:44:36.452241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.585769+0000","last_change":"2024-03-16T07:28:41.584450+0000","last_active":"2024-03-16T07:28:41.585769+0000","last_peered":"2024-03-16T07:28:41.585769+0000","last_clean":"2024-03-16T07:28:41.585769+0000","last_became_active":"2024-03-16T07:28:41.583048+0000","last_became_peered":"2024-03-16T07:28:41.583048+0000","last_unstale":"2024-03-16T07:28:41.585769+0000","last_undegraded":"2024-03-16T07:28:41.585769+0000","last_fullsized":"2024-03-16T07:28:41.585769+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:13:25.929350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.560432+0000","last_change":"2024-03-16T07:28:40.880394+0000","last_active":"2024-03-16T07:28:41.560432+0000","last_peered":"2024-03-16T07:28:41.560432+0000","last_clean":"2024-03-16T07:28:41.560432+0000","last_became_active":"2024-03-16T07:28:40.880131+0000","last_became_peered":"2024-03-16T07:28:40.880131+0000","last_unstale":"2024-03-16T07:28:41.560432+0000","last_undegraded":"2024-03-16T07:28:41.560432+0000","last_fullsized":"2024-03-16T07:28:41.560432+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_clean_scrub_stamp":"2024-03-16T07:28:39.861342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:14:40.328662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.585881+0000","last_change":"2024-03-16T07:28:41.584622+0000","last_active":"2024-03-16T07:28:41.585881+0000","last_peered":"2024-03-16T07:28:41.585881+0000","last_clean":"2024-03-16T07:28:41.585881+0000","last_became_active":"2024-03-16T07:28:41.583267+0000","last_became_peered":"2024-03-16T07:28:41.583267+0000","last_unstale":"2024-03-16T07:28:41.585881+0000","last_undegraded":"2024-03-16T07:28:41.585881+0000","last_fullsized":"2024-03-16T07:28:41.585881+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:11:39.795157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"73'5","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.570896+0000","last_change":"2024-03-16T07:28:40.891056+0000","last_active":"2024-03-16T07:28:41.570896+0000","last_peered":"2024-03-16T07:28:41.570896+0000","last_clean":"2024-03-16T07:28:41.570896+0000","last_became_active":"2024-03-16T07:28:40.890632+0000","last_became_peered":"2024-03-16T07:28:40.890632+0000","last_unstale":"2024-03-16T07:28:41.570896+0000","last_undegraded":"2024-03-16T07:28:41.570896+0000","last_fullsized":"2024-03-16T07:28:41.570896+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_clean_scrub_stamp":"2024-03-16T07:28:39.861342+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:24:57.129852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.579545+0000","last_change":"2024-03-16T07:28:41.577118+0000","last_active":"2024-03-16T07:28:41.579545+0000","last_peered":"2024-03-16T07:28:41.579545+0000","last_clean":"2024-03-16T07:28:41.579545+0000","last_became_active":"2024-03-16T07:28:41.576870+0000","last_became_peered":"2024-03-16T07:28:41.576870+0000","last_unstale":"2024-03-16T07:28:41.579545+0000","last_undegraded":"2024-03-16T07:28:41.579545+0000","last_fullsized":"2024-03-16T07:28:41.579545+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:55:34.572521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.f","version":"73'1","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.874353+0000","last_change":"2024-03-16T07:28:40.884362+0000","last_active":"2024-03-16T07:28:41.874353+0000","last_peered":"2024-03-16T07:28:41.874353+0000","last_clean":"2024-03-16T07:28:41.874353+0000","last_became_active":"2024-03-16T07:28:40.883691+0000","last_became_peered":"2024-03-16T07:28:40.883691+0000","last_unstale":"2024-03-16T07:28:41.874353+0000","last_undegraded":"2024-03-16T07:28:41.874353+0000","last_fullsized":"2024-03-16T07:28:41.874353+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_clean_scrub_stamp":"2024-03-16T07:28:39.861342+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:45:07.242723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.575461+0000","last_change":"2024-03-16T07:28:41.571334+0000","last_active":"2024-03-16T07:28:41.575461+0000","last_peered":"2024-03-16T07:28:41.575461+0000","last_clean":"2024-03-16T07:28:41.575461+0000","last_became_active":"2024-03-16T07:28:41.571041+0000","last_became_peered":"2024-03-16T07:28:41.571041+0000","last_unstale":"2024-03-16T07:28:41.575461+0000","last_undegraded":"2024-03-16T07:28:41.575461+0000","last_fullsized":"2024-03-16T07:28:41.575461+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:00:45.561416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.e","version":"73'2","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.570475+0000","last_change":"2024-03-16T07:28:40.889189+0000","last_active":"2024-03-16T07:28:41.570475+0000","last_peered":"2024-03-16T07:28:41.570475+0000","last_clean":"2024-03-16T07:28:41.570475+0000","last_became_active":"2024-03-16T07:28:40.886103+0000","last_became_peered":"2024-03-16T07:28:40.886103+0000","last_unstale":"2024-03-16T07:28:41.570475+0000","last_undegraded":"2024-03-16T07:28:41.570475+0000","last_fullsized":"2024-03-16T07:28:41.570475+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_clean_scrub_stamp":"2024-03-16T07:28:39.861342+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:03:01.754754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.578204+0000","last_change":"2024-03-16T07:28:41.576599+0000","last_active":"2024-03-16T07:28:41.578204+0000","last_peered":"2024-03-16T07:28:41.578204+0000","last_clean":"2024-03-16T07:28:41.578204+0000","last_became_active":"2024-03-16T07:28:41.576352+0000","last_became_peered":"2024-03-16T07:28:41.576352+0000","last_unstale":"2024-03-16T07:28:41.578204+0000","last_undegraded":"2024-03-16T07:28:41.578204+0000","last_fullsized":"2024-03-16T07:28:41.578204+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:49:43.485782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.572923+0000","last_change":"2024-03-16T07:28:40.891054+0000","last_active":"2024-03-16T07:28:41.572923+0000","last_peered":"2024-03-16T07:28:41.572923+0000","last_clean":"2024-03-16T07:28:41.572923+0000","last_became_active":"2024-03-16T07:28:40.890675+0000","last_became_peered":"2024-03-16T07:28:40.890675+0000","last_unstale":"2024-03-16T07:28:41.572923+0000","last_undegraded":"2024-03-16T07:28:41.572923+0000","last_fullsized":"2024-03-16T07:28:41.572923+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_clean_scrub_stamp":"2024-03-16T07:28:39.861342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:42:34.511753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.575642+0000","last_change":"2024-03-16T07:28:41.571632+0000","last_active":"2024-03-16T07:28:41.575642+0000","last_peered":"2024-03-16T07:28:41.575642+0000","last_clean":"2024-03-16T07:28:41.575642+0000","last_became_active":"2024-03-16T07:28:41.571014+0000","last_became_peered":"2024-03-16T07:28:41.571014+0000","last_unstale":"2024-03-16T07:28:41.575642+0000","last_undegraded":"2024-03-16T07:28:41.575642+0000","last_fullsized":"2024-03-16T07:28:41.575642+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:39:54.396263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"73'2","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.873824+0000","last_change":"2024-03-16T07:28:40.890368+0000","last_active":"2024-03-16T07:28:41.873824+0000","last_peered":"2024-03-16T07:28:41.873824+0000","last_clean":"2024-03-16T07:28:41.873824+0000","last_became_active":"2024-03-16T07:28:40.889977+0000","last_became_peered":"2024-03-16T07:28:40.889977+0000","last_unstale":"2024-03-16T07:28:41.873824+0000","last_undegraded":"2024-03-16T07:28:41.873824+0000","last_fullsized":"2024-03-16T07:28:41.873824+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_clean_scrub_stamp":"2024-03-16T07:28:39.861342+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:13:21.940217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.575901+0000","last_change":"2024-03-16T07:28:41.573020+0000","last_active":"2024-03-16T07:28:41.575901+0000","last_peered":"2024-03-16T07:28:41.575901+0000","last_clean":"2024-03-16T07:28:41.575901+0000","last_became_active":"2024-03-16T07:28:41.572167+0000","last_became_peered":"2024-03-16T07:28:41.572167+0000","last_unstale":"2024-03-16T07:28:41.575901+0000","last_undegraded":"2024-03-16T07:28:41.575901+0000","last_fullsized":"2024-03-16T07:28:41.575901+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:29:37.170019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.560625+0000","last_change":"2024-03-16T07:28:40.878850+0000","last_active":"2024-03-16T07:28:41.560625+0000","last_peered":"2024-03-16T07:28:41.560625+0000","last_clean":"2024-03-16T07:28:41.560625+0000","last_became_active":"2024-03-16T07:28:40.878359+0000","last_became_peered":"2024-03-16T07:28:40.878359+0000","last_unstale":"2024-03-16T07:28:41.560625+0000","last_undegraded":"2024-03-16T07:28:41.560625+0000","last_fullsized":"2024-03-16T07:28:41.560625+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_clean_scrub_stamp":"2024-03-16T07:28:39.861342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:43:24.007718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.583319+0000","last_change":"2024-03-16T07:28:41.580177+0000","last_active":"2024-03-16T07:28:41.583319+0000","last_peered":"2024-03-16T07:28:41.583319+0000","last_clean":"2024-03-16T07:28:41.583319+0000","last_became_active":"2024-03-16T07:28:41.579841+0000","last_became_peered":"2024-03-16T07:28:41.579841+0000","last_unstale":"2024-03-16T07:28:41.583319+0000","last_undegraded":"2024-03-16T07:28:41.583319+0000","last_fullsized":"2024-03-16T07:28:41.583319+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:18:48.716783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.560487+0000","last_change":"2024-03-16T07:28:40.881199+0000","last_active":"2024-03-16T07:28:41.560487+0000","last_peered":"2024-03-16T07:28:41.560487+0000","last_clean":"2024-03-16T07:28:41.560487+0000","last_became_active":"2024-03-16T07:28:40.880911+0000","last_became_peered":"2024-03-16T07:28:40.880911+0000","last_unstale":"2024-03-16T07:28:41.560487+0000","last_undegraded":"2024-03-16T07:28:41.560487+0000","last_fullsized":"2024-03-16T07:28:41.560487+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_clean_scrub_stamp":"2024-03-16T07:28:39.861342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:21:43.748833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.583364+0000","last_change":"2024-03-16T07:28:41.580467+0000","last_active":"2024-03-16T07:28:41.583364+0000","last_peered":"2024-03-16T07:28:41.583364+0000","last_clean":"2024-03-16T07:28:41.583364+0000","last_became_active":"2024-03-16T07:28:41.579919+0000","last_became_peered":"2024-03-16T07:28:41.579919+0000","last_unstale":"2024-03-16T07:28:41.583364+0000","last_undegraded":"2024-03-16T07:28:41.583364+0000","last_fullsized":"2024-03-16T07:28:41.583364+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:57:22.199053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.562037+0000","last_change":"2024-03-16T07:28:40.878754+0000","last_active":"2024-03-16T07:28:41.562037+0000","last_peered":"2024-03-16T07:28:41.562037+0000","last_clean":"2024-03-16T07:28:41.562037+0000","last_became_active":"2024-03-16T07:28:40.878452+0000","last_became_peered":"2024-03-16T07:28:40.878452+0000","last_unstale":"2024-03-16T07:28:41.562037+0000","last_undegraded":"2024-03-16T07:28:41.562037+0000","last_fullsized":"2024-03-16T07:28:41.562037+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_clean_scrub_stamp":"2024-03-16T07:28:39.861342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:41:14.355084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.579563+0000","last_change":"2024-03-16T07:28:41.577897+0000","last_active":"2024-03-16T07:28:41.579563+0000","last_peered":"2024-03-16T07:28:41.579563+0000","last_clean":"2024-03-16T07:28:41.579563+0000","last_became_active":"2024-03-16T07:28:41.577214+0000","last_became_peered":"2024-03-16T07:28:41.577214+0000","last_unstale":"2024-03-16T07:28:41.579563+0000","last_undegraded":"2024-03-16T07:28:41.579563+0000","last_fullsized":"2024-03-16T07:28:41.579563+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:32:55.227706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.7","version":"73'2","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.874382+0000","last_change":"2024-03-16T07:28:40.887728+0000","last_active":"2024-03-16T07:28:41.874382+0000","last_peered":"2024-03-16T07:28:41.874382+0000","last_clean":"2024-03-16T07:28:41.874382+0000","last_became_active":"2024-03-16T07:28:40.887133+0000","last_became_peered":"2024-03-16T07:28:40.887133+0000","last_unstale":"2024-03-16T07:28:41.874382+0000","last_undegraded":"2024-03-16T07:28:41.874382+0000","last_fullsized":"2024-03-16T07:28:41.874382+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_clean_scrub_stamp":"2024-03-16T07:28:39.861342+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:26:59.911899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.586356+0000","last_change":"2024-03-16T07:28:41.585466+0000","last_active":"2024-03-16T07:28:41.586356+0000","last_peered":"2024-03-16T07:28:41.586356+0000","last_clean":"2024-03-16T07:28:41.586356+0000","last_became_active":"2024-03-16T07:28:41.585226+0000","last_became_peered":"2024-03-16T07:28:41.585226+0000","last_unstale":"2024-03-16T07:28:41.586356+0000","last_undegraded":"2024-03-16T07:28:41.586356+0000","last_fullsized":"2024-03-16T07:28:41.586356+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:18:39.708516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.564601+0000","last_change":"2024-03-16T07:28:40.882367+0000","last_active":"2024-03-16T07:28:41.564601+0000","last_peered":"2024-03-16T07:28:41.564601+0000","last_clean":"2024-03-16T07:28:41.564601+0000","last_became_active":"2024-03-16T07:28:40.882075+0000","last_became_peered":"2024-03-16T07:28:40.882075+0000","last_unstale":"2024-03-16T07:28:41.564601+0000","last_undegraded":"2024-03-16T07:28:41.564601+0000","last_fullsized":"2024-03-16T07:28:41.564601+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_clean_scrub_stamp":"2024-03-16T07:28:39.861342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:40:12.565428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.581285+0000","last_change":"2024-03-16T07:28:41.579252+0000","last_active":"2024-03-16T07:28:41.581285+0000","last_peered":"2024-03-16T07:28:41.581285+0000","last_clean":"2024-03-16T07:28:41.581285+0000","last_became_active":"2024-03-16T07:28:41.579005+0000","last_became_peered":"2024-03-16T07:28:41.579005+0000","last_unstale":"2024-03-16T07:28:41.581285+0000","last_undegraded":"2024-03-16T07:28:41.581285+0000","last_fullsized":"2024-03-16T07:28:41.581285+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:00:52.036688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.569455+0000","last_change":"2024-03-16T07:28:40.889130+0000","last_active":"2024-03-16T07:28:41.569455+0000","last_peered":"2024-03-16T07:28:41.569455+0000","last_clean":"2024-03-16T07:28:41.569455+0000","last_became_active":"2024-03-16T07:28:40.888858+0000","last_became_peered":"2024-03-16T07:28:40.888858+0000","last_unstale":"2024-03-16T07:28:41.569455+0000","last_undegraded":"2024-03-16T07:28:41.569455+0000","last_fullsized":"2024-03-16T07:28:41.569455+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_clean_scrub_stamp":"2024-03-16T07:28:39.861342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:53:46.531176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.575850+0000","last_change":"2024-03-16T07:28:41.573311+0000","last_active":"2024-03-16T07:28:41.575850+0000","last_peered":"2024-03-16T07:28:41.575850+0000","last_clean":"2024-03-16T07:28:41.575850+0000","last_became_active":"2024-03-16T07:28:41.572424+0000","last_became_peered":"2024-03-16T07:28:41.572424+0000","last_unstale":"2024-03-16T07:28:41.575850+0000","last_undegraded":"2024-03-16T07:28:41.575850+0000","last_fullsized":"2024-03-16T07:28:41.575850+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:07:53.076520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.561426+0000","last_change":"2024-03-16T07:28:40.880251+0000","last_active":"2024-03-16T07:28:41.561426+0000","last_peered":"2024-03-16T07:28:41.561426+0000","last_clean":"2024-03-16T07:28:41.561426+0000","last_became_active":"2024-03-16T07:28:40.879971+0000","last_became_peered":"2024-03-16T07:28:40.879971+0000","last_unstale":"2024-03-16T07:28:41.561426+0000","last_undegraded":"2024-03-16T07:28:41.561426+0000","last_fullsized":"2024-03-16T07:28:41.561426+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_clean_scrub_stamp":"2024-03-16T07:28:39.861342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:13:24.928381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.584435+0000","last_change":"2024-03-16T07:28:41.583018+0000","last_active":"2024-03-16T07:28:41.584435+0000","last_peered":"2024-03-16T07:28:41.584435+0000","last_clean":"2024-03-16T07:28:41.584435+0000","last_became_active":"2024-03-16T07:28:41.581147+0000","last_became_peered":"2024-03-16T07:28:41.581147+0000","last_unstale":"2024-03-16T07:28:41.584435+0000","last_undegraded":"2024-03-16T07:28:41.584435+0000","last_fullsized":"2024-03-16T07:28:41.584435+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:42:49.724956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.569563+0000","last_change":"2024-03-16T07:28:40.889809+0000","last_active":"2024-03-16T07:28:41.569563+0000","last_peered":"2024-03-16T07:28:41.569563+0000","last_clean":"2024-03-16T07:28:41.569563+0000","last_became_active":"2024-03-16T07:28:40.889330+0000","last_became_peered":"2024-03-16T07:28:40.889330+0000","last_unstale":"2024-03-16T07:28:41.569563+0000","last_undegraded":"2024-03-16T07:28:41.569563+0000","last_fullsized":"2024-03-16T07:28:41.569563+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_clean_scrub_stamp":"2024-03-16T07:28:39.861342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:35:52.160999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.579873+0000","last_change":"2024-03-16T07:28:41.578826+0000","last_active":"2024-03-16T07:28:41.579873+0000","last_peered":"2024-03-16T07:28:41.579873+0000","last_clean":"2024-03-16T07:28:41.579873+0000","last_became_active":"2024-03-16T07:28:41.578575+0000","last_became_peered":"2024-03-16T07:28:41.578575+0000","last_unstale":"2024-03-16T07:28:41.579873+0000","last_undegraded":"2024-03-16T07:28:41.579873+0000","last_fullsized":"2024-03-16T07:28:41.579873+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:14:10.641625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.561214+0000","last_change":"2024-03-16T07:28:40.878633+0000","last_active":"2024-03-16T07:28:41.561214+0000","last_peered":"2024-03-16T07:28:41.561214+0000","last_clean":"2024-03-16T07:28:41.561214+0000","last_became_active":"2024-03-16T07:28:40.878286+0000","last_became_peered":"2024-03-16T07:28:40.878286+0000","last_unstale":"2024-03-16T07:28:41.561214+0000","last_undegraded":"2024-03-16T07:28:41.561214+0000","last_fullsized":"2024-03-16T07:28:41.561214+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_clean_scrub_stamp":"2024-03-16T07:28:39.861342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:23:46.664218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.576437+0000","last_change":"2024-03-16T07:28:41.575151+0000","last_active":"2024-03-16T07:28:41.576437+0000","last_peered":"2024-03-16T07:28:41.576437+0000","last_clean":"2024-03-16T07:28:41.576437+0000","last_became_active":"2024-03-16T07:28:41.573833+0000","last_became_peered":"2024-03-16T07:28:41.573833+0000","last_unstale":"2024-03-16T07:28:41.576437+0000","last_undegraded":"2024-03-16T07:28:41.576437+0000","last_fullsized":"2024-03-16T07:28:41.576437+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:57:13.275380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.564007+0000","last_change":"2024-03-16T07:28:40.882270+0000","last_active":"2024-03-16T07:28:41.564007+0000","last_peered":"2024-03-16T07:28:41.564007+0000","last_clean":"2024-03-16T07:28:41.564007+0000","last_became_active":"2024-03-16T07:28:40.882028+0000","last_became_peered":"2024-03-16T07:28:40.882028+0000","last_unstale":"2024-03-16T07:28:41.564007+0000","last_undegraded":"2024-03-16T07:28:41.564007+0000","last_fullsized":"2024-03-16T07:28:41.564007+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_clean_scrub_stamp":"2024-03-16T07:28:39.861342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:56:29.041650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.574637+0000","last_change":"2024-03-16T07:28:41.573973+0000","last_active":"2024-03-16T07:28:41.574637+0000","last_peered":"2024-03-16T07:28:41.574637+0000","last_clean":"2024-03-16T07:28:41.574637+0000","last_became_active":"2024-03-16T07:28:41.573727+0000","last_became_peered":"2024-03-16T07:28:41.573727+0000","last_unstale":"2024-03-16T07:28:41.574637+0000","last_undegraded":"2024-03-16T07:28:41.574637+0000","last_fullsized":"2024-03-16T07:28:41.574637+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:58:33.191129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.571055+0000","last_change":"2024-03-16T07:28:40.889413+0000","last_active":"2024-03-16T07:28:41.571055+0000","last_peered":"2024-03-16T07:28:41.571055+0000","last_clean":"2024-03-16T07:28:41.571055+0000","last_became_active":"2024-03-16T07:28:40.886509+0000","last_became_peered":"2024-03-16T07:28:40.886509+0000","last_unstale":"2024-03-16T07:28:41.571055+0000","last_undegraded":"2024-03-16T07:28:41.571055+0000","last_fullsized":"2024-03-16T07:28:41.571055+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_clean_scrub_stamp":"2024-03-16T07:28:39.861342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:48:28.551260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.587704+0000","last_change":"2024-03-16T07:28:41.586465+0000","last_active":"2024-03-16T07:28:41.587704+0000","last_peered":"2024-03-16T07:28:41.587704+0000","last_clean":"2024-03-16T07:28:41.587704+0000","last_became_active":"2024-03-16T07:28:41.586201+0000","last_became_peered":"2024-03-16T07:28:41.586201+0000","last_unstale":"2024-03-16T07:28:41.587704+0000","last_undegraded":"2024-03-16T07:28:41.587704+0000","last_fullsized":"2024-03-16T07:28:41.587704+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:57:26.350308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"73'1","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.875000+0000","last_change":"2024-03-16T07:28:40.883217+0000","last_active":"2024-03-16T07:28:41.875000+0000","last_peered":"2024-03-16T07:28:41.875000+0000","last_clean":"2024-03-16T07:28:41.875000+0000","last_became_active":"2024-03-16T07:28:40.882980+0000","last_became_peered":"2024-03-16T07:28:40.882980+0000","last_unstale":"2024-03-16T07:28:41.875000+0000","last_undegraded":"2024-03-16T07:28:41.875000+0000","last_fullsized":"2024-03-16T07:28:41.875000+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_clean_scrub_stamp":"2024-03-16T07:28:39.861342+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:07:49.913968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"58'141","reported_seq":412,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.565759+0000","last_change":"2024-03-16T07:24:31.650537+0000","last_active":"2024-03-16T07:28:41.565759+0000","last_peered":"2024-03-16T07:28:41.565759+0000","last_clean":"2024-03-16T07:28:41.565759+0000","last_became_active":"2024-03-16T07:24:31.649574+0000","last_became_peered":"2024-03-16T07:24:31.649574+0000","last_unstale":"2024-03-16T07:28:41.565759+0000","last_undegraded":"2024-03-16T07:28:41.565759+0000","last_fullsized":"2024-03-16T07:28:41.565759+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:29.719970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:29.719970+0000","last_clean_scrub_stamp":"2024-03-16T07:24:29.719970+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:31:35.774554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":490,"num_read_kb":915,"num_write":217,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":798,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":29,"ondisk_log_size":29,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":490,"num_read_kb":915,"num_write":217,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":141,"ondisk_log_size":141,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738419,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":31900,"kb_used_data":712,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":104825700,"statfs":{"total":107374182400,"available":107341516800,"internally_reserved":0,"allocated":729088,"data_stored":287417,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738419,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":32480,"kb_used_data":1292,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":104825120,"statfs":{"total":107374182400,"available":107340922880,"internally_reserved":0,"allocated":1323008,"data_stored":877785,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738419,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":32468,"kb_used_data":1284,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":104825132,"statfs":{"total":107374182400,"available":107340935168,"internally_reserved":0,"allocated":1314816,"data_stored":873320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-16T07:28:45.964 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-16T07:28:46.307 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:28:46.308 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2024-03-16T07:28:46.318 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":34,"stamp":"2024-03-16T07:28:45.890215+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591166,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":490,"num_read_kb":915,"num_write":250,"num_write_kb":1905,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":170,"ondisk_log_size":170,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":314572800,"kb_used":96848,"kb_used_data":3288,"kb_used_omap":4,"kb_used_meta":93499,"kb_avail":314475952,"statfs":{"total":322122547200,"available":322023374848,"internally_reserved":0,"allocated":3366912,"data_stored":2038522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":95743311},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":798,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001054"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.586322+0000","last_change":"2024-03-16T07:28:41.584717+0000","last_active":"2024-03-16T07:28:41.586322+0000","last_peered":"2024-03-16T07:28:41.586322+0000","last_clean":"2024-03-16T07:28:41.586322+0000","last_became_active":"2024-03-16T07:28:41.582095+0000","last_became_peered":"2024-03-16T07:28:41.582095+0000","last_unstale":"2024-03-16T07:28:41.586322+0000","last_undegraded":"2024-03-16T07:28:41.586322+0000","last_fullsized":"2024-03-16T07:28:41.586322+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:41:15.356053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.582151+0000","last_change":"2024-03-16T07:28:41.581340+0000","last_active":"2024-03-16T07:28:41.582151+0000","last_peered":"2024-03-16T07:28:41.582151+0000","last_clean":"2024-03-16T07:28:41.582151+0000","last_became_active":"2024-03-16T07:28:41.580857+0000","last_became_peered":"2024-03-16T07:28:41.580857+0000","last_unstale":"2024-03-16T07:28:41.582151+0000","last_undegraded":"2024-03-16T07:28:41.582151+0000","last_fullsized":"2024-03-16T07:28:41.582151+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:08:14.215455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.575831+0000","last_change":"2024-03-16T07:28:41.571483+0000","last_active":"2024-03-16T07:28:41.575831+0000","last_peered":"2024-03-16T07:28:41.575831+0000","last_clean":"2024-03-16T07:28:41.575831+0000","last_became_active":"2024-03-16T07:28:41.571155+0000","last_became_peered":"2024-03-16T07:28:41.571155+0000","last_unstale":"2024-03-16T07:28:41.575831+0000","last_undegraded":"2024-03-16T07:28:41.575831+0000","last_fullsized":"2024-03-16T07:28:41.575831+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:06:30.085366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.575749+0000","last_change":"2024-03-16T07:28:41.573044+0000","last_active":"2024-03-16T07:28:41.575749+0000","last_peered":"2024-03-16T07:28:41.575749+0000","last_clean":"2024-03-16T07:28:41.575749+0000","last_became_active":"2024-03-16T07:28:41.572405+0000","last_became_peered":"2024-03-16T07:28:41.572405+0000","last_unstale":"2024-03-16T07:28:41.575749+0000","last_undegraded":"2024-03-16T07:28:41.575749+0000","last_fullsized":"2024-03-16T07:28:41.575749+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:03:27.209411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.576420+0000","last_change":"2024-03-16T07:28:41.574275+0000","last_active":"2024-03-16T07:28:41.576420+0000","last_peered":"2024-03-16T07:28:41.576420+0000","last_clean":"2024-03-16T07:28:41.576420+0000","last_became_active":"2024-03-16T07:28:41.572254+0000","last_became_peered":"2024-03-16T07:28:41.572254+0000","last_unstale":"2024-03-16T07:28:41.576420+0000","last_undegraded":"2024-03-16T07:28:41.576420+0000","last_fullsized":"2024-03-16T07:28:41.576420+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:37:56.085909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.575661+0000","last_change":"2024-03-16T07:28:41.571823+0000","last_active":"2024-03-16T07:28:41.575661+0000","last_peered":"2024-03-16T07:28:41.575661+0000","last_clean":"2024-03-16T07:28:41.575661+0000","last_became_active":"2024-03-16T07:28:41.571384+0000","last_became_peered":"2024-03-16T07:28:41.571384+0000","last_unstale":"2024-03-16T07:28:41.575661+0000","last_undegraded":"2024-03-16T07:28:41.575661+0000","last_fullsized":"2024-03-16T07:28:41.575661+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:18:39.708516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.577234+0000","last_change":"2024-03-16T07:28:41.575572+0000","last_active":"2024-03-16T07:28:41.577234+0000","last_peered":"2024-03-16T07:28:41.577234+0000","last_clean":"2024-03-16T07:28:41.577234+0000","last_became_active":"2024-03-16T07:28:41.574604+0000","last_became_peered":"2024-03-16T07:28:41.574604+0000","last_unstale":"2024-03-16T07:28:41.577234+0000","last_undegraded":"2024-03-16T07:28:41.577234+0000","last_fullsized":"2024-03-16T07:28:41.577234+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:22:34.129441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.588376+0000","last_change":"2024-03-16T07:28:41.587931+0000","last_active":"2024-03-16T07:28:41.588376+0000","last_peered":"2024-03-16T07:28:41.588376+0000","last_clean":"2024-03-16T07:28:41.588376+0000","last_became_active":"2024-03-16T07:28:41.587665+0000","last_became_peered":"2024-03-16T07:28:41.587665+0000","last_unstale":"2024-03-16T07:28:41.588376+0000","last_undegraded":"2024-03-16T07:28:41.588376+0000","last_fullsized":"2024-03-16T07:28:41.588376+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:28:19.073163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.588033+0000","last_change":"2024-03-16T07:28:41.586380+0000","last_active":"2024-03-16T07:28:41.588033+0000","last_peered":"2024-03-16T07:28:41.588033+0000","last_clean":"2024-03-16T07:28:41.588033+0000","last_became_active":"2024-03-16T07:28:41.586099+0000","last_became_peered":"2024-03-16T07:28:41.586099+0000","last_unstale":"2024-03-16T07:28:41.588033+0000","last_undegraded":"2024-03-16T07:28:41.588033+0000","last_fullsized":"2024-03-16T07:28:41.588033+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:52:07.913753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.575497+0000","last_change":"2024-03-16T07:28:41.573336+0000","last_active":"2024-03-16T07:28:41.575497+0000","last_peered":"2024-03-16T07:28:41.575497+0000","last_clean":"2024-03-16T07:28:41.575497+0000","last_became_active":"2024-03-16T07:28:41.573117+0000","last_became_peered":"2024-03-16T07:28:41.573117+0000","last_unstale":"2024-03-16T07:28:41.575497+0000","last_undegraded":"2024-03-16T07:28:41.575497+0000","last_fullsized":"2024-03-16T07:28:41.575497+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:31:17.966399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.582123+0000","last_change":"2024-03-16T07:28:41.581320+0000","last_active":"2024-03-16T07:28:41.582123+0000","last_peered":"2024-03-16T07:28:41.582123+0000","last_clean":"2024-03-16T07:28:41.582123+0000","last_became_active":"2024-03-16T07:28:41.581060+0000","last_became_peered":"2024-03-16T07:28:41.581060+0000","last_unstale":"2024-03-16T07:28:41.582123+0000","last_undegraded":"2024-03-16T07:28:41.582123+0000","last_fullsized":"2024-03-16T07:28:41.582123+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:45:53.674282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.587924+0000","last_change":"2024-03-16T07:28:41.587377+0000","last_active":"2024-03-16T07:28:41.587924+0000","last_peered":"2024-03-16T07:28:41.587924+0000","last_clean":"2024-03-16T07:28:41.587924+0000","last_became_active":"2024-03-16T07:28:41.586980+0000","last_became_peered":"2024-03-16T07:28:41.586980+0000","last_unstale":"2024-03-16T07:28:41.587924+0000","last_undegraded":"2024-03-16T07:28:41.587924+0000","last_fullsized":"2024-03-16T07:28:41.587924+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:49:39.237111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.579892+0000","last_change":"2024-03-16T07:28:41.579054+0000","last_active":"2024-03-16T07:28:41.579892+0000","last_peered":"2024-03-16T07:28:41.579892+0000","last_clean":"2024-03-16T07:28:41.579892+0000","last_became_active":"2024-03-16T07:28:41.578801+0000","last_became_peered":"2024-03-16T07:28:41.578801+0000","last_unstale":"2024-03-16T07:28:41.579892+0000","last_undegraded":"2024-03-16T07:28:41.579892+0000","last_fullsized":"2024-03-16T07:28:41.579892+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:20:11.138916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.576983+0000","last_change":"2024-03-16T07:28:41.576077+0000","last_active":"2024-03-16T07:28:41.576983+0000","last_peered":"2024-03-16T07:28:41.576983+0000","last_clean":"2024-03-16T07:28:41.576983+0000","last_became_active":"2024-03-16T07:28:41.575830+0000","last_became_peered":"2024-03-16T07:28:41.575830+0000","last_unstale":"2024-03-16T07:28:41.576983+0000","last_undegraded":"2024-03-16T07:28:41.576983+0000","last_fullsized":"2024-03-16T07:28:41.576983+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:51:02.351017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.585899+0000","last_change":"2024-03-16T07:28:41.585018+0000","last_active":"2024-03-16T07:28:41.585899+0000","last_peered":"2024-03-16T07:28:41.585899+0000","last_clean":"2024-03-16T07:28:41.585899+0000","last_became_active":"2024-03-16T07:28:41.584767+0000","last_became_peered":"2024-03-16T07:28:41.584767+0000","last_unstale":"2024-03-16T07:28:41.585899+0000","last_undegraded":"2024-03-16T07:28:41.585899+0000","last_fullsized":"2024-03-16T07:28:41.585899+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:06:30.085366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.580753+0000","last_change":"2024-03-16T07:28:41.579446+0000","last_active":"2024-03-16T07:28:41.580753+0000","last_peered":"2024-03-16T07:28:41.580753+0000","last_clean":"2024-03-16T07:28:41.580753+0000","last_became_active":"2024-03-16T07:28:41.579222+0000","last_became_peered":"2024-03-16T07:28:41.579222+0000","last_unstale":"2024-03-16T07:28:41.580753+0000","last_undegraded":"2024-03-16T07:28:41.580753+0000","last_fullsized":"2024-03-16T07:28:41.580753+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:12:10.158550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.576132+0000","last_change":"2024-03-16T07:28:41.575562+0000","last_active":"2024-03-16T07:28:41.576132+0000","last_peered":"2024-03-16T07:28:41.576132+0000","last_clean":"2024-03-16T07:28:41.576132+0000","last_became_active":"2024-03-16T07:28:41.574861+0000","last_became_peered":"2024-03-16T07:28:41.574861+0000","last_unstale":"2024-03-16T07:28:41.576132+0000","last_undegraded":"2024-03-16T07:28:41.576132+0000","last_fullsized":"2024-03-16T07:28:41.576132+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:27:19.086279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.575478+0000","last_change":"2024-03-16T07:28:41.573236+0000","last_active":"2024-03-16T07:28:41.575478+0000","last_peered":"2024-03-16T07:28:41.575478+0000","last_clean":"2024-03-16T07:28:41.575478+0000","last_became_active":"2024-03-16T07:28:41.572821+0000","last_became_peered":"2024-03-16T07:28:41.572821+0000","last_unstale":"2024-03-16T07:28:41.575478+0000","last_undegraded":"2024-03-16T07:28:41.575478+0000","last_fullsized":"2024-03-16T07:28:41.575478+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:57:26.350308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.578183+0000","last_change":"2024-03-16T07:28:41.576503+0000","last_active":"2024-03-16T07:28:41.578183+0000","last_peered":"2024-03-16T07:28:41.578183+0000","last_clean":"2024-03-16T07:28:41.578183+0000","last_became_active":"2024-03-16T07:28:41.576209+0000","last_became_peered":"2024-03-16T07:28:41.576209+0000","last_unstale":"2024-03-16T07:28:41.578183+0000","last_undegraded":"2024-03-16T07:28:41.578183+0000","last_fullsized":"2024-03-16T07:28:41.578183+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:26:04.808962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.582992+0000","last_change":"2024-03-16T07:28:41.580683+0000","last_active":"2024-03-16T07:28:41.582992+0000","last_peered":"2024-03-16T07:28:41.582992+0000","last_clean":"2024-03-16T07:28:41.582992+0000","last_became_active":"2024-03-16T07:28:41.580015+0000","last_became_peered":"2024-03-16T07:28:41.580015+0000","last_unstale":"2024-03-16T07:28:41.582992+0000","last_undegraded":"2024-03-16T07:28:41.582992+0000","last_fullsized":"2024-03-16T07:28:41.582992+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:44:44.566786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.575939+0000","last_change":"2024-03-16T07:28:41.574346+0000","last_active":"2024-03-16T07:28:41.575939+0000","last_peered":"2024-03-16T07:28:41.575939+0000","last_clean":"2024-03-16T07:28:41.575939+0000","last_became_active":"2024-03-16T07:28:41.572788+0000","last_became_peered":"2024-03-16T07:28:41.572788+0000","last_unstale":"2024-03-16T07:28:41.575939+0000","last_undegraded":"2024-03-16T07:28:41.575939+0000","last_fullsized":"2024-03-16T07:28:41.575939+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:19:25.780587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.586845+0000","last_change":"2024-03-16T07:28:41.585789+0000","last_active":"2024-03-16T07:28:41.586845+0000","last_peered":"2024-03-16T07:28:41.586845+0000","last_clean":"2024-03-16T07:28:41.586845+0000","last_became_active":"2024-03-16T07:28:41.585253+0000","last_became_peered":"2024-03-16T07:28:41.585253+0000","last_unstale":"2024-03-16T07:28:41.586845+0000","last_undegraded":"2024-03-16T07:28:41.586845+0000","last_fullsized":"2024-03-16T07:28:41.586845+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:29:37.170019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.583375+0000","last_change":"2024-03-16T07:28:41.580659+0000","last_active":"2024-03-16T07:28:41.583375+0000","last_peered":"2024-03-16T07:28:41.583375+0000","last_clean":"2024-03-16T07:28:41.583375+0000","last_became_active":"2024-03-16T07:28:41.580236+0000","last_became_peered":"2024-03-16T07:28:41.580236+0000","last_unstale":"2024-03-16T07:28:41.583375+0000","last_undegraded":"2024-03-16T07:28:41.583375+0000","last_fullsized":"2024-03-16T07:28:41.583375+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:52:07.322808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.578781+0000","last_change":"2024-03-16T07:28:41.578066+0000","last_active":"2024-03-16T07:28:41.578781+0000","last_peered":"2024-03-16T07:28:41.578781+0000","last_clean":"2024-03-16T07:28:41.578781+0000","last_became_active":"2024-03-16T07:28:41.577559+0000","last_became_peered":"2024-03-16T07:28:41.577559+0000","last_unstale":"2024-03-16T07:28:41.578781+0000","last_undegraded":"2024-03-16T07:28:41.578781+0000","last_fullsized":"2024-03-16T07:28:41.578781+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:30:35.704161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.587491+0000","last_change":"2024-03-16T07:28:41.586201+0000","last_active":"2024-03-16T07:28:41.587491+0000","last_peered":"2024-03-16T07:28:41.587491+0000","last_clean":"2024-03-16T07:28:41.587491+0000","last_became_active":"2024-03-16T07:28:41.585957+0000","last_became_peered":"2024-03-16T07:28:41.585957+0000","last_unstale":"2024-03-16T07:28:41.587491+0000","last_undegraded":"2024-03-16T07:28:41.587491+0000","last_fullsized":"2024-03-16T07:28:41.587491+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:03:27.209411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.585875+0000","last_change":"2024-03-16T07:28:41.584462+0000","last_active":"2024-03-16T07:28:41.585875+0000","last_peered":"2024-03-16T07:28:41.585875+0000","last_clean":"2024-03-16T07:28:41.585875+0000","last_became_active":"2024-03-16T07:28:41.583131+0000","last_became_peered":"2024-03-16T07:28:41.583131+0000","last_unstale":"2024-03-16T07:28:41.585875+0000","last_undegraded":"2024-03-16T07:28:41.585875+0000","last_fullsized":"2024-03-16T07:28:41.585875+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:43:25.008688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.575866+0000","last_change":"2024-03-16T07:28:41.574267+0000","last_active":"2024-03-16T07:28:41.575866+0000","last_peered":"2024-03-16T07:28:41.575866+0000","last_clean":"2024-03-16T07:28:41.575866+0000","last_became_active":"2024-03-16T07:28:41.573063+0000","last_became_peered":"2024-03-16T07:28:41.573063+0000","last_unstale":"2024-03-16T07:28:41.575866+0000","last_undegraded":"2024-03-16T07:28:41.575866+0000","last_fullsized":"2024-03-16T07:28:41.575866+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:09:05.453250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.582880+0000","last_change":"2024-03-16T07:28:41.581852+0000","last_active":"2024-03-16T07:28:41.582880+0000","last_peered":"2024-03-16T07:28:41.582880+0000","last_clean":"2024-03-16T07:28:41.582880+0000","last_became_active":"2024-03-16T07:28:41.581577+0000","last_became_peered":"2024-03-16T07:28:41.581577+0000","last_unstale":"2024-03-16T07:28:41.582880+0000","last_undegraded":"2024-03-16T07:28:41.582880+0000","last_fullsized":"2024-03-16T07:28:41.582880+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:54:32.776648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.584829+0000","last_change":"2024-03-16T07:28:41.582852+0000","last_active":"2024-03-16T07:28:41.584829+0000","last_peered":"2024-03-16T07:28:41.584829+0000","last_clean":"2024-03-16T07:28:41.584829+0000","last_became_active":"2024-03-16T07:28:41.582617+0000","last_became_peered":"2024-03-16T07:28:41.582617+0000","last_unstale":"2024-03-16T07:28:41.584829+0000","last_undegraded":"2024-03-16T07:28:41.584829+0000","last_fullsized":"2024-03-16T07:28:41.584829+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:07:42.637683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.585445+0000","last_change":"2024-03-16T07:28:41.583248+0000","last_active":"2024-03-16T07:28:41.585445+0000","last_peered":"2024-03-16T07:28:41.585445+0000","last_clean":"2024-03-16T07:28:41.585445+0000","last_became_active":"2024-03-16T07:28:41.582850+0000","last_became_peered":"2024-03-16T07:28:41.582850+0000","last_unstale":"2024-03-16T07:28:41.585445+0000","last_undegraded":"2024-03-16T07:28:41.585445+0000","last_fullsized":"2024-03-16T07:28:41.585445+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:21:44.749802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.577216+0000","last_change":"2024-03-16T07:28:41.574835+0000","last_active":"2024-03-16T07:28:41.577216+0000","last_peered":"2024-03-16T07:28:41.577216+0000","last_clean":"2024-03-16T07:28:41.577216+0000","last_became_active":"2024-03-16T07:28:41.574293+0000","last_became_peered":"2024-03-16T07:28:41.574293+0000","last_unstale":"2024-03-16T07:28:41.577216+0000","last_undegraded":"2024-03-16T07:28:41.577216+0000","last_fullsized":"2024-03-16T07:28:41.577216+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:17:45.831164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.578762+0000","last_change":"2024-03-16T07:28:41.577793+0000","last_active":"2024-03-16T07:28:41.578762+0000","last_peered":"2024-03-16T07:28:41.578762+0000","last_clean":"2024-03-16T07:28:41.578762+0000","last_became_active":"2024-03-16T07:28:41.577243+0000","last_became_peered":"2024-03-16T07:28:41.577243+0000","last_unstale":"2024-03-16T07:28:41.578762+0000","last_undegraded":"2024-03-16T07:28:41.578762+0000","last_fullsized":"2024-03-16T07:28:41.578762+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:39:46.941392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.581299+0000","last_change":"2024-03-16T07:28:41.579444+0000","last_active":"2024-03-16T07:28:41.581299+0000","last_peered":"2024-03-16T07:28:41.581299+0000","last_clean":"2024-03-16T07:28:41.581299+0000","last_became_active":"2024-03-16T07:28:41.579180+0000","last_became_peered":"2024-03-16T07:28:41.579180+0000","last_unstale":"2024-03-16T07:28:41.581299+0000","last_undegraded":"2024-03-16T07:28:41.581299+0000","last_fullsized":"2024-03-16T07:28:41.581299+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:27:57.425323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"73'4","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.875760+0000","last_change":"2024-03-16T07:28:40.884571+0000","last_active":"2024-03-16T07:28:41.875760+0000","last_peered":"2024-03-16T07:28:41.875760+0000","last_clean":"2024-03-16T07:28:41.875760+0000","last_became_active":"2024-03-16T07:28:40.884044+0000","last_became_peered":"2024-03-16T07:28:40.884044+0000","last_unstale":"2024-03-16T07:28:41.875760+0000","last_undegraded":"2024-03-16T07:28:41.875760+0000","last_fullsized":"2024-03-16T07:28:41.875760+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_clean_scrub_stamp":"2024-03-16T07:28:39.861342+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:05:55.028514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.586340+0000","last_change":"2024-03-16T07:28:41.584924+0000","last_active":"2024-03-16T07:28:41.586340+0000","last_peered":"2024-03-16T07:28:41.586340+0000","last_clean":"2024-03-16T07:28:41.586340+0000","last_became_active":"2024-03-16T07:28:41.583141+0000","last_became_peered":"2024-03-16T07:28:41.583141+0000","last_unstale":"2024-03-16T07:28:41.586340+0000","last_undegraded":"2024-03-16T07:28:41.586340+0000","last_fullsized":"2024-03-16T07:28:41.586340+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:00:45.561416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1e","version":"73'1","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.873315+0000","last_change":"2024-03-16T07:28:40.880780+0000","last_active":"2024-03-16T07:28:41.873315+0000","last_peered":"2024-03-16T07:28:41.873315+0000","last_clean":"2024-03-16T07:28:41.873315+0000","last_became_active":"2024-03-16T07:28:40.880529+0000","last_became_peered":"2024-03-16T07:28:40.880529+0000","last_unstale":"2024-03-16T07:28:41.873315+0000","last_undegraded":"2024-03-16T07:28:41.873315+0000","last_fullsized":"2024-03-16T07:28:41.873315+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_clean_scrub_stamp":"2024-03-16T07:28:39.861342+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:11:38.794188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.587905+0000","last_change":"2024-03-16T07:28:41.587228+0000","last_active":"2024-03-16T07:28:41.587905+0000","last_peered":"2024-03-16T07:28:41.587905+0000","last_clean":"2024-03-16T07:28:41.587905+0000","last_became_active":"2024-03-16T07:28:41.586930+0000","last_became_peered":"2024-03-16T07:28:41.586930+0000","last_unstale":"2024-03-16T07:28:41.587905+0000","last_undegraded":"2024-03-16T07:28:41.587905+0000","last_fullsized":"2024-03-16T07:28:41.587905+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:54:36.142881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1d","version":"73'2","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.873769+0000","last_change":"2024-03-16T07:28:40.889280+0000","last_active":"2024-03-16T07:28:41.873769+0000","last_peered":"2024-03-16T07:28:41.873769+0000","last_clean":"2024-03-16T07:28:41.873769+0000","last_became_active":"2024-03-16T07:28:40.889014+0000","last_became_peered":"2024-03-16T07:28:40.889014+0000","last_unstale":"2024-03-16T07:28:41.873769+0000","last_undegraded":"2024-03-16T07:28:41.873769+0000","last_fullsized":"2024-03-16T07:28:41.873769+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_clean_scrub_stamp":"2024-03-16T07:28:39.861342+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:30:34.345858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.574662+0000","last_change":"2024-03-16T07:28:41.574130+0000","last_active":"2024-03-16T07:28:41.574662+0000","last_peered":"2024-03-16T07:28:41.574662+0000","last_clean":"2024-03-16T07:28:41.574662+0000","last_became_active":"2024-03-16T07:28:41.573863+0000","last_became_peered":"2024-03-16T07:28:41.573863+0000","last_unstale":"2024-03-16T07:28:41.574662+0000","last_undegraded":"2024-03-16T07:28:41.574662+0000","last_fullsized":"2024-03-16T07:28:41.574662+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:41:47.127439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.574574+0000","last_change":"2024-03-16T07:28:40.890321+0000","last_active":"2024-03-16T07:28:41.574574+0000","last_peered":"2024-03-16T07:28:41.574574+0000","last_clean":"2024-03-16T07:28:41.574574+0000","last_became_active":"2024-03-16T07:28:40.888214+0000","last_became_peered":"2024-03-16T07:28:40.888214+0000","last_unstale":"2024-03-16T07:28:41.574574+0000","last_undegraded":"2024-03-16T07:28:41.574574+0000","last_fullsized":"2024-03-16T07:28:41.574574+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_clean_scrub_stamp":"2024-03-16T07:28:39.861342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:59:34.630341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.584530+0000","last_change":"2024-03-16T07:28:41.583111+0000","last_active":"2024-03-16T07:28:41.584530+0000","last_peered":"2024-03-16T07:28:41.584530+0000","last_clean":"2024-03-16T07:28:41.584530+0000","last_became_active":"2024-03-16T07:28:41.582554+0000","last_became_peered":"2024-03-16T07:28:41.582554+0000","last_unstale":"2024-03-16T07:28:41.584530+0000","last_undegraded":"2024-03-16T07:28:41.584530+0000","last_fullsized":"2024-03-16T07:28:41.584530+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:14:41.329632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"73'1","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.874365+0000","last_change":"2024-03-16T07:28:40.884283+0000","last_active":"2024-03-16T07:28:41.874365+0000","last_peered":"2024-03-16T07:28:41.874365+0000","last_clean":"2024-03-16T07:28:41.874365+0000","last_became_active":"2024-03-16T07:28:40.884015+0000","last_became_peered":"2024-03-16T07:28:40.884015+0000","last_unstale":"2024-03-16T07:28:41.874365+0000","last_undegraded":"2024-03-16T07:28:41.874365+0000","last_fullsized":"2024-03-16T07:28:41.874365+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_clean_scrub_stamp":"2024-03-16T07:28:39.861342+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:27:57.241790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.575922+0000","last_change":"2024-03-16T07:28:41.573219+0000","last_active":"2024-03-16T07:28:41.575922+0000","last_peered":"2024-03-16T07:28:41.575922+0000","last_clean":"2024-03-16T07:28:41.575922+0000","last_became_active":"2024-03-16T07:28:41.572483+0000","last_became_peered":"2024-03-16T07:28:41.572483+0000","last_unstale":"2024-03-16T07:28:41.575922+0000","last_undegraded":"2024-03-16T07:28:41.575922+0000","last_fullsized":"2024-03-16T07:28:41.575922+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:52:07.913753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.1a","version":"73'1","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.873085+0000","last_change":"2024-03-16T07:28:40.878927+0000","last_active":"2024-03-16T07:28:41.873085+0000","last_peered":"2024-03-16T07:28:41.873085+0000","last_clean":"2024-03-16T07:28:41.873085+0000","last_became_active":"2024-03-16T07:28:40.878669+0000","last_became_peered":"2024-03-16T07:28:40.878669+0000","last_unstale":"2024-03-16T07:28:41.873085+0000","last_undegraded":"2024-03-16T07:28:41.873085+0000","last_fullsized":"2024-03-16T07:28:41.873085+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_clean_scrub_stamp":"2024-03-16T07:28:39.861342+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:51:58.338500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.585928+0000","last_change":"2024-03-16T07:28:41.585134+0000","last_active":"2024-03-16T07:28:41.585928+0000","last_peered":"2024-03-16T07:28:41.585928+0000","last_clean":"2024-03-16T07:28:41.585928+0000","last_became_active":"2024-03-16T07:28:41.584887+0000","last_became_peered":"2024-03-16T07:28:41.584887+0000","last_unstale":"2024-03-16T07:28:41.585928+0000","last_undegraded":"2024-03-16T07:28:41.585928+0000","last_fullsized":"2024-03-16T07:28:41.585928+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:39:54.396263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.569735+0000","last_change":"2024-03-16T07:28:40.890932+0000","last_active":"2024-03-16T07:28:41.569735+0000","last_peered":"2024-03-16T07:28:41.569735+0000","last_clean":"2024-03-16T07:28:41.569735+0000","last_became_active":"2024-03-16T07:28:40.890340+0000","last_became_peered":"2024-03-16T07:28:40.890340+0000","last_unstale":"2024-03-16T07:28:41.569735+0000","last_undegraded":"2024-03-16T07:28:41.569735+0000","last_fullsized":"2024-03-16T07:28:41.569735+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_clean_scrub_stamp":"2024-03-16T07:28:39.861342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:54:35.284150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.577837+0000","last_change":"2024-03-16T07:28:41.577102+0000","last_active":"2024-03-16T07:28:41.577837+0000","last_peered":"2024-03-16T07:28:41.577837+0000","last_clean":"2024-03-16T07:28:41.577837+0000","last_became_active":"2024-03-16T07:28:41.576845+0000","last_became_peered":"2024-03-16T07:28:41.576845+0000","last_unstale":"2024-03-16T07:28:41.577837+0000","last_undegraded":"2024-03-16T07:28:41.577837+0000","last_fullsized":"2024-03-16T07:28:41.577837+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:46:18.244213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.565580+0000","last_change":"2024-03-16T07:28:40.883138+0000","last_active":"2024-03-16T07:28:41.565580+0000","last_peered":"2024-03-16T07:28:41.565580+0000","last_clean":"2024-03-16T07:28:41.565580+0000","last_became_active":"2024-03-16T07:28:40.882873+0000","last_became_peered":"2024-03-16T07:28:40.882873+0000","last_unstale":"2024-03-16T07:28:41.565580+0000","last_undegraded":"2024-03-16T07:28:41.565580+0000","last_fullsized":"2024-03-16T07:28:41.565580+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_clean_scrub_stamp":"2024-03-16T07:28:39.861342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:50:03.695566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.587446+0000","last_change":"2024-03-16T07:28:41.586728+0000","last_active":"2024-03-16T07:28:41.587446+0000","last_peered":"2024-03-16T07:28:41.587446+0000","last_clean":"2024-03-16T07:28:41.587446+0000","last_became_active":"2024-03-16T07:28:41.586429+0000","last_became_peered":"2024-03-16T07:28:41.586429+0000","last_unstale":"2024-03-16T07:28:41.587446+0000","last_undegraded":"2024-03-16T07:28:41.587446+0000","last_fullsized":"2024-03-16T07:28:41.587446+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:13:48.908105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.566967+0000","last_change":"2024-03-16T07:28:40.887890+0000","last_active":"2024-03-16T07:28:41.566967+0000","last_peered":"2024-03-16T07:28:41.566967+0000","last_clean":"2024-03-16T07:28:41.566967+0000","last_became_active":"2024-03-16T07:28:40.887271+0000","last_became_peered":"2024-03-16T07:28:40.887271+0000","last_unstale":"2024-03-16T07:28:41.566967+0000","last_undegraded":"2024-03-16T07:28:41.566967+0000","last_fullsized":"2024-03-16T07:28:41.566967+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_clean_scrub_stamp":"2024-03-16T07:28:39.861342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:57:30.494001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.586304+0000","last_change":"2024-03-16T07:28:41.584498+0000","last_active":"2024-03-16T07:28:41.586304+0000","last_peered":"2024-03-16T07:28:41.586304+0000","last_clean":"2024-03-16T07:28:41.586304+0000","last_became_active":"2024-03-16T07:28:41.581697+0000","last_became_peered":"2024-03-16T07:28:41.581697+0000","last_unstale":"2024-03-16T07:28:41.586304+0000","last_undegraded":"2024-03-16T07:28:41.586304+0000","last_fullsized":"2024-03-16T07:28:41.586304+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:23:47.665187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.560534+0000","last_change":"2024-03-16T07:28:40.886362+0000","last_active":"2024-03-16T07:28:41.560534+0000","last_peered":"2024-03-16T07:28:41.560534+0000","last_clean":"2024-03-16T07:28:41.560534+0000","last_became_active":"2024-03-16T07:28:40.886129+0000","last_became_peered":"2024-03-16T07:28:40.886129+0000","last_unstale":"2024-03-16T07:28:41.560534+0000","last_undegraded":"2024-03-16T07:28:41.560534+0000","last_fullsized":"2024-03-16T07:28:41.560534+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_clean_scrub_stamp":"2024-03-16T07:28:39.861342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:42:48.723986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.587660+0000","last_change":"2024-03-16T07:28:41.587165+0000","last_active":"2024-03-16T07:28:41.587660+0000","last_peered":"2024-03-16T07:28:41.587660+0000","last_clean":"2024-03-16T07:28:41.587660+0000","last_became_active":"2024-03-16T07:28:41.586578+0000","last_became_peered":"2024-03-16T07:28:41.586578+0000","last_unstale":"2024-03-16T07:28:41.587660+0000","last_undegraded":"2024-03-16T07:28:41.587660+0000","last_fullsized":"2024-03-16T07:28:41.587660+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:12:22.482264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"73'3","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.875371+0000","last_change":"2024-03-16T07:28:40.885939+0000","last_active":"2024-03-16T07:28:41.875371+0000","last_peered":"2024-03-16T07:28:41.875371+0000","last_clean":"2024-03-16T07:28:41.875371+0000","last_became_active":"2024-03-16T07:28:40.885668+0000","last_became_peered":"2024-03-16T07:28:40.885668+0000","last_unstale":"2024-03-16T07:28:41.875371+0000","last_undegraded":"2024-03-16T07:28:41.875371+0000","last_fullsized":"2024-03-16T07:28:41.875371+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_clean_scrub_stamp":"2024-03-16T07:28:39.861342+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:33:05.728451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.575882+0000","last_change":"2024-03-16T07:28:41.574377+0000","last_active":"2024-03-16T07:28:41.575882+0000","last_peered":"2024-03-16T07:28:41.575882+0000","last_clean":"2024-03-16T07:28:41.575882+0000","last_became_active":"2024-03-16T07:28:41.572757+0000","last_became_peered":"2024-03-16T07:28:41.572757+0000","last_unstale":"2024-03-16T07:28:41.575882+0000","last_undegraded":"2024-03-16T07:28:41.575882+0000","last_fullsized":"2024-03-16T07:28:41.575882+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:52:41.800604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.14","version":"73'2","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.572780+0000","last_change":"2024-03-16T07:28:40.890793+0000","last_active":"2024-03-16T07:28:41.572780+0000","last_peered":"2024-03-16T07:28:41.572780+0000","last_clean":"2024-03-16T07:28:41.572780+0000","last_became_active":"2024-03-16T07:28:40.889033+0000","last_became_peered":"2024-03-16T07:28:40.889033+0000","last_unstale":"2024-03-16T07:28:41.572780+0000","last_undegraded":"2024-03-16T07:28:41.572780+0000","last_fullsized":"2024-03-16T07:28:41.572780+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_clean_scrub_stamp":"2024-03-16T07:28:39.861342+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:25:23.243480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.578086+0000","last_change":"2024-03-16T07:28:41.576721+0000","last_active":"2024-03-16T07:28:41.578086+0000","last_peered":"2024-03-16T07:28:41.578086+0000","last_clean":"2024-03-16T07:28:41.578086+0000","last_became_active":"2024-03-16T07:28:41.576367+0000","last_became_peered":"2024-03-16T07:28:41.576367+0000","last_unstale":"2024-03-16T07:28:41.578086+0000","last_undegraded":"2024-03-16T07:28:41.578086+0000","last_fullsized":"2024-03-16T07:28:41.578086+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:43:22.790774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"73'2","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.875258+0000","last_change":"2024-03-16T07:28:40.883154+0000","last_active":"2024-03-16T07:28:41.875258+0000","last_peered":"2024-03-16T07:28:41.875258+0000","last_clean":"2024-03-16T07:28:41.875258+0000","last_became_active":"2024-03-16T07:28:40.882887+0000","last_became_peered":"2024-03-16T07:28:40.882887+0000","last_unstale":"2024-03-16T07:28:41.875258+0000","last_undegraded":"2024-03-16T07:28:41.875258+0000","last_fullsized":"2024-03-16T07:28:41.875258+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_clean_scrub_stamp":"2024-03-16T07:28:39.861342+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:40:18.964304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.585832+0000","last_change":"2024-03-16T07:28:41.584733+0000","last_active":"2024-03-16T07:28:41.585832+0000","last_peered":"2024-03-16T07:28:41.585832+0000","last_clean":"2024-03-16T07:28:41.585832+0000","last_became_active":"2024-03-16T07:28:41.584482+0000","last_became_peered":"2024-03-16T07:28:41.584482+0000","last_unstale":"2024-03-16T07:28:41.585832+0000","last_undegraded":"2024-03-16T07:28:41.585832+0000","last_fullsized":"2024-03-16T07:28:41.585832+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:51:59.339470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.566732+0000","last_change":"2024-03-16T07:28:40.884089+0000","last_active":"2024-03-16T07:28:41.566732+0000","last_peered":"2024-03-16T07:28:41.566732+0000","last_clean":"2024-03-16T07:28:41.566732+0000","last_became_active":"2024-03-16T07:28:40.883831+0000","last_became_peered":"2024-03-16T07:28:40.883831+0000","last_unstale":"2024-03-16T07:28:41.566732+0000","last_undegraded":"2024-03-16T07:28:41.566732+0000","last_fullsized":"2024-03-16T07:28:41.566732+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_clean_scrub_stamp":"2024-03-16T07:28:39.861342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:44:36.452241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.585769+0000","last_change":"2024-03-16T07:28:41.584450+0000","last_active":"2024-03-16T07:28:41.585769+0000","last_peered":"2024-03-16T07:28:41.585769+0000","last_clean":"2024-03-16T07:28:41.585769+0000","last_became_active":"2024-03-16T07:28:41.583048+0000","last_became_peered":"2024-03-16T07:28:41.583048+0000","last_unstale":"2024-03-16T07:28:41.585769+0000","last_undegraded":"2024-03-16T07:28:41.585769+0000","last_fullsized":"2024-03-16T07:28:41.585769+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:13:25.929350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.560432+0000","last_change":"2024-03-16T07:28:40.880394+0000","last_active":"2024-03-16T07:28:41.560432+0000","last_peered":"2024-03-16T07:28:41.560432+0000","last_clean":"2024-03-16T07:28:41.560432+0000","last_became_active":"2024-03-16T07:28:40.880131+0000","last_became_peered":"2024-03-16T07:28:40.880131+0000","last_unstale":"2024-03-16T07:28:41.560432+0000","last_undegraded":"2024-03-16T07:28:41.560432+0000","last_fullsized":"2024-03-16T07:28:41.560432+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_clean_scrub_stamp":"2024-03-16T07:28:39.861342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:14:40.328662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.585881+0000","last_change":"2024-03-16T07:28:41.584622+0000","last_active":"2024-03-16T07:28:41.585881+0000","last_peered":"2024-03-16T07:28:41.585881+0000","last_clean":"2024-03-16T07:28:41.585881+0000","last_became_active":"2024-03-16T07:28:41.583267+0000","last_became_peered":"2024-03-16T07:28:41.583267+0000","last_unstale":"2024-03-16T07:28:41.585881+0000","last_undegraded":"2024-03-16T07:28:41.585881+0000","last_fullsized":"2024-03-16T07:28:41.585881+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:11:39.795157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"73'5","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.570896+0000","last_change":"2024-03-16T07:28:40.891056+0000","last_active":"2024-03-16T07:28:41.570896+0000","last_peered":"2024-03-16T07:28:41.570896+0000","last_clean":"2024-03-16T07:28:41.570896+0000","last_became_active":"2024-03-16T07:28:40.890632+0000","last_became_peered":"2024-03-16T07:28:40.890632+0000","last_unstale":"2024-03-16T07:28:41.570896+0000","last_undegraded":"2024-03-16T07:28:41.570896+0000","last_fullsized":"2024-03-16T07:28:41.570896+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_clean_scrub_stamp":"2024-03-16T07:28:39.861342+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:24:57.129852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.579545+0000","last_change":"2024-03-16T07:28:41.577118+0000","last_active":"2024-03-16T07:28:41.579545+0000","last_peered":"2024-03-16T07:28:41.579545+0000","last_clean":"2024-03-16T07:28:41.579545+0000","last_became_active":"2024-03-16T07:28:41.576870+0000","last_became_peered":"2024-03-16T07:28:41.576870+0000","last_unstale":"2024-03-16T07:28:41.579545+0000","last_undegraded":"2024-03-16T07:28:41.579545+0000","last_fullsized":"2024-03-16T07:28:41.579545+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:55:34.572521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.f","version":"73'1","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.874353+0000","last_change":"2024-03-16T07:28:40.884362+0000","last_active":"2024-03-16T07:28:41.874353+0000","last_peered":"2024-03-16T07:28:41.874353+0000","last_clean":"2024-03-16T07:28:41.874353+0000","last_became_active":"2024-03-16T07:28:40.883691+0000","last_became_peered":"2024-03-16T07:28:40.883691+0000","last_unstale":"2024-03-16T07:28:41.874353+0000","last_undegraded":"2024-03-16T07:28:41.874353+0000","last_fullsized":"2024-03-16T07:28:41.874353+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_clean_scrub_stamp":"2024-03-16T07:28:39.861342+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:45:07.242723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.575461+0000","last_change":"2024-03-16T07:28:41.571334+0000","last_active":"2024-03-16T07:28:41.575461+0000","last_peered":"2024-03-16T07:28:41.575461+0000","last_clean":"2024-03-16T07:28:41.575461+0000","last_became_active":"2024-03-16T07:28:41.571041+0000","last_became_peered":"2024-03-16T07:28:41.571041+0000","last_unstale":"2024-03-16T07:28:41.575461+0000","last_undegraded":"2024-03-16T07:28:41.575461+0000","last_fullsized":"2024-03-16T07:28:41.575461+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:00:45.561416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.e","version":"73'2","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.570475+0000","last_change":"2024-03-16T07:28:40.889189+0000","last_active":"2024-03-16T07:28:41.570475+0000","last_peered":"2024-03-16T07:28:41.570475+0000","last_clean":"2024-03-16T07:28:41.570475+0000","last_became_active":"2024-03-16T07:28:40.886103+0000","last_became_peered":"2024-03-16T07:28:40.886103+0000","last_unstale":"2024-03-16T07:28:41.570475+0000","last_undegraded":"2024-03-16T07:28:41.570475+0000","last_fullsized":"2024-03-16T07:28:41.570475+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_clean_scrub_stamp":"2024-03-16T07:28:39.861342+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:03:01.754754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.578204+0000","last_change":"2024-03-16T07:28:41.576599+0000","last_active":"2024-03-16T07:28:41.578204+0000","last_peered":"2024-03-16T07:28:41.578204+0000","last_clean":"2024-03-16T07:28:41.578204+0000","last_became_active":"2024-03-16T07:28:41.576352+0000","last_became_peered":"2024-03-16T07:28:41.576352+0000","last_unstale":"2024-03-16T07:28:41.578204+0000","last_undegraded":"2024-03-16T07:28:41.578204+0000","last_fullsized":"2024-03-16T07:28:41.578204+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:49:43.485782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.572923+0000","last_change":"2024-03-16T07:28:40.891054+0000","last_active":"2024-03-16T07:28:41.572923+0000","last_peered":"2024-03-16T07:28:41.572923+0000","last_clean":"2024-03-16T07:28:41.572923+0000","last_became_active":"2024-03-16T07:28:40.890675+0000","last_became_peered":"2024-03-16T07:28:40.890675+0000","last_unstale":"2024-03-16T07:28:41.572923+0000","last_undegraded":"2024-03-16T07:28:41.572923+0000","last_fullsized":"2024-03-16T07:28:41.572923+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_clean_scrub_stamp":"2024-03-16T07:28:39.861342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:42:34.511753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.575642+0000","last_change":"2024-03-16T07:28:41.571632+0000","last_active":"2024-03-16T07:28:41.575642+0000","last_peered":"2024-03-16T07:28:41.575642+0000","last_clean":"2024-03-16T07:28:41.575642+0000","last_became_active":"2024-03-16T07:28:41.571014+0000","last_became_peered":"2024-03-16T07:28:41.571014+0000","last_unstale":"2024-03-16T07:28:41.575642+0000","last_undegraded":"2024-03-16T07:28:41.575642+0000","last_fullsized":"2024-03-16T07:28:41.575642+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:39:54.396263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"73'2","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.873824+0000","last_change":"2024-03-16T07:28:40.890368+0000","last_active":"2024-03-16T07:28:41.873824+0000","last_peered":"2024-03-16T07:28:41.873824+0000","last_clean":"2024-03-16T07:28:41.873824+0000","last_became_active":"2024-03-16T07:28:40.889977+0000","last_became_peered":"2024-03-16T07:28:40.889977+0000","last_unstale":"2024-03-16T07:28:41.873824+0000","last_undegraded":"2024-03-16T07:28:41.873824+0000","last_fullsized":"2024-03-16T07:28:41.873824+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_clean_scrub_stamp":"2024-03-16T07:28:39.861342+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:13:21.940217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.575901+0000","last_change":"2024-03-16T07:28:41.573020+0000","last_active":"2024-03-16T07:28:41.575901+0000","last_peered":"2024-03-16T07:28:41.575901+0000","last_clean":"2024-03-16T07:28:41.575901+0000","last_became_active":"2024-03-16T07:28:41.572167+0000","last_became_peered":"2024-03-16T07:28:41.572167+0000","last_unstale":"2024-03-16T07:28:41.575901+0000","last_undegraded":"2024-03-16T07:28:41.575901+0000","last_fullsized":"2024-03-16T07:28:41.575901+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:29:37.170019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.560625+0000","last_change":"2024-03-16T07:28:40.878850+0000","last_active":"2024-03-16T07:28:41.560625+0000","last_peered":"2024-03-16T07:28:41.560625+0000","last_clean":"2024-03-16T07:28:41.560625+0000","last_became_active":"2024-03-16T07:28:40.878359+0000","last_became_peered":"2024-03-16T07:28:40.878359+0000","last_unstale":"2024-03-16T07:28:41.560625+0000","last_undegraded":"2024-03-16T07:28:41.560625+0000","last_fullsized":"2024-03-16T07:28:41.560625+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_clean_scrub_stamp":"2024-03-16T07:28:39.861342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:43:24.007718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.583319+0000","last_change":"2024-03-16T07:28:41.580177+0000","last_active":"2024-03-16T07:28:41.583319+0000","last_peered":"2024-03-16T07:28:41.583319+0000","last_clean":"2024-03-16T07:28:41.583319+0000","last_became_active":"2024-03-16T07:28:41.579841+0000","last_became_peered":"2024-03-16T07:28:41.579841+0000","last_unstale":"2024-03-16T07:28:41.583319+0000","last_undegraded":"2024-03-16T07:28:41.583319+0000","last_fullsized":"2024-03-16T07:28:41.583319+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:18:48.716783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.560487+0000","last_change":"2024-03-16T07:28:40.881199+0000","last_active":"2024-03-16T07:28:41.560487+0000","last_peered":"2024-03-16T07:28:41.560487+0000","last_clean":"2024-03-16T07:28:41.560487+0000","last_became_active":"2024-03-16T07:28:40.880911+0000","last_became_peered":"2024-03-16T07:28:40.880911+0000","last_unstale":"2024-03-16T07:28:41.560487+0000","last_undegraded":"2024-03-16T07:28:41.560487+0000","last_fullsized":"2024-03-16T07:28:41.560487+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_clean_scrub_stamp":"2024-03-16T07:28:39.861342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:21:43.748833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.583364+0000","last_change":"2024-03-16T07:28:41.580467+0000","last_active":"2024-03-16T07:28:41.583364+0000","last_peered":"2024-03-16T07:28:41.583364+0000","last_clean":"2024-03-16T07:28:41.583364+0000","last_became_active":"2024-03-16T07:28:41.579919+0000","last_became_peered":"2024-03-16T07:28:41.579919+0000","last_unstale":"2024-03-16T07:28:41.583364+0000","last_undegraded":"2024-03-16T07:28:41.583364+0000","last_fullsized":"2024-03-16T07:28:41.583364+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:57:22.199053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.562037+0000","last_change":"2024-03-16T07:28:40.878754+0000","last_active":"2024-03-16T07:28:41.562037+0000","last_peered":"2024-03-16T07:28:41.562037+0000","last_clean":"2024-03-16T07:28:41.562037+0000","last_became_active":"2024-03-16T07:28:40.878452+0000","last_became_peered":"2024-03-16T07:28:40.878452+0000","last_unstale":"2024-03-16T07:28:41.562037+0000","last_undegraded":"2024-03-16T07:28:41.562037+0000","last_fullsized":"2024-03-16T07:28:41.562037+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_clean_scrub_stamp":"2024-03-16T07:28:39.861342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:41:14.355084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.579563+0000","last_change":"2024-03-16T07:28:41.577897+0000","last_active":"2024-03-16T07:28:41.579563+0000","last_peered":"2024-03-16T07:28:41.579563+0000","last_clean":"2024-03-16T07:28:41.579563+0000","last_became_active":"2024-03-16T07:28:41.577214+0000","last_became_peered":"2024-03-16T07:28:41.577214+0000","last_unstale":"2024-03-16T07:28:41.579563+0000","last_undegraded":"2024-03-16T07:28:41.579563+0000","last_fullsized":"2024-03-16T07:28:41.579563+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:32:55.227706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.7","version":"73'2","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.874382+0000","last_change":"2024-03-16T07:28:40.887728+0000","last_active":"2024-03-16T07:28:41.874382+0000","last_peered":"2024-03-16T07:28:41.874382+0000","last_clean":"2024-03-16T07:28:41.874382+0000","last_became_active":"2024-03-16T07:28:40.887133+0000","last_became_peered":"2024-03-16T07:28:40.887133+0000","last_unstale":"2024-03-16T07:28:41.874382+0000","last_undegraded":"2024-03-16T07:28:41.874382+0000","last_fullsized":"2024-03-16T07:28:41.874382+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_clean_scrub_stamp":"2024-03-16T07:28:39.861342+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:26:59.911899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.586356+0000","last_change":"2024-03-16T07:28:41.585466+0000","last_active":"2024-03-16T07:28:41.586356+0000","last_peered":"2024-03-16T07:28:41.586356+0000","last_clean":"2024-03-16T07:28:41.586356+0000","last_became_active":"2024-03-16T07:28:41.585226+0000","last_became_peered":"2024-03-16T07:28:41.585226+0000","last_unstale":"2024-03-16T07:28:41.586356+0000","last_undegraded":"2024-03-16T07:28:41.586356+0000","last_fullsized":"2024-03-16T07:28:41.586356+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:18:39.708516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.564601+0000","last_change":"2024-03-16T07:28:40.882367+0000","last_active":"2024-03-16T07:28:41.564601+0000","last_peered":"2024-03-16T07:28:41.564601+0000","last_clean":"2024-03-16T07:28:41.564601+0000","last_became_active":"2024-03-16T07:28:40.882075+0000","last_became_peered":"2024-03-16T07:28:40.882075+0000","last_unstale":"2024-03-16T07:28:41.564601+0000","last_undegraded":"2024-03-16T07:28:41.564601+0000","last_fullsized":"2024-03-16T07:28:41.564601+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_clean_scrub_stamp":"2024-03-16T07:28:39.861342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:40:12.565428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.581285+0000","last_change":"2024-03-16T07:28:41.579252+0000","last_active":"2024-03-16T07:28:41.581285+0000","last_peered":"2024-03-16T07:28:41.581285+0000","last_clean":"2024-03-16T07:28:41.581285+0000","last_became_active":"2024-03-16T07:28:41.579005+0000","last_became_peered":"2024-03-16T07:28:41.579005+0000","last_unstale":"2024-03-16T07:28:41.581285+0000","last_undegraded":"2024-03-16T07:28:41.581285+0000","last_fullsized":"2024-03-16T07:28:41.581285+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:00:52.036688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.569455+0000","last_change":"2024-03-16T07:28:40.889130+0000","last_active":"2024-03-16T07:28:41.569455+0000","last_peered":"2024-03-16T07:28:41.569455+0000","last_clean":"2024-03-16T07:28:41.569455+0000","last_became_active":"2024-03-16T07:28:40.888858+0000","last_became_peered":"2024-03-16T07:28:40.888858+0000","last_unstale":"2024-03-16T07:28:41.569455+0000","last_undegraded":"2024-03-16T07:28:41.569455+0000","last_fullsized":"2024-03-16T07:28:41.569455+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_clean_scrub_stamp":"2024-03-16T07:28:39.861342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:53:46.531176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.575850+0000","last_change":"2024-03-16T07:28:41.573311+0000","last_active":"2024-03-16T07:28:41.575850+0000","last_peered":"2024-03-16T07:28:41.575850+0000","last_clean":"2024-03-16T07:28:41.575850+0000","last_became_active":"2024-03-16T07:28:41.572424+0000","last_became_peered":"2024-03-16T07:28:41.572424+0000","last_unstale":"2024-03-16T07:28:41.575850+0000","last_undegraded":"2024-03-16T07:28:41.575850+0000","last_fullsized":"2024-03-16T07:28:41.575850+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:07:53.076520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.561426+0000","last_change":"2024-03-16T07:28:40.880251+0000","last_active":"2024-03-16T07:28:41.561426+0000","last_peered":"2024-03-16T07:28:41.561426+0000","last_clean":"2024-03-16T07:28:41.561426+0000","last_became_active":"2024-03-16T07:28:40.879971+0000","last_became_peered":"2024-03-16T07:28:40.879971+0000","last_unstale":"2024-03-16T07:28:41.561426+0000","last_undegraded":"2024-03-16T07:28:41.561426+0000","last_fullsized":"2024-03-16T07:28:41.561426+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_clean_scrub_stamp":"2024-03-16T07:28:39.861342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:13:24.928381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.584435+0000","last_change":"2024-03-16T07:28:41.583018+0000","last_active":"2024-03-16T07:28:41.584435+0000","last_peered":"2024-03-16T07:28:41.584435+0000","last_clean":"2024-03-16T07:28:41.584435+0000","last_became_active":"2024-03-16T07:28:41.581147+0000","last_became_peered":"2024-03-16T07:28:41.581147+0000","last_unstale":"2024-03-16T07:28:41.584435+0000","last_undegraded":"2024-03-16T07:28:41.584435+0000","last_fullsized":"2024-03-16T07:28:41.584435+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:42:49.724956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.569563+0000","last_change":"2024-03-16T07:28:40.889809+0000","last_active":"2024-03-16T07:28:41.569563+0000","last_peered":"2024-03-16T07:28:41.569563+0000","last_clean":"2024-03-16T07:28:41.569563+0000","last_became_active":"2024-03-16T07:28:40.889330+0000","last_became_peered":"2024-03-16T07:28:40.889330+0000","last_unstale":"2024-03-16T07:28:41.569563+0000","last_undegraded":"2024-03-16T07:28:41.569563+0000","last_fullsized":"2024-03-16T07:28:41.569563+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_clean_scrub_stamp":"2024-03-16T07:28:39.861342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:35:52.160999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.579873+0000","last_change":"2024-03-16T07:28:41.578826+0000","last_active":"2024-03-16T07:28:41.579873+0000","last_peered":"2024-03-16T07:28:41.579873+0000","last_clean":"2024-03-16T07:28:41.579873+0000","last_became_active":"2024-03-16T07:28:41.578575+0000","last_became_peered":"2024-03-16T07:28:41.578575+0000","last_unstale":"2024-03-16T07:28:41.579873+0000","last_undegraded":"2024-03-16T07:28:41.579873+0000","last_fullsized":"2024-03-16T07:28:41.579873+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:14:10.641625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.561214+0000","last_change":"2024-03-16T07:28:40.878633+0000","last_active":"2024-03-16T07:28:41.561214+0000","last_peered":"2024-03-16T07:28:41.561214+0000","last_clean":"2024-03-16T07:28:41.561214+0000","last_became_active":"2024-03-16T07:28:40.878286+0000","last_became_peered":"2024-03-16T07:28:40.878286+0000","last_unstale":"2024-03-16T07:28:41.561214+0000","last_undegraded":"2024-03-16T07:28:41.561214+0000","last_fullsized":"2024-03-16T07:28:41.561214+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_clean_scrub_stamp":"2024-03-16T07:28:39.861342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:23:46.664218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.576437+0000","last_change":"2024-03-16T07:28:41.575151+0000","last_active":"2024-03-16T07:28:41.576437+0000","last_peered":"2024-03-16T07:28:41.576437+0000","last_clean":"2024-03-16T07:28:41.576437+0000","last_became_active":"2024-03-16T07:28:41.573833+0000","last_became_peered":"2024-03-16T07:28:41.573833+0000","last_unstale":"2024-03-16T07:28:41.576437+0000","last_undegraded":"2024-03-16T07:28:41.576437+0000","last_fullsized":"2024-03-16T07:28:41.576437+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:57:13.275380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.564007+0000","last_change":"2024-03-16T07:28:40.882270+0000","last_active":"2024-03-16T07:28:41.564007+0000","last_peered":"2024-03-16T07:28:41.564007+0000","last_clean":"2024-03-16T07:28:41.564007+0000","last_became_active":"2024-03-16T07:28:40.882028+0000","last_became_peered":"2024-03-16T07:28:40.882028+0000","last_unstale":"2024-03-16T07:28:41.564007+0000","last_undegraded":"2024-03-16T07:28:41.564007+0000","last_fullsized":"2024-03-16T07:28:41.564007+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_clean_scrub_stamp":"2024-03-16T07:28:39.861342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:56:29.041650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.574637+0000","last_change":"2024-03-16T07:28:41.573973+0000","last_active":"2024-03-16T07:28:41.574637+0000","last_peered":"2024-03-16T07:28:41.574637+0000","last_clean":"2024-03-16T07:28:41.574637+0000","last_became_active":"2024-03-16T07:28:41.573727+0000","last_became_peered":"2024-03-16T07:28:41.573727+0000","last_unstale":"2024-03-16T07:28:41.574637+0000","last_undegraded":"2024-03-16T07:28:41.574637+0000","last_fullsized":"2024-03-16T07:28:41.574637+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:58:33.191129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.571055+0000","last_change":"2024-03-16T07:28:40.889413+0000","last_active":"2024-03-16T07:28:41.571055+0000","last_peered":"2024-03-16T07:28:41.571055+0000","last_clean":"2024-03-16T07:28:41.571055+0000","last_became_active":"2024-03-16T07:28:40.886509+0000","last_became_peered":"2024-03-16T07:28:40.886509+0000","last_unstale":"2024-03-16T07:28:41.571055+0000","last_undegraded":"2024-03-16T07:28:41.571055+0000","last_fullsized":"2024-03-16T07:28:41.571055+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_clean_scrub_stamp":"2024-03-16T07:28:39.861342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:48:28.551260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.587704+0000","last_change":"2024-03-16T07:28:41.586465+0000","last_active":"2024-03-16T07:28:41.587704+0000","last_peered":"2024-03-16T07:28:41.587704+0000","last_clean":"2024-03-16T07:28:41.587704+0000","last_became_active":"2024-03-16T07:28:41.586201+0000","last_became_peered":"2024-03-16T07:28:41.586201+0000","last_unstale":"2024-03-16T07:28:41.587704+0000","last_undegraded":"2024-03-16T07:28:41.587704+0000","last_fullsized":"2024-03-16T07:28:41.587704+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:57:26.350308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"73'1","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.875000+0000","last_change":"2024-03-16T07:28:40.883217+0000","last_active":"2024-03-16T07:28:41.875000+0000","last_peered":"2024-03-16T07:28:41.875000+0000","last_clean":"2024-03-16T07:28:41.875000+0000","last_became_active":"2024-03-16T07:28:40.882980+0000","last_became_peered":"2024-03-16T07:28:40.882980+0000","last_unstale":"2024-03-16T07:28:41.875000+0000","last_undegraded":"2024-03-16T07:28:41.875000+0000","last_fullsized":"2024-03-16T07:28:41.875000+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_clean_scrub_stamp":"2024-03-16T07:28:39.861342+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:07:49.913968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"58'141","reported_seq":412,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-03-16T07:28:41.565759+0000","last_change":"2024-03-16T07:24:31.650537+0000","last_active":"2024-03-16T07:28:41.565759+0000","last_peered":"2024-03-16T07:28:41.565759+0000","last_clean":"2024-03-16T07:28:41.565759+0000","last_became_active":"2024-03-16T07:24:31.649574+0000","last_became_peered":"2024-03-16T07:24:31.649574+0000","last_unstale":"2024-03-16T07:28:41.565759+0000","last_undegraded":"2024-03-16T07:28:41.565759+0000","last_fullsized":"2024-03-16T07:28:41.565759+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:29.719970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:29.719970+0000","last_clean_scrub_stamp":"2024-03-16T07:24:29.719970+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:31:35.774554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":490,"num_read_kb":915,"num_write":217,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":798,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":29,"ondisk_log_size":29,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":490,"num_read_kb":915,"num_write":217,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":141,"ondisk_log_size":141,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738419,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":31900,"kb_used_data":712,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":104825700,"statfs":{"total":107374182400,"available":107341516800,"internally_reserved":0,"allocated":729088,"data_stored":287417,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738419,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":32480,"kb_used_data":1292,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":104825120,"statfs":{"total":107374182400,"available":107340922880,"internally_reserved":0,"allocated":1323008,"data_stored":877785,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738419,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":32468,"kb_used_data":1284,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":104825132,"statfs":{"total":107374182400,"available":107340935168,"internally_reserved":0,"allocated":1314816,"data_stored":873320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-16T07:28:46.322 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-03-16T07:28:46.322 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-03-16T07:28:46.745 INFO:teuthology.orchestra.run.smithi049.stdout:[client.0] 2024-03-16T07:28:46.745 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQAaSfVlmBmvGRAAaxdhkajaioVlq23dyv/g4g== 2024-03-16T07:28:46.745 INFO:teuthology.orchestra.run.smithi049.stdout: caps mds = "allow" 2024-03-16T07:28:46.745 INFO:teuthology.orchestra.run.smithi049.stdout: caps mon = "allow r" 2024-03-16T07:28:46.745 INFO:teuthology.orchestra.run.smithi049.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-03-16T07:28:46.745 INFO:teuthology.orchestra.run.smithi049.stderr:updated caps for client.0 2024-03-16T07:28:46.758 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T07:28:47.098 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:28:47.098 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":51,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5259,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6827/3159374847","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":3159374847},{"type":"v1","addr":"172.21.15.49:6827","nonce":3159374847}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":46},{"gid":5260,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6829/626442568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":626442568},{"type":"v1","addr":"172.21.15.49:6829","nonce":626442568}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":46},{"gid":5267,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6831/3455133872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":3455133872},{"type":"v1","addr":"172.21.15.49:6831","nonce":3455133872}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":46},{"gid":5268,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6833/1067362108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":1067362108},{"type":"v1","addr":"172.21.15.49:6833","nonce":1067362108}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":46}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-16T07:28:41.244463+0000","modified":"2024-03-16T07:28:44.360549+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5269":{"gid":5269,"name":"e","rank":0,"incarnation":47,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6835/647809721","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":647809721},{"type":"v1","addr":"172.21.15.49:6835","nonce":647809721}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5269,"qdb_cluster":[5269]},"id":6}]} 2024-03-16T07:28:47.099 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 51 2024-03-16T07:28:47.534 INFO:tasks.ceph.mds.e.smithi049.stderr:2024-03-16T07:28:47.535+0000 7effa3fbd640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-03-16T07:28:47.614 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 51, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-03-16T07:28:41.244463+0000', 'modified': '2024-03-16T07:28:44.360549+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5269}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5269': {'gid': 5269, 'name': 'e', 'rank': 0, 'incarnation': 47, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.49:6835/647809721', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.49:6834', 'nonce': 647809721}, {'type': 'v1', 'addr': '172.21.15.49:6835', 'nonce': 647809721}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5269, 'qdb_cluster': [5269]} 2024-03-16T07:28:47.614 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-03-16T07:28:47.614 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.e status 2024-03-16T07:28:47.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-16T07:28:47.736+0000 7f9dceffd640 0 client.5328 ms_handle_reset on v2:172.21.15.49:6834/647809721 2024-03-16T07:28:47.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-16T07:28:47.759+0000 7f9dceffd640 0 client.5330 ms_handle_reset on v2:172.21.15.49:6834/647809721 2024-03-16T07:28:47.759 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-03-16T07:28:47.759 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_fsid": "f91af061-9eac-4793-87fa-8d27ae3d242f", 2024-03-16T07:28:47.759 INFO:teuthology.orchestra.run.smithi049.stdout: "whoami": 0, 2024-03-16T07:28:47.759 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 5269, 2024-03-16T07:28:47.759 INFO:teuthology.orchestra.run.smithi049.stdout: "want_state": "up:active", 2024-03-16T07:28:47.759 INFO:teuthology.orchestra.run.smithi049.stdout: "state": "up:active", 2024-03-16T07:28:47.759 INFO:teuthology.orchestra.run.smithi049.stdout: "fs_name": "cephfs", 2024-03-16T07:28:47.759 INFO:teuthology.orchestra.run.smithi049.stdout: "rank_uptime": 5.8948876930000003, 2024-03-16T07:28:47.759 INFO:teuthology.orchestra.run.smithi049.stdout: "mdsmap_epoch": 51, 2024-03-16T07:28:47.759 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch": 74, 2024-03-16T07:28:47.759 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch_barrier": 74, 2024-03-16T07:28:47.760 INFO:teuthology.orchestra.run.smithi049.stdout: "uptime": 11.17254127 2024-03-16T07:28:47.760 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-03-16T07:28:47.770 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-03-16T07:28:48.121 INFO:teuthology.orchestra.run.smithi049.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-03-16T07:28:48.133 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-03-16T07:28:48.133 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-03-16T07:28:48.134 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi049.front.sepia.ceph.com 2024-03-16T07:28:48.134 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-03-16T07:28:48.134 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-03-16T07:28:48.134 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-03-16T07:28:48.134 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-03-16T07:28:48.134 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-03-16T07:28:48.134 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-03-16T07:28:48.134 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:28:48.134 DEBUG:teuthology.orchestra.run.smithi049:> ip addr 2024-03-16T07:28:48.150 INFO:teuthology.orchestra.run.smithi049.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-16T07:28:48.150 INFO:teuthology.orchestra.run.smithi049.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-16T07:28:48.150 INFO:teuthology.orchestra.run.smithi049.stdout: inet 127.0.0.1/8 scope host lo 2024-03-16T07:28:48.150 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-03-16T07:28:48.150 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 ::1/128 scope host 2024-03-16T07:28:48.150 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-03-16T07:28:48.150 INFO:teuthology.orchestra.run.smithi049.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-16T07:28:48.150 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:6b:ff:84 brd ff:ff:ff:ff:ff:ff 2024-03-16T07:28:48.150 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp7s0f0 2024-03-16T07:28:48.150 INFO:teuthology.orchestra.run.smithi049.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-16T07:28:48.150 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:6b:ff:85 brd ff:ff:ff:ff:ff:ff 2024-03-16T07:28:48.151 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp7s0f1 2024-03-16T07:28:48.151 INFO:teuthology.orchestra.run.smithi049.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-03-16T07:28:48.151 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:bd:15:66 brd ff:ff:ff:ff:ff:ff 2024-03-16T07:28:48.151 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp1s0f0 2024-03-16T07:28:48.151 INFO:teuthology.orchestra.run.smithi049.stdout: inet 172.21.15.49/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-03-16T07:28:48.151 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft 42179sec preferred_lft 42179sec 2024-03-16T07:28:48.151 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::ec4:7aff:febd:1566/64 scope link noprefixroute 2024-03-16T07:28:48.151 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-03-16T07:28:48.151 INFO:teuthology.orchestra.run.smithi049.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-16T07:28:48.151 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:bd:15:67 brd ff:ff:ff:ff:ff:ff 2024-03-16T07:28:48.151 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp1s0f1 2024-03-16T07:28:48.151 INFO:teuthology.orchestra.run.smithi049.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-03-16T07:28:48.151 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether a2:f1:88:c1:22:e7 brd ff:ff:ff:ff:ff:ff 2024-03-16T07:28:48.151 INFO:teuthology.orchestra.run.smithi049.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-03-16T07:28:48.152 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-03-16T07:28:48.152 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::e0e6:55ff:fe4d:1d68/64 scope link 2024-03-16T07:28:48.152 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-03-16T07:28:48.152 INFO:teuthology.orchestra.run.smithi049.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-03-16T07:28:48.152 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether ee:10:71:d7:68:c4 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-16T07:28:48.152 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::ec10:71ff:fed7:68c4/64 scope link 2024-03-16T07:28:48.152 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-03-16T07:28:48.152 INFO:teuthology.orchestra.run.smithi049.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-03-16T07:28:48.152 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether a2:f1:88:c1:22:e7 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-16T07:28:48.152 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::a0f1:88ff:fec1:22e7/64 scope link 2024-03-16T07:28:48.152 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-03-16T07:28:48.152 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:28:48.153 DEBUG:teuthology.orchestra.run.smithi049:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-03-16T07:28:48.219 INFO:teuthology.orchestra.run.smithi049.stdout:1 2024-03-16T07:28:48.221 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:28:48.221 DEBUG:teuthology.orchestra.run.smithi049:> route 2024-03-16T07:28:48.278 INFO:teuthology.orchestra.run.smithi049.stdout:Kernel IP routing table 2024-03-16T07:28:48.278 INFO:teuthology.orchestra.run.smithi049.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-03-16T07:28:48.278 INFO:teuthology.orchestra.run.smithi049.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-03-16T07:28:48.278 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-03-16T07:28:48.278 INFO:teuthology.orchestra.run.smithi049.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-03-16T07:28:48.279 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-16T07:28:48.279 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-03-16T07:28:48.279 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-03-16T07:28:48.279 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-03-16T07:28:48.279 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-03-16T07:28:48.279 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-03-16T07:28:48.385 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-16T07:28:48 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-16T07:28:48.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-16T07:28:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-16T07:28:48.443 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:28:48.443 DEBUG:teuthology.orchestra.run.smithi049:> ip netns list 2024-03-16T07:28:48.458 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 1) 2024-03-16T07:28:48.458 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-03-16T07:28:48.458 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-03-16T07:28:48.458 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:28:48.458 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link set brx.0 up 2024-03-16T07:28:48.529 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-03-16T07:28:48.529 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-16T07:28:48.529 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-03-16T07:28:48.585 INFO:teuthology.orchestra.run.smithi049.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-03-16T07:28:48.585 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-16T07:28:48.585 DEBUG:teuthology.orchestra.run.smithi049:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-03-16T07:28:48.639 DEBUG:teuthology.orchestra.run.smithi049:> sudo modprobe fuse 2024-03-16T07:28:48.711 DEBUG:teuthology.orchestra.run.smithi049:> cat /proc/self/mounts | awk '{print $2}' 2024-03-16T07:28:48.767 INFO:teuthology.orchestra.run.smithi049.stdout:/proc 2024-03-16T07:28:48.767 INFO:teuthology.orchestra.run.smithi049.stdout:/sys 2024-03-16T07:28:48.767 INFO:teuthology.orchestra.run.smithi049.stdout:/dev 2024-03-16T07:28:48.768 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/security 2024-03-16T07:28:48.768 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/shm 2024-03-16T07:28:48.768 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/pts 2024-03-16T07:28:48.768 INFO:teuthology.orchestra.run.smithi049.stdout:/run 2024-03-16T07:28:48.768 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/cgroup 2024-03-16T07:28:48.768 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/pstore 2024-03-16T07:28:48.768 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/bpf 2024-03-16T07:28:48.768 INFO:teuthology.orchestra.run.smithi049.stdout:/ 2024-03-16T07:28:48.768 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/selinux 2024-03-16T07:28:48.768 INFO:teuthology.orchestra.run.smithi049.stdout:/proc/sys/fs/binfmt_misc 2024-03-16T07:28:48.768 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/mqueue 2024-03-16T07:28:48.768 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/hugepages 2024-03-16T07:28:48.768 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/debug 2024-03-16T07:28:48.768 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/tracing 2024-03-16T07:28:48.768 INFO:teuthology.orchestra.run.smithi049.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-03-16T07:28:48.768 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/fuse/connections 2024-03-16T07:28:48.769 INFO:teuthology.orchestra.run.smithi049.stdout:/run/credentials/systemd-sysctl.service 2024-03-16T07:28:48.769 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/config 2024-03-16T07:28:48.769 INFO:teuthology.orchestra.run.smithi049.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-03-16T07:28:48.769 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/nfs/rpc_pipefs 2024-03-16T07:28:48.769 INFO:teuthology.orchestra.run.smithi049.stdout:/run/user/1000 2024-03-16T07:28:48.769 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph 2024-03-16T07:28:48.769 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-0 2024-03-16T07:28:48.769 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-1 2024-03-16T07:28:48.769 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-2 2024-03-16T07:28:48.769 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns 2024-03-16T07:28:48.769 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-16T07:28:48.769 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-16T07:28:48.769 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-16T07:28:48.769 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-16T07:28:48.770 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:28:48.770 DEBUG:teuthology.orchestra.run.smithi049:> ls /sys/fs/fuse/connections 2024-03-16T07:28:48.826 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-03-16T07:28:48.826 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-03-16T07:28:48.868 DEBUG:teuthology.orchestra.run.smithi049:> sudo modprobe fuse 2024-03-16T07:28:48.903 DEBUG:teuthology.orchestra.run.smithi049:> cat /proc/self/mounts | awk '{print $2}' 2024-03-16T07:28:48.959 INFO:teuthology.orchestra.run.smithi049.stdout:/proc 2024-03-16T07:28:48.959 INFO:teuthology.orchestra.run.smithi049.stdout:/sys 2024-03-16T07:28:48.960 INFO:teuthology.orchestra.run.smithi049.stdout:/dev 2024-03-16T07:28:48.960 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/security 2024-03-16T07:28:48.960 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/shm 2024-03-16T07:28:48.960 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/pts 2024-03-16T07:28:48.960 INFO:teuthology.orchestra.run.smithi049.stdout:/run 2024-03-16T07:28:48.960 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/cgroup 2024-03-16T07:28:48.960 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/pstore 2024-03-16T07:28:48.960 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/bpf 2024-03-16T07:28:48.960 INFO:teuthology.orchestra.run.smithi049.stdout:/ 2024-03-16T07:28:48.960 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/selinux 2024-03-16T07:28:48.960 INFO:teuthology.orchestra.run.smithi049.stdout:/proc/sys/fs/binfmt_misc 2024-03-16T07:28:48.960 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/mqueue 2024-03-16T07:28:48.960 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/hugepages 2024-03-16T07:28:48.960 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/debug 2024-03-16T07:28:48.960 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/tracing 2024-03-16T07:28:48.961 INFO:teuthology.orchestra.run.smithi049.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-03-16T07:28:48.961 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/fuse/connections 2024-03-16T07:28:48.961 INFO:teuthology.orchestra.run.smithi049.stdout:/run/credentials/systemd-sysctl.service 2024-03-16T07:28:48.961 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/config 2024-03-16T07:28:48.961 INFO:teuthology.orchestra.run.smithi049.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-03-16T07:28:48.961 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/nfs/rpc_pipefs 2024-03-16T07:28:48.961 INFO:teuthology.orchestra.run.smithi049.stdout:/run/user/1000 2024-03-16T07:28:48.961 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph 2024-03-16T07:28:48.961 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-0 2024-03-16T07:28:48.961 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-1 2024-03-16T07:28:48.961 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-2 2024-03-16T07:28:48.961 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns 2024-03-16T07:28:48.961 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-16T07:28:48.961 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-16T07:28:48.961 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-16T07:28:48.962 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-16T07:28:48.962 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:28:48.962 DEBUG:teuthology.orchestra.run.smithi049:> ls /sys/fs/fuse/connections 2024-03-16T07:28:48.966 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi049.stderr:2024-03-16T07:28:48.967+0000 7f8569841480 -1 init, newargv = 0x5639eda6fd40 newargc=15 2024-03-16T07:28:48.966 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi049.stderr:ceph-fuse[58887]: starting ceph client 2024-03-16T07:28:48.970 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi049.stderr:ceph-fuse[58887]: starting fuse 2024-03-16T07:28:48.982 INFO:teuthology.orchestra.run.smithi049.stdout:41 2024-03-16T07:28:48.982 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2024-03-16T07:28:48.982 DEBUG:teuthology.orchestra.run.smithi049:> sudo stdin-killer -- python3 -c ' 2024-03-16T07:28:48.982 DEBUG:teuthology.orchestra.run.smithi049:> import glob 2024-03-16T07:28:48.982 DEBUG:teuthology.orchestra.run.smithi049:> import re 2024-03-16T07:28:48.982 DEBUG:teuthology.orchestra.run.smithi049:> import os 2024-03-16T07:28:48.982 DEBUG:teuthology.orchestra.run.smithi049:> import subprocess 2024-03-16T07:28:48.982 DEBUG:teuthology.orchestra.run.smithi049:> 2024-03-16T07:28:48.983 DEBUG:teuthology.orchestra.run.smithi049:> def _find_admin_socket(client_name): 2024-03-16T07:28:48.983 DEBUG:teuthology.orchestra.run.smithi049:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-03-16T07:28:48.983 DEBUG:teuthology.orchestra.run.smithi049:> files = glob.glob(asok_path) 2024-03-16T07:28:48.983 DEBUG:teuthology.orchestra.run.smithi049:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-03-16T07:28:48.983 DEBUG:teuthology.orchestra.run.smithi049:> 2024-03-16T07:28:48.983 DEBUG:teuthology.orchestra.run.smithi049:> # Given a non-glob path, it better be there 2024-03-16T07:28:48.983 DEBUG:teuthology.orchestra.run.smithi049:> if "*" not in asok_path: 2024-03-16T07:28:48.983 DEBUG:teuthology.orchestra.run.smithi049:> assert(len(files) == 1) 2024-03-16T07:28:48.983 DEBUG:teuthology.orchestra.run.smithi049:> return files[0] 2024-03-16T07:28:48.983 DEBUG:teuthology.orchestra.run.smithi049:> 2024-03-16T07:28:48.983 DEBUG:teuthology.orchestra.run.smithi049:> for f in files: 2024-03-16T07:28:48.983 DEBUG:teuthology.orchestra.run.smithi049:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-03-16T07:28:48.983 DEBUG:teuthology.orchestra.run.smithi049:> if os.path.exists("/proc/{0}".format(pid)): 2024-03-16T07:28:48.983 DEBUG:teuthology.orchestra.run.smithi049:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-03-16T07:28:48.983 DEBUG:teuthology.orchestra.run.smithi049:> contents = proc_f.read() 2024-03-16T07:28:48.983 DEBUG:teuthology.orchestra.run.smithi049:> if mountpoint in contents: 2024-03-16T07:28:48.983 DEBUG:teuthology.orchestra.run.smithi049:> return f 2024-03-16T07:28:48.984 DEBUG:teuthology.orchestra.run.smithi049:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-03-16T07:28:48.984 DEBUG:teuthology.orchestra.run.smithi049:> 2024-03-16T07:28:48.984 DEBUG:teuthology.orchestra.run.smithi049:> print(_find_admin_socket("client.0")) 2024-03-16T07:28:48.984 DEBUG:teuthology.orchestra.run.smithi049:> ' 2024-03-16T07:28:49.107 INFO:teuthology.orchestra.run.smithi049.stdout:/var/run/ceph/ceph-client.0.58887.asok 2024-03-16T07:28:49.110 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-16T07:28:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-16T07:28:49.117 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.58887.asok 2024-03-16T07:28:49.117 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:28:49.118 DEBUG:teuthology.orchestra.run.smithi049:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.58887.asok status 2024-03-16T07:28:49.259 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-03-16T07:28:49.259 INFO:teuthology.orchestra.run.smithi049.stdout: "metadata": { 2024-03-16T07:28:49.260 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph_sha1": "3d78f5ba07bf18880172c07d4d7b4ac00c9d30af", 2024-03-16T07:28:49.260 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph_version": "ceph version 19.0.0-2162-g3d78f5ba (3d78f5ba07bf18880172c07d4d7b4ac00c9d30af) squid (dev)", 2024-03-16T07:28:49.260 INFO:teuthology.orchestra.run.smithi049.stdout: "entity_id": "0", 2024-03-16T07:28:49.260 INFO:teuthology.orchestra.run.smithi049.stdout: "hostname": "smithi049", 2024-03-16T07:28:49.260 INFO:teuthology.orchestra.run.smithi049.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-03-16T07:28:49.260 INFO:teuthology.orchestra.run.smithi049.stdout: "pid": "58887", 2024-03-16T07:28:49.260 INFO:teuthology.orchestra.run.smithi049.stdout: "root": "/" 2024-03-16T07:28:49.260 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:28:49.260 INFO:teuthology.orchestra.run.smithi049.stdout: "dentry_count": 0, 2024-03-16T07:28:49.260 INFO:teuthology.orchestra.run.smithi049.stdout: "dentry_pinned_count": 0, 2024-03-16T07:28:49.260 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 5336, 2024-03-16T07:28:49.260 INFO:teuthology.orchestra.run.smithi049.stdout: "inst": { 2024-03-16T07:28:49.260 INFO:teuthology.orchestra.run.smithi049.stdout: "name": { 2024-03-16T07:28:49.261 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "client", 2024-03-16T07:28:49.261 INFO:teuthology.orchestra.run.smithi049.stdout: "num": 5336 2024-03-16T07:28:49.261 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:28:49.261 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": { 2024-03-16T07:28:49.261 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2024-03-16T07:28:49.261 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "192.168.0.1:0", 2024-03-16T07:28:49.261 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 4127617530 2024-03-16T07:28:49.261 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:28:49.261 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:28:49.261 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": { 2024-03-16T07:28:49.261 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2024-03-16T07:28:49.261 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "192.168.0.1:0", 2024-03-16T07:28:49.261 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 4127617530 2024-03-16T07:28:49.261 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:28:49.261 INFO:teuthology.orchestra.run.smithi049.stdout: "inst_str": "client.5336 192.168.0.1:0/4127617530", 2024-03-16T07:28:49.262 INFO:teuthology.orchestra.run.smithi049.stdout: "addr_str": "192.168.0.1:0/4127617530", 2024-03-16T07:28:49.262 INFO:teuthology.orchestra.run.smithi049.stdout: "inode_count": 1, 2024-03-16T07:28:49.262 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_epoch": 51, 2024-03-16T07:28:49.262 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_epoch": 74, 2024-03-16T07:28:49.262 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_epoch_barrier": 0, 2024-03-16T07:28:49.262 INFO:teuthology.orchestra.run.smithi049.stdout: "blocklisted": false, 2024-03-16T07:28:49.262 INFO:teuthology.orchestra.run.smithi049.stdout: "fs_name": "cephfs" 2024-03-16T07:28:49.262 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-03-16T07:28:49.267 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:28:49.268 DEBUG:teuthology.orchestra.run.smithi049:> stat --file-system '--printf=%T 2024-03-16T07:28:49.268 DEBUG:teuthology.orchestra.run.smithi049:> ' -- /home/ubuntu/cephtest/mnt.0 2024-03-16T07:28:49.283 INFO:teuthology.orchestra.run.smithi049.stdout:fuseblk 2024-03-16T07:28:49.283 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-03-16T07:28:49.283 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:28:49.283 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-03-16T07:28:49.354 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-03-16T07:28:49.741 INFO:teuthology.orchestra.run.smithi049.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-03-16T07:28:49.753 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-03-16T07:28:49.753 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-03-16T07:28:49.754 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi049.front.sepia.ceph.com 2024-03-16T07:28:49.754 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-03-16T07:28:49.754 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-03-16T07:28:49.754 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-03-16T07:28:49.754 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-03-16T07:28:49.754 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-03-16T07:28:49.754 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-03-16T07:28:49.754 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:28:49.754 DEBUG:teuthology.orchestra.run.smithi049:> ip addr 2024-03-16T07:28:49.770 INFO:teuthology.orchestra.run.smithi049.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-16T07:28:49.770 INFO:teuthology.orchestra.run.smithi049.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-16T07:28:49.770 INFO:teuthology.orchestra.run.smithi049.stdout: inet 127.0.0.1/8 scope host lo 2024-03-16T07:28:49.771 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-03-16T07:28:49.771 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 ::1/128 scope host 2024-03-16T07:28:49.771 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-03-16T07:28:49.771 INFO:teuthology.orchestra.run.smithi049.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-16T07:28:49.771 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:6b:ff:84 brd ff:ff:ff:ff:ff:ff 2024-03-16T07:28:49.771 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp7s0f0 2024-03-16T07:28:49.771 INFO:teuthology.orchestra.run.smithi049.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-16T07:28:49.771 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:6b:ff:85 brd ff:ff:ff:ff:ff:ff 2024-03-16T07:28:49.772 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp7s0f1 2024-03-16T07:28:49.772 INFO:teuthology.orchestra.run.smithi049.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-03-16T07:28:49.772 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:bd:15:66 brd ff:ff:ff:ff:ff:ff 2024-03-16T07:28:49.772 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp1s0f0 2024-03-16T07:28:49.772 INFO:teuthology.orchestra.run.smithi049.stdout: inet 172.21.15.49/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-03-16T07:28:49.772 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft 42178sec preferred_lft 42178sec 2024-03-16T07:28:49.772 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::ec4:7aff:febd:1566/64 scope link noprefixroute 2024-03-16T07:28:49.773 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-03-16T07:28:49.773 INFO:teuthology.orchestra.run.smithi049.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-16T07:28:49.773 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:bd:15:67 brd ff:ff:ff:ff:ff:ff 2024-03-16T07:28:49.773 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp1s0f1 2024-03-16T07:28:49.773 INFO:teuthology.orchestra.run.smithi049.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-03-16T07:28:49.773 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether a2:f1:88:c1:22:e7 brd ff:ff:ff:ff:ff:ff 2024-03-16T07:28:49.773 INFO:teuthology.orchestra.run.smithi049.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-03-16T07:28:49.773 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-03-16T07:28:49.773 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::e0e6:55ff:fe4d:1d68/64 scope link 2024-03-16T07:28:49.773 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-03-16T07:28:49.774 INFO:teuthology.orchestra.run.smithi049.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-03-16T07:28:49.774 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether ee:10:71:d7:68:c4 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-16T07:28:49.774 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::ec10:71ff:fed7:68c4/64 scope link 2024-03-16T07:28:49.774 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-03-16T07:28:49.774 INFO:teuthology.orchestra.run.smithi049.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-03-16T07:28:49.774 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether a2:f1:88:c1:22:e7 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-16T07:28:49.774 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::a0f1:88ff:fec1:22e7/64 scope link 2024-03-16T07:28:49.774 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-03-16T07:28:49.774 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:28:49.774 DEBUG:teuthology.orchestra.run.smithi049:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-03-16T07:28:49.839 INFO:teuthology.orchestra.run.smithi049.stdout:1 2024-03-16T07:28:49.841 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:28:49.841 DEBUG:teuthology.orchestra.run.smithi049:> route 2024-03-16T07:28:49.897 INFO:teuthology.orchestra.run.smithi049.stdout:Kernel IP routing table 2024-03-16T07:28:49.897 INFO:teuthology.orchestra.run.smithi049.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-03-16T07:28:49.897 INFO:teuthology.orchestra.run.smithi049.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-03-16T07:28:49.897 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-03-16T07:28:49.897 INFO:teuthology.orchestra.run.smithi049.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-03-16T07:28:49.898 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-16T07:28:49.898 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-03-16T07:28:49.898 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-03-16T07:28:49.898 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-03-16T07:28:49.898 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-03-16T07:28:49.898 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-03-16T07:28:49.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-16T07:28:49 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-16T07:28:50.038 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-16T07:28:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-16T07:28:50.044 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:28:50.044 DEBUG:teuthology.orchestra.run.smithi049:> ip netns list 2024-03-16T07:28:50.059 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 1) 2024-03-16T07:28:50.060 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-03-16T07:28:50.060 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-03-16T07:28:50.060 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:28:50.060 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link set brx.1 up 2024-03-16T07:28:50.131 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-03-16T07:28:50.132 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-16T07:28:50.132 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-03-16T07:28:50.187 INFO:teuthology.orchestra.run.smithi049.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-03-16T07:28:50.187 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-16T07:28:50.187 DEBUG:teuthology.orchestra.run.smithi049:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-03-16T07:28:50.242 DEBUG:teuthology.orchestra.run.smithi049:> sudo modprobe fuse 2024-03-16T07:28:50.313 DEBUG:teuthology.orchestra.run.smithi049:> cat /proc/self/mounts | awk '{print $2}' 2024-03-16T07:28:50.370 INFO:teuthology.orchestra.run.smithi049.stdout:/proc 2024-03-16T07:28:50.370 INFO:teuthology.orchestra.run.smithi049.stdout:/sys 2024-03-16T07:28:50.370 INFO:teuthology.orchestra.run.smithi049.stdout:/dev 2024-03-16T07:28:50.370 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/security 2024-03-16T07:28:50.371 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/shm 2024-03-16T07:28:50.371 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/pts 2024-03-16T07:28:50.371 INFO:teuthology.orchestra.run.smithi049.stdout:/run 2024-03-16T07:28:50.371 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/cgroup 2024-03-16T07:28:50.371 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/pstore 2024-03-16T07:28:50.371 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/bpf 2024-03-16T07:28:50.371 INFO:teuthology.orchestra.run.smithi049.stdout:/ 2024-03-16T07:28:50.371 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/selinux 2024-03-16T07:28:50.371 INFO:teuthology.orchestra.run.smithi049.stdout:/proc/sys/fs/binfmt_misc 2024-03-16T07:28:50.371 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/mqueue 2024-03-16T07:28:50.371 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/hugepages 2024-03-16T07:28:50.371 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/debug 2024-03-16T07:28:50.371 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/tracing 2024-03-16T07:28:50.371 INFO:teuthology.orchestra.run.smithi049.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-03-16T07:28:50.371 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/fuse/connections 2024-03-16T07:28:50.371 INFO:teuthology.orchestra.run.smithi049.stdout:/run/credentials/systemd-sysctl.service 2024-03-16T07:28:50.372 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/config 2024-03-16T07:28:50.372 INFO:teuthology.orchestra.run.smithi049.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-03-16T07:28:50.372 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/nfs/rpc_pipefs 2024-03-16T07:28:50.372 INFO:teuthology.orchestra.run.smithi049.stdout:/run/user/1000 2024-03-16T07:28:50.372 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph 2024-03-16T07:28:50.372 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-0 2024-03-16T07:28:50.372 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-1 2024-03-16T07:28:50.372 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-2 2024-03-16T07:28:50.372 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns 2024-03-16T07:28:50.372 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-16T07:28:50.372 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-16T07:28:50.372 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-16T07:28:50.372 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-16T07:28:50.372 INFO:teuthology.orchestra.run.smithi049.stdout:/home/ubuntu/cephtest/mnt.0 2024-03-16T07:28:50.373 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:28:50.373 DEBUG:teuthology.orchestra.run.smithi049:> ls /sys/fs/fuse/connections 2024-03-16T07:28:50.425 INFO:teuthology.orchestra.run.smithi049.stdout:41 2024-03-16T07:28:50.425 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [41] 2024-03-16T07:28:50.425 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-03-16T07:28:50.468 DEBUG:teuthology.orchestra.run.smithi049:> sudo modprobe fuse 2024-03-16T07:28:50.500 DEBUG:teuthology.orchestra.run.smithi049:> cat /proc/self/mounts | awk '{print $2}' 2024-03-16T07:28:50.557 INFO:teuthology.orchestra.run.smithi049.stdout:/proc 2024-03-16T07:28:50.557 INFO:teuthology.orchestra.run.smithi049.stdout:/sys 2024-03-16T07:28:50.557 INFO:teuthology.orchestra.run.smithi049.stdout:/dev 2024-03-16T07:28:50.558 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/security 2024-03-16T07:28:50.558 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/shm 2024-03-16T07:28:50.558 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/pts 2024-03-16T07:28:50.558 INFO:teuthology.orchestra.run.smithi049.stdout:/run 2024-03-16T07:28:50.558 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/cgroup 2024-03-16T07:28:50.558 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/pstore 2024-03-16T07:28:50.558 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/bpf 2024-03-16T07:28:50.558 INFO:teuthology.orchestra.run.smithi049.stdout:/ 2024-03-16T07:28:50.558 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/selinux 2024-03-16T07:28:50.559 INFO:teuthology.orchestra.run.smithi049.stdout:/proc/sys/fs/binfmt_misc 2024-03-16T07:28:50.559 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/mqueue 2024-03-16T07:28:50.559 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/hugepages 2024-03-16T07:28:50.559 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/debug 2024-03-16T07:28:50.559 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/tracing 2024-03-16T07:28:50.559 INFO:teuthology.orchestra.run.smithi049.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-03-16T07:28:50.559 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/fuse/connections 2024-03-16T07:28:50.559 INFO:teuthology.orchestra.run.smithi049.stdout:/run/credentials/systemd-sysctl.service 2024-03-16T07:28:50.559 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/config 2024-03-16T07:28:50.559 INFO:teuthology.orchestra.run.smithi049.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-03-16T07:28:50.559 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/nfs/rpc_pipefs 2024-03-16T07:28:50.559 INFO:teuthology.orchestra.run.smithi049.stdout:/run/user/1000 2024-03-16T07:28:50.559 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph 2024-03-16T07:28:50.559 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-0 2024-03-16T07:28:50.559 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-1 2024-03-16T07:28:50.559 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-2 2024-03-16T07:28:50.560 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns 2024-03-16T07:28:50.560 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-16T07:28:50.560 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-16T07:28:50.560 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-16T07:28:50.560 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-16T07:28:50.560 INFO:teuthology.orchestra.run.smithi049.stdout:/home/ubuntu/cephtest/mnt.0 2024-03-16T07:28:50.560 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:28:50.560 DEBUG:teuthology.orchestra.run.smithi049:> ls /sys/fs/fuse/connections 2024-03-16T07:28:50.565 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi049.stderr:2024-03-16T07:28:50.565+0000 7f8db3cb9480 -1 init, newargv = 0x5628dfd8def0 newargc=15 2024-03-16T07:28:50.565 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi049.stderr:ceph-fuse[59305]: starting ceph client 2024-03-16T07:28:50.569 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi049.stderr:ceph-fuse[59305]: starting fuse 2024-03-16T07:28:50.580 INFO:teuthology.orchestra.run.smithi049.stdout:41 2024-03-16T07:28:50.580 INFO:teuthology.orchestra.run.smithi049.stdout:44 2024-03-16T07:28:50.580 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41, 44] 2024-03-16T07:28:50.580 DEBUG:teuthology.orchestra.run.smithi049:> sudo stdin-killer -- python3 -c ' 2024-03-16T07:28:50.580 DEBUG:teuthology.orchestra.run.smithi049:> import glob 2024-03-16T07:28:50.581 DEBUG:teuthology.orchestra.run.smithi049:> import re 2024-03-16T07:28:50.581 DEBUG:teuthology.orchestra.run.smithi049:> import os 2024-03-16T07:28:50.581 DEBUG:teuthology.orchestra.run.smithi049:> import subprocess 2024-03-16T07:28:50.581 DEBUG:teuthology.orchestra.run.smithi049:> 2024-03-16T07:28:50.581 DEBUG:teuthology.orchestra.run.smithi049:> def _find_admin_socket(client_name): 2024-03-16T07:28:50.581 DEBUG:teuthology.orchestra.run.smithi049:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-03-16T07:28:50.581 DEBUG:teuthology.orchestra.run.smithi049:> files = glob.glob(asok_path) 2024-03-16T07:28:50.581 DEBUG:teuthology.orchestra.run.smithi049:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-03-16T07:28:50.581 DEBUG:teuthology.orchestra.run.smithi049:> 2024-03-16T07:28:50.581 DEBUG:teuthology.orchestra.run.smithi049:> # Given a non-glob path, it better be there 2024-03-16T07:28:50.581 DEBUG:teuthology.orchestra.run.smithi049:> if "*" not in asok_path: 2024-03-16T07:28:50.581 DEBUG:teuthology.orchestra.run.smithi049:> assert(len(files) == 1) 2024-03-16T07:28:50.581 DEBUG:teuthology.orchestra.run.smithi049:> return files[0] 2024-03-16T07:28:50.581 DEBUG:teuthology.orchestra.run.smithi049:> 2024-03-16T07:28:50.581 DEBUG:teuthology.orchestra.run.smithi049:> for f in files: 2024-03-16T07:28:50.581 DEBUG:teuthology.orchestra.run.smithi049:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-03-16T07:28:50.582 DEBUG:teuthology.orchestra.run.smithi049:> if os.path.exists("/proc/{0}".format(pid)): 2024-03-16T07:28:50.582 DEBUG:teuthology.orchestra.run.smithi049:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-03-16T07:28:50.582 DEBUG:teuthology.orchestra.run.smithi049:> contents = proc_f.read() 2024-03-16T07:28:50.582 DEBUG:teuthology.orchestra.run.smithi049:> if mountpoint in contents: 2024-03-16T07:28:50.582 DEBUG:teuthology.orchestra.run.smithi049:> return f 2024-03-16T07:28:50.582 DEBUG:teuthology.orchestra.run.smithi049:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-03-16T07:28:50.582 DEBUG:teuthology.orchestra.run.smithi049:> 2024-03-16T07:28:50.582 DEBUG:teuthology.orchestra.run.smithi049:> print(_find_admin_socket("client.1")) 2024-03-16T07:28:50.582 DEBUG:teuthology.orchestra.run.smithi049:> ' 2024-03-16T07:28:50.719 INFO:teuthology.orchestra.run.smithi049.stdout:/var/run/ceph/ceph-client.1.59305.asok 2024-03-16T07:28:50.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-16T07:28:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-16T07:28:50.733 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.59305.asok 2024-03-16T07:28:50.733 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:28:50.733 DEBUG:teuthology.orchestra.run.smithi049:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.59305.asok status 2024-03-16T07:28:50.875 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-03-16T07:28:50.875 INFO:teuthology.orchestra.run.smithi049.stdout: "metadata": { 2024-03-16T07:28:50.875 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph_sha1": "3d78f5ba07bf18880172c07d4d7b4ac00c9d30af", 2024-03-16T07:28:50.875 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph_version": "ceph version 19.0.0-2162-g3d78f5ba (3d78f5ba07bf18880172c07d4d7b4ac00c9d30af) squid (dev)", 2024-03-16T07:28:50.876 INFO:teuthology.orchestra.run.smithi049.stdout: "entity_id": "1", 2024-03-16T07:28:50.876 INFO:teuthology.orchestra.run.smithi049.stdout: "hostname": "smithi049", 2024-03-16T07:28:50.876 INFO:teuthology.orchestra.run.smithi049.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-03-16T07:28:50.876 INFO:teuthology.orchestra.run.smithi049.stdout: "pid": "59305", 2024-03-16T07:28:50.876 INFO:teuthology.orchestra.run.smithi049.stdout: "root": "/" 2024-03-16T07:28:50.876 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:28:50.876 INFO:teuthology.orchestra.run.smithi049.stdout: "dentry_count": 0, 2024-03-16T07:28:50.876 INFO:teuthology.orchestra.run.smithi049.stdout: "dentry_pinned_count": 0, 2024-03-16T07:28:50.876 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 5342, 2024-03-16T07:28:50.876 INFO:teuthology.orchestra.run.smithi049.stdout: "inst": { 2024-03-16T07:28:50.876 INFO:teuthology.orchestra.run.smithi049.stdout: "name": { 2024-03-16T07:28:50.876 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "client", 2024-03-16T07:28:50.876 INFO:teuthology.orchestra.run.smithi049.stdout: "num": 5342 2024-03-16T07:28:50.876 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:28:50.876 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": { 2024-03-16T07:28:50.876 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2024-03-16T07:28:50.877 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "192.168.0.2:0", 2024-03-16T07:28:50.877 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 3320002688 2024-03-16T07:28:50.877 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:28:50.877 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:28:50.877 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": { 2024-03-16T07:28:50.877 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2024-03-16T07:28:50.877 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "192.168.0.2:0", 2024-03-16T07:28:50.877 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 3320002688 2024-03-16T07:28:50.877 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:28:50.877 INFO:teuthology.orchestra.run.smithi049.stdout: "inst_str": "client.5342 192.168.0.2:0/3320002688", 2024-03-16T07:28:50.877 INFO:teuthology.orchestra.run.smithi049.stdout: "addr_str": "192.168.0.2:0/3320002688", 2024-03-16T07:28:50.877 INFO:teuthology.orchestra.run.smithi049.stdout: "inode_count": 1, 2024-03-16T07:28:50.877 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_epoch": 51, 2024-03-16T07:28:50.877 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_epoch": 74, 2024-03-16T07:28:50.877 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_epoch_barrier": 0, 2024-03-16T07:28:50.878 INFO:teuthology.orchestra.run.smithi049.stdout: "blocklisted": false, 2024-03-16T07:28:50.878 INFO:teuthology.orchestra.run.smithi049.stdout: "fs_name": "cephfs" 2024-03-16T07:28:50.878 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-03-16T07:28:50.885 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:28:50.885 DEBUG:teuthology.orchestra.run.smithi049:> stat --file-system '--printf=%T 2024-03-16T07:28:50.885 DEBUG:teuthology.orchestra.run.smithi049:> ' -- /home/ubuntu/cephtest/mnt.1 2024-03-16T07:28:50.902 INFO:teuthology.orchestra.run.smithi049.stdout:fuseblk 2024-03-16T07:28:50.902 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-03-16T07:28:50.902 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:28:50.902 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-03-16T07:28:50.973 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2024-03-16T07:28:51.899 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T07:28:52.203 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:28:52.203 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":74,"fsid":"f91af061-9eac-4793-87fa-8d27ae3d242f","created":"2024-03-16T07:24:20.357868+0000","modified":"2024-03-16T07:28:42.558288+0000","last_up_change":"2024-03-16T07:24:27.474980+0000","last_in_change":"2024-03-16T07:24:21.254179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T07:24:28.947521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-03-16T07:28:39.556362+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.4099999666213989,"score_stable":1.4099999666213989,"optimal_score":1,"raw_score_acting":1.4099999666213989,"raw_score_stable":1.4099999666213989,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-03-16T07:28:40.220835+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2df14aac-98dc-4e3c-ae7e-9eb677aa30be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6801","nonce":2744935777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6803","nonce":2744935777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6807","nonce":2744935777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6805","nonce":2744935777}]},"public_addr":"172.21.15.49:6801/2744935777","cluster_addr":"172.21.15.49:6803/2744935777","heartbeat_back_addr":"172.21.15.49:6807/2744935777","heartbeat_front_addr":"172.21.15.49:6805/2744935777","state":["exists","up"]},{"osd":1,"uuid":"80461bd9-59ef-46df-9eea-bad92d960c57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6811","nonce":1655120118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6815","nonce":1655120118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6821","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6823","nonce":1655120118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6817","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6819","nonce":1655120118}]},"public_addr":"172.21.15.49:6811/1655120118","cluster_addr":"172.21.15.49:6815/1655120118","heartbeat_back_addr":"172.21.15.49:6823/1655120118","heartbeat_front_addr":"172.21.15.49:6819/1655120118","state":["exists","up"]},{"osd":2,"uuid":"d6bf40eb-6e42-4ec9-8b3d-0b6c5a6def79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6810","nonce":3815472376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6814","nonce":3815472376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6822","nonce":3815472376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6818","nonce":3815472376}]},"public_addr":"172.21.15.49:6810/3815472376","cluster_addr":"172.21.15.49:6814/3815472376","heartbeat_back_addr":"172.21.15.49:6822/3815472376","heartbeat_front_addr":"172.21.15.49:6818/3815472376","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.641492+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.668598+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.614940+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T07:28:52.215 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-16T07:24:28.947521+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-16T07:28:39.556362+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '73', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.409999966621399, 'score_stable': 1.409999966621399, 'optimal_score': 1, 'raw_score_acting': 1.409999966621399, 'raw_score_stable': 1.409999966621399, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2024-03-16T07:28:40.220835+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '74', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-16T07:28:52.215 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-16T07:28:52.575 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2024-03-16T07:28:52.589 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-16T07:28:52.894 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2024-03-16T07:28:52.910 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-16T07:28:53.241 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2024-03-16T07:28:53.254 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-03-16T07:28:53.560 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:28:53.560 INFO:teuthology.orchestra.run.smithi049.stdout:[ 2024-03-16T07:28:53.560 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:28:53.560 INFO:teuthology.orchestra.run.smithi049.stdout: "poolnum": 1, 2024-03-16T07:28:53.560 INFO:teuthology.orchestra.run.smithi049.stdout: "poolname": ".mgr" 2024-03-16T07:28:53.560 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:28:53.560 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:28:53.560 INFO:teuthology.orchestra.run.smithi049.stdout: "poolnum": 12, 2024-03-16T07:28:53.560 INFO:teuthology.orchestra.run.smithi049.stdout: "poolname": "cephfs_metadata" 2024-03-16T07:28:53.561 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:28:53.561 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:28:53.561 INFO:teuthology.orchestra.run.smithi049.stdout: "poolnum": 13, 2024-03-16T07:28:53.561 INFO:teuthology.orchestra.run.smithi049.stdout: "poolname": "cephfs_data" 2024-03-16T07:28:53.561 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:28:53.561 INFO:teuthology.orchestra.run.smithi049.stdout:] 2024-03-16T07:28:53.572 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'backup_fs' 2024-03-16T07:28:53.573 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create backup_fs_metadata --pg_num_min 64 2024-03-16T07:28:53.958 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'backup_fs_metadata' created 2024-03-16T07:28:53.981 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create backup_fs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-03-16T07:28:54.962 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'backup_fs_data' created 2024-03-16T07:28:54.991 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new backup_fs backup_fs_metadata backup_fs_data 2024-03-16T07:28:55.963 INFO:teuthology.orchestra.run.smithi049.stderr:new fs with metadata pool 14 and data pool 15 2024-03-16T07:28:56.008 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T07:28:56.356 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:28:56.356 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":77,"fsid":"f91af061-9eac-4793-87fa-8d27ae3d242f","created":"2024-03-16T07:24:20.357868+0000","modified":"2024-03-16T07:28:55.340534+0000","last_up_change":"2024-03-16T07:24:27.474980+0000","last_in_change":"2024-03-16T07:24:21.254179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T07:24:28.947521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-03-16T07:28:39.556362+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.4099999666213989,"score_stable":1.4099999666213989,"optimal_score":1,"raw_score_acting":1.4099999666213989,"raw_score_stable":1.4099999666213989,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-03-16T07:28:40.220835+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"backup_fs_metadata","create_time":"2024-03-16T07:28:53.909674+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"backup_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.309999942779541,"score_stable":1.309999942779541,"optimal_score":1,"raw_score_acting":1.309999942779541,"raw_score_stable":1.309999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"backup_fs_data","create_time":"2024-03-16T07:28:54.340919+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"backup_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1699999570846558,"score_stable":1.1699999570846558,"optimal_score":1,"raw_score_acting":1.1699999570846558,"raw_score_stable":1.1699999570846558,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2df14aac-98dc-4e3c-ae7e-9eb677aa30be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6801","nonce":2744935777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6803","nonce":2744935777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6807","nonce":2744935777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6805","nonce":2744935777}]},"public_addr":"172.21.15.49:6801/2744935777","cluster_addr":"172.21.15.49:6803/2744935777","heartbeat_back_addr":"172.21.15.49:6807/2744935777","heartbeat_front_addr":"172.21.15.49:6805/2744935777","state":["exists","up"]},{"osd":1,"uuid":"80461bd9-59ef-46df-9eea-bad92d960c57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6811","nonce":1655120118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6815","nonce":1655120118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6821","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6823","nonce":1655120118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6817","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6819","nonce":1655120118}]},"public_addr":"172.21.15.49:6811/1655120118","cluster_addr":"172.21.15.49:6815/1655120118","heartbeat_back_addr":"172.21.15.49:6823/1655120118","heartbeat_front_addr":"172.21.15.49:6819/1655120118","state":["exists","up"]},{"osd":2,"uuid":"d6bf40eb-6e42-4ec9-8b3d-0b6c5a6def79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6810","nonce":3815472376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6814","nonce":3815472376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6822","nonce":3815472376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6818","nonce":3815472376}]},"public_addr":"172.21.15.49:6810/3815472376","cluster_addr":"172.21.15.49:6814/3815472376","heartbeat_back_addr":"172.21.15.49:6822/3815472376","heartbeat_front_addr":"172.21.15.49:6818/3815472376","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.641492+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.668598+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.614940+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T07:28:56.372 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T07:28:56.716 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:28:56.716 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":77,"fsid":"f91af061-9eac-4793-87fa-8d27ae3d242f","created":"2024-03-16T07:24:20.357868+0000","modified":"2024-03-16T07:28:55.340534+0000","last_up_change":"2024-03-16T07:24:27.474980+0000","last_in_change":"2024-03-16T07:24:21.254179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T07:24:28.947521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-03-16T07:28:39.556362+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.4099999666213989,"score_stable":1.4099999666213989,"optimal_score":1,"raw_score_acting":1.4099999666213989,"raw_score_stable":1.4099999666213989,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-03-16T07:28:40.220835+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"backup_fs_metadata","create_time":"2024-03-16T07:28:53.909674+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"backup_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.309999942779541,"score_stable":1.309999942779541,"optimal_score":1,"raw_score_acting":1.309999942779541,"raw_score_stable":1.309999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"backup_fs_data","create_time":"2024-03-16T07:28:54.340919+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"backup_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1699999570846558,"score_stable":1.1699999570846558,"optimal_score":1,"raw_score_acting":1.1699999570846558,"raw_score_stable":1.1699999570846558,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2df14aac-98dc-4e3c-ae7e-9eb677aa30be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6801","nonce":2744935777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6803","nonce":2744935777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6807","nonce":2744935777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6805","nonce":2744935777}]},"public_addr":"172.21.15.49:6801/2744935777","cluster_addr":"172.21.15.49:6803/2744935777","heartbeat_back_addr":"172.21.15.49:6807/2744935777","heartbeat_front_addr":"172.21.15.49:6805/2744935777","state":["exists","up"]},{"osd":1,"uuid":"80461bd9-59ef-46df-9eea-bad92d960c57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6811","nonce":1655120118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6815","nonce":1655120118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6821","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6823","nonce":1655120118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6817","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6819","nonce":1655120118}]},"public_addr":"172.21.15.49:6811/1655120118","cluster_addr":"172.21.15.49:6815/1655120118","heartbeat_back_addr":"172.21.15.49:6823/1655120118","heartbeat_front_addr":"172.21.15.49:6819/1655120118","state":["exists","up"]},{"osd":2,"uuid":"d6bf40eb-6e42-4ec9-8b3d-0b6c5a6def79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6810","nonce":3815472376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6814","nonce":3815472376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6822","nonce":3815472376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6818","nonce":3815472376}]},"public_addr":"172.21.15.49:6810/3815472376","cluster_addr":"172.21.15.49:6814/3815472376","heartbeat_back_addr":"172.21.15.49:6822/3815472376","heartbeat_front_addr":"172.21.15.49:6818/3815472376","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.641492+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.668598+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.614940+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T07:28:56.730 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set backup_fs standby_count_wanted 0 2024-03-16T07:28:57.535 INFO:tasks.ceph.mds.a.smithi049.stderr:2024-03-16T07:28:57.535+0000 7f7128f37640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-03-16T07:28:57.994 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-03-16T07:28:57.995 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set backup_fs allow_standby_replay false 2024-03-16T07:28:58.994 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'backup_fs' 2024-03-16T07:28:58.994 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T07:28:59.473 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:28:59.473 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":57,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5259,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6827/3159374847","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":3159374847},{"type":"v1","addr":"172.21.15.49:6827","nonce":3159374847}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":46},{"gid":5260,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6829/626442568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":626442568},{"type":"v1","addr":"172.21.15.49:6829","nonce":626442568}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":46},{"gid":5267,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6831/3455133872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":3455133872},{"type":"v1","addr":"172.21.15.49:6831","nonce":3455133872}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":46}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-16T07:28:41.244463+0000","modified":"2024-03-16T07:28:44.360549+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5269":{"gid":5269,"name":"e","rank":0,"incarnation":47,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6835/647809721","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":647809721},{"type":"v1","addr":"172.21.15.49:6835","nonce":647809721}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5269,"qdb_cluster":[5269]},"id":6},{"mdsmap":{"epoch":57,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-16T07:28:55.340838+0000","modified":"2024-03-16T07:28:58.365965+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5268},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5268":{"gid":5268,"name":"a","rank":0,"incarnation":53,"state":"up:active","state_seq":6,"addr":"172.21.15.49:6833/1067362108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":1067362108},{"type":"v1","addr":"172.21.15.49:6833","nonce":1067362108}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"backup_fs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5268,"qdb_cluster":[5268]},"id":7}]} 2024-03-16T07:28:59.473 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 57 2024-03-16T07:28:59.487 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T07:28:59.790 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:28:59.790 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":78,"fsid":"f91af061-9eac-4793-87fa-8d27ae3d242f","created":"2024-03-16T07:24:20.357868+0000","modified":"2024-03-16T07:28:56.973477+0000","last_up_change":"2024-03-16T07:24:27.474980+0000","last_in_change":"2024-03-16T07:24:21.254179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T07:24:28.947521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-03-16T07:28:39.556362+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.4099999666213989,"score_stable":1.4099999666213989,"optimal_score":1,"raw_score_acting":1.4099999666213989,"raw_score_stable":1.4099999666213989,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-03-16T07:28:40.220835+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"backup_fs_metadata","create_time":"2024-03-16T07:28:53.909674+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"backup_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.309999942779541,"score_stable":1.309999942779541,"optimal_score":1,"raw_score_acting":1.309999942779541,"raw_score_stable":1.309999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"backup_fs_data","create_time":"2024-03-16T07:28:54.340919+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"backup_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1699999570846558,"score_stable":1.1699999570846558,"optimal_score":1,"raw_score_acting":1.1699999570846558,"raw_score_stable":1.1699999570846558,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2df14aac-98dc-4e3c-ae7e-9eb677aa30be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6801","nonce":2744935777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6803","nonce":2744935777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6807","nonce":2744935777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6805","nonce":2744935777}]},"public_addr":"172.21.15.49:6801/2744935777","cluster_addr":"172.21.15.49:6803/2744935777","heartbeat_back_addr":"172.21.15.49:6807/2744935777","heartbeat_front_addr":"172.21.15.49:6805/2744935777","state":["exists","up"]},{"osd":1,"uuid":"80461bd9-59ef-46df-9eea-bad92d960c57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6811","nonce":1655120118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6815","nonce":1655120118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6821","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6823","nonce":1655120118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6817","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6819","nonce":1655120118}]},"public_addr":"172.21.15.49:6811/1655120118","cluster_addr":"172.21.15.49:6815/1655120118","heartbeat_back_addr":"172.21.15.49:6823/1655120118","heartbeat_front_addr":"172.21.15.49:6819/1655120118","state":["exists","up"]},{"osd":2,"uuid":"d6bf40eb-6e42-4ec9-8b3d-0b6c5a6def79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6810","nonce":3815472376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6814","nonce":3815472376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6822","nonce":3815472376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6818","nonce":3815472376}]},"public_addr":"172.21.15.49:6810/3815472376","cluster_addr":"172.21.15.49:6814/3815472376","heartbeat_back_addr":"172.21.15.49:6822/3815472376","heartbeat_front_addr":"172.21.15.49:6818/3815472376","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.641492+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.668598+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.614940+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T07:28:59.803 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-03-16T07:28:59.803 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-16T07:29:00.252 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:29:00.256 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2024-03-16T07:29:00.262 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":45,"stamp":"2024-03-16T07:28:59.892754+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596885,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":490,"num_read_kb":915,"num_write":308,"num_write_kb":1925,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":220,"ondisk_log_size":220,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":254,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":314572800,"kb_used":97052,"kb_used_data":3504,"kb_used_omap":4,"kb_used_meta":93499,"kb_avail":314475748,"statfs":{"total":322122547200,"available":322023165952,"internally_reserved":0,"allocated":3588096,"data_stored":2104134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":95743311},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.931772"},"pg_stats":[{"pgid":"15.3d","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:56.000159+0000","last_change":"2024-03-16T07:28:55.997326+0000","last_active":"2024-03-16T07:28:56.000159+0000","last_peered":"2024-03-16T07:28:56.000159+0000","last_clean":"2024-03-16T07:28:56.000159+0000","last_became_active":"2024-03-16T07:28:55.996651+0000","last_became_peered":"2024-03-16T07:28:55.996651+0000","last_unstale":"2024-03-16T07:28:56.000159+0000","last_undegraded":"2024-03-16T07:28:56.000159+0000","last_fullsized":"2024-03-16T07:28:56.000159+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_clean_scrub_stamp":"2024-03-16T07:28:54.963620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:51:05.203345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.974370+0000","last_change":"2024-03-16T07:28:41.584717+0000","last_active":"2024-03-16T07:28:55.974370+0000","last_peered":"2024-03-16T07:28:55.974370+0000","last_clean":"2024-03-16T07:28:55.974370+0000","last_became_active":"2024-03-16T07:28:41.582095+0000","last_became_peered":"2024-03-16T07:28:41.582095+0000","last_unstale":"2024-03-16T07:28:55.974370+0000","last_undegraded":"2024-03-16T07:28:55.974370+0000","last_fullsized":"2024-03-16T07:28:55.974370+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:58:10.625850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:56.002685+0000","last_change":"2024-03-16T07:28:55.999932+0000","last_active":"2024-03-16T07:28:56.002685+0000","last_peered":"2024-03-16T07:28:56.002685+0000","last_clean":"2024-03-16T07:28:56.002685+0000","last_became_active":"2024-03-16T07:28:55.996321+0000","last_became_peered":"2024-03-16T07:28:55.996321+0000","last_unstale":"2024-03-16T07:28:56.002685+0000","last_undegraded":"2024-03-16T07:28:56.002685+0000","last_fullsized":"2024-03-16T07:28:56.002685+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_clean_scrub_stamp":"2024-03-16T07:28:54.963620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:30:14.668142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.972634+0000","last_change":"2024-03-16T07:28:41.581340+0000","last_active":"2024-03-16T07:28:55.972634+0000","last_peered":"2024-03-16T07:28:55.972634+0000","last_clean":"2024-03-16T07:28:55.972634+0000","last_became_active":"2024-03-16T07:28:41.580857+0000","last_became_peered":"2024-03-16T07:28:41.580857+0000","last_unstale":"2024-03-16T07:28:55.972634+0000","last_undegraded":"2024-03-16T07:28:55.972634+0000","last_fullsized":"2024-03-16T07:28:55.972634+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:12:10.158550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3f","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:56.001007+0000","last_change":"2024-03-16T07:28:55.995204+0000","last_active":"2024-03-16T07:28:56.001007+0000","last_peered":"2024-03-16T07:28:56.001007+0000","last_clean":"2024-03-16T07:28:56.001007+0000","last_became_active":"2024-03-16T07:28:55.992867+0000","last_became_peered":"2024-03-16T07:28:55.992867+0000","last_unstale":"2024-03-16T07:28:56.001007+0000","last_undegraded":"2024-03-16T07:28:56.001007+0000","last_fullsized":"2024-03-16T07:28:56.001007+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_clean_scrub_stamp":"2024-03-16T07:28:54.963620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:49:10.718848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.974096+0000","last_change":"2024-03-16T07:28:41.571483+0000","last_active":"2024-03-16T07:28:55.974096+0000","last_peered":"2024-03-16T07:28:55.974096+0000","last_clean":"2024-03-16T07:28:55.974096+0000","last_became_active":"2024-03-16T07:28:41.571155+0000","last_became_peered":"2024-03-16T07:28:41.571155+0000","last_unstale":"2024-03-16T07:28:55.974096+0000","last_undegraded":"2024-03-16T07:28:55.974096+0000","last_fullsized":"2024-03-16T07:28:55.974096+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:45:08.243692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:56.008273+0000","last_change":"2024-03-16T07:28:56.005925+0000","last_active":"2024-03-16T07:28:56.008273+0000","last_peered":"2024-03-16T07:28:56.008273+0000","last_clean":"2024-03-16T07:28:56.008273+0000","last_became_active":"2024-03-16T07:28:56.005513+0000","last_became_peered":"2024-03-16T07:28:56.005513+0000","last_unstale":"2024-03-16T07:28:56.008273+0000","last_undegraded":"2024-03-16T07:28:56.008273+0000","last_fullsized":"2024-03-16T07:28:56.008273+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_clean_scrub_stamp":"2024-03-16T07:28:54.963620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:53:49.931951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.969961+0000","last_change":"2024-03-16T07:28:41.573044+0000","last_active":"2024-03-16T07:28:55.969961+0000","last_peered":"2024-03-16T07:28:55.969961+0000","last_clean":"2024-03-16T07:28:55.969961+0000","last_became_active":"2024-03-16T07:28:41.572405+0000","last_became_peered":"2024-03-16T07:28:41.572405+0000","last_unstale":"2024-03-16T07:28:55.969961+0000","last_undegraded":"2024-03-16T07:28:55.969961+0000","last_fullsized":"2024-03-16T07:28:55.969961+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:27:58.242759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:56.010129+0000","last_change":"2024-03-16T07:28:56.006281+0000","last_active":"2024-03-16T07:28:56.010129+0000","last_peered":"2024-03-16T07:28:56.010129+0000","last_clean":"2024-03-16T07:28:56.010129+0000","last_became_active":"2024-03-16T07:28:56.004845+0000","last_became_peered":"2024-03-16T07:28:56.004845+0000","last_unstale":"2024-03-16T07:28:56.010129+0000","last_undegraded":"2024-03-16T07:28:56.010129+0000","last_fullsized":"2024-03-16T07:28:56.010129+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_clean_scrub_stamp":"2024-03-16T07:28:54.963620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:09:07.363254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.976379+0000","last_change":"2024-03-16T07:28:41.574275+0000","last_active":"2024-03-16T07:28:55.976379+0000","last_peered":"2024-03-16T07:28:55.976379+0000","last_clean":"2024-03-16T07:28:55.976379+0000","last_became_active":"2024-03-16T07:28:41.572254+0000","last_became_peered":"2024-03-16T07:28:41.572254+0000","last_unstale":"2024-03-16T07:28:55.976379+0000","last_undegraded":"2024-03-16T07:28:55.976379+0000","last_fullsized":"2024-03-16T07:28:55.976379+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:31:09.682383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:56.008120+0000","last_change":"2024-03-16T07:28:56.002802+0000","last_active":"2024-03-16T07:28:56.008120+0000","last_peered":"2024-03-16T07:28:56.008120+0000","last_clean":"2024-03-16T07:28:56.008120+0000","last_became_active":"2024-03-16T07:28:56.000148+0000","last_became_peered":"2024-03-16T07:28:56.000148+0000","last_unstale":"2024-03-16T07:28:56.008120+0000","last_undegraded":"2024-03-16T07:28:56.008120+0000","last_fullsized":"2024-03-16T07:28:56.008120+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_clean_scrub_stamp":"2024-03-16T07:28:54.963620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:51:30.118961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.974720+0000","last_change":"2024-03-16T07:28:41.571823+0000","last_active":"2024-03-16T07:28:55.974720+0000","last_peered":"2024-03-16T07:28:55.974720+0000","last_clean":"2024-03-16T07:28:55.974720+0000","last_became_active":"2024-03-16T07:28:41.571384+0000","last_became_peered":"2024-03-16T07:28:41.571384+0000","last_unstale":"2024-03-16T07:28:55.974720+0000","last_undegraded":"2024-03-16T07:28:55.974720+0000","last_fullsized":"2024-03-16T07:28:55.974720+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:19:56.148452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:56.004029+0000","last_change":"2024-03-16T07:28:55.999599+0000","last_active":"2024-03-16T07:28:56.004029+0000","last_peered":"2024-03-16T07:28:56.004029+0000","last_clean":"2024-03-16T07:28:56.004029+0000","last_became_active":"2024-03-16T07:28:55.998025+0000","last_became_peered":"2024-03-16T07:28:55.998025+0000","last_unstale":"2024-03-16T07:28:56.004029+0000","last_undegraded":"2024-03-16T07:28:56.004029+0000","last_fullsized":"2024-03-16T07:28:56.004029+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_clean_scrub_stamp":"2024-03-16T07:28:54.963620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:34:28.837701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.968162+0000","last_change":"2024-03-16T07:28:41.575572+0000","last_active":"2024-03-16T07:28:55.968162+0000","last_peered":"2024-03-16T07:28:55.968162+0000","last_clean":"2024-03-16T07:28:55.968162+0000","last_became_active":"2024-03-16T07:28:41.574604+0000","last_became_peered":"2024-03-16T07:28:41.574604+0000","last_unstale":"2024-03-16T07:28:55.968162+0000","last_undegraded":"2024-03-16T07:28:55.968162+0000","last_fullsized":"2024-03-16T07:28:55.968162+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:11:52.604254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:56.006168+0000","last_change":"2024-03-16T07:28:56.003241+0000","last_active":"2024-03-16T07:28:56.006168+0000","last_peered":"2024-03-16T07:28:56.006168+0000","last_clean":"2024-03-16T07:28:56.006168+0000","last_became_active":"2024-03-16T07:28:56.002996+0000","last_became_peered":"2024-03-16T07:28:56.002996+0000","last_unstale":"2024-03-16T07:28:56.006168+0000","last_undegraded":"2024-03-16T07:28:56.006168+0000","last_fullsized":"2024-03-16T07:28:56.006168+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_clean_scrub_stamp":"2024-03-16T07:28:54.963620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:36:49.316052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.984074+0000","last_change":"2024-03-16T07:28:41.587931+0000","last_active":"2024-03-16T07:28:55.984074+0000","last_peered":"2024-03-16T07:28:55.984074+0000","last_clean":"2024-03-16T07:28:55.984074+0000","last_became_active":"2024-03-16T07:28:41.587665+0000","last_became_peered":"2024-03-16T07:28:41.587665+0000","last_unstale":"2024-03-16T07:28:55.984074+0000","last_undegraded":"2024-03-16T07:28:55.984074+0000","last_fullsized":"2024-03-16T07:28:55.984074+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:48:56.617539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.996604+0000","last_change":"2024-03-16T07:28:55.990258+0000","last_active":"2024-03-16T07:28:55.996604+0000","last_peered":"2024-03-16T07:28:55.996604+0000","last_clean":"2024-03-16T07:28:55.996604+0000","last_became_active":"2024-03-16T07:28:55.989020+0000","last_became_peered":"2024-03-16T07:28:55.989020+0000","last_unstale":"2024-03-16T07:28:55.996604+0000","last_undegraded":"2024-03-16T07:28:55.996604+0000","last_fullsized":"2024-03-16T07:28:55.996604+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_clean_scrub_stamp":"2024-03-16T07:28:54.963620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:17:00.626133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.974463+0000","last_change":"2024-03-16T07:28:41.586380+0000","last_active":"2024-03-16T07:28:55.974463+0000","last_peered":"2024-03-16T07:28:55.974463+0000","last_clean":"2024-03-16T07:28:55.974463+0000","last_became_active":"2024-03-16T07:28:41.586099+0000","last_became_peered":"2024-03-16T07:28:41.586099+0000","last_unstale":"2024-03-16T07:28:55.974463+0000","last_undegraded":"2024-03-16T07:28:55.974463+0000","last_fullsized":"2024-03-16T07:28:55.974463+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:18:48.716783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:56.001945+0000","last_change":"2024-03-16T07:28:55.993306+0000","last_active":"2024-03-16T07:28:56.001945+0000","last_peered":"2024-03-16T07:28:56.001945+0000","last_clean":"2024-03-16T07:28:56.001945+0000","last_became_active":"2024-03-16T07:28:55.992184+0000","last_became_peered":"2024-03-16T07:28:55.992184+0000","last_unstale":"2024-03-16T07:28:56.001945+0000","last_undegraded":"2024-03-16T07:28:56.001945+0000","last_fullsized":"2024-03-16T07:28:56.001945+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_clean_scrub_stamp":"2024-03-16T07:28:54.963620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:28:33.174472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.969627+0000","last_change":"2024-03-16T07:28:41.573336+0000","last_active":"2024-03-16T07:28:55.969627+0000","last_peered":"2024-03-16T07:28:55.969627+0000","last_clean":"2024-03-16T07:28:55.969627+0000","last_became_active":"2024-03-16T07:28:41.573117+0000","last_became_peered":"2024-03-16T07:28:41.573117+0000","last_unstale":"2024-03-16T07:28:55.969627+0000","last_undegraded":"2024-03-16T07:28:55.969627+0000","last_fullsized":"2024-03-16T07:28:55.969627+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:05:51.922468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.991488+0000","last_change":"2024-03-16T07:28:55.991017+0000","last_active":"2024-03-16T07:28:55.991488+0000","last_peered":"2024-03-16T07:28:55.991488+0000","last_clean":"2024-03-16T07:28:55.991488+0000","last_became_active":"2024-03-16T07:28:55.989764+0000","last_became_peered":"2024-03-16T07:28:55.989764+0000","last_unstale":"2024-03-16T07:28:55.991488+0000","last_undegraded":"2024-03-16T07:28:55.991488+0000","last_fullsized":"2024-03-16T07:28:55.991488+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_clean_scrub_stamp":"2024-03-16T07:28:54.963620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:13:15.253368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.973691+0000","last_change":"2024-03-16T07:28:41.581320+0000","last_active":"2024-03-16T07:28:55.973691+0000","last_peered":"2024-03-16T07:28:55.973691+0000","last_clean":"2024-03-16T07:28:55.973691+0000","last_became_active":"2024-03-16T07:28:41.581060+0000","last_became_peered":"2024-03-16T07:28:41.581060+0000","last_unstale":"2024-03-16T07:28:55.973691+0000","last_undegraded":"2024-03-16T07:28:55.973691+0000","last_fullsized":"2024-03-16T07:28:55.973691+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:11:52.604254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:56.010066+0000","last_change":"2024-03-16T07:28:56.006528+0000","last_active":"2024-03-16T07:28:56.010066+0000","last_peered":"2024-03-16T07:28:56.010066+0000","last_clean":"2024-03-16T07:28:56.010066+0000","last_became_active":"2024-03-16T07:28:56.006172+0000","last_became_peered":"2024-03-16T07:28:56.006172+0000","last_unstale":"2024-03-16T07:28:56.010066+0000","last_undegraded":"2024-03-16T07:28:56.010066+0000","last_fullsized":"2024-03-16T07:28:56.010066+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_clean_scrub_stamp":"2024-03-16T07:28:54.963620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:38:58.977752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.986422+0000","last_change":"2024-03-16T07:28:41.587377+0000","last_active":"2024-03-16T07:28:55.986422+0000","last_peered":"2024-03-16T07:28:55.986422+0000","last_clean":"2024-03-16T07:28:55.986422+0000","last_became_active":"2024-03-16T07:28:41.586980+0000","last_became_peered":"2024-03-16T07:28:41.586980+0000","last_unstale":"2024-03-16T07:28:55.986422+0000","last_undegraded":"2024-03-16T07:28:55.986422+0000","last_fullsized":"2024-03-16T07:28:55.986422+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:51:48.259581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:56.005875+0000","last_change":"2024-03-16T07:28:56.000934+0000","last_active":"2024-03-16T07:28:56.005875+0000","last_peered":"2024-03-16T07:28:56.005875+0000","last_clean":"2024-03-16T07:28:56.005875+0000","last_became_active":"2024-03-16T07:28:55.992424+0000","last_became_peered":"2024-03-16T07:28:55.992424+0000","last_unstale":"2024-03-16T07:28:56.005875+0000","last_undegraded":"2024-03-16T07:28:56.005875+0000","last_fullsized":"2024-03-16T07:28:56.005875+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_clean_scrub_stamp":"2024-03-16T07:28:54.963620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:52:02.360890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.985861+0000","last_change":"2024-03-16T07:28:41.579054+0000","last_active":"2024-03-16T07:28:55.985861+0000","last_peered":"2024-03-16T07:28:55.985861+0000","last_clean":"2024-03-16T07:28:55.985861+0000","last_became_active":"2024-03-16T07:28:41.578801+0000","last_became_peered":"2024-03-16T07:28:41.578801+0000","last_unstale":"2024-03-16T07:28:55.985861+0000","last_undegraded":"2024-03-16T07:28:55.985861+0000","last_fullsized":"2024-03-16T07:28:55.985861+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:55:30.991091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:56.008136+0000","last_change":"2024-03-16T07:28:56.003622+0000","last_active":"2024-03-16T07:28:56.008136+0000","last_peered":"2024-03-16T07:28:56.008136+0000","last_clean":"2024-03-16T07:28:56.008136+0000","last_became_active":"2024-03-16T07:28:56.002430+0000","last_became_peered":"2024-03-16T07:28:56.002430+0000","last_unstale":"2024-03-16T07:28:56.008136+0000","last_undegraded":"2024-03-16T07:28:56.008136+0000","last_fullsized":"2024-03-16T07:28:56.008136+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_clean_scrub_stamp":"2024-03-16T07:28:54.963620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:05:22.629387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.975103+0000","last_change":"2024-03-16T07:28:41.576077+0000","last_active":"2024-03-16T07:28:55.975103+0000","last_peered":"2024-03-16T07:28:55.975103+0000","last_clean":"2024-03-16T07:28:55.975103+0000","last_became_active":"2024-03-16T07:28:41.575830+0000","last_became_peered":"2024-03-16T07:28:41.575830+0000","last_unstale":"2024-03-16T07:28:55.975103+0000","last_undegraded":"2024-03-16T07:28:55.975103+0000","last_fullsized":"2024-03-16T07:28:55.975103+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:14:32.345113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:56.004095+0000","last_change":"2024-03-16T07:28:55.999797+0000","last_active":"2024-03-16T07:28:56.004095+0000","last_peered":"2024-03-16T07:28:56.004095+0000","last_clean":"2024-03-16T07:28:56.004095+0000","last_became_active":"2024-03-16T07:28:55.999217+0000","last_became_peered":"2024-03-16T07:28:55.999217+0000","last_unstale":"2024-03-16T07:28:56.004095+0000","last_undegraded":"2024-03-16T07:28:56.004095+0000","last_fullsized":"2024-03-16T07:28:56.004095+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_clean_scrub_stamp":"2024-03-16T07:28:54.963620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:06:44.968559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.974543+0000","last_change":"2024-03-16T07:28:41.585018+0000","last_active":"2024-03-16T07:28:55.974543+0000","last_peered":"2024-03-16T07:28:55.974543+0000","last_clean":"2024-03-16T07:28:55.974543+0000","last_became_active":"2024-03-16T07:28:41.584767+0000","last_became_peered":"2024-03-16T07:28:41.584767+0000","last_unstale":"2024-03-16T07:28:55.974543+0000","last_undegraded":"2024-03-16T07:28:55.974543+0000","last_fullsized":"2024-03-16T07:28:55.974543+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:07:53.076520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.994861+0000","last_change":"2024-03-16T07:28:55.992449+0000","last_active":"2024-03-16T07:28:55.994861+0000","last_peered":"2024-03-16T07:28:55.994861+0000","last_clean":"2024-03-16T07:28:55.994861+0000","last_became_active":"2024-03-16T07:28:55.991705+0000","last_became_peered":"2024-03-16T07:28:55.991705+0000","last_unstale":"2024-03-16T07:28:55.994861+0000","last_undegraded":"2024-03-16T07:28:55.994861+0000","last_fullsized":"2024-03-16T07:28:55.994861+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_clean_scrub_stamp":"2024-03-16T07:28:54.963620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:55:45.092400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.968982+0000","last_change":"2024-03-16T07:28:41.579446+0000","last_active":"2024-03-16T07:28:55.968982+0000","last_peered":"2024-03-16T07:28:55.968982+0000","last_clean":"2024-03-16T07:28:55.968982+0000","last_became_active":"2024-03-16T07:28:41.579222+0000","last_became_peered":"2024-03-16T07:28:41.579222+0000","last_unstale":"2024-03-16T07:28:55.968982+0000","last_undegraded":"2024-03-16T07:28:55.968982+0000","last_fullsized":"2024-03-16T07:28:55.968982+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:58:10.625850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.996631+0000","last_change":"2024-03-16T07:28:55.992798+0000","last_active":"2024-03-16T07:28:55.996631+0000","last_peered":"2024-03-16T07:28:55.996631+0000","last_clean":"2024-03-16T07:28:55.996631+0000","last_became_active":"2024-03-16T07:28:55.989068+0000","last_became_peered":"2024-03-16T07:28:55.989068+0000","last_unstale":"2024-03-16T07:28:55.996631+0000","last_undegraded":"2024-03-16T07:28:55.996631+0000","last_fullsized":"2024-03-16T07:28:55.996631+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_clean_scrub_stamp":"2024-03-16T07:28:54.963620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:52:02.360890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.990790+0000","last_change":"2024-03-16T07:28:41.575562+0000","last_active":"2024-03-16T07:28:55.990790+0000","last_peered":"2024-03-16T07:28:55.990790+0000","last_clean":"2024-03-16T07:28:55.990790+0000","last_became_active":"2024-03-16T07:28:41.574861+0000","last_became_peered":"2024-03-16T07:28:41.574861+0000","last_unstale":"2024-03-16T07:28:55.990790+0000","last_undegraded":"2024-03-16T07:28:55.990790+0000","last_fullsized":"2024-03-16T07:28:55.990790+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:16:46.524824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:56.001814+0000","last_change":"2024-03-16T07:28:55.995419+0000","last_active":"2024-03-16T07:28:56.001814+0000","last_peered":"2024-03-16T07:28:56.001814+0000","last_clean":"2024-03-16T07:28:56.001814+0000","last_became_active":"2024-03-16T07:28:55.993340+0000","last_became_peered":"2024-03-16T07:28:55.993340+0000","last_unstale":"2024-03-16T07:28:56.001814+0000","last_undegraded":"2024-03-16T07:28:56.001814+0000","last_fullsized":"2024-03-16T07:28:56.001814+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_clean_scrub_stamp":"2024-03-16T07:28:54.963620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:48:32.792723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.969701+0000","last_change":"2024-03-16T07:28:41.573236+0000","last_active":"2024-03-16T07:28:55.969701+0000","last_peered":"2024-03-16T07:28:55.969701+0000","last_clean":"2024-03-16T07:28:55.969701+0000","last_became_active":"2024-03-16T07:28:41.572821+0000","last_became_peered":"2024-03-16T07:28:41.572821+0000","last_unstale":"2024-03-16T07:28:55.969701+0000","last_undegraded":"2024-03-16T07:28:55.969701+0000","last_fullsized":"2024-03-16T07:28:55.969701+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:53:47.532145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:56.004471+0000","last_change":"2024-03-16T07:28:55.994573+0000","last_active":"2024-03-16T07:28:56.004471+0000","last_peered":"2024-03-16T07:28:56.004471+0000","last_clean":"2024-03-16T07:28:56.004471+0000","last_became_active":"2024-03-16T07:28:55.994345+0000","last_became_peered":"2024-03-16T07:28:55.994345+0000","last_unstale":"2024-03-16T07:28:56.004471+0000","last_undegraded":"2024-03-16T07:28:56.004471+0000","last_fullsized":"2024-03-16T07:28:56.004471+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_clean_scrub_stamp":"2024-03-16T07:28:54.963620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:34:53.100466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.988159+0000","last_change":"2024-03-16T07:28:41.576503+0000","last_active":"2024-03-16T07:28:55.988159+0000","last_peered":"2024-03-16T07:28:55.988159+0000","last_clean":"2024-03-16T07:28:55.988159+0000","last_became_active":"2024-03-16T07:28:41.576209+0000","last_became_peered":"2024-03-16T07:28:41.576209+0000","last_unstale":"2024-03-16T07:28:55.988159+0000","last_undegraded":"2024-03-16T07:28:55.988159+0000","last_fullsized":"2024-03-16T07:28:55.988159+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:50:51.102035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:56.003981+0000","last_change":"2024-03-16T07:28:55.998559+0000","last_active":"2024-03-16T07:28:56.003981+0000","last_peered":"2024-03-16T07:28:56.003981+0000","last_clean":"2024-03-16T07:28:56.003981+0000","last_became_active":"2024-03-16T07:28:55.998113+0000","last_became_peered":"2024-03-16T07:28:55.998113+0000","last_unstale":"2024-03-16T07:28:56.003981+0000","last_undegraded":"2024-03-16T07:28:56.003981+0000","last_fullsized":"2024-03-16T07:28:56.003981+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_clean_scrub_stamp":"2024-03-16T07:28:54.963620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:11:10.385099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.970060+0000","last_change":"2024-03-16T07:28:41.580683+0000","last_active":"2024-03-16T07:28:55.970060+0000","last_peered":"2024-03-16T07:28:55.970060+0000","last_clean":"2024-03-16T07:28:55.970060+0000","last_became_active":"2024-03-16T07:28:41.580015+0000","last_became_peered":"2024-03-16T07:28:41.580015+0000","last_unstale":"2024-03-16T07:28:55.970060+0000","last_undegraded":"2024-03-16T07:28:55.970060+0000","last_fullsized":"2024-03-16T07:28:55.970060+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:13:22.941187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:56.003919+0000","last_change":"2024-03-16T07:28:55.997383+0000","last_active":"2024-03-16T07:28:56.003919+0000","last_peered":"2024-03-16T07:28:56.003919+0000","last_clean":"2024-03-16T07:28:56.003919+0000","last_became_active":"2024-03-16T07:28:55.997162+0000","last_became_peered":"2024-03-16T07:28:55.997162+0000","last_unstale":"2024-03-16T07:28:56.003919+0000","last_undegraded":"2024-03-16T07:28:56.003919+0000","last_fullsized":"2024-03-16T07:28:56.003919+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_clean_scrub_stamp":"2024-03-16T07:28:54.963620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:12:57.519834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.976692+0000","last_change":"2024-03-16T07:28:41.574346+0000","last_active":"2024-03-16T07:28:55.976692+0000","last_peered":"2024-03-16T07:28:55.976692+0000","last_clean":"2024-03-16T07:28:55.976692+0000","last_became_active":"2024-03-16T07:28:41.572788+0000","last_became_peered":"2024-03-16T07:28:41.572788+0000","last_unstale":"2024-03-16T07:28:55.976692+0000","last_undegraded":"2024-03-16T07:28:55.976692+0000","last_fullsized":"2024-03-16T07:28:55.976692+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:04:31.191298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.991971+0000","last_change":"2024-03-16T07:28:55.990172+0000","last_active":"2024-03-16T07:28:55.991971+0000","last_peered":"2024-03-16T07:28:55.991971+0000","last_clean":"2024-03-16T07:28:55.991971+0000","last_became_active":"2024-03-16T07:28:55.989601+0000","last_became_peered":"2024-03-16T07:28:55.989601+0000","last_unstale":"2024-03-16T07:28:55.991971+0000","last_undegraded":"2024-03-16T07:28:55.991971+0000","last_fullsized":"2024-03-16T07:28:55.991971+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_clean_scrub_stamp":"2024-03-16T07:28:54.963620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:49:53.338420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.975573+0000","last_change":"2024-03-16T07:28:41.585789+0000","last_active":"2024-03-16T07:28:55.975573+0000","last_peered":"2024-03-16T07:28:55.975573+0000","last_clean":"2024-03-16T07:28:55.975573+0000","last_became_active":"2024-03-16T07:28:41.585253+0000","last_became_peered":"2024-03-16T07:28:41.585253+0000","last_unstale":"2024-03-16T07:28:55.975573+0000","last_undegraded":"2024-03-16T07:28:55.975573+0000","last_fullsized":"2024-03-16T07:28:55.975573+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:52:41.800604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.999289+0000","last_change":"2024-03-16T07:28:55.996731+0000","last_active":"2024-03-16T07:28:55.999289+0000","last_peered":"2024-03-16T07:28:55.999289+0000","last_clean":"2024-03-16T07:28:55.999289+0000","last_became_active":"2024-03-16T07:28:55.996043+0000","last_became_peered":"2024-03-16T07:28:55.996043+0000","last_unstale":"2024-03-16T07:28:55.999289+0000","last_undegraded":"2024-03-16T07:28:55.999289+0000","last_fullsized":"2024-03-16T07:28:55.999289+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_clean_scrub_stamp":"2024-03-16T07:28:54.963620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:03:20.957952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.983476+0000","last_change":"2024-03-16T07:28:41.580659+0000","last_active":"2024-03-16T07:28:55.983476+0000","last_peered":"2024-03-16T07:28:55.983476+0000","last_clean":"2024-03-16T07:28:55.983476+0000","last_became_active":"2024-03-16T07:28:41.580236+0000","last_became_peered":"2024-03-16T07:28:41.580236+0000","last_unstale":"2024-03-16T07:28:55.983476+0000","last_undegraded":"2024-03-16T07:28:55.983476+0000","last_fullsized":"2024-03-16T07:28:55.983476+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:13:01.152059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:56.003899+0000","last_change":"2024-03-16T07:28:55.994379+0000","last_active":"2024-03-16T07:28:56.003899+0000","last_peered":"2024-03-16T07:28:56.003899+0000","last_clean":"2024-03-16T07:28:56.003899+0000","last_became_active":"2024-03-16T07:28:55.991996+0000","last_became_peered":"2024-03-16T07:28:55.991996+0000","last_unstale":"2024-03-16T07:28:56.003899+0000","last_undegraded":"2024-03-16T07:28:56.003899+0000","last_fullsized":"2024-03-16T07:28:56.003899+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_clean_scrub_stamp":"2024-03-16T07:28:54.963620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:20:07.538708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.968987+0000","last_change":"2024-03-16T07:28:41.578066+0000","last_active":"2024-03-16T07:28:55.968987+0000","last_peered":"2024-03-16T07:28:55.968987+0000","last_clean":"2024-03-16T07:28:55.968987+0000","last_became_active":"2024-03-16T07:28:41.577559+0000","last_became_peered":"2024-03-16T07:28:41.577559+0000","last_unstale":"2024-03-16T07:28:55.968987+0000","last_undegraded":"2024-03-16T07:28:55.968987+0000","last_fullsized":"2024-03-16T07:28:55.968987+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:59:28.713162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:56.000807+0000","last_change":"2024-03-16T07:28:55.999501+0000","last_active":"2024-03-16T07:28:56.000807+0000","last_peered":"2024-03-16T07:28:56.000807+0000","last_clean":"2024-03-16T07:28:56.000807+0000","last_became_active":"2024-03-16T07:28:55.996821+0000","last_became_peered":"2024-03-16T07:28:55.996821+0000","last_unstale":"2024-03-16T07:28:56.000807+0000","last_undegraded":"2024-03-16T07:28:56.000807+0000","last_fullsized":"2024-03-16T07:28:56.000807+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_clean_scrub_stamp":"2024-03-16T07:28:54.963620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:28:46.708502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.974560+0000","last_change":"2024-03-16T07:28:41.586201+0000","last_active":"2024-03-16T07:28:55.974560+0000","last_peered":"2024-03-16T07:28:55.974560+0000","last_clean":"2024-03-16T07:28:55.974560+0000","last_became_active":"2024-03-16T07:28:41.585957+0000","last_became_peered":"2024-03-16T07:28:41.585957+0000","last_unstale":"2024-03-16T07:28:55.974560+0000","last_undegraded":"2024-03-16T07:28:55.974560+0000","last_fullsized":"2024-03-16T07:28:55.974560+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:42:27.646009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.988233+0000","last_change":"2024-03-16T07:28:55.987814+0000","last_active":"2024-03-16T07:28:55.988233+0000","last_peered":"2024-03-16T07:28:55.988233+0000","last_clean":"2024-03-16T07:28:55.988233+0000","last_became_active":"2024-03-16T07:28:55.987512+0000","last_became_peered":"2024-03-16T07:28:55.987512+0000","last_unstale":"2024-03-16T07:28:55.988233+0000","last_undegraded":"2024-03-16T07:28:55.988233+0000","last_fullsized":"2024-03-16T07:28:55.988233+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_clean_scrub_stamp":"2024-03-16T07:28:54.963620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:54:50.244190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.972706+0000","last_change":"2024-03-16T07:28:41.584462+0000","last_active":"2024-03-16T07:28:55.972706+0000","last_peered":"2024-03-16T07:28:55.972706+0000","last_clean":"2024-03-16T07:28:55.972706+0000","last_became_active":"2024-03-16T07:28:41.583131+0000","last_became_peered":"2024-03-16T07:28:41.583131+0000","last_unstale":"2024-03-16T07:28:55.972706+0000","last_undegraded":"2024-03-16T07:28:55.972706+0000","last_fullsized":"2024-03-16T07:28:55.972706+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:53:17.428726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:56.004494+0000","last_change":"2024-03-16T07:28:55.995291+0000","last_active":"2024-03-16T07:28:56.004494+0000","last_peered":"2024-03-16T07:28:56.004494+0000","last_clean":"2024-03-16T07:28:56.004494+0000","last_became_active":"2024-03-16T07:28:55.995053+0000","last_became_peered":"2024-03-16T07:28:55.995053+0000","last_unstale":"2024-03-16T07:28:56.004494+0000","last_undegraded":"2024-03-16T07:28:56.004494+0000","last_fullsized":"2024-03-16T07:28:56.004494+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_clean_scrub_stamp":"2024-03-16T07:28:54.963620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:04:19.463088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.974320+0000","last_change":"2024-03-16T07:28:41.574267+0000","last_active":"2024-03-16T07:28:55.974320+0000","last_peered":"2024-03-16T07:28:55.974320+0000","last_clean":"2024-03-16T07:28:55.974320+0000","last_became_active":"2024-03-16T07:28:41.573063+0000","last_became_peered":"2024-03-16T07:28:41.573063+0000","last_unstale":"2024-03-16T07:28:55.974320+0000","last_undegraded":"2024-03-16T07:28:55.974320+0000","last_fullsized":"2024-03-16T07:28:55.974320+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:54:36.285120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:56.008257+0000","last_change":"2024-03-16T07:28:56.005747+0000","last_active":"2024-03-16T07:28:56.008257+0000","last_peered":"2024-03-16T07:28:56.008257+0000","last_clean":"2024-03-16T07:28:56.008257+0000","last_became_active":"2024-03-16T07:28:56.004450+0000","last_became_peered":"2024-03-16T07:28:56.004450+0000","last_unstale":"2024-03-16T07:28:56.008257+0000","last_undegraded":"2024-03-16T07:28:56.008257+0000","last_fullsized":"2024-03-16T07:28:56.008257+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_clean_scrub_stamp":"2024-03-16T07:28:54.963620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:33:44.362493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.973384+0000","last_change":"2024-03-16T07:28:41.581852+0000","last_active":"2024-03-16T07:28:55.973384+0000","last_peered":"2024-03-16T07:28:55.973384+0000","last_clean":"2024-03-16T07:28:55.973384+0000","last_became_active":"2024-03-16T07:28:41.581577+0000","last_became_peered":"2024-03-16T07:28:41.581577+0000","last_unstale":"2024-03-16T07:28:55.973384+0000","last_undegraded":"2024-03-16T07:28:55.973384+0000","last_fullsized":"2024-03-16T07:28:55.973384+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:46:18.244213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:56.005858+0000","last_change":"2024-03-16T07:28:56.000699+0000","last_active":"2024-03-16T07:28:56.005858+0000","last_peered":"2024-03-16T07:28:56.005858+0000","last_clean":"2024-03-16T07:28:56.005858+0000","last_became_active":"2024-03-16T07:28:55.993328+0000","last_became_peered":"2024-03-16T07:28:55.993328+0000","last_unstale":"2024-03-16T07:28:56.005858+0000","last_undegraded":"2024-03-16T07:28:56.005858+0000","last_fullsized":"2024-03-16T07:28:56.005858+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_clean_scrub_stamp":"2024-03-16T07:28:54.963620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:12:43.816594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.972015+0000","last_change":"2024-03-16T07:28:41.582852+0000","last_active":"2024-03-16T07:28:55.972015+0000","last_peered":"2024-03-16T07:28:55.972015+0000","last_clean":"2024-03-16T07:28:55.972015+0000","last_became_active":"2024-03-16T07:28:41.582617+0000","last_became_peered":"2024-03-16T07:28:41.582617+0000","last_unstale":"2024-03-16T07:28:55.972015+0000","last_undegraded":"2024-03-16T07:28:55.972015+0000","last_fullsized":"2024-03-16T07:28:55.972015+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:37:56.085909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.995631+0000","last_change":"2024-03-16T07:28:55.990536+0000","last_active":"2024-03-16T07:28:55.995631+0000","last_peered":"2024-03-16T07:28:55.995631+0000","last_clean":"2024-03-16T07:28:55.995631+0000","last_became_active":"2024-03-16T07:28:55.990314+0000","last_became_peered":"2024-03-16T07:28:55.990314+0000","last_unstale":"2024-03-16T07:28:55.995631+0000","last_undegraded":"2024-03-16T07:28:55.995631+0000","last_fullsized":"2024-03-16T07:28:55.995631+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_clean_scrub_stamp":"2024-03-16T07:28:54.963620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:14:03.009414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.975671+0000","last_change":"2024-03-16T07:28:41.583248+0000","last_active":"2024-03-16T07:28:55.975671+0000","last_peered":"2024-03-16T07:28:55.975671+0000","last_clean":"2024-03-16T07:28:55.975671+0000","last_became_active":"2024-03-16T07:28:41.582850+0000","last_became_peered":"2024-03-16T07:28:41.582850+0000","last_unstale":"2024-03-16T07:28:55.975671+0000","last_undegraded":"2024-03-16T07:28:55.975671+0000","last_fullsized":"2024-03-16T07:28:55.975671+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:22:34.129441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:56.008301+0000","last_change":"2024-03-16T07:28:56.005331+0000","last_active":"2024-03-16T07:28:56.008301+0000","last_peered":"2024-03-16T07:28:56.008301+0000","last_clean":"2024-03-16T07:28:56.008301+0000","last_became_active":"2024-03-16T07:28:56.004400+0000","last_became_peered":"2024-03-16T07:28:56.004400+0000","last_unstale":"2024-03-16T07:28:56.008301+0000","last_undegraded":"2024-03-16T07:28:56.008301+0000","last_fullsized":"2024-03-16T07:28:56.008301+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_clean_scrub_stamp":"2024-03-16T07:28:54.963620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:23:42.169905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.968321+0000","last_change":"2024-03-16T07:28:41.574835+0000","last_active":"2024-03-16T07:28:55.968321+0000","last_peered":"2024-03-16T07:28:55.968321+0000","last_clean":"2024-03-16T07:28:55.968321+0000","last_became_active":"2024-03-16T07:28:41.574293+0000","last_became_peered":"2024-03-16T07:28:41.574293+0000","last_unstale":"2024-03-16T07:28:55.968321+0000","last_undegraded":"2024-03-16T07:28:55.968321+0000","last_fullsized":"2024-03-16T07:28:55.968321+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:53:17.428726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.992903+0000","last_change":"2024-03-16T07:28:55.990866+0000","last_active":"2024-03-16T07:28:55.992903+0000","last_peered":"2024-03-16T07:28:55.992903+0000","last_clean":"2024-03-16T07:28:55.992903+0000","last_became_active":"2024-03-16T07:28:55.989884+0000","last_became_peered":"2024-03-16T07:28:55.989884+0000","last_unstale":"2024-03-16T07:28:55.992903+0000","last_undegraded":"2024-03-16T07:28:55.992903+0000","last_fullsized":"2024-03-16T07:28:55.992903+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_clean_scrub_stamp":"2024-03-16T07:28:54.963620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:49:10.718848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.969099+0000","last_change":"2024-03-16T07:28:41.577793+0000","last_active":"2024-03-16T07:28:55.969099+0000","last_peered":"2024-03-16T07:28:55.969099+0000","last_clean":"2024-03-16T07:28:55.969099+0000","last_became_active":"2024-03-16T07:28:41.577243+0000","last_became_peered":"2024-03-16T07:28:41.577243+0000","last_unstale":"2024-03-16T07:28:55.969099+0000","last_undegraded":"2024-03-16T07:28:55.969099+0000","last_fullsized":"2024-03-16T07:28:55.969099+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:56:37.671313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.997800+0000","last_change":"2024-03-16T07:28:55.991894+0000","last_active":"2024-03-16T07:28:55.997800+0000","last_peered":"2024-03-16T07:28:55.997800+0000","last_clean":"2024-03-16T07:28:55.997800+0000","last_became_active":"2024-03-16T07:28:55.991669+0000","last_became_peered":"2024-03-16T07:28:55.991669+0000","last_unstale":"2024-03-16T07:28:55.997800+0000","last_undegraded":"2024-03-16T07:28:55.997800+0000","last_fullsized":"2024-03-16T07:28:55.997800+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_clean_scrub_stamp":"2024-03-16T07:28:54.963620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:54:50.244190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"77'2","reported_seq":14,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:56.010362+0000","last_change":"2024-03-16T07:28:54.993398+0000","last_active":"2024-03-16T07:28:56.010362+0000","last_peered":"2024-03-16T07:28:56.010362+0000","last_clean":"2024-03-16T07:28:56.010362+0000","last_became_active":"2024-03-16T07:28:54.992833+0000","last_became_peered":"2024-03-16T07:28:54.992833+0000","last_unstale":"2024-03-16T07:28:56.010362+0000","last_undegraded":"2024-03-16T07:28:56.010362+0000","last_fullsized":"2024-03-16T07:28:56.010362+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:53.959780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:53.959780+0000","last_clean_scrub_stamp":"2024-03-16T07:28:53.959780+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:44:20.836034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.989560+0000","last_change":"2024-03-16T07:28:41.579444+0000","last_active":"2024-03-16T07:28:55.989560+0000","last_peered":"2024-03-16T07:28:55.989560+0000","last_clean":"2024-03-16T07:28:55.989560+0000","last_became_active":"2024-03-16T07:28:41.579180+0000","last_became_peered":"2024-03-16T07:28:41.579180+0000","last_unstale":"2024-03-16T07:28:55.989560+0000","last_undegraded":"2024-03-16T07:28:55.989560+0000","last_fullsized":"2024-03-16T07:28:55.989560+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:36:35.214743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"73'4","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.990895+0000","last_change":"2024-03-16T07:28:40.884571+0000","last_active":"2024-03-16T07:28:55.990895+0000","last_peered":"2024-03-16T07:28:55.990895+0000","last_clean":"2024-03-16T07:28:55.990895+0000","last_became_active":"2024-03-16T07:28:40.884044+0000","last_became_peered":"2024-03-16T07:28:40.884044+0000","last_unstale":"2024-03-16T07:28:55.990895+0000","last_undegraded":"2024-03-16T07:28:55.990895+0000","last_fullsized":"2024-03-16T07:28:55.990895+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_clean_scrub_stamp":"2024-03-16T07:28:39.861342+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:05:55.028514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:56.007916+0000","last_change":"2024-03-16T07:28:56.003358+0000","last_active":"2024-03-16T07:28:56.007916+0000","last_peered":"2024-03-16T07:28:56.007916+0000","last_clean":"2024-03-16T07:28:56.007916+0000","last_became_active":"2024-03-16T07:28:56.003140+0000","last_became_peered":"2024-03-16T07:28:56.003140+0000","last_unstale":"2024-03-16T07:28:56.007916+0000","last_undegraded":"2024-03-16T07:28:56.007916+0000","last_fullsized":"2024-03-16T07:28:56.007916+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_clean_scrub_stamp":"2024-03-16T07:28:54.963620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:44:32.924114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"77'2","reported_seq":14,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:56.007708+0000","last_change":"2024-03-16T07:28:54.989688+0000","last_active":"2024-03-16T07:28:56.007708+0000","last_peered":"2024-03-16T07:28:56.007708+0000","last_clean":"2024-03-16T07:28:56.007708+0000","last_became_active":"2024-03-16T07:28:54.988974+0000","last_became_peered":"2024-03-16T07:28:54.988974+0000","last_unstale":"2024-03-16T07:28:56.007708+0000","last_undegraded":"2024-03-16T07:28:56.007708+0000","last_fullsized":"2024-03-16T07:28:56.007708+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:53.959780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:53.959780+0000","last_clean_scrub_stamp":"2024-03-16T07:28:53.959780+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:07:18.788373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.974665+0000","last_change":"2024-03-16T07:28:41.584924+0000","last_active":"2024-03-16T07:28:55.974665+0000","last_peered":"2024-03-16T07:28:55.974665+0000","last_clean":"2024-03-16T07:28:55.974665+0000","last_became_active":"2024-03-16T07:28:41.583141+0000","last_became_peered":"2024-03-16T07:28:41.583141+0000","last_unstale":"2024-03-16T07:28:55.974665+0000","last_undegraded":"2024-03-16T07:28:55.974665+0000","last_fullsized":"2024-03-16T07:28:55.974665+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:05:51.922468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1e","version":"73'1","reported_seq":21,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.969795+0000","last_change":"2024-03-16T07:28:40.880780+0000","last_active":"2024-03-16T07:28:55.969795+0000","last_peered":"2024-03-16T07:28:55.969795+0000","last_clean":"2024-03-16T07:28:55.969795+0000","last_became_active":"2024-03-16T07:28:40.880529+0000","last_became_peered":"2024-03-16T07:28:40.880529+0000","last_unstale":"2024-03-16T07:28:55.969795+0000","last_undegraded":"2024-03-16T07:28:55.969795+0000","last_fullsized":"2024-03-16T07:28:55.969795+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_clean_scrub_stamp":"2024-03-16T07:28:39.861342+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:11:38.794188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.991181+0000","last_change":"2024-03-16T07:28:55.990416+0000","last_active":"2024-03-16T07:28:55.991181+0000","last_peered":"2024-03-16T07:28:55.991181+0000","last_clean":"2024-03-16T07:28:55.991181+0000","last_became_active":"2024-03-16T07:28:55.989035+0000","last_became_peered":"2024-03-16T07:28:55.989035+0000","last_unstale":"2024-03-16T07:28:55.991181+0000","last_undegraded":"2024-03-16T07:28:55.991181+0000","last_fullsized":"2024-03-16T07:28:55.991181+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_clean_scrub_stamp":"2024-03-16T07:28:54.963620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:28:33.174472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"77'4","reported_seq":16,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:56.010671+0000","last_change":"2024-03-16T07:28:54.986505+0000","last_active":"2024-03-16T07:28:56.010671+0000","last_peered":"2024-03-16T07:28:56.010671+0000","last_clean":"2024-03-16T07:28:56.010671+0000","last_became_active":"2024-03-16T07:28:54.986079+0000","last_became_peered":"2024-03-16T07:28:54.986079+0000","last_unstale":"2024-03-16T07:28:56.010671+0000","last_undegraded":"2024-03-16T07:28:56.010671+0000","last_fullsized":"2024-03-16T07:28:56.010671+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:53.959780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:53.959780+0000","last_clean_scrub_stamp":"2024-03-16T07:28:53.959780+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:24:56.292411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.986523+0000","last_change":"2024-03-16T07:28:41.587228+0000","last_active":"2024-03-16T07:28:55.986523+0000","last_peered":"2024-03-16T07:28:55.986523+0000","last_clean":"2024-03-16T07:28:55.986523+0000","last_became_active":"2024-03-16T07:28:41.586930+0000","last_became_peered":"2024-03-16T07:28:41.586930+0000","last_unstale":"2024-03-16T07:28:55.986523+0000","last_undegraded":"2024-03-16T07:28:55.986523+0000","last_fullsized":"2024-03-16T07:28:55.986523+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:09:13.097423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1d","version":"73'2","reported_seq":22,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.988293+0000","last_change":"2024-03-16T07:28:40.889280+0000","last_active":"2024-03-16T07:28:55.988293+0000","last_peered":"2024-03-16T07:28:55.988293+0000","last_clean":"2024-03-16T07:28:55.988293+0000","last_became_active":"2024-03-16T07:28:40.889014+0000","last_became_peered":"2024-03-16T07:28:40.889014+0000","last_unstale":"2024-03-16T07:28:55.988293+0000","last_undegraded":"2024-03-16T07:28:55.988293+0000","last_fullsized":"2024-03-16T07:28:55.988293+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_clean_scrub_stamp":"2024-03-16T07:28:39.861342+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:30:34.345858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.995390+0000","last_change":"2024-03-16T07:28:55.991102+0000","last_active":"2024-03-16T07:28:55.995390+0000","last_peered":"2024-03-16T07:28:55.995390+0000","last_clean":"2024-03-16T07:28:55.995390+0000","last_became_active":"2024-03-16T07:28:55.990869+0000","last_became_peered":"2024-03-16T07:28:55.990869+0000","last_unstale":"2024-03-16T07:28:55.995390+0000","last_undegraded":"2024-03-16T07:28:55.995390+0000","last_fullsized":"2024-03-16T07:28:55.995390+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_clean_scrub_stamp":"2024-03-16T07:28:54.963620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:12:36.583573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1e","version":"77'1","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:56.010613+0000","last_change":"2024-03-16T07:28:54.985456+0000","last_active":"2024-03-16T07:28:56.010613+0000","last_peered":"2024-03-16T07:28:56.010613+0000","last_clean":"2024-03-16T07:28:56.010613+0000","last_became_active":"2024-03-16T07:28:54.984861+0000","last_became_peered":"2024-03-16T07:28:54.984861+0000","last_unstale":"2024-03-16T07:28:56.010613+0000","last_undegraded":"2024-03-16T07:28:56.010613+0000","last_fullsized":"2024-03-16T07:28:56.010613+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:53.959780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:53.959780+0000","last_clean_scrub_stamp":"2024-03-16T07:28:53.959780+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:31:03.904867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.973772+0000","last_change":"2024-03-16T07:28:41.574130+0000","last_active":"2024-03-16T07:28:55.973772+0000","last_peered":"2024-03-16T07:28:55.973772+0000","last_clean":"2024-03-16T07:28:55.973772+0000","last_became_active":"2024-03-16T07:28:41.573863+0000","last_became_peered":"2024-03-16T07:28:41.573863+0000","last_unstale":"2024-03-16T07:28:55.973772+0000","last_undegraded":"2024-03-16T07:28:55.973772+0000","last_fullsized":"2024-03-16T07:28:55.973772+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:56:37.671313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1c","version":"73'2","reported_seq":22,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.986706+0000","last_change":"2024-03-16T07:28:40.890321+0000","last_active":"2024-03-16T07:28:55.986706+0000","last_peered":"2024-03-16T07:28:55.986706+0000","last_clean":"2024-03-16T07:28:55.986706+0000","last_became_active":"2024-03-16T07:28:40.888214+0000","last_became_peered":"2024-03-16T07:28:40.888214+0000","last_unstale":"2024-03-16T07:28:55.986706+0000","last_undegraded":"2024-03-16T07:28:55.986706+0000","last_fullsized":"2024-03-16T07:28:55.986706+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_clean_scrub_stamp":"2024-03-16T07:28:39.861342+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:59:34.630341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:56.008104+0000","last_change":"2024-03-16T07:28:56.002672+0000","last_active":"2024-03-16T07:28:56.008104+0000","last_peered":"2024-03-16T07:28:56.008104+0000","last_clean":"2024-03-16T07:28:56.008104+0000","last_became_active":"2024-03-16T07:28:55.997481+0000","last_became_peered":"2024-03-16T07:28:55.997481+0000","last_unstale":"2024-03-16T07:28:56.008104+0000","last_undegraded":"2024-03-16T07:28:56.008104+0000","last_fullsized":"2024-03-16T07:28:56.008104+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_clean_scrub_stamp":"2024-03-16T07:28:54.963620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:36:33.155947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":12,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.983183+0000","last_change":"2024-03-16T07:28:54.985516+0000","last_active":"2024-03-16T07:28:55.983183+0000","last_peered":"2024-03-16T07:28:55.983183+0000","last_clean":"2024-03-16T07:28:55.983183+0000","last_became_active":"2024-03-16T07:28:54.985118+0000","last_became_peered":"2024-03-16T07:28:54.985118+0000","last_unstale":"2024-03-16T07:28:55.983183+0000","last_undegraded":"2024-03-16T07:28:55.983183+0000","last_fullsized":"2024-03-16T07:28:55.983183+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:53.959780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:53.959780+0000","last_clean_scrub_stamp":"2024-03-16T07:28:53.959780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:17:21.262323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.975759+0000","last_change":"2024-03-16T07:28:41.583111+0000","last_active":"2024-03-16T07:28:55.975759+0000","last_peered":"2024-03-16T07:28:55.975759+0000","last_clean":"2024-03-16T07:28:55.975759+0000","last_became_active":"2024-03-16T07:28:41.582554+0000","last_became_peered":"2024-03-16T07:28:41.582554+0000","last_unstale":"2024-03-16T07:28:55.975759+0000","last_undegraded":"2024-03-16T07:28:55.975759+0000","last_fullsized":"2024-03-16T07:28:55.975759+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:30:35.704161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"73'1","reported_seq":21,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.986340+0000","last_change":"2024-03-16T07:28:40.884283+0000","last_active":"2024-03-16T07:28:55.986340+0000","last_peered":"2024-03-16T07:28:55.986340+0000","last_clean":"2024-03-16T07:28:55.986340+0000","last_became_active":"2024-03-16T07:28:40.884015+0000","last_became_peered":"2024-03-16T07:28:40.884015+0000","last_unstale":"2024-03-16T07:28:55.986340+0000","last_undegraded":"2024-03-16T07:28:55.986340+0000","last_fullsized":"2024-03-16T07:28:55.986340+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_clean_scrub_stamp":"2024-03-16T07:28:39.861342+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:27:57.241790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:56.005840+0000","last_change":"2024-03-16T07:28:56.000515+0000","last_active":"2024-03-16T07:28:56.005840+0000","last_peered":"2024-03-16T07:28:56.005840+0000","last_clean":"2024-03-16T07:28:56.005840+0000","last_became_active":"2024-03-16T07:28:55.992995+0000","last_became_peered":"2024-03-16T07:28:55.992995+0000","last_unstale":"2024-03-16T07:28:56.005840+0000","last_undegraded":"2024-03-16T07:28:56.005840+0000","last_fullsized":"2024-03-16T07:28:56.005840+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_clean_scrub_stamp":"2024-03-16T07:28:54.963620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:17:00.626133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":12,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.971757+0000","last_change":"2024-03-16T07:28:54.983484+0000","last_active":"2024-03-16T07:28:55.971757+0000","last_peered":"2024-03-16T07:28:55.971757+0000","last_clean":"2024-03-16T07:28:55.971757+0000","last_became_active":"2024-03-16T07:28:54.983181+0000","last_became_peered":"2024-03-16T07:28:54.983181+0000","last_unstale":"2024-03-16T07:28:55.971757+0000","last_undegraded":"2024-03-16T07:28:55.971757+0000","last_fullsized":"2024-03-16T07:28:55.971757+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:53.959780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:53.959780+0000","last_clean_scrub_stamp":"2024-03-16T07:28:53.959780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:27:32.183748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.976815+0000","last_change":"2024-03-16T07:28:41.573219+0000","last_active":"2024-03-16T07:28:55.976815+0000","last_peered":"2024-03-16T07:28:55.976815+0000","last_clean":"2024-03-16T07:28:55.976815+0000","last_became_active":"2024-03-16T07:28:41.572483+0000","last_became_peered":"2024-03-16T07:28:41.572483+0000","last_unstale":"2024-03-16T07:28:55.976815+0000","last_undegraded":"2024-03-16T07:28:55.976815+0000","last_fullsized":"2024-03-16T07:28:55.976815+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:44:37.453210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.1a","version":"73'1","reported_seq":21,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.975295+0000","last_change":"2024-03-16T07:28:40.878927+0000","last_active":"2024-03-16T07:28:55.975295+0000","last_peered":"2024-03-16T07:28:55.975295+0000","last_clean":"2024-03-16T07:28:55.975295+0000","last_became_active":"2024-03-16T07:28:40.878669+0000","last_became_peered":"2024-03-16T07:28:40.878669+0000","last_unstale":"2024-03-16T07:28:55.975295+0000","last_undegraded":"2024-03-16T07:28:55.975295+0000","last_fullsized":"2024-03-16T07:28:55.975295+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_clean_scrub_stamp":"2024-03-16T07:28:39.861342+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:51:58.338500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.995036+0000","last_change":"2024-03-16T07:28:55.989524+0000","last_active":"2024-03-16T07:28:55.995036+0000","last_peered":"2024-03-16T07:28:55.995036+0000","last_clean":"2024-03-16T07:28:55.995036+0000","last_became_active":"2024-03-16T07:28:55.989299+0000","last_became_peered":"2024-03-16T07:28:55.989299+0000","last_unstale":"2024-03-16T07:28:55.995036+0000","last_undegraded":"2024-03-16T07:28:55.995036+0000","last_fullsized":"2024-03-16T07:28:55.995036+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_clean_scrub_stamp":"2024-03-16T07:28:54.963620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:52:21.424117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1b","version":"77'1","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:56.001646+0000","last_change":"2024-03-16T07:28:54.987010+0000","last_active":"2024-03-16T07:28:56.001646+0000","last_peered":"2024-03-16T07:28:56.001646+0000","last_clean":"2024-03-16T07:28:56.001646+0000","last_became_active":"2024-03-16T07:28:54.986762+0000","last_became_peered":"2024-03-16T07:28:54.986762+0000","last_unstale":"2024-03-16T07:28:56.001646+0000","last_undegraded":"2024-03-16T07:28:56.001646+0000","last_fullsized":"2024-03-16T07:28:56.001646+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:53.959780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:53.959780+0000","last_clean_scrub_stamp":"2024-03-16T07:28:53.959780+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:59:48.728779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.971939+0000","last_change":"2024-03-16T07:28:41.585134+0000","last_active":"2024-03-16T07:28:55.971939+0000","last_peered":"2024-03-16T07:28:55.971939+0000","last_clean":"2024-03-16T07:28:55.971939+0000","last_became_active":"2024-03-16T07:28:41.584887+0000","last_became_peered":"2024-03-16T07:28:41.584887+0000","last_unstale":"2024-03-16T07:28:55.971939+0000","last_undegraded":"2024-03-16T07:28:55.971939+0000","last_fullsized":"2024-03-16T07:28:55.971939+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:31:17.966399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":20,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.983711+0000","last_change":"2024-03-16T07:28:40.890932+0000","last_active":"2024-03-16T07:28:55.983711+0000","last_peered":"2024-03-16T07:28:55.983711+0000","last_clean":"2024-03-16T07:28:55.983711+0000","last_became_active":"2024-03-16T07:28:40.890340+0000","last_became_peered":"2024-03-16T07:28:40.890340+0000","last_unstale":"2024-03-16T07:28:55.983711+0000","last_undegraded":"2024-03-16T07:28:55.983711+0000","last_fullsized":"2024-03-16T07:28:55.983711+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_clean_scrub_stamp":"2024-03-16T07:28:39.861342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:54:35.284150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:56.004074+0000","last_change":"2024-03-16T07:28:55.999675+0000","last_active":"2024-03-16T07:28:56.004074+0000","last_peered":"2024-03-16T07:28:56.004074+0000","last_clean":"2024-03-16T07:28:56.004074+0000","last_became_active":"2024-03-16T07:28:55.999365+0000","last_became_peered":"2024-03-16T07:28:55.999365+0000","last_unstale":"2024-03-16T07:28:56.004074+0000","last_undegraded":"2024-03-16T07:28:56.004074+0000","last_fullsized":"2024-03-16T07:28:56.004074+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_clean_scrub_stamp":"2024-03-16T07:28:54.963620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:10:54.130248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1a","version":"77'1","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:56.005257+0000","last_change":"2024-03-16T07:28:54.985591+0000","last_active":"2024-03-16T07:28:56.005257+0000","last_peered":"2024-03-16T07:28:56.005257+0000","last_clean":"2024-03-16T07:28:56.005257+0000","last_became_active":"2024-03-16T07:28:54.984750+0000","last_became_peered":"2024-03-16T07:28:54.984750+0000","last_unstale":"2024-03-16T07:28:56.005257+0000","last_undegraded":"2024-03-16T07:28:56.005257+0000","last_fullsized":"2024-03-16T07:28:56.005257+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:53.959780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:53.959780+0000","last_clean_scrub_stamp":"2024-03-16T07:28:53.959780+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:56:05.105114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.968405+0000","last_change":"2024-03-16T07:28:41.577102+0000","last_active":"2024-03-16T07:28:55.968405+0000","last_peered":"2024-03-16T07:28:55.968405+0000","last_clean":"2024-03-16T07:28:55.968405+0000","last_became_active":"2024-03-16T07:28:41.576845+0000","last_became_peered":"2024-03-16T07:28:41.576845+0000","last_unstale":"2024-03-16T07:28:55.968405+0000","last_undegraded":"2024-03-16T07:28:55.968405+0000","last_fullsized":"2024-03-16T07:28:55.968405+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:30:35.346827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":20,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.972335+0000","last_change":"2024-03-16T07:28:40.883138+0000","last_active":"2024-03-16T07:28:55.972335+0000","last_peered":"2024-03-16T07:28:55.972335+0000","last_clean":"2024-03-16T07:28:55.972335+0000","last_became_active":"2024-03-16T07:28:40.882873+0000","last_became_peered":"2024-03-16T07:28:40.882873+0000","last_unstale":"2024-03-16T07:28:55.972335+0000","last_undegraded":"2024-03-16T07:28:55.972335+0000","last_fullsized":"2024-03-16T07:28:55.972335+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_clean_scrub_stamp":"2024-03-16T07:28:39.861342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:50:03.695566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:56.000131+0000","last_change":"2024-03-16T07:28:55.996492+0000","last_active":"2024-03-16T07:28:56.000131+0000","last_peered":"2024-03-16T07:28:56.000131+0000","last_clean":"2024-03-16T07:28:56.000131+0000","last_became_active":"2024-03-16T07:28:55.996056+0000","last_became_peered":"2024-03-16T07:28:55.996056+0000","last_unstale":"2024-03-16T07:28:56.000131+0000","last_undegraded":"2024-03-16T07:28:56.000131+0000","last_fullsized":"2024-03-16T07:28:56.000131+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_clean_scrub_stamp":"2024-03-16T07:28:54.963620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:07:44.085051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.15","version":"77'3","reported_seq":15,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:56.007326+0000","last_change":"2024-03-16T07:28:54.980899+0000","last_active":"2024-03-16T07:28:56.007326+0000","last_peered":"2024-03-16T07:28:56.007326+0000","last_clean":"2024-03-16T07:28:56.007326+0000","last_became_active":"2024-03-16T07:28:54.980524+0000","last_became_peered":"2024-03-16T07:28:54.980524+0000","last_unstale":"2024-03-16T07:28:56.007326+0000","last_undegraded":"2024-03-16T07:28:56.007326+0000","last_fullsized":"2024-03-16T07:28:56.007326+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:53.959780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:53.959780+0000","last_clean_scrub_stamp":"2024-03-16T07:28:53.959780+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:33:08.325174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.989661+0000","last_change":"2024-03-16T07:28:41.586728+0000","last_active":"2024-03-16T07:28:55.989661+0000","last_peered":"2024-03-16T07:28:55.989661+0000","last_clean":"2024-03-16T07:28:55.989661+0000","last_became_active":"2024-03-16T07:28:41.586429+0000","last_became_peered":"2024-03-16T07:28:41.586429+0000","last_unstale":"2024-03-16T07:28:55.989661+0000","last_undegraded":"2024-03-16T07:28:55.989661+0000","last_fullsized":"2024-03-16T07:28:55.989661+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:07:29.983742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":20,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.977762+0000","last_change":"2024-03-16T07:28:40.887890+0000","last_active":"2024-03-16T07:28:55.977762+0000","last_peered":"2024-03-16T07:28:55.977762+0000","last_clean":"2024-03-16T07:28:55.977762+0000","last_became_active":"2024-03-16T07:28:40.887271+0000","last_became_peered":"2024-03-16T07:28:40.887271+0000","last_unstale":"2024-03-16T07:28:55.977762+0000","last_undegraded":"2024-03-16T07:28:55.977762+0000","last_fullsized":"2024-03-16T07:28:55.977762+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_clean_scrub_stamp":"2024-03-16T07:28:39.861342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:57:30.494001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:56.002762+0000","last_change":"2024-03-16T07:28:56.000652+0000","last_active":"2024-03-16T07:28:56.002762+0000","last_peered":"2024-03-16T07:28:56.002762+0000","last_clean":"2024-03-16T07:28:56.002762+0000","last_became_active":"2024-03-16T07:28:56.000413+0000","last_became_peered":"2024-03-16T07:28:56.000413+0000","last_unstale":"2024-03-16T07:28:56.002762+0000","last_undegraded":"2024-03-16T07:28:56.002762+0000","last_fullsized":"2024-03-16T07:28:56.002762+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_clean_scrub_stamp":"2024-03-16T07:28:54.963620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:33:01.073896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.14","version":"77'6","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:56.010819+0000","last_change":"2024-03-16T07:28:54.989985+0000","last_active":"2024-03-16T07:28:56.010819+0000","last_peered":"2024-03-16T07:28:56.010819+0000","last_clean":"2024-03-16T07:28:56.010819+0000","last_became_active":"2024-03-16T07:28:54.989760+0000","last_became_peered":"2024-03-16T07:28:54.989760+0000","last_unstale":"2024-03-16T07:28:56.010819+0000","last_undegraded":"2024-03-16T07:28:56.010819+0000","last_fullsized":"2024-03-16T07:28:56.010819+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:53.959780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:53.959780+0000","last_clean_scrub_stamp":"2024-03-16T07:28:53.959780+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:55:47.669989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.974760+0000","last_change":"2024-03-16T07:28:41.584498+0000","last_active":"2024-03-16T07:28:55.974760+0000","last_peered":"2024-03-16T07:28:55.974760+0000","last_clean":"2024-03-16T07:28:55.974760+0000","last_became_active":"2024-03-16T07:28:41.581697+0000","last_became_peered":"2024-03-16T07:28:41.581697+0000","last_unstale":"2024-03-16T07:28:55.974760+0000","last_undegraded":"2024-03-16T07:28:55.974760+0000","last_fullsized":"2024-03-16T07:28:55.974760+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:14:32.345113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":20,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.969802+0000","last_change":"2024-03-16T07:28:40.886362+0000","last_active":"2024-03-16T07:28:55.969802+0000","last_peered":"2024-03-16T07:28:55.969802+0000","last_clean":"2024-03-16T07:28:55.969802+0000","last_became_active":"2024-03-16T07:28:40.886129+0000","last_became_peered":"2024-03-16T07:28:40.886129+0000","last_unstale":"2024-03-16T07:28:55.969802+0000","last_undegraded":"2024-03-16T07:28:55.969802+0000","last_fullsized":"2024-03-16T07:28:55.969802+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_clean_scrub_stamp":"2024-03-16T07:28:39.861342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:42:48.723986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:56.008238+0000","last_change":"2024-03-16T07:28:56.004381+0000","last_active":"2024-03-16T07:28:56.008238+0000","last_peered":"2024-03-16T07:28:56.008238+0000","last_clean":"2024-03-16T07:28:56.008238+0000","last_became_active":"2024-03-16T07:28:56.004130+0000","last_became_peered":"2024-03-16T07:28:56.004130+0000","last_unstale":"2024-03-16T07:28:56.008238+0000","last_undegraded":"2024-03-16T07:28:56.008238+0000","last_fullsized":"2024-03-16T07:28:56.008238+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_clean_scrub_stamp":"2024-03-16T07:28:54.963620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:56:31.024591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":12,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.974031+0000","last_change":"2024-03-16T07:28:54.986400+0000","last_active":"2024-03-16T07:28:55.974031+0000","last_peered":"2024-03-16T07:28:55.974031+0000","last_clean":"2024-03-16T07:28:55.974031+0000","last_became_active":"2024-03-16T07:28:54.986162+0000","last_became_peered":"2024-03-16T07:28:54.986162+0000","last_unstale":"2024-03-16T07:28:55.974031+0000","last_undegraded":"2024-03-16T07:28:55.974031+0000","last_fullsized":"2024-03-16T07:28:55.974031+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:53.959780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:53.959780+0000","last_clean_scrub_stamp":"2024-03-16T07:28:53.959780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:14:23.739094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.986597+0000","last_change":"2024-03-16T07:28:41.587165+0000","last_active":"2024-03-16T07:28:55.986597+0000","last_peered":"2024-03-16T07:28:55.986597+0000","last_clean":"2024-03-16T07:28:55.986597+0000","last_became_active":"2024-03-16T07:28:41.586578+0000","last_became_peered":"2024-03-16T07:28:41.586578+0000","last_unstale":"2024-03-16T07:28:55.986597+0000","last_undegraded":"2024-03-16T07:28:55.986597+0000","last_fullsized":"2024-03-16T07:28:55.986597+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:05:42.909993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"73'3","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.973808+0000","last_change":"2024-03-16T07:28:40.885939+0000","last_active":"2024-03-16T07:28:55.973808+0000","last_peered":"2024-03-16T07:28:55.973808+0000","last_clean":"2024-03-16T07:28:55.973808+0000","last_became_active":"2024-03-16T07:28:40.885668+0000","last_became_peered":"2024-03-16T07:28:40.885668+0000","last_unstale":"2024-03-16T07:28:55.973808+0000","last_undegraded":"2024-03-16T07:28:55.973808+0000","last_fullsized":"2024-03-16T07:28:55.973808+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_clean_scrub_stamp":"2024-03-16T07:28:39.861342+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:33:05.728451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.995047+0000","last_change":"2024-03-16T07:28:55.992143+0000","last_active":"2024-03-16T07:28:55.995047+0000","last_peered":"2024-03-16T07:28:55.995047+0000","last_clean":"2024-03-16T07:28:55.995047+0000","last_became_active":"2024-03-16T07:28:55.991539+0000","last_became_peered":"2024-03-16T07:28:55.991539+0000","last_unstale":"2024-03-16T07:28:55.995047+0000","last_undegraded":"2024-03-16T07:28:55.995047+0000","last_fullsized":"2024-03-16T07:28:55.995047+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_clean_scrub_stamp":"2024-03-16T07:28:54.963620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:51:05.203345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":12,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.972252+0000","last_change":"2024-03-16T07:28:54.986722+0000","last_active":"2024-03-16T07:28:55.972252+0000","last_peered":"2024-03-16T07:28:55.972252+0000","last_clean":"2024-03-16T07:28:55.972252+0000","last_became_active":"2024-03-16T07:28:54.983682+0000","last_became_peered":"2024-03-16T07:28:54.983682+0000","last_unstale":"2024-03-16T07:28:55.972252+0000","last_undegraded":"2024-03-16T07:28:55.972252+0000","last_fullsized":"2024-03-16T07:28:55.972252+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:53.959780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:53.959780+0000","last_clean_scrub_stamp":"2024-03-16T07:28:53.959780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:26:17.906430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.974412+0000","last_change":"2024-03-16T07:28:41.574377+0000","last_active":"2024-03-16T07:28:55.974412+0000","last_peered":"2024-03-16T07:28:55.974412+0000","last_clean":"2024-03-16T07:28:55.974412+0000","last_became_active":"2024-03-16T07:28:41.572757+0000","last_became_peered":"2024-03-16T07:28:41.572757+0000","last_unstale":"2024-03-16T07:28:55.974412+0000","last_undegraded":"2024-03-16T07:28:55.974412+0000","last_fullsized":"2024-03-16T07:28:55.974412+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:35:53.161968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.14","version":"74'8","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.986744+0000","last_change":"2024-03-16T07:28:40.890793+0000","last_active":"2024-03-16T07:28:55.986744+0000","last_peered":"2024-03-16T07:28:55.986744+0000","last_clean":"2024-03-16T07:28:55.986744+0000","last_became_active":"2024-03-16T07:28:40.889033+0000","last_became_peered":"2024-03-16T07:28:40.889033+0000","last_unstale":"2024-03-16T07:28:55.986744+0000","last_undegraded":"2024-03-16T07:28:55.986744+0000","last_fullsized":"2024-03-16T07:28:55.986744+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_clean_scrub_stamp":"2024-03-16T07:28:39.861342+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:25:23.243480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3309,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:56.008085+0000","last_change":"2024-03-16T07:28:56.002562+0000","last_active":"2024-03-16T07:28:56.008085+0000","last_peered":"2024-03-16T07:28:56.008085+0000","last_clean":"2024-03-16T07:28:56.008085+0000","last_became_active":"2024-03-16T07:28:55.996288+0000","last_became_peered":"2024-03-16T07:28:55.996288+0000","last_unstale":"2024-03-16T07:28:56.008085+0000","last_undegraded":"2024-03-16T07:28:56.008085+0000","last_fullsized":"2024-03-16T07:28:56.008085+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_clean_scrub_stamp":"2024-03-16T07:28:54.963620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:39:41.775481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":12,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.974496+0000","last_change":"2024-03-16T07:28:54.983440+0000","last_active":"2024-03-16T07:28:55.974496+0000","last_peered":"2024-03-16T07:28:55.974496+0000","last_clean":"2024-03-16T07:28:55.974496+0000","last_became_active":"2024-03-16T07:28:54.983117+0000","last_became_peered":"2024-03-16T07:28:54.983117+0000","last_unstale":"2024-03-16T07:28:55.974496+0000","last_undegraded":"2024-03-16T07:28:55.974496+0000","last_fullsized":"2024-03-16T07:28:55.974496+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:53.959780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:53.959780+0000","last_clean_scrub_stamp":"2024-03-16T07:28:53.959780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:57:35.296521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.983336+0000","last_change":"2024-03-16T07:28:41.576721+0000","last_active":"2024-03-16T07:28:55.983336+0000","last_peered":"2024-03-16T07:28:55.983336+0000","last_clean":"2024-03-16T07:28:55.983336+0000","last_became_active":"2024-03-16T07:28:41.576367+0000","last_became_peered":"2024-03-16T07:28:41.576367+0000","last_unstale":"2024-03-16T07:28:55.983336+0000","last_undegraded":"2024-03-16T07:28:55.983336+0000","last_fullsized":"2024-03-16T07:28:55.983336+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:31:51.310053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"73'2","reported_seq":22,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.972108+0000","last_change":"2024-03-16T07:28:40.883154+0000","last_active":"2024-03-16T07:28:55.972108+0000","last_peered":"2024-03-16T07:28:55.972108+0000","last_clean":"2024-03-16T07:28:55.972108+0000","last_became_active":"2024-03-16T07:28:40.882887+0000","last_became_peered":"2024-03-16T07:28:40.882887+0000","last_unstale":"2024-03-16T07:28:55.972108+0000","last_undegraded":"2024-03-16T07:28:55.972108+0000","last_fullsized":"2024-03-16T07:28:55.972108+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_clean_scrub_stamp":"2024-03-16T07:28:39.861342+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:40:18.964304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.998859+0000","last_change":"2024-03-16T07:28:55.995479+0000","last_active":"2024-03-16T07:28:55.998859+0000","last_peered":"2024-03-16T07:28:55.998859+0000","last_clean":"2024-03-16T07:28:55.998859+0000","last_became_active":"2024-03-16T07:28:55.995250+0000","last_became_peered":"2024-03-16T07:28:55.995250+0000","last_unstale":"2024-03-16T07:28:55.998859+0000","last_undegraded":"2024-03-16T07:28:55.998859+0000","last_fullsized":"2024-03-16T07:28:55.998859+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_clean_scrub_stamp":"2024-03-16T07:28:54.963620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:09:27.198732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"77'8","reported_seq":20,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:56.010954+0000","last_change":"2024-03-16T07:28:54.984419+0000","last_active":"2024-03-16T07:28:56.010954+0000","last_peered":"2024-03-16T07:28:56.010954+0000","last_clean":"2024-03-16T07:28:56.010954+0000","last_became_active":"2024-03-16T07:28:54.984175+0000","last_became_peered":"2024-03-16T07:28:54.984175+0000","last_unstale":"2024-03-16T07:28:56.010954+0000","last_undegraded":"2024-03-16T07:28:56.010954+0000","last_fullsized":"2024-03-16T07:28:56.010954+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:53.959780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:53.959780+0000","last_clean_scrub_stamp":"2024-03-16T07:28:53.959780+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:43:35.888243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.972064+0000","last_change":"2024-03-16T07:28:41.584733+0000","last_active":"2024-03-16T07:28:55.972064+0000","last_peered":"2024-03-16T07:28:55.972064+0000","last_clean":"2024-03-16T07:28:55.972064+0000","last_became_active":"2024-03-16T07:28:41.584482+0000","last_became_peered":"2024-03-16T07:28:41.584482+0000","last_unstale":"2024-03-16T07:28:55.972064+0000","last_undegraded":"2024-03-16T07:28:55.972064+0000","last_fullsized":"2024-03-16T07:28:55.972064+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:51:02.351017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":20,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.983633+0000","last_change":"2024-03-16T07:28:40.884089+0000","last_active":"2024-03-16T07:28:55.983633+0000","last_peered":"2024-03-16T07:28:55.983633+0000","last_clean":"2024-03-16T07:28:55.983633+0000","last_became_active":"2024-03-16T07:28:40.883831+0000","last_became_peered":"2024-03-16T07:28:40.883831+0000","last_unstale":"2024-03-16T07:28:55.983633+0000","last_undegraded":"2024-03-16T07:28:55.983633+0000","last_fullsized":"2024-03-16T07:28:55.983633+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_clean_scrub_stamp":"2024-03-16T07:28:39.861342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:44:36.452241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.994293+0000","last_change":"2024-03-16T07:28:55.990684+0000","last_active":"2024-03-16T07:28:55.994293+0000","last_peered":"2024-03-16T07:28:55.994293+0000","last_clean":"2024-03-16T07:28:55.994293+0000","last_became_active":"2024-03-16T07:28:55.990443+0000","last_became_peered":"2024-03-16T07:28:55.990443+0000","last_unstale":"2024-03-16T07:28:55.994293+0000","last_undegraded":"2024-03-16T07:28:55.994293+0000","last_fullsized":"2024-03-16T07:28:55.994293+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_clean_scrub_stamp":"2024-03-16T07:28:54.963620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:30:46.990190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.13","version":"77'2","reported_seq":14,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.990626+0000","last_change":"2024-03-16T07:28:54.991538+0000","last_active":"2024-03-16T07:28:55.990626+0000","last_peered":"2024-03-16T07:28:55.990626+0000","last_clean":"2024-03-16T07:28:55.990626+0000","last_became_active":"2024-03-16T07:28:54.991297+0000","last_became_peered":"2024-03-16T07:28:54.991297+0000","last_unstale":"2024-03-16T07:28:55.990626+0000","last_undegraded":"2024-03-16T07:28:55.990626+0000","last_fullsized":"2024-03-16T07:28:55.990626+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:53.959780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:53.959780+0000","last_clean_scrub_stamp":"2024-03-16T07:28:53.959780+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:01:05.134156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.972132+0000","last_change":"2024-03-16T07:28:41.584450+0000","last_active":"2024-03-16T07:28:55.972132+0000","last_peered":"2024-03-16T07:28:55.972132+0000","last_clean":"2024-03-16T07:28:55.972132+0000","last_became_active":"2024-03-16T07:28:41.583048+0000","last_became_peered":"2024-03-16T07:28:41.583048+0000","last_unstale":"2024-03-16T07:28:55.972132+0000","last_undegraded":"2024-03-16T07:28:55.972132+0000","last_fullsized":"2024-03-16T07:28:55.972132+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:59:28.713162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":20,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.968489+0000","last_change":"2024-03-16T07:28:40.880394+0000","last_active":"2024-03-16T07:28:55.968489+0000","last_peered":"2024-03-16T07:28:55.968489+0000","last_clean":"2024-03-16T07:28:55.968489+0000","last_became_active":"2024-03-16T07:28:40.880131+0000","last_became_peered":"2024-03-16T07:28:40.880131+0000","last_unstale":"2024-03-16T07:28:55.968489+0000","last_undegraded":"2024-03-16T07:28:55.968489+0000","last_fullsized":"2024-03-16T07:28:55.968489+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_clean_scrub_stamp":"2024-03-16T07:28:39.861342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:14:40.328662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.999935+0000","last_change":"2024-03-16T07:28:55.994956+0000","last_active":"2024-03-16T07:28:55.999935+0000","last_peered":"2024-03-16T07:28:55.999935+0000","last_clean":"2024-03-16T07:28:55.999935+0000","last_became_active":"2024-03-16T07:28:55.993167+0000","last_became_peered":"2024-03-16T07:28:55.993167+0000","last_unstale":"2024-03-16T07:28:55.999935+0000","last_undegraded":"2024-03-16T07:28:55.999935+0000","last_fullsized":"2024-03-16T07:28:55.999935+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_clean_scrub_stamp":"2024-03-16T07:28:54.963620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:32:05.411362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":12,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.970461+0000","last_change":"2024-03-16T07:28:54.992335+0000","last_active":"2024-03-16T07:28:55.970461+0000","last_peered":"2024-03-16T07:28:55.970461+0000","last_clean":"2024-03-16T07:28:55.970461+0000","last_became_active":"2024-03-16T07:28:54.992104+0000","last_became_peered":"2024-03-16T07:28:54.992104+0000","last_unstale":"2024-03-16T07:28:55.970461+0000","last_undegraded":"2024-03-16T07:28:55.970461+0000","last_fullsized":"2024-03-16T07:28:55.970461+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:53.959780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:53.959780+0000","last_clean_scrub_stamp":"2024-03-16T07:28:53.959780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:28:10.522791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.974645+0000","last_change":"2024-03-16T07:28:41.584622+0000","last_active":"2024-03-16T07:28:55.974645+0000","last_peered":"2024-03-16T07:28:55.974645+0000","last_clean":"2024-03-16T07:28:55.974645+0000","last_became_active":"2024-03-16T07:28:41.583267+0000","last_became_peered":"2024-03-16T07:28:41.583267+0000","last_unstale":"2024-03-16T07:28:55.974645+0000","last_undegraded":"2024-03-16T07:28:55.974645+0000","last_fullsized":"2024-03-16T07:28:55.974645+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:09:05.453250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"73'8","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.984229+0000","last_change":"2024-03-16T07:28:40.891056+0000","last_active":"2024-03-16T07:28:55.984229+0000","last_peered":"2024-03-16T07:28:55.984229+0000","last_clean":"2024-03-16T07:28:55.984229+0000","last_became_active":"2024-03-16T07:28:40.890632+0000","last_became_peered":"2024-03-16T07:28:40.890632+0000","last_unstale":"2024-03-16T07:28:55.984229+0000","last_undegraded":"2024-03-16T07:28:55.984229+0000","last_fullsized":"2024-03-16T07:28:55.984229+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_clean_scrub_stamp":"2024-03-16T07:28:39.861342+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:24:57.129852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:56.000111+0000","last_change":"2024-03-16T07:28:55.996301+0000","last_active":"2024-03-16T07:28:56.000111+0000","last_peered":"2024-03-16T07:28:56.000111+0000","last_clean":"2024-03-16T07:28:56.000111+0000","last_became_active":"2024-03-16T07:28:55.995466+0000","last_became_peered":"2024-03-16T07:28:55.995466+0000","last_unstale":"2024-03-16T07:28:56.000111+0000","last_undegraded":"2024-03-16T07:28:56.000111+0000","last_fullsized":"2024-03-16T07:28:56.000111+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_clean_scrub_stamp":"2024-03-16T07:28:54.963620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:05:57.011302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.d","version":"77'1","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:56.005989+0000","last_change":"2024-03-16T07:28:54.993260+0000","last_active":"2024-03-16T07:28:56.005989+0000","last_peered":"2024-03-16T07:28:56.005989+0000","last_clean":"2024-03-16T07:28:56.005989+0000","last_became_active":"2024-03-16T07:28:54.992508+0000","last_became_peered":"2024-03-16T07:28:54.992508+0000","last_unstale":"2024-03-16T07:28:56.005989+0000","last_undegraded":"2024-03-16T07:28:56.005989+0000","last_fullsized":"2024-03-16T07:28:56.005989+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:53.959780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:53.959780+0000","last_clean_scrub_stamp":"2024-03-16T07:28:53.959780+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:30:54.241488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.989746+0000","last_change":"2024-03-16T07:28:41.577118+0000","last_active":"2024-03-16T07:28:55.989746+0000","last_peered":"2024-03-16T07:28:55.989746+0000","last_clean":"2024-03-16T07:28:55.989746+0000","last_became_active":"2024-03-16T07:28:41.576870+0000","last_became_peered":"2024-03-16T07:28:41.576870+0000","last_unstale":"2024-03-16T07:28:55.989746+0000","last_undegraded":"2024-03-16T07:28:55.989746+0000","last_fullsized":"2024-03-16T07:28:55.989746+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:07:51.321412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.f","version":"73'1","reported_seq":21,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.990944+0000","last_change":"2024-03-16T07:28:40.884362+0000","last_active":"2024-03-16T07:28:55.990944+0000","last_peered":"2024-03-16T07:28:55.990944+0000","last_clean":"2024-03-16T07:28:55.990944+0000","last_became_active":"2024-03-16T07:28:40.883691+0000","last_became_peered":"2024-03-16T07:28:40.883691+0000","last_unstale":"2024-03-16T07:28:55.990944+0000","last_undegraded":"2024-03-16T07:28:55.990944+0000","last_fullsized":"2024-03-16T07:28:55.990944+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_clean_scrub_stamp":"2024-03-16T07:28:39.861342+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:45:07.242723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:56.000181+0000","last_change":"2024-03-16T07:28:55.997566+0000","last_active":"2024-03-16T07:28:56.000181+0000","last_peered":"2024-03-16T07:28:56.000181+0000","last_clean":"2024-03-16T07:28:56.000181+0000","last_became_active":"2024-03-16T07:28:55.996973+0000","last_became_peered":"2024-03-16T07:28:55.996973+0000","last_unstale":"2024-03-16T07:28:56.000181+0000","last_undegraded":"2024-03-16T07:28:56.000181+0000","last_fullsized":"2024-03-16T07:28:56.000181+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_clean_scrub_stamp":"2024-03-16T07:28:54.963620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:38:21.923182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":12,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.986247+0000","last_change":"2024-03-16T07:28:54.992978+0000","last_active":"2024-03-16T07:28:55.986247+0000","last_peered":"2024-03-16T07:28:55.986247+0000","last_clean":"2024-03-16T07:28:55.986247+0000","last_became_active":"2024-03-16T07:28:54.992712+0000","last_became_peered":"2024-03-16T07:28:54.992712+0000","last_unstale":"2024-03-16T07:28:55.986247+0000","last_undegraded":"2024-03-16T07:28:55.986247+0000","last_fullsized":"2024-03-16T07:28:55.986247+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:53.959780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:53.959780+0000","last_clean_scrub_stamp":"2024-03-16T07:28:53.959780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:52:05.120058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.969533+0000","last_change":"2024-03-16T07:28:41.571334+0000","last_active":"2024-03-16T07:28:55.969533+0000","last_peered":"2024-03-16T07:28:55.969533+0000","last_clean":"2024-03-16T07:28:55.969533+0000","last_became_active":"2024-03-16T07:28:41.571041+0000","last_became_peered":"2024-03-16T07:28:41.571041+0000","last_unstale":"2024-03-16T07:28:55.969533+0000","last_undegraded":"2024-03-16T07:28:55.969533+0000","last_fullsized":"2024-03-16T07:28:55.969533+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:03:02.755723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.e","version":"73'2","reported_seq":22,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.990046+0000","last_change":"2024-03-16T07:28:40.889189+0000","last_active":"2024-03-16T07:28:55.990046+0000","last_peered":"2024-03-16T07:28:55.990046+0000","last_clean":"2024-03-16T07:28:55.990046+0000","last_became_active":"2024-03-16T07:28:40.886103+0000","last_became_peered":"2024-03-16T07:28:40.886103+0000","last_unstale":"2024-03-16T07:28:55.990046+0000","last_undegraded":"2024-03-16T07:28:55.990046+0000","last_fullsized":"2024-03-16T07:28:55.990046+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_clean_scrub_stamp":"2024-03-16T07:28:39.861342+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:03:01.754754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.987237+0000","last_change":"2024-03-16T07:28:55.986083+0000","last_active":"2024-03-16T07:28:55.987237+0000","last_peered":"2024-03-16T07:28:55.987237+0000","last_clean":"2024-03-16T07:28:55.987237+0000","last_became_active":"2024-03-16T07:28:55.985846+0000","last_became_peered":"2024-03-16T07:28:55.985846+0000","last_unstale":"2024-03-16T07:28:55.987237+0000","last_undegraded":"2024-03-16T07:28:55.987237+0000","last_fullsized":"2024-03-16T07:28:55.987237+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_clean_scrub_stamp":"2024-03-16T07:28:54.963620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:14:03.009414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.e","version":"77'2","reported_seq":14,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:56.001446+0000","last_change":"2024-03-16T07:28:54.989085+0000","last_active":"2024-03-16T07:28:56.001446+0000","last_peered":"2024-03-16T07:28:56.001446+0000","last_clean":"2024-03-16T07:28:56.001446+0000","last_became_active":"2024-03-16T07:28:54.988834+0000","last_became_peered":"2024-03-16T07:28:54.988834+0000","last_unstale":"2024-03-16T07:28:56.001446+0000","last_undegraded":"2024-03-16T07:28:56.001446+0000","last_fullsized":"2024-03-16T07:28:56.001446+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:53.959780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:53.959780+0000","last_clean_scrub_stamp":"2024-03-16T07:28:53.959780+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:49:56.583251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.988239+0000","last_change":"2024-03-16T07:28:41.576599+0000","last_active":"2024-03-16T07:28:55.988239+0000","last_peered":"2024-03-16T07:28:55.988239+0000","last_clean":"2024-03-16T07:28:55.988239+0000","last_became_active":"2024-03-16T07:28:41.576352+0000","last_became_peered":"2024-03-16T07:28:41.576352+0000","last_unstale":"2024-03-16T07:28:55.988239+0000","last_undegraded":"2024-03-16T07:28:55.988239+0000","last_fullsized":"2024-03-16T07:28:55.988239+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:38:07.821873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":20,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.986812+0000","last_change":"2024-03-16T07:28:40.891054+0000","last_active":"2024-03-16T07:28:55.986812+0000","last_peered":"2024-03-16T07:28:55.986812+0000","last_clean":"2024-03-16T07:28:55.986812+0000","last_became_active":"2024-03-16T07:28:40.890675+0000","last_became_peered":"2024-03-16T07:28:40.890675+0000","last_unstale":"2024-03-16T07:28:55.986812+0000","last_undegraded":"2024-03-16T07:28:55.986812+0000","last_fullsized":"2024-03-16T07:28:55.986812+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_clean_scrub_stamp":"2024-03-16T07:28:39.861342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:42:34.511753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.995076+0000","last_change":"2024-03-16T07:28:55.992105+0000","last_active":"2024-03-16T07:28:55.995076+0000","last_peered":"2024-03-16T07:28:55.995076+0000","last_clean":"2024-03-16T07:28:55.995076+0000","last_became_active":"2024-03-16T07:28:55.991814+0000","last_became_peered":"2024-03-16T07:28:55.991814+0000","last_unstale":"2024-03-16T07:28:55.995076+0000","last_undegraded":"2024-03-16T07:28:55.995076+0000","last_fullsized":"2024-03-16T07:28:55.995076+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_clean_scrub_stamp":"2024-03-16T07:28:54.963620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:48:32.792723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":12,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.983429+0000","last_change":"2024-03-16T07:28:54.990600+0000","last_active":"2024-03-16T07:28:55.983429+0000","last_peered":"2024-03-16T07:28:55.983429+0000","last_clean":"2024-03-16T07:28:55.983429+0000","last_became_active":"2024-03-16T07:28:54.990382+0000","last_became_peered":"2024-03-16T07:28:54.990382+0000","last_unstale":"2024-03-16T07:28:55.983429+0000","last_undegraded":"2024-03-16T07:28:55.983429+0000","last_fullsized":"2024-03-16T07:28:55.983429+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:53.959780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:53.959780+0000","last_clean_scrub_stamp":"2024-03-16T07:28:53.959780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:27:32.357701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.975201+0000","last_change":"2024-03-16T07:28:41.571632+0000","last_active":"2024-03-16T07:28:55.975201+0000","last_peered":"2024-03-16T07:28:55.975201+0000","last_clean":"2024-03-16T07:28:55.975201+0000","last_became_active":"2024-03-16T07:28:41.571014+0000","last_became_peered":"2024-03-16T07:28:41.571014+0000","last_unstale":"2024-03-16T07:28:55.975201+0000","last_undegraded":"2024-03-16T07:28:55.975201+0000","last_fullsized":"2024-03-16T07:28:55.975201+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:43:41.145523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"73'2","reported_seq":22,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.986445+0000","last_change":"2024-03-16T07:28:40.890368+0000","last_active":"2024-03-16T07:28:55.986445+0000","last_peered":"2024-03-16T07:28:55.986445+0000","last_clean":"2024-03-16T07:28:55.986445+0000","last_became_active":"2024-03-16T07:28:40.889977+0000","last_became_peered":"2024-03-16T07:28:40.889977+0000","last_unstale":"2024-03-16T07:28:55.986445+0000","last_undegraded":"2024-03-16T07:28:55.986445+0000","last_fullsized":"2024-03-16T07:28:55.986445+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_clean_scrub_stamp":"2024-03-16T07:28:39.861342+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:13:21.940217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.987311+0000","last_change":"2024-03-16T07:28:55.986229+0000","last_active":"2024-03-16T07:28:55.987311+0000","last_peered":"2024-03-16T07:28:55.987311+0000","last_clean":"2024-03-16T07:28:55.987311+0000","last_became_active":"2024-03-16T07:28:55.985835+0000","last_became_peered":"2024-03-16T07:28:55.985835+0000","last_unstale":"2024-03-16T07:28:55.987311+0000","last_undegraded":"2024-03-16T07:28:55.987311+0000","last_fullsized":"2024-03-16T07:28:55.987311+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_clean_scrub_stamp":"2024-03-16T07:28:54.963620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:12:36.583573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":12,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.983929+0000","last_change":"2024-03-16T07:28:54.988103+0000","last_active":"2024-03-16T07:28:55.983929+0000","last_peered":"2024-03-16T07:28:55.983929+0000","last_clean":"2024-03-16T07:28:55.983929+0000","last_became_active":"2024-03-16T07:28:54.986247+0000","last_became_peered":"2024-03-16T07:28:54.986247+0000","last_unstale":"2024-03-16T07:28:55.983929+0000","last_undegraded":"2024-03-16T07:28:55.983929+0000","last_fullsized":"2024-03-16T07:28:55.983929+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:53.959780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:53.959780+0000","last_clean_scrub_stamp":"2024-03-16T07:28:53.959780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:44:11.391083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.976792+0000","last_change":"2024-03-16T07:28:41.573020+0000","last_active":"2024-03-16T07:28:55.976792+0000","last_peered":"2024-03-16T07:28:55.976792+0000","last_clean":"2024-03-16T07:28:55.976792+0000","last_became_active":"2024-03-16T07:28:41.572167+0000","last_became_peered":"2024-03-16T07:28:41.572167+0000","last_unstale":"2024-03-16T07:28:55.976792+0000","last_undegraded":"2024-03-16T07:28:55.976792+0000","last_fullsized":"2024-03-16T07:28:55.976792+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:05:56.029483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":20,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.980637+0000","last_change":"2024-03-16T07:28:40.878850+0000","last_active":"2024-03-16T07:28:55.980637+0000","last_peered":"2024-03-16T07:28:55.980637+0000","last_clean":"2024-03-16T07:28:55.980637+0000","last_became_active":"2024-03-16T07:28:40.878359+0000","last_became_peered":"2024-03-16T07:28:40.878359+0000","last_unstale":"2024-03-16T07:28:55.980637+0000","last_undegraded":"2024-03-16T07:28:55.980637+0000","last_fullsized":"2024-03-16T07:28:55.980637+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_clean_scrub_stamp":"2024-03-16T07:28:39.861342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:43:24.007718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.994881+0000","last_change":"2024-03-16T07:28:55.992636+0000","last_active":"2024-03-16T07:28:55.994881+0000","last_peered":"2024-03-16T07:28:55.994881+0000","last_clean":"2024-03-16T07:28:55.994881+0000","last_became_active":"2024-03-16T07:28:55.992012+0000","last_became_peered":"2024-03-16T07:28:55.992012+0000","last_unstale":"2024-03-16T07:28:55.994881+0000","last_undegraded":"2024-03-16T07:28:55.994881+0000","last_fullsized":"2024-03-16T07:28:55.994881+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_clean_scrub_stamp":"2024-03-16T07:28:54.963620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:12:43.816594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"77'2","reported_seq":14,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:56.006742+0000","last_change":"2024-03-16T07:28:54.991273+0000","last_active":"2024-03-16T07:28:56.006742+0000","last_peered":"2024-03-16T07:28:56.006742+0000","last_clean":"2024-03-16T07:28:56.006742+0000","last_became_active":"2024-03-16T07:28:54.991020+0000","last_became_peered":"2024-03-16T07:28:54.991020+0000","last_unstale":"2024-03-16T07:28:56.006742+0000","last_undegraded":"2024-03-16T07:28:56.006742+0000","last_fullsized":"2024-03-16T07:28:56.006742+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:53.959780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:53.959780+0000","last_clean_scrub_stamp":"2024-03-16T07:28:53.959780+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:44:10.767627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.969194+0000","last_change":"2024-03-16T07:28:41.580177+0000","last_active":"2024-03-16T07:28:55.969194+0000","last_peered":"2024-03-16T07:28:55.969194+0000","last_clean":"2024-03-16T07:28:55.969194+0000","last_became_active":"2024-03-16T07:28:41.579841+0000","last_became_peered":"2024-03-16T07:28:41.579841+0000","last_unstale":"2024-03-16T07:28:55.969194+0000","last_undegraded":"2024-03-16T07:28:55.969194+0000","last_fullsized":"2024-03-16T07:28:55.969194+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:42:27.646009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":20,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.968576+0000","last_change":"2024-03-16T07:28:40.881199+0000","last_active":"2024-03-16T07:28:55.968576+0000","last_peered":"2024-03-16T07:28:55.968576+0000","last_clean":"2024-03-16T07:28:55.968576+0000","last_became_active":"2024-03-16T07:28:40.880911+0000","last_became_peered":"2024-03-16T07:28:40.880911+0000","last_unstale":"2024-03-16T07:28:55.968576+0000","last_undegraded":"2024-03-16T07:28:55.968576+0000","last_fullsized":"2024-03-16T07:28:55.968576+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_clean_scrub_stamp":"2024-03-16T07:28:39.861342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:21:43.748833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.999268+0000","last_change":"2024-03-16T07:28:55.996530+0000","last_active":"2024-03-16T07:28:55.999268+0000","last_peered":"2024-03-16T07:28:55.999268+0000","last_clean":"2024-03-16T07:28:55.999268+0000","last_became_active":"2024-03-16T07:28:55.995712+0000","last_became_peered":"2024-03-16T07:28:55.995712+0000","last_unstale":"2024-03-16T07:28:55.999268+0000","last_undegraded":"2024-03-16T07:28:55.999268+0000","last_fullsized":"2024-03-16T07:28:55.999268+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_clean_scrub_stamp":"2024-03-16T07:28:54.963620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:08:05.422721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":12,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.974302+0000","last_change":"2024-03-16T07:28:54.994360+0000","last_active":"2024-03-16T07:28:55.974302+0000","last_peered":"2024-03-16T07:28:55.974302+0000","last_clean":"2024-03-16T07:28:55.974302+0000","last_became_active":"2024-03-16T07:28:54.993903+0000","last_became_peered":"2024-03-16T07:28:54.993903+0000","last_unstale":"2024-03-16T07:28:55.974302+0000","last_undegraded":"2024-03-16T07:28:55.974302+0000","last_fullsized":"2024-03-16T07:28:55.974302+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:53.959780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:53.959780+0000","last_clean_scrub_stamp":"2024-03-16T07:28:53.959780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:57:35.296521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.983564+0000","last_change":"2024-03-16T07:28:41.580467+0000","last_active":"2024-03-16T07:28:55.983564+0000","last_peered":"2024-03-16T07:28:55.983564+0000","last_clean":"2024-03-16T07:28:55.983564+0000","last_became_active":"2024-03-16T07:28:41.579919+0000","last_became_peered":"2024-03-16T07:28:41.579919+0000","last_unstale":"2024-03-16T07:28:55.983564+0000","last_undegraded":"2024-03-16T07:28:55.983564+0000","last_fullsized":"2024-03-16T07:28:55.983564+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:48:18.691414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":20,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.969300+0000","last_change":"2024-03-16T07:28:40.878754+0000","last_active":"2024-03-16T07:28:55.969300+0000","last_peered":"2024-03-16T07:28:55.969300+0000","last_clean":"2024-03-16T07:28:55.969300+0000","last_became_active":"2024-03-16T07:28:40.878452+0000","last_became_peered":"2024-03-16T07:28:40.878452+0000","last_unstale":"2024-03-16T07:28:55.969300+0000","last_undegraded":"2024-03-16T07:28:55.969300+0000","last_fullsized":"2024-03-16T07:28:55.969300+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_clean_scrub_stamp":"2024-03-16T07:28:39.861342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:41:14.355084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:56.001793+0000","last_change":"2024-03-16T07:28:55.995252+0000","last_active":"2024-03-16T07:28:56.001793+0000","last_peered":"2024-03-16T07:28:56.001793+0000","last_clean":"2024-03-16T07:28:56.001793+0000","last_became_active":"2024-03-16T07:28:55.992674+0000","last_became_peered":"2024-03-16T07:28:55.992674+0000","last_unstale":"2024-03-16T07:28:56.001793+0000","last_undegraded":"2024-03-16T07:28:56.001793+0000","last_fullsized":"2024-03-16T07:28:56.001793+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_clean_scrub_stamp":"2024-03-16T07:28:54.963620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:13:15.253368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":12,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.988011+0000","last_change":"2024-03-16T07:28:54.993064+0000","last_active":"2024-03-16T07:28:55.988011+0000","last_peered":"2024-03-16T07:28:55.988011+0000","last_clean":"2024-03-16T07:28:55.988011+0000","last_became_active":"2024-03-16T07:28:54.992194+0000","last_became_peered":"2024-03-16T07:28:54.992194+0000","last_unstale":"2024-03-16T07:28:55.988011+0000","last_undegraded":"2024-03-16T07:28:55.988011+0000","last_fullsized":"2024-03-16T07:28:55.988011+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:53.959780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:53.959780+0000","last_clean_scrub_stamp":"2024-03-16T07:28:53.959780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:51:53.445787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.989898+0000","last_change":"2024-03-16T07:28:41.577897+0000","last_active":"2024-03-16T07:28:55.989898+0000","last_peered":"2024-03-16T07:28:55.989898+0000","last_clean":"2024-03-16T07:28:55.989898+0000","last_became_active":"2024-03-16T07:28:41.577214+0000","last_became_peered":"2024-03-16T07:28:41.577214+0000","last_unstale":"2024-03-16T07:28:55.989898+0000","last_undegraded":"2024-03-16T07:28:55.989898+0000","last_fullsized":"2024-03-16T07:28:55.989898+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:03:06.856643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.7","version":"73'2","reported_seq":22,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.977855+0000","last_change":"2024-03-16T07:28:40.887728+0000","last_active":"2024-03-16T07:28:55.977855+0000","last_peered":"2024-03-16T07:28:55.977855+0000","last_clean":"2024-03-16T07:28:55.977855+0000","last_became_active":"2024-03-16T07:28:40.887133+0000","last_became_peered":"2024-03-16T07:28:40.887133+0000","last_unstale":"2024-03-16T07:28:55.977855+0000","last_undegraded":"2024-03-16T07:28:55.977855+0000","last_fullsized":"2024-03-16T07:28:55.977855+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_clean_scrub_stamp":"2024-03-16T07:28:39.861342+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:26:59.911899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:56.000929+0000","last_change":"2024-03-16T07:28:55.999695+0000","last_active":"2024-03-16T07:28:56.000929+0000","last_peered":"2024-03-16T07:28:56.000929+0000","last_clean":"2024-03-16T07:28:56.000929+0000","last_became_active":"2024-03-16T07:28:55.998853+0000","last_became_peered":"2024-03-16T07:28:55.998853+0000","last_unstale":"2024-03-16T07:28:56.000929+0000","last_undegraded":"2024-03-16T07:28:56.000929+0000","last_fullsized":"2024-03-16T07:28:56.000929+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_clean_scrub_stamp":"2024-03-16T07:28:54.963620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:22:47.351164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":12,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.969824+0000","last_change":"2024-03-16T07:28:54.993548+0000","last_active":"2024-03-16T07:28:55.969824+0000","last_peered":"2024-03-16T07:28:55.969824+0000","last_clean":"2024-03-16T07:28:55.969824+0000","last_became_active":"2024-03-16T07:28:54.991467+0000","last_became_peered":"2024-03-16T07:28:54.991467+0000","last_unstale":"2024-03-16T07:28:55.969824+0000","last_undegraded":"2024-03-16T07:28:55.969824+0000","last_fullsized":"2024-03-16T07:28:55.969824+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:53.959780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:53.959780+0000","last_clean_scrub_stamp":"2024-03-16T07:28:53.959780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:20:24.236384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.977682+0000","last_change":"2024-03-16T07:28:41.585466+0000","last_active":"2024-03-16T07:28:55.977682+0000","last_peered":"2024-03-16T07:28:55.977682+0000","last_clean":"2024-03-16T07:28:55.977682+0000","last_became_active":"2024-03-16T07:28:41.585226+0000","last_became_peered":"2024-03-16T07:28:41.585226+0000","last_unstale":"2024-03-16T07:28:55.977682+0000","last_undegraded":"2024-03-16T07:28:55.977682+0000","last_fullsized":"2024-03-16T07:28:55.977682+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:19:56.148452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.6","version":"74'1","reported_seq":21,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.972940+0000","last_change":"2024-03-16T07:28:40.882367+0000","last_active":"2024-03-16T07:28:55.972940+0000","last_peered":"2024-03-16T07:28:55.972940+0000","last_clean":"2024-03-16T07:28:55.972940+0000","last_became_active":"2024-03-16T07:28:40.882075+0000","last_became_peered":"2024-03-16T07:28:40.882075+0000","last_unstale":"2024-03-16T07:28:55.972940+0000","last_undegraded":"2024-03-16T07:28:55.972940+0000","last_fullsized":"2024-03-16T07:28:55.972940+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_clean_scrub_stamp":"2024-03-16T07:28:39.861342+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:40:12.565428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:56.004001+0000","last_change":"2024-03-16T07:28:55.999044+0000","last_active":"2024-03-16T07:28:56.004001+0000","last_peered":"2024-03-16T07:28:56.004001+0000","last_clean":"2024-03-16T07:28:56.004001+0000","last_became_active":"2024-03-16T07:28:55.998706+0000","last_became_peered":"2024-03-16T07:28:55.998706+0000","last_unstale":"2024-03-16T07:28:56.004001+0000","last_undegraded":"2024-03-16T07:28:56.004001+0000","last_fullsized":"2024-03-16T07:28:56.004001+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_clean_scrub_stamp":"2024-03-16T07:28:54.963620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:42:58.192917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"77'2","reported_seq":14,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:56.003452+0000","last_change":"2024-03-16T07:28:54.984144+0000","last_active":"2024-03-16T07:28:56.003452+0000","last_peered":"2024-03-16T07:28:56.003452+0000","last_clean":"2024-03-16T07:28:56.003452+0000","last_became_active":"2024-03-16T07:28:54.983891+0000","last_became_peered":"2024-03-16T07:28:54.983891+0000","last_unstale":"2024-03-16T07:28:56.003452+0000","last_undegraded":"2024-03-16T07:28:56.003452+0000","last_fullsized":"2024-03-16T07:28:56.003452+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:53.959780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:53.959780+0000","last_clean_scrub_stamp":"2024-03-16T07:28:53.959780+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:28:10.522791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.986643+0000","last_change":"2024-03-16T07:28:41.579252+0000","last_active":"2024-03-16T07:28:55.986643+0000","last_peered":"2024-03-16T07:28:55.986643+0000","last_clean":"2024-03-16T07:28:55.986643+0000","last_became_active":"2024-03-16T07:28:41.579005+0000","last_became_peered":"2024-03-16T07:28:41.579005+0000","last_unstale":"2024-03-16T07:28:55.986643+0000","last_undegraded":"2024-03-16T07:28:55.986643+0000","last_fullsized":"2024-03-16T07:28:55.986643+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:28:32.607193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":20,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.988293+0000","last_change":"2024-03-16T07:28:40.889130+0000","last_active":"2024-03-16T07:28:55.988293+0000","last_peered":"2024-03-16T07:28:55.988293+0000","last_clean":"2024-03-16T07:28:55.988293+0000","last_became_active":"2024-03-16T07:28:40.888858+0000","last_became_peered":"2024-03-16T07:28:40.888858+0000","last_unstale":"2024-03-16T07:28:55.988293+0000","last_undegraded":"2024-03-16T07:28:55.988293+0000","last_fullsized":"2024-03-16T07:28:55.988293+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_clean_scrub_stamp":"2024-03-16T07:28:39.861342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:53:46.531176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.995408+0000","last_change":"2024-03-16T07:28:55.992074+0000","last_active":"2024-03-16T07:28:55.995408+0000","last_peered":"2024-03-16T07:28:55.995408+0000","last_clean":"2024-03-16T07:28:55.995408+0000","last_became_active":"2024-03-16T07:28:55.991854+0000","last_became_peered":"2024-03-16T07:28:55.991854+0000","last_unstale":"2024-03-16T07:28:55.995408+0000","last_undegraded":"2024-03-16T07:28:55.995408+0000","last_fullsized":"2024-03-16T07:28:55.995408+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_clean_scrub_stamp":"2024-03-16T07:28:54.963620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:49:53.338420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":12,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.989341+0000","last_change":"2024-03-16T07:28:54.990493+0000","last_active":"2024-03-16T07:28:55.989341+0000","last_peered":"2024-03-16T07:28:55.989341+0000","last_clean":"2024-03-16T07:28:55.989341+0000","last_became_active":"2024-03-16T07:28:54.990263+0000","last_became_peered":"2024-03-16T07:28:54.990263+0000","last_unstale":"2024-03-16T07:28:55.989341+0000","last_undegraded":"2024-03-16T07:28:55.989341+0000","last_fullsized":"2024-03-16T07:28:55.989341+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:53.959780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:53.959780+0000","last_clean_scrub_stamp":"2024-03-16T07:28:53.959780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:18:46.830366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.974502+0000","last_change":"2024-03-16T07:28:41.573311+0000","last_active":"2024-03-16T07:28:55.974502+0000","last_peered":"2024-03-16T07:28:55.974502+0000","last_clean":"2024-03-16T07:28:55.974502+0000","last_became_active":"2024-03-16T07:28:41.572424+0000","last_became_peered":"2024-03-16T07:28:41.572424+0000","last_unstale":"2024-03-16T07:28:55.974502+0000","last_undegraded":"2024-03-16T07:28:55.974502+0000","last_fullsized":"2024-03-16T07:28:55.974502+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:24:58.130821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":20,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.970159+0000","last_change":"2024-03-16T07:28:40.880251+0000","last_active":"2024-03-16T07:28:55.970159+0000","last_peered":"2024-03-16T07:28:55.970159+0000","last_clean":"2024-03-16T07:28:55.970159+0000","last_became_active":"2024-03-16T07:28:40.879971+0000","last_became_peered":"2024-03-16T07:28:40.879971+0000","last_unstale":"2024-03-16T07:28:55.970159+0000","last_undegraded":"2024-03-16T07:28:55.970159+0000","last_fullsized":"2024-03-16T07:28:55.970159+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_clean_scrub_stamp":"2024-03-16T07:28:39.861342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:13:24.928381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.991991+0000","last_change":"2024-03-16T07:28:55.990665+0000","last_active":"2024-03-16T07:28:55.991991+0000","last_peered":"2024-03-16T07:28:55.991991+0000","last_clean":"2024-03-16T07:28:55.991991+0000","last_became_active":"2024-03-16T07:28:55.989940+0000","last_became_peered":"2024-03-16T07:28:55.989940+0000","last_unstale":"2024-03-16T07:28:55.991991+0000","last_undegraded":"2024-03-16T07:28:55.991991+0000","last_fullsized":"2024-03-16T07:28:55.991991+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_clean_scrub_stamp":"2024-03-16T07:28:54.963620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:32:05.411362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":12,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.974304+0000","last_change":"2024-03-16T07:28:54.983396+0000","last_active":"2024-03-16T07:28:55.974304+0000","last_peered":"2024-03-16T07:28:55.974304+0000","last_clean":"2024-03-16T07:28:55.974304+0000","last_became_active":"2024-03-16T07:28:54.982955+0000","last_became_peered":"2024-03-16T07:28:54.982955+0000","last_unstale":"2024-03-16T07:28:55.974304+0000","last_undegraded":"2024-03-16T07:28:55.974304+0000","last_fullsized":"2024-03-16T07:28:55.974304+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:53.959780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:53.959780+0000","last_clean_scrub_stamp":"2024-03-16T07:28:53.959780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:01:05.134156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.976715+0000","last_change":"2024-03-16T07:28:41.583018+0000","last_active":"2024-03-16T07:28:55.976715+0000","last_peered":"2024-03-16T07:28:55.976715+0000","last_clean":"2024-03-16T07:28:55.976715+0000","last_became_active":"2024-03-16T07:28:41.581147+0000","last_became_peered":"2024-03-16T07:28:41.581147+0000","last_unstale":"2024-03-16T07:28:55.976715+0000","last_undegraded":"2024-03-16T07:28:55.976715+0000","last_fullsized":"2024-03-16T07:28:55.976715+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:44:44.566786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":20,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.986557+0000","last_change":"2024-03-16T07:28:40.889809+0000","last_active":"2024-03-16T07:28:55.986557+0000","last_peered":"2024-03-16T07:28:55.986557+0000","last_clean":"2024-03-16T07:28:55.986557+0000","last_became_active":"2024-03-16T07:28:40.889330+0000","last_became_peered":"2024-03-16T07:28:40.889330+0000","last_unstale":"2024-03-16T07:28:55.986557+0000","last_undegraded":"2024-03-16T07:28:55.986557+0000","last_fullsized":"2024-03-16T07:28:55.986557+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_clean_scrub_stamp":"2024-03-16T07:28:39.861342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:35:52.160999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:56.005818+0000","last_change":"2024-03-16T07:28:56.000327+0000","last_active":"2024-03-16T07:28:56.005818+0000","last_peered":"2024-03-16T07:28:56.005818+0000","last_clean":"2024-03-16T07:28:56.005818+0000","last_became_active":"2024-03-16T07:28:55.992668+0000","last_became_peered":"2024-03-16T07:28:55.992668+0000","last_unstale":"2024-03-16T07:28:56.005818+0000","last_undegraded":"2024-03-16T07:28:56.005818+0000","last_fullsized":"2024-03-16T07:28:56.005818+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_clean_scrub_stamp":"2024-03-16T07:28:54.963620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:55:45.092400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":12,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.968722+0000","last_change":"2024-03-16T07:28:54.987983+0000","last_active":"2024-03-16T07:28:55.968722+0000","last_peered":"2024-03-16T07:28:55.968722+0000","last_clean":"2024-03-16T07:28:55.968722+0000","last_became_active":"2024-03-16T07:28:54.987754+0000","last_became_peered":"2024-03-16T07:28:54.987754+0000","last_unstale":"2024-03-16T07:28:55.968722+0000","last_undegraded":"2024-03-16T07:28:55.968722+0000","last_fullsized":"2024-03-16T07:28:55.968722+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:53.959780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:53.959780+0000","last_clean_scrub_stamp":"2024-03-16T07:28:53.959780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:14:23.739094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.986221+0000","last_change":"2024-03-16T07:28:41.578826+0000","last_active":"2024-03-16T07:28:55.986221+0000","last_peered":"2024-03-16T07:28:55.986221+0000","last_clean":"2024-03-16T07:28:55.986221+0000","last_became_active":"2024-03-16T07:28:41.578575+0000","last_became_peered":"2024-03-16T07:28:41.578575+0000","last_unstale":"2024-03-16T07:28:55.986221+0000","last_undegraded":"2024-03-16T07:28:55.986221+0000","last_fullsized":"2024-03-16T07:28:55.986221+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:12:29.715285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":20,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.976951+0000","last_change":"2024-03-16T07:28:40.878633+0000","last_active":"2024-03-16T07:28:55.976951+0000","last_peered":"2024-03-16T07:28:55.976951+0000","last_clean":"2024-03-16T07:28:55.976951+0000","last_became_active":"2024-03-16T07:28:40.878286+0000","last_became_peered":"2024-03-16T07:28:40.878286+0000","last_unstale":"2024-03-16T07:28:55.976951+0000","last_undegraded":"2024-03-16T07:28:55.976951+0000","last_fullsized":"2024-03-16T07:28:55.976951+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_clean_scrub_stamp":"2024-03-16T07:28:39.861342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:23:46.664218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.994838+0000","last_change":"2024-03-16T07:28:55.992263+0000","last_active":"2024-03-16T07:28:55.994838+0000","last_peered":"2024-03-16T07:28:55.994838+0000","last_clean":"2024-03-16T07:28:55.994838+0000","last_became_active":"2024-03-16T07:28:55.991363+0000","last_became_peered":"2024-03-16T07:28:55.991363+0000","last_unstale":"2024-03-16T07:28:55.994838+0000","last_undegraded":"2024-03-16T07:28:55.994838+0000","last_fullsized":"2024-03-16T07:28:55.994838+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_clean_scrub_stamp":"2024-03-16T07:28:54.963620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:38:21.923182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":12,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.985500+0000","last_change":"2024-03-16T07:28:54.988363+0000","last_active":"2024-03-16T07:28:55.985500+0000","last_peered":"2024-03-16T07:28:55.985500+0000","last_clean":"2024-03-16T07:28:55.985500+0000","last_became_active":"2024-03-16T07:28:54.988082+0000","last_became_peered":"2024-03-16T07:28:54.988082+0000","last_unstale":"2024-03-16T07:28:55.985500+0000","last_undegraded":"2024-03-16T07:28:55.985500+0000","last_fullsized":"2024-03-16T07:28:55.985500+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:53.959780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:53.959780+0000","last_clean_scrub_stamp":"2024-03-16T07:28:53.959780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:11:21.210695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.972239+0000","last_change":"2024-03-16T07:28:41.575151+0000","last_active":"2024-03-16T07:28:55.972239+0000","last_peered":"2024-03-16T07:28:55.972239+0000","last_clean":"2024-03-16T07:28:55.972239+0000","last_became_active":"2024-03-16T07:28:41.573833+0000","last_became_peered":"2024-03-16T07:28:41.573833+0000","last_unstale":"2024-03-16T07:28:55.972239+0000","last_undegraded":"2024-03-16T07:28:55.972239+0000","last_fullsized":"2024-03-16T07:28:55.972239+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:19:25.780587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":20,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.975281+0000","last_change":"2024-03-16T07:28:40.882270+0000","last_active":"2024-03-16T07:28:55.975281+0000","last_peered":"2024-03-16T07:28:55.975281+0000","last_clean":"2024-03-16T07:28:55.975281+0000","last_became_active":"2024-03-16T07:28:40.882028+0000","last_became_peered":"2024-03-16T07:28:40.882028+0000","last_unstale":"2024-03-16T07:28:55.975281+0000","last_undegraded":"2024-03-16T07:28:55.975281+0000","last_fullsized":"2024-03-16T07:28:55.975281+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_clean_scrub_stamp":"2024-03-16T07:28:39.861342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:56:29.041650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:56.008323+0000","last_change":"2024-03-16T07:28:56.006185+0000","last_active":"2024-03-16T07:28:56.008323+0000","last_peered":"2024-03-16T07:28:56.008323+0000","last_clean":"2024-03-16T07:28:56.008323+0000","last_became_active":"2024-03-16T07:28:56.004811+0000","last_became_peered":"2024-03-16T07:28:56.004811+0000","last_unstale":"2024-03-16T07:28:56.008323+0000","last_undegraded":"2024-03-16T07:28:56.008323+0000","last_fullsized":"2024-03-16T07:28:56.008323+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_clean_scrub_stamp":"2024-03-16T07:28:54.963620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:32:22.760415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":12,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.974448+0000","last_change":"2024-03-16T07:28:54.994437+0000","last_active":"2024-03-16T07:28:55.974448+0000","last_peered":"2024-03-16T07:28:55.974448+0000","last_clean":"2024-03-16T07:28:55.974448+0000","last_became_active":"2024-03-16T07:28:54.994194+0000","last_became_peered":"2024-03-16T07:28:54.994194+0000","last_unstale":"2024-03-16T07:28:55.974448+0000","last_undegraded":"2024-03-16T07:28:55.974448+0000","last_fullsized":"2024-03-16T07:28:55.974448+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:53.959780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:53.959780+0000","last_clean_scrub_stamp":"2024-03-16T07:28:53.959780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:52:20.420277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.974733+0000","last_change":"2024-03-16T07:28:41.573973+0000","last_active":"2024-03-16T07:28:55.974733+0000","last_peered":"2024-03-16T07:28:55.974733+0000","last_clean":"2024-03-16T07:28:55.974733+0000","last_became_active":"2024-03-16T07:28:41.573727+0000","last_became_peered":"2024-03-16T07:28:41.573727+0000","last_unstale":"2024-03-16T07:28:55.974733+0000","last_undegraded":"2024-03-16T07:28:55.974733+0000","last_fullsized":"2024-03-16T07:28:55.974733+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:17:45.831164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":20,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.984289+0000","last_change":"2024-03-16T07:28:40.889413+0000","last_active":"2024-03-16T07:28:55.984289+0000","last_peered":"2024-03-16T07:28:55.984289+0000","last_clean":"2024-03-16T07:28:55.984289+0000","last_became_active":"2024-03-16T07:28:40.886509+0000","last_became_peered":"2024-03-16T07:28:40.886509+0000","last_unstale":"2024-03-16T07:28:55.984289+0000","last_undegraded":"2024-03-16T07:28:55.984289+0000","last_fullsized":"2024-03-16T07:28:55.984289+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_clean_scrub_stamp":"2024-03-16T07:28:39.861342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:48:28.551260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.998830+0000","last_change":"2024-03-16T07:28:55.994916+0000","last_active":"2024-03-16T07:28:55.998830+0000","last_peered":"2024-03-16T07:28:55.998830+0000","last_clean":"2024-03-16T07:28:55.998830+0000","last_became_active":"2024-03-16T07:28:55.991137+0000","last_became_peered":"2024-03-16T07:28:55.991137+0000","last_unstale":"2024-03-16T07:28:55.998830+0000","last_undegraded":"2024-03-16T07:28:55.998830+0000","last_fullsized":"2024-03-16T07:28:55.998830+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_clean_scrub_stamp":"2024-03-16T07:28:54.963620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:36:49.316052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"77'1","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:56.003683+0000","last_change":"2024-03-16T07:28:54.986430+0000","last_active":"2024-03-16T07:28:56.003683+0000","last_peered":"2024-03-16T07:28:56.003683+0000","last_clean":"2024-03-16T07:28:56.003683+0000","last_became_active":"2024-03-16T07:28:54.986212+0000","last_became_peered":"2024-03-16T07:28:54.986212+0000","last_unstale":"2024-03-16T07:28:56.003683+0000","last_undegraded":"2024-03-16T07:28:56.003683+0000","last_fullsized":"2024-03-16T07:28:56.003683+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:53.959780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:53.959780+0000","last_clean_scrub_stamp":"2024-03-16T07:28:53.959780+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:20:24.236384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.973494+0000","last_change":"2024-03-16T07:28:41.586465+0000","last_active":"2024-03-16T07:28:55.973494+0000","last_peered":"2024-03-16T07:28:55.973494+0000","last_clean":"2024-03-16T07:28:55.973494+0000","last_became_active":"2024-03-16T07:28:41.586201+0000","last_became_peered":"2024-03-16T07:28:41.586201+0000","last_unstale":"2024-03-16T07:28:55.973494+0000","last_undegraded":"2024-03-16T07:28:55.973494+0000","last_fullsized":"2024-03-16T07:28:55.973494+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:39:46.941392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"73'1","reported_seq":21,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.973862+0000","last_change":"2024-03-16T07:28:40.883217+0000","last_active":"2024-03-16T07:28:55.973862+0000","last_peered":"2024-03-16T07:28:55.973862+0000","last_clean":"2024-03-16T07:28:55.973862+0000","last_became_active":"2024-03-16T07:28:40.882980+0000","last_became_peered":"2024-03-16T07:28:40.882980+0000","last_unstale":"2024-03-16T07:28:55.973862+0000","last_undegraded":"2024-03-16T07:28:55.973862+0000","last_fullsized":"2024-03-16T07:28:55.973862+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_clean_scrub_stamp":"2024-03-16T07:28:39.861342+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:07:49.913968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"58'141","reported_seq":420,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.972584+0000","last_change":"2024-03-16T07:24:31.650537+0000","last_active":"2024-03-16T07:28:55.972584+0000","last_peered":"2024-03-16T07:28:55.972584+0000","last_clean":"2024-03-16T07:28:55.972584+0000","last_became_active":"2024-03-16T07:24:31.649574+0000","last_became_peered":"2024-03-16T07:24:31.649574+0000","last_unstale":"2024-03-16T07:28:55.972584+0000","last_undegraded":"2024-03-16T07:28:55.972584+0000","last_fullsized":"2024-03-16T07:28:55.972584+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:29.719970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:29.719970+0000","last_clean_scrub_stamp":"2024-03-16T07:24:29.719970+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:31:35.774554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":490,"num_read_kb":915,"num_write":217,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":4107,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":8214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":3},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":490,"num_read_kb":915,"num_write":217,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":141,"ondisk_log_size":141,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738422,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":31988,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":104825612,"statfs":{"total":107374182400,"available":107341426688,"internally_reserved":0,"allocated":823296,"data_stored":311824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738422,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":32512,"kb_used_data":1332,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":104825088,"statfs":{"total":107374182400,"available":107340890112,"internally_reserved":0,"allocated":1363968,"data_stored":891240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738422,"num_pgs":82,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":32552,"kb_used_data":1368,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":104825048,"statfs":{"total":107374182400,"available":107340849152,"internally_reserved":0,"allocated":1400832,"data_stored":901070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":3947,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-16T07:29:00.270 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-16T07:29:00.626 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:29:00.628 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2024-03-16T07:29:00.635 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":45,"stamp":"2024-03-16T07:28:59.892754+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596885,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":490,"num_read_kb":915,"num_write":308,"num_write_kb":1925,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":220,"ondisk_log_size":220,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":254,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":314572800,"kb_used":97052,"kb_used_data":3504,"kb_used_omap":4,"kb_used_meta":93499,"kb_avail":314475748,"statfs":{"total":322122547200,"available":322023165952,"internally_reserved":0,"allocated":3588096,"data_stored":2104134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":95743311},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.931772"},"pg_stats":[{"pgid":"15.3d","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:56.000159+0000","last_change":"2024-03-16T07:28:55.997326+0000","last_active":"2024-03-16T07:28:56.000159+0000","last_peered":"2024-03-16T07:28:56.000159+0000","last_clean":"2024-03-16T07:28:56.000159+0000","last_became_active":"2024-03-16T07:28:55.996651+0000","last_became_peered":"2024-03-16T07:28:55.996651+0000","last_unstale":"2024-03-16T07:28:56.000159+0000","last_undegraded":"2024-03-16T07:28:56.000159+0000","last_fullsized":"2024-03-16T07:28:56.000159+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_clean_scrub_stamp":"2024-03-16T07:28:54.963620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:51:05.203345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.974370+0000","last_change":"2024-03-16T07:28:41.584717+0000","last_active":"2024-03-16T07:28:55.974370+0000","last_peered":"2024-03-16T07:28:55.974370+0000","last_clean":"2024-03-16T07:28:55.974370+0000","last_became_active":"2024-03-16T07:28:41.582095+0000","last_became_peered":"2024-03-16T07:28:41.582095+0000","last_unstale":"2024-03-16T07:28:55.974370+0000","last_undegraded":"2024-03-16T07:28:55.974370+0000","last_fullsized":"2024-03-16T07:28:55.974370+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:58:10.625850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:56.002685+0000","last_change":"2024-03-16T07:28:55.999932+0000","last_active":"2024-03-16T07:28:56.002685+0000","last_peered":"2024-03-16T07:28:56.002685+0000","last_clean":"2024-03-16T07:28:56.002685+0000","last_became_active":"2024-03-16T07:28:55.996321+0000","last_became_peered":"2024-03-16T07:28:55.996321+0000","last_unstale":"2024-03-16T07:28:56.002685+0000","last_undegraded":"2024-03-16T07:28:56.002685+0000","last_fullsized":"2024-03-16T07:28:56.002685+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_clean_scrub_stamp":"2024-03-16T07:28:54.963620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:30:14.668142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.972634+0000","last_change":"2024-03-16T07:28:41.581340+0000","last_active":"2024-03-16T07:28:55.972634+0000","last_peered":"2024-03-16T07:28:55.972634+0000","last_clean":"2024-03-16T07:28:55.972634+0000","last_became_active":"2024-03-16T07:28:41.580857+0000","last_became_peered":"2024-03-16T07:28:41.580857+0000","last_unstale":"2024-03-16T07:28:55.972634+0000","last_undegraded":"2024-03-16T07:28:55.972634+0000","last_fullsized":"2024-03-16T07:28:55.972634+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:12:10.158550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3f","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:56.001007+0000","last_change":"2024-03-16T07:28:55.995204+0000","last_active":"2024-03-16T07:28:56.001007+0000","last_peered":"2024-03-16T07:28:56.001007+0000","last_clean":"2024-03-16T07:28:56.001007+0000","last_became_active":"2024-03-16T07:28:55.992867+0000","last_became_peered":"2024-03-16T07:28:55.992867+0000","last_unstale":"2024-03-16T07:28:56.001007+0000","last_undegraded":"2024-03-16T07:28:56.001007+0000","last_fullsized":"2024-03-16T07:28:56.001007+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_clean_scrub_stamp":"2024-03-16T07:28:54.963620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:49:10.718848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.974096+0000","last_change":"2024-03-16T07:28:41.571483+0000","last_active":"2024-03-16T07:28:55.974096+0000","last_peered":"2024-03-16T07:28:55.974096+0000","last_clean":"2024-03-16T07:28:55.974096+0000","last_became_active":"2024-03-16T07:28:41.571155+0000","last_became_peered":"2024-03-16T07:28:41.571155+0000","last_unstale":"2024-03-16T07:28:55.974096+0000","last_undegraded":"2024-03-16T07:28:55.974096+0000","last_fullsized":"2024-03-16T07:28:55.974096+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:45:08.243692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:56.008273+0000","last_change":"2024-03-16T07:28:56.005925+0000","last_active":"2024-03-16T07:28:56.008273+0000","last_peered":"2024-03-16T07:28:56.008273+0000","last_clean":"2024-03-16T07:28:56.008273+0000","last_became_active":"2024-03-16T07:28:56.005513+0000","last_became_peered":"2024-03-16T07:28:56.005513+0000","last_unstale":"2024-03-16T07:28:56.008273+0000","last_undegraded":"2024-03-16T07:28:56.008273+0000","last_fullsized":"2024-03-16T07:28:56.008273+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_clean_scrub_stamp":"2024-03-16T07:28:54.963620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:53:49.931951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.969961+0000","last_change":"2024-03-16T07:28:41.573044+0000","last_active":"2024-03-16T07:28:55.969961+0000","last_peered":"2024-03-16T07:28:55.969961+0000","last_clean":"2024-03-16T07:28:55.969961+0000","last_became_active":"2024-03-16T07:28:41.572405+0000","last_became_peered":"2024-03-16T07:28:41.572405+0000","last_unstale":"2024-03-16T07:28:55.969961+0000","last_undegraded":"2024-03-16T07:28:55.969961+0000","last_fullsized":"2024-03-16T07:28:55.969961+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:27:58.242759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:56.010129+0000","last_change":"2024-03-16T07:28:56.006281+0000","last_active":"2024-03-16T07:28:56.010129+0000","last_peered":"2024-03-16T07:28:56.010129+0000","last_clean":"2024-03-16T07:28:56.010129+0000","last_became_active":"2024-03-16T07:28:56.004845+0000","last_became_peered":"2024-03-16T07:28:56.004845+0000","last_unstale":"2024-03-16T07:28:56.010129+0000","last_undegraded":"2024-03-16T07:28:56.010129+0000","last_fullsized":"2024-03-16T07:28:56.010129+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_clean_scrub_stamp":"2024-03-16T07:28:54.963620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:09:07.363254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.976379+0000","last_change":"2024-03-16T07:28:41.574275+0000","last_active":"2024-03-16T07:28:55.976379+0000","last_peered":"2024-03-16T07:28:55.976379+0000","last_clean":"2024-03-16T07:28:55.976379+0000","last_became_active":"2024-03-16T07:28:41.572254+0000","last_became_peered":"2024-03-16T07:28:41.572254+0000","last_unstale":"2024-03-16T07:28:55.976379+0000","last_undegraded":"2024-03-16T07:28:55.976379+0000","last_fullsized":"2024-03-16T07:28:55.976379+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:31:09.682383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:56.008120+0000","last_change":"2024-03-16T07:28:56.002802+0000","last_active":"2024-03-16T07:28:56.008120+0000","last_peered":"2024-03-16T07:28:56.008120+0000","last_clean":"2024-03-16T07:28:56.008120+0000","last_became_active":"2024-03-16T07:28:56.000148+0000","last_became_peered":"2024-03-16T07:28:56.000148+0000","last_unstale":"2024-03-16T07:28:56.008120+0000","last_undegraded":"2024-03-16T07:28:56.008120+0000","last_fullsized":"2024-03-16T07:28:56.008120+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_clean_scrub_stamp":"2024-03-16T07:28:54.963620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:51:30.118961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.974720+0000","last_change":"2024-03-16T07:28:41.571823+0000","last_active":"2024-03-16T07:28:55.974720+0000","last_peered":"2024-03-16T07:28:55.974720+0000","last_clean":"2024-03-16T07:28:55.974720+0000","last_became_active":"2024-03-16T07:28:41.571384+0000","last_became_peered":"2024-03-16T07:28:41.571384+0000","last_unstale":"2024-03-16T07:28:55.974720+0000","last_undegraded":"2024-03-16T07:28:55.974720+0000","last_fullsized":"2024-03-16T07:28:55.974720+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:19:56.148452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:56.004029+0000","last_change":"2024-03-16T07:28:55.999599+0000","last_active":"2024-03-16T07:28:56.004029+0000","last_peered":"2024-03-16T07:28:56.004029+0000","last_clean":"2024-03-16T07:28:56.004029+0000","last_became_active":"2024-03-16T07:28:55.998025+0000","last_became_peered":"2024-03-16T07:28:55.998025+0000","last_unstale":"2024-03-16T07:28:56.004029+0000","last_undegraded":"2024-03-16T07:28:56.004029+0000","last_fullsized":"2024-03-16T07:28:56.004029+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_clean_scrub_stamp":"2024-03-16T07:28:54.963620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:34:28.837701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.968162+0000","last_change":"2024-03-16T07:28:41.575572+0000","last_active":"2024-03-16T07:28:55.968162+0000","last_peered":"2024-03-16T07:28:55.968162+0000","last_clean":"2024-03-16T07:28:55.968162+0000","last_became_active":"2024-03-16T07:28:41.574604+0000","last_became_peered":"2024-03-16T07:28:41.574604+0000","last_unstale":"2024-03-16T07:28:55.968162+0000","last_undegraded":"2024-03-16T07:28:55.968162+0000","last_fullsized":"2024-03-16T07:28:55.968162+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:11:52.604254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:56.006168+0000","last_change":"2024-03-16T07:28:56.003241+0000","last_active":"2024-03-16T07:28:56.006168+0000","last_peered":"2024-03-16T07:28:56.006168+0000","last_clean":"2024-03-16T07:28:56.006168+0000","last_became_active":"2024-03-16T07:28:56.002996+0000","last_became_peered":"2024-03-16T07:28:56.002996+0000","last_unstale":"2024-03-16T07:28:56.006168+0000","last_undegraded":"2024-03-16T07:28:56.006168+0000","last_fullsized":"2024-03-16T07:28:56.006168+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_clean_scrub_stamp":"2024-03-16T07:28:54.963620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:36:49.316052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.984074+0000","last_change":"2024-03-16T07:28:41.587931+0000","last_active":"2024-03-16T07:28:55.984074+0000","last_peered":"2024-03-16T07:28:55.984074+0000","last_clean":"2024-03-16T07:28:55.984074+0000","last_became_active":"2024-03-16T07:28:41.587665+0000","last_became_peered":"2024-03-16T07:28:41.587665+0000","last_unstale":"2024-03-16T07:28:55.984074+0000","last_undegraded":"2024-03-16T07:28:55.984074+0000","last_fullsized":"2024-03-16T07:28:55.984074+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:48:56.617539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.996604+0000","last_change":"2024-03-16T07:28:55.990258+0000","last_active":"2024-03-16T07:28:55.996604+0000","last_peered":"2024-03-16T07:28:55.996604+0000","last_clean":"2024-03-16T07:28:55.996604+0000","last_became_active":"2024-03-16T07:28:55.989020+0000","last_became_peered":"2024-03-16T07:28:55.989020+0000","last_unstale":"2024-03-16T07:28:55.996604+0000","last_undegraded":"2024-03-16T07:28:55.996604+0000","last_fullsized":"2024-03-16T07:28:55.996604+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_clean_scrub_stamp":"2024-03-16T07:28:54.963620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:17:00.626133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.974463+0000","last_change":"2024-03-16T07:28:41.586380+0000","last_active":"2024-03-16T07:28:55.974463+0000","last_peered":"2024-03-16T07:28:55.974463+0000","last_clean":"2024-03-16T07:28:55.974463+0000","last_became_active":"2024-03-16T07:28:41.586099+0000","last_became_peered":"2024-03-16T07:28:41.586099+0000","last_unstale":"2024-03-16T07:28:55.974463+0000","last_undegraded":"2024-03-16T07:28:55.974463+0000","last_fullsized":"2024-03-16T07:28:55.974463+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:18:48.716783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:56.001945+0000","last_change":"2024-03-16T07:28:55.993306+0000","last_active":"2024-03-16T07:28:56.001945+0000","last_peered":"2024-03-16T07:28:56.001945+0000","last_clean":"2024-03-16T07:28:56.001945+0000","last_became_active":"2024-03-16T07:28:55.992184+0000","last_became_peered":"2024-03-16T07:28:55.992184+0000","last_unstale":"2024-03-16T07:28:56.001945+0000","last_undegraded":"2024-03-16T07:28:56.001945+0000","last_fullsized":"2024-03-16T07:28:56.001945+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_clean_scrub_stamp":"2024-03-16T07:28:54.963620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:28:33.174472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.969627+0000","last_change":"2024-03-16T07:28:41.573336+0000","last_active":"2024-03-16T07:28:55.969627+0000","last_peered":"2024-03-16T07:28:55.969627+0000","last_clean":"2024-03-16T07:28:55.969627+0000","last_became_active":"2024-03-16T07:28:41.573117+0000","last_became_peered":"2024-03-16T07:28:41.573117+0000","last_unstale":"2024-03-16T07:28:55.969627+0000","last_undegraded":"2024-03-16T07:28:55.969627+0000","last_fullsized":"2024-03-16T07:28:55.969627+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:05:51.922468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.991488+0000","last_change":"2024-03-16T07:28:55.991017+0000","last_active":"2024-03-16T07:28:55.991488+0000","last_peered":"2024-03-16T07:28:55.991488+0000","last_clean":"2024-03-16T07:28:55.991488+0000","last_became_active":"2024-03-16T07:28:55.989764+0000","last_became_peered":"2024-03-16T07:28:55.989764+0000","last_unstale":"2024-03-16T07:28:55.991488+0000","last_undegraded":"2024-03-16T07:28:55.991488+0000","last_fullsized":"2024-03-16T07:28:55.991488+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_clean_scrub_stamp":"2024-03-16T07:28:54.963620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:13:15.253368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.973691+0000","last_change":"2024-03-16T07:28:41.581320+0000","last_active":"2024-03-16T07:28:55.973691+0000","last_peered":"2024-03-16T07:28:55.973691+0000","last_clean":"2024-03-16T07:28:55.973691+0000","last_became_active":"2024-03-16T07:28:41.581060+0000","last_became_peered":"2024-03-16T07:28:41.581060+0000","last_unstale":"2024-03-16T07:28:55.973691+0000","last_undegraded":"2024-03-16T07:28:55.973691+0000","last_fullsized":"2024-03-16T07:28:55.973691+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:11:52.604254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:56.010066+0000","last_change":"2024-03-16T07:28:56.006528+0000","last_active":"2024-03-16T07:28:56.010066+0000","last_peered":"2024-03-16T07:28:56.010066+0000","last_clean":"2024-03-16T07:28:56.010066+0000","last_became_active":"2024-03-16T07:28:56.006172+0000","last_became_peered":"2024-03-16T07:28:56.006172+0000","last_unstale":"2024-03-16T07:28:56.010066+0000","last_undegraded":"2024-03-16T07:28:56.010066+0000","last_fullsized":"2024-03-16T07:28:56.010066+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_clean_scrub_stamp":"2024-03-16T07:28:54.963620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:38:58.977752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.986422+0000","last_change":"2024-03-16T07:28:41.587377+0000","last_active":"2024-03-16T07:28:55.986422+0000","last_peered":"2024-03-16T07:28:55.986422+0000","last_clean":"2024-03-16T07:28:55.986422+0000","last_became_active":"2024-03-16T07:28:41.586980+0000","last_became_peered":"2024-03-16T07:28:41.586980+0000","last_unstale":"2024-03-16T07:28:55.986422+0000","last_undegraded":"2024-03-16T07:28:55.986422+0000","last_fullsized":"2024-03-16T07:28:55.986422+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:51:48.259581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:56.005875+0000","last_change":"2024-03-16T07:28:56.000934+0000","last_active":"2024-03-16T07:28:56.005875+0000","last_peered":"2024-03-16T07:28:56.005875+0000","last_clean":"2024-03-16T07:28:56.005875+0000","last_became_active":"2024-03-16T07:28:55.992424+0000","last_became_peered":"2024-03-16T07:28:55.992424+0000","last_unstale":"2024-03-16T07:28:56.005875+0000","last_undegraded":"2024-03-16T07:28:56.005875+0000","last_fullsized":"2024-03-16T07:28:56.005875+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_clean_scrub_stamp":"2024-03-16T07:28:54.963620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:52:02.360890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.985861+0000","last_change":"2024-03-16T07:28:41.579054+0000","last_active":"2024-03-16T07:28:55.985861+0000","last_peered":"2024-03-16T07:28:55.985861+0000","last_clean":"2024-03-16T07:28:55.985861+0000","last_became_active":"2024-03-16T07:28:41.578801+0000","last_became_peered":"2024-03-16T07:28:41.578801+0000","last_unstale":"2024-03-16T07:28:55.985861+0000","last_undegraded":"2024-03-16T07:28:55.985861+0000","last_fullsized":"2024-03-16T07:28:55.985861+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:55:30.991091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:56.008136+0000","last_change":"2024-03-16T07:28:56.003622+0000","last_active":"2024-03-16T07:28:56.008136+0000","last_peered":"2024-03-16T07:28:56.008136+0000","last_clean":"2024-03-16T07:28:56.008136+0000","last_became_active":"2024-03-16T07:28:56.002430+0000","last_became_peered":"2024-03-16T07:28:56.002430+0000","last_unstale":"2024-03-16T07:28:56.008136+0000","last_undegraded":"2024-03-16T07:28:56.008136+0000","last_fullsized":"2024-03-16T07:28:56.008136+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_clean_scrub_stamp":"2024-03-16T07:28:54.963620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:05:22.629387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.975103+0000","last_change":"2024-03-16T07:28:41.576077+0000","last_active":"2024-03-16T07:28:55.975103+0000","last_peered":"2024-03-16T07:28:55.975103+0000","last_clean":"2024-03-16T07:28:55.975103+0000","last_became_active":"2024-03-16T07:28:41.575830+0000","last_became_peered":"2024-03-16T07:28:41.575830+0000","last_unstale":"2024-03-16T07:28:55.975103+0000","last_undegraded":"2024-03-16T07:28:55.975103+0000","last_fullsized":"2024-03-16T07:28:55.975103+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:14:32.345113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:56.004095+0000","last_change":"2024-03-16T07:28:55.999797+0000","last_active":"2024-03-16T07:28:56.004095+0000","last_peered":"2024-03-16T07:28:56.004095+0000","last_clean":"2024-03-16T07:28:56.004095+0000","last_became_active":"2024-03-16T07:28:55.999217+0000","last_became_peered":"2024-03-16T07:28:55.999217+0000","last_unstale":"2024-03-16T07:28:56.004095+0000","last_undegraded":"2024-03-16T07:28:56.004095+0000","last_fullsized":"2024-03-16T07:28:56.004095+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_clean_scrub_stamp":"2024-03-16T07:28:54.963620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:06:44.968559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.974543+0000","last_change":"2024-03-16T07:28:41.585018+0000","last_active":"2024-03-16T07:28:55.974543+0000","last_peered":"2024-03-16T07:28:55.974543+0000","last_clean":"2024-03-16T07:28:55.974543+0000","last_became_active":"2024-03-16T07:28:41.584767+0000","last_became_peered":"2024-03-16T07:28:41.584767+0000","last_unstale":"2024-03-16T07:28:55.974543+0000","last_undegraded":"2024-03-16T07:28:55.974543+0000","last_fullsized":"2024-03-16T07:28:55.974543+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:07:53.076520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.994861+0000","last_change":"2024-03-16T07:28:55.992449+0000","last_active":"2024-03-16T07:28:55.994861+0000","last_peered":"2024-03-16T07:28:55.994861+0000","last_clean":"2024-03-16T07:28:55.994861+0000","last_became_active":"2024-03-16T07:28:55.991705+0000","last_became_peered":"2024-03-16T07:28:55.991705+0000","last_unstale":"2024-03-16T07:28:55.994861+0000","last_undegraded":"2024-03-16T07:28:55.994861+0000","last_fullsized":"2024-03-16T07:28:55.994861+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_clean_scrub_stamp":"2024-03-16T07:28:54.963620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:55:45.092400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.968982+0000","last_change":"2024-03-16T07:28:41.579446+0000","last_active":"2024-03-16T07:28:55.968982+0000","last_peered":"2024-03-16T07:28:55.968982+0000","last_clean":"2024-03-16T07:28:55.968982+0000","last_became_active":"2024-03-16T07:28:41.579222+0000","last_became_peered":"2024-03-16T07:28:41.579222+0000","last_unstale":"2024-03-16T07:28:55.968982+0000","last_undegraded":"2024-03-16T07:28:55.968982+0000","last_fullsized":"2024-03-16T07:28:55.968982+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:58:10.625850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.996631+0000","last_change":"2024-03-16T07:28:55.992798+0000","last_active":"2024-03-16T07:28:55.996631+0000","last_peered":"2024-03-16T07:28:55.996631+0000","last_clean":"2024-03-16T07:28:55.996631+0000","last_became_active":"2024-03-16T07:28:55.989068+0000","last_became_peered":"2024-03-16T07:28:55.989068+0000","last_unstale":"2024-03-16T07:28:55.996631+0000","last_undegraded":"2024-03-16T07:28:55.996631+0000","last_fullsized":"2024-03-16T07:28:55.996631+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_clean_scrub_stamp":"2024-03-16T07:28:54.963620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:52:02.360890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.990790+0000","last_change":"2024-03-16T07:28:41.575562+0000","last_active":"2024-03-16T07:28:55.990790+0000","last_peered":"2024-03-16T07:28:55.990790+0000","last_clean":"2024-03-16T07:28:55.990790+0000","last_became_active":"2024-03-16T07:28:41.574861+0000","last_became_peered":"2024-03-16T07:28:41.574861+0000","last_unstale":"2024-03-16T07:28:55.990790+0000","last_undegraded":"2024-03-16T07:28:55.990790+0000","last_fullsized":"2024-03-16T07:28:55.990790+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:16:46.524824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:56.001814+0000","last_change":"2024-03-16T07:28:55.995419+0000","last_active":"2024-03-16T07:28:56.001814+0000","last_peered":"2024-03-16T07:28:56.001814+0000","last_clean":"2024-03-16T07:28:56.001814+0000","last_became_active":"2024-03-16T07:28:55.993340+0000","last_became_peered":"2024-03-16T07:28:55.993340+0000","last_unstale":"2024-03-16T07:28:56.001814+0000","last_undegraded":"2024-03-16T07:28:56.001814+0000","last_fullsized":"2024-03-16T07:28:56.001814+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_clean_scrub_stamp":"2024-03-16T07:28:54.963620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:48:32.792723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.969701+0000","last_change":"2024-03-16T07:28:41.573236+0000","last_active":"2024-03-16T07:28:55.969701+0000","last_peered":"2024-03-16T07:28:55.969701+0000","last_clean":"2024-03-16T07:28:55.969701+0000","last_became_active":"2024-03-16T07:28:41.572821+0000","last_became_peered":"2024-03-16T07:28:41.572821+0000","last_unstale":"2024-03-16T07:28:55.969701+0000","last_undegraded":"2024-03-16T07:28:55.969701+0000","last_fullsized":"2024-03-16T07:28:55.969701+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:53:47.532145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:56.004471+0000","last_change":"2024-03-16T07:28:55.994573+0000","last_active":"2024-03-16T07:28:56.004471+0000","last_peered":"2024-03-16T07:28:56.004471+0000","last_clean":"2024-03-16T07:28:56.004471+0000","last_became_active":"2024-03-16T07:28:55.994345+0000","last_became_peered":"2024-03-16T07:28:55.994345+0000","last_unstale":"2024-03-16T07:28:56.004471+0000","last_undegraded":"2024-03-16T07:28:56.004471+0000","last_fullsized":"2024-03-16T07:28:56.004471+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_clean_scrub_stamp":"2024-03-16T07:28:54.963620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:34:53.100466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.988159+0000","last_change":"2024-03-16T07:28:41.576503+0000","last_active":"2024-03-16T07:28:55.988159+0000","last_peered":"2024-03-16T07:28:55.988159+0000","last_clean":"2024-03-16T07:28:55.988159+0000","last_became_active":"2024-03-16T07:28:41.576209+0000","last_became_peered":"2024-03-16T07:28:41.576209+0000","last_unstale":"2024-03-16T07:28:55.988159+0000","last_undegraded":"2024-03-16T07:28:55.988159+0000","last_fullsized":"2024-03-16T07:28:55.988159+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:50:51.102035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:56.003981+0000","last_change":"2024-03-16T07:28:55.998559+0000","last_active":"2024-03-16T07:28:56.003981+0000","last_peered":"2024-03-16T07:28:56.003981+0000","last_clean":"2024-03-16T07:28:56.003981+0000","last_became_active":"2024-03-16T07:28:55.998113+0000","last_became_peered":"2024-03-16T07:28:55.998113+0000","last_unstale":"2024-03-16T07:28:56.003981+0000","last_undegraded":"2024-03-16T07:28:56.003981+0000","last_fullsized":"2024-03-16T07:28:56.003981+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_clean_scrub_stamp":"2024-03-16T07:28:54.963620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:11:10.385099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.970060+0000","last_change":"2024-03-16T07:28:41.580683+0000","last_active":"2024-03-16T07:28:55.970060+0000","last_peered":"2024-03-16T07:28:55.970060+0000","last_clean":"2024-03-16T07:28:55.970060+0000","last_became_active":"2024-03-16T07:28:41.580015+0000","last_became_peered":"2024-03-16T07:28:41.580015+0000","last_unstale":"2024-03-16T07:28:55.970060+0000","last_undegraded":"2024-03-16T07:28:55.970060+0000","last_fullsized":"2024-03-16T07:28:55.970060+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:13:22.941187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:56.003919+0000","last_change":"2024-03-16T07:28:55.997383+0000","last_active":"2024-03-16T07:28:56.003919+0000","last_peered":"2024-03-16T07:28:56.003919+0000","last_clean":"2024-03-16T07:28:56.003919+0000","last_became_active":"2024-03-16T07:28:55.997162+0000","last_became_peered":"2024-03-16T07:28:55.997162+0000","last_unstale":"2024-03-16T07:28:56.003919+0000","last_undegraded":"2024-03-16T07:28:56.003919+0000","last_fullsized":"2024-03-16T07:28:56.003919+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_clean_scrub_stamp":"2024-03-16T07:28:54.963620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:12:57.519834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.976692+0000","last_change":"2024-03-16T07:28:41.574346+0000","last_active":"2024-03-16T07:28:55.976692+0000","last_peered":"2024-03-16T07:28:55.976692+0000","last_clean":"2024-03-16T07:28:55.976692+0000","last_became_active":"2024-03-16T07:28:41.572788+0000","last_became_peered":"2024-03-16T07:28:41.572788+0000","last_unstale":"2024-03-16T07:28:55.976692+0000","last_undegraded":"2024-03-16T07:28:55.976692+0000","last_fullsized":"2024-03-16T07:28:55.976692+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:04:31.191298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.991971+0000","last_change":"2024-03-16T07:28:55.990172+0000","last_active":"2024-03-16T07:28:55.991971+0000","last_peered":"2024-03-16T07:28:55.991971+0000","last_clean":"2024-03-16T07:28:55.991971+0000","last_became_active":"2024-03-16T07:28:55.989601+0000","last_became_peered":"2024-03-16T07:28:55.989601+0000","last_unstale":"2024-03-16T07:28:55.991971+0000","last_undegraded":"2024-03-16T07:28:55.991971+0000","last_fullsized":"2024-03-16T07:28:55.991971+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_clean_scrub_stamp":"2024-03-16T07:28:54.963620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:49:53.338420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.975573+0000","last_change":"2024-03-16T07:28:41.585789+0000","last_active":"2024-03-16T07:28:55.975573+0000","last_peered":"2024-03-16T07:28:55.975573+0000","last_clean":"2024-03-16T07:28:55.975573+0000","last_became_active":"2024-03-16T07:28:41.585253+0000","last_became_peered":"2024-03-16T07:28:41.585253+0000","last_unstale":"2024-03-16T07:28:55.975573+0000","last_undegraded":"2024-03-16T07:28:55.975573+0000","last_fullsized":"2024-03-16T07:28:55.975573+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:52:41.800604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.999289+0000","last_change":"2024-03-16T07:28:55.996731+0000","last_active":"2024-03-16T07:28:55.999289+0000","last_peered":"2024-03-16T07:28:55.999289+0000","last_clean":"2024-03-16T07:28:55.999289+0000","last_became_active":"2024-03-16T07:28:55.996043+0000","last_became_peered":"2024-03-16T07:28:55.996043+0000","last_unstale":"2024-03-16T07:28:55.999289+0000","last_undegraded":"2024-03-16T07:28:55.999289+0000","last_fullsized":"2024-03-16T07:28:55.999289+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_clean_scrub_stamp":"2024-03-16T07:28:54.963620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:03:20.957952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.983476+0000","last_change":"2024-03-16T07:28:41.580659+0000","last_active":"2024-03-16T07:28:55.983476+0000","last_peered":"2024-03-16T07:28:55.983476+0000","last_clean":"2024-03-16T07:28:55.983476+0000","last_became_active":"2024-03-16T07:28:41.580236+0000","last_became_peered":"2024-03-16T07:28:41.580236+0000","last_unstale":"2024-03-16T07:28:55.983476+0000","last_undegraded":"2024-03-16T07:28:55.983476+0000","last_fullsized":"2024-03-16T07:28:55.983476+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:13:01.152059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:56.003899+0000","last_change":"2024-03-16T07:28:55.994379+0000","last_active":"2024-03-16T07:28:56.003899+0000","last_peered":"2024-03-16T07:28:56.003899+0000","last_clean":"2024-03-16T07:28:56.003899+0000","last_became_active":"2024-03-16T07:28:55.991996+0000","last_became_peered":"2024-03-16T07:28:55.991996+0000","last_unstale":"2024-03-16T07:28:56.003899+0000","last_undegraded":"2024-03-16T07:28:56.003899+0000","last_fullsized":"2024-03-16T07:28:56.003899+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_clean_scrub_stamp":"2024-03-16T07:28:54.963620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:20:07.538708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.968987+0000","last_change":"2024-03-16T07:28:41.578066+0000","last_active":"2024-03-16T07:28:55.968987+0000","last_peered":"2024-03-16T07:28:55.968987+0000","last_clean":"2024-03-16T07:28:55.968987+0000","last_became_active":"2024-03-16T07:28:41.577559+0000","last_became_peered":"2024-03-16T07:28:41.577559+0000","last_unstale":"2024-03-16T07:28:55.968987+0000","last_undegraded":"2024-03-16T07:28:55.968987+0000","last_fullsized":"2024-03-16T07:28:55.968987+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:59:28.713162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:56.000807+0000","last_change":"2024-03-16T07:28:55.999501+0000","last_active":"2024-03-16T07:28:56.000807+0000","last_peered":"2024-03-16T07:28:56.000807+0000","last_clean":"2024-03-16T07:28:56.000807+0000","last_became_active":"2024-03-16T07:28:55.996821+0000","last_became_peered":"2024-03-16T07:28:55.996821+0000","last_unstale":"2024-03-16T07:28:56.000807+0000","last_undegraded":"2024-03-16T07:28:56.000807+0000","last_fullsized":"2024-03-16T07:28:56.000807+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_clean_scrub_stamp":"2024-03-16T07:28:54.963620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:28:46.708502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.974560+0000","last_change":"2024-03-16T07:28:41.586201+0000","last_active":"2024-03-16T07:28:55.974560+0000","last_peered":"2024-03-16T07:28:55.974560+0000","last_clean":"2024-03-16T07:28:55.974560+0000","last_became_active":"2024-03-16T07:28:41.585957+0000","last_became_peered":"2024-03-16T07:28:41.585957+0000","last_unstale":"2024-03-16T07:28:55.974560+0000","last_undegraded":"2024-03-16T07:28:55.974560+0000","last_fullsized":"2024-03-16T07:28:55.974560+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:42:27.646009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.988233+0000","last_change":"2024-03-16T07:28:55.987814+0000","last_active":"2024-03-16T07:28:55.988233+0000","last_peered":"2024-03-16T07:28:55.988233+0000","last_clean":"2024-03-16T07:28:55.988233+0000","last_became_active":"2024-03-16T07:28:55.987512+0000","last_became_peered":"2024-03-16T07:28:55.987512+0000","last_unstale":"2024-03-16T07:28:55.988233+0000","last_undegraded":"2024-03-16T07:28:55.988233+0000","last_fullsized":"2024-03-16T07:28:55.988233+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_clean_scrub_stamp":"2024-03-16T07:28:54.963620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:54:50.244190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.972706+0000","last_change":"2024-03-16T07:28:41.584462+0000","last_active":"2024-03-16T07:28:55.972706+0000","last_peered":"2024-03-16T07:28:55.972706+0000","last_clean":"2024-03-16T07:28:55.972706+0000","last_became_active":"2024-03-16T07:28:41.583131+0000","last_became_peered":"2024-03-16T07:28:41.583131+0000","last_unstale":"2024-03-16T07:28:55.972706+0000","last_undegraded":"2024-03-16T07:28:55.972706+0000","last_fullsized":"2024-03-16T07:28:55.972706+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:53:17.428726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:56.004494+0000","last_change":"2024-03-16T07:28:55.995291+0000","last_active":"2024-03-16T07:28:56.004494+0000","last_peered":"2024-03-16T07:28:56.004494+0000","last_clean":"2024-03-16T07:28:56.004494+0000","last_became_active":"2024-03-16T07:28:55.995053+0000","last_became_peered":"2024-03-16T07:28:55.995053+0000","last_unstale":"2024-03-16T07:28:56.004494+0000","last_undegraded":"2024-03-16T07:28:56.004494+0000","last_fullsized":"2024-03-16T07:28:56.004494+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_clean_scrub_stamp":"2024-03-16T07:28:54.963620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:04:19.463088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.974320+0000","last_change":"2024-03-16T07:28:41.574267+0000","last_active":"2024-03-16T07:28:55.974320+0000","last_peered":"2024-03-16T07:28:55.974320+0000","last_clean":"2024-03-16T07:28:55.974320+0000","last_became_active":"2024-03-16T07:28:41.573063+0000","last_became_peered":"2024-03-16T07:28:41.573063+0000","last_unstale":"2024-03-16T07:28:55.974320+0000","last_undegraded":"2024-03-16T07:28:55.974320+0000","last_fullsized":"2024-03-16T07:28:55.974320+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:54:36.285120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:56.008257+0000","last_change":"2024-03-16T07:28:56.005747+0000","last_active":"2024-03-16T07:28:56.008257+0000","last_peered":"2024-03-16T07:28:56.008257+0000","last_clean":"2024-03-16T07:28:56.008257+0000","last_became_active":"2024-03-16T07:28:56.004450+0000","last_became_peered":"2024-03-16T07:28:56.004450+0000","last_unstale":"2024-03-16T07:28:56.008257+0000","last_undegraded":"2024-03-16T07:28:56.008257+0000","last_fullsized":"2024-03-16T07:28:56.008257+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_clean_scrub_stamp":"2024-03-16T07:28:54.963620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:33:44.362493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.973384+0000","last_change":"2024-03-16T07:28:41.581852+0000","last_active":"2024-03-16T07:28:55.973384+0000","last_peered":"2024-03-16T07:28:55.973384+0000","last_clean":"2024-03-16T07:28:55.973384+0000","last_became_active":"2024-03-16T07:28:41.581577+0000","last_became_peered":"2024-03-16T07:28:41.581577+0000","last_unstale":"2024-03-16T07:28:55.973384+0000","last_undegraded":"2024-03-16T07:28:55.973384+0000","last_fullsized":"2024-03-16T07:28:55.973384+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:46:18.244213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:56.005858+0000","last_change":"2024-03-16T07:28:56.000699+0000","last_active":"2024-03-16T07:28:56.005858+0000","last_peered":"2024-03-16T07:28:56.005858+0000","last_clean":"2024-03-16T07:28:56.005858+0000","last_became_active":"2024-03-16T07:28:55.993328+0000","last_became_peered":"2024-03-16T07:28:55.993328+0000","last_unstale":"2024-03-16T07:28:56.005858+0000","last_undegraded":"2024-03-16T07:28:56.005858+0000","last_fullsized":"2024-03-16T07:28:56.005858+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_clean_scrub_stamp":"2024-03-16T07:28:54.963620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:12:43.816594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.972015+0000","last_change":"2024-03-16T07:28:41.582852+0000","last_active":"2024-03-16T07:28:55.972015+0000","last_peered":"2024-03-16T07:28:55.972015+0000","last_clean":"2024-03-16T07:28:55.972015+0000","last_became_active":"2024-03-16T07:28:41.582617+0000","last_became_peered":"2024-03-16T07:28:41.582617+0000","last_unstale":"2024-03-16T07:28:55.972015+0000","last_undegraded":"2024-03-16T07:28:55.972015+0000","last_fullsized":"2024-03-16T07:28:55.972015+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:37:56.085909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.995631+0000","last_change":"2024-03-16T07:28:55.990536+0000","last_active":"2024-03-16T07:28:55.995631+0000","last_peered":"2024-03-16T07:28:55.995631+0000","last_clean":"2024-03-16T07:28:55.995631+0000","last_became_active":"2024-03-16T07:28:55.990314+0000","last_became_peered":"2024-03-16T07:28:55.990314+0000","last_unstale":"2024-03-16T07:28:55.995631+0000","last_undegraded":"2024-03-16T07:28:55.995631+0000","last_fullsized":"2024-03-16T07:28:55.995631+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_clean_scrub_stamp":"2024-03-16T07:28:54.963620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:14:03.009414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.975671+0000","last_change":"2024-03-16T07:28:41.583248+0000","last_active":"2024-03-16T07:28:55.975671+0000","last_peered":"2024-03-16T07:28:55.975671+0000","last_clean":"2024-03-16T07:28:55.975671+0000","last_became_active":"2024-03-16T07:28:41.582850+0000","last_became_peered":"2024-03-16T07:28:41.582850+0000","last_unstale":"2024-03-16T07:28:55.975671+0000","last_undegraded":"2024-03-16T07:28:55.975671+0000","last_fullsized":"2024-03-16T07:28:55.975671+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:22:34.129441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:56.008301+0000","last_change":"2024-03-16T07:28:56.005331+0000","last_active":"2024-03-16T07:28:56.008301+0000","last_peered":"2024-03-16T07:28:56.008301+0000","last_clean":"2024-03-16T07:28:56.008301+0000","last_became_active":"2024-03-16T07:28:56.004400+0000","last_became_peered":"2024-03-16T07:28:56.004400+0000","last_unstale":"2024-03-16T07:28:56.008301+0000","last_undegraded":"2024-03-16T07:28:56.008301+0000","last_fullsized":"2024-03-16T07:28:56.008301+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_clean_scrub_stamp":"2024-03-16T07:28:54.963620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:23:42.169905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.968321+0000","last_change":"2024-03-16T07:28:41.574835+0000","last_active":"2024-03-16T07:28:55.968321+0000","last_peered":"2024-03-16T07:28:55.968321+0000","last_clean":"2024-03-16T07:28:55.968321+0000","last_became_active":"2024-03-16T07:28:41.574293+0000","last_became_peered":"2024-03-16T07:28:41.574293+0000","last_unstale":"2024-03-16T07:28:55.968321+0000","last_undegraded":"2024-03-16T07:28:55.968321+0000","last_fullsized":"2024-03-16T07:28:55.968321+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:53:17.428726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.992903+0000","last_change":"2024-03-16T07:28:55.990866+0000","last_active":"2024-03-16T07:28:55.992903+0000","last_peered":"2024-03-16T07:28:55.992903+0000","last_clean":"2024-03-16T07:28:55.992903+0000","last_became_active":"2024-03-16T07:28:55.989884+0000","last_became_peered":"2024-03-16T07:28:55.989884+0000","last_unstale":"2024-03-16T07:28:55.992903+0000","last_undegraded":"2024-03-16T07:28:55.992903+0000","last_fullsized":"2024-03-16T07:28:55.992903+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_clean_scrub_stamp":"2024-03-16T07:28:54.963620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:49:10.718848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.969099+0000","last_change":"2024-03-16T07:28:41.577793+0000","last_active":"2024-03-16T07:28:55.969099+0000","last_peered":"2024-03-16T07:28:55.969099+0000","last_clean":"2024-03-16T07:28:55.969099+0000","last_became_active":"2024-03-16T07:28:41.577243+0000","last_became_peered":"2024-03-16T07:28:41.577243+0000","last_unstale":"2024-03-16T07:28:55.969099+0000","last_undegraded":"2024-03-16T07:28:55.969099+0000","last_fullsized":"2024-03-16T07:28:55.969099+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:56:37.671313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.997800+0000","last_change":"2024-03-16T07:28:55.991894+0000","last_active":"2024-03-16T07:28:55.997800+0000","last_peered":"2024-03-16T07:28:55.997800+0000","last_clean":"2024-03-16T07:28:55.997800+0000","last_became_active":"2024-03-16T07:28:55.991669+0000","last_became_peered":"2024-03-16T07:28:55.991669+0000","last_unstale":"2024-03-16T07:28:55.997800+0000","last_undegraded":"2024-03-16T07:28:55.997800+0000","last_fullsized":"2024-03-16T07:28:55.997800+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_clean_scrub_stamp":"2024-03-16T07:28:54.963620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:54:50.244190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"77'2","reported_seq":14,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:56.010362+0000","last_change":"2024-03-16T07:28:54.993398+0000","last_active":"2024-03-16T07:28:56.010362+0000","last_peered":"2024-03-16T07:28:56.010362+0000","last_clean":"2024-03-16T07:28:56.010362+0000","last_became_active":"2024-03-16T07:28:54.992833+0000","last_became_peered":"2024-03-16T07:28:54.992833+0000","last_unstale":"2024-03-16T07:28:56.010362+0000","last_undegraded":"2024-03-16T07:28:56.010362+0000","last_fullsized":"2024-03-16T07:28:56.010362+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:53.959780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:53.959780+0000","last_clean_scrub_stamp":"2024-03-16T07:28:53.959780+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:44:20.836034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.989560+0000","last_change":"2024-03-16T07:28:41.579444+0000","last_active":"2024-03-16T07:28:55.989560+0000","last_peered":"2024-03-16T07:28:55.989560+0000","last_clean":"2024-03-16T07:28:55.989560+0000","last_became_active":"2024-03-16T07:28:41.579180+0000","last_became_peered":"2024-03-16T07:28:41.579180+0000","last_unstale":"2024-03-16T07:28:55.989560+0000","last_undegraded":"2024-03-16T07:28:55.989560+0000","last_fullsized":"2024-03-16T07:28:55.989560+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:36:35.214743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"73'4","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.990895+0000","last_change":"2024-03-16T07:28:40.884571+0000","last_active":"2024-03-16T07:28:55.990895+0000","last_peered":"2024-03-16T07:28:55.990895+0000","last_clean":"2024-03-16T07:28:55.990895+0000","last_became_active":"2024-03-16T07:28:40.884044+0000","last_became_peered":"2024-03-16T07:28:40.884044+0000","last_unstale":"2024-03-16T07:28:55.990895+0000","last_undegraded":"2024-03-16T07:28:55.990895+0000","last_fullsized":"2024-03-16T07:28:55.990895+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_clean_scrub_stamp":"2024-03-16T07:28:39.861342+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:05:55.028514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:56.007916+0000","last_change":"2024-03-16T07:28:56.003358+0000","last_active":"2024-03-16T07:28:56.007916+0000","last_peered":"2024-03-16T07:28:56.007916+0000","last_clean":"2024-03-16T07:28:56.007916+0000","last_became_active":"2024-03-16T07:28:56.003140+0000","last_became_peered":"2024-03-16T07:28:56.003140+0000","last_unstale":"2024-03-16T07:28:56.007916+0000","last_undegraded":"2024-03-16T07:28:56.007916+0000","last_fullsized":"2024-03-16T07:28:56.007916+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_clean_scrub_stamp":"2024-03-16T07:28:54.963620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:44:32.924114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"77'2","reported_seq":14,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:56.007708+0000","last_change":"2024-03-16T07:28:54.989688+0000","last_active":"2024-03-16T07:28:56.007708+0000","last_peered":"2024-03-16T07:28:56.007708+0000","last_clean":"2024-03-16T07:28:56.007708+0000","last_became_active":"2024-03-16T07:28:54.988974+0000","last_became_peered":"2024-03-16T07:28:54.988974+0000","last_unstale":"2024-03-16T07:28:56.007708+0000","last_undegraded":"2024-03-16T07:28:56.007708+0000","last_fullsized":"2024-03-16T07:28:56.007708+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:53.959780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:53.959780+0000","last_clean_scrub_stamp":"2024-03-16T07:28:53.959780+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:07:18.788373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.974665+0000","last_change":"2024-03-16T07:28:41.584924+0000","last_active":"2024-03-16T07:28:55.974665+0000","last_peered":"2024-03-16T07:28:55.974665+0000","last_clean":"2024-03-16T07:28:55.974665+0000","last_became_active":"2024-03-16T07:28:41.583141+0000","last_became_peered":"2024-03-16T07:28:41.583141+0000","last_unstale":"2024-03-16T07:28:55.974665+0000","last_undegraded":"2024-03-16T07:28:55.974665+0000","last_fullsized":"2024-03-16T07:28:55.974665+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:05:51.922468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1e","version":"73'1","reported_seq":21,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.969795+0000","last_change":"2024-03-16T07:28:40.880780+0000","last_active":"2024-03-16T07:28:55.969795+0000","last_peered":"2024-03-16T07:28:55.969795+0000","last_clean":"2024-03-16T07:28:55.969795+0000","last_became_active":"2024-03-16T07:28:40.880529+0000","last_became_peered":"2024-03-16T07:28:40.880529+0000","last_unstale":"2024-03-16T07:28:55.969795+0000","last_undegraded":"2024-03-16T07:28:55.969795+0000","last_fullsized":"2024-03-16T07:28:55.969795+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_clean_scrub_stamp":"2024-03-16T07:28:39.861342+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:11:38.794188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.991181+0000","last_change":"2024-03-16T07:28:55.990416+0000","last_active":"2024-03-16T07:28:55.991181+0000","last_peered":"2024-03-16T07:28:55.991181+0000","last_clean":"2024-03-16T07:28:55.991181+0000","last_became_active":"2024-03-16T07:28:55.989035+0000","last_became_peered":"2024-03-16T07:28:55.989035+0000","last_unstale":"2024-03-16T07:28:55.991181+0000","last_undegraded":"2024-03-16T07:28:55.991181+0000","last_fullsized":"2024-03-16T07:28:55.991181+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_clean_scrub_stamp":"2024-03-16T07:28:54.963620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:28:33.174472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"77'4","reported_seq":16,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:56.010671+0000","last_change":"2024-03-16T07:28:54.986505+0000","last_active":"2024-03-16T07:28:56.010671+0000","last_peered":"2024-03-16T07:28:56.010671+0000","last_clean":"2024-03-16T07:28:56.010671+0000","last_became_active":"2024-03-16T07:28:54.986079+0000","last_became_peered":"2024-03-16T07:28:54.986079+0000","last_unstale":"2024-03-16T07:28:56.010671+0000","last_undegraded":"2024-03-16T07:28:56.010671+0000","last_fullsized":"2024-03-16T07:28:56.010671+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:53.959780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:53.959780+0000","last_clean_scrub_stamp":"2024-03-16T07:28:53.959780+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:24:56.292411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.986523+0000","last_change":"2024-03-16T07:28:41.587228+0000","last_active":"2024-03-16T07:28:55.986523+0000","last_peered":"2024-03-16T07:28:55.986523+0000","last_clean":"2024-03-16T07:28:55.986523+0000","last_became_active":"2024-03-16T07:28:41.586930+0000","last_became_peered":"2024-03-16T07:28:41.586930+0000","last_unstale":"2024-03-16T07:28:55.986523+0000","last_undegraded":"2024-03-16T07:28:55.986523+0000","last_fullsized":"2024-03-16T07:28:55.986523+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:09:13.097423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1d","version":"73'2","reported_seq":22,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.988293+0000","last_change":"2024-03-16T07:28:40.889280+0000","last_active":"2024-03-16T07:28:55.988293+0000","last_peered":"2024-03-16T07:28:55.988293+0000","last_clean":"2024-03-16T07:28:55.988293+0000","last_became_active":"2024-03-16T07:28:40.889014+0000","last_became_peered":"2024-03-16T07:28:40.889014+0000","last_unstale":"2024-03-16T07:28:55.988293+0000","last_undegraded":"2024-03-16T07:28:55.988293+0000","last_fullsized":"2024-03-16T07:28:55.988293+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_clean_scrub_stamp":"2024-03-16T07:28:39.861342+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:30:34.345858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.995390+0000","last_change":"2024-03-16T07:28:55.991102+0000","last_active":"2024-03-16T07:28:55.995390+0000","last_peered":"2024-03-16T07:28:55.995390+0000","last_clean":"2024-03-16T07:28:55.995390+0000","last_became_active":"2024-03-16T07:28:55.990869+0000","last_became_peered":"2024-03-16T07:28:55.990869+0000","last_unstale":"2024-03-16T07:28:55.995390+0000","last_undegraded":"2024-03-16T07:28:55.995390+0000","last_fullsized":"2024-03-16T07:28:55.995390+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_clean_scrub_stamp":"2024-03-16T07:28:54.963620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:12:36.583573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1e","version":"77'1","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:56.010613+0000","last_change":"2024-03-16T07:28:54.985456+0000","last_active":"2024-03-16T07:28:56.010613+0000","last_peered":"2024-03-16T07:28:56.010613+0000","last_clean":"2024-03-16T07:28:56.010613+0000","last_became_active":"2024-03-16T07:28:54.984861+0000","last_became_peered":"2024-03-16T07:28:54.984861+0000","last_unstale":"2024-03-16T07:28:56.010613+0000","last_undegraded":"2024-03-16T07:28:56.010613+0000","last_fullsized":"2024-03-16T07:28:56.010613+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:53.959780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:53.959780+0000","last_clean_scrub_stamp":"2024-03-16T07:28:53.959780+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:31:03.904867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.973772+0000","last_change":"2024-03-16T07:28:41.574130+0000","last_active":"2024-03-16T07:28:55.973772+0000","last_peered":"2024-03-16T07:28:55.973772+0000","last_clean":"2024-03-16T07:28:55.973772+0000","last_became_active":"2024-03-16T07:28:41.573863+0000","last_became_peered":"2024-03-16T07:28:41.573863+0000","last_unstale":"2024-03-16T07:28:55.973772+0000","last_undegraded":"2024-03-16T07:28:55.973772+0000","last_fullsized":"2024-03-16T07:28:55.973772+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:56:37.671313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1c","version":"73'2","reported_seq":22,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.986706+0000","last_change":"2024-03-16T07:28:40.890321+0000","last_active":"2024-03-16T07:28:55.986706+0000","last_peered":"2024-03-16T07:28:55.986706+0000","last_clean":"2024-03-16T07:28:55.986706+0000","last_became_active":"2024-03-16T07:28:40.888214+0000","last_became_peered":"2024-03-16T07:28:40.888214+0000","last_unstale":"2024-03-16T07:28:55.986706+0000","last_undegraded":"2024-03-16T07:28:55.986706+0000","last_fullsized":"2024-03-16T07:28:55.986706+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_clean_scrub_stamp":"2024-03-16T07:28:39.861342+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:59:34.630341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:56.008104+0000","last_change":"2024-03-16T07:28:56.002672+0000","last_active":"2024-03-16T07:28:56.008104+0000","last_peered":"2024-03-16T07:28:56.008104+0000","last_clean":"2024-03-16T07:28:56.008104+0000","last_became_active":"2024-03-16T07:28:55.997481+0000","last_became_peered":"2024-03-16T07:28:55.997481+0000","last_unstale":"2024-03-16T07:28:56.008104+0000","last_undegraded":"2024-03-16T07:28:56.008104+0000","last_fullsized":"2024-03-16T07:28:56.008104+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_clean_scrub_stamp":"2024-03-16T07:28:54.963620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:36:33.155947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":12,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.983183+0000","last_change":"2024-03-16T07:28:54.985516+0000","last_active":"2024-03-16T07:28:55.983183+0000","last_peered":"2024-03-16T07:28:55.983183+0000","last_clean":"2024-03-16T07:28:55.983183+0000","last_became_active":"2024-03-16T07:28:54.985118+0000","last_became_peered":"2024-03-16T07:28:54.985118+0000","last_unstale":"2024-03-16T07:28:55.983183+0000","last_undegraded":"2024-03-16T07:28:55.983183+0000","last_fullsized":"2024-03-16T07:28:55.983183+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:53.959780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:53.959780+0000","last_clean_scrub_stamp":"2024-03-16T07:28:53.959780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:17:21.262323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.975759+0000","last_change":"2024-03-16T07:28:41.583111+0000","last_active":"2024-03-16T07:28:55.975759+0000","last_peered":"2024-03-16T07:28:55.975759+0000","last_clean":"2024-03-16T07:28:55.975759+0000","last_became_active":"2024-03-16T07:28:41.582554+0000","last_became_peered":"2024-03-16T07:28:41.582554+0000","last_unstale":"2024-03-16T07:28:55.975759+0000","last_undegraded":"2024-03-16T07:28:55.975759+0000","last_fullsized":"2024-03-16T07:28:55.975759+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:30:35.704161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"73'1","reported_seq":21,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.986340+0000","last_change":"2024-03-16T07:28:40.884283+0000","last_active":"2024-03-16T07:28:55.986340+0000","last_peered":"2024-03-16T07:28:55.986340+0000","last_clean":"2024-03-16T07:28:55.986340+0000","last_became_active":"2024-03-16T07:28:40.884015+0000","last_became_peered":"2024-03-16T07:28:40.884015+0000","last_unstale":"2024-03-16T07:28:55.986340+0000","last_undegraded":"2024-03-16T07:28:55.986340+0000","last_fullsized":"2024-03-16T07:28:55.986340+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_clean_scrub_stamp":"2024-03-16T07:28:39.861342+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:27:57.241790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:56.005840+0000","last_change":"2024-03-16T07:28:56.000515+0000","last_active":"2024-03-16T07:28:56.005840+0000","last_peered":"2024-03-16T07:28:56.005840+0000","last_clean":"2024-03-16T07:28:56.005840+0000","last_became_active":"2024-03-16T07:28:55.992995+0000","last_became_peered":"2024-03-16T07:28:55.992995+0000","last_unstale":"2024-03-16T07:28:56.005840+0000","last_undegraded":"2024-03-16T07:28:56.005840+0000","last_fullsized":"2024-03-16T07:28:56.005840+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_clean_scrub_stamp":"2024-03-16T07:28:54.963620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:17:00.626133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":12,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.971757+0000","last_change":"2024-03-16T07:28:54.983484+0000","last_active":"2024-03-16T07:28:55.971757+0000","last_peered":"2024-03-16T07:28:55.971757+0000","last_clean":"2024-03-16T07:28:55.971757+0000","last_became_active":"2024-03-16T07:28:54.983181+0000","last_became_peered":"2024-03-16T07:28:54.983181+0000","last_unstale":"2024-03-16T07:28:55.971757+0000","last_undegraded":"2024-03-16T07:28:55.971757+0000","last_fullsized":"2024-03-16T07:28:55.971757+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:53.959780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:53.959780+0000","last_clean_scrub_stamp":"2024-03-16T07:28:53.959780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:27:32.183748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.976815+0000","last_change":"2024-03-16T07:28:41.573219+0000","last_active":"2024-03-16T07:28:55.976815+0000","last_peered":"2024-03-16T07:28:55.976815+0000","last_clean":"2024-03-16T07:28:55.976815+0000","last_became_active":"2024-03-16T07:28:41.572483+0000","last_became_peered":"2024-03-16T07:28:41.572483+0000","last_unstale":"2024-03-16T07:28:55.976815+0000","last_undegraded":"2024-03-16T07:28:55.976815+0000","last_fullsized":"2024-03-16T07:28:55.976815+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:44:37.453210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.1a","version":"73'1","reported_seq":21,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.975295+0000","last_change":"2024-03-16T07:28:40.878927+0000","last_active":"2024-03-16T07:28:55.975295+0000","last_peered":"2024-03-16T07:28:55.975295+0000","last_clean":"2024-03-16T07:28:55.975295+0000","last_became_active":"2024-03-16T07:28:40.878669+0000","last_became_peered":"2024-03-16T07:28:40.878669+0000","last_unstale":"2024-03-16T07:28:55.975295+0000","last_undegraded":"2024-03-16T07:28:55.975295+0000","last_fullsized":"2024-03-16T07:28:55.975295+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_clean_scrub_stamp":"2024-03-16T07:28:39.861342+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:51:58.338500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.995036+0000","last_change":"2024-03-16T07:28:55.989524+0000","last_active":"2024-03-16T07:28:55.995036+0000","last_peered":"2024-03-16T07:28:55.995036+0000","last_clean":"2024-03-16T07:28:55.995036+0000","last_became_active":"2024-03-16T07:28:55.989299+0000","last_became_peered":"2024-03-16T07:28:55.989299+0000","last_unstale":"2024-03-16T07:28:55.995036+0000","last_undegraded":"2024-03-16T07:28:55.995036+0000","last_fullsized":"2024-03-16T07:28:55.995036+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_clean_scrub_stamp":"2024-03-16T07:28:54.963620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:52:21.424117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1b","version":"77'1","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:56.001646+0000","last_change":"2024-03-16T07:28:54.987010+0000","last_active":"2024-03-16T07:28:56.001646+0000","last_peered":"2024-03-16T07:28:56.001646+0000","last_clean":"2024-03-16T07:28:56.001646+0000","last_became_active":"2024-03-16T07:28:54.986762+0000","last_became_peered":"2024-03-16T07:28:54.986762+0000","last_unstale":"2024-03-16T07:28:56.001646+0000","last_undegraded":"2024-03-16T07:28:56.001646+0000","last_fullsized":"2024-03-16T07:28:56.001646+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:53.959780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:53.959780+0000","last_clean_scrub_stamp":"2024-03-16T07:28:53.959780+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:59:48.728779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.971939+0000","last_change":"2024-03-16T07:28:41.585134+0000","last_active":"2024-03-16T07:28:55.971939+0000","last_peered":"2024-03-16T07:28:55.971939+0000","last_clean":"2024-03-16T07:28:55.971939+0000","last_became_active":"2024-03-16T07:28:41.584887+0000","last_became_peered":"2024-03-16T07:28:41.584887+0000","last_unstale":"2024-03-16T07:28:55.971939+0000","last_undegraded":"2024-03-16T07:28:55.971939+0000","last_fullsized":"2024-03-16T07:28:55.971939+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:31:17.966399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":20,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.983711+0000","last_change":"2024-03-16T07:28:40.890932+0000","last_active":"2024-03-16T07:28:55.983711+0000","last_peered":"2024-03-16T07:28:55.983711+0000","last_clean":"2024-03-16T07:28:55.983711+0000","last_became_active":"2024-03-16T07:28:40.890340+0000","last_became_peered":"2024-03-16T07:28:40.890340+0000","last_unstale":"2024-03-16T07:28:55.983711+0000","last_undegraded":"2024-03-16T07:28:55.983711+0000","last_fullsized":"2024-03-16T07:28:55.983711+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_clean_scrub_stamp":"2024-03-16T07:28:39.861342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:54:35.284150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:56.004074+0000","last_change":"2024-03-16T07:28:55.999675+0000","last_active":"2024-03-16T07:28:56.004074+0000","last_peered":"2024-03-16T07:28:56.004074+0000","last_clean":"2024-03-16T07:28:56.004074+0000","last_became_active":"2024-03-16T07:28:55.999365+0000","last_became_peered":"2024-03-16T07:28:55.999365+0000","last_unstale":"2024-03-16T07:28:56.004074+0000","last_undegraded":"2024-03-16T07:28:56.004074+0000","last_fullsized":"2024-03-16T07:28:56.004074+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_clean_scrub_stamp":"2024-03-16T07:28:54.963620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:10:54.130248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1a","version":"77'1","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:56.005257+0000","last_change":"2024-03-16T07:28:54.985591+0000","last_active":"2024-03-16T07:28:56.005257+0000","last_peered":"2024-03-16T07:28:56.005257+0000","last_clean":"2024-03-16T07:28:56.005257+0000","last_became_active":"2024-03-16T07:28:54.984750+0000","last_became_peered":"2024-03-16T07:28:54.984750+0000","last_unstale":"2024-03-16T07:28:56.005257+0000","last_undegraded":"2024-03-16T07:28:56.005257+0000","last_fullsized":"2024-03-16T07:28:56.005257+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:53.959780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:53.959780+0000","last_clean_scrub_stamp":"2024-03-16T07:28:53.959780+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:56:05.105114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.968405+0000","last_change":"2024-03-16T07:28:41.577102+0000","last_active":"2024-03-16T07:28:55.968405+0000","last_peered":"2024-03-16T07:28:55.968405+0000","last_clean":"2024-03-16T07:28:55.968405+0000","last_became_active":"2024-03-16T07:28:41.576845+0000","last_became_peered":"2024-03-16T07:28:41.576845+0000","last_unstale":"2024-03-16T07:28:55.968405+0000","last_undegraded":"2024-03-16T07:28:55.968405+0000","last_fullsized":"2024-03-16T07:28:55.968405+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:30:35.346827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":20,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.972335+0000","last_change":"2024-03-16T07:28:40.883138+0000","last_active":"2024-03-16T07:28:55.972335+0000","last_peered":"2024-03-16T07:28:55.972335+0000","last_clean":"2024-03-16T07:28:55.972335+0000","last_became_active":"2024-03-16T07:28:40.882873+0000","last_became_peered":"2024-03-16T07:28:40.882873+0000","last_unstale":"2024-03-16T07:28:55.972335+0000","last_undegraded":"2024-03-16T07:28:55.972335+0000","last_fullsized":"2024-03-16T07:28:55.972335+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_clean_scrub_stamp":"2024-03-16T07:28:39.861342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:50:03.695566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:56.000131+0000","last_change":"2024-03-16T07:28:55.996492+0000","last_active":"2024-03-16T07:28:56.000131+0000","last_peered":"2024-03-16T07:28:56.000131+0000","last_clean":"2024-03-16T07:28:56.000131+0000","last_became_active":"2024-03-16T07:28:55.996056+0000","last_became_peered":"2024-03-16T07:28:55.996056+0000","last_unstale":"2024-03-16T07:28:56.000131+0000","last_undegraded":"2024-03-16T07:28:56.000131+0000","last_fullsized":"2024-03-16T07:28:56.000131+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_clean_scrub_stamp":"2024-03-16T07:28:54.963620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:07:44.085051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.15","version":"77'3","reported_seq":15,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:56.007326+0000","last_change":"2024-03-16T07:28:54.980899+0000","last_active":"2024-03-16T07:28:56.007326+0000","last_peered":"2024-03-16T07:28:56.007326+0000","last_clean":"2024-03-16T07:28:56.007326+0000","last_became_active":"2024-03-16T07:28:54.980524+0000","last_became_peered":"2024-03-16T07:28:54.980524+0000","last_unstale":"2024-03-16T07:28:56.007326+0000","last_undegraded":"2024-03-16T07:28:56.007326+0000","last_fullsized":"2024-03-16T07:28:56.007326+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:53.959780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:53.959780+0000","last_clean_scrub_stamp":"2024-03-16T07:28:53.959780+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:33:08.325174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.989661+0000","last_change":"2024-03-16T07:28:41.586728+0000","last_active":"2024-03-16T07:28:55.989661+0000","last_peered":"2024-03-16T07:28:55.989661+0000","last_clean":"2024-03-16T07:28:55.989661+0000","last_became_active":"2024-03-16T07:28:41.586429+0000","last_became_peered":"2024-03-16T07:28:41.586429+0000","last_unstale":"2024-03-16T07:28:55.989661+0000","last_undegraded":"2024-03-16T07:28:55.989661+0000","last_fullsized":"2024-03-16T07:28:55.989661+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:07:29.983742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":20,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.977762+0000","last_change":"2024-03-16T07:28:40.887890+0000","last_active":"2024-03-16T07:28:55.977762+0000","last_peered":"2024-03-16T07:28:55.977762+0000","last_clean":"2024-03-16T07:28:55.977762+0000","last_became_active":"2024-03-16T07:28:40.887271+0000","last_became_peered":"2024-03-16T07:28:40.887271+0000","last_unstale":"2024-03-16T07:28:55.977762+0000","last_undegraded":"2024-03-16T07:28:55.977762+0000","last_fullsized":"2024-03-16T07:28:55.977762+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_clean_scrub_stamp":"2024-03-16T07:28:39.861342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:57:30.494001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:56.002762+0000","last_change":"2024-03-16T07:28:56.000652+0000","last_active":"2024-03-16T07:28:56.002762+0000","last_peered":"2024-03-16T07:28:56.002762+0000","last_clean":"2024-03-16T07:28:56.002762+0000","last_became_active":"2024-03-16T07:28:56.000413+0000","last_became_peered":"2024-03-16T07:28:56.000413+0000","last_unstale":"2024-03-16T07:28:56.002762+0000","last_undegraded":"2024-03-16T07:28:56.002762+0000","last_fullsized":"2024-03-16T07:28:56.002762+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_clean_scrub_stamp":"2024-03-16T07:28:54.963620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:33:01.073896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.14","version":"77'6","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:56.010819+0000","last_change":"2024-03-16T07:28:54.989985+0000","last_active":"2024-03-16T07:28:56.010819+0000","last_peered":"2024-03-16T07:28:56.010819+0000","last_clean":"2024-03-16T07:28:56.010819+0000","last_became_active":"2024-03-16T07:28:54.989760+0000","last_became_peered":"2024-03-16T07:28:54.989760+0000","last_unstale":"2024-03-16T07:28:56.010819+0000","last_undegraded":"2024-03-16T07:28:56.010819+0000","last_fullsized":"2024-03-16T07:28:56.010819+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:53.959780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:53.959780+0000","last_clean_scrub_stamp":"2024-03-16T07:28:53.959780+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:55:47.669989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.974760+0000","last_change":"2024-03-16T07:28:41.584498+0000","last_active":"2024-03-16T07:28:55.974760+0000","last_peered":"2024-03-16T07:28:55.974760+0000","last_clean":"2024-03-16T07:28:55.974760+0000","last_became_active":"2024-03-16T07:28:41.581697+0000","last_became_peered":"2024-03-16T07:28:41.581697+0000","last_unstale":"2024-03-16T07:28:55.974760+0000","last_undegraded":"2024-03-16T07:28:55.974760+0000","last_fullsized":"2024-03-16T07:28:55.974760+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:14:32.345113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":20,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.969802+0000","last_change":"2024-03-16T07:28:40.886362+0000","last_active":"2024-03-16T07:28:55.969802+0000","last_peered":"2024-03-16T07:28:55.969802+0000","last_clean":"2024-03-16T07:28:55.969802+0000","last_became_active":"2024-03-16T07:28:40.886129+0000","last_became_peered":"2024-03-16T07:28:40.886129+0000","last_unstale":"2024-03-16T07:28:55.969802+0000","last_undegraded":"2024-03-16T07:28:55.969802+0000","last_fullsized":"2024-03-16T07:28:55.969802+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_clean_scrub_stamp":"2024-03-16T07:28:39.861342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:42:48.723986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:56.008238+0000","last_change":"2024-03-16T07:28:56.004381+0000","last_active":"2024-03-16T07:28:56.008238+0000","last_peered":"2024-03-16T07:28:56.008238+0000","last_clean":"2024-03-16T07:28:56.008238+0000","last_became_active":"2024-03-16T07:28:56.004130+0000","last_became_peered":"2024-03-16T07:28:56.004130+0000","last_unstale":"2024-03-16T07:28:56.008238+0000","last_undegraded":"2024-03-16T07:28:56.008238+0000","last_fullsized":"2024-03-16T07:28:56.008238+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_clean_scrub_stamp":"2024-03-16T07:28:54.963620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:56:31.024591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":12,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.974031+0000","last_change":"2024-03-16T07:28:54.986400+0000","last_active":"2024-03-16T07:28:55.974031+0000","last_peered":"2024-03-16T07:28:55.974031+0000","last_clean":"2024-03-16T07:28:55.974031+0000","last_became_active":"2024-03-16T07:28:54.986162+0000","last_became_peered":"2024-03-16T07:28:54.986162+0000","last_unstale":"2024-03-16T07:28:55.974031+0000","last_undegraded":"2024-03-16T07:28:55.974031+0000","last_fullsized":"2024-03-16T07:28:55.974031+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:53.959780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:53.959780+0000","last_clean_scrub_stamp":"2024-03-16T07:28:53.959780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:14:23.739094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.986597+0000","last_change":"2024-03-16T07:28:41.587165+0000","last_active":"2024-03-16T07:28:55.986597+0000","last_peered":"2024-03-16T07:28:55.986597+0000","last_clean":"2024-03-16T07:28:55.986597+0000","last_became_active":"2024-03-16T07:28:41.586578+0000","last_became_peered":"2024-03-16T07:28:41.586578+0000","last_unstale":"2024-03-16T07:28:55.986597+0000","last_undegraded":"2024-03-16T07:28:55.986597+0000","last_fullsized":"2024-03-16T07:28:55.986597+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:05:42.909993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"73'3","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.973808+0000","last_change":"2024-03-16T07:28:40.885939+0000","last_active":"2024-03-16T07:28:55.973808+0000","last_peered":"2024-03-16T07:28:55.973808+0000","last_clean":"2024-03-16T07:28:55.973808+0000","last_became_active":"2024-03-16T07:28:40.885668+0000","last_became_peered":"2024-03-16T07:28:40.885668+0000","last_unstale":"2024-03-16T07:28:55.973808+0000","last_undegraded":"2024-03-16T07:28:55.973808+0000","last_fullsized":"2024-03-16T07:28:55.973808+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_clean_scrub_stamp":"2024-03-16T07:28:39.861342+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:33:05.728451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.995047+0000","last_change":"2024-03-16T07:28:55.992143+0000","last_active":"2024-03-16T07:28:55.995047+0000","last_peered":"2024-03-16T07:28:55.995047+0000","last_clean":"2024-03-16T07:28:55.995047+0000","last_became_active":"2024-03-16T07:28:55.991539+0000","last_became_peered":"2024-03-16T07:28:55.991539+0000","last_unstale":"2024-03-16T07:28:55.995047+0000","last_undegraded":"2024-03-16T07:28:55.995047+0000","last_fullsized":"2024-03-16T07:28:55.995047+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_clean_scrub_stamp":"2024-03-16T07:28:54.963620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:51:05.203345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":12,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.972252+0000","last_change":"2024-03-16T07:28:54.986722+0000","last_active":"2024-03-16T07:28:55.972252+0000","last_peered":"2024-03-16T07:28:55.972252+0000","last_clean":"2024-03-16T07:28:55.972252+0000","last_became_active":"2024-03-16T07:28:54.983682+0000","last_became_peered":"2024-03-16T07:28:54.983682+0000","last_unstale":"2024-03-16T07:28:55.972252+0000","last_undegraded":"2024-03-16T07:28:55.972252+0000","last_fullsized":"2024-03-16T07:28:55.972252+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:53.959780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:53.959780+0000","last_clean_scrub_stamp":"2024-03-16T07:28:53.959780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:26:17.906430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.974412+0000","last_change":"2024-03-16T07:28:41.574377+0000","last_active":"2024-03-16T07:28:55.974412+0000","last_peered":"2024-03-16T07:28:55.974412+0000","last_clean":"2024-03-16T07:28:55.974412+0000","last_became_active":"2024-03-16T07:28:41.572757+0000","last_became_peered":"2024-03-16T07:28:41.572757+0000","last_unstale":"2024-03-16T07:28:55.974412+0000","last_undegraded":"2024-03-16T07:28:55.974412+0000","last_fullsized":"2024-03-16T07:28:55.974412+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:35:53.161968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.14","version":"74'8","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.986744+0000","last_change":"2024-03-16T07:28:40.890793+0000","last_active":"2024-03-16T07:28:55.986744+0000","last_peered":"2024-03-16T07:28:55.986744+0000","last_clean":"2024-03-16T07:28:55.986744+0000","last_became_active":"2024-03-16T07:28:40.889033+0000","last_became_peered":"2024-03-16T07:28:40.889033+0000","last_unstale":"2024-03-16T07:28:55.986744+0000","last_undegraded":"2024-03-16T07:28:55.986744+0000","last_fullsized":"2024-03-16T07:28:55.986744+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_clean_scrub_stamp":"2024-03-16T07:28:39.861342+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:25:23.243480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3309,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:56.008085+0000","last_change":"2024-03-16T07:28:56.002562+0000","last_active":"2024-03-16T07:28:56.008085+0000","last_peered":"2024-03-16T07:28:56.008085+0000","last_clean":"2024-03-16T07:28:56.008085+0000","last_became_active":"2024-03-16T07:28:55.996288+0000","last_became_peered":"2024-03-16T07:28:55.996288+0000","last_unstale":"2024-03-16T07:28:56.008085+0000","last_undegraded":"2024-03-16T07:28:56.008085+0000","last_fullsized":"2024-03-16T07:28:56.008085+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_clean_scrub_stamp":"2024-03-16T07:28:54.963620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:39:41.775481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":12,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.974496+0000","last_change":"2024-03-16T07:28:54.983440+0000","last_active":"2024-03-16T07:28:55.974496+0000","last_peered":"2024-03-16T07:28:55.974496+0000","last_clean":"2024-03-16T07:28:55.974496+0000","last_became_active":"2024-03-16T07:28:54.983117+0000","last_became_peered":"2024-03-16T07:28:54.983117+0000","last_unstale":"2024-03-16T07:28:55.974496+0000","last_undegraded":"2024-03-16T07:28:55.974496+0000","last_fullsized":"2024-03-16T07:28:55.974496+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:53.959780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:53.959780+0000","last_clean_scrub_stamp":"2024-03-16T07:28:53.959780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:57:35.296521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.983336+0000","last_change":"2024-03-16T07:28:41.576721+0000","last_active":"2024-03-16T07:28:55.983336+0000","last_peered":"2024-03-16T07:28:55.983336+0000","last_clean":"2024-03-16T07:28:55.983336+0000","last_became_active":"2024-03-16T07:28:41.576367+0000","last_became_peered":"2024-03-16T07:28:41.576367+0000","last_unstale":"2024-03-16T07:28:55.983336+0000","last_undegraded":"2024-03-16T07:28:55.983336+0000","last_fullsized":"2024-03-16T07:28:55.983336+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:31:51.310053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"73'2","reported_seq":22,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.972108+0000","last_change":"2024-03-16T07:28:40.883154+0000","last_active":"2024-03-16T07:28:55.972108+0000","last_peered":"2024-03-16T07:28:55.972108+0000","last_clean":"2024-03-16T07:28:55.972108+0000","last_became_active":"2024-03-16T07:28:40.882887+0000","last_became_peered":"2024-03-16T07:28:40.882887+0000","last_unstale":"2024-03-16T07:28:55.972108+0000","last_undegraded":"2024-03-16T07:28:55.972108+0000","last_fullsized":"2024-03-16T07:28:55.972108+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_clean_scrub_stamp":"2024-03-16T07:28:39.861342+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:40:18.964304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.998859+0000","last_change":"2024-03-16T07:28:55.995479+0000","last_active":"2024-03-16T07:28:55.998859+0000","last_peered":"2024-03-16T07:28:55.998859+0000","last_clean":"2024-03-16T07:28:55.998859+0000","last_became_active":"2024-03-16T07:28:55.995250+0000","last_became_peered":"2024-03-16T07:28:55.995250+0000","last_unstale":"2024-03-16T07:28:55.998859+0000","last_undegraded":"2024-03-16T07:28:55.998859+0000","last_fullsized":"2024-03-16T07:28:55.998859+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_clean_scrub_stamp":"2024-03-16T07:28:54.963620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:09:27.198732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"77'8","reported_seq":20,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:56.010954+0000","last_change":"2024-03-16T07:28:54.984419+0000","last_active":"2024-03-16T07:28:56.010954+0000","last_peered":"2024-03-16T07:28:56.010954+0000","last_clean":"2024-03-16T07:28:56.010954+0000","last_became_active":"2024-03-16T07:28:54.984175+0000","last_became_peered":"2024-03-16T07:28:54.984175+0000","last_unstale":"2024-03-16T07:28:56.010954+0000","last_undegraded":"2024-03-16T07:28:56.010954+0000","last_fullsized":"2024-03-16T07:28:56.010954+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:53.959780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:53.959780+0000","last_clean_scrub_stamp":"2024-03-16T07:28:53.959780+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:43:35.888243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.972064+0000","last_change":"2024-03-16T07:28:41.584733+0000","last_active":"2024-03-16T07:28:55.972064+0000","last_peered":"2024-03-16T07:28:55.972064+0000","last_clean":"2024-03-16T07:28:55.972064+0000","last_became_active":"2024-03-16T07:28:41.584482+0000","last_became_peered":"2024-03-16T07:28:41.584482+0000","last_unstale":"2024-03-16T07:28:55.972064+0000","last_undegraded":"2024-03-16T07:28:55.972064+0000","last_fullsized":"2024-03-16T07:28:55.972064+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:51:02.351017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":20,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.983633+0000","last_change":"2024-03-16T07:28:40.884089+0000","last_active":"2024-03-16T07:28:55.983633+0000","last_peered":"2024-03-16T07:28:55.983633+0000","last_clean":"2024-03-16T07:28:55.983633+0000","last_became_active":"2024-03-16T07:28:40.883831+0000","last_became_peered":"2024-03-16T07:28:40.883831+0000","last_unstale":"2024-03-16T07:28:55.983633+0000","last_undegraded":"2024-03-16T07:28:55.983633+0000","last_fullsized":"2024-03-16T07:28:55.983633+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_clean_scrub_stamp":"2024-03-16T07:28:39.861342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:44:36.452241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.994293+0000","last_change":"2024-03-16T07:28:55.990684+0000","last_active":"2024-03-16T07:28:55.994293+0000","last_peered":"2024-03-16T07:28:55.994293+0000","last_clean":"2024-03-16T07:28:55.994293+0000","last_became_active":"2024-03-16T07:28:55.990443+0000","last_became_peered":"2024-03-16T07:28:55.990443+0000","last_unstale":"2024-03-16T07:28:55.994293+0000","last_undegraded":"2024-03-16T07:28:55.994293+0000","last_fullsized":"2024-03-16T07:28:55.994293+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_clean_scrub_stamp":"2024-03-16T07:28:54.963620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:30:46.990190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.13","version":"77'2","reported_seq":14,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.990626+0000","last_change":"2024-03-16T07:28:54.991538+0000","last_active":"2024-03-16T07:28:55.990626+0000","last_peered":"2024-03-16T07:28:55.990626+0000","last_clean":"2024-03-16T07:28:55.990626+0000","last_became_active":"2024-03-16T07:28:54.991297+0000","last_became_peered":"2024-03-16T07:28:54.991297+0000","last_unstale":"2024-03-16T07:28:55.990626+0000","last_undegraded":"2024-03-16T07:28:55.990626+0000","last_fullsized":"2024-03-16T07:28:55.990626+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:53.959780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:53.959780+0000","last_clean_scrub_stamp":"2024-03-16T07:28:53.959780+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:01:05.134156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.972132+0000","last_change":"2024-03-16T07:28:41.584450+0000","last_active":"2024-03-16T07:28:55.972132+0000","last_peered":"2024-03-16T07:28:55.972132+0000","last_clean":"2024-03-16T07:28:55.972132+0000","last_became_active":"2024-03-16T07:28:41.583048+0000","last_became_peered":"2024-03-16T07:28:41.583048+0000","last_unstale":"2024-03-16T07:28:55.972132+0000","last_undegraded":"2024-03-16T07:28:55.972132+0000","last_fullsized":"2024-03-16T07:28:55.972132+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:59:28.713162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":20,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.968489+0000","last_change":"2024-03-16T07:28:40.880394+0000","last_active":"2024-03-16T07:28:55.968489+0000","last_peered":"2024-03-16T07:28:55.968489+0000","last_clean":"2024-03-16T07:28:55.968489+0000","last_became_active":"2024-03-16T07:28:40.880131+0000","last_became_peered":"2024-03-16T07:28:40.880131+0000","last_unstale":"2024-03-16T07:28:55.968489+0000","last_undegraded":"2024-03-16T07:28:55.968489+0000","last_fullsized":"2024-03-16T07:28:55.968489+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_clean_scrub_stamp":"2024-03-16T07:28:39.861342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:14:40.328662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.999935+0000","last_change":"2024-03-16T07:28:55.994956+0000","last_active":"2024-03-16T07:28:55.999935+0000","last_peered":"2024-03-16T07:28:55.999935+0000","last_clean":"2024-03-16T07:28:55.999935+0000","last_became_active":"2024-03-16T07:28:55.993167+0000","last_became_peered":"2024-03-16T07:28:55.993167+0000","last_unstale":"2024-03-16T07:28:55.999935+0000","last_undegraded":"2024-03-16T07:28:55.999935+0000","last_fullsized":"2024-03-16T07:28:55.999935+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_clean_scrub_stamp":"2024-03-16T07:28:54.963620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:32:05.411362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":12,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.970461+0000","last_change":"2024-03-16T07:28:54.992335+0000","last_active":"2024-03-16T07:28:55.970461+0000","last_peered":"2024-03-16T07:28:55.970461+0000","last_clean":"2024-03-16T07:28:55.970461+0000","last_became_active":"2024-03-16T07:28:54.992104+0000","last_became_peered":"2024-03-16T07:28:54.992104+0000","last_unstale":"2024-03-16T07:28:55.970461+0000","last_undegraded":"2024-03-16T07:28:55.970461+0000","last_fullsized":"2024-03-16T07:28:55.970461+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:53.959780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:53.959780+0000","last_clean_scrub_stamp":"2024-03-16T07:28:53.959780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:28:10.522791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.974645+0000","last_change":"2024-03-16T07:28:41.584622+0000","last_active":"2024-03-16T07:28:55.974645+0000","last_peered":"2024-03-16T07:28:55.974645+0000","last_clean":"2024-03-16T07:28:55.974645+0000","last_became_active":"2024-03-16T07:28:41.583267+0000","last_became_peered":"2024-03-16T07:28:41.583267+0000","last_unstale":"2024-03-16T07:28:55.974645+0000","last_undegraded":"2024-03-16T07:28:55.974645+0000","last_fullsized":"2024-03-16T07:28:55.974645+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:09:05.453250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"73'8","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.984229+0000","last_change":"2024-03-16T07:28:40.891056+0000","last_active":"2024-03-16T07:28:55.984229+0000","last_peered":"2024-03-16T07:28:55.984229+0000","last_clean":"2024-03-16T07:28:55.984229+0000","last_became_active":"2024-03-16T07:28:40.890632+0000","last_became_peered":"2024-03-16T07:28:40.890632+0000","last_unstale":"2024-03-16T07:28:55.984229+0000","last_undegraded":"2024-03-16T07:28:55.984229+0000","last_fullsized":"2024-03-16T07:28:55.984229+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_clean_scrub_stamp":"2024-03-16T07:28:39.861342+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:24:57.129852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:56.000111+0000","last_change":"2024-03-16T07:28:55.996301+0000","last_active":"2024-03-16T07:28:56.000111+0000","last_peered":"2024-03-16T07:28:56.000111+0000","last_clean":"2024-03-16T07:28:56.000111+0000","last_became_active":"2024-03-16T07:28:55.995466+0000","last_became_peered":"2024-03-16T07:28:55.995466+0000","last_unstale":"2024-03-16T07:28:56.000111+0000","last_undegraded":"2024-03-16T07:28:56.000111+0000","last_fullsized":"2024-03-16T07:28:56.000111+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_clean_scrub_stamp":"2024-03-16T07:28:54.963620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:05:57.011302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.d","version":"77'1","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:56.005989+0000","last_change":"2024-03-16T07:28:54.993260+0000","last_active":"2024-03-16T07:28:56.005989+0000","last_peered":"2024-03-16T07:28:56.005989+0000","last_clean":"2024-03-16T07:28:56.005989+0000","last_became_active":"2024-03-16T07:28:54.992508+0000","last_became_peered":"2024-03-16T07:28:54.992508+0000","last_unstale":"2024-03-16T07:28:56.005989+0000","last_undegraded":"2024-03-16T07:28:56.005989+0000","last_fullsized":"2024-03-16T07:28:56.005989+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:53.959780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:53.959780+0000","last_clean_scrub_stamp":"2024-03-16T07:28:53.959780+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:30:54.241488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.989746+0000","last_change":"2024-03-16T07:28:41.577118+0000","last_active":"2024-03-16T07:28:55.989746+0000","last_peered":"2024-03-16T07:28:55.989746+0000","last_clean":"2024-03-16T07:28:55.989746+0000","last_became_active":"2024-03-16T07:28:41.576870+0000","last_became_peered":"2024-03-16T07:28:41.576870+0000","last_unstale":"2024-03-16T07:28:55.989746+0000","last_undegraded":"2024-03-16T07:28:55.989746+0000","last_fullsized":"2024-03-16T07:28:55.989746+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:07:51.321412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.f","version":"73'1","reported_seq":21,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.990944+0000","last_change":"2024-03-16T07:28:40.884362+0000","last_active":"2024-03-16T07:28:55.990944+0000","last_peered":"2024-03-16T07:28:55.990944+0000","last_clean":"2024-03-16T07:28:55.990944+0000","last_became_active":"2024-03-16T07:28:40.883691+0000","last_became_peered":"2024-03-16T07:28:40.883691+0000","last_unstale":"2024-03-16T07:28:55.990944+0000","last_undegraded":"2024-03-16T07:28:55.990944+0000","last_fullsized":"2024-03-16T07:28:55.990944+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_clean_scrub_stamp":"2024-03-16T07:28:39.861342+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:45:07.242723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:56.000181+0000","last_change":"2024-03-16T07:28:55.997566+0000","last_active":"2024-03-16T07:28:56.000181+0000","last_peered":"2024-03-16T07:28:56.000181+0000","last_clean":"2024-03-16T07:28:56.000181+0000","last_became_active":"2024-03-16T07:28:55.996973+0000","last_became_peered":"2024-03-16T07:28:55.996973+0000","last_unstale":"2024-03-16T07:28:56.000181+0000","last_undegraded":"2024-03-16T07:28:56.000181+0000","last_fullsized":"2024-03-16T07:28:56.000181+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_clean_scrub_stamp":"2024-03-16T07:28:54.963620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:38:21.923182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":12,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.986247+0000","last_change":"2024-03-16T07:28:54.992978+0000","last_active":"2024-03-16T07:28:55.986247+0000","last_peered":"2024-03-16T07:28:55.986247+0000","last_clean":"2024-03-16T07:28:55.986247+0000","last_became_active":"2024-03-16T07:28:54.992712+0000","last_became_peered":"2024-03-16T07:28:54.992712+0000","last_unstale":"2024-03-16T07:28:55.986247+0000","last_undegraded":"2024-03-16T07:28:55.986247+0000","last_fullsized":"2024-03-16T07:28:55.986247+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:53.959780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:53.959780+0000","last_clean_scrub_stamp":"2024-03-16T07:28:53.959780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:52:05.120058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.969533+0000","last_change":"2024-03-16T07:28:41.571334+0000","last_active":"2024-03-16T07:28:55.969533+0000","last_peered":"2024-03-16T07:28:55.969533+0000","last_clean":"2024-03-16T07:28:55.969533+0000","last_became_active":"2024-03-16T07:28:41.571041+0000","last_became_peered":"2024-03-16T07:28:41.571041+0000","last_unstale":"2024-03-16T07:28:55.969533+0000","last_undegraded":"2024-03-16T07:28:55.969533+0000","last_fullsized":"2024-03-16T07:28:55.969533+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:03:02.755723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.e","version":"73'2","reported_seq":22,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.990046+0000","last_change":"2024-03-16T07:28:40.889189+0000","last_active":"2024-03-16T07:28:55.990046+0000","last_peered":"2024-03-16T07:28:55.990046+0000","last_clean":"2024-03-16T07:28:55.990046+0000","last_became_active":"2024-03-16T07:28:40.886103+0000","last_became_peered":"2024-03-16T07:28:40.886103+0000","last_unstale":"2024-03-16T07:28:55.990046+0000","last_undegraded":"2024-03-16T07:28:55.990046+0000","last_fullsized":"2024-03-16T07:28:55.990046+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_clean_scrub_stamp":"2024-03-16T07:28:39.861342+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:03:01.754754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.987237+0000","last_change":"2024-03-16T07:28:55.986083+0000","last_active":"2024-03-16T07:28:55.987237+0000","last_peered":"2024-03-16T07:28:55.987237+0000","last_clean":"2024-03-16T07:28:55.987237+0000","last_became_active":"2024-03-16T07:28:55.985846+0000","last_became_peered":"2024-03-16T07:28:55.985846+0000","last_unstale":"2024-03-16T07:28:55.987237+0000","last_undegraded":"2024-03-16T07:28:55.987237+0000","last_fullsized":"2024-03-16T07:28:55.987237+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_clean_scrub_stamp":"2024-03-16T07:28:54.963620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:14:03.009414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.e","version":"77'2","reported_seq":14,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:56.001446+0000","last_change":"2024-03-16T07:28:54.989085+0000","last_active":"2024-03-16T07:28:56.001446+0000","last_peered":"2024-03-16T07:28:56.001446+0000","last_clean":"2024-03-16T07:28:56.001446+0000","last_became_active":"2024-03-16T07:28:54.988834+0000","last_became_peered":"2024-03-16T07:28:54.988834+0000","last_unstale":"2024-03-16T07:28:56.001446+0000","last_undegraded":"2024-03-16T07:28:56.001446+0000","last_fullsized":"2024-03-16T07:28:56.001446+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:53.959780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:53.959780+0000","last_clean_scrub_stamp":"2024-03-16T07:28:53.959780+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:49:56.583251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.988239+0000","last_change":"2024-03-16T07:28:41.576599+0000","last_active":"2024-03-16T07:28:55.988239+0000","last_peered":"2024-03-16T07:28:55.988239+0000","last_clean":"2024-03-16T07:28:55.988239+0000","last_became_active":"2024-03-16T07:28:41.576352+0000","last_became_peered":"2024-03-16T07:28:41.576352+0000","last_unstale":"2024-03-16T07:28:55.988239+0000","last_undegraded":"2024-03-16T07:28:55.988239+0000","last_fullsized":"2024-03-16T07:28:55.988239+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:38:07.821873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":20,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.986812+0000","last_change":"2024-03-16T07:28:40.891054+0000","last_active":"2024-03-16T07:28:55.986812+0000","last_peered":"2024-03-16T07:28:55.986812+0000","last_clean":"2024-03-16T07:28:55.986812+0000","last_became_active":"2024-03-16T07:28:40.890675+0000","last_became_peered":"2024-03-16T07:28:40.890675+0000","last_unstale":"2024-03-16T07:28:55.986812+0000","last_undegraded":"2024-03-16T07:28:55.986812+0000","last_fullsized":"2024-03-16T07:28:55.986812+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_clean_scrub_stamp":"2024-03-16T07:28:39.861342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:42:34.511753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.995076+0000","last_change":"2024-03-16T07:28:55.992105+0000","last_active":"2024-03-16T07:28:55.995076+0000","last_peered":"2024-03-16T07:28:55.995076+0000","last_clean":"2024-03-16T07:28:55.995076+0000","last_became_active":"2024-03-16T07:28:55.991814+0000","last_became_peered":"2024-03-16T07:28:55.991814+0000","last_unstale":"2024-03-16T07:28:55.995076+0000","last_undegraded":"2024-03-16T07:28:55.995076+0000","last_fullsized":"2024-03-16T07:28:55.995076+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_clean_scrub_stamp":"2024-03-16T07:28:54.963620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:48:32.792723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":12,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.983429+0000","last_change":"2024-03-16T07:28:54.990600+0000","last_active":"2024-03-16T07:28:55.983429+0000","last_peered":"2024-03-16T07:28:55.983429+0000","last_clean":"2024-03-16T07:28:55.983429+0000","last_became_active":"2024-03-16T07:28:54.990382+0000","last_became_peered":"2024-03-16T07:28:54.990382+0000","last_unstale":"2024-03-16T07:28:55.983429+0000","last_undegraded":"2024-03-16T07:28:55.983429+0000","last_fullsized":"2024-03-16T07:28:55.983429+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:53.959780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:53.959780+0000","last_clean_scrub_stamp":"2024-03-16T07:28:53.959780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:27:32.357701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.975201+0000","last_change":"2024-03-16T07:28:41.571632+0000","last_active":"2024-03-16T07:28:55.975201+0000","last_peered":"2024-03-16T07:28:55.975201+0000","last_clean":"2024-03-16T07:28:55.975201+0000","last_became_active":"2024-03-16T07:28:41.571014+0000","last_became_peered":"2024-03-16T07:28:41.571014+0000","last_unstale":"2024-03-16T07:28:55.975201+0000","last_undegraded":"2024-03-16T07:28:55.975201+0000","last_fullsized":"2024-03-16T07:28:55.975201+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:43:41.145523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"73'2","reported_seq":22,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.986445+0000","last_change":"2024-03-16T07:28:40.890368+0000","last_active":"2024-03-16T07:28:55.986445+0000","last_peered":"2024-03-16T07:28:55.986445+0000","last_clean":"2024-03-16T07:28:55.986445+0000","last_became_active":"2024-03-16T07:28:40.889977+0000","last_became_peered":"2024-03-16T07:28:40.889977+0000","last_unstale":"2024-03-16T07:28:55.986445+0000","last_undegraded":"2024-03-16T07:28:55.986445+0000","last_fullsized":"2024-03-16T07:28:55.986445+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_clean_scrub_stamp":"2024-03-16T07:28:39.861342+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:13:21.940217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.987311+0000","last_change":"2024-03-16T07:28:55.986229+0000","last_active":"2024-03-16T07:28:55.987311+0000","last_peered":"2024-03-16T07:28:55.987311+0000","last_clean":"2024-03-16T07:28:55.987311+0000","last_became_active":"2024-03-16T07:28:55.985835+0000","last_became_peered":"2024-03-16T07:28:55.985835+0000","last_unstale":"2024-03-16T07:28:55.987311+0000","last_undegraded":"2024-03-16T07:28:55.987311+0000","last_fullsized":"2024-03-16T07:28:55.987311+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_clean_scrub_stamp":"2024-03-16T07:28:54.963620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:12:36.583573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":12,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.983929+0000","last_change":"2024-03-16T07:28:54.988103+0000","last_active":"2024-03-16T07:28:55.983929+0000","last_peered":"2024-03-16T07:28:55.983929+0000","last_clean":"2024-03-16T07:28:55.983929+0000","last_became_active":"2024-03-16T07:28:54.986247+0000","last_became_peered":"2024-03-16T07:28:54.986247+0000","last_unstale":"2024-03-16T07:28:55.983929+0000","last_undegraded":"2024-03-16T07:28:55.983929+0000","last_fullsized":"2024-03-16T07:28:55.983929+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:53.959780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:53.959780+0000","last_clean_scrub_stamp":"2024-03-16T07:28:53.959780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:44:11.391083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.976792+0000","last_change":"2024-03-16T07:28:41.573020+0000","last_active":"2024-03-16T07:28:55.976792+0000","last_peered":"2024-03-16T07:28:55.976792+0000","last_clean":"2024-03-16T07:28:55.976792+0000","last_became_active":"2024-03-16T07:28:41.572167+0000","last_became_peered":"2024-03-16T07:28:41.572167+0000","last_unstale":"2024-03-16T07:28:55.976792+0000","last_undegraded":"2024-03-16T07:28:55.976792+0000","last_fullsized":"2024-03-16T07:28:55.976792+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:05:56.029483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":20,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.980637+0000","last_change":"2024-03-16T07:28:40.878850+0000","last_active":"2024-03-16T07:28:55.980637+0000","last_peered":"2024-03-16T07:28:55.980637+0000","last_clean":"2024-03-16T07:28:55.980637+0000","last_became_active":"2024-03-16T07:28:40.878359+0000","last_became_peered":"2024-03-16T07:28:40.878359+0000","last_unstale":"2024-03-16T07:28:55.980637+0000","last_undegraded":"2024-03-16T07:28:55.980637+0000","last_fullsized":"2024-03-16T07:28:55.980637+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_clean_scrub_stamp":"2024-03-16T07:28:39.861342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:43:24.007718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.994881+0000","last_change":"2024-03-16T07:28:55.992636+0000","last_active":"2024-03-16T07:28:55.994881+0000","last_peered":"2024-03-16T07:28:55.994881+0000","last_clean":"2024-03-16T07:28:55.994881+0000","last_became_active":"2024-03-16T07:28:55.992012+0000","last_became_peered":"2024-03-16T07:28:55.992012+0000","last_unstale":"2024-03-16T07:28:55.994881+0000","last_undegraded":"2024-03-16T07:28:55.994881+0000","last_fullsized":"2024-03-16T07:28:55.994881+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_clean_scrub_stamp":"2024-03-16T07:28:54.963620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:12:43.816594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"77'2","reported_seq":14,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:56.006742+0000","last_change":"2024-03-16T07:28:54.991273+0000","last_active":"2024-03-16T07:28:56.006742+0000","last_peered":"2024-03-16T07:28:56.006742+0000","last_clean":"2024-03-16T07:28:56.006742+0000","last_became_active":"2024-03-16T07:28:54.991020+0000","last_became_peered":"2024-03-16T07:28:54.991020+0000","last_unstale":"2024-03-16T07:28:56.006742+0000","last_undegraded":"2024-03-16T07:28:56.006742+0000","last_fullsized":"2024-03-16T07:28:56.006742+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:53.959780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:53.959780+0000","last_clean_scrub_stamp":"2024-03-16T07:28:53.959780+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:44:10.767627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.969194+0000","last_change":"2024-03-16T07:28:41.580177+0000","last_active":"2024-03-16T07:28:55.969194+0000","last_peered":"2024-03-16T07:28:55.969194+0000","last_clean":"2024-03-16T07:28:55.969194+0000","last_became_active":"2024-03-16T07:28:41.579841+0000","last_became_peered":"2024-03-16T07:28:41.579841+0000","last_unstale":"2024-03-16T07:28:55.969194+0000","last_undegraded":"2024-03-16T07:28:55.969194+0000","last_fullsized":"2024-03-16T07:28:55.969194+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:42:27.646009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":20,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.968576+0000","last_change":"2024-03-16T07:28:40.881199+0000","last_active":"2024-03-16T07:28:55.968576+0000","last_peered":"2024-03-16T07:28:55.968576+0000","last_clean":"2024-03-16T07:28:55.968576+0000","last_became_active":"2024-03-16T07:28:40.880911+0000","last_became_peered":"2024-03-16T07:28:40.880911+0000","last_unstale":"2024-03-16T07:28:55.968576+0000","last_undegraded":"2024-03-16T07:28:55.968576+0000","last_fullsized":"2024-03-16T07:28:55.968576+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_clean_scrub_stamp":"2024-03-16T07:28:39.861342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:21:43.748833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.999268+0000","last_change":"2024-03-16T07:28:55.996530+0000","last_active":"2024-03-16T07:28:55.999268+0000","last_peered":"2024-03-16T07:28:55.999268+0000","last_clean":"2024-03-16T07:28:55.999268+0000","last_became_active":"2024-03-16T07:28:55.995712+0000","last_became_peered":"2024-03-16T07:28:55.995712+0000","last_unstale":"2024-03-16T07:28:55.999268+0000","last_undegraded":"2024-03-16T07:28:55.999268+0000","last_fullsized":"2024-03-16T07:28:55.999268+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_clean_scrub_stamp":"2024-03-16T07:28:54.963620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:08:05.422721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":12,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.974302+0000","last_change":"2024-03-16T07:28:54.994360+0000","last_active":"2024-03-16T07:28:55.974302+0000","last_peered":"2024-03-16T07:28:55.974302+0000","last_clean":"2024-03-16T07:28:55.974302+0000","last_became_active":"2024-03-16T07:28:54.993903+0000","last_became_peered":"2024-03-16T07:28:54.993903+0000","last_unstale":"2024-03-16T07:28:55.974302+0000","last_undegraded":"2024-03-16T07:28:55.974302+0000","last_fullsized":"2024-03-16T07:28:55.974302+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:53.959780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:53.959780+0000","last_clean_scrub_stamp":"2024-03-16T07:28:53.959780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:57:35.296521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.983564+0000","last_change":"2024-03-16T07:28:41.580467+0000","last_active":"2024-03-16T07:28:55.983564+0000","last_peered":"2024-03-16T07:28:55.983564+0000","last_clean":"2024-03-16T07:28:55.983564+0000","last_became_active":"2024-03-16T07:28:41.579919+0000","last_became_peered":"2024-03-16T07:28:41.579919+0000","last_unstale":"2024-03-16T07:28:55.983564+0000","last_undegraded":"2024-03-16T07:28:55.983564+0000","last_fullsized":"2024-03-16T07:28:55.983564+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:48:18.691414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":20,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.969300+0000","last_change":"2024-03-16T07:28:40.878754+0000","last_active":"2024-03-16T07:28:55.969300+0000","last_peered":"2024-03-16T07:28:55.969300+0000","last_clean":"2024-03-16T07:28:55.969300+0000","last_became_active":"2024-03-16T07:28:40.878452+0000","last_became_peered":"2024-03-16T07:28:40.878452+0000","last_unstale":"2024-03-16T07:28:55.969300+0000","last_undegraded":"2024-03-16T07:28:55.969300+0000","last_fullsized":"2024-03-16T07:28:55.969300+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_clean_scrub_stamp":"2024-03-16T07:28:39.861342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:41:14.355084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:56.001793+0000","last_change":"2024-03-16T07:28:55.995252+0000","last_active":"2024-03-16T07:28:56.001793+0000","last_peered":"2024-03-16T07:28:56.001793+0000","last_clean":"2024-03-16T07:28:56.001793+0000","last_became_active":"2024-03-16T07:28:55.992674+0000","last_became_peered":"2024-03-16T07:28:55.992674+0000","last_unstale":"2024-03-16T07:28:56.001793+0000","last_undegraded":"2024-03-16T07:28:56.001793+0000","last_fullsized":"2024-03-16T07:28:56.001793+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_clean_scrub_stamp":"2024-03-16T07:28:54.963620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:13:15.253368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":12,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.988011+0000","last_change":"2024-03-16T07:28:54.993064+0000","last_active":"2024-03-16T07:28:55.988011+0000","last_peered":"2024-03-16T07:28:55.988011+0000","last_clean":"2024-03-16T07:28:55.988011+0000","last_became_active":"2024-03-16T07:28:54.992194+0000","last_became_peered":"2024-03-16T07:28:54.992194+0000","last_unstale":"2024-03-16T07:28:55.988011+0000","last_undegraded":"2024-03-16T07:28:55.988011+0000","last_fullsized":"2024-03-16T07:28:55.988011+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:53.959780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:53.959780+0000","last_clean_scrub_stamp":"2024-03-16T07:28:53.959780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:51:53.445787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.989898+0000","last_change":"2024-03-16T07:28:41.577897+0000","last_active":"2024-03-16T07:28:55.989898+0000","last_peered":"2024-03-16T07:28:55.989898+0000","last_clean":"2024-03-16T07:28:55.989898+0000","last_became_active":"2024-03-16T07:28:41.577214+0000","last_became_peered":"2024-03-16T07:28:41.577214+0000","last_unstale":"2024-03-16T07:28:55.989898+0000","last_undegraded":"2024-03-16T07:28:55.989898+0000","last_fullsized":"2024-03-16T07:28:55.989898+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:03:06.856643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.7","version":"73'2","reported_seq":22,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.977855+0000","last_change":"2024-03-16T07:28:40.887728+0000","last_active":"2024-03-16T07:28:55.977855+0000","last_peered":"2024-03-16T07:28:55.977855+0000","last_clean":"2024-03-16T07:28:55.977855+0000","last_became_active":"2024-03-16T07:28:40.887133+0000","last_became_peered":"2024-03-16T07:28:40.887133+0000","last_unstale":"2024-03-16T07:28:55.977855+0000","last_undegraded":"2024-03-16T07:28:55.977855+0000","last_fullsized":"2024-03-16T07:28:55.977855+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_clean_scrub_stamp":"2024-03-16T07:28:39.861342+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:26:59.911899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:56.000929+0000","last_change":"2024-03-16T07:28:55.999695+0000","last_active":"2024-03-16T07:28:56.000929+0000","last_peered":"2024-03-16T07:28:56.000929+0000","last_clean":"2024-03-16T07:28:56.000929+0000","last_became_active":"2024-03-16T07:28:55.998853+0000","last_became_peered":"2024-03-16T07:28:55.998853+0000","last_unstale":"2024-03-16T07:28:56.000929+0000","last_undegraded":"2024-03-16T07:28:56.000929+0000","last_fullsized":"2024-03-16T07:28:56.000929+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_clean_scrub_stamp":"2024-03-16T07:28:54.963620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:22:47.351164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":12,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.969824+0000","last_change":"2024-03-16T07:28:54.993548+0000","last_active":"2024-03-16T07:28:55.969824+0000","last_peered":"2024-03-16T07:28:55.969824+0000","last_clean":"2024-03-16T07:28:55.969824+0000","last_became_active":"2024-03-16T07:28:54.991467+0000","last_became_peered":"2024-03-16T07:28:54.991467+0000","last_unstale":"2024-03-16T07:28:55.969824+0000","last_undegraded":"2024-03-16T07:28:55.969824+0000","last_fullsized":"2024-03-16T07:28:55.969824+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:53.959780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:53.959780+0000","last_clean_scrub_stamp":"2024-03-16T07:28:53.959780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:20:24.236384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.977682+0000","last_change":"2024-03-16T07:28:41.585466+0000","last_active":"2024-03-16T07:28:55.977682+0000","last_peered":"2024-03-16T07:28:55.977682+0000","last_clean":"2024-03-16T07:28:55.977682+0000","last_became_active":"2024-03-16T07:28:41.585226+0000","last_became_peered":"2024-03-16T07:28:41.585226+0000","last_unstale":"2024-03-16T07:28:55.977682+0000","last_undegraded":"2024-03-16T07:28:55.977682+0000","last_fullsized":"2024-03-16T07:28:55.977682+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:19:56.148452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.6","version":"74'1","reported_seq":21,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.972940+0000","last_change":"2024-03-16T07:28:40.882367+0000","last_active":"2024-03-16T07:28:55.972940+0000","last_peered":"2024-03-16T07:28:55.972940+0000","last_clean":"2024-03-16T07:28:55.972940+0000","last_became_active":"2024-03-16T07:28:40.882075+0000","last_became_peered":"2024-03-16T07:28:40.882075+0000","last_unstale":"2024-03-16T07:28:55.972940+0000","last_undegraded":"2024-03-16T07:28:55.972940+0000","last_fullsized":"2024-03-16T07:28:55.972940+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_clean_scrub_stamp":"2024-03-16T07:28:39.861342+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:40:12.565428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:56.004001+0000","last_change":"2024-03-16T07:28:55.999044+0000","last_active":"2024-03-16T07:28:56.004001+0000","last_peered":"2024-03-16T07:28:56.004001+0000","last_clean":"2024-03-16T07:28:56.004001+0000","last_became_active":"2024-03-16T07:28:55.998706+0000","last_became_peered":"2024-03-16T07:28:55.998706+0000","last_unstale":"2024-03-16T07:28:56.004001+0000","last_undegraded":"2024-03-16T07:28:56.004001+0000","last_fullsized":"2024-03-16T07:28:56.004001+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_clean_scrub_stamp":"2024-03-16T07:28:54.963620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:42:58.192917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"77'2","reported_seq":14,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:56.003452+0000","last_change":"2024-03-16T07:28:54.984144+0000","last_active":"2024-03-16T07:28:56.003452+0000","last_peered":"2024-03-16T07:28:56.003452+0000","last_clean":"2024-03-16T07:28:56.003452+0000","last_became_active":"2024-03-16T07:28:54.983891+0000","last_became_peered":"2024-03-16T07:28:54.983891+0000","last_unstale":"2024-03-16T07:28:56.003452+0000","last_undegraded":"2024-03-16T07:28:56.003452+0000","last_fullsized":"2024-03-16T07:28:56.003452+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:53.959780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:53.959780+0000","last_clean_scrub_stamp":"2024-03-16T07:28:53.959780+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:28:10.522791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.986643+0000","last_change":"2024-03-16T07:28:41.579252+0000","last_active":"2024-03-16T07:28:55.986643+0000","last_peered":"2024-03-16T07:28:55.986643+0000","last_clean":"2024-03-16T07:28:55.986643+0000","last_became_active":"2024-03-16T07:28:41.579005+0000","last_became_peered":"2024-03-16T07:28:41.579005+0000","last_unstale":"2024-03-16T07:28:55.986643+0000","last_undegraded":"2024-03-16T07:28:55.986643+0000","last_fullsized":"2024-03-16T07:28:55.986643+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:28:32.607193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":20,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.988293+0000","last_change":"2024-03-16T07:28:40.889130+0000","last_active":"2024-03-16T07:28:55.988293+0000","last_peered":"2024-03-16T07:28:55.988293+0000","last_clean":"2024-03-16T07:28:55.988293+0000","last_became_active":"2024-03-16T07:28:40.888858+0000","last_became_peered":"2024-03-16T07:28:40.888858+0000","last_unstale":"2024-03-16T07:28:55.988293+0000","last_undegraded":"2024-03-16T07:28:55.988293+0000","last_fullsized":"2024-03-16T07:28:55.988293+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_clean_scrub_stamp":"2024-03-16T07:28:39.861342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:53:46.531176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.995408+0000","last_change":"2024-03-16T07:28:55.992074+0000","last_active":"2024-03-16T07:28:55.995408+0000","last_peered":"2024-03-16T07:28:55.995408+0000","last_clean":"2024-03-16T07:28:55.995408+0000","last_became_active":"2024-03-16T07:28:55.991854+0000","last_became_peered":"2024-03-16T07:28:55.991854+0000","last_unstale":"2024-03-16T07:28:55.995408+0000","last_undegraded":"2024-03-16T07:28:55.995408+0000","last_fullsized":"2024-03-16T07:28:55.995408+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_clean_scrub_stamp":"2024-03-16T07:28:54.963620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:49:53.338420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":12,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.989341+0000","last_change":"2024-03-16T07:28:54.990493+0000","last_active":"2024-03-16T07:28:55.989341+0000","last_peered":"2024-03-16T07:28:55.989341+0000","last_clean":"2024-03-16T07:28:55.989341+0000","last_became_active":"2024-03-16T07:28:54.990263+0000","last_became_peered":"2024-03-16T07:28:54.990263+0000","last_unstale":"2024-03-16T07:28:55.989341+0000","last_undegraded":"2024-03-16T07:28:55.989341+0000","last_fullsized":"2024-03-16T07:28:55.989341+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:53.959780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:53.959780+0000","last_clean_scrub_stamp":"2024-03-16T07:28:53.959780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:18:46.830366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.974502+0000","last_change":"2024-03-16T07:28:41.573311+0000","last_active":"2024-03-16T07:28:55.974502+0000","last_peered":"2024-03-16T07:28:55.974502+0000","last_clean":"2024-03-16T07:28:55.974502+0000","last_became_active":"2024-03-16T07:28:41.572424+0000","last_became_peered":"2024-03-16T07:28:41.572424+0000","last_unstale":"2024-03-16T07:28:55.974502+0000","last_undegraded":"2024-03-16T07:28:55.974502+0000","last_fullsized":"2024-03-16T07:28:55.974502+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:24:58.130821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":20,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.970159+0000","last_change":"2024-03-16T07:28:40.880251+0000","last_active":"2024-03-16T07:28:55.970159+0000","last_peered":"2024-03-16T07:28:55.970159+0000","last_clean":"2024-03-16T07:28:55.970159+0000","last_became_active":"2024-03-16T07:28:40.879971+0000","last_became_peered":"2024-03-16T07:28:40.879971+0000","last_unstale":"2024-03-16T07:28:55.970159+0000","last_undegraded":"2024-03-16T07:28:55.970159+0000","last_fullsized":"2024-03-16T07:28:55.970159+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_clean_scrub_stamp":"2024-03-16T07:28:39.861342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:13:24.928381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.991991+0000","last_change":"2024-03-16T07:28:55.990665+0000","last_active":"2024-03-16T07:28:55.991991+0000","last_peered":"2024-03-16T07:28:55.991991+0000","last_clean":"2024-03-16T07:28:55.991991+0000","last_became_active":"2024-03-16T07:28:55.989940+0000","last_became_peered":"2024-03-16T07:28:55.989940+0000","last_unstale":"2024-03-16T07:28:55.991991+0000","last_undegraded":"2024-03-16T07:28:55.991991+0000","last_fullsized":"2024-03-16T07:28:55.991991+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_clean_scrub_stamp":"2024-03-16T07:28:54.963620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:32:05.411362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":12,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.974304+0000","last_change":"2024-03-16T07:28:54.983396+0000","last_active":"2024-03-16T07:28:55.974304+0000","last_peered":"2024-03-16T07:28:55.974304+0000","last_clean":"2024-03-16T07:28:55.974304+0000","last_became_active":"2024-03-16T07:28:54.982955+0000","last_became_peered":"2024-03-16T07:28:54.982955+0000","last_unstale":"2024-03-16T07:28:55.974304+0000","last_undegraded":"2024-03-16T07:28:55.974304+0000","last_fullsized":"2024-03-16T07:28:55.974304+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:53.959780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:53.959780+0000","last_clean_scrub_stamp":"2024-03-16T07:28:53.959780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:01:05.134156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.976715+0000","last_change":"2024-03-16T07:28:41.583018+0000","last_active":"2024-03-16T07:28:55.976715+0000","last_peered":"2024-03-16T07:28:55.976715+0000","last_clean":"2024-03-16T07:28:55.976715+0000","last_became_active":"2024-03-16T07:28:41.581147+0000","last_became_peered":"2024-03-16T07:28:41.581147+0000","last_unstale":"2024-03-16T07:28:55.976715+0000","last_undegraded":"2024-03-16T07:28:55.976715+0000","last_fullsized":"2024-03-16T07:28:55.976715+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:44:44.566786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":20,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.986557+0000","last_change":"2024-03-16T07:28:40.889809+0000","last_active":"2024-03-16T07:28:55.986557+0000","last_peered":"2024-03-16T07:28:55.986557+0000","last_clean":"2024-03-16T07:28:55.986557+0000","last_became_active":"2024-03-16T07:28:40.889330+0000","last_became_peered":"2024-03-16T07:28:40.889330+0000","last_unstale":"2024-03-16T07:28:55.986557+0000","last_undegraded":"2024-03-16T07:28:55.986557+0000","last_fullsized":"2024-03-16T07:28:55.986557+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_clean_scrub_stamp":"2024-03-16T07:28:39.861342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:35:52.160999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:56.005818+0000","last_change":"2024-03-16T07:28:56.000327+0000","last_active":"2024-03-16T07:28:56.005818+0000","last_peered":"2024-03-16T07:28:56.005818+0000","last_clean":"2024-03-16T07:28:56.005818+0000","last_became_active":"2024-03-16T07:28:55.992668+0000","last_became_peered":"2024-03-16T07:28:55.992668+0000","last_unstale":"2024-03-16T07:28:56.005818+0000","last_undegraded":"2024-03-16T07:28:56.005818+0000","last_fullsized":"2024-03-16T07:28:56.005818+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_clean_scrub_stamp":"2024-03-16T07:28:54.963620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:55:45.092400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":12,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.968722+0000","last_change":"2024-03-16T07:28:54.987983+0000","last_active":"2024-03-16T07:28:55.968722+0000","last_peered":"2024-03-16T07:28:55.968722+0000","last_clean":"2024-03-16T07:28:55.968722+0000","last_became_active":"2024-03-16T07:28:54.987754+0000","last_became_peered":"2024-03-16T07:28:54.987754+0000","last_unstale":"2024-03-16T07:28:55.968722+0000","last_undegraded":"2024-03-16T07:28:55.968722+0000","last_fullsized":"2024-03-16T07:28:55.968722+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:53.959780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:53.959780+0000","last_clean_scrub_stamp":"2024-03-16T07:28:53.959780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:14:23.739094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.986221+0000","last_change":"2024-03-16T07:28:41.578826+0000","last_active":"2024-03-16T07:28:55.986221+0000","last_peered":"2024-03-16T07:28:55.986221+0000","last_clean":"2024-03-16T07:28:55.986221+0000","last_became_active":"2024-03-16T07:28:41.578575+0000","last_became_peered":"2024-03-16T07:28:41.578575+0000","last_unstale":"2024-03-16T07:28:55.986221+0000","last_undegraded":"2024-03-16T07:28:55.986221+0000","last_fullsized":"2024-03-16T07:28:55.986221+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:12:29.715285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":20,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.976951+0000","last_change":"2024-03-16T07:28:40.878633+0000","last_active":"2024-03-16T07:28:55.976951+0000","last_peered":"2024-03-16T07:28:55.976951+0000","last_clean":"2024-03-16T07:28:55.976951+0000","last_became_active":"2024-03-16T07:28:40.878286+0000","last_became_peered":"2024-03-16T07:28:40.878286+0000","last_unstale":"2024-03-16T07:28:55.976951+0000","last_undegraded":"2024-03-16T07:28:55.976951+0000","last_fullsized":"2024-03-16T07:28:55.976951+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_clean_scrub_stamp":"2024-03-16T07:28:39.861342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:23:46.664218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.994838+0000","last_change":"2024-03-16T07:28:55.992263+0000","last_active":"2024-03-16T07:28:55.994838+0000","last_peered":"2024-03-16T07:28:55.994838+0000","last_clean":"2024-03-16T07:28:55.994838+0000","last_became_active":"2024-03-16T07:28:55.991363+0000","last_became_peered":"2024-03-16T07:28:55.991363+0000","last_unstale":"2024-03-16T07:28:55.994838+0000","last_undegraded":"2024-03-16T07:28:55.994838+0000","last_fullsized":"2024-03-16T07:28:55.994838+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_clean_scrub_stamp":"2024-03-16T07:28:54.963620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:38:21.923182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":12,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.985500+0000","last_change":"2024-03-16T07:28:54.988363+0000","last_active":"2024-03-16T07:28:55.985500+0000","last_peered":"2024-03-16T07:28:55.985500+0000","last_clean":"2024-03-16T07:28:55.985500+0000","last_became_active":"2024-03-16T07:28:54.988082+0000","last_became_peered":"2024-03-16T07:28:54.988082+0000","last_unstale":"2024-03-16T07:28:55.985500+0000","last_undegraded":"2024-03-16T07:28:55.985500+0000","last_fullsized":"2024-03-16T07:28:55.985500+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:53.959780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:53.959780+0000","last_clean_scrub_stamp":"2024-03-16T07:28:53.959780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:11:21.210695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.972239+0000","last_change":"2024-03-16T07:28:41.575151+0000","last_active":"2024-03-16T07:28:55.972239+0000","last_peered":"2024-03-16T07:28:55.972239+0000","last_clean":"2024-03-16T07:28:55.972239+0000","last_became_active":"2024-03-16T07:28:41.573833+0000","last_became_peered":"2024-03-16T07:28:41.573833+0000","last_unstale":"2024-03-16T07:28:55.972239+0000","last_undegraded":"2024-03-16T07:28:55.972239+0000","last_fullsized":"2024-03-16T07:28:55.972239+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:19:25.780587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":20,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.975281+0000","last_change":"2024-03-16T07:28:40.882270+0000","last_active":"2024-03-16T07:28:55.975281+0000","last_peered":"2024-03-16T07:28:55.975281+0000","last_clean":"2024-03-16T07:28:55.975281+0000","last_became_active":"2024-03-16T07:28:40.882028+0000","last_became_peered":"2024-03-16T07:28:40.882028+0000","last_unstale":"2024-03-16T07:28:55.975281+0000","last_undegraded":"2024-03-16T07:28:55.975281+0000","last_fullsized":"2024-03-16T07:28:55.975281+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_clean_scrub_stamp":"2024-03-16T07:28:39.861342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:56:29.041650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:56.008323+0000","last_change":"2024-03-16T07:28:56.006185+0000","last_active":"2024-03-16T07:28:56.008323+0000","last_peered":"2024-03-16T07:28:56.008323+0000","last_clean":"2024-03-16T07:28:56.008323+0000","last_became_active":"2024-03-16T07:28:56.004811+0000","last_became_peered":"2024-03-16T07:28:56.004811+0000","last_unstale":"2024-03-16T07:28:56.008323+0000","last_undegraded":"2024-03-16T07:28:56.008323+0000","last_fullsized":"2024-03-16T07:28:56.008323+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_clean_scrub_stamp":"2024-03-16T07:28:54.963620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:32:22.760415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":12,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.974448+0000","last_change":"2024-03-16T07:28:54.994437+0000","last_active":"2024-03-16T07:28:55.974448+0000","last_peered":"2024-03-16T07:28:55.974448+0000","last_clean":"2024-03-16T07:28:55.974448+0000","last_became_active":"2024-03-16T07:28:54.994194+0000","last_became_peered":"2024-03-16T07:28:54.994194+0000","last_unstale":"2024-03-16T07:28:55.974448+0000","last_undegraded":"2024-03-16T07:28:55.974448+0000","last_fullsized":"2024-03-16T07:28:55.974448+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:53.959780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:53.959780+0000","last_clean_scrub_stamp":"2024-03-16T07:28:53.959780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:52:20.420277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.974733+0000","last_change":"2024-03-16T07:28:41.573973+0000","last_active":"2024-03-16T07:28:55.974733+0000","last_peered":"2024-03-16T07:28:55.974733+0000","last_clean":"2024-03-16T07:28:55.974733+0000","last_became_active":"2024-03-16T07:28:41.573727+0000","last_became_peered":"2024-03-16T07:28:41.573727+0000","last_unstale":"2024-03-16T07:28:55.974733+0000","last_undegraded":"2024-03-16T07:28:55.974733+0000","last_fullsized":"2024-03-16T07:28:55.974733+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:17:45.831164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":20,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.984289+0000","last_change":"2024-03-16T07:28:40.889413+0000","last_active":"2024-03-16T07:28:55.984289+0000","last_peered":"2024-03-16T07:28:55.984289+0000","last_clean":"2024-03-16T07:28:55.984289+0000","last_became_active":"2024-03-16T07:28:40.886509+0000","last_became_peered":"2024-03-16T07:28:40.886509+0000","last_unstale":"2024-03-16T07:28:55.984289+0000","last_undegraded":"2024-03-16T07:28:55.984289+0000","last_fullsized":"2024-03-16T07:28:55.984289+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_clean_scrub_stamp":"2024-03-16T07:28:39.861342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:48:28.551260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.998830+0000","last_change":"2024-03-16T07:28:55.994916+0000","last_active":"2024-03-16T07:28:55.998830+0000","last_peered":"2024-03-16T07:28:55.998830+0000","last_clean":"2024-03-16T07:28:55.998830+0000","last_became_active":"2024-03-16T07:28:55.991137+0000","last_became_peered":"2024-03-16T07:28:55.991137+0000","last_unstale":"2024-03-16T07:28:55.998830+0000","last_undegraded":"2024-03-16T07:28:55.998830+0000","last_fullsized":"2024-03-16T07:28:55.998830+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:54.963620+0000","last_clean_scrub_stamp":"2024-03-16T07:28:54.963620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:36:49.316052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"77'1","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:56.003683+0000","last_change":"2024-03-16T07:28:54.986430+0000","last_active":"2024-03-16T07:28:56.003683+0000","last_peered":"2024-03-16T07:28:56.003683+0000","last_clean":"2024-03-16T07:28:56.003683+0000","last_became_active":"2024-03-16T07:28:54.986212+0000","last_became_peered":"2024-03-16T07:28:54.986212+0000","last_unstale":"2024-03-16T07:28:56.003683+0000","last_undegraded":"2024-03-16T07:28:56.003683+0000","last_fullsized":"2024-03-16T07:28:56.003683+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:53.959780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:53.959780+0000","last_clean_scrub_stamp":"2024-03-16T07:28:53.959780+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:20:24.236384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.973494+0000","last_change":"2024-03-16T07:28:41.586465+0000","last_active":"2024-03-16T07:28:55.973494+0000","last_peered":"2024-03-16T07:28:55.973494+0000","last_clean":"2024-03-16T07:28:55.973494+0000","last_became_active":"2024-03-16T07:28:41.586201+0000","last_became_peered":"2024-03-16T07:28:41.586201+0000","last_unstale":"2024-03-16T07:28:55.973494+0000","last_undegraded":"2024-03-16T07:28:55.973494+0000","last_fullsized":"2024-03-16T07:28:55.973494+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:40.862311+0000","last_clean_scrub_stamp":"2024-03-16T07:28:40.862311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:39:46.941392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"73'1","reported_seq":21,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.973862+0000","last_change":"2024-03-16T07:28:40.883217+0000","last_active":"2024-03-16T07:28:55.973862+0000","last_peered":"2024-03-16T07:28:55.973862+0000","last_clean":"2024-03-16T07:28:55.973862+0000","last_became_active":"2024-03-16T07:28:40.882980+0000","last_became_peered":"2024-03-16T07:28:40.882980+0000","last_unstale":"2024-03-16T07:28:55.973862+0000","last_undegraded":"2024-03-16T07:28:55.973862+0000","last_fullsized":"2024-03-16T07:28:55.973862+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:28:39.861342+0000","last_clean_scrub_stamp":"2024-03-16T07:28:39.861342+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:07:49.913968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"58'141","reported_seq":420,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-03-16T07:28:55.972584+0000","last_change":"2024-03-16T07:24:31.650537+0000","last_active":"2024-03-16T07:28:55.972584+0000","last_peered":"2024-03-16T07:28:55.972584+0000","last_clean":"2024-03-16T07:28:55.972584+0000","last_became_active":"2024-03-16T07:24:31.649574+0000","last_became_peered":"2024-03-16T07:24:31.649574+0000","last_unstale":"2024-03-16T07:28:55.972584+0000","last_undegraded":"2024-03-16T07:28:55.972584+0000","last_fullsized":"2024-03-16T07:28:55.972584+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:29.719970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:29.719970+0000","last_clean_scrub_stamp":"2024-03-16T07:24:29.719970+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:31:35.774554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":490,"num_read_kb":915,"num_write":217,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":4107,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":8214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":3},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":490,"num_read_kb":915,"num_write":217,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":141,"ondisk_log_size":141,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738422,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":31988,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":104825612,"statfs":{"total":107374182400,"available":107341426688,"internally_reserved":0,"allocated":823296,"data_stored":311824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738422,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":32512,"kb_used_data":1332,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":104825088,"statfs":{"total":107374182400,"available":107340890112,"internally_reserved":0,"allocated":1363968,"data_stored":891240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738422,"num_pgs":82,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":32552,"kb_used_data":1368,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":104825048,"statfs":{"total":107374182400,"available":107340849152,"internally_reserved":0,"allocated":1400832,"data_stored":901070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":3947,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-16T07:29:00.642 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-03-16T07:29:00.642 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T07:29:01.066 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:29:01.067 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":57,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5259,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6827/3159374847","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":3159374847},{"type":"v1","addr":"172.21.15.49:6827","nonce":3159374847}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":46},{"gid":5260,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6829/626442568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":626442568},{"type":"v1","addr":"172.21.15.49:6829","nonce":626442568}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":46},{"gid":5267,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6831/3455133872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":3455133872},{"type":"v1","addr":"172.21.15.49:6831","nonce":3455133872}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":46}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-16T07:28:41.244463+0000","modified":"2024-03-16T07:28:44.360549+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5269":{"gid":5269,"name":"e","rank":0,"incarnation":47,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6835/647809721","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":647809721},{"type":"v1","addr":"172.21.15.49:6835","nonce":647809721}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5269,"qdb_cluster":[5269]},"id":6},{"mdsmap":{"epoch":57,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-16T07:28:55.340838+0000","modified":"2024-03-16T07:28:58.365965+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5268},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5268":{"gid":5268,"name":"a","rank":0,"incarnation":53,"state":"up:active","state_seq":6,"addr":"172.21.15.49:6833/1067362108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":1067362108},{"type":"v1","addr":"172.21.15.49:6833","nonce":1067362108}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"backup_fs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5268,"qdb_cluster":[5268]},"id":7}]} 2024-03-16T07:29:01.067 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 57 2024-03-16T07:29:01.585 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 57, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-03-16T07:28:55.340838+0000', 'modified': '2024-03-16T07:28:58.365965+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5268}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5268': {'gid': 5268, 'name': 'a', 'rank': 0, 'incarnation': 53, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.49:6833/1067362108', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.49:6832', 'nonce': 1067362108}, {'type': 'v1', 'addr': '172.21.15.49:6833', 'nonce': 1067362108}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [15], 'metadata_pool': 14, 'enabled': True, 'fs_name': 'backup_fs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5268, 'qdb_cluster': [5268]} 2024-03-16T07:29:01.586 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-03-16T07:29:01.586 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-03-16T07:29:01.726 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-16T07:29:01.727+0000 7f8462ffd640 0 client.5401 ms_handle_reset on v2:172.21.15.49:6832/1067362108 2024-03-16T07:29:01.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-16T07:29:01.750+0000 7f8462ffd640 0 client.5403 ms_handle_reset on v2:172.21.15.49:6832/1067362108 2024-03-16T07:29:01.749 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-03-16T07:29:01.749 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_fsid": "f91af061-9eac-4793-87fa-8d27ae3d242f", 2024-03-16T07:29:01.749 INFO:teuthology.orchestra.run.smithi049.stdout: "whoami": 0, 2024-03-16T07:29:01.749 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 5268, 2024-03-16T07:29:01.749 INFO:teuthology.orchestra.run.smithi049.stdout: "want_state": "up:active", 2024-03-16T07:29:01.749 INFO:teuthology.orchestra.run.smithi049.stdout: "state": "up:active", 2024-03-16T07:29:01.749 INFO:teuthology.orchestra.run.smithi049.stdout: "fs_name": "backup_fs", 2024-03-16T07:29:01.749 INFO:teuthology.orchestra.run.smithi049.stdout: "rank_uptime": 5.7854100959999997, 2024-03-16T07:29:01.750 INFO:teuthology.orchestra.run.smithi049.stdout: "mdsmap_epoch": 57, 2024-03-16T07:29:01.750 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch": 78, 2024-03-16T07:29:01.750 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch_barrier": 78, 2024-03-16T07:29:01.750 INFO:teuthology.orchestra.run.smithi049.stdout: "uptime": 25.164615688000001 2024-03-16T07:29:01.750 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-03-16T07:29:01.765 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable mirroring 2024-03-16T07:29:03.010 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-03-16T07:29:03.010 DEBUG:teuthology.orchestra.run.smithi049:mirror status for fs: cephfs> ceph --admin-daemon /var/run/ceph/cephfs-mirror.asok fs mirror status cephfs@6 2024-03-16T07:29:03.117 INFO:teuthology.orchestra.run.smithi049.stderr:no valid command found; 10 closest matches: 2024-03-16T07:29:03.117 INFO:teuthology.orchestra.run.smithi049.stderr:0 2024-03-16T07:29:03.117 INFO:teuthology.orchestra.run.smithi049.stderr:1 2024-03-16T07:29:03.117 INFO:teuthology.orchestra.run.smithi049.stderr:2 2024-03-16T07:29:03.117 INFO:teuthology.orchestra.run.smithi049.stderr:abort 2024-03-16T07:29:03.117 INFO:teuthology.orchestra.run.smithi049.stderr:assert 2024-03-16T07:29:03.117 INFO:teuthology.orchestra.run.smithi049.stderr:config diff 2024-03-16T07:29:03.117 INFO:teuthology.orchestra.run.smithi049.stderr:config diff get 2024-03-16T07:29:03.117 INFO:teuthology.orchestra.run.smithi049.stderr:config get 2024-03-16T07:29:03.117 INFO:teuthology.orchestra.run.smithi049.stderr:config help [] 2024-03-16T07:29:03.117 INFO:teuthology.orchestra.run.smithi049.stderr:config set ... 2024-03-16T07:29:03.118 INFO:teuthology.orchestra.run.smithi049.stderr:admin_socket: invalid command 2024-03-16T07:29:03.118 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-03-16T07:29:03.119 WARNING:tasks.cephfs.test_mirroring:mirror daemon command with label "mirror status for fs: cephfs" failed: Command failed (mirror status for fs: cephfs) on smithi049 with status 22: 'ceph --admin-daemon /var/run/ceph/cephfs-mirror.asok fs mirror status cephfs@6' 2024-03-16T07:29:03.119 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable mirroring 2024-03-16T07:29:03.473 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:29:03.475+0000 7fe4e9a42040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-16T07:29:03.522 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:29:03.524+0000 7fe4e9a42040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-16T07:29:03.938 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:29:03.940+0000 7fe4e9a42040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-16T07:29:03.986 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:29:03.987+0000 7fe4e9a42040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-16T07:29:04.009 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-03-16T07:29:04.009 DEBUG:teuthology.orchestra.run.smithi049:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-03-16T07:29:04.059 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:29:04.061+0000 7fe4e9a42040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-16T07:29:04.070 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-03-16T07:29:04.070 INFO:tasks.cephfs.mount:Terminating background process 2024-03-16T07:29:04.070 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-03-16T07:29:04.070 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-16T07:29:04.086 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T07:29:04.156 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:29:04.157+0000 7fe4e9a42040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-16T07:29:04.234 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:29:04.236+0000 7fe4e9a42040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-16T07:29:04.433 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:29:04.433 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":78,"fsid":"f91af061-9eac-4793-87fa-8d27ae3d242f","created":"2024-03-16T07:24:20.357868+0000","modified":"2024-03-16T07:28:56.973477+0000","last_up_change":"2024-03-16T07:24:27.474980+0000","last_in_change":"2024-03-16T07:24:21.254179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T07:24:28.947521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-03-16T07:28:39.556362+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.4099999666213989,"score_stable":1.4099999666213989,"optimal_score":1,"raw_score_acting":1.4099999666213989,"raw_score_stable":1.4099999666213989,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-03-16T07:28:40.220835+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"backup_fs_metadata","create_time":"2024-03-16T07:28:53.909674+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"backup_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.309999942779541,"score_stable":1.309999942779541,"optimal_score":1,"raw_score_acting":1.309999942779541,"raw_score_stable":1.309999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"backup_fs_data","create_time":"2024-03-16T07:28:54.340919+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"backup_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1699999570846558,"score_stable":1.1699999570846558,"optimal_score":1,"raw_score_acting":1.1699999570846558,"raw_score_stable":1.1699999570846558,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2df14aac-98dc-4e3c-ae7e-9eb677aa30be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6801","nonce":2744935777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6803","nonce":2744935777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6807","nonce":2744935777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6805","nonce":2744935777}]},"public_addr":"172.21.15.49:6801/2744935777","cluster_addr":"172.21.15.49:6803/2744935777","heartbeat_back_addr":"172.21.15.49:6807/2744935777","heartbeat_front_addr":"172.21.15.49:6805/2744935777","state":["exists","up"]},{"osd":1,"uuid":"80461bd9-59ef-46df-9eea-bad92d960c57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6811","nonce":1655120118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6815","nonce":1655120118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6821","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6823","nonce":1655120118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6817","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6819","nonce":1655120118}]},"public_addr":"172.21.15.49:6811/1655120118","cluster_addr":"172.21.15.49:6815/1655120118","heartbeat_back_addr":"172.21.15.49:6823/1655120118","heartbeat_front_addr":"172.21.15.49:6819/1655120118","state":["exists","up"]},{"osd":2,"uuid":"d6bf40eb-6e42-4ec9-8b3d-0b6c5a6def79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6810","nonce":3815472376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6814","nonce":3815472376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6822","nonce":3815472376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6818","nonce":3815472376}]},"public_addr":"172.21.15.49:6810/3815472376","cluster_addr":"172.21.15.49:6814/3815472376","heartbeat_back_addr":"172.21.15.49:6822/3815472376","heartbeat_front_addr":"172.21.15.49:6818/3815472376","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.641492+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.668598+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.614940+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T07:29:04.446 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-16T07:24:28.947521+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-16T07:28:39.556362+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '73', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.409999966621399, 'score_stable': 1.409999966621399, 'optimal_score': 1, 'raw_score_acting': 1.409999966621399, 'raw_score_stable': 1.409999966621399, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2024-03-16T07:28:40.220835+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '74', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'backup_fs_metadata', 'create_time': '2024-03-16T07:28:53.909674+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '77', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'backup_fs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.309999942779541, 'score_stable': 1.309999942779541, 'optimal_score': 1, 'raw_score_acting': 1.309999942779541, 'raw_score_stable': 1.309999942779541, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'backup_fs_data', 'create_time': '2024-03-16T07:28:54.340919+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '78', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'backup_fs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1699999570846558, 'score_stable': 1.1699999570846558, 'optimal_score': 1, 'raw_score_acting': 1.1699999570846558, 'raw_score_stable': 1.1699999570846558, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-16T07:29:04.446 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-16T07:29:04.455 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:29:04.457+0000 7fe4e9a42040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-16T07:29:04.556 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:29:04.558+0000 7fe4e9a42040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-16T07:29:04.606 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:29:04.608+0000 7fe4e9a42040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-16T07:29:04.658 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:29:04.660+0000 7fe4e9a42040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-16T07:29:04.704 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:29:04.706+0000 7fe4e9a42040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-16T07:29:04.896 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2024-03-16T07:29:04.916 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-16T07:29:05.086 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:29:05.088+0000 7fe4e9a42040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-16T07:29:05.292 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:29:05.294+0000 7fe4e9a42040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-16T07:29:05.390 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:29:05.392+0000 7fe4e9a42040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-16T07:29:05.412 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2024-03-16T07:29:05.425 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-16T07:29:05.436 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:29:05.438+0000 7fe4e9a42040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-16T07:29:05.613 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:29:05.615+0000 7fe4e9a42040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-16T07:29:05.710 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:29:05.712+0000 7fe4e9a42040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-16T07:29:05.816 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2024-03-16T07:29:05.829 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get backup_fs_metadata pg_num 2024-03-16T07:29:05.900 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:29:05.902+0000 7fe4e9a42040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-16T07:29:05.946 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:29:05.948+0000 7fe4e9a42040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-16T07:29:06.157 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:29:06.159+0000 7fe4e9a42040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-16T07:29:06.186 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2024-03-16T07:29:06.199 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get backup_fs_data pg_num 2024-03-16T07:29:06.550 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2024-03-16T07:29:06.563 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-16T07:29:06.882 INFO:teuthology.orchestra.run.smithi049.stderr:listed 0 entries 2024-03-16T07:29:06.895 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi049.front.sepia.ceph.com... 2024-03-16T07:29:06.895 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:29:06.896 DEBUG:teuthology.orchestra.run.smithi049:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-03-16T07:29:06.925 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi049.stderr:ceph-fuse[58887]: fuse finished with error 0 and tester_r 0 2024-03-16T07:29:06.927 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi049.front.sepia.ceph.com 2024-03-16T07:29:06.927 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:29:06.928 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-03-16T07:29:06.984 INFO:tasks.cephfs.mount:Terminating background process 2024-03-16T07:29:06.985 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-03-16T07:29:06.985 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-16T07:29:07.041 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T07:29:07.059 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:29:07.061+0000 7fe4e9a42040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-16T07:29:07.393 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:29:07.393 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":78,"fsid":"f91af061-9eac-4793-87fa-8d27ae3d242f","created":"2024-03-16T07:24:20.357868+0000","modified":"2024-03-16T07:28:56.973477+0000","last_up_change":"2024-03-16T07:24:27.474980+0000","last_in_change":"2024-03-16T07:24:21.254179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T07:24:28.947521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-03-16T07:28:39.556362+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.4099999666213989,"score_stable":1.4099999666213989,"optimal_score":1,"raw_score_acting":1.4099999666213989,"raw_score_stable":1.4099999666213989,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-03-16T07:28:40.220835+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"backup_fs_metadata","create_time":"2024-03-16T07:28:53.909674+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"backup_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.309999942779541,"score_stable":1.309999942779541,"optimal_score":1,"raw_score_acting":1.309999942779541,"raw_score_stable":1.309999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"backup_fs_data","create_time":"2024-03-16T07:28:54.340919+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"backup_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1699999570846558,"score_stable":1.1699999570846558,"optimal_score":1,"raw_score_acting":1.1699999570846558,"raw_score_stable":1.1699999570846558,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2df14aac-98dc-4e3c-ae7e-9eb677aa30be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6801","nonce":2744935777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6803","nonce":2744935777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6807","nonce":2744935777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6805","nonce":2744935777}]},"public_addr":"172.21.15.49:6801/2744935777","cluster_addr":"172.21.15.49:6803/2744935777","heartbeat_back_addr":"172.21.15.49:6807/2744935777","heartbeat_front_addr":"172.21.15.49:6805/2744935777","state":["exists","up"]},{"osd":1,"uuid":"80461bd9-59ef-46df-9eea-bad92d960c57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6811","nonce":1655120118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6815","nonce":1655120118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6821","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6823","nonce":1655120118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6817","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6819","nonce":1655120118}]},"public_addr":"172.21.15.49:6811/1655120118","cluster_addr":"172.21.15.49:6815/1655120118","heartbeat_back_addr":"172.21.15.49:6823/1655120118","heartbeat_front_addr":"172.21.15.49:6819/1655120118","state":["exists","up"]},{"osd":2,"uuid":"d6bf40eb-6e42-4ec9-8b3d-0b6c5a6def79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6810","nonce":3815472376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6814","nonce":3815472376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6822","nonce":3815472376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6818","nonce":3815472376}]},"public_addr":"172.21.15.49:6810/3815472376","cluster_addr":"172.21.15.49:6814/3815472376","heartbeat_back_addr":"172.21.15.49:6822/3815472376","heartbeat_front_addr":"172.21.15.49:6818/3815472376","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.641492+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.668598+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.614940+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T07:29:07.406 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-16T07:24:28.947521+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-16T07:28:39.556362+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '73', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.409999966621399, 'score_stable': 1.409999966621399, 'optimal_score': 1, 'raw_score_acting': 1.409999966621399, 'raw_score_stable': 1.409999966621399, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2024-03-16T07:28:40.220835+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '74', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'backup_fs_metadata', 'create_time': '2024-03-16T07:28:53.909674+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '77', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'backup_fs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.309999942779541, 'score_stable': 1.309999942779541, 'optimal_score': 1, 'raw_score_acting': 1.309999942779541, 'raw_score_stable': 1.309999942779541, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'backup_fs_data', 'create_time': '2024-03-16T07:28:54.340919+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '78', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'backup_fs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1699999570846558, 'score_stable': 1.1699999570846558, 'optimal_score': 1, 'raw_score_acting': 1.1699999570846558, 'raw_score_stable': 1.1699999570846558, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-16T07:29:07.407 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-16T07:29:07.465 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:29:07.466+0000 7fe4e9a42040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-16T07:29:07.518 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:29:07.519+0000 7fe4e9a42040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-16T07:29:07.657 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:29:07.659+0000 7fe4e9a42040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-16T07:29:07.830 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2024-03-16T07:29:07.845 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-16T07:29:08.109 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:29:08.110+0000 7fd84de32040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-16T07:29:08.158 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:29:08.160+0000 7fd84de32040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-16T07:29:08.220 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2024-03-16T07:29:08.240 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-16T07:29:08.524 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T07:29:08.556 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2024-03-16T07:29:08.569 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get backup_fs_metadata pg_num 2024-03-16T07:29:08.585 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:29:08.587+0000 7fd84de32040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-16T07:29:08.643 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:29:08.645+0000 7fd84de32040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-16T07:29:08.689 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:29:08.691+0000 7fd84de32040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-16T07:29:08.749 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:29:08.751+0000 7fd84de32040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-16T07:29:08.819 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:29:08.820+0000 7fd84de32040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-16T07:29:08.897 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2024-03-16T07:29:08.914 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get backup_fs_data pg_num 2024-03-16T07:29:08.989 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:29:08.990+0000 7fd84de32040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-16T07:29:09.088 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:29:09.090+0000 7fd84de32040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-16T07:29:09.133 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:29:09.135+0000 7fd84de32040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-16T07:29:09.204 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:29:09.206+0000 7fd84de32040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-16T07:29:09.225 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2024-03-16T07:29:09.239 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-16T07:29:09.262 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:29:09.263+0000 7fd84de32040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-16T07:29:09.563 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/132815804 2024-03-17T07:29:07.672636+0000 2024-03-16T07:29:09.563 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/1432118456 2024-03-17T07:29:07.672636+0000 2024-03-16T07:29:09.563 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/1092992686 2024-03-17T07:29:07.672636+0000 2024-03-16T07:29:09.563 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/3749314698 2024-03-17T07:29:07.672636+0000 2024-03-16T07:29:09.563 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/2350030053 2024-03-17T07:29:07.672636+0000 2024-03-16T07:29:09.563 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:6825/932165724 2024-03-17T07:29:07.672636+0000 2024-03-16T07:29:09.564 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:6824/932165724 2024-03-17T07:29:07.672636+0000 2024-03-16T07:29:09.564 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/2424772700 2024-03-17T07:29:07.672636+0000 2024-03-16T07:29:09.564 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/3374244176 2024-03-17T07:29:07.672636+0000 2024-03-16T07:29:09.564 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/2065171791 2024-03-17T07:29:07.672636+0000 2024-03-16T07:29:09.564 INFO:teuthology.orchestra.run.smithi049.stderr:listed 10 entries 2024-03-16T07:29:09.577 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi049.front.sepia.ceph.com... 2024-03-16T07:29:09.577 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:29:09.577 DEBUG:teuthology.orchestra.run.smithi049:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2024-03-16T07:29:09.648 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi049.stderr:ceph-fuse[59305]: fuse finished with error 0 and tester_r 0 2024-03-16T07:29:09.650 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi049.front.sepia.ceph.com 2024-03-16T07:29:09.650 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:29:09.651 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-03-16T07:29:09.708 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:29:09.709+0000 7fd84de32040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-16T07:29:09.774 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T07:29:09.948 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:29:09.949+0000 7fd84de32040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-16T07:29:10.085 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:29:10.087+0000 7fd84de32040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-16T07:29:10.130 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:29:10.132+0000 7fd84de32040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-16T07:29:10.207 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:29:10.207 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":57,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5259,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6827/3159374847","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":3159374847},{"type":"v1","addr":"172.21.15.49:6827","nonce":3159374847}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":46},{"gid":5260,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6829/626442568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":626442568},{"type":"v1","addr":"172.21.15.49:6829","nonce":626442568}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":46},{"gid":5267,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6831/3455133872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":3455133872},{"type":"v1","addr":"172.21.15.49:6831","nonce":3455133872}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":46}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-16T07:28:41.244463+0000","modified":"2024-03-16T07:28:44.360549+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5269":{"gid":5269,"name":"e","rank":0,"incarnation":47,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6835/647809721","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":647809721},{"type":"v1","addr":"172.21.15.49:6835","nonce":647809721}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5269,"qdb_cluster":[5269]},"id":6},{"mdsmap":{"epoch":57,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-16T07:28:55.340838+0000","modified":"2024-03-16T07:28:58.365965+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5268},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5268":{"gid":5268,"name":"a","rank":0,"incarnation":53,"state":"up:active","state_seq":6,"addr":"172.21.15.49:6833/1067362108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":1067362108},{"type":"v1","addr":"172.21.15.49:6833","nonce":1067362108}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"backup_fs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5268,"qdb_cluster":[5268]},"id":7}]} 2024-03-16T07:29:10.207 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 57 2024-03-16T07:29:10.225 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T07:29:10.250 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:29:10.252+0000 7fd84de32040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-16T07:29:10.359 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:29:10.360+0000 7fd84de32040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-16T07:29:10.558 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:29:10.560+0000 7fd84de32040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-16T07:29:10.607 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:29:10.607 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":79,"fsid":"f91af061-9eac-4793-87fa-8d27ae3d242f","created":"2024-03-16T07:24:20.357868+0000","modified":"2024-03-16T07:29:07.672677+0000","last_up_change":"2024-03-16T07:24:27.474980+0000","last_in_change":"2024-03-16T07:24:21.254179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T07:24:28.947521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-03-16T07:28:39.556362+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.4099999666213989,"score_stable":1.4099999666213989,"optimal_score":1,"raw_score_acting":1.4099999666213989,"raw_score_stable":1.4099999666213989,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-03-16T07:28:40.220835+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"backup_fs_metadata","create_time":"2024-03-16T07:28:53.909674+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"backup_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.309999942779541,"score_stable":1.309999942779541,"optimal_score":1,"raw_score_acting":1.309999942779541,"raw_score_stable":1.309999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"backup_fs_data","create_time":"2024-03-16T07:28:54.340919+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"backup_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1699999570846558,"score_stable":1.1699999570846558,"optimal_score":1,"raw_score_acting":1.1699999570846558,"raw_score_stable":1.1699999570846558,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2df14aac-98dc-4e3c-ae7e-9eb677aa30be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6801","nonce":2744935777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6803","nonce":2744935777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6807","nonce":2744935777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6805","nonce":2744935777}]},"public_addr":"172.21.15.49:6801/2744935777","cluster_addr":"172.21.15.49:6803/2744935777","heartbeat_back_addr":"172.21.15.49:6807/2744935777","heartbeat_front_addr":"172.21.15.49:6805/2744935777","state":["exists","up"]},{"osd":1,"uuid":"80461bd9-59ef-46df-9eea-bad92d960c57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6811","nonce":1655120118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6815","nonce":1655120118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6821","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6823","nonce":1655120118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6817","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6819","nonce":1655120118}]},"public_addr":"172.21.15.49:6811/1655120118","cluster_addr":"172.21.15.49:6815/1655120118","heartbeat_back_addr":"172.21.15.49:6823/1655120118","heartbeat_front_addr":"172.21.15.49:6819/1655120118","state":["exists","up"]},{"osd":2,"uuid":"d6bf40eb-6e42-4ec9-8b3d-0b6c5a6def79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6810","nonce":3815472376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6814","nonce":3815472376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6822","nonce":3815472376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6818","nonce":3815472376}]},"public_addr":"172.21.15.49:6810/3815472376","cluster_addr":"172.21.15.49:6814/3815472376","heartbeat_back_addr":"172.21.15.49:6822/3815472376","heartbeat_front_addr":"172.21.15.49:6818/3815472376","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.641492+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.668598+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.614940+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.49:0/132815804":"2024-03-17T07:29:07.672636+0000","172.21.15.49:0/1432118456":"2024-03-17T07:29:07.672636+0000","172.21.15.49:0/1092992686":"2024-03-17T07:29:07.672636+0000","172.21.15.49:0/3749314698":"2024-03-17T07:29:07.672636+0000","172.21.15.49:0/2350030053":"2024-03-17T07:29:07.672636+0000","172.21.15.49:6825/932165724":"2024-03-17T07:29:07.672636+0000","172.21.15.49:6824/932165724":"2024-03-17T07:29:07.672636+0000","172.21.15.49:0/2424772700":"2024-03-17T07:29:07.672636+0000","172.21.15.49:0/3374244176":"2024-03-17T07:29:07.672636+0000","172.21.15.49:0/2065171791":"2024-03-17T07:29:07.672636+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T07:29:10.620 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-16T07:24:28.947521+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-16T07:28:39.556362+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '73', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.409999966621399, 'score_stable': 1.409999966621399, 'optimal_score': 1, 'raw_score_acting': 1.409999966621399, 'raw_score_stable': 1.409999966621399, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2024-03-16T07:28:40.220835+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '74', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'backup_fs_metadata', 'create_time': '2024-03-16T07:28:53.909674+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '77', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'backup_fs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.309999942779541, 'score_stable': 1.309999942779541, 'optimal_score': 1, 'raw_score_acting': 1.309999942779541, 'raw_score_stable': 1.309999942779541, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'backup_fs_data', 'create_time': '2024-03-16T07:28:54.340919+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '78', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'backup_fs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1699999570846558, 'score_stable': 1.1699999570846558, 'optimal_score': 1, 'raw_score_acting': 1.1699999570846558, 'raw_score_stable': 1.1699999570846558, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-16T07:29:10.620 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-16T07:29:10.629 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:29:10.631+0000 7fd84de32040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-16T07:29:10.766 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:29:10.768+0000 7fd84de32040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-16T07:29:11.058 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2024-03-16T07:29:11.072 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-16T07:29:11.396 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2024-03-16T07:29:11.414 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-16T07:29:11.561 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:29:11.563+0000 7fd84de32040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-16T07:29:11.787 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2024-03-16T07:29:11.800 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get backup_fs_metadata pg_num 2024-03-16T07:29:11.949 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:29:11.950+0000 7fd84de32040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-16T07:29:12.006 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:29:12.007+0000 7fd84de32040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-16T07:29:12.131 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:29:12.133+0000 7fd84de32040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-16T07:29:12.156 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2024-03-16T07:29:12.175 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get backup_fs_data pg_num 2024-03-16T07:29:12.228 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:29:12.229+0000 7fd7cf2b5640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:29:12.228 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:29:12.229+0000 7fd7cf2b5640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:29:12.228 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:29:12.229+0000 7fd7cf2b5640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:29:12.228 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:29:12.229+0000 7fd7cf2b5640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:29:12.228 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:29:12.229+0000 7fd7cf2b5640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:29:12.229 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:29:12.230+0000 7fd7d22bb640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:29:12.229 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:29:12.230+0000 7fd7d22bb640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:29:12.229 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:29:12.230+0000 7fd7d22bb640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:29:12.229 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:29:12.230+0000 7fd7d22bb640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:29:12.229 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:29:12.230+0000 7fd7d22bb640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:29:12.244 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:29:12.246+0000 7fd7cf2b5640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:29:12.244 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:29:12.246+0000 7fd7cf2b5640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:29:12.244 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:29:12.246+0000 7fd7cf2b5640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:29:12.244 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:29:12.246+0000 7fd7cf2b5640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:29:12.244 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:29:12.246+0000 7fd7cf2b5640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:29:12.245 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:29:12.247+0000 7fd7d22bb640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:29:12.245 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:29:12.247+0000 7fd7d22bb640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:29:12.245 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:29:12.247+0000 7fd7d22bb640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:29:12.245 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:29:12.247+0000 7fd7d22bb640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:29:12.246 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:29:12.247+0000 7fd7d22bb640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:29:12.504 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2024-03-16T07:29:12.517 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T07:29:12.892 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:29:12.892 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":57,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5259,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6827/3159374847","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":3159374847},{"type":"v1","addr":"172.21.15.49:6827","nonce":3159374847}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":46},{"gid":5260,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6829/626442568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":626442568},{"type":"v1","addr":"172.21.15.49:6829","nonce":626442568}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":46},{"gid":5267,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6831/3455133872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":3455133872},{"type":"v1","addr":"172.21.15.49:6831","nonce":3455133872}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":46}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-16T07:28:41.244463+0000","modified":"2024-03-16T07:28:44.360549+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5269":{"gid":5269,"name":"e","rank":0,"incarnation":47,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6835/647809721","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":647809721},{"type":"v1","addr":"172.21.15.49:6835","nonce":647809721}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5269,"qdb_cluster":[5269]},"id":6},{"mdsmap":{"epoch":57,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-16T07:28:55.340838+0000","modified":"2024-03-16T07:28:58.365965+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5268},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5268":{"gid":5268,"name":"a","rank":0,"incarnation":53,"state":"up:active","state_seq":6,"addr":"172.21.15.49:6833/1067362108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":1067362108},{"type":"v1","addr":"172.21.15.49:6833","nonce":1067362108}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"backup_fs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5268,"qdb_cluster":[5268]},"id":7}]} 2024-03-16T07:29:12.893 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 57 2024-03-16T07:29:12.906 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T07:29:13.283 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:29:13.283 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":80,"fsid":"f91af061-9eac-4793-87fa-8d27ae3d242f","created":"2024-03-16T07:24:20.357868+0000","modified":"2024-03-16T07:29:12.146674+0000","last_up_change":"2024-03-16T07:24:27.474980+0000","last_in_change":"2024-03-16T07:24:21.254179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T07:24:28.947521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-03-16T07:28:39.556362+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.4099999666213989,"score_stable":1.4099999666213989,"optimal_score":1,"raw_score_acting":1.4099999666213989,"raw_score_stable":1.4099999666213989,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-03-16T07:28:40.220835+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"backup_fs_metadata","create_time":"2024-03-16T07:28:53.909674+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"backup_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.309999942779541,"score_stable":1.309999942779541,"optimal_score":1,"raw_score_acting":1.309999942779541,"raw_score_stable":1.309999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"backup_fs_data","create_time":"2024-03-16T07:28:54.340919+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"backup_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1699999570846558,"score_stable":1.1699999570846558,"optimal_score":1,"raw_score_acting":1.1699999570846558,"raw_score_stable":1.1699999570846558,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2df14aac-98dc-4e3c-ae7e-9eb677aa30be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6801","nonce":2744935777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6803","nonce":2744935777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6807","nonce":2744935777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6805","nonce":2744935777}]},"public_addr":"172.21.15.49:6801/2744935777","cluster_addr":"172.21.15.49:6803/2744935777","heartbeat_back_addr":"172.21.15.49:6807/2744935777","heartbeat_front_addr":"172.21.15.49:6805/2744935777","state":["exists","up"]},{"osd":1,"uuid":"80461bd9-59ef-46df-9eea-bad92d960c57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6811","nonce":1655120118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6815","nonce":1655120118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6821","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6823","nonce":1655120118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6817","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6819","nonce":1655120118}]},"public_addr":"172.21.15.49:6811/1655120118","cluster_addr":"172.21.15.49:6815/1655120118","heartbeat_back_addr":"172.21.15.49:6823/1655120118","heartbeat_front_addr":"172.21.15.49:6819/1655120118","state":["exists","up"]},{"osd":2,"uuid":"d6bf40eb-6e42-4ec9-8b3d-0b6c5a6def79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6810","nonce":3815472376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6814","nonce":3815472376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6822","nonce":3815472376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6818","nonce":3815472376}]},"public_addr":"172.21.15.49:6810/3815472376","cluster_addr":"172.21.15.49:6814/3815472376","heartbeat_back_addr":"172.21.15.49:6822/3815472376","heartbeat_front_addr":"172.21.15.49:6818/3815472376","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.641492+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.668598+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.614940+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.49:0/132815804":"2024-03-17T07:29:07.672636+0000","172.21.15.49:0/1432118456":"2024-03-17T07:29:07.672636+0000","172.21.15.49:0/1092992686":"2024-03-17T07:29:07.672636+0000","172.21.15.49:0/3749314698":"2024-03-17T07:29:07.672636+0000","172.21.15.49:0/2350030053":"2024-03-17T07:29:07.672636+0000","172.21.15.49:6825/932165724":"2024-03-17T07:29:07.672636+0000","172.21.15.49:6824/932165724":"2024-03-17T07:29:07.672636+0000","172.21.15.49:0/2424772700":"2024-03-17T07:29:07.672636+0000","172.21.15.49:0/3374244176":"2024-03-17T07:29:07.672636+0000","172.21.15.49:0/2065171791":"2024-03-17T07:29:07.672636+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T07:29:13.297 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-03-16T07:29:13.297 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T07:29:13.690 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:29:13.690 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":57,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5259,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6827/3159374847","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":3159374847},{"type":"v1","addr":"172.21.15.49:6827","nonce":3159374847}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":46},{"gid":5260,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6829/626442568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":626442568},{"type":"v1","addr":"172.21.15.49:6829","nonce":626442568}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":46},{"gid":5267,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6831/3455133872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":3455133872},{"type":"v1","addr":"172.21.15.49:6831","nonce":3455133872}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":46}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-16T07:28:41.244463+0000","modified":"2024-03-16T07:28:44.360549+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5269":{"gid":5269,"name":"e","rank":0,"incarnation":47,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6835/647809721","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":647809721},{"type":"v1","addr":"172.21.15.49:6835","nonce":647809721}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5269,"qdb_cluster":[5269]},"id":6},{"mdsmap":{"epoch":57,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-16T07:28:55.340838+0000","modified":"2024-03-16T07:28:58.365965+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5268},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5268":{"gid":5268,"name":"a","rank":0,"incarnation":53,"state":"up:active","state_seq":6,"addr":"172.21.15.49:6833/1067362108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":1067362108},{"type":"v1","addr":"172.21.15.49:6833","nonce":1067362108}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"backup_fs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5268,"qdb_cluster":[5268]},"id":7}]} 2024-03-16T07:29:13.691 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 57 2024-03-16T07:29:13.703 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T07:29:14.066 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:29:14.066 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":57,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5259,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6827/3159374847","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":3159374847},{"type":"v1","addr":"172.21.15.49:6827","nonce":3159374847}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":46},{"gid":5260,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6829/626442568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":626442568},{"type":"v1","addr":"172.21.15.49:6829","nonce":626442568}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":46},{"gid":5267,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6831/3455133872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":3455133872},{"type":"v1","addr":"172.21.15.49:6831","nonce":3455133872}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":46}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-16T07:28:41.244463+0000","modified":"2024-03-16T07:28:44.360549+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5269":{"gid":5269,"name":"e","rank":0,"incarnation":47,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6835/647809721","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":647809721},{"type":"v1","addr":"172.21.15.49:6835","nonce":647809721}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5269,"qdb_cluster":[5269]},"id":6},{"mdsmap":{"epoch":57,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-16T07:28:55.340838+0000","modified":"2024-03-16T07:28:58.365965+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5268},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5268":{"gid":5268,"name":"a","rank":0,"incarnation":53,"state":"up:active","state_seq":6,"addr":"172.21.15.49:6833/1067362108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":1067362108},{"type":"v1","addr":"172.21.15.49:6833","nonce":1067362108}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"backup_fs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5268,"qdb_cluster":[5268]},"id":7}]} 2024-03-16T07:29:14.067 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 57 2024-03-16T07:29:14.079 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T07:29:14.491 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:29:14.491 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":80,"fsid":"f91af061-9eac-4793-87fa-8d27ae3d242f","created":"2024-03-16T07:24:20.357868+0000","modified":"2024-03-16T07:29:12.146674+0000","last_up_change":"2024-03-16T07:24:27.474980+0000","last_in_change":"2024-03-16T07:24:21.254179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T07:24:28.947521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-03-16T07:28:39.556362+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.4099999666213989,"score_stable":1.4099999666213989,"optimal_score":1,"raw_score_acting":1.4099999666213989,"raw_score_stable":1.4099999666213989,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-03-16T07:28:40.220835+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"backup_fs_metadata","create_time":"2024-03-16T07:28:53.909674+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"backup_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.309999942779541,"score_stable":1.309999942779541,"optimal_score":1,"raw_score_acting":1.309999942779541,"raw_score_stable":1.309999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"backup_fs_data","create_time":"2024-03-16T07:28:54.340919+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"backup_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1699999570846558,"score_stable":1.1699999570846558,"optimal_score":1,"raw_score_acting":1.1699999570846558,"raw_score_stable":1.1699999570846558,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2df14aac-98dc-4e3c-ae7e-9eb677aa30be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6801","nonce":2744935777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6803","nonce":2744935777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6807","nonce":2744935777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6805","nonce":2744935777}]},"public_addr":"172.21.15.49:6801/2744935777","cluster_addr":"172.21.15.49:6803/2744935777","heartbeat_back_addr":"172.21.15.49:6807/2744935777","heartbeat_front_addr":"172.21.15.49:6805/2744935777","state":["exists","up"]},{"osd":1,"uuid":"80461bd9-59ef-46df-9eea-bad92d960c57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6811","nonce":1655120118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6815","nonce":1655120118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6821","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6823","nonce":1655120118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6817","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6819","nonce":1655120118}]},"public_addr":"172.21.15.49:6811/1655120118","cluster_addr":"172.21.15.49:6815/1655120118","heartbeat_back_addr":"172.21.15.49:6823/1655120118","heartbeat_front_addr":"172.21.15.49:6819/1655120118","state":["exists","up"]},{"osd":2,"uuid":"d6bf40eb-6e42-4ec9-8b3d-0b6c5a6def79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6810","nonce":3815472376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6814","nonce":3815472376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6822","nonce":3815472376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6818","nonce":3815472376}]},"public_addr":"172.21.15.49:6810/3815472376","cluster_addr":"172.21.15.49:6814/3815472376","heartbeat_back_addr":"172.21.15.49:6822/3815472376","heartbeat_front_addr":"172.21.15.49:6818/3815472376","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.641492+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.668598+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.614940+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.49:0/132815804":"2024-03-17T07:29:07.672636+0000","172.21.15.49:0/1432118456":"2024-03-17T07:29:07.672636+0000","172.21.15.49:0/1092992686":"2024-03-17T07:29:07.672636+0000","172.21.15.49:0/3749314698":"2024-03-17T07:29:07.672636+0000","172.21.15.49:0/2350030053":"2024-03-17T07:29:07.672636+0000","172.21.15.49:6825/932165724":"2024-03-17T07:29:07.672636+0000","172.21.15.49:6824/932165724":"2024-03-17T07:29:07.672636+0000","172.21.15.49:0/2424772700":"2024-03-17T07:29:07.672636+0000","172.21.15.49:0/3374244176":"2024-03-17T07:29:07.672636+0000","172.21.15.49:0/2065171791":"2024-03-17T07:29:07.672636+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T07:29:14.504 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-03-16T07:29:15.071 INFO:tasks.ceph.mon.a.smithi049.stderr:2024-03-16T07:29:15.073+0000 7feb67011640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-03-16T07:29:15.072 INFO:teuthology.orchestra.run.smithi049.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-03-16T07:29:15.074 INFO:tasks.ceph.mds.e.smithi049.stderr: -218> 2024-03-16T07:28:47.535+0000 7effa3fbd640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-03-16T07:29:15.090 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-03-16T07:29:15.100 INFO:tasks.ceph.mds.e.smithi049.stdout:starting mds.e at 2024-03-16T07:29:16.087 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-03-16T07:29:17.156 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_metadata' removed 2024-03-16T07:29:17.175 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-03-16T07:29:18.156 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_data' removed 2024-03-16T07:29:18.179 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T07:29:18.567 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:29:18.568 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":83,"fsid":"f91af061-9eac-4793-87fa-8d27ae3d242f","created":"2024-03-16T07:24:20.357868+0000","modified":"2024-03-16T07:29:18.158230+0000","last_up_change":"2024-03-16T07:24:27.474980+0000","last_in_change":"2024-03-16T07:24:21.254179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T07:24:28.947521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"backup_fs_metadata","create_time":"2024-03-16T07:28:53.909674+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"backup_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.309999942779541,"score_stable":1.309999942779541,"optimal_score":1,"raw_score_acting":1.309999942779541,"raw_score_stable":1.309999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"backup_fs_data","create_time":"2024-03-16T07:28:54.340919+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"backup_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1699999570846558,"score_stable":1.1699999570846558,"optimal_score":1,"raw_score_acting":1.1699999570846558,"raw_score_stable":1.1699999570846558,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2df14aac-98dc-4e3c-ae7e-9eb677aa30be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6801","nonce":2744935777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6803","nonce":2744935777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6807","nonce":2744935777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6805","nonce":2744935777}]},"public_addr":"172.21.15.49:6801/2744935777","cluster_addr":"172.21.15.49:6803/2744935777","heartbeat_back_addr":"172.21.15.49:6807/2744935777","heartbeat_front_addr":"172.21.15.49:6805/2744935777","state":["exists","up"]},{"osd":1,"uuid":"80461bd9-59ef-46df-9eea-bad92d960c57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6811","nonce":1655120118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6815","nonce":1655120118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6821","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6823","nonce":1655120118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6817","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6819","nonce":1655120118}]},"public_addr":"172.21.15.49:6811/1655120118","cluster_addr":"172.21.15.49:6815/1655120118","heartbeat_back_addr":"172.21.15.49:6823/1655120118","heartbeat_front_addr":"172.21.15.49:6819/1655120118","state":["exists","up"]},{"osd":2,"uuid":"d6bf40eb-6e42-4ec9-8b3d-0b6c5a6def79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6810","nonce":3815472376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6814","nonce":3815472376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6822","nonce":3815472376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6818","nonce":3815472376}]},"public_addr":"172.21.15.49:6810/3815472376","cluster_addr":"172.21.15.49:6814/3815472376","heartbeat_back_addr":"172.21.15.49:6822/3815472376","heartbeat_front_addr":"172.21.15.49:6818/3815472376","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.641492+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.668598+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.614940+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.49:6835/647809721":"2024-03-17T07:29:15.073767+0000","172.21.15.49:6834/647809721":"2024-03-17T07:29:15.073767+0000","172.21.15.49:0/132815804":"2024-03-17T07:29:07.672636+0000","172.21.15.49:0/1432118456":"2024-03-17T07:29:07.672636+0000","172.21.15.49:0/1092992686":"2024-03-17T07:29:07.672636+0000","172.21.15.49:0/3749314698":"2024-03-17T07:29:07.672636+0000","172.21.15.49:0/2350030053":"2024-03-17T07:29:07.672636+0000","172.21.15.49:6825/932165724":"2024-03-17T07:29:07.672636+0000","172.21.15.49:6824/932165724":"2024-03-17T07:29:07.672636+0000","172.21.15.49:0/2424772700":"2024-03-17T07:29:07.672636+0000","172.21.15.49:0/3374244176":"2024-03-17T07:29:07.672636+0000","172.21.15.49:0/2065171791":"2024-03-17T07:29:07.672636+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T07:29:18.584 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-16T07:24:28.947521+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'backup_fs_metadata', 'create_time': '2024-03-16T07:28:53.909674+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '77', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'backup_fs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.309999942779541, 'score_stable': 1.309999942779541, 'optimal_score': 1, 'raw_score_acting': 1.309999942779541, 'raw_score_stable': 1.309999942779541, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'backup_fs_data', 'create_time': '2024-03-16T07:28:54.340919+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '78', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'backup_fs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1699999570846558, 'score_stable': 1.1699999570846558, 'optimal_score': 1, 'raw_score_acting': 1.1699999570846558, 'raw_score_stable': 1.1699999570846558, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-16T07:29:18.584 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-16T07:29:18.892 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2024-03-16T07:29:18.906 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get backup_fs_metadata pg_num 2024-03-16T07:29:19.214 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2024-03-16T07:29:19.227 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get backup_fs_data pg_num 2024-03-16T07:29:19.537 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2024-03-16T07:29:19.550 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T07:29:19.891 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:29:19.891 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":59,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5259,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6827/3159374847","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":3159374847},{"type":"v1","addr":"172.21.15.49:6827","nonce":3159374847}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":46},{"gid":5260,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6829/626442568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":626442568},{"type":"v1","addr":"172.21.15.49:6829","nonce":626442568}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":46},{"gid":5267,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6831/3455133872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":3455133872},{"type":"v1","addr":"172.21.15.49:6831","nonce":3455133872}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":46},{"gid":5512,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/1907907321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":1907907321},{"type":"v1","addr":"172.21.15.49:6835","nonce":1907907321}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":59}],"filesystems":[{"mdsmap":{"epoch":57,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-16T07:28:55.340838+0000","modified":"2024-03-16T07:28:58.365965+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5268},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5268":{"gid":5268,"name":"a","rank":0,"incarnation":53,"state":"up:active","state_seq":6,"addr":"172.21.15.49:6833/1067362108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":1067362108},{"type":"v1","addr":"172.21.15.49:6833","nonce":1067362108}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"backup_fs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5268,"qdb_cluster":[5268]},"id":7}]} 2024-03-16T07:29:19.891 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 59 2024-03-16T07:29:19.903 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T07:29:20.209 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:29:20.209 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":83,"fsid":"f91af061-9eac-4793-87fa-8d27ae3d242f","created":"2024-03-16T07:24:20.357868+0000","modified":"2024-03-16T07:29:18.158230+0000","last_up_change":"2024-03-16T07:24:27.474980+0000","last_in_change":"2024-03-16T07:24:21.254179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T07:24:28.947521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"backup_fs_metadata","create_time":"2024-03-16T07:28:53.909674+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"backup_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.309999942779541,"score_stable":1.309999942779541,"optimal_score":1,"raw_score_acting":1.309999942779541,"raw_score_stable":1.309999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"backup_fs_data","create_time":"2024-03-16T07:28:54.340919+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"backup_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1699999570846558,"score_stable":1.1699999570846558,"optimal_score":1,"raw_score_acting":1.1699999570846558,"raw_score_stable":1.1699999570846558,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2df14aac-98dc-4e3c-ae7e-9eb677aa30be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6801","nonce":2744935777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6803","nonce":2744935777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6807","nonce":2744935777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6805","nonce":2744935777}]},"public_addr":"172.21.15.49:6801/2744935777","cluster_addr":"172.21.15.49:6803/2744935777","heartbeat_back_addr":"172.21.15.49:6807/2744935777","heartbeat_front_addr":"172.21.15.49:6805/2744935777","state":["exists","up"]},{"osd":1,"uuid":"80461bd9-59ef-46df-9eea-bad92d960c57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6811","nonce":1655120118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6815","nonce":1655120118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6821","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6823","nonce":1655120118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6817","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6819","nonce":1655120118}]},"public_addr":"172.21.15.49:6811/1655120118","cluster_addr":"172.21.15.49:6815/1655120118","heartbeat_back_addr":"172.21.15.49:6823/1655120118","heartbeat_front_addr":"172.21.15.49:6819/1655120118","state":["exists","up"]},{"osd":2,"uuid":"d6bf40eb-6e42-4ec9-8b3d-0b6c5a6def79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6810","nonce":3815472376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6814","nonce":3815472376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6822","nonce":3815472376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6818","nonce":3815472376}]},"public_addr":"172.21.15.49:6810/3815472376","cluster_addr":"172.21.15.49:6814/3815472376","heartbeat_back_addr":"172.21.15.49:6822/3815472376","heartbeat_front_addr":"172.21.15.49:6818/3815472376","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.641492+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.668598+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.614940+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.49:6835/647809721":"2024-03-17T07:29:15.073767+0000","172.21.15.49:6834/647809721":"2024-03-17T07:29:15.073767+0000","172.21.15.49:0/132815804":"2024-03-17T07:29:07.672636+0000","172.21.15.49:0/1432118456":"2024-03-17T07:29:07.672636+0000","172.21.15.49:0/1092992686":"2024-03-17T07:29:07.672636+0000","172.21.15.49:0/3749314698":"2024-03-17T07:29:07.672636+0000","172.21.15.49:0/2350030053":"2024-03-17T07:29:07.672636+0000","172.21.15.49:6825/932165724":"2024-03-17T07:29:07.672636+0000","172.21.15.49:6824/932165724":"2024-03-17T07:29:07.672636+0000","172.21.15.49:0/2424772700":"2024-03-17T07:29:07.672636+0000","172.21.15.49:0/3374244176":"2024-03-17T07:29:07.672636+0000","172.21.15.49:0/2065171791":"2024-03-17T07:29:07.672636+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T07:29:20.222 INFO:tasks.cephfs.filesystem:Destroying file system backup_fs and related pools 2024-03-16T07:29:20.222 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T07:29:20.561 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:29:20.561 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":59,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5259,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6827/3159374847","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":3159374847},{"type":"v1","addr":"172.21.15.49:6827","nonce":3159374847}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":46},{"gid":5260,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6829/626442568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":626442568},{"type":"v1","addr":"172.21.15.49:6829","nonce":626442568}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":46},{"gid":5267,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6831/3455133872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":3455133872},{"type":"v1","addr":"172.21.15.49:6831","nonce":3455133872}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":46},{"gid":5512,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/1907907321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":1907907321},{"type":"v1","addr":"172.21.15.49:6835","nonce":1907907321}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":59}],"filesystems":[{"mdsmap":{"epoch":57,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-16T07:28:55.340838+0000","modified":"2024-03-16T07:28:58.365965+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5268},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5268":{"gid":5268,"name":"a","rank":0,"incarnation":53,"state":"up:active","state_seq":6,"addr":"172.21.15.49:6833/1067362108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":1067362108},{"type":"v1","addr":"172.21.15.49:6833","nonce":1067362108}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"backup_fs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5268,"qdb_cluster":[5268]},"id":7}]} 2024-03-16T07:29:20.561 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 59 2024-03-16T07:29:20.574 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T07:29:20.958 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:29:20.958 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":59,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5259,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6827/3159374847","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":3159374847},{"type":"v1","addr":"172.21.15.49:6827","nonce":3159374847}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":46},{"gid":5260,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6829/626442568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":626442568},{"type":"v1","addr":"172.21.15.49:6829","nonce":626442568}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":46},{"gid":5267,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6831/3455133872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":3455133872},{"type":"v1","addr":"172.21.15.49:6831","nonce":3455133872}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":46},{"gid":5512,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/1907907321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":1907907321},{"type":"v1","addr":"172.21.15.49:6835","nonce":1907907321}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":59}],"filesystems":[{"mdsmap":{"epoch":57,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-16T07:28:55.340838+0000","modified":"2024-03-16T07:28:58.365965+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5268},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5268":{"gid":5268,"name":"a","rank":0,"incarnation":53,"state":"up:active","state_seq":6,"addr":"172.21.15.49:6833/1067362108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":1067362108},{"type":"v1","addr":"172.21.15.49:6833","nonce":1067362108}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"backup_fs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5268,"qdb_cluster":[5268]},"id":7}]} 2024-03-16T07:29:20.958 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 59 2024-03-16T07:29:20.971 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T07:29:21.391 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:29:21.391 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":83,"fsid":"f91af061-9eac-4793-87fa-8d27ae3d242f","created":"2024-03-16T07:24:20.357868+0000","modified":"2024-03-16T07:29:18.158230+0000","last_up_change":"2024-03-16T07:24:27.474980+0000","last_in_change":"2024-03-16T07:24:21.254179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T07:24:28.947521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"backup_fs_metadata","create_time":"2024-03-16T07:28:53.909674+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"backup_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.309999942779541,"score_stable":1.309999942779541,"optimal_score":1,"raw_score_acting":1.309999942779541,"raw_score_stable":1.309999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"backup_fs_data","create_time":"2024-03-16T07:28:54.340919+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"backup_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1699999570846558,"score_stable":1.1699999570846558,"optimal_score":1,"raw_score_acting":1.1699999570846558,"raw_score_stable":1.1699999570846558,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2df14aac-98dc-4e3c-ae7e-9eb677aa30be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6801","nonce":2744935777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6803","nonce":2744935777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6807","nonce":2744935777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6805","nonce":2744935777}]},"public_addr":"172.21.15.49:6801/2744935777","cluster_addr":"172.21.15.49:6803/2744935777","heartbeat_back_addr":"172.21.15.49:6807/2744935777","heartbeat_front_addr":"172.21.15.49:6805/2744935777","state":["exists","up"]},{"osd":1,"uuid":"80461bd9-59ef-46df-9eea-bad92d960c57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6811","nonce":1655120118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6815","nonce":1655120118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6821","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6823","nonce":1655120118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6817","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6819","nonce":1655120118}]},"public_addr":"172.21.15.49:6811/1655120118","cluster_addr":"172.21.15.49:6815/1655120118","heartbeat_back_addr":"172.21.15.49:6823/1655120118","heartbeat_front_addr":"172.21.15.49:6819/1655120118","state":["exists","up"]},{"osd":2,"uuid":"d6bf40eb-6e42-4ec9-8b3d-0b6c5a6def79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6810","nonce":3815472376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6814","nonce":3815472376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6822","nonce":3815472376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6818","nonce":3815472376}]},"public_addr":"172.21.15.49:6810/3815472376","cluster_addr":"172.21.15.49:6814/3815472376","heartbeat_back_addr":"172.21.15.49:6822/3815472376","heartbeat_front_addr":"172.21.15.49:6818/3815472376","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.641492+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.668598+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.614940+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.49:6835/647809721":"2024-03-17T07:29:15.073767+0000","172.21.15.49:6834/647809721":"2024-03-17T07:29:15.073767+0000","172.21.15.49:0/132815804":"2024-03-17T07:29:07.672636+0000","172.21.15.49:0/1432118456":"2024-03-17T07:29:07.672636+0000","172.21.15.49:0/1092992686":"2024-03-17T07:29:07.672636+0000","172.21.15.49:0/3749314698":"2024-03-17T07:29:07.672636+0000","172.21.15.49:0/2350030053":"2024-03-17T07:29:07.672636+0000","172.21.15.49:6825/932165724":"2024-03-17T07:29:07.672636+0000","172.21.15.49:6824/932165724":"2024-03-17T07:29:07.672636+0000","172.21.15.49:0/2424772700":"2024-03-17T07:29:07.672636+0000","172.21.15.49:0/3374244176":"2024-03-17T07:29:07.672636+0000","172.21.15.49:0/2065171791":"2024-03-17T07:29:07.672636+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T07:29:21.405 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail backup_fs 2024-03-16T07:29:21.774 INFO:tasks.ceph.mon.a.smithi049.stderr:2024-03-16T07:29:21.776+0000 7feb67011640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-03-16T07:29:21.775 INFO:teuthology.orchestra.run.smithi049.stderr:backup_fs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-03-16T07:29:21.776 INFO:tasks.ceph.mds.a.smithi049.stderr: -185> 2024-03-16T07:28:57.535+0000 7f7128f37640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-03-16T07:29:21.790 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm backup_fs --yes-i-really-mean-it 2024-03-16T07:29:21.801 INFO:tasks.ceph.mds.a.smithi049.stdout:starting mds.a at 2024-03-16T07:29:22.794 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm backup_fs_metadata backup_fs_metadata --yes-i-really-really-mean-it 2024-03-16T07:29:23.778 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'backup_fs_metadata' removed 2024-03-16T07:29:23.797 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm backup_fs_data backup_fs_data --yes-i-really-really-mean-it 2024-03-16T07:29:24.781 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'backup_fs_data' removed 2024-03-16T07:29:24.802 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-03-16T07:29:25.128 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_mirroring.TestMirroring.test_add_directory_with_mirroring_disabled' 2024-03-16T07:29:25.795 INFO:tasks.cephfs_test_runner:test_add_directory_with_mirroring_disabled (tasks.cephfs.test_mirroring.TestMirroring) ... ok 2024-03-16T07:29:25.795 INFO:tasks.cephfs_test_runner:Starting test: test_add_relative_directory_path (tasks.cephfs.test_mirroring.TestMirroring) 2024-03-16T07:29:25.796 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T07:29:26.109 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:29:26.109 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":86,"fsid":"f91af061-9eac-4793-87fa-8d27ae3d242f","created":"2024-03-16T07:24:20.357868+0000","modified":"2024-03-16T07:29:24.780749+0000","last_up_change":"2024-03-16T07:24:27.474980+0000","last_in_change":"2024-03-16T07:24:21.254179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T07:24:28.947521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2df14aac-98dc-4e3c-ae7e-9eb677aa30be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6801","nonce":2744935777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6803","nonce":2744935777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6807","nonce":2744935777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6805","nonce":2744935777}]},"public_addr":"172.21.15.49:6801/2744935777","cluster_addr":"172.21.15.49:6803/2744935777","heartbeat_back_addr":"172.21.15.49:6807/2744935777","heartbeat_front_addr":"172.21.15.49:6805/2744935777","state":["exists","up"]},{"osd":1,"uuid":"80461bd9-59ef-46df-9eea-bad92d960c57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6811","nonce":1655120118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6815","nonce":1655120118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6821","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6823","nonce":1655120118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6817","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6819","nonce":1655120118}]},"public_addr":"172.21.15.49:6811/1655120118","cluster_addr":"172.21.15.49:6815/1655120118","heartbeat_back_addr":"172.21.15.49:6823/1655120118","heartbeat_front_addr":"172.21.15.49:6819/1655120118","state":["exists","up"]},{"osd":2,"uuid":"d6bf40eb-6e42-4ec9-8b3d-0b6c5a6def79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6810","nonce":3815472376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6814","nonce":3815472376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6822","nonce":3815472376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6818","nonce":3815472376}]},"public_addr":"172.21.15.49:6810/3815472376","cluster_addr":"172.21.15.49:6814/3815472376","heartbeat_back_addr":"172.21.15.49:6822/3815472376","heartbeat_front_addr":"172.21.15.49:6818/3815472376","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.641492+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.668598+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.614940+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.49:6832/1067362108":"2024-03-17T07:29:21.776622+0000","172.21.15.49:6835/647809721":"2024-03-17T07:29:15.073767+0000","172.21.15.49:6834/647809721":"2024-03-17T07:29:15.073767+0000","172.21.15.49:0/132815804":"2024-03-17T07:29:07.672636+0000","172.21.15.49:0/1432118456":"2024-03-17T07:29:07.672636+0000","172.21.15.49:0/1092992686":"2024-03-17T07:29:07.672636+0000","172.21.15.49:0/3749314698":"2024-03-17T07:29:07.672636+0000","172.21.15.49:0/2350030053":"2024-03-17T07:29:07.672636+0000","172.21.15.49:6825/932165724":"2024-03-17T07:29:07.672636+0000","172.21.15.49:6824/932165724":"2024-03-17T07:29:07.672636+0000","172.21.15.49:6833/1067362108":"2024-03-17T07:29:21.776622+0000","172.21.15.49:0/2424772700":"2024-03-17T07:29:07.672636+0000","172.21.15.49:0/3374244176":"2024-03-17T07:29:07.672636+0000","172.21.15.49:0/2065171791":"2024-03-17T07:29:07.672636+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T07:29:26.122 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-16T07:24:28.947521+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-16T07:29:26.122 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-16T07:29:26.423 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2024-03-16T07:29:26.435 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_mirroring.TestMirroring.test_add_relative_directory_path' 2024-03-16T07:29:27.800 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-03-16T07:29:28.125 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-03-16T07:29:28.126 DEBUG:teuthology.orchestra.run.smithi049:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-03-16T07:29:28.176 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-03-16T07:29:28.176 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-03-16T07:29:28.177 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-16T07:29:28.192 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056354,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497664k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=13886 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248828k,nr_inodes=812207,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497664k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2024-03-16T07:29:28.192 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-03-16T07:29:28.192 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-16T07:29:28.247 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056354,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497664k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=13886 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248828k,nr_inodes=812207,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497664k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2024-03-16T07:29:28.247 INFO:tasks.cephfs.cephfs_test_case:[, ] 2024-03-16T07:29:28.248 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T07:29:28.629 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:29:28.629 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":61,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5259,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6827/3159374847","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":3159374847},{"type":"v1","addr":"172.21.15.49:6827","nonce":3159374847}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":46},{"gid":5260,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6829/626442568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":626442568},{"type":"v1","addr":"172.21.15.49:6829","nonce":626442568}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":46},{"gid":5267,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6831/3455133872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":3455133872},{"type":"v1","addr":"172.21.15.49:6831","nonce":3455133872}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":46},{"gid":5512,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/1907907321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":1907907321},{"type":"v1","addr":"172.21.15.49:6835","nonce":1907907321}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":59},{"gid":5554,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6833/1455699378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":1455699378},{"type":"v1","addr":"172.21.15.49:6833","nonce":1455699378}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":61}],"filesystems":[]} 2024-03-16T07:29:28.629 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 61 2024-03-16T07:29:28.641 INFO:tasks.ceph.mds.a:Restarting daemon 2024-03-16T07:29:28.642 INFO:tasks.ceph.mds.a:Stopping old one... 2024-03-16T07:29:28.642 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-03-16T07:29:28.642 INFO:teuthology.orchestra.run:waiting for 300 2024-03-16T07:29:28.642 INFO:tasks.ceph.mds.b:Restarting daemon 2024-03-16T07:29:28.642 INFO:tasks.ceph.mds.b:Stopping old one... 2024-03-16T07:29:28.642 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-03-16T07:29:28.642 INFO:teuthology.orchestra.run:waiting for 300 2024-03-16T07:29:28.643 INFO:tasks.ceph.mds.c:Restarting daemon 2024-03-16T07:29:28.643 INFO:tasks.ceph.mds.c:Stopping old one... 2024-03-16T07:29:28.643 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-03-16T07:29:28.643 INFO:teuthology.orchestra.run:waiting for 300 2024-03-16T07:29:28.643 INFO:tasks.ceph.mds.d:Restarting daemon 2024-03-16T07:29:28.643 INFO:tasks.ceph.mds.d:Stopping old one... 2024-03-16T07:29:28.643 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-03-16T07:29:28.643 INFO:teuthology.orchestra.run:waiting for 300 2024-03-16T07:29:28.644 INFO:tasks.ceph.mds.e:Restarting daemon 2024-03-16T07:29:28.644 INFO:tasks.ceph.mds.e:Stopping old one... 2024-03-16T07:29:28.644 DEBUG:tasks.ceph.mds.e:waiting for process to exit 2024-03-16T07:29:28.644 INFO:teuthology.orchestra.run:waiting for 300 2024-03-16T07:29:28.654 INFO:tasks.ceph.mds.b:Stopped 2024-03-16T07:29:28.654 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-03-16T07:29:28.655 INFO:tasks.ceph.mds.d:Stopped 2024-03-16T07:29:28.655 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-03-16T07:29:28.656 INFO:tasks.ceph.mds.e:Stopped 2024-03-16T07:29:28.657 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i e 2024-03-16T07:29:28.658 INFO:tasks.ceph.mds.a:Stopped 2024-03-16T07:29:28.658 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-03-16T07:29:28.659 INFO:tasks.ceph.mds.c:Stopped 2024-03-16T07:29:28.659 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-03-16T07:29:28.700 INFO:tasks.ceph.mds.b:Started 2024-03-16T07:29:28.701 INFO:tasks.ceph.mds.d:Started 2024-03-16T07:29:28.701 DEBUG:teuthology.parallel:result is None 2024-03-16T07:29:28.701 INFO:tasks.ceph.mds.e:Started 2024-03-16T07:29:28.701 DEBUG:teuthology.parallel:result is None 2024-03-16T07:29:28.702 DEBUG:teuthology.parallel:result is None 2024-03-16T07:29:28.702 INFO:tasks.ceph.mds.a:Started 2024-03-16T07:29:28.702 DEBUG:teuthology.parallel:result is None 2024-03-16T07:29:28.703 INFO:tasks.ceph.mds.c:Started 2024-03-16T07:29:28.703 DEBUG:teuthology.parallel:result is None 2024-03-16T07:29:28.703 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-03-16T07:29:28.795 INFO:tasks.ceph.mds.b.smithi049.stdout:starting mds.b at 2024-03-16T07:29:28.796 INFO:tasks.ceph.mds.c.smithi049.stdout:starting mds.c at 2024-03-16T07:29:28.811 INFO:tasks.ceph.mds.d.smithi049.stdout:starting mds.d at 2024-03-16T07:29:28.815 INFO:tasks.ceph.mds.a.smithi049.stdout:starting mds.a at 2024-03-16T07:29:28.816 INFO:tasks.ceph.mds.e.smithi049.stdout:starting mds.e at 2024-03-16T07:29:30.120 INFO:teuthology.orchestra.run.smithi049.stderr: removed all blocklist entries 2024-03-16T07:29:30.137 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-03-16T07:29:30.517 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:29:30.518 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-03-16T07:29:30.518 INFO:teuthology.orchestra.run.smithi049.stdout: "auth_dump": [ 2024-03-16T07:29:30.518 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:29:30.518 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.a", 2024-03-16T07:29:30.518 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAZSfVlKDkWLhAAVo2ZJMZSwTGLhocUPcHaUw==", 2024-03-16T07:29:30.518 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-03-16T07:29:30.518 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2024-03-16T07:29:30.518 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2024-03-16T07:29:30.518 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2024-03-16T07:29:30.518 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-03-16T07:29:30.518 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:29:30.518 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:29:30.519 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:29:30.519 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.b", 2024-03-16T07:29:30.519 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAZSfVl53IaNhAATOLh8Lzad03tyKQph1oowQ==", 2024-03-16T07:29:30.519 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-03-16T07:29:30.519 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2024-03-16T07:29:30.519 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2024-03-16T07:29:30.519 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2024-03-16T07:29:30.519 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-03-16T07:29:30.519 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:29:30.519 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:29:30.519 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:29:30.520 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.c", 2024-03-16T07:29:30.520 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAaSfVlI3p/AhAAZEetRkGlMLMEI7hMN7pS5w==", 2024-03-16T07:29:30.520 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-03-16T07:29:30.520 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2024-03-16T07:29:30.520 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2024-03-16T07:29:30.520 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2024-03-16T07:29:30.520 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-03-16T07:29:30.520 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:29:30.520 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:29:30.520 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:29:30.520 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.d", 2024-03-16T07:29:30.520 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAaSfVl3ueIChAA640lcZj8yUgH9jq7r7B+bA==", 2024-03-16T07:29:30.520 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-03-16T07:29:30.520 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2024-03-16T07:29:30.521 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2024-03-16T07:29:30.521 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2024-03-16T07:29:30.521 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-03-16T07:29:30.521 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:29:30.521 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:29:30.521 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:29:30.521 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.e", 2024-03-16T07:29:30.521 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAaSfVl8OySEhAAyF3ScxdSuQ0jhZhRbJ2gEg==", 2024-03-16T07:29:30.521 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-03-16T07:29:30.521 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2024-03-16T07:29:30.521 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2024-03-16T07:29:30.521 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2024-03-16T07:29:30.521 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-03-16T07:29:30.521 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:29:30.521 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:29:30.522 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:29:30.522 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.0", 2024-03-16T07:29:30.522 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAbSfVlNhmeKBAAVnxZbeNKU/kVViG2vb2+tQ==", 2024-03-16T07:29:30.522 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-03-16T07:29:30.522 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2024-03-16T07:29:30.522 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2024-03-16T07:29:30.522 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-03-16T07:29:30.522 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:29:30.522 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:29:30.522 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:29:30.522 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.1", 2024-03-16T07:29:30.522 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAdSfVlNNNkNhAAKhYH9tWxFT8HH6ZLMnaK7A==", 2024-03-16T07:29:30.522 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-03-16T07:29:30.523 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2024-03-16T07:29:30.523 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2024-03-16T07:29:30.523 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-03-16T07:29:30.523 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:29:30.523 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:29:30.523 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:29:30.523 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.2", 2024-03-16T07:29:30.523 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAgSfVlXJh1BxAAEOX+brDLOLTkp0thYQgMrw==", 2024-03-16T07:29:30.523 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-03-16T07:29:30.523 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2024-03-16T07:29:30.523 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2024-03-16T07:29:30.523 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-03-16T07:29:30.523 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:29:30.523 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:29:30.523 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:29:30.524 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.0", 2024-03-16T07:29:30.524 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAaSfVlmBmvGRAAaxdhkajaioVlq23dyv/g4g==", 2024-03-16T07:29:30.524 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-03-16T07:29:30.524 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2024-03-16T07:29:30.524 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow r", 2024-03-16T07:29:30.524 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-03-16T07:29:30.524 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:29:30.524 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:29:30.524 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:29:30.524 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.1", 2024-03-16T07:29:30.524 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAaSfVlCp2DHRAAdVsc+jh/QA74EBwffEqP5g==", 2024-03-16T07:29:30.524 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-03-16T07:29:30.524 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2024-03-16T07:29:30.524 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow r", 2024-03-16T07:29:30.524 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow rw", 2024-03-16T07:29:30.525 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rwx" 2024-03-16T07:29:30.525 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:29:30.525 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:29:30.525 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:29:30.525 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.admin", 2024-03-16T07:29:30.525 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAZSfVl0iRiFxAArXglVmR8MpJZNrXNv5tS7A==", 2024-03-16T07:29:30.525 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-03-16T07:29:30.525 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow *", 2024-03-16T07:29:30.525 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2024-03-16T07:29:30.525 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2024-03-16T07:29:30.525 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-03-16T07:29:30.525 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:29:30.526 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:29:30.526 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:29:30.526 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.mirror", 2024-03-16T07:29:30.526 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAaSfVldspUIRAAa1kAy23ZdMBfbhy+7HMVqA==", 2024-03-16T07:29:30.526 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-03-16T07:29:30.526 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow r", 2024-03-16T07:29:30.526 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow r", 2024-03-16T07:29:30.526 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "profile cephfs-mirror", 2024-03-16T07:29:30.526 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rw tag cephfs metadata=*, allow r tag cephfs data=*" 2024-03-16T07:29:30.526 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:29:30.526 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:29:30.526 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:29:30.526 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.mirror_remote", 2024-03-16T07:29:30.527 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAaSfVlaygzJRAAJVP9XACdC2Wikb4ZtKci9g==", 2024-03-16T07:29:30.527 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-03-16T07:29:30.527 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow rwps", 2024-03-16T07:29:30.527 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow r", 2024-03-16T07:29:30.527 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow r", 2024-03-16T07:29:30.527 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rw tag cephfs *=*" 2024-03-16T07:29:30.527 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:29:30.527 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:29:30.527 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:29:30.527 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mgr.x", 2024-03-16T07:29:30.527 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAZSfVlX9BEKhAAftDfT7+IPsQFhrTPl2h0SQ==", 2024-03-16T07:29:30.527 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-03-16T07:29:30.527 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow *", 2024-03-16T07:29:30.527 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile mgr", 2024-03-16T07:29:30.528 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-03-16T07:29:30.528 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:29:30.528 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:29:30.528 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2024-03-16T07:29:30.528 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-03-16T07:29:30.530 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T07:29:30.831 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:29:30.832 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":92,"fsid":"f91af061-9eac-4793-87fa-8d27ae3d242f","created":"2024-03-16T07:24:20.357868+0000","modified":"2024-03-16T07:29:30.121758+0000","last_up_change":"2024-03-16T07:24:27.474980+0000","last_in_change":"2024-03-16T07:24:21.254179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T07:24:28.947521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2df14aac-98dc-4e3c-ae7e-9eb677aa30be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6801","nonce":2744935777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6803","nonce":2744935777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6807","nonce":2744935777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6805","nonce":2744935777}]},"public_addr":"172.21.15.49:6801/2744935777","cluster_addr":"172.21.15.49:6803/2744935777","heartbeat_back_addr":"172.21.15.49:6807/2744935777","heartbeat_front_addr":"172.21.15.49:6805/2744935777","state":["exists","up"]},{"osd":1,"uuid":"80461bd9-59ef-46df-9eea-bad92d960c57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6811","nonce":1655120118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6815","nonce":1655120118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6821","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6823","nonce":1655120118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6817","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6819","nonce":1655120118}]},"public_addr":"172.21.15.49:6811/1655120118","cluster_addr":"172.21.15.49:6815/1655120118","heartbeat_back_addr":"172.21.15.49:6823/1655120118","heartbeat_front_addr":"172.21.15.49:6819/1655120118","state":["exists","up"]},{"osd":2,"uuid":"d6bf40eb-6e42-4ec9-8b3d-0b6c5a6def79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6810","nonce":3815472376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6814","nonce":3815472376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6822","nonce":3815472376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6818","nonce":3815472376}]},"public_addr":"172.21.15.49:6810/3815472376","cluster_addr":"172.21.15.49:6814/3815472376","heartbeat_back_addr":"172.21.15.49:6822/3815472376","heartbeat_front_addr":"172.21.15.49:6818/3815472376","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.641492+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.668598+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.614940+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T07:29:30.844 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-16T07:24:28.947521+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-16T07:29:30.844 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-16T07:29:31.148 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2024-03-16T07:29:31.161 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-03-16T07:29:31.463 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:29:31.463 INFO:teuthology.orchestra.run.smithi049.stdout:[ 2024-03-16T07:29:31.464 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:29:31.464 INFO:teuthology.orchestra.run.smithi049.stdout: "poolnum": 1, 2024-03-16T07:29:31.464 INFO:teuthology.orchestra.run.smithi049.stdout: "poolname": ".mgr" 2024-03-16T07:29:31.464 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:29:31.464 INFO:teuthology.orchestra.run.smithi049.stdout:] 2024-03-16T07:29:31.476 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-03-16T07:29:31.476 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-03-16T07:29:32.121 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_metadata' created 2024-03-16T07:29:32.140 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-03-16T07:29:33.124 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_data' created 2024-03-16T07:29:33.155 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-03-16T07:29:34.125 INFO:teuthology.orchestra.run.smithi049.stderr:new fs with metadata pool 16 and data pool 17 2024-03-16T07:29:34.144 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T07:29:34.447 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:29:34.447 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":95,"fsid":"f91af061-9eac-4793-87fa-8d27ae3d242f","created":"2024-03-16T07:24:20.357868+0000","modified":"2024-03-16T07:29:33.502908+0000","last_up_change":"2024-03-16T07:24:27.474980+0000","last_in_change":"2024-03-16T07:24:21.254179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T07:24:28.947521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-03-16T07:29:31.811291+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-03-16T07:29:32.483018+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3600000143051147,"score_stable":1.3600000143051147,"optimal_score":1,"raw_score_acting":1.3600000143051147,"raw_score_stable":1.3600000143051147,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2df14aac-98dc-4e3c-ae7e-9eb677aa30be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6801","nonce":2744935777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6803","nonce":2744935777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6807","nonce":2744935777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6805","nonce":2744935777}]},"public_addr":"172.21.15.49:6801/2744935777","cluster_addr":"172.21.15.49:6803/2744935777","heartbeat_back_addr":"172.21.15.49:6807/2744935777","heartbeat_front_addr":"172.21.15.49:6805/2744935777","state":["exists","up"]},{"osd":1,"uuid":"80461bd9-59ef-46df-9eea-bad92d960c57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6811","nonce":1655120118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6815","nonce":1655120118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6821","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6823","nonce":1655120118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6817","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6819","nonce":1655120118}]},"public_addr":"172.21.15.49:6811/1655120118","cluster_addr":"172.21.15.49:6815/1655120118","heartbeat_back_addr":"172.21.15.49:6823/1655120118","heartbeat_front_addr":"172.21.15.49:6819/1655120118","state":["exists","up"]},{"osd":2,"uuid":"d6bf40eb-6e42-4ec9-8b3d-0b6c5a6def79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6810","nonce":3815472376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6814","nonce":3815472376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6822","nonce":3815472376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6818","nonce":3815472376}]},"public_addr":"172.21.15.49:6810/3815472376","cluster_addr":"172.21.15.49:6814/3815472376","heartbeat_back_addr":"172.21.15.49:6822/3815472376","heartbeat_front_addr":"172.21.15.49:6818/3815472376","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.641492+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.668598+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.614940+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T07:29:34.459 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T07:29:34.762 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:29:34.762 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":95,"fsid":"f91af061-9eac-4793-87fa-8d27ae3d242f","created":"2024-03-16T07:24:20.357868+0000","modified":"2024-03-16T07:29:33.502908+0000","last_up_change":"2024-03-16T07:24:27.474980+0000","last_in_change":"2024-03-16T07:24:21.254179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T07:24:28.947521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-03-16T07:29:31.811291+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-03-16T07:29:32.483018+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3600000143051147,"score_stable":1.3600000143051147,"optimal_score":1,"raw_score_acting":1.3600000143051147,"raw_score_stable":1.3600000143051147,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2df14aac-98dc-4e3c-ae7e-9eb677aa30be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6801","nonce":2744935777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6803","nonce":2744935777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6807","nonce":2744935777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6805","nonce":2744935777}]},"public_addr":"172.21.15.49:6801/2744935777","cluster_addr":"172.21.15.49:6803/2744935777","heartbeat_back_addr":"172.21.15.49:6807/2744935777","heartbeat_front_addr":"172.21.15.49:6805/2744935777","state":["exists","up"]},{"osd":1,"uuid":"80461bd9-59ef-46df-9eea-bad92d960c57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6811","nonce":1655120118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6815","nonce":1655120118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6821","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6823","nonce":1655120118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6817","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6819","nonce":1655120118}]},"public_addr":"172.21.15.49:6811/1655120118","cluster_addr":"172.21.15.49:6815/1655120118","heartbeat_back_addr":"172.21.15.49:6823/1655120118","heartbeat_front_addr":"172.21.15.49:6819/1655120118","state":["exists","up"]},{"osd":2,"uuid":"d6bf40eb-6e42-4ec9-8b3d-0b6c5a6def79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6810","nonce":3815472376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6814","nonce":3815472376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6822","nonce":3815472376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6818","nonce":3815472376}]},"public_addr":"172.21.15.49:6810/3815472376","cluster_addr":"172.21.15.49:6814/3815472376","heartbeat_back_addr":"172.21.15.49:6822/3815472376","heartbeat_front_addr":"172.21.15.49:6818/3815472376","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.641492+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.668598+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.614940+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T07:29:34.774 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-03-16T07:29:35.142 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-03-16T07:29:35.143 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-03-16T07:29:36.146 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-03-16T07:29:36.146 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T07:29:36.621 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:29:36.621 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":65,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5588,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6827/1816248233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":1816248233},{"type":"v1","addr":"172.21.15.49:6827","nonce":1816248233}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62},{"gid":5589,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6829/2028370121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":2028370121},{"type":"v1","addr":"172.21.15.49:6829","nonce":2028370121}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62},{"gid":5596,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6831/2282357763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":2282357763},{"type":"v1","addr":"172.21.15.49:6831","nonce":2282357763}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62},{"gid":5597,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6833/2335462758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":2335462758},{"type":"v1","addr":"172.21.15.49:6833","nonce":2335462758}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62}],"filesystems":[{"mdsmap":{"epoch":65,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-16T07:29:33.503199+0000","modified":"2024-03-16T07:29:35.492553+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5598},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5598":{"gid":5598,"name":"e","rank":0,"incarnation":63,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6835/2451687435","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":2451687435},{"type":"v1","addr":"172.21.15.49:6835","nonce":2451687435}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5598,"qdb_cluster":[5598]},"id":8}]} 2024-03-16T07:29:36.621 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 65 2024-03-16T07:29:36.638 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T07:29:36.947 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:29:36.947 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":96,"fsid":"f91af061-9eac-4793-87fa-8d27ae3d242f","created":"2024-03-16T07:24:20.357868+0000","modified":"2024-03-16T07:29:34.813554+0000","last_up_change":"2024-03-16T07:24:27.474980+0000","last_in_change":"2024-03-16T07:24:21.254179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T07:24:28.947521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-03-16T07:29:31.811291+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-03-16T07:29:32.483018+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"96","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3600000143051147,"score_stable":1.3600000143051147,"optimal_score":1,"raw_score_acting":1.3600000143051147,"raw_score_stable":1.3600000143051147,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2df14aac-98dc-4e3c-ae7e-9eb677aa30be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6801","nonce":2744935777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6803","nonce":2744935777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6807","nonce":2744935777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6805","nonce":2744935777}]},"public_addr":"172.21.15.49:6801/2744935777","cluster_addr":"172.21.15.49:6803/2744935777","heartbeat_back_addr":"172.21.15.49:6807/2744935777","heartbeat_front_addr":"172.21.15.49:6805/2744935777","state":["exists","up"]},{"osd":1,"uuid":"80461bd9-59ef-46df-9eea-bad92d960c57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6811","nonce":1655120118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6815","nonce":1655120118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6821","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6823","nonce":1655120118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6817","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6819","nonce":1655120118}]},"public_addr":"172.21.15.49:6811/1655120118","cluster_addr":"172.21.15.49:6815/1655120118","heartbeat_back_addr":"172.21.15.49:6823/1655120118","heartbeat_front_addr":"172.21.15.49:6819/1655120118","state":["exists","up"]},{"osd":2,"uuid":"d6bf40eb-6e42-4ec9-8b3d-0b6c5a6def79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6810","nonce":3815472376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6814","nonce":3815472376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6822","nonce":3815472376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6818","nonce":3815472376}]},"public_addr":"172.21.15.49:6810/3815472376","cluster_addr":"172.21.15.49:6814/3815472376","heartbeat_back_addr":"172.21.15.49:6822/3815472376","heartbeat_front_addr":"172.21.15.49:6818/3815472376","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.641492+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.668598+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.614940+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T07:29:36.960 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-03-16T07:29:36.961 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-16T07:29:37.347 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:29:37.348 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2024-03-16T07:29:37.362 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":31,"stamp":"2024-03-16T07:29:36.166204+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":586,"num_read_kb":1121,"num_write":237,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":152,"ondisk_log_size":152,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":13,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":314572800,"kb_used":97456,"kb_used_data":3908,"kb_used_omap":4,"kb_used_meta":93499,"kb_avail":314475344,"statfs":{"total":322122547200,"available":322022752256,"internally_reserved":0,"allocated":4001792,"data_stored":2297075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":95743311},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.041864"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.140450+0000","last_change":"2024-03-16T07:29:33.140450+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.140450+0000","last_undegraded":"2024-03-16T07:29:33.140450+0000","last_fullsized":"2024-03-16T07:29:33.140450+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.134820+0000","last_change":"2024-03-16T07:29:33.134820+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.134820+0000","last_undegraded":"2024-03-16T07:29:33.134820+0000","last_fullsized":"2024-03-16T07:29:33.134820+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.137535+0000","last_change":"2024-03-16T07:29:33.137535+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.137535+0000","last_undegraded":"2024-03-16T07:29:33.137535+0000","last_fullsized":"2024-03-16T07:29:33.137535+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.140710+0000","last_change":"2024-03-16T07:29:33.140710+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.140710+0000","last_undegraded":"2024-03-16T07:29:33.140710+0000","last_fullsized":"2024-03-16T07:29:33.140710+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.137548+0000","last_change":"2024-03-16T07:29:33.137548+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.137548+0000","last_undegraded":"2024-03-16T07:29:33.137548+0000","last_fullsized":"2024-03-16T07:29:33.137548+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.137600+0000","last_change":"2024-03-16T07:29:33.137600+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.137600+0000","last_undegraded":"2024-03-16T07:29:33.137600+0000","last_fullsized":"2024-03-16T07:29:33.137600+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.134947+0000","last_change":"2024-03-16T07:29:33.134947+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.134947+0000","last_undegraded":"2024-03-16T07:29:33.134947+0000","last_fullsized":"2024-03-16T07:29:33.134947+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.135232+0000","last_change":"2024-03-16T07:29:33.135232+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.135232+0000","last_undegraded":"2024-03-16T07:29:33.135232+0000","last_fullsized":"2024-03-16T07:29:33.135232+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.139990+0000","last_change":"2024-03-16T07:29:33.139990+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.139990+0000","last_undegraded":"2024-03-16T07:29:33.139990+0000","last_fullsized":"2024-03-16T07:29:33.139990+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.140060+0000","last_change":"2024-03-16T07:29:33.140060+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.140060+0000","last_undegraded":"2024-03-16T07:29:33.140060+0000","last_fullsized":"2024-03-16T07:29:33.140060+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.140023+0000","last_change":"2024-03-16T07:29:33.140023+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.140023+0000","last_undegraded":"2024-03-16T07:29:33.140023+0000","last_fullsized":"2024-03-16T07:29:33.140023+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.140376+0000","last_change":"2024-03-16T07:29:33.140376+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.140376+0000","last_undegraded":"2024-03-16T07:29:33.140376+0000","last_fullsized":"2024-03-16T07:29:33.140376+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.136995+0000","last_change":"2024-03-16T07:29:33.136995+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.136995+0000","last_undegraded":"2024-03-16T07:29:33.136995+0000","last_fullsized":"2024-03-16T07:29:33.136995+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.139015+0000","last_change":"2024-03-16T07:29:33.139015+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.139015+0000","last_undegraded":"2024-03-16T07:29:33.139015+0000","last_fullsized":"2024-03-16T07:29:33.139015+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.137927+0000","last_change":"2024-03-16T07:29:33.137927+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.137927+0000","last_undegraded":"2024-03-16T07:29:33.137927+0000","last_fullsized":"2024-03-16T07:29:33.137927+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.139019+0000","last_change":"2024-03-16T07:29:33.139019+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.139019+0000","last_undegraded":"2024-03-16T07:29:33.139019+0000","last_fullsized":"2024-03-16T07:29:33.139019+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.138741+0000","last_change":"2024-03-16T07:29:33.138741+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.138741+0000","last_undegraded":"2024-03-16T07:29:33.138741+0000","last_fullsized":"2024-03-16T07:29:33.138741+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.138601+0000","last_change":"2024-03-16T07:29:33.138601+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.138601+0000","last_undegraded":"2024-03-16T07:29:33.138601+0000","last_fullsized":"2024-03-16T07:29:33.138601+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.137234+0000","last_change":"2024-03-16T07:29:33.137234+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.137234+0000","last_undegraded":"2024-03-16T07:29:33.137234+0000","last_fullsized":"2024-03-16T07:29:33.137234+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.137282+0000","last_change":"2024-03-16T07:29:33.137282+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.137282+0000","last_undegraded":"2024-03-16T07:29:33.137282+0000","last_fullsized":"2024-03-16T07:29:33.137282+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.136651+0000","last_change":"2024-03-16T07:29:33.136651+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.136651+0000","last_undegraded":"2024-03-16T07:29:33.136651+0000","last_fullsized":"2024-03-16T07:29:33.136651+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.135578+0000","last_change":"2024-03-16T07:29:33.135578+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.135578+0000","last_undegraded":"2024-03-16T07:29:33.135578+0000","last_fullsized":"2024-03-16T07:29:33.135578+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.138948+0000","last_change":"2024-03-16T07:29:33.138948+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.138948+0000","last_undegraded":"2024-03-16T07:29:33.138948+0000","last_fullsized":"2024-03-16T07:29:33.138948+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.133877+0000","last_change":"2024-03-16T07:29:33.133877+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.133877+0000","last_undegraded":"2024-03-16T07:29:33.133877+0000","last_fullsized":"2024-03-16T07:29:33.133877+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.134216+0000","last_change":"2024-03-16T07:29:33.134216+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.134216+0000","last_undegraded":"2024-03-16T07:29:33.134216+0000","last_fullsized":"2024-03-16T07:29:33.134216+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.136040+0000","last_change":"2024-03-16T07:29:33.136040+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.136040+0000","last_undegraded":"2024-03-16T07:29:33.136040+0000","last_fullsized":"2024-03-16T07:29:33.136040+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.136915+0000","last_change":"2024-03-16T07:29:33.136915+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.136915+0000","last_undegraded":"2024-03-16T07:29:33.136915+0000","last_fullsized":"2024-03-16T07:29:33.136915+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.135741+0000","last_change":"2024-03-16T07:29:33.135741+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.135741+0000","last_undegraded":"2024-03-16T07:29:33.135741+0000","last_fullsized":"2024-03-16T07:29:33.135741+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.139465+0000","last_change":"2024-03-16T07:29:33.139465+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.139465+0000","last_undegraded":"2024-03-16T07:29:33.139465+0000","last_fullsized":"2024-03-16T07:29:33.139465+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.132351+0000","last_change":"2024-03-16T07:29:33.132351+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.132351+0000","last_undegraded":"2024-03-16T07:29:33.132351+0000","last_fullsized":"2024-03-16T07:29:33.132351+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.135630+0000","last_change":"2024-03-16T07:29:33.135630+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.135630+0000","last_undegraded":"2024-03-16T07:29:33.135630+0000","last_fullsized":"2024-03-16T07:29:33.135630+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.137860+0000","last_change":"2024-03-16T07:29:33.137860+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.137860+0000","last_undegraded":"2024-03-16T07:29:33.137860+0000","last_fullsized":"2024-03-16T07:29:33.137860+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.138139+0000","last_change":"2024-03-16T07:29:33.138139+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.138139+0000","last_undegraded":"2024-03-16T07:29:33.138139+0000","last_fullsized":"2024-03-16T07:29:33.138139+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-03-16T07:29:33.143252+0000","last_change":"2024-03-16T07:29:33.142157+0000","last_active":"2024-03-16T07:29:33.143252+0000","last_peered":"2024-03-16T07:29:33.143252+0000","last_clean":"2024-03-16T07:29:33.143252+0000","last_became_active":"2024-03-16T07:29:33.141750+0000","last_became_peered":"2024-03-16T07:29:33.141750+0000","last_unstale":"2024-03-16T07:29:33.143252+0000","last_undegraded":"2024-03-16T07:29:33.143252+0000","last_fullsized":"2024-03-16T07:29:33.143252+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:44:37.218059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.135311+0000","last_change":"2024-03-16T07:29:33.135311+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.135311+0000","last_undegraded":"2024-03-16T07:29:33.135311+0000","last_fullsized":"2024-03-16T07:29:33.135311+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-03-16T07:29:33.146214+0000","last_change":"2024-03-16T07:29:33.144641+0000","last_active":"2024-03-16T07:29:33.146214+0000","last_peered":"2024-03-16T07:29:33.146214+0000","last_clean":"2024-03-16T07:29:33.146214+0000","last_became_active":"2024-03-16T07:29:33.144370+0000","last_became_peered":"2024-03-16T07:29:33.144370+0000","last_unstale":"2024-03-16T07:29:33.146214+0000","last_undegraded":"2024-03-16T07:29:33.146214+0000","last_fullsized":"2024-03-16T07:29:33.146214+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:40:18.934958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.133066+0000","last_change":"2024-03-16T07:29:33.133066+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.133066+0000","last_undegraded":"2024-03-16T07:29:33.133066+0000","last_fullsized":"2024-03-16T07:29:33.133066+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-03-16T07:29:33.147993+0000","last_change":"2024-03-16T07:29:33.145140+0000","last_active":"2024-03-16T07:29:33.147993+0000","last_peered":"2024-03-16T07:29:33.147993+0000","last_clean":"2024-03-16T07:29:33.147993+0000","last_became_active":"2024-03-16T07:29:33.144891+0000","last_became_peered":"2024-03-16T07:29:33.144891+0000","last_unstale":"2024-03-16T07:29:33.147993+0000","last_undegraded":"2024-03-16T07:29:33.147993+0000","last_fullsized":"2024-03-16T07:29:33.147993+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:37:10.315423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.133620+0000","last_change":"2024-03-16T07:29:33.133620+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.133620+0000","last_undegraded":"2024-03-16T07:29:33.133620+0000","last_fullsized":"2024-03-16T07:29:33.133620+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-03-16T07:29:33.144911+0000","last_change":"2024-03-16T07:29:33.143477+0000","last_active":"2024-03-16T07:29:33.144911+0000","last_peered":"2024-03-16T07:29:33.144911+0000","last_clean":"2024-03-16T07:29:33.144911+0000","last_became_active":"2024-03-16T07:29:33.143221+0000","last_became_peered":"2024-03-16T07:29:33.143221+0000","last_unstale":"2024-03-16T07:29:33.144911+0000","last_undegraded":"2024-03-16T07:29:33.144911+0000","last_fullsized":"2024-03-16T07:29:33.144911+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:35:05.997178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.134166+0000","last_change":"2024-03-16T07:29:33.134166+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.134166+0000","last_undegraded":"2024-03-16T07:29:33.134166+0000","last_fullsized":"2024-03-16T07:29:33.134166+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-03-16T07:29:33.152398+0000","last_change":"2024-03-16T07:29:33.151173+0000","last_active":"2024-03-16T07:29:33.152398+0000","last_peered":"2024-03-16T07:29:33.152398+0000","last_clean":"2024-03-16T07:29:33.152398+0000","last_became_active":"2024-03-16T07:29:33.150934+0000","last_became_peered":"2024-03-16T07:29:33.150934+0000","last_unstale":"2024-03-16T07:29:33.152398+0000","last_undegraded":"2024-03-16T07:29:33.152398+0000","last_fullsized":"2024-03-16T07:29:33.152398+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:19:24.993683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.135250+0000","last_change":"2024-03-16T07:29:33.135250+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.135250+0000","last_undegraded":"2024-03-16T07:29:33.135250+0000","last_fullsized":"2024-03-16T07:29:33.135250+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-03-16T07:29:33.153893+0000","last_change":"2024-03-16T07:29:33.152347+0000","last_active":"2024-03-16T07:29:33.153893+0000","last_peered":"2024-03-16T07:29:33.153893+0000","last_clean":"2024-03-16T07:29:33.153893+0000","last_became_active":"2024-03-16T07:29:33.152108+0000","last_became_peered":"2024-03-16T07:29:33.152108+0000","last_unstale":"2024-03-16T07:29:33.153893+0000","last_undegraded":"2024-03-16T07:29:33.153893+0000","last_fullsized":"2024-03-16T07:29:33.153893+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:54:27.091427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.134164+0000","last_change":"2024-03-16T07:29:33.134164+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.134164+0000","last_undegraded":"2024-03-16T07:29:33.134164+0000","last_fullsized":"2024-03-16T07:29:33.134164+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-03-16T07:29:33.152354+0000","last_change":"2024-03-16T07:29:33.149360+0000","last_active":"2024-03-16T07:29:33.152354+0000","last_peered":"2024-03-16T07:29:33.152354+0000","last_clean":"2024-03-16T07:29:33.152354+0000","last_became_active":"2024-03-16T07:29:33.148940+0000","last_became_peered":"2024-03-16T07:29:33.148940+0000","last_unstale":"2024-03-16T07:29:33.152354+0000","last_undegraded":"2024-03-16T07:29:33.152354+0000","last_fullsized":"2024-03-16T07:29:33.152354+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:44:58.999351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.133015+0000","last_change":"2024-03-16T07:29:33.133015+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.133015+0000","last_undegraded":"2024-03-16T07:29:33.133015+0000","last_fullsized":"2024-03-16T07:29:33.133015+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-03-16T07:29:33.148332+0000","last_change":"2024-03-16T07:29:33.147410+0000","last_active":"2024-03-16T07:29:33.148332+0000","last_peered":"2024-03-16T07:29:33.148332+0000","last_clean":"2024-03-16T07:29:33.148332+0000","last_became_active":"2024-03-16T07:29:33.146998+0000","last_became_peered":"2024-03-16T07:29:33.146998+0000","last_unstale":"2024-03-16T07:29:33.148332+0000","last_undegraded":"2024-03-16T07:29:33.148332+0000","last_fullsized":"2024-03-16T07:29:33.148332+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:01:51.501320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.131243+0000","last_change":"2024-03-16T07:29:33.131243+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.131243+0000","last_undegraded":"2024-03-16T07:29:33.131243+0000","last_fullsized":"2024-03-16T07:29:33.131243+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-03-16T07:29:33.147633+0000","last_change":"2024-03-16T07:29:33.145570+0000","last_active":"2024-03-16T07:29:33.147633+0000","last_peered":"2024-03-16T07:29:33.147633+0000","last_clean":"2024-03-16T07:29:33.147633+0000","last_became_active":"2024-03-16T07:29:33.145332+0000","last_became_peered":"2024-03-16T07:29:33.145332+0000","last_unstale":"2024-03-16T07:29:33.147633+0000","last_undegraded":"2024-03-16T07:29:33.147633+0000","last_fullsized":"2024-03-16T07:29:33.147633+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:45:10.083590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.133380+0000","last_change":"2024-03-16T07:29:33.133380+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.133380+0000","last_undegraded":"2024-03-16T07:29:33.133380+0000","last_fullsized":"2024-03-16T07:29:33.133380+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-03-16T07:29:33.147171+0000","last_change":"2024-03-16T07:29:33.145151+0000","last_active":"2024-03-16T07:29:33.147171+0000","last_peered":"2024-03-16T07:29:33.147171+0000","last_clean":"2024-03-16T07:29:33.147171+0000","last_became_active":"2024-03-16T07:29:33.144911+0000","last_became_peered":"2024-03-16T07:29:33.144911+0000","last_unstale":"2024-03-16T07:29:33.147171+0000","last_undegraded":"2024-03-16T07:29:33.147171+0000","last_fullsized":"2024-03-16T07:29:33.147171+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:52:07.278437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.132744+0000","last_change":"2024-03-16T07:29:33.132744+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.132744+0000","last_undegraded":"2024-03-16T07:29:33.132744+0000","last_fullsized":"2024-03-16T07:29:33.132744+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-03-16T07:29:33.148579+0000","last_change":"2024-03-16T07:29:33.145719+0000","last_active":"2024-03-16T07:29:33.148579+0000","last_peered":"2024-03-16T07:29:33.148579+0000","last_clean":"2024-03-16T07:29:33.148579+0000","last_became_active":"2024-03-16T07:29:33.141978+0000","last_became_peered":"2024-03-16T07:29:33.141978+0000","last_unstale":"2024-03-16T07:29:33.148579+0000","last_undegraded":"2024-03-16T07:29:33.148579+0000","last_fullsized":"2024-03-16T07:29:33.148579+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:53:03.878506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.135951+0000","last_change":"2024-03-16T07:29:33.135951+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.135951+0000","last_undegraded":"2024-03-16T07:29:33.135951+0000","last_fullsized":"2024-03-16T07:29:33.135951+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-03-16T07:29:33.143953+0000","last_change":"2024-03-16T07:29:33.143457+0000","last_active":"2024-03-16T07:29:33.143953+0000","last_peered":"2024-03-16T07:29:33.143953+0000","last_clean":"2024-03-16T07:29:33.143953+0000","last_became_active":"2024-03-16T07:29:33.143020+0000","last_became_peered":"2024-03-16T07:29:33.143020+0000","last_unstale":"2024-03-16T07:29:33.143953+0000","last_undegraded":"2024-03-16T07:29:33.143953+0000","last_fullsized":"2024-03-16T07:29:33.143953+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:04:32.253995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.130820+0000","last_change":"2024-03-16T07:29:33.130820+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.130820+0000","last_undegraded":"2024-03-16T07:29:33.130820+0000","last_fullsized":"2024-03-16T07:29:33.130820+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-03-16T07:29:33.152379+0000","last_change":"2024-03-16T07:29:33.150475+0000","last_active":"2024-03-16T07:29:33.152379+0000","last_peered":"2024-03-16T07:29:33.152379+0000","last_clean":"2024-03-16T07:29:33.152379+0000","last_became_active":"2024-03-16T07:29:33.150220+0000","last_became_peered":"2024-03-16T07:29:33.150220+0000","last_unstale":"2024-03-16T07:29:33.152379+0000","last_undegraded":"2024-03-16T07:29:33.152379+0000","last_fullsized":"2024-03-16T07:29:33.152379+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:31:42.068184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.133883+0000","last_change":"2024-03-16T07:29:33.133883+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.133883+0000","last_undegraded":"2024-03-16T07:29:33.133883+0000","last_fullsized":"2024-03-16T07:29:33.133883+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-03-16T07:29:33.151494+0000","last_change":"2024-03-16T07:29:33.144891+0000","last_active":"2024-03-16T07:29:33.151494+0000","last_peered":"2024-03-16T07:29:33.151494+0000","last_clean":"2024-03-16T07:29:33.151494+0000","last_became_active":"2024-03-16T07:29:33.144574+0000","last_became_peered":"2024-03-16T07:29:33.144574+0000","last_unstale":"2024-03-16T07:29:33.151494+0000","last_undegraded":"2024-03-16T07:29:33.151494+0000","last_fullsized":"2024-03-16T07:29:33.151494+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:11:59.374012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.132033+0000","last_change":"2024-03-16T07:29:33.132033+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.132033+0000","last_undegraded":"2024-03-16T07:29:33.132033+0000","last_fullsized":"2024-03-16T07:29:33.132033+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-03-16T07:29:33.151099+0000","last_change":"2024-03-16T07:29:33.147235+0000","last_active":"2024-03-16T07:29:33.151099+0000","last_peered":"2024-03-16T07:29:33.151099+0000","last_clean":"2024-03-16T07:29:33.151099+0000","last_became_active":"2024-03-16T07:29:33.146884+0000","last_became_peered":"2024-03-16T07:29:33.146884+0000","last_unstale":"2024-03-16T07:29:33.151099+0000","last_undegraded":"2024-03-16T07:29:33.151099+0000","last_fullsized":"2024-03-16T07:29:33.151099+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:57:08.184067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.130807+0000","last_change":"2024-03-16T07:29:33.130807+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.130807+0000","last_undegraded":"2024-03-16T07:29:33.130807+0000","last_fullsized":"2024-03-16T07:29:33.130807+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-03-16T07:29:33.143536+0000","last_change":"2024-03-16T07:29:33.142821+0000","last_active":"2024-03-16T07:29:33.143536+0000","last_peered":"2024-03-16T07:29:33.143536+0000","last_clean":"2024-03-16T07:29:33.143536+0000","last_became_active":"2024-03-16T07:29:33.142350+0000","last_became_peered":"2024-03-16T07:29:33.142350+0000","last_unstale":"2024-03-16T07:29:33.143536+0000","last_undegraded":"2024-03-16T07:29:33.143536+0000","last_fullsized":"2024-03-16T07:29:33.143536+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:57:53.414562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.135272+0000","last_change":"2024-03-16T07:29:33.135272+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.135272+0000","last_undegraded":"2024-03-16T07:29:33.135272+0000","last_fullsized":"2024-03-16T07:29:33.135272+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-03-16T07:29:33.150743+0000","last_change":"2024-03-16T07:29:33.149722+0000","last_active":"2024-03-16T07:29:33.150743+0000","last_peered":"2024-03-16T07:29:33.150743+0000","last_clean":"2024-03-16T07:29:33.150743+0000","last_became_active":"2024-03-16T07:29:33.149431+0000","last_became_peered":"2024-03-16T07:29:33.149431+0000","last_unstale":"2024-03-16T07:29:33.150743+0000","last_undegraded":"2024-03-16T07:29:33.150743+0000","last_fullsized":"2024-03-16T07:29:33.150743+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:34:21.521970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.133508+0000","last_change":"2024-03-16T07:29:33.133508+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.133508+0000","last_undegraded":"2024-03-16T07:29:33.133508+0000","last_fullsized":"2024-03-16T07:29:33.133508+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-03-16T07:29:33.145842+0000","last_change":"2024-03-16T07:29:33.142518+0000","last_active":"2024-03-16T07:29:33.145842+0000","last_peered":"2024-03-16T07:29:33.145842+0000","last_clean":"2024-03-16T07:29:33.145842+0000","last_became_active":"2024-03-16T07:29:33.141657+0000","last_became_peered":"2024-03-16T07:29:33.141657+0000","last_unstale":"2024-03-16T07:29:33.145842+0000","last_undegraded":"2024-03-16T07:29:33.145842+0000","last_fullsized":"2024-03-16T07:29:33.145842+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:22:00.943132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.133761+0000","last_change":"2024-03-16T07:29:33.133761+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.133761+0000","last_undegraded":"2024-03-16T07:29:33.133761+0000","last_fullsized":"2024-03-16T07:29:33.133761+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-03-16T07:29:33.143936+0000","last_change":"2024-03-16T07:29:33.143262+0000","last_active":"2024-03-16T07:29:33.143936+0000","last_peered":"2024-03-16T07:29:33.143936+0000","last_clean":"2024-03-16T07:29:33.143936+0000","last_became_active":"2024-03-16T07:29:33.142682+0000","last_became_peered":"2024-03-16T07:29:33.142682+0000","last_unstale":"2024-03-16T07:29:33.143936+0000","last_undegraded":"2024-03-16T07:29:33.143936+0000","last_fullsized":"2024-03-16T07:29:33.143936+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:27:42.837553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.134707+0000","last_change":"2024-03-16T07:29:33.134707+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.134707+0000","last_undegraded":"2024-03-16T07:29:33.134707+0000","last_fullsized":"2024-03-16T07:29:33.134707+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-03-16T07:29:33.151877+0000","last_change":"2024-03-16T07:29:33.147427+0000","last_active":"2024-03-16T07:29:33.151877+0000","last_peered":"2024-03-16T07:29:33.151877+0000","last_clean":"2024-03-16T07:29:33.151877+0000","last_became_active":"2024-03-16T07:29:33.147011+0000","last_became_peered":"2024-03-16T07:29:33.147011+0000","last_unstale":"2024-03-16T07:29:33.151877+0000","last_undegraded":"2024-03-16T07:29:33.151877+0000","last_fullsized":"2024-03-16T07:29:33.151877+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:52:43.283375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.133048+0000","last_change":"2024-03-16T07:29:33.133048+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.133048+0000","last_undegraded":"2024-03-16T07:29:33.133048+0000","last_fullsized":"2024-03-16T07:29:33.133048+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-03-16T07:29:33.153913+0000","last_change":"2024-03-16T07:29:33.152620+0000","last_active":"2024-03-16T07:29:33.153913+0000","last_peered":"2024-03-16T07:29:33.153913+0000","last_clean":"2024-03-16T07:29:33.153913+0000","last_became_active":"2024-03-16T07:29:33.152352+0000","last_became_peered":"2024-03-16T07:29:33.152352+0000","last_unstale":"2024-03-16T07:29:33.153913+0000","last_undegraded":"2024-03-16T07:29:33.153913+0000","last_fullsized":"2024-03-16T07:29:33.153913+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:24:19.329381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.133122+0000","last_change":"2024-03-16T07:29:33.133122+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.133122+0000","last_undegraded":"2024-03-16T07:29:33.133122+0000","last_fullsized":"2024-03-16T07:29:33.133122+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-03-16T07:29:33.151908+0000","last_change":"2024-03-16T07:29:33.147855+0000","last_active":"2024-03-16T07:29:33.151908+0000","last_peered":"2024-03-16T07:29:33.151908+0000","last_clean":"2024-03-16T07:29:33.151908+0000","last_became_active":"2024-03-16T07:29:33.147615+0000","last_became_peered":"2024-03-16T07:29:33.147615+0000","last_unstale":"2024-03-16T07:29:33.151908+0000","last_undegraded":"2024-03-16T07:29:33.151908+0000","last_fullsized":"2024-03-16T07:29:33.151908+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:52:31.609104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.131590+0000","last_change":"2024-03-16T07:29:33.131590+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.131590+0000","last_undegraded":"2024-03-16T07:29:33.131590+0000","last_fullsized":"2024-03-16T07:29:33.131590+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-03-16T07:29:33.148313+0000","last_change":"2024-03-16T07:29:33.147292+0000","last_active":"2024-03-16T07:29:33.148313+0000","last_peered":"2024-03-16T07:29:33.148313+0000","last_clean":"2024-03-16T07:29:33.148313+0000","last_became_active":"2024-03-16T07:29:33.146227+0000","last_became_peered":"2024-03-16T07:29:33.146227+0000","last_unstale":"2024-03-16T07:29:33.148313+0000","last_undegraded":"2024-03-16T07:29:33.148313+0000","last_fullsized":"2024-03-16T07:29:33.148313+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:01:06.794154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.134062+0000","last_change":"2024-03-16T07:29:33.134062+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.134062+0000","last_undegraded":"2024-03-16T07:29:33.134062+0000","last_fullsized":"2024-03-16T07:29:33.134062+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-03-16T07:29:33.152441+0000","last_change":"2024-03-16T07:29:33.150332+0000","last_active":"2024-03-16T07:29:33.152441+0000","last_peered":"2024-03-16T07:29:33.152441+0000","last_clean":"2024-03-16T07:29:33.152441+0000","last_became_active":"2024-03-16T07:29:33.149989+0000","last_became_peered":"2024-03-16T07:29:33.149989+0000","last_unstale":"2024-03-16T07:29:33.152441+0000","last_undegraded":"2024-03-16T07:29:33.152441+0000","last_fullsized":"2024-03-16T07:29:33.152441+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:31:32.404805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.132587+0000","last_change":"2024-03-16T07:29:33.132587+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.132587+0000","last_undegraded":"2024-03-16T07:29:33.132587+0000","last_fullsized":"2024-03-16T07:29:33.132587+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-03-16T07:29:33.149916+0000","last_change":"2024-03-16T07:29:33.144113+0000","last_active":"2024-03-16T07:29:33.149916+0000","last_peered":"2024-03-16T07:29:33.149916+0000","last_clean":"2024-03-16T07:29:33.149916+0000","last_became_active":"2024-03-16T07:29:33.140102+0000","last_became_peered":"2024-03-16T07:29:33.140102+0000","last_unstale":"2024-03-16T07:29:33.149916+0000","last_undegraded":"2024-03-16T07:29:33.149916+0000","last_fullsized":"2024-03-16T07:29:33.149916+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:44:48.930944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.132525+0000","last_change":"2024-03-16T07:29:33.132525+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.132525+0000","last_undegraded":"2024-03-16T07:29:33.132525+0000","last_fullsized":"2024-03-16T07:29:33.132525+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-03-16T07:29:33.148557+0000","last_change":"2024-03-16T07:29:33.145636+0000","last_active":"2024-03-16T07:29:33.148557+0000","last_peered":"2024-03-16T07:29:33.148557+0000","last_clean":"2024-03-16T07:29:33.148557+0000","last_became_active":"2024-03-16T07:29:33.143854+0000","last_became_peered":"2024-03-16T07:29:33.143854+0000","last_unstale":"2024-03-16T07:29:33.148557+0000","last_undegraded":"2024-03-16T07:29:33.148557+0000","last_fullsized":"2024-03-16T07:29:33.148557+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:57:05.520910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.132844+0000","last_change":"2024-03-16T07:29:33.132844+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.132844+0000","last_undegraded":"2024-03-16T07:29:33.132844+0000","last_fullsized":"2024-03-16T07:29:33.132844+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-03-16T07:29:33.146251+0000","last_change":"2024-03-16T07:29:33.144300+0000","last_active":"2024-03-16T07:29:33.146251+0000","last_peered":"2024-03-16T07:29:33.146251+0000","last_clean":"2024-03-16T07:29:33.146251+0000","last_became_active":"2024-03-16T07:29:33.144052+0000","last_became_peered":"2024-03-16T07:29:33.144052+0000","last_unstale":"2024-03-16T07:29:33.146251+0000","last_undegraded":"2024-03-16T07:29:33.146251+0000","last_fullsized":"2024-03-16T07:29:33.146251+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:07:22.128035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.134349+0000","last_change":"2024-03-16T07:29:33.134349+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.134349+0000","last_undegraded":"2024-03-16T07:29:33.134349+0000","last_fullsized":"2024-03-16T07:29:33.134349+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-03-16T07:29:33.151765+0000","last_change":"2024-03-16T07:29:33.147234+0000","last_active":"2024-03-16T07:29:33.151765+0000","last_peered":"2024-03-16T07:29:33.151765+0000","last_clean":"2024-03-16T07:29:33.151765+0000","last_became_active":"2024-03-16T07:29:33.146693+0000","last_became_peered":"2024-03-16T07:29:33.146693+0000","last_unstale":"2024-03-16T07:29:33.151765+0000","last_undegraded":"2024-03-16T07:29:33.151765+0000","last_fullsized":"2024-03-16T07:29:33.151765+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:07:56.951689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.132156+0000","last_change":"2024-03-16T07:29:33.132156+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.132156+0000","last_undegraded":"2024-03-16T07:29:33.132156+0000","last_fullsized":"2024-03-16T07:29:33.132156+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-03-16T07:29:33.143221+0000","last_change":"2024-03-16T07:29:33.141889+0000","last_active":"2024-03-16T07:29:33.143221+0000","last_peered":"2024-03-16T07:29:33.143221+0000","last_clean":"2024-03-16T07:29:33.143221+0000","last_became_active":"2024-03-16T07:29:33.141560+0000","last_became_peered":"2024-03-16T07:29:33.141560+0000","last_unstale":"2024-03-16T07:29:33.143221+0000","last_undegraded":"2024-03-16T07:29:33.143221+0000","last_fullsized":"2024-03-16T07:29:33.143221+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:42:43.864427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.131902+0000","last_change":"2024-03-16T07:29:33.131902+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.131902+0000","last_undegraded":"2024-03-16T07:29:33.131902+0000","last_fullsized":"2024-03-16T07:29:33.131902+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-03-16T07:29:33.144953+0000","last_change":"2024-03-16T07:29:33.143890+0000","last_active":"2024-03-16T07:29:33.144953+0000","last_peered":"2024-03-16T07:29:33.144953+0000","last_clean":"2024-03-16T07:29:33.144953+0000","last_became_active":"2024-03-16T07:29:33.143637+0000","last_became_peered":"2024-03-16T07:29:33.143637+0000","last_unstale":"2024-03-16T07:29:33.144953+0000","last_undegraded":"2024-03-16T07:29:33.144953+0000","last_fullsized":"2024-03-16T07:29:33.144953+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:11:31.289724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.131911+0000","last_change":"2024-03-16T07:29:33.131911+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.131911+0000","last_undegraded":"2024-03-16T07:29:33.131911+0000","last_fullsized":"2024-03-16T07:29:33.131911+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-03-16T07:29:33.146377+0000","last_change":"2024-03-16T07:29:33.139819+0000","last_active":"2024-03-16T07:29:33.146377+0000","last_peered":"2024-03-16T07:29:33.146377+0000","last_clean":"2024-03-16T07:29:33.146377+0000","last_became_active":"2024-03-16T07:29:33.139567+0000","last_became_peered":"2024-03-16T07:29:33.139567+0000","last_unstale":"2024-03-16T07:29:33.146377+0000","last_undegraded":"2024-03-16T07:29:33.146377+0000","last_fullsized":"2024-03-16T07:29:33.146377+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:14:54.131717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.135433+0000","last_change":"2024-03-16T07:29:33.135433+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.135433+0000","last_undegraded":"2024-03-16T07:29:33.135433+0000","last_fullsized":"2024-03-16T07:29:33.135433+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-03-16T07:29:33.148902+0000","last_change":"2024-03-16T07:29:33.147194+0000","last_active":"2024-03-16T07:29:33.148902+0000","last_peered":"2024-03-16T07:29:33.148902+0000","last_clean":"2024-03-16T07:29:33.148902+0000","last_became_active":"2024-03-16T07:29:33.146945+0000","last_became_peered":"2024-03-16T07:29:33.146945+0000","last_unstale":"2024-03-16T07:29:33.148902+0000","last_undegraded":"2024-03-16T07:29:33.148902+0000","last_fullsized":"2024-03-16T07:29:33.148902+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:05:59.788864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"80'152","reported_seq":489,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-03-16T07:29:33.135902+0000","last_change":"2024-03-16T07:24:31.650537+0000","last_active":"2024-03-16T07:29:33.135902+0000","last_peered":"2024-03-16T07:29:33.135902+0000","last_clean":"2024-03-16T07:29:33.135902+0000","last_became_active":"2024-03-16T07:24:31.649574+0000","last_became_peered":"2024-03-16T07:24:31.649574+0000","last_unstale":"2024-03-16T07:29:33.135902+0000","last_undegraded":"2024-03-16T07:29:33.135902+0000","last_fullsized":"2024-03-16T07:29:33.135902+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:29.719970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:29.719970+0000","last_clean_scrub_stamp":"2024-03-16T07:24:29.719970+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:31:35.774554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":586,"num_read_kb":1121,"num_write":237,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":586,"num_read_kb":1121,"num_write":237,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":152,"ondisk_log_size":152,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738428,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":32096,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":104825504,"statfs":{"total":107374182400,"available":107341316096,"internally_reserved":0,"allocated":937984,"data_stored":372113,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738428,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":32680,"kb_used_data":1496,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":104824920,"statfs":{"total":107374182400,"available":107340718080,"internally_reserved":0,"allocated":1531904,"data_stored":962481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738428,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":32680,"kb_used_data":1496,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":104824920,"statfs":{"total":107374182400,"available":107340718080,"internally_reserved":0,"allocated":1531904,"data_stored":962481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-16T07:29:37.366 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-16T07:29:37.732 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:29:37.733 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2024-03-16T07:29:37.744 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":31,"stamp":"2024-03-16T07:29:36.166204+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":586,"num_read_kb":1121,"num_write":237,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":152,"ondisk_log_size":152,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":13,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":314572800,"kb_used":97456,"kb_used_data":3908,"kb_used_omap":4,"kb_used_meta":93499,"kb_avail":314475344,"statfs":{"total":322122547200,"available":322022752256,"internally_reserved":0,"allocated":4001792,"data_stored":2297075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":95743311},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.041864"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.140450+0000","last_change":"2024-03-16T07:29:33.140450+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.140450+0000","last_undegraded":"2024-03-16T07:29:33.140450+0000","last_fullsized":"2024-03-16T07:29:33.140450+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.134820+0000","last_change":"2024-03-16T07:29:33.134820+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.134820+0000","last_undegraded":"2024-03-16T07:29:33.134820+0000","last_fullsized":"2024-03-16T07:29:33.134820+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.137535+0000","last_change":"2024-03-16T07:29:33.137535+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.137535+0000","last_undegraded":"2024-03-16T07:29:33.137535+0000","last_fullsized":"2024-03-16T07:29:33.137535+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.140710+0000","last_change":"2024-03-16T07:29:33.140710+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.140710+0000","last_undegraded":"2024-03-16T07:29:33.140710+0000","last_fullsized":"2024-03-16T07:29:33.140710+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.137548+0000","last_change":"2024-03-16T07:29:33.137548+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.137548+0000","last_undegraded":"2024-03-16T07:29:33.137548+0000","last_fullsized":"2024-03-16T07:29:33.137548+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.137600+0000","last_change":"2024-03-16T07:29:33.137600+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.137600+0000","last_undegraded":"2024-03-16T07:29:33.137600+0000","last_fullsized":"2024-03-16T07:29:33.137600+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.134947+0000","last_change":"2024-03-16T07:29:33.134947+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.134947+0000","last_undegraded":"2024-03-16T07:29:33.134947+0000","last_fullsized":"2024-03-16T07:29:33.134947+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.135232+0000","last_change":"2024-03-16T07:29:33.135232+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.135232+0000","last_undegraded":"2024-03-16T07:29:33.135232+0000","last_fullsized":"2024-03-16T07:29:33.135232+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.139990+0000","last_change":"2024-03-16T07:29:33.139990+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.139990+0000","last_undegraded":"2024-03-16T07:29:33.139990+0000","last_fullsized":"2024-03-16T07:29:33.139990+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.140060+0000","last_change":"2024-03-16T07:29:33.140060+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.140060+0000","last_undegraded":"2024-03-16T07:29:33.140060+0000","last_fullsized":"2024-03-16T07:29:33.140060+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.140023+0000","last_change":"2024-03-16T07:29:33.140023+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.140023+0000","last_undegraded":"2024-03-16T07:29:33.140023+0000","last_fullsized":"2024-03-16T07:29:33.140023+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.140376+0000","last_change":"2024-03-16T07:29:33.140376+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.140376+0000","last_undegraded":"2024-03-16T07:29:33.140376+0000","last_fullsized":"2024-03-16T07:29:33.140376+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.136995+0000","last_change":"2024-03-16T07:29:33.136995+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.136995+0000","last_undegraded":"2024-03-16T07:29:33.136995+0000","last_fullsized":"2024-03-16T07:29:33.136995+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.139015+0000","last_change":"2024-03-16T07:29:33.139015+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.139015+0000","last_undegraded":"2024-03-16T07:29:33.139015+0000","last_fullsized":"2024-03-16T07:29:33.139015+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.137927+0000","last_change":"2024-03-16T07:29:33.137927+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.137927+0000","last_undegraded":"2024-03-16T07:29:33.137927+0000","last_fullsized":"2024-03-16T07:29:33.137927+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.139019+0000","last_change":"2024-03-16T07:29:33.139019+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.139019+0000","last_undegraded":"2024-03-16T07:29:33.139019+0000","last_fullsized":"2024-03-16T07:29:33.139019+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.138741+0000","last_change":"2024-03-16T07:29:33.138741+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.138741+0000","last_undegraded":"2024-03-16T07:29:33.138741+0000","last_fullsized":"2024-03-16T07:29:33.138741+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.138601+0000","last_change":"2024-03-16T07:29:33.138601+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.138601+0000","last_undegraded":"2024-03-16T07:29:33.138601+0000","last_fullsized":"2024-03-16T07:29:33.138601+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.137234+0000","last_change":"2024-03-16T07:29:33.137234+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.137234+0000","last_undegraded":"2024-03-16T07:29:33.137234+0000","last_fullsized":"2024-03-16T07:29:33.137234+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.137282+0000","last_change":"2024-03-16T07:29:33.137282+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.137282+0000","last_undegraded":"2024-03-16T07:29:33.137282+0000","last_fullsized":"2024-03-16T07:29:33.137282+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.136651+0000","last_change":"2024-03-16T07:29:33.136651+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.136651+0000","last_undegraded":"2024-03-16T07:29:33.136651+0000","last_fullsized":"2024-03-16T07:29:33.136651+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.135578+0000","last_change":"2024-03-16T07:29:33.135578+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.135578+0000","last_undegraded":"2024-03-16T07:29:33.135578+0000","last_fullsized":"2024-03-16T07:29:33.135578+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.138948+0000","last_change":"2024-03-16T07:29:33.138948+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.138948+0000","last_undegraded":"2024-03-16T07:29:33.138948+0000","last_fullsized":"2024-03-16T07:29:33.138948+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.133877+0000","last_change":"2024-03-16T07:29:33.133877+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.133877+0000","last_undegraded":"2024-03-16T07:29:33.133877+0000","last_fullsized":"2024-03-16T07:29:33.133877+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.134216+0000","last_change":"2024-03-16T07:29:33.134216+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.134216+0000","last_undegraded":"2024-03-16T07:29:33.134216+0000","last_fullsized":"2024-03-16T07:29:33.134216+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.136040+0000","last_change":"2024-03-16T07:29:33.136040+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.136040+0000","last_undegraded":"2024-03-16T07:29:33.136040+0000","last_fullsized":"2024-03-16T07:29:33.136040+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.136915+0000","last_change":"2024-03-16T07:29:33.136915+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.136915+0000","last_undegraded":"2024-03-16T07:29:33.136915+0000","last_fullsized":"2024-03-16T07:29:33.136915+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.135741+0000","last_change":"2024-03-16T07:29:33.135741+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.135741+0000","last_undegraded":"2024-03-16T07:29:33.135741+0000","last_fullsized":"2024-03-16T07:29:33.135741+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.139465+0000","last_change":"2024-03-16T07:29:33.139465+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.139465+0000","last_undegraded":"2024-03-16T07:29:33.139465+0000","last_fullsized":"2024-03-16T07:29:33.139465+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.132351+0000","last_change":"2024-03-16T07:29:33.132351+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.132351+0000","last_undegraded":"2024-03-16T07:29:33.132351+0000","last_fullsized":"2024-03-16T07:29:33.132351+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.135630+0000","last_change":"2024-03-16T07:29:33.135630+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.135630+0000","last_undegraded":"2024-03-16T07:29:33.135630+0000","last_fullsized":"2024-03-16T07:29:33.135630+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.137860+0000","last_change":"2024-03-16T07:29:33.137860+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.137860+0000","last_undegraded":"2024-03-16T07:29:33.137860+0000","last_fullsized":"2024-03-16T07:29:33.137860+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.138139+0000","last_change":"2024-03-16T07:29:33.138139+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.138139+0000","last_undegraded":"2024-03-16T07:29:33.138139+0000","last_fullsized":"2024-03-16T07:29:33.138139+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-03-16T07:29:33.143252+0000","last_change":"2024-03-16T07:29:33.142157+0000","last_active":"2024-03-16T07:29:33.143252+0000","last_peered":"2024-03-16T07:29:33.143252+0000","last_clean":"2024-03-16T07:29:33.143252+0000","last_became_active":"2024-03-16T07:29:33.141750+0000","last_became_peered":"2024-03-16T07:29:33.141750+0000","last_unstale":"2024-03-16T07:29:33.143252+0000","last_undegraded":"2024-03-16T07:29:33.143252+0000","last_fullsized":"2024-03-16T07:29:33.143252+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:44:37.218059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.135311+0000","last_change":"2024-03-16T07:29:33.135311+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.135311+0000","last_undegraded":"2024-03-16T07:29:33.135311+0000","last_fullsized":"2024-03-16T07:29:33.135311+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-03-16T07:29:33.146214+0000","last_change":"2024-03-16T07:29:33.144641+0000","last_active":"2024-03-16T07:29:33.146214+0000","last_peered":"2024-03-16T07:29:33.146214+0000","last_clean":"2024-03-16T07:29:33.146214+0000","last_became_active":"2024-03-16T07:29:33.144370+0000","last_became_peered":"2024-03-16T07:29:33.144370+0000","last_unstale":"2024-03-16T07:29:33.146214+0000","last_undegraded":"2024-03-16T07:29:33.146214+0000","last_fullsized":"2024-03-16T07:29:33.146214+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:40:18.934958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.133066+0000","last_change":"2024-03-16T07:29:33.133066+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.133066+0000","last_undegraded":"2024-03-16T07:29:33.133066+0000","last_fullsized":"2024-03-16T07:29:33.133066+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-03-16T07:29:33.147993+0000","last_change":"2024-03-16T07:29:33.145140+0000","last_active":"2024-03-16T07:29:33.147993+0000","last_peered":"2024-03-16T07:29:33.147993+0000","last_clean":"2024-03-16T07:29:33.147993+0000","last_became_active":"2024-03-16T07:29:33.144891+0000","last_became_peered":"2024-03-16T07:29:33.144891+0000","last_unstale":"2024-03-16T07:29:33.147993+0000","last_undegraded":"2024-03-16T07:29:33.147993+0000","last_fullsized":"2024-03-16T07:29:33.147993+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:37:10.315423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.133620+0000","last_change":"2024-03-16T07:29:33.133620+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.133620+0000","last_undegraded":"2024-03-16T07:29:33.133620+0000","last_fullsized":"2024-03-16T07:29:33.133620+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-03-16T07:29:33.144911+0000","last_change":"2024-03-16T07:29:33.143477+0000","last_active":"2024-03-16T07:29:33.144911+0000","last_peered":"2024-03-16T07:29:33.144911+0000","last_clean":"2024-03-16T07:29:33.144911+0000","last_became_active":"2024-03-16T07:29:33.143221+0000","last_became_peered":"2024-03-16T07:29:33.143221+0000","last_unstale":"2024-03-16T07:29:33.144911+0000","last_undegraded":"2024-03-16T07:29:33.144911+0000","last_fullsized":"2024-03-16T07:29:33.144911+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:35:05.997178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.134166+0000","last_change":"2024-03-16T07:29:33.134166+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.134166+0000","last_undegraded":"2024-03-16T07:29:33.134166+0000","last_fullsized":"2024-03-16T07:29:33.134166+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-03-16T07:29:33.152398+0000","last_change":"2024-03-16T07:29:33.151173+0000","last_active":"2024-03-16T07:29:33.152398+0000","last_peered":"2024-03-16T07:29:33.152398+0000","last_clean":"2024-03-16T07:29:33.152398+0000","last_became_active":"2024-03-16T07:29:33.150934+0000","last_became_peered":"2024-03-16T07:29:33.150934+0000","last_unstale":"2024-03-16T07:29:33.152398+0000","last_undegraded":"2024-03-16T07:29:33.152398+0000","last_fullsized":"2024-03-16T07:29:33.152398+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:19:24.993683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.135250+0000","last_change":"2024-03-16T07:29:33.135250+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.135250+0000","last_undegraded":"2024-03-16T07:29:33.135250+0000","last_fullsized":"2024-03-16T07:29:33.135250+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-03-16T07:29:33.153893+0000","last_change":"2024-03-16T07:29:33.152347+0000","last_active":"2024-03-16T07:29:33.153893+0000","last_peered":"2024-03-16T07:29:33.153893+0000","last_clean":"2024-03-16T07:29:33.153893+0000","last_became_active":"2024-03-16T07:29:33.152108+0000","last_became_peered":"2024-03-16T07:29:33.152108+0000","last_unstale":"2024-03-16T07:29:33.153893+0000","last_undegraded":"2024-03-16T07:29:33.153893+0000","last_fullsized":"2024-03-16T07:29:33.153893+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:54:27.091427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.134164+0000","last_change":"2024-03-16T07:29:33.134164+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.134164+0000","last_undegraded":"2024-03-16T07:29:33.134164+0000","last_fullsized":"2024-03-16T07:29:33.134164+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-03-16T07:29:33.152354+0000","last_change":"2024-03-16T07:29:33.149360+0000","last_active":"2024-03-16T07:29:33.152354+0000","last_peered":"2024-03-16T07:29:33.152354+0000","last_clean":"2024-03-16T07:29:33.152354+0000","last_became_active":"2024-03-16T07:29:33.148940+0000","last_became_peered":"2024-03-16T07:29:33.148940+0000","last_unstale":"2024-03-16T07:29:33.152354+0000","last_undegraded":"2024-03-16T07:29:33.152354+0000","last_fullsized":"2024-03-16T07:29:33.152354+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:44:58.999351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.133015+0000","last_change":"2024-03-16T07:29:33.133015+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.133015+0000","last_undegraded":"2024-03-16T07:29:33.133015+0000","last_fullsized":"2024-03-16T07:29:33.133015+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-03-16T07:29:33.148332+0000","last_change":"2024-03-16T07:29:33.147410+0000","last_active":"2024-03-16T07:29:33.148332+0000","last_peered":"2024-03-16T07:29:33.148332+0000","last_clean":"2024-03-16T07:29:33.148332+0000","last_became_active":"2024-03-16T07:29:33.146998+0000","last_became_peered":"2024-03-16T07:29:33.146998+0000","last_unstale":"2024-03-16T07:29:33.148332+0000","last_undegraded":"2024-03-16T07:29:33.148332+0000","last_fullsized":"2024-03-16T07:29:33.148332+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:01:51.501320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.131243+0000","last_change":"2024-03-16T07:29:33.131243+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.131243+0000","last_undegraded":"2024-03-16T07:29:33.131243+0000","last_fullsized":"2024-03-16T07:29:33.131243+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-03-16T07:29:33.147633+0000","last_change":"2024-03-16T07:29:33.145570+0000","last_active":"2024-03-16T07:29:33.147633+0000","last_peered":"2024-03-16T07:29:33.147633+0000","last_clean":"2024-03-16T07:29:33.147633+0000","last_became_active":"2024-03-16T07:29:33.145332+0000","last_became_peered":"2024-03-16T07:29:33.145332+0000","last_unstale":"2024-03-16T07:29:33.147633+0000","last_undegraded":"2024-03-16T07:29:33.147633+0000","last_fullsized":"2024-03-16T07:29:33.147633+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:45:10.083590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.133380+0000","last_change":"2024-03-16T07:29:33.133380+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.133380+0000","last_undegraded":"2024-03-16T07:29:33.133380+0000","last_fullsized":"2024-03-16T07:29:33.133380+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-03-16T07:29:33.147171+0000","last_change":"2024-03-16T07:29:33.145151+0000","last_active":"2024-03-16T07:29:33.147171+0000","last_peered":"2024-03-16T07:29:33.147171+0000","last_clean":"2024-03-16T07:29:33.147171+0000","last_became_active":"2024-03-16T07:29:33.144911+0000","last_became_peered":"2024-03-16T07:29:33.144911+0000","last_unstale":"2024-03-16T07:29:33.147171+0000","last_undegraded":"2024-03-16T07:29:33.147171+0000","last_fullsized":"2024-03-16T07:29:33.147171+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:52:07.278437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.132744+0000","last_change":"2024-03-16T07:29:33.132744+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.132744+0000","last_undegraded":"2024-03-16T07:29:33.132744+0000","last_fullsized":"2024-03-16T07:29:33.132744+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-03-16T07:29:33.148579+0000","last_change":"2024-03-16T07:29:33.145719+0000","last_active":"2024-03-16T07:29:33.148579+0000","last_peered":"2024-03-16T07:29:33.148579+0000","last_clean":"2024-03-16T07:29:33.148579+0000","last_became_active":"2024-03-16T07:29:33.141978+0000","last_became_peered":"2024-03-16T07:29:33.141978+0000","last_unstale":"2024-03-16T07:29:33.148579+0000","last_undegraded":"2024-03-16T07:29:33.148579+0000","last_fullsized":"2024-03-16T07:29:33.148579+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:53:03.878506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.135951+0000","last_change":"2024-03-16T07:29:33.135951+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.135951+0000","last_undegraded":"2024-03-16T07:29:33.135951+0000","last_fullsized":"2024-03-16T07:29:33.135951+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-03-16T07:29:33.143953+0000","last_change":"2024-03-16T07:29:33.143457+0000","last_active":"2024-03-16T07:29:33.143953+0000","last_peered":"2024-03-16T07:29:33.143953+0000","last_clean":"2024-03-16T07:29:33.143953+0000","last_became_active":"2024-03-16T07:29:33.143020+0000","last_became_peered":"2024-03-16T07:29:33.143020+0000","last_unstale":"2024-03-16T07:29:33.143953+0000","last_undegraded":"2024-03-16T07:29:33.143953+0000","last_fullsized":"2024-03-16T07:29:33.143953+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:04:32.253995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.130820+0000","last_change":"2024-03-16T07:29:33.130820+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.130820+0000","last_undegraded":"2024-03-16T07:29:33.130820+0000","last_fullsized":"2024-03-16T07:29:33.130820+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-03-16T07:29:33.152379+0000","last_change":"2024-03-16T07:29:33.150475+0000","last_active":"2024-03-16T07:29:33.152379+0000","last_peered":"2024-03-16T07:29:33.152379+0000","last_clean":"2024-03-16T07:29:33.152379+0000","last_became_active":"2024-03-16T07:29:33.150220+0000","last_became_peered":"2024-03-16T07:29:33.150220+0000","last_unstale":"2024-03-16T07:29:33.152379+0000","last_undegraded":"2024-03-16T07:29:33.152379+0000","last_fullsized":"2024-03-16T07:29:33.152379+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:31:42.068184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.133883+0000","last_change":"2024-03-16T07:29:33.133883+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.133883+0000","last_undegraded":"2024-03-16T07:29:33.133883+0000","last_fullsized":"2024-03-16T07:29:33.133883+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-03-16T07:29:33.151494+0000","last_change":"2024-03-16T07:29:33.144891+0000","last_active":"2024-03-16T07:29:33.151494+0000","last_peered":"2024-03-16T07:29:33.151494+0000","last_clean":"2024-03-16T07:29:33.151494+0000","last_became_active":"2024-03-16T07:29:33.144574+0000","last_became_peered":"2024-03-16T07:29:33.144574+0000","last_unstale":"2024-03-16T07:29:33.151494+0000","last_undegraded":"2024-03-16T07:29:33.151494+0000","last_fullsized":"2024-03-16T07:29:33.151494+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:11:59.374012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.132033+0000","last_change":"2024-03-16T07:29:33.132033+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.132033+0000","last_undegraded":"2024-03-16T07:29:33.132033+0000","last_fullsized":"2024-03-16T07:29:33.132033+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-03-16T07:29:33.151099+0000","last_change":"2024-03-16T07:29:33.147235+0000","last_active":"2024-03-16T07:29:33.151099+0000","last_peered":"2024-03-16T07:29:33.151099+0000","last_clean":"2024-03-16T07:29:33.151099+0000","last_became_active":"2024-03-16T07:29:33.146884+0000","last_became_peered":"2024-03-16T07:29:33.146884+0000","last_unstale":"2024-03-16T07:29:33.151099+0000","last_undegraded":"2024-03-16T07:29:33.151099+0000","last_fullsized":"2024-03-16T07:29:33.151099+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:57:08.184067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.130807+0000","last_change":"2024-03-16T07:29:33.130807+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.130807+0000","last_undegraded":"2024-03-16T07:29:33.130807+0000","last_fullsized":"2024-03-16T07:29:33.130807+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-03-16T07:29:33.143536+0000","last_change":"2024-03-16T07:29:33.142821+0000","last_active":"2024-03-16T07:29:33.143536+0000","last_peered":"2024-03-16T07:29:33.143536+0000","last_clean":"2024-03-16T07:29:33.143536+0000","last_became_active":"2024-03-16T07:29:33.142350+0000","last_became_peered":"2024-03-16T07:29:33.142350+0000","last_unstale":"2024-03-16T07:29:33.143536+0000","last_undegraded":"2024-03-16T07:29:33.143536+0000","last_fullsized":"2024-03-16T07:29:33.143536+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:57:53.414562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.135272+0000","last_change":"2024-03-16T07:29:33.135272+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.135272+0000","last_undegraded":"2024-03-16T07:29:33.135272+0000","last_fullsized":"2024-03-16T07:29:33.135272+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-03-16T07:29:33.150743+0000","last_change":"2024-03-16T07:29:33.149722+0000","last_active":"2024-03-16T07:29:33.150743+0000","last_peered":"2024-03-16T07:29:33.150743+0000","last_clean":"2024-03-16T07:29:33.150743+0000","last_became_active":"2024-03-16T07:29:33.149431+0000","last_became_peered":"2024-03-16T07:29:33.149431+0000","last_unstale":"2024-03-16T07:29:33.150743+0000","last_undegraded":"2024-03-16T07:29:33.150743+0000","last_fullsized":"2024-03-16T07:29:33.150743+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:34:21.521970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.133508+0000","last_change":"2024-03-16T07:29:33.133508+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.133508+0000","last_undegraded":"2024-03-16T07:29:33.133508+0000","last_fullsized":"2024-03-16T07:29:33.133508+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-03-16T07:29:33.145842+0000","last_change":"2024-03-16T07:29:33.142518+0000","last_active":"2024-03-16T07:29:33.145842+0000","last_peered":"2024-03-16T07:29:33.145842+0000","last_clean":"2024-03-16T07:29:33.145842+0000","last_became_active":"2024-03-16T07:29:33.141657+0000","last_became_peered":"2024-03-16T07:29:33.141657+0000","last_unstale":"2024-03-16T07:29:33.145842+0000","last_undegraded":"2024-03-16T07:29:33.145842+0000","last_fullsized":"2024-03-16T07:29:33.145842+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:22:00.943132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.133761+0000","last_change":"2024-03-16T07:29:33.133761+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.133761+0000","last_undegraded":"2024-03-16T07:29:33.133761+0000","last_fullsized":"2024-03-16T07:29:33.133761+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-03-16T07:29:33.143936+0000","last_change":"2024-03-16T07:29:33.143262+0000","last_active":"2024-03-16T07:29:33.143936+0000","last_peered":"2024-03-16T07:29:33.143936+0000","last_clean":"2024-03-16T07:29:33.143936+0000","last_became_active":"2024-03-16T07:29:33.142682+0000","last_became_peered":"2024-03-16T07:29:33.142682+0000","last_unstale":"2024-03-16T07:29:33.143936+0000","last_undegraded":"2024-03-16T07:29:33.143936+0000","last_fullsized":"2024-03-16T07:29:33.143936+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:27:42.837553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.134707+0000","last_change":"2024-03-16T07:29:33.134707+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.134707+0000","last_undegraded":"2024-03-16T07:29:33.134707+0000","last_fullsized":"2024-03-16T07:29:33.134707+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-03-16T07:29:33.151877+0000","last_change":"2024-03-16T07:29:33.147427+0000","last_active":"2024-03-16T07:29:33.151877+0000","last_peered":"2024-03-16T07:29:33.151877+0000","last_clean":"2024-03-16T07:29:33.151877+0000","last_became_active":"2024-03-16T07:29:33.147011+0000","last_became_peered":"2024-03-16T07:29:33.147011+0000","last_unstale":"2024-03-16T07:29:33.151877+0000","last_undegraded":"2024-03-16T07:29:33.151877+0000","last_fullsized":"2024-03-16T07:29:33.151877+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:52:43.283375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.133048+0000","last_change":"2024-03-16T07:29:33.133048+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.133048+0000","last_undegraded":"2024-03-16T07:29:33.133048+0000","last_fullsized":"2024-03-16T07:29:33.133048+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-03-16T07:29:33.153913+0000","last_change":"2024-03-16T07:29:33.152620+0000","last_active":"2024-03-16T07:29:33.153913+0000","last_peered":"2024-03-16T07:29:33.153913+0000","last_clean":"2024-03-16T07:29:33.153913+0000","last_became_active":"2024-03-16T07:29:33.152352+0000","last_became_peered":"2024-03-16T07:29:33.152352+0000","last_unstale":"2024-03-16T07:29:33.153913+0000","last_undegraded":"2024-03-16T07:29:33.153913+0000","last_fullsized":"2024-03-16T07:29:33.153913+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:24:19.329381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.133122+0000","last_change":"2024-03-16T07:29:33.133122+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.133122+0000","last_undegraded":"2024-03-16T07:29:33.133122+0000","last_fullsized":"2024-03-16T07:29:33.133122+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-03-16T07:29:33.151908+0000","last_change":"2024-03-16T07:29:33.147855+0000","last_active":"2024-03-16T07:29:33.151908+0000","last_peered":"2024-03-16T07:29:33.151908+0000","last_clean":"2024-03-16T07:29:33.151908+0000","last_became_active":"2024-03-16T07:29:33.147615+0000","last_became_peered":"2024-03-16T07:29:33.147615+0000","last_unstale":"2024-03-16T07:29:33.151908+0000","last_undegraded":"2024-03-16T07:29:33.151908+0000","last_fullsized":"2024-03-16T07:29:33.151908+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:52:31.609104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.131590+0000","last_change":"2024-03-16T07:29:33.131590+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.131590+0000","last_undegraded":"2024-03-16T07:29:33.131590+0000","last_fullsized":"2024-03-16T07:29:33.131590+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-03-16T07:29:33.148313+0000","last_change":"2024-03-16T07:29:33.147292+0000","last_active":"2024-03-16T07:29:33.148313+0000","last_peered":"2024-03-16T07:29:33.148313+0000","last_clean":"2024-03-16T07:29:33.148313+0000","last_became_active":"2024-03-16T07:29:33.146227+0000","last_became_peered":"2024-03-16T07:29:33.146227+0000","last_unstale":"2024-03-16T07:29:33.148313+0000","last_undegraded":"2024-03-16T07:29:33.148313+0000","last_fullsized":"2024-03-16T07:29:33.148313+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:01:06.794154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.134062+0000","last_change":"2024-03-16T07:29:33.134062+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.134062+0000","last_undegraded":"2024-03-16T07:29:33.134062+0000","last_fullsized":"2024-03-16T07:29:33.134062+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-03-16T07:29:33.152441+0000","last_change":"2024-03-16T07:29:33.150332+0000","last_active":"2024-03-16T07:29:33.152441+0000","last_peered":"2024-03-16T07:29:33.152441+0000","last_clean":"2024-03-16T07:29:33.152441+0000","last_became_active":"2024-03-16T07:29:33.149989+0000","last_became_peered":"2024-03-16T07:29:33.149989+0000","last_unstale":"2024-03-16T07:29:33.152441+0000","last_undegraded":"2024-03-16T07:29:33.152441+0000","last_fullsized":"2024-03-16T07:29:33.152441+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:31:32.404805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.132587+0000","last_change":"2024-03-16T07:29:33.132587+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.132587+0000","last_undegraded":"2024-03-16T07:29:33.132587+0000","last_fullsized":"2024-03-16T07:29:33.132587+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-03-16T07:29:33.149916+0000","last_change":"2024-03-16T07:29:33.144113+0000","last_active":"2024-03-16T07:29:33.149916+0000","last_peered":"2024-03-16T07:29:33.149916+0000","last_clean":"2024-03-16T07:29:33.149916+0000","last_became_active":"2024-03-16T07:29:33.140102+0000","last_became_peered":"2024-03-16T07:29:33.140102+0000","last_unstale":"2024-03-16T07:29:33.149916+0000","last_undegraded":"2024-03-16T07:29:33.149916+0000","last_fullsized":"2024-03-16T07:29:33.149916+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:44:48.930944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.132525+0000","last_change":"2024-03-16T07:29:33.132525+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.132525+0000","last_undegraded":"2024-03-16T07:29:33.132525+0000","last_fullsized":"2024-03-16T07:29:33.132525+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-03-16T07:29:33.148557+0000","last_change":"2024-03-16T07:29:33.145636+0000","last_active":"2024-03-16T07:29:33.148557+0000","last_peered":"2024-03-16T07:29:33.148557+0000","last_clean":"2024-03-16T07:29:33.148557+0000","last_became_active":"2024-03-16T07:29:33.143854+0000","last_became_peered":"2024-03-16T07:29:33.143854+0000","last_unstale":"2024-03-16T07:29:33.148557+0000","last_undegraded":"2024-03-16T07:29:33.148557+0000","last_fullsized":"2024-03-16T07:29:33.148557+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:57:05.520910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.132844+0000","last_change":"2024-03-16T07:29:33.132844+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.132844+0000","last_undegraded":"2024-03-16T07:29:33.132844+0000","last_fullsized":"2024-03-16T07:29:33.132844+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-03-16T07:29:33.146251+0000","last_change":"2024-03-16T07:29:33.144300+0000","last_active":"2024-03-16T07:29:33.146251+0000","last_peered":"2024-03-16T07:29:33.146251+0000","last_clean":"2024-03-16T07:29:33.146251+0000","last_became_active":"2024-03-16T07:29:33.144052+0000","last_became_peered":"2024-03-16T07:29:33.144052+0000","last_unstale":"2024-03-16T07:29:33.146251+0000","last_undegraded":"2024-03-16T07:29:33.146251+0000","last_fullsized":"2024-03-16T07:29:33.146251+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:07:22.128035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.134349+0000","last_change":"2024-03-16T07:29:33.134349+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.134349+0000","last_undegraded":"2024-03-16T07:29:33.134349+0000","last_fullsized":"2024-03-16T07:29:33.134349+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-03-16T07:29:33.151765+0000","last_change":"2024-03-16T07:29:33.147234+0000","last_active":"2024-03-16T07:29:33.151765+0000","last_peered":"2024-03-16T07:29:33.151765+0000","last_clean":"2024-03-16T07:29:33.151765+0000","last_became_active":"2024-03-16T07:29:33.146693+0000","last_became_peered":"2024-03-16T07:29:33.146693+0000","last_unstale":"2024-03-16T07:29:33.151765+0000","last_undegraded":"2024-03-16T07:29:33.151765+0000","last_fullsized":"2024-03-16T07:29:33.151765+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:07:56.951689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.132156+0000","last_change":"2024-03-16T07:29:33.132156+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.132156+0000","last_undegraded":"2024-03-16T07:29:33.132156+0000","last_fullsized":"2024-03-16T07:29:33.132156+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-03-16T07:29:33.143221+0000","last_change":"2024-03-16T07:29:33.141889+0000","last_active":"2024-03-16T07:29:33.143221+0000","last_peered":"2024-03-16T07:29:33.143221+0000","last_clean":"2024-03-16T07:29:33.143221+0000","last_became_active":"2024-03-16T07:29:33.141560+0000","last_became_peered":"2024-03-16T07:29:33.141560+0000","last_unstale":"2024-03-16T07:29:33.143221+0000","last_undegraded":"2024-03-16T07:29:33.143221+0000","last_fullsized":"2024-03-16T07:29:33.143221+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:42:43.864427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.131902+0000","last_change":"2024-03-16T07:29:33.131902+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.131902+0000","last_undegraded":"2024-03-16T07:29:33.131902+0000","last_fullsized":"2024-03-16T07:29:33.131902+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-03-16T07:29:33.144953+0000","last_change":"2024-03-16T07:29:33.143890+0000","last_active":"2024-03-16T07:29:33.144953+0000","last_peered":"2024-03-16T07:29:33.144953+0000","last_clean":"2024-03-16T07:29:33.144953+0000","last_became_active":"2024-03-16T07:29:33.143637+0000","last_became_peered":"2024-03-16T07:29:33.143637+0000","last_unstale":"2024-03-16T07:29:33.144953+0000","last_undegraded":"2024-03-16T07:29:33.144953+0000","last_fullsized":"2024-03-16T07:29:33.144953+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:11:31.289724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.131911+0000","last_change":"2024-03-16T07:29:33.131911+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.131911+0000","last_undegraded":"2024-03-16T07:29:33.131911+0000","last_fullsized":"2024-03-16T07:29:33.131911+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-03-16T07:29:33.146377+0000","last_change":"2024-03-16T07:29:33.139819+0000","last_active":"2024-03-16T07:29:33.146377+0000","last_peered":"2024-03-16T07:29:33.146377+0000","last_clean":"2024-03-16T07:29:33.146377+0000","last_became_active":"2024-03-16T07:29:33.139567+0000","last_became_peered":"2024-03-16T07:29:33.139567+0000","last_unstale":"2024-03-16T07:29:33.146377+0000","last_undegraded":"2024-03-16T07:29:33.146377+0000","last_fullsized":"2024-03-16T07:29:33.146377+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:14:54.131717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.135433+0000","last_change":"2024-03-16T07:29:33.135433+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.135433+0000","last_undegraded":"2024-03-16T07:29:33.135433+0000","last_fullsized":"2024-03-16T07:29:33.135433+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-03-16T07:29:33.148902+0000","last_change":"2024-03-16T07:29:33.147194+0000","last_active":"2024-03-16T07:29:33.148902+0000","last_peered":"2024-03-16T07:29:33.148902+0000","last_clean":"2024-03-16T07:29:33.148902+0000","last_became_active":"2024-03-16T07:29:33.146945+0000","last_became_peered":"2024-03-16T07:29:33.146945+0000","last_unstale":"2024-03-16T07:29:33.148902+0000","last_undegraded":"2024-03-16T07:29:33.148902+0000","last_fullsized":"2024-03-16T07:29:33.148902+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:05:59.788864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"80'152","reported_seq":489,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-03-16T07:29:33.135902+0000","last_change":"2024-03-16T07:24:31.650537+0000","last_active":"2024-03-16T07:29:33.135902+0000","last_peered":"2024-03-16T07:29:33.135902+0000","last_clean":"2024-03-16T07:29:33.135902+0000","last_became_active":"2024-03-16T07:24:31.649574+0000","last_became_peered":"2024-03-16T07:24:31.649574+0000","last_unstale":"2024-03-16T07:29:33.135902+0000","last_undegraded":"2024-03-16T07:29:33.135902+0000","last_fullsized":"2024-03-16T07:29:33.135902+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:29.719970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:29.719970+0000","last_clean_scrub_stamp":"2024-03-16T07:24:29.719970+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:31:35.774554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":586,"num_read_kb":1121,"num_write":237,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":586,"num_read_kb":1121,"num_write":237,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":152,"ondisk_log_size":152,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738428,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":32096,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":104825504,"statfs":{"total":107374182400,"available":107341316096,"internally_reserved":0,"allocated":937984,"data_stored":372113,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738428,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":32680,"kb_used_data":1496,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":104824920,"statfs":{"total":107374182400,"available":107340718080,"internally_reserved":0,"allocated":1531904,"data_stored":962481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738428,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":32680,"kb_used_data":1496,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":104824920,"statfs":{"total":107374182400,"available":107340718080,"internally_reserved":0,"allocated":1531904,"data_stored":962481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-16T07:29:37.748 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-16T07:29:38.089 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:29:38.090 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2024-03-16T07:29:38.101 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":31,"stamp":"2024-03-16T07:29:36.166204+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":586,"num_read_kb":1121,"num_write":237,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":152,"ondisk_log_size":152,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":13,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":314572800,"kb_used":97456,"kb_used_data":3908,"kb_used_omap":4,"kb_used_meta":93499,"kb_avail":314475344,"statfs":{"total":322122547200,"available":322022752256,"internally_reserved":0,"allocated":4001792,"data_stored":2297075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":95743311},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.041864"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.140450+0000","last_change":"2024-03-16T07:29:33.140450+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.140450+0000","last_undegraded":"2024-03-16T07:29:33.140450+0000","last_fullsized":"2024-03-16T07:29:33.140450+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.134820+0000","last_change":"2024-03-16T07:29:33.134820+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.134820+0000","last_undegraded":"2024-03-16T07:29:33.134820+0000","last_fullsized":"2024-03-16T07:29:33.134820+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.137535+0000","last_change":"2024-03-16T07:29:33.137535+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.137535+0000","last_undegraded":"2024-03-16T07:29:33.137535+0000","last_fullsized":"2024-03-16T07:29:33.137535+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.140710+0000","last_change":"2024-03-16T07:29:33.140710+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.140710+0000","last_undegraded":"2024-03-16T07:29:33.140710+0000","last_fullsized":"2024-03-16T07:29:33.140710+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.137548+0000","last_change":"2024-03-16T07:29:33.137548+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.137548+0000","last_undegraded":"2024-03-16T07:29:33.137548+0000","last_fullsized":"2024-03-16T07:29:33.137548+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.137600+0000","last_change":"2024-03-16T07:29:33.137600+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.137600+0000","last_undegraded":"2024-03-16T07:29:33.137600+0000","last_fullsized":"2024-03-16T07:29:33.137600+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.134947+0000","last_change":"2024-03-16T07:29:33.134947+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.134947+0000","last_undegraded":"2024-03-16T07:29:33.134947+0000","last_fullsized":"2024-03-16T07:29:33.134947+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.135232+0000","last_change":"2024-03-16T07:29:33.135232+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.135232+0000","last_undegraded":"2024-03-16T07:29:33.135232+0000","last_fullsized":"2024-03-16T07:29:33.135232+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.139990+0000","last_change":"2024-03-16T07:29:33.139990+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.139990+0000","last_undegraded":"2024-03-16T07:29:33.139990+0000","last_fullsized":"2024-03-16T07:29:33.139990+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.140060+0000","last_change":"2024-03-16T07:29:33.140060+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.140060+0000","last_undegraded":"2024-03-16T07:29:33.140060+0000","last_fullsized":"2024-03-16T07:29:33.140060+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.140023+0000","last_change":"2024-03-16T07:29:33.140023+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.140023+0000","last_undegraded":"2024-03-16T07:29:33.140023+0000","last_fullsized":"2024-03-16T07:29:33.140023+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.140376+0000","last_change":"2024-03-16T07:29:33.140376+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.140376+0000","last_undegraded":"2024-03-16T07:29:33.140376+0000","last_fullsized":"2024-03-16T07:29:33.140376+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.136995+0000","last_change":"2024-03-16T07:29:33.136995+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.136995+0000","last_undegraded":"2024-03-16T07:29:33.136995+0000","last_fullsized":"2024-03-16T07:29:33.136995+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.139015+0000","last_change":"2024-03-16T07:29:33.139015+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.139015+0000","last_undegraded":"2024-03-16T07:29:33.139015+0000","last_fullsized":"2024-03-16T07:29:33.139015+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.137927+0000","last_change":"2024-03-16T07:29:33.137927+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.137927+0000","last_undegraded":"2024-03-16T07:29:33.137927+0000","last_fullsized":"2024-03-16T07:29:33.137927+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.139019+0000","last_change":"2024-03-16T07:29:33.139019+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.139019+0000","last_undegraded":"2024-03-16T07:29:33.139019+0000","last_fullsized":"2024-03-16T07:29:33.139019+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.138741+0000","last_change":"2024-03-16T07:29:33.138741+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.138741+0000","last_undegraded":"2024-03-16T07:29:33.138741+0000","last_fullsized":"2024-03-16T07:29:33.138741+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.138601+0000","last_change":"2024-03-16T07:29:33.138601+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.138601+0000","last_undegraded":"2024-03-16T07:29:33.138601+0000","last_fullsized":"2024-03-16T07:29:33.138601+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.137234+0000","last_change":"2024-03-16T07:29:33.137234+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.137234+0000","last_undegraded":"2024-03-16T07:29:33.137234+0000","last_fullsized":"2024-03-16T07:29:33.137234+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.137282+0000","last_change":"2024-03-16T07:29:33.137282+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.137282+0000","last_undegraded":"2024-03-16T07:29:33.137282+0000","last_fullsized":"2024-03-16T07:29:33.137282+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.136651+0000","last_change":"2024-03-16T07:29:33.136651+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.136651+0000","last_undegraded":"2024-03-16T07:29:33.136651+0000","last_fullsized":"2024-03-16T07:29:33.136651+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.135578+0000","last_change":"2024-03-16T07:29:33.135578+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.135578+0000","last_undegraded":"2024-03-16T07:29:33.135578+0000","last_fullsized":"2024-03-16T07:29:33.135578+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.138948+0000","last_change":"2024-03-16T07:29:33.138948+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.138948+0000","last_undegraded":"2024-03-16T07:29:33.138948+0000","last_fullsized":"2024-03-16T07:29:33.138948+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.133877+0000","last_change":"2024-03-16T07:29:33.133877+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.133877+0000","last_undegraded":"2024-03-16T07:29:33.133877+0000","last_fullsized":"2024-03-16T07:29:33.133877+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.134216+0000","last_change":"2024-03-16T07:29:33.134216+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.134216+0000","last_undegraded":"2024-03-16T07:29:33.134216+0000","last_fullsized":"2024-03-16T07:29:33.134216+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.136040+0000","last_change":"2024-03-16T07:29:33.136040+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.136040+0000","last_undegraded":"2024-03-16T07:29:33.136040+0000","last_fullsized":"2024-03-16T07:29:33.136040+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.136915+0000","last_change":"2024-03-16T07:29:33.136915+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.136915+0000","last_undegraded":"2024-03-16T07:29:33.136915+0000","last_fullsized":"2024-03-16T07:29:33.136915+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.135741+0000","last_change":"2024-03-16T07:29:33.135741+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.135741+0000","last_undegraded":"2024-03-16T07:29:33.135741+0000","last_fullsized":"2024-03-16T07:29:33.135741+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.139465+0000","last_change":"2024-03-16T07:29:33.139465+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.139465+0000","last_undegraded":"2024-03-16T07:29:33.139465+0000","last_fullsized":"2024-03-16T07:29:33.139465+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.132351+0000","last_change":"2024-03-16T07:29:33.132351+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.132351+0000","last_undegraded":"2024-03-16T07:29:33.132351+0000","last_fullsized":"2024-03-16T07:29:33.132351+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.135630+0000","last_change":"2024-03-16T07:29:33.135630+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.135630+0000","last_undegraded":"2024-03-16T07:29:33.135630+0000","last_fullsized":"2024-03-16T07:29:33.135630+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.137860+0000","last_change":"2024-03-16T07:29:33.137860+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.137860+0000","last_undegraded":"2024-03-16T07:29:33.137860+0000","last_fullsized":"2024-03-16T07:29:33.137860+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.138139+0000","last_change":"2024-03-16T07:29:33.138139+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.138139+0000","last_undegraded":"2024-03-16T07:29:33.138139+0000","last_fullsized":"2024-03-16T07:29:33.138139+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-03-16T07:29:33.143252+0000","last_change":"2024-03-16T07:29:33.142157+0000","last_active":"2024-03-16T07:29:33.143252+0000","last_peered":"2024-03-16T07:29:33.143252+0000","last_clean":"2024-03-16T07:29:33.143252+0000","last_became_active":"2024-03-16T07:29:33.141750+0000","last_became_peered":"2024-03-16T07:29:33.141750+0000","last_unstale":"2024-03-16T07:29:33.143252+0000","last_undegraded":"2024-03-16T07:29:33.143252+0000","last_fullsized":"2024-03-16T07:29:33.143252+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:44:37.218059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.135311+0000","last_change":"2024-03-16T07:29:33.135311+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.135311+0000","last_undegraded":"2024-03-16T07:29:33.135311+0000","last_fullsized":"2024-03-16T07:29:33.135311+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-03-16T07:29:33.146214+0000","last_change":"2024-03-16T07:29:33.144641+0000","last_active":"2024-03-16T07:29:33.146214+0000","last_peered":"2024-03-16T07:29:33.146214+0000","last_clean":"2024-03-16T07:29:33.146214+0000","last_became_active":"2024-03-16T07:29:33.144370+0000","last_became_peered":"2024-03-16T07:29:33.144370+0000","last_unstale":"2024-03-16T07:29:33.146214+0000","last_undegraded":"2024-03-16T07:29:33.146214+0000","last_fullsized":"2024-03-16T07:29:33.146214+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:40:18.934958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.133066+0000","last_change":"2024-03-16T07:29:33.133066+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.133066+0000","last_undegraded":"2024-03-16T07:29:33.133066+0000","last_fullsized":"2024-03-16T07:29:33.133066+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-03-16T07:29:33.147993+0000","last_change":"2024-03-16T07:29:33.145140+0000","last_active":"2024-03-16T07:29:33.147993+0000","last_peered":"2024-03-16T07:29:33.147993+0000","last_clean":"2024-03-16T07:29:33.147993+0000","last_became_active":"2024-03-16T07:29:33.144891+0000","last_became_peered":"2024-03-16T07:29:33.144891+0000","last_unstale":"2024-03-16T07:29:33.147993+0000","last_undegraded":"2024-03-16T07:29:33.147993+0000","last_fullsized":"2024-03-16T07:29:33.147993+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:37:10.315423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.133620+0000","last_change":"2024-03-16T07:29:33.133620+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.133620+0000","last_undegraded":"2024-03-16T07:29:33.133620+0000","last_fullsized":"2024-03-16T07:29:33.133620+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-03-16T07:29:33.144911+0000","last_change":"2024-03-16T07:29:33.143477+0000","last_active":"2024-03-16T07:29:33.144911+0000","last_peered":"2024-03-16T07:29:33.144911+0000","last_clean":"2024-03-16T07:29:33.144911+0000","last_became_active":"2024-03-16T07:29:33.143221+0000","last_became_peered":"2024-03-16T07:29:33.143221+0000","last_unstale":"2024-03-16T07:29:33.144911+0000","last_undegraded":"2024-03-16T07:29:33.144911+0000","last_fullsized":"2024-03-16T07:29:33.144911+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:35:05.997178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.134166+0000","last_change":"2024-03-16T07:29:33.134166+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.134166+0000","last_undegraded":"2024-03-16T07:29:33.134166+0000","last_fullsized":"2024-03-16T07:29:33.134166+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-03-16T07:29:33.152398+0000","last_change":"2024-03-16T07:29:33.151173+0000","last_active":"2024-03-16T07:29:33.152398+0000","last_peered":"2024-03-16T07:29:33.152398+0000","last_clean":"2024-03-16T07:29:33.152398+0000","last_became_active":"2024-03-16T07:29:33.150934+0000","last_became_peered":"2024-03-16T07:29:33.150934+0000","last_unstale":"2024-03-16T07:29:33.152398+0000","last_undegraded":"2024-03-16T07:29:33.152398+0000","last_fullsized":"2024-03-16T07:29:33.152398+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:19:24.993683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.135250+0000","last_change":"2024-03-16T07:29:33.135250+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.135250+0000","last_undegraded":"2024-03-16T07:29:33.135250+0000","last_fullsized":"2024-03-16T07:29:33.135250+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-03-16T07:29:33.153893+0000","last_change":"2024-03-16T07:29:33.152347+0000","last_active":"2024-03-16T07:29:33.153893+0000","last_peered":"2024-03-16T07:29:33.153893+0000","last_clean":"2024-03-16T07:29:33.153893+0000","last_became_active":"2024-03-16T07:29:33.152108+0000","last_became_peered":"2024-03-16T07:29:33.152108+0000","last_unstale":"2024-03-16T07:29:33.153893+0000","last_undegraded":"2024-03-16T07:29:33.153893+0000","last_fullsized":"2024-03-16T07:29:33.153893+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:54:27.091427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.134164+0000","last_change":"2024-03-16T07:29:33.134164+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.134164+0000","last_undegraded":"2024-03-16T07:29:33.134164+0000","last_fullsized":"2024-03-16T07:29:33.134164+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-03-16T07:29:33.152354+0000","last_change":"2024-03-16T07:29:33.149360+0000","last_active":"2024-03-16T07:29:33.152354+0000","last_peered":"2024-03-16T07:29:33.152354+0000","last_clean":"2024-03-16T07:29:33.152354+0000","last_became_active":"2024-03-16T07:29:33.148940+0000","last_became_peered":"2024-03-16T07:29:33.148940+0000","last_unstale":"2024-03-16T07:29:33.152354+0000","last_undegraded":"2024-03-16T07:29:33.152354+0000","last_fullsized":"2024-03-16T07:29:33.152354+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:44:58.999351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.133015+0000","last_change":"2024-03-16T07:29:33.133015+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.133015+0000","last_undegraded":"2024-03-16T07:29:33.133015+0000","last_fullsized":"2024-03-16T07:29:33.133015+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-03-16T07:29:33.148332+0000","last_change":"2024-03-16T07:29:33.147410+0000","last_active":"2024-03-16T07:29:33.148332+0000","last_peered":"2024-03-16T07:29:33.148332+0000","last_clean":"2024-03-16T07:29:33.148332+0000","last_became_active":"2024-03-16T07:29:33.146998+0000","last_became_peered":"2024-03-16T07:29:33.146998+0000","last_unstale":"2024-03-16T07:29:33.148332+0000","last_undegraded":"2024-03-16T07:29:33.148332+0000","last_fullsized":"2024-03-16T07:29:33.148332+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:01:51.501320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.131243+0000","last_change":"2024-03-16T07:29:33.131243+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.131243+0000","last_undegraded":"2024-03-16T07:29:33.131243+0000","last_fullsized":"2024-03-16T07:29:33.131243+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-03-16T07:29:33.147633+0000","last_change":"2024-03-16T07:29:33.145570+0000","last_active":"2024-03-16T07:29:33.147633+0000","last_peered":"2024-03-16T07:29:33.147633+0000","last_clean":"2024-03-16T07:29:33.147633+0000","last_became_active":"2024-03-16T07:29:33.145332+0000","last_became_peered":"2024-03-16T07:29:33.145332+0000","last_unstale":"2024-03-16T07:29:33.147633+0000","last_undegraded":"2024-03-16T07:29:33.147633+0000","last_fullsized":"2024-03-16T07:29:33.147633+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:45:10.083590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.133380+0000","last_change":"2024-03-16T07:29:33.133380+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.133380+0000","last_undegraded":"2024-03-16T07:29:33.133380+0000","last_fullsized":"2024-03-16T07:29:33.133380+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-03-16T07:29:33.147171+0000","last_change":"2024-03-16T07:29:33.145151+0000","last_active":"2024-03-16T07:29:33.147171+0000","last_peered":"2024-03-16T07:29:33.147171+0000","last_clean":"2024-03-16T07:29:33.147171+0000","last_became_active":"2024-03-16T07:29:33.144911+0000","last_became_peered":"2024-03-16T07:29:33.144911+0000","last_unstale":"2024-03-16T07:29:33.147171+0000","last_undegraded":"2024-03-16T07:29:33.147171+0000","last_fullsized":"2024-03-16T07:29:33.147171+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:52:07.278437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.132744+0000","last_change":"2024-03-16T07:29:33.132744+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.132744+0000","last_undegraded":"2024-03-16T07:29:33.132744+0000","last_fullsized":"2024-03-16T07:29:33.132744+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-03-16T07:29:33.148579+0000","last_change":"2024-03-16T07:29:33.145719+0000","last_active":"2024-03-16T07:29:33.148579+0000","last_peered":"2024-03-16T07:29:33.148579+0000","last_clean":"2024-03-16T07:29:33.148579+0000","last_became_active":"2024-03-16T07:29:33.141978+0000","last_became_peered":"2024-03-16T07:29:33.141978+0000","last_unstale":"2024-03-16T07:29:33.148579+0000","last_undegraded":"2024-03-16T07:29:33.148579+0000","last_fullsized":"2024-03-16T07:29:33.148579+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:53:03.878506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.135951+0000","last_change":"2024-03-16T07:29:33.135951+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.135951+0000","last_undegraded":"2024-03-16T07:29:33.135951+0000","last_fullsized":"2024-03-16T07:29:33.135951+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-03-16T07:29:33.143953+0000","last_change":"2024-03-16T07:29:33.143457+0000","last_active":"2024-03-16T07:29:33.143953+0000","last_peered":"2024-03-16T07:29:33.143953+0000","last_clean":"2024-03-16T07:29:33.143953+0000","last_became_active":"2024-03-16T07:29:33.143020+0000","last_became_peered":"2024-03-16T07:29:33.143020+0000","last_unstale":"2024-03-16T07:29:33.143953+0000","last_undegraded":"2024-03-16T07:29:33.143953+0000","last_fullsized":"2024-03-16T07:29:33.143953+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:04:32.253995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.130820+0000","last_change":"2024-03-16T07:29:33.130820+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.130820+0000","last_undegraded":"2024-03-16T07:29:33.130820+0000","last_fullsized":"2024-03-16T07:29:33.130820+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-03-16T07:29:33.152379+0000","last_change":"2024-03-16T07:29:33.150475+0000","last_active":"2024-03-16T07:29:33.152379+0000","last_peered":"2024-03-16T07:29:33.152379+0000","last_clean":"2024-03-16T07:29:33.152379+0000","last_became_active":"2024-03-16T07:29:33.150220+0000","last_became_peered":"2024-03-16T07:29:33.150220+0000","last_unstale":"2024-03-16T07:29:33.152379+0000","last_undegraded":"2024-03-16T07:29:33.152379+0000","last_fullsized":"2024-03-16T07:29:33.152379+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:31:42.068184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.133883+0000","last_change":"2024-03-16T07:29:33.133883+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.133883+0000","last_undegraded":"2024-03-16T07:29:33.133883+0000","last_fullsized":"2024-03-16T07:29:33.133883+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-03-16T07:29:33.151494+0000","last_change":"2024-03-16T07:29:33.144891+0000","last_active":"2024-03-16T07:29:33.151494+0000","last_peered":"2024-03-16T07:29:33.151494+0000","last_clean":"2024-03-16T07:29:33.151494+0000","last_became_active":"2024-03-16T07:29:33.144574+0000","last_became_peered":"2024-03-16T07:29:33.144574+0000","last_unstale":"2024-03-16T07:29:33.151494+0000","last_undegraded":"2024-03-16T07:29:33.151494+0000","last_fullsized":"2024-03-16T07:29:33.151494+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:11:59.374012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.132033+0000","last_change":"2024-03-16T07:29:33.132033+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.132033+0000","last_undegraded":"2024-03-16T07:29:33.132033+0000","last_fullsized":"2024-03-16T07:29:33.132033+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-03-16T07:29:33.151099+0000","last_change":"2024-03-16T07:29:33.147235+0000","last_active":"2024-03-16T07:29:33.151099+0000","last_peered":"2024-03-16T07:29:33.151099+0000","last_clean":"2024-03-16T07:29:33.151099+0000","last_became_active":"2024-03-16T07:29:33.146884+0000","last_became_peered":"2024-03-16T07:29:33.146884+0000","last_unstale":"2024-03-16T07:29:33.151099+0000","last_undegraded":"2024-03-16T07:29:33.151099+0000","last_fullsized":"2024-03-16T07:29:33.151099+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:57:08.184067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.130807+0000","last_change":"2024-03-16T07:29:33.130807+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.130807+0000","last_undegraded":"2024-03-16T07:29:33.130807+0000","last_fullsized":"2024-03-16T07:29:33.130807+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-03-16T07:29:33.143536+0000","last_change":"2024-03-16T07:29:33.142821+0000","last_active":"2024-03-16T07:29:33.143536+0000","last_peered":"2024-03-16T07:29:33.143536+0000","last_clean":"2024-03-16T07:29:33.143536+0000","last_became_active":"2024-03-16T07:29:33.142350+0000","last_became_peered":"2024-03-16T07:29:33.142350+0000","last_unstale":"2024-03-16T07:29:33.143536+0000","last_undegraded":"2024-03-16T07:29:33.143536+0000","last_fullsized":"2024-03-16T07:29:33.143536+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:57:53.414562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.135272+0000","last_change":"2024-03-16T07:29:33.135272+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.135272+0000","last_undegraded":"2024-03-16T07:29:33.135272+0000","last_fullsized":"2024-03-16T07:29:33.135272+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-03-16T07:29:33.150743+0000","last_change":"2024-03-16T07:29:33.149722+0000","last_active":"2024-03-16T07:29:33.150743+0000","last_peered":"2024-03-16T07:29:33.150743+0000","last_clean":"2024-03-16T07:29:33.150743+0000","last_became_active":"2024-03-16T07:29:33.149431+0000","last_became_peered":"2024-03-16T07:29:33.149431+0000","last_unstale":"2024-03-16T07:29:33.150743+0000","last_undegraded":"2024-03-16T07:29:33.150743+0000","last_fullsized":"2024-03-16T07:29:33.150743+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:34:21.521970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.133508+0000","last_change":"2024-03-16T07:29:33.133508+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.133508+0000","last_undegraded":"2024-03-16T07:29:33.133508+0000","last_fullsized":"2024-03-16T07:29:33.133508+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-03-16T07:29:33.145842+0000","last_change":"2024-03-16T07:29:33.142518+0000","last_active":"2024-03-16T07:29:33.145842+0000","last_peered":"2024-03-16T07:29:33.145842+0000","last_clean":"2024-03-16T07:29:33.145842+0000","last_became_active":"2024-03-16T07:29:33.141657+0000","last_became_peered":"2024-03-16T07:29:33.141657+0000","last_unstale":"2024-03-16T07:29:33.145842+0000","last_undegraded":"2024-03-16T07:29:33.145842+0000","last_fullsized":"2024-03-16T07:29:33.145842+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:22:00.943132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.133761+0000","last_change":"2024-03-16T07:29:33.133761+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.133761+0000","last_undegraded":"2024-03-16T07:29:33.133761+0000","last_fullsized":"2024-03-16T07:29:33.133761+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-03-16T07:29:33.143936+0000","last_change":"2024-03-16T07:29:33.143262+0000","last_active":"2024-03-16T07:29:33.143936+0000","last_peered":"2024-03-16T07:29:33.143936+0000","last_clean":"2024-03-16T07:29:33.143936+0000","last_became_active":"2024-03-16T07:29:33.142682+0000","last_became_peered":"2024-03-16T07:29:33.142682+0000","last_unstale":"2024-03-16T07:29:33.143936+0000","last_undegraded":"2024-03-16T07:29:33.143936+0000","last_fullsized":"2024-03-16T07:29:33.143936+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:27:42.837553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.134707+0000","last_change":"2024-03-16T07:29:33.134707+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.134707+0000","last_undegraded":"2024-03-16T07:29:33.134707+0000","last_fullsized":"2024-03-16T07:29:33.134707+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-03-16T07:29:33.151877+0000","last_change":"2024-03-16T07:29:33.147427+0000","last_active":"2024-03-16T07:29:33.151877+0000","last_peered":"2024-03-16T07:29:33.151877+0000","last_clean":"2024-03-16T07:29:33.151877+0000","last_became_active":"2024-03-16T07:29:33.147011+0000","last_became_peered":"2024-03-16T07:29:33.147011+0000","last_unstale":"2024-03-16T07:29:33.151877+0000","last_undegraded":"2024-03-16T07:29:33.151877+0000","last_fullsized":"2024-03-16T07:29:33.151877+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:52:43.283375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.133048+0000","last_change":"2024-03-16T07:29:33.133048+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.133048+0000","last_undegraded":"2024-03-16T07:29:33.133048+0000","last_fullsized":"2024-03-16T07:29:33.133048+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-03-16T07:29:33.153913+0000","last_change":"2024-03-16T07:29:33.152620+0000","last_active":"2024-03-16T07:29:33.153913+0000","last_peered":"2024-03-16T07:29:33.153913+0000","last_clean":"2024-03-16T07:29:33.153913+0000","last_became_active":"2024-03-16T07:29:33.152352+0000","last_became_peered":"2024-03-16T07:29:33.152352+0000","last_unstale":"2024-03-16T07:29:33.153913+0000","last_undegraded":"2024-03-16T07:29:33.153913+0000","last_fullsized":"2024-03-16T07:29:33.153913+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:24:19.329381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.133122+0000","last_change":"2024-03-16T07:29:33.133122+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.133122+0000","last_undegraded":"2024-03-16T07:29:33.133122+0000","last_fullsized":"2024-03-16T07:29:33.133122+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-03-16T07:29:33.151908+0000","last_change":"2024-03-16T07:29:33.147855+0000","last_active":"2024-03-16T07:29:33.151908+0000","last_peered":"2024-03-16T07:29:33.151908+0000","last_clean":"2024-03-16T07:29:33.151908+0000","last_became_active":"2024-03-16T07:29:33.147615+0000","last_became_peered":"2024-03-16T07:29:33.147615+0000","last_unstale":"2024-03-16T07:29:33.151908+0000","last_undegraded":"2024-03-16T07:29:33.151908+0000","last_fullsized":"2024-03-16T07:29:33.151908+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:52:31.609104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.131590+0000","last_change":"2024-03-16T07:29:33.131590+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.131590+0000","last_undegraded":"2024-03-16T07:29:33.131590+0000","last_fullsized":"2024-03-16T07:29:33.131590+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-03-16T07:29:33.148313+0000","last_change":"2024-03-16T07:29:33.147292+0000","last_active":"2024-03-16T07:29:33.148313+0000","last_peered":"2024-03-16T07:29:33.148313+0000","last_clean":"2024-03-16T07:29:33.148313+0000","last_became_active":"2024-03-16T07:29:33.146227+0000","last_became_peered":"2024-03-16T07:29:33.146227+0000","last_unstale":"2024-03-16T07:29:33.148313+0000","last_undegraded":"2024-03-16T07:29:33.148313+0000","last_fullsized":"2024-03-16T07:29:33.148313+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:01:06.794154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.134062+0000","last_change":"2024-03-16T07:29:33.134062+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.134062+0000","last_undegraded":"2024-03-16T07:29:33.134062+0000","last_fullsized":"2024-03-16T07:29:33.134062+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-03-16T07:29:33.152441+0000","last_change":"2024-03-16T07:29:33.150332+0000","last_active":"2024-03-16T07:29:33.152441+0000","last_peered":"2024-03-16T07:29:33.152441+0000","last_clean":"2024-03-16T07:29:33.152441+0000","last_became_active":"2024-03-16T07:29:33.149989+0000","last_became_peered":"2024-03-16T07:29:33.149989+0000","last_unstale":"2024-03-16T07:29:33.152441+0000","last_undegraded":"2024-03-16T07:29:33.152441+0000","last_fullsized":"2024-03-16T07:29:33.152441+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:31:32.404805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.132587+0000","last_change":"2024-03-16T07:29:33.132587+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.132587+0000","last_undegraded":"2024-03-16T07:29:33.132587+0000","last_fullsized":"2024-03-16T07:29:33.132587+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-03-16T07:29:33.149916+0000","last_change":"2024-03-16T07:29:33.144113+0000","last_active":"2024-03-16T07:29:33.149916+0000","last_peered":"2024-03-16T07:29:33.149916+0000","last_clean":"2024-03-16T07:29:33.149916+0000","last_became_active":"2024-03-16T07:29:33.140102+0000","last_became_peered":"2024-03-16T07:29:33.140102+0000","last_unstale":"2024-03-16T07:29:33.149916+0000","last_undegraded":"2024-03-16T07:29:33.149916+0000","last_fullsized":"2024-03-16T07:29:33.149916+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:44:48.930944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.132525+0000","last_change":"2024-03-16T07:29:33.132525+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.132525+0000","last_undegraded":"2024-03-16T07:29:33.132525+0000","last_fullsized":"2024-03-16T07:29:33.132525+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-03-16T07:29:33.148557+0000","last_change":"2024-03-16T07:29:33.145636+0000","last_active":"2024-03-16T07:29:33.148557+0000","last_peered":"2024-03-16T07:29:33.148557+0000","last_clean":"2024-03-16T07:29:33.148557+0000","last_became_active":"2024-03-16T07:29:33.143854+0000","last_became_peered":"2024-03-16T07:29:33.143854+0000","last_unstale":"2024-03-16T07:29:33.148557+0000","last_undegraded":"2024-03-16T07:29:33.148557+0000","last_fullsized":"2024-03-16T07:29:33.148557+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:57:05.520910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.132844+0000","last_change":"2024-03-16T07:29:33.132844+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.132844+0000","last_undegraded":"2024-03-16T07:29:33.132844+0000","last_fullsized":"2024-03-16T07:29:33.132844+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-03-16T07:29:33.146251+0000","last_change":"2024-03-16T07:29:33.144300+0000","last_active":"2024-03-16T07:29:33.146251+0000","last_peered":"2024-03-16T07:29:33.146251+0000","last_clean":"2024-03-16T07:29:33.146251+0000","last_became_active":"2024-03-16T07:29:33.144052+0000","last_became_peered":"2024-03-16T07:29:33.144052+0000","last_unstale":"2024-03-16T07:29:33.146251+0000","last_undegraded":"2024-03-16T07:29:33.146251+0000","last_fullsized":"2024-03-16T07:29:33.146251+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:07:22.128035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.134349+0000","last_change":"2024-03-16T07:29:33.134349+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.134349+0000","last_undegraded":"2024-03-16T07:29:33.134349+0000","last_fullsized":"2024-03-16T07:29:33.134349+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-03-16T07:29:33.151765+0000","last_change":"2024-03-16T07:29:33.147234+0000","last_active":"2024-03-16T07:29:33.151765+0000","last_peered":"2024-03-16T07:29:33.151765+0000","last_clean":"2024-03-16T07:29:33.151765+0000","last_became_active":"2024-03-16T07:29:33.146693+0000","last_became_peered":"2024-03-16T07:29:33.146693+0000","last_unstale":"2024-03-16T07:29:33.151765+0000","last_undegraded":"2024-03-16T07:29:33.151765+0000","last_fullsized":"2024-03-16T07:29:33.151765+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:07:56.951689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.132156+0000","last_change":"2024-03-16T07:29:33.132156+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.132156+0000","last_undegraded":"2024-03-16T07:29:33.132156+0000","last_fullsized":"2024-03-16T07:29:33.132156+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-03-16T07:29:33.143221+0000","last_change":"2024-03-16T07:29:33.141889+0000","last_active":"2024-03-16T07:29:33.143221+0000","last_peered":"2024-03-16T07:29:33.143221+0000","last_clean":"2024-03-16T07:29:33.143221+0000","last_became_active":"2024-03-16T07:29:33.141560+0000","last_became_peered":"2024-03-16T07:29:33.141560+0000","last_unstale":"2024-03-16T07:29:33.143221+0000","last_undegraded":"2024-03-16T07:29:33.143221+0000","last_fullsized":"2024-03-16T07:29:33.143221+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:42:43.864427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.131902+0000","last_change":"2024-03-16T07:29:33.131902+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.131902+0000","last_undegraded":"2024-03-16T07:29:33.131902+0000","last_fullsized":"2024-03-16T07:29:33.131902+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-03-16T07:29:33.144953+0000","last_change":"2024-03-16T07:29:33.143890+0000","last_active":"2024-03-16T07:29:33.144953+0000","last_peered":"2024-03-16T07:29:33.144953+0000","last_clean":"2024-03-16T07:29:33.144953+0000","last_became_active":"2024-03-16T07:29:33.143637+0000","last_became_peered":"2024-03-16T07:29:33.143637+0000","last_unstale":"2024-03-16T07:29:33.144953+0000","last_undegraded":"2024-03-16T07:29:33.144953+0000","last_fullsized":"2024-03-16T07:29:33.144953+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:11:31.289724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.131911+0000","last_change":"2024-03-16T07:29:33.131911+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.131911+0000","last_undegraded":"2024-03-16T07:29:33.131911+0000","last_fullsized":"2024-03-16T07:29:33.131911+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-03-16T07:29:33.146377+0000","last_change":"2024-03-16T07:29:33.139819+0000","last_active":"2024-03-16T07:29:33.146377+0000","last_peered":"2024-03-16T07:29:33.146377+0000","last_clean":"2024-03-16T07:29:33.146377+0000","last_became_active":"2024-03-16T07:29:33.139567+0000","last_became_peered":"2024-03-16T07:29:33.139567+0000","last_unstale":"2024-03-16T07:29:33.146377+0000","last_undegraded":"2024-03-16T07:29:33.146377+0000","last_fullsized":"2024-03-16T07:29:33.146377+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:14:54.131717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2024-03-16T07:29:33.135433+0000","last_change":"2024-03-16T07:29:33.135433+0000","last_active":"2024-03-16T07:29:33.124420+0000","last_peered":"2024-03-16T07:29:33.124420+0000","last_clean":"2024-03-16T07:29:33.124420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T07:29:33.135433+0000","last_undegraded":"2024-03-16T07:29:33.135433+0000","last_fullsized":"2024-03-16T07:29:33.135433+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-03-16T07:29:33.148902+0000","last_change":"2024-03-16T07:29:33.147194+0000","last_active":"2024-03-16T07:29:33.148902+0000","last_peered":"2024-03-16T07:29:33.148902+0000","last_clean":"2024-03-16T07:29:33.148902+0000","last_became_active":"2024-03-16T07:29:33.146945+0000","last_became_peered":"2024-03-16T07:29:33.146945+0000","last_unstale":"2024-03-16T07:29:33.148902+0000","last_undegraded":"2024-03-16T07:29:33.148902+0000","last_fullsized":"2024-03-16T07:29:33.148902+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:05:59.788864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"80'152","reported_seq":489,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-03-16T07:29:33.135902+0000","last_change":"2024-03-16T07:24:31.650537+0000","last_active":"2024-03-16T07:29:33.135902+0000","last_peered":"2024-03-16T07:29:33.135902+0000","last_clean":"2024-03-16T07:29:33.135902+0000","last_became_active":"2024-03-16T07:24:31.649574+0000","last_became_peered":"2024-03-16T07:24:31.649574+0000","last_unstale":"2024-03-16T07:29:33.135902+0000","last_undegraded":"2024-03-16T07:29:33.135902+0000","last_fullsized":"2024-03-16T07:29:33.135902+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:29.719970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:29.719970+0000","last_clean_scrub_stamp":"2024-03-16T07:24:29.719970+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:31:35.774554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":586,"num_read_kb":1121,"num_write":237,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":586,"num_read_kb":1121,"num_write":237,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":152,"ondisk_log_size":152,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738428,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":32096,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":104825504,"statfs":{"total":107374182400,"available":107341316096,"internally_reserved":0,"allocated":937984,"data_stored":372113,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738428,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":32680,"kb_used_data":1496,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":104824920,"statfs":{"total":107374182400,"available":107340718080,"internally_reserved":0,"allocated":1531904,"data_stored":962481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738428,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":32680,"kb_used_data":1496,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":104824920,"statfs":{"total":107374182400,"available":107340718080,"internally_reserved":0,"allocated":1531904,"data_stored":962481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-16T07:29:38.104 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.3f is not active+clean 2024-03-16T07:29:38.105 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 94, 'state': 'creating+peering', 'last_fresh': '2024-03-16T07:29:33.140450+0000', 'last_change': '2024-03-16T07:29:33.140450+0000', 'last_active': '2024-03-16T07:29:33.124420+0000', 'last_peered': '2024-03-16T07:29:33.124420+0000', 'last_clean': '2024-03-16T07:29:33.124420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-16T07:29:33.140450+0000', 'last_undegraded': '2024-03-16T07:29:33.140450+0000', 'last_fullsized': '2024-03-16T07:29:33.140450+0000', 'mapping_epoch': 94, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 94, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'last_clean_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-03-16T07:29:38.105 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.3e is not active+clean 2024-03-16T07:29:38.105 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 94, 'state': 'creating+peering', 'last_fresh': '2024-03-16T07:29:33.134820+0000', 'last_change': '2024-03-16T07:29:33.134820+0000', 'last_active': '2024-03-16T07:29:33.124420+0000', 'last_peered': '2024-03-16T07:29:33.124420+0000', 'last_clean': '2024-03-16T07:29:33.124420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-16T07:29:33.134820+0000', 'last_undegraded': '2024-03-16T07:29:33.134820+0000', 'last_fullsized': '2024-03-16T07:29:33.134820+0000', 'mapping_epoch': 94, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 94, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'last_clean_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-03-16T07:29:38.105 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.3d is not active+clean 2024-03-16T07:29:38.105 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 94, 'state': 'creating+peering', 'last_fresh': '2024-03-16T07:29:33.137535+0000', 'last_change': '2024-03-16T07:29:33.137535+0000', 'last_active': '2024-03-16T07:29:33.124420+0000', 'last_peered': '2024-03-16T07:29:33.124420+0000', 'last_clean': '2024-03-16T07:29:33.124420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-16T07:29:33.137535+0000', 'last_undegraded': '2024-03-16T07:29:33.137535+0000', 'last_fullsized': '2024-03-16T07:29:33.137535+0000', 'mapping_epoch': 94, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 94, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'last_clean_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-03-16T07:29:38.105 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.3c is not active+clean 2024-03-16T07:29:38.105 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 94, 'state': 'creating+peering', 'last_fresh': '2024-03-16T07:29:33.140710+0000', 'last_change': '2024-03-16T07:29:33.140710+0000', 'last_active': '2024-03-16T07:29:33.124420+0000', 'last_peered': '2024-03-16T07:29:33.124420+0000', 'last_clean': '2024-03-16T07:29:33.124420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-16T07:29:33.140710+0000', 'last_undegraded': '2024-03-16T07:29:33.140710+0000', 'last_fullsized': '2024-03-16T07:29:33.140710+0000', 'mapping_epoch': 94, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 94, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'last_clean_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-03-16T07:29:38.106 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.3b is not active+clean 2024-03-16T07:29:38.106 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 94, 'state': 'creating+peering', 'last_fresh': '2024-03-16T07:29:33.137548+0000', 'last_change': '2024-03-16T07:29:33.137548+0000', 'last_active': '2024-03-16T07:29:33.124420+0000', 'last_peered': '2024-03-16T07:29:33.124420+0000', 'last_clean': '2024-03-16T07:29:33.124420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-16T07:29:33.137548+0000', 'last_undegraded': '2024-03-16T07:29:33.137548+0000', 'last_fullsized': '2024-03-16T07:29:33.137548+0000', 'mapping_epoch': 94, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 94, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'last_clean_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-03-16T07:29:38.106 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.3a is not active+clean 2024-03-16T07:29:38.106 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 94, 'state': 'creating+peering', 'last_fresh': '2024-03-16T07:29:33.137600+0000', 'last_change': '2024-03-16T07:29:33.137600+0000', 'last_active': '2024-03-16T07:29:33.124420+0000', 'last_peered': '2024-03-16T07:29:33.124420+0000', 'last_clean': '2024-03-16T07:29:33.124420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-16T07:29:33.137600+0000', 'last_undegraded': '2024-03-16T07:29:33.137600+0000', 'last_fullsized': '2024-03-16T07:29:33.137600+0000', 'mapping_epoch': 94, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 94, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'last_clean_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-03-16T07:29:38.106 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.39 is not active+clean 2024-03-16T07:29:38.106 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 94, 'state': 'creating+peering', 'last_fresh': '2024-03-16T07:29:33.134947+0000', 'last_change': '2024-03-16T07:29:33.134947+0000', 'last_active': '2024-03-16T07:29:33.124420+0000', 'last_peered': '2024-03-16T07:29:33.124420+0000', 'last_clean': '2024-03-16T07:29:33.124420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-16T07:29:33.134947+0000', 'last_undegraded': '2024-03-16T07:29:33.134947+0000', 'last_fullsized': '2024-03-16T07:29:33.134947+0000', 'mapping_epoch': 94, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 94, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'last_clean_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-03-16T07:29:38.106 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.38 is not active+clean 2024-03-16T07:29:38.106 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 94, 'state': 'creating+peering', 'last_fresh': '2024-03-16T07:29:33.135232+0000', 'last_change': '2024-03-16T07:29:33.135232+0000', 'last_active': '2024-03-16T07:29:33.124420+0000', 'last_peered': '2024-03-16T07:29:33.124420+0000', 'last_clean': '2024-03-16T07:29:33.124420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-16T07:29:33.135232+0000', 'last_undegraded': '2024-03-16T07:29:33.135232+0000', 'last_fullsized': '2024-03-16T07:29:33.135232+0000', 'mapping_epoch': 94, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 94, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'last_clean_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-03-16T07:29:38.106 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.37 is not active+clean 2024-03-16T07:29:38.106 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 94, 'state': 'creating+peering', 'last_fresh': '2024-03-16T07:29:33.139990+0000', 'last_change': '2024-03-16T07:29:33.139990+0000', 'last_active': '2024-03-16T07:29:33.124420+0000', 'last_peered': '2024-03-16T07:29:33.124420+0000', 'last_clean': '2024-03-16T07:29:33.124420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-16T07:29:33.139990+0000', 'last_undegraded': '2024-03-16T07:29:33.139990+0000', 'last_fullsized': '2024-03-16T07:29:33.139990+0000', 'mapping_epoch': 94, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 94, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'last_clean_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-03-16T07:29:38.106 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.36 is not active+clean 2024-03-16T07:29:38.106 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 94, 'state': 'creating+peering', 'last_fresh': '2024-03-16T07:29:33.140060+0000', 'last_change': '2024-03-16T07:29:33.140060+0000', 'last_active': '2024-03-16T07:29:33.124420+0000', 'last_peered': '2024-03-16T07:29:33.124420+0000', 'last_clean': '2024-03-16T07:29:33.124420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-16T07:29:33.140060+0000', 'last_undegraded': '2024-03-16T07:29:33.140060+0000', 'last_fullsized': '2024-03-16T07:29:33.140060+0000', 'mapping_epoch': 94, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 94, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'last_clean_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-03-16T07:29:38.107 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.35 is not active+clean 2024-03-16T07:29:38.107 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 94, 'state': 'creating+peering', 'last_fresh': '2024-03-16T07:29:33.140023+0000', 'last_change': '2024-03-16T07:29:33.140023+0000', 'last_active': '2024-03-16T07:29:33.124420+0000', 'last_peered': '2024-03-16T07:29:33.124420+0000', 'last_clean': '2024-03-16T07:29:33.124420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-16T07:29:33.140023+0000', 'last_undegraded': '2024-03-16T07:29:33.140023+0000', 'last_fullsized': '2024-03-16T07:29:33.140023+0000', 'mapping_epoch': 94, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 94, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'last_clean_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-03-16T07:29:38.107 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.34 is not active+clean 2024-03-16T07:29:38.107 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 94, 'state': 'creating+peering', 'last_fresh': '2024-03-16T07:29:33.140376+0000', 'last_change': '2024-03-16T07:29:33.140376+0000', 'last_active': '2024-03-16T07:29:33.124420+0000', 'last_peered': '2024-03-16T07:29:33.124420+0000', 'last_clean': '2024-03-16T07:29:33.124420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-16T07:29:33.140376+0000', 'last_undegraded': '2024-03-16T07:29:33.140376+0000', 'last_fullsized': '2024-03-16T07:29:33.140376+0000', 'mapping_epoch': 94, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 94, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'last_clean_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-03-16T07:29:38.107 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.33 is not active+clean 2024-03-16T07:29:38.107 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 94, 'state': 'creating+peering', 'last_fresh': '2024-03-16T07:29:33.136995+0000', 'last_change': '2024-03-16T07:29:33.136995+0000', 'last_active': '2024-03-16T07:29:33.124420+0000', 'last_peered': '2024-03-16T07:29:33.124420+0000', 'last_clean': '2024-03-16T07:29:33.124420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-16T07:29:33.136995+0000', 'last_undegraded': '2024-03-16T07:29:33.136995+0000', 'last_fullsized': '2024-03-16T07:29:33.136995+0000', 'mapping_epoch': 94, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 94, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'last_clean_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-03-16T07:29:38.107 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.32 is not active+clean 2024-03-16T07:29:38.107 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 94, 'state': 'creating+peering', 'last_fresh': '2024-03-16T07:29:33.139015+0000', 'last_change': '2024-03-16T07:29:33.139015+0000', 'last_active': '2024-03-16T07:29:33.124420+0000', 'last_peered': '2024-03-16T07:29:33.124420+0000', 'last_clean': '2024-03-16T07:29:33.124420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-16T07:29:33.139015+0000', 'last_undegraded': '2024-03-16T07:29:33.139015+0000', 'last_fullsized': '2024-03-16T07:29:33.139015+0000', 'mapping_epoch': 94, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 94, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'last_clean_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-03-16T07:29:38.107 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.31 is not active+clean 2024-03-16T07:29:38.107 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 94, 'state': 'creating+peering', 'last_fresh': '2024-03-16T07:29:33.137927+0000', 'last_change': '2024-03-16T07:29:33.137927+0000', 'last_active': '2024-03-16T07:29:33.124420+0000', 'last_peered': '2024-03-16T07:29:33.124420+0000', 'last_clean': '2024-03-16T07:29:33.124420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-16T07:29:33.137927+0000', 'last_undegraded': '2024-03-16T07:29:33.137927+0000', 'last_fullsized': '2024-03-16T07:29:33.137927+0000', 'mapping_epoch': 94, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 94, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'last_clean_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-03-16T07:29:38.107 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.30 is not active+clean 2024-03-16T07:29:38.107 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 94, 'state': 'creating+peering', 'last_fresh': '2024-03-16T07:29:33.139019+0000', 'last_change': '2024-03-16T07:29:33.139019+0000', 'last_active': '2024-03-16T07:29:33.124420+0000', 'last_peered': '2024-03-16T07:29:33.124420+0000', 'last_clean': '2024-03-16T07:29:33.124420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-16T07:29:33.139019+0000', 'last_undegraded': '2024-03-16T07:29:33.139019+0000', 'last_fullsized': '2024-03-16T07:29:33.139019+0000', 'mapping_epoch': 94, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 94, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'last_clean_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-03-16T07:29:38.108 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.2f is not active+clean 2024-03-16T07:29:38.108 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 94, 'state': 'creating+peering', 'last_fresh': '2024-03-16T07:29:33.138741+0000', 'last_change': '2024-03-16T07:29:33.138741+0000', 'last_active': '2024-03-16T07:29:33.124420+0000', 'last_peered': '2024-03-16T07:29:33.124420+0000', 'last_clean': '2024-03-16T07:29:33.124420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-16T07:29:33.138741+0000', 'last_undegraded': '2024-03-16T07:29:33.138741+0000', 'last_fullsized': '2024-03-16T07:29:33.138741+0000', 'mapping_epoch': 94, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 94, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'last_clean_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-03-16T07:29:38.108 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.2e is not active+clean 2024-03-16T07:29:38.108 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 94, 'state': 'creating+peering', 'last_fresh': '2024-03-16T07:29:33.138601+0000', 'last_change': '2024-03-16T07:29:33.138601+0000', 'last_active': '2024-03-16T07:29:33.124420+0000', 'last_peered': '2024-03-16T07:29:33.124420+0000', 'last_clean': '2024-03-16T07:29:33.124420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-16T07:29:33.138601+0000', 'last_undegraded': '2024-03-16T07:29:33.138601+0000', 'last_fullsized': '2024-03-16T07:29:33.138601+0000', 'mapping_epoch': 94, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 94, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'last_clean_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-03-16T07:29:38.108 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.2d is not active+clean 2024-03-16T07:29:38.108 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 94, 'state': 'creating+peering', 'last_fresh': '2024-03-16T07:29:33.137234+0000', 'last_change': '2024-03-16T07:29:33.137234+0000', 'last_active': '2024-03-16T07:29:33.124420+0000', 'last_peered': '2024-03-16T07:29:33.124420+0000', 'last_clean': '2024-03-16T07:29:33.124420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-16T07:29:33.137234+0000', 'last_undegraded': '2024-03-16T07:29:33.137234+0000', 'last_fullsized': '2024-03-16T07:29:33.137234+0000', 'mapping_epoch': 94, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 94, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'last_clean_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-03-16T07:29:38.109 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.2c is not active+clean 2024-03-16T07:29:38.109 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 94, 'state': 'creating+peering', 'last_fresh': '2024-03-16T07:29:33.137282+0000', 'last_change': '2024-03-16T07:29:33.137282+0000', 'last_active': '2024-03-16T07:29:33.124420+0000', 'last_peered': '2024-03-16T07:29:33.124420+0000', 'last_clean': '2024-03-16T07:29:33.124420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-16T07:29:33.137282+0000', 'last_undegraded': '2024-03-16T07:29:33.137282+0000', 'last_fullsized': '2024-03-16T07:29:33.137282+0000', 'mapping_epoch': 94, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 94, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'last_clean_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-03-16T07:29:38.109 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.2b is not active+clean 2024-03-16T07:29:38.109 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 94, 'state': 'creating+peering', 'last_fresh': '2024-03-16T07:29:33.136651+0000', 'last_change': '2024-03-16T07:29:33.136651+0000', 'last_active': '2024-03-16T07:29:33.124420+0000', 'last_peered': '2024-03-16T07:29:33.124420+0000', 'last_clean': '2024-03-16T07:29:33.124420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-16T07:29:33.136651+0000', 'last_undegraded': '2024-03-16T07:29:33.136651+0000', 'last_fullsized': '2024-03-16T07:29:33.136651+0000', 'mapping_epoch': 94, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 94, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'last_clean_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-03-16T07:29:38.109 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.2a is not active+clean 2024-03-16T07:29:38.110 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 94, 'state': 'creating+peering', 'last_fresh': '2024-03-16T07:29:33.135578+0000', 'last_change': '2024-03-16T07:29:33.135578+0000', 'last_active': '2024-03-16T07:29:33.124420+0000', 'last_peered': '2024-03-16T07:29:33.124420+0000', 'last_clean': '2024-03-16T07:29:33.124420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-16T07:29:33.135578+0000', 'last_undegraded': '2024-03-16T07:29:33.135578+0000', 'last_fullsized': '2024-03-16T07:29:33.135578+0000', 'mapping_epoch': 94, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 94, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'last_clean_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-03-16T07:29:38.110 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.29 is not active+clean 2024-03-16T07:29:38.110 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 94, 'state': 'creating+peering', 'last_fresh': '2024-03-16T07:29:33.138948+0000', 'last_change': '2024-03-16T07:29:33.138948+0000', 'last_active': '2024-03-16T07:29:33.124420+0000', 'last_peered': '2024-03-16T07:29:33.124420+0000', 'last_clean': '2024-03-16T07:29:33.124420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-16T07:29:33.138948+0000', 'last_undegraded': '2024-03-16T07:29:33.138948+0000', 'last_fullsized': '2024-03-16T07:29:33.138948+0000', 'mapping_epoch': 94, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 94, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'last_clean_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-03-16T07:29:38.110 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.28 is not active+clean 2024-03-16T07:29:38.110 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 94, 'state': 'creating+peering', 'last_fresh': '2024-03-16T07:29:33.133877+0000', 'last_change': '2024-03-16T07:29:33.133877+0000', 'last_active': '2024-03-16T07:29:33.124420+0000', 'last_peered': '2024-03-16T07:29:33.124420+0000', 'last_clean': '2024-03-16T07:29:33.124420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-16T07:29:33.133877+0000', 'last_undegraded': '2024-03-16T07:29:33.133877+0000', 'last_fullsized': '2024-03-16T07:29:33.133877+0000', 'mapping_epoch': 94, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 94, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'last_clean_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-03-16T07:29:38.110 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.27 is not active+clean 2024-03-16T07:29:38.110 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 94, 'state': 'creating+peering', 'last_fresh': '2024-03-16T07:29:33.134216+0000', 'last_change': '2024-03-16T07:29:33.134216+0000', 'last_active': '2024-03-16T07:29:33.124420+0000', 'last_peered': '2024-03-16T07:29:33.124420+0000', 'last_clean': '2024-03-16T07:29:33.124420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-16T07:29:33.134216+0000', 'last_undegraded': '2024-03-16T07:29:33.134216+0000', 'last_fullsized': '2024-03-16T07:29:33.134216+0000', 'mapping_epoch': 94, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 94, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'last_clean_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-03-16T07:29:38.110 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.26 is not active+clean 2024-03-16T07:29:38.110 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 94, 'state': 'creating+peering', 'last_fresh': '2024-03-16T07:29:33.136040+0000', 'last_change': '2024-03-16T07:29:33.136040+0000', 'last_active': '2024-03-16T07:29:33.124420+0000', 'last_peered': '2024-03-16T07:29:33.124420+0000', 'last_clean': '2024-03-16T07:29:33.124420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-16T07:29:33.136040+0000', 'last_undegraded': '2024-03-16T07:29:33.136040+0000', 'last_fullsized': '2024-03-16T07:29:33.136040+0000', 'mapping_epoch': 94, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 94, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'last_clean_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-03-16T07:29:38.110 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.25 is not active+clean 2024-03-16T07:29:38.111 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 94, 'state': 'creating+peering', 'last_fresh': '2024-03-16T07:29:33.136915+0000', 'last_change': '2024-03-16T07:29:33.136915+0000', 'last_active': '2024-03-16T07:29:33.124420+0000', 'last_peered': '2024-03-16T07:29:33.124420+0000', 'last_clean': '2024-03-16T07:29:33.124420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-16T07:29:33.136915+0000', 'last_undegraded': '2024-03-16T07:29:33.136915+0000', 'last_fullsized': '2024-03-16T07:29:33.136915+0000', 'mapping_epoch': 94, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 94, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'last_clean_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-03-16T07:29:38.111 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.24 is not active+clean 2024-03-16T07:29:38.111 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 94, 'state': 'creating+peering', 'last_fresh': '2024-03-16T07:29:33.135741+0000', 'last_change': '2024-03-16T07:29:33.135741+0000', 'last_active': '2024-03-16T07:29:33.124420+0000', 'last_peered': '2024-03-16T07:29:33.124420+0000', 'last_clean': '2024-03-16T07:29:33.124420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-16T07:29:33.135741+0000', 'last_undegraded': '2024-03-16T07:29:33.135741+0000', 'last_fullsized': '2024-03-16T07:29:33.135741+0000', 'mapping_epoch': 94, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 94, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'last_clean_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-03-16T07:29:38.111 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.23 is not active+clean 2024-03-16T07:29:38.111 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 94, 'state': 'creating+peering', 'last_fresh': '2024-03-16T07:29:33.139465+0000', 'last_change': '2024-03-16T07:29:33.139465+0000', 'last_active': '2024-03-16T07:29:33.124420+0000', 'last_peered': '2024-03-16T07:29:33.124420+0000', 'last_clean': '2024-03-16T07:29:33.124420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-16T07:29:33.139465+0000', 'last_undegraded': '2024-03-16T07:29:33.139465+0000', 'last_fullsized': '2024-03-16T07:29:33.139465+0000', 'mapping_epoch': 94, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 94, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'last_clean_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-03-16T07:29:38.111 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.22 is not active+clean 2024-03-16T07:29:38.111 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 94, 'state': 'creating+peering', 'last_fresh': '2024-03-16T07:29:33.132351+0000', 'last_change': '2024-03-16T07:29:33.132351+0000', 'last_active': '2024-03-16T07:29:33.124420+0000', 'last_peered': '2024-03-16T07:29:33.124420+0000', 'last_clean': '2024-03-16T07:29:33.124420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-16T07:29:33.132351+0000', 'last_undegraded': '2024-03-16T07:29:33.132351+0000', 'last_fullsized': '2024-03-16T07:29:33.132351+0000', 'mapping_epoch': 94, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 94, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'last_clean_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-03-16T07:29:38.111 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.21 is not active+clean 2024-03-16T07:29:38.111 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 94, 'state': 'creating+peering', 'last_fresh': '2024-03-16T07:29:33.135630+0000', 'last_change': '2024-03-16T07:29:33.135630+0000', 'last_active': '2024-03-16T07:29:33.124420+0000', 'last_peered': '2024-03-16T07:29:33.124420+0000', 'last_clean': '2024-03-16T07:29:33.124420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-16T07:29:33.135630+0000', 'last_undegraded': '2024-03-16T07:29:33.135630+0000', 'last_fullsized': '2024-03-16T07:29:33.135630+0000', 'mapping_epoch': 94, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 94, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'last_clean_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-03-16T07:29:38.111 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.20 is not active+clean 2024-03-16T07:29:38.111 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 94, 'state': 'creating+peering', 'last_fresh': '2024-03-16T07:29:33.137860+0000', 'last_change': '2024-03-16T07:29:33.137860+0000', 'last_active': '2024-03-16T07:29:33.124420+0000', 'last_peered': '2024-03-16T07:29:33.124420+0000', 'last_clean': '2024-03-16T07:29:33.124420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-16T07:29:33.137860+0000', 'last_undegraded': '2024-03-16T07:29:33.137860+0000', 'last_fullsized': '2024-03-16T07:29:33.137860+0000', 'mapping_epoch': 94, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 94, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'last_clean_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-03-16T07:29:38.111 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.1e is not active+clean 2024-03-16T07:29:38.112 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 94, 'state': 'creating+peering', 'last_fresh': '2024-03-16T07:29:33.138139+0000', 'last_change': '2024-03-16T07:29:33.138139+0000', 'last_active': '2024-03-16T07:29:33.124420+0000', 'last_peered': '2024-03-16T07:29:33.124420+0000', 'last_clean': '2024-03-16T07:29:33.124420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-16T07:29:33.138139+0000', 'last_undegraded': '2024-03-16T07:29:33.138139+0000', 'last_fullsized': '2024-03-16T07:29:33.138139+0000', 'mapping_epoch': 94, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 94, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'last_clean_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-03-16T07:29:38.112 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.1f is not active+clean 2024-03-16T07:29:38.112 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 94, 'state': 'creating+peering', 'last_fresh': '2024-03-16T07:29:33.135311+0000', 'last_change': '2024-03-16T07:29:33.135311+0000', 'last_active': '2024-03-16T07:29:33.124420+0000', 'last_peered': '2024-03-16T07:29:33.124420+0000', 'last_clean': '2024-03-16T07:29:33.124420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-16T07:29:33.135311+0000', 'last_undegraded': '2024-03-16T07:29:33.135311+0000', 'last_fullsized': '2024-03-16T07:29:33.135311+0000', 'mapping_epoch': 94, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 94, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'last_clean_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-03-16T07:29:38.112 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.1c is not active+clean 2024-03-16T07:29:38.112 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 94, 'state': 'creating+peering', 'last_fresh': '2024-03-16T07:29:33.133066+0000', 'last_change': '2024-03-16T07:29:33.133066+0000', 'last_active': '2024-03-16T07:29:33.124420+0000', 'last_peered': '2024-03-16T07:29:33.124420+0000', 'last_clean': '2024-03-16T07:29:33.124420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-16T07:29:33.133066+0000', 'last_undegraded': '2024-03-16T07:29:33.133066+0000', 'last_fullsized': '2024-03-16T07:29:33.133066+0000', 'mapping_epoch': 94, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 94, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'last_clean_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-03-16T07:29:38.112 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.1d is not active+clean 2024-03-16T07:29:38.112 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 94, 'state': 'creating+peering', 'last_fresh': '2024-03-16T07:29:33.133620+0000', 'last_change': '2024-03-16T07:29:33.133620+0000', 'last_active': '2024-03-16T07:29:33.124420+0000', 'last_peered': '2024-03-16T07:29:33.124420+0000', 'last_clean': '2024-03-16T07:29:33.124420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-16T07:29:33.133620+0000', 'last_undegraded': '2024-03-16T07:29:33.133620+0000', 'last_fullsized': '2024-03-16T07:29:33.133620+0000', 'mapping_epoch': 94, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 94, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'last_clean_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-03-16T07:29:38.112 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.1a is not active+clean 2024-03-16T07:29:38.112 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 94, 'state': 'creating+peering', 'last_fresh': '2024-03-16T07:29:33.134166+0000', 'last_change': '2024-03-16T07:29:33.134166+0000', 'last_active': '2024-03-16T07:29:33.124420+0000', 'last_peered': '2024-03-16T07:29:33.124420+0000', 'last_clean': '2024-03-16T07:29:33.124420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-16T07:29:33.134166+0000', 'last_undegraded': '2024-03-16T07:29:33.134166+0000', 'last_fullsized': '2024-03-16T07:29:33.134166+0000', 'mapping_epoch': 94, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 94, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'last_clean_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-03-16T07:29:38.112 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.1b is not active+clean 2024-03-16T07:29:38.112 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 94, 'state': 'creating+peering', 'last_fresh': '2024-03-16T07:29:33.135250+0000', 'last_change': '2024-03-16T07:29:33.135250+0000', 'last_active': '2024-03-16T07:29:33.124420+0000', 'last_peered': '2024-03-16T07:29:33.124420+0000', 'last_clean': '2024-03-16T07:29:33.124420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-16T07:29:33.135250+0000', 'last_undegraded': '2024-03-16T07:29:33.135250+0000', 'last_fullsized': '2024-03-16T07:29:33.135250+0000', 'mapping_epoch': 94, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 94, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'last_clean_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-03-16T07:29:38.112 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.18 is not active+clean 2024-03-16T07:29:38.113 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 94, 'state': 'creating+peering', 'last_fresh': '2024-03-16T07:29:33.134164+0000', 'last_change': '2024-03-16T07:29:33.134164+0000', 'last_active': '2024-03-16T07:29:33.124420+0000', 'last_peered': '2024-03-16T07:29:33.124420+0000', 'last_clean': '2024-03-16T07:29:33.124420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-16T07:29:33.134164+0000', 'last_undegraded': '2024-03-16T07:29:33.134164+0000', 'last_fullsized': '2024-03-16T07:29:33.134164+0000', 'mapping_epoch': 94, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 94, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'last_clean_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-03-16T07:29:38.113 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.19 is not active+clean 2024-03-16T07:29:38.113 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 94, 'state': 'creating+peering', 'last_fresh': '2024-03-16T07:29:33.133015+0000', 'last_change': '2024-03-16T07:29:33.133015+0000', 'last_active': '2024-03-16T07:29:33.124420+0000', 'last_peered': '2024-03-16T07:29:33.124420+0000', 'last_clean': '2024-03-16T07:29:33.124420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-16T07:29:33.133015+0000', 'last_undegraded': '2024-03-16T07:29:33.133015+0000', 'last_fullsized': '2024-03-16T07:29:33.133015+0000', 'mapping_epoch': 94, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 94, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'last_clean_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-03-16T07:29:38.113 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.16 is not active+clean 2024-03-16T07:29:38.113 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 94, 'state': 'creating+peering', 'last_fresh': '2024-03-16T07:29:33.131243+0000', 'last_change': '2024-03-16T07:29:33.131243+0000', 'last_active': '2024-03-16T07:29:33.124420+0000', 'last_peered': '2024-03-16T07:29:33.124420+0000', 'last_clean': '2024-03-16T07:29:33.124420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-16T07:29:33.131243+0000', 'last_undegraded': '2024-03-16T07:29:33.131243+0000', 'last_fullsized': '2024-03-16T07:29:33.131243+0000', 'mapping_epoch': 94, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 94, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'last_clean_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-03-16T07:29:38.113 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.17 is not active+clean 2024-03-16T07:29:38.113 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 94, 'state': 'creating+peering', 'last_fresh': '2024-03-16T07:29:33.133380+0000', 'last_change': '2024-03-16T07:29:33.133380+0000', 'last_active': '2024-03-16T07:29:33.124420+0000', 'last_peered': '2024-03-16T07:29:33.124420+0000', 'last_clean': '2024-03-16T07:29:33.124420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-16T07:29:33.133380+0000', 'last_undegraded': '2024-03-16T07:29:33.133380+0000', 'last_fullsized': '2024-03-16T07:29:33.133380+0000', 'mapping_epoch': 94, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 94, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'last_clean_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-03-16T07:29:38.113 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.14 is not active+clean 2024-03-16T07:29:38.113 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 94, 'state': 'creating+peering', 'last_fresh': '2024-03-16T07:29:33.132744+0000', 'last_change': '2024-03-16T07:29:33.132744+0000', 'last_active': '2024-03-16T07:29:33.124420+0000', 'last_peered': '2024-03-16T07:29:33.124420+0000', 'last_clean': '2024-03-16T07:29:33.124420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-16T07:29:33.132744+0000', 'last_undegraded': '2024-03-16T07:29:33.132744+0000', 'last_fullsized': '2024-03-16T07:29:33.132744+0000', 'mapping_epoch': 94, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 94, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'last_clean_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-03-16T07:29:38.113 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.15 is not active+clean 2024-03-16T07:29:38.113 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 94, 'state': 'creating+peering', 'last_fresh': '2024-03-16T07:29:33.135951+0000', 'last_change': '2024-03-16T07:29:33.135951+0000', 'last_active': '2024-03-16T07:29:33.124420+0000', 'last_peered': '2024-03-16T07:29:33.124420+0000', 'last_clean': '2024-03-16T07:29:33.124420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-16T07:29:33.135951+0000', 'last_undegraded': '2024-03-16T07:29:33.135951+0000', 'last_fullsized': '2024-03-16T07:29:33.135951+0000', 'mapping_epoch': 94, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 94, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'last_clean_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-03-16T07:29:38.114 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.12 is not active+clean 2024-03-16T07:29:38.114 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 94, 'state': 'creating+peering', 'last_fresh': '2024-03-16T07:29:33.130820+0000', 'last_change': '2024-03-16T07:29:33.130820+0000', 'last_active': '2024-03-16T07:29:33.124420+0000', 'last_peered': '2024-03-16T07:29:33.124420+0000', 'last_clean': '2024-03-16T07:29:33.124420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-16T07:29:33.130820+0000', 'last_undegraded': '2024-03-16T07:29:33.130820+0000', 'last_fullsized': '2024-03-16T07:29:33.130820+0000', 'mapping_epoch': 94, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 94, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'last_clean_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-03-16T07:29:38.114 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.13 is not active+clean 2024-03-16T07:29:38.114 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 94, 'state': 'creating+peering', 'last_fresh': '2024-03-16T07:29:33.133883+0000', 'last_change': '2024-03-16T07:29:33.133883+0000', 'last_active': '2024-03-16T07:29:33.124420+0000', 'last_peered': '2024-03-16T07:29:33.124420+0000', 'last_clean': '2024-03-16T07:29:33.124420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-16T07:29:33.133883+0000', 'last_undegraded': '2024-03-16T07:29:33.133883+0000', 'last_fullsized': '2024-03-16T07:29:33.133883+0000', 'mapping_epoch': 94, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 94, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'last_clean_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-03-16T07:29:38.114 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.11 is not active+clean 2024-03-16T07:29:38.114 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 94, 'state': 'creating+peering', 'last_fresh': '2024-03-16T07:29:33.132033+0000', 'last_change': '2024-03-16T07:29:33.132033+0000', 'last_active': '2024-03-16T07:29:33.124420+0000', 'last_peered': '2024-03-16T07:29:33.124420+0000', 'last_clean': '2024-03-16T07:29:33.124420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-16T07:29:33.132033+0000', 'last_undegraded': '2024-03-16T07:29:33.132033+0000', 'last_fullsized': '2024-03-16T07:29:33.132033+0000', 'mapping_epoch': 94, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 94, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'last_clean_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-03-16T07:29:38.114 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.e is not active+clean 2024-03-16T07:29:38.114 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 94, 'state': 'creating+peering', 'last_fresh': '2024-03-16T07:29:33.130807+0000', 'last_change': '2024-03-16T07:29:33.130807+0000', 'last_active': '2024-03-16T07:29:33.124420+0000', 'last_peered': '2024-03-16T07:29:33.124420+0000', 'last_clean': '2024-03-16T07:29:33.124420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-16T07:29:33.130807+0000', 'last_undegraded': '2024-03-16T07:29:33.130807+0000', 'last_fullsized': '2024-03-16T07:29:33.130807+0000', 'mapping_epoch': 94, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 94, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'last_clean_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-03-16T07:29:38.114 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.f is not active+clean 2024-03-16T07:29:38.114 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 94, 'state': 'creating+peering', 'last_fresh': '2024-03-16T07:29:33.135272+0000', 'last_change': '2024-03-16T07:29:33.135272+0000', 'last_active': '2024-03-16T07:29:33.124420+0000', 'last_peered': '2024-03-16T07:29:33.124420+0000', 'last_clean': '2024-03-16T07:29:33.124420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-16T07:29:33.135272+0000', 'last_undegraded': '2024-03-16T07:29:33.135272+0000', 'last_fullsized': '2024-03-16T07:29:33.135272+0000', 'mapping_epoch': 94, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 94, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'last_clean_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-03-16T07:29:38.114 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.c is not active+clean 2024-03-16T07:29:38.115 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 94, 'state': 'creating+peering', 'last_fresh': '2024-03-16T07:29:33.133508+0000', 'last_change': '2024-03-16T07:29:33.133508+0000', 'last_active': '2024-03-16T07:29:33.124420+0000', 'last_peered': '2024-03-16T07:29:33.124420+0000', 'last_clean': '2024-03-16T07:29:33.124420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-16T07:29:33.133508+0000', 'last_undegraded': '2024-03-16T07:29:33.133508+0000', 'last_fullsized': '2024-03-16T07:29:33.133508+0000', 'mapping_epoch': 94, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 94, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'last_clean_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-03-16T07:29:38.115 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.d is not active+clean 2024-03-16T07:29:38.115 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 94, 'state': 'creating+peering', 'last_fresh': '2024-03-16T07:29:33.133761+0000', 'last_change': '2024-03-16T07:29:33.133761+0000', 'last_active': '2024-03-16T07:29:33.124420+0000', 'last_peered': '2024-03-16T07:29:33.124420+0000', 'last_clean': '2024-03-16T07:29:33.124420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-16T07:29:33.133761+0000', 'last_undegraded': '2024-03-16T07:29:33.133761+0000', 'last_fullsized': '2024-03-16T07:29:33.133761+0000', 'mapping_epoch': 94, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 94, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'last_clean_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-03-16T07:29:38.115 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.a is not active+clean 2024-03-16T07:29:38.115 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 94, 'state': 'creating+peering', 'last_fresh': '2024-03-16T07:29:33.134707+0000', 'last_change': '2024-03-16T07:29:33.134707+0000', 'last_active': '2024-03-16T07:29:33.124420+0000', 'last_peered': '2024-03-16T07:29:33.124420+0000', 'last_clean': '2024-03-16T07:29:33.124420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-16T07:29:33.134707+0000', 'last_undegraded': '2024-03-16T07:29:33.134707+0000', 'last_fullsized': '2024-03-16T07:29:33.134707+0000', 'mapping_epoch': 94, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 94, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'last_clean_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-03-16T07:29:38.115 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.b is not active+clean 2024-03-16T07:29:38.115 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 94, 'state': 'creating+peering', 'last_fresh': '2024-03-16T07:29:33.133048+0000', 'last_change': '2024-03-16T07:29:33.133048+0000', 'last_active': '2024-03-16T07:29:33.124420+0000', 'last_peered': '2024-03-16T07:29:33.124420+0000', 'last_clean': '2024-03-16T07:29:33.124420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-16T07:29:33.133048+0000', 'last_undegraded': '2024-03-16T07:29:33.133048+0000', 'last_fullsized': '2024-03-16T07:29:33.133048+0000', 'mapping_epoch': 94, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 94, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'last_clean_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-03-16T07:29:38.115 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.8 is not active+clean 2024-03-16T07:29:38.115 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 94, 'state': 'creating+peering', 'last_fresh': '2024-03-16T07:29:33.133122+0000', 'last_change': '2024-03-16T07:29:33.133122+0000', 'last_active': '2024-03-16T07:29:33.124420+0000', 'last_peered': '2024-03-16T07:29:33.124420+0000', 'last_clean': '2024-03-16T07:29:33.124420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-16T07:29:33.133122+0000', 'last_undegraded': '2024-03-16T07:29:33.133122+0000', 'last_fullsized': '2024-03-16T07:29:33.133122+0000', 'mapping_epoch': 94, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 94, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'last_clean_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-03-16T07:29:38.115 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.9 is not active+clean 2024-03-16T07:29:38.115 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 94, 'state': 'creating+peering', 'last_fresh': '2024-03-16T07:29:33.131590+0000', 'last_change': '2024-03-16T07:29:33.131590+0000', 'last_active': '2024-03-16T07:29:33.124420+0000', 'last_peered': '2024-03-16T07:29:33.124420+0000', 'last_clean': '2024-03-16T07:29:33.124420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-16T07:29:33.131590+0000', 'last_undegraded': '2024-03-16T07:29:33.131590+0000', 'last_fullsized': '2024-03-16T07:29:33.131590+0000', 'mapping_epoch': 94, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 94, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'last_clean_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-03-16T07:29:38.116 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.6 is not active+clean 2024-03-16T07:29:38.116 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 94, 'state': 'creating+peering', 'last_fresh': '2024-03-16T07:29:33.134062+0000', 'last_change': '2024-03-16T07:29:33.134062+0000', 'last_active': '2024-03-16T07:29:33.124420+0000', 'last_peered': '2024-03-16T07:29:33.124420+0000', 'last_clean': '2024-03-16T07:29:33.124420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-16T07:29:33.134062+0000', 'last_undegraded': '2024-03-16T07:29:33.134062+0000', 'last_fullsized': '2024-03-16T07:29:33.134062+0000', 'mapping_epoch': 94, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 94, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'last_clean_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-03-16T07:29:38.116 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.7 is not active+clean 2024-03-16T07:29:38.116 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 94, 'state': 'creating+peering', 'last_fresh': '2024-03-16T07:29:33.132587+0000', 'last_change': '2024-03-16T07:29:33.132587+0000', 'last_active': '2024-03-16T07:29:33.124420+0000', 'last_peered': '2024-03-16T07:29:33.124420+0000', 'last_clean': '2024-03-16T07:29:33.124420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-16T07:29:33.132587+0000', 'last_undegraded': '2024-03-16T07:29:33.132587+0000', 'last_fullsized': '2024-03-16T07:29:33.132587+0000', 'mapping_epoch': 94, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 94, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'last_clean_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-03-16T07:29:38.116 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.4 is not active+clean 2024-03-16T07:29:38.116 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 94, 'state': 'creating+peering', 'last_fresh': '2024-03-16T07:29:33.132525+0000', 'last_change': '2024-03-16T07:29:33.132525+0000', 'last_active': '2024-03-16T07:29:33.124420+0000', 'last_peered': '2024-03-16T07:29:33.124420+0000', 'last_clean': '2024-03-16T07:29:33.124420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-16T07:29:33.132525+0000', 'last_undegraded': '2024-03-16T07:29:33.132525+0000', 'last_fullsized': '2024-03-16T07:29:33.132525+0000', 'mapping_epoch': 94, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 94, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'last_clean_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-03-16T07:29:38.116 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.5 is not active+clean 2024-03-16T07:29:38.116 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 94, 'state': 'creating+peering', 'last_fresh': '2024-03-16T07:29:33.132844+0000', 'last_change': '2024-03-16T07:29:33.132844+0000', 'last_active': '2024-03-16T07:29:33.124420+0000', 'last_peered': '2024-03-16T07:29:33.124420+0000', 'last_clean': '2024-03-16T07:29:33.124420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-16T07:29:33.132844+0000', 'last_undegraded': '2024-03-16T07:29:33.132844+0000', 'last_fullsized': '2024-03-16T07:29:33.132844+0000', 'mapping_epoch': 94, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 94, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'last_clean_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-03-16T07:29:38.116 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.2 is not active+clean 2024-03-16T07:29:38.116 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 94, 'state': 'creating+peering', 'last_fresh': '2024-03-16T07:29:33.134349+0000', 'last_change': '2024-03-16T07:29:33.134349+0000', 'last_active': '2024-03-16T07:29:33.124420+0000', 'last_peered': '2024-03-16T07:29:33.124420+0000', 'last_clean': '2024-03-16T07:29:33.124420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-16T07:29:33.134349+0000', 'last_undegraded': '2024-03-16T07:29:33.134349+0000', 'last_fullsized': '2024-03-16T07:29:33.134349+0000', 'mapping_epoch': 94, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 94, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'last_clean_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-03-16T07:29:38.116 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.3 is not active+clean 2024-03-16T07:29:38.116 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 94, 'state': 'creating+peering', 'last_fresh': '2024-03-16T07:29:33.132156+0000', 'last_change': '2024-03-16T07:29:33.132156+0000', 'last_active': '2024-03-16T07:29:33.124420+0000', 'last_peered': '2024-03-16T07:29:33.124420+0000', 'last_clean': '2024-03-16T07:29:33.124420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-16T07:29:33.132156+0000', 'last_undegraded': '2024-03-16T07:29:33.132156+0000', 'last_fullsized': '2024-03-16T07:29:33.132156+0000', 'mapping_epoch': 94, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 94, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'last_clean_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-03-16T07:29:38.117 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.0 is not active+clean 2024-03-16T07:29:38.117 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 94, 'state': 'creating+peering', 'last_fresh': '2024-03-16T07:29:33.131902+0000', 'last_change': '2024-03-16T07:29:33.131902+0000', 'last_active': '2024-03-16T07:29:33.124420+0000', 'last_peered': '2024-03-16T07:29:33.124420+0000', 'last_clean': '2024-03-16T07:29:33.124420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-16T07:29:33.131902+0000', 'last_undegraded': '2024-03-16T07:29:33.131902+0000', 'last_fullsized': '2024-03-16T07:29:33.131902+0000', 'mapping_epoch': 94, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 94, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'last_clean_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-03-16T07:29:38.117 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.1 is not active+clean 2024-03-16T07:29:38.117 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 94, 'state': 'creating+peering', 'last_fresh': '2024-03-16T07:29:33.131911+0000', 'last_change': '2024-03-16T07:29:33.131911+0000', 'last_active': '2024-03-16T07:29:33.124420+0000', 'last_peered': '2024-03-16T07:29:33.124420+0000', 'last_clean': '2024-03-16T07:29:33.124420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-16T07:29:33.131911+0000', 'last_undegraded': '2024-03-16T07:29:33.131911+0000', 'last_fullsized': '2024-03-16T07:29:33.131911+0000', 'mapping_epoch': 94, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 94, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'last_clean_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-03-16T07:29:38.117 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.10 is not active+clean 2024-03-16T07:29:38.117 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 94, 'state': 'creating+peering', 'last_fresh': '2024-03-16T07:29:33.135433+0000', 'last_change': '2024-03-16T07:29:33.135433+0000', 'last_active': '2024-03-16T07:29:33.124420+0000', 'last_peered': '2024-03-16T07:29:33.124420+0000', 'last_clean': '2024-03-16T07:29:33.124420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-16T07:29:33.135433+0000', 'last_undegraded': '2024-03-16T07:29:33.135433+0000', 'last_fullsized': '2024-03-16T07:29:33.135433+0000', 'mapping_epoch': 94, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 94, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'last_clean_scrub_stamp': '2024-03-16T07:29:33.124420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-03-16T07:29:38.117 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-03-16T07:29:38.509 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:29:38.510 INFO:teuthology.orchestra.run.smithi049.stdout:{"fsid":"f91af061-9eac-4793-87fa-8d27ae3d242f","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":3,"quorum":[0],"quorum_names":["a"],"quorum_age":318,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":1},"osdmap":{"epoch":96,"num_osds":3,"num_up_osds":3,"osd_up_since":1710573867,"num_in_osds":3,"osd_in_since":1710573861,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"active+clean","count":33}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":99794944,"bytes_avail":322022752256,"bytes_total":322122547200,"inactive_pgs_ratio":0.65979379415512085},"fsmap":{"epoch":65,"id":8,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":8,"rank":0,"name":"e","status":"up:active","gid":5598}],"up:standby":4},"mgrmap":{"available":true,"num_standbys":0,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":8,"modified":"2024-03-16T07:29:22.163890+0000","services":{"cephfs-mirror":{"daemons":{"summary":"","4487":{"start_epoch":3,"start_stamp":"2024-03-16T07:25:17.058618+0000","gid":4487,"addr":"172.21.15.49:0/2144406915","metadata":{"arch":"x86_64","ceph_release":"squid","ceph_version":"ceph version 19.0.0-2162-g3d78f5ba (3d78f5ba07bf18880172c07d4d7b4ac00c9d30af) squid (dev)","ceph_version_short":"19.0.0-2162-g3d78f5ba","cpu":"Intel(R) Xeon(R) CPU E5-1620 v3 @ 3.50GHz","distro":"centos","distro_description":"CentOS Stream 9","distro_version":"9","hostname":"smithi049","id":"mirror","instance_id":"4487","kernel_description":"#1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024","kernel_version":"5.14.0-427.el9.x86_64","mem_swap_kb":"0","mem_total_kb":"32488312","os":"Linux"},"task_status":{}}}},"mds":{"daemons":{"summary":"","b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"e":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"mgr":{"daemons":{"summary":"","x":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"mon":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"osd":{"daemons":{"summary":"","0":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"1":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"2":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-03-16T07:29:38.523 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-03-16T07:29:38.523 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-16T07:29:38.577 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T07:29:38.838 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:29:38.839 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2024-03-16T07:29:38.850 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":32,"stamp":"2024-03-16T07:29:38.166470+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":586,"num_read_kb":1121,"num_write":282,"num_write_kb":1908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":191,"ondisk_log_size":191,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":314572800,"kb_used":105916,"kb_used_data":4044,"kb_used_omap":4,"kb_used_meta":101819,"kb_avail":314466884,"statfs":{"total":322122547200,"available":322014089216,"internally_reserved":0,"allocated":4141056,"data_stored":2339275,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":104262991},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001030"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:35.136282+0000","last_change":"2024-03-16T07:29:33.837801+0000","last_active":"2024-03-16T07:29:35.136282+0000","last_peered":"2024-03-16T07:29:35.136282+0000","last_clean":"2024-03-16T07:29:35.136282+0000","last_became_active":"2024-03-16T07:29:33.837541+0000","last_became_peered":"2024-03-16T07:29:33.837541+0000","last_unstale":"2024-03-16T07:29:35.136282+0000","last_undegraded":"2024-03-16T07:29:35.136282+0000","last_fullsized":"2024-03-16T07:29:35.136282+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:04:52.392474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:34.818153+0000","last_change":"2024-03-16T07:29:33.828285+0000","last_active":"2024-03-16T07:29:34.818153+0000","last_peered":"2024-03-16T07:29:34.818153+0000","last_clean":"2024-03-16T07:29:34.818153+0000","last_became_active":"2024-03-16T07:29:33.827699+0000","last_became_peered":"2024-03-16T07:29:33.827699+0000","last_unstale":"2024-03-16T07:29:34.818153+0000","last_undegraded":"2024-03-16T07:29:34.818153+0000","last_fullsized":"2024-03-16T07:29:34.818153+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:26:06.558057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:35.133390+0000","last_change":"2024-03-16T07:29:33.832571+0000","last_active":"2024-03-16T07:29:35.133390+0000","last_peered":"2024-03-16T07:29:35.133390+0000","last_clean":"2024-03-16T07:29:35.133390+0000","last_became_active":"2024-03-16T07:29:33.832329+0000","last_became_peered":"2024-03-16T07:29:33.832329+0000","last_unstale":"2024-03-16T07:29:35.133390+0000","last_undegraded":"2024-03-16T07:29:35.133390+0000","last_fullsized":"2024-03-16T07:29:35.133390+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:45:05.916690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:35.135868+0000","last_change":"2024-03-16T07:29:33.830557+0000","last_active":"2024-03-16T07:29:35.135868+0000","last_peered":"2024-03-16T07:29:35.135868+0000","last_clean":"2024-03-16T07:29:35.135868+0000","last_became_active":"2024-03-16T07:29:33.830122+0000","last_became_peered":"2024-03-16T07:29:33.830122+0000","last_unstale":"2024-03-16T07:29:35.135868+0000","last_undegraded":"2024-03-16T07:29:35.135868+0000","last_fullsized":"2024-03-16T07:29:35.135868+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:35:43.576229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:34.818862+0000","last_change":"2024-03-16T07:29:33.834562+0000","last_active":"2024-03-16T07:29:34.818862+0000","last_peered":"2024-03-16T07:29:34.818862+0000","last_clean":"2024-03-16T07:29:34.818862+0000","last_became_active":"2024-03-16T07:29:33.833200+0000","last_became_peered":"2024-03-16T07:29:33.833200+0000","last_unstale":"2024-03-16T07:29:34.818862+0000","last_undegraded":"2024-03-16T07:29:34.818862+0000","last_fullsized":"2024-03-16T07:29:34.818862+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:07:30.736713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:35.133141+0000","last_change":"2024-03-16T07:29:33.826274+0000","last_active":"2024-03-16T07:29:35.133141+0000","last_peered":"2024-03-16T07:29:35.133141+0000","last_clean":"2024-03-16T07:29:35.133141+0000","last_became_active":"2024-03-16T07:29:33.825821+0000","last_became_peered":"2024-03-16T07:29:33.825821+0000","last_unstale":"2024-03-16T07:29:35.133141+0000","last_undegraded":"2024-03-16T07:29:35.133141+0000","last_fullsized":"2024-03-16T07:29:35.133141+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:54:54.165392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:34.817863+0000","last_change":"2024-03-16T07:29:33.832454+0000","last_active":"2024-03-16T07:29:34.817863+0000","last_peered":"2024-03-16T07:29:34.817863+0000","last_clean":"2024-03-16T07:29:34.817863+0000","last_became_active":"2024-03-16T07:29:33.832205+0000","last_became_peered":"2024-03-16T07:29:33.832205+0000","last_unstale":"2024-03-16T07:29:34.817863+0000","last_undegraded":"2024-03-16T07:29:34.817863+0000","last_fullsized":"2024-03-16T07:29:34.817863+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:45:54.158424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:34.817695+0000","last_change":"2024-03-16T07:29:33.834186+0000","last_active":"2024-03-16T07:29:34.817695+0000","last_peered":"2024-03-16T07:29:34.817695+0000","last_clean":"2024-03-16T07:29:34.817695+0000","last_became_active":"2024-03-16T07:29:33.833939+0000","last_became_peered":"2024-03-16T07:29:33.833939+0000","last_unstale":"2024-03-16T07:29:34.817695+0000","last_undegraded":"2024-03-16T07:29:34.817695+0000","last_fullsized":"2024-03-16T07:29:34.817695+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:05:33.276056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:35.136420+0000","last_change":"2024-03-16T07:29:33.840759+0000","last_active":"2024-03-16T07:29:35.136420+0000","last_peered":"2024-03-16T07:29:35.136420+0000","last_clean":"2024-03-16T07:29:35.136420+0000","last_became_active":"2024-03-16T07:29:33.840493+0000","last_became_peered":"2024-03-16T07:29:33.840493+0000","last_unstale":"2024-03-16T07:29:35.136420+0000","last_undegraded":"2024-03-16T07:29:35.136420+0000","last_fullsized":"2024-03-16T07:29:35.136420+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:28:46.696178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:35.136204+0000","last_change":"2024-03-16T07:29:33.837411+0000","last_active":"2024-03-16T07:29:35.136204+0000","last_peered":"2024-03-16T07:29:35.136204+0000","last_clean":"2024-03-16T07:29:35.136204+0000","last_became_active":"2024-03-16T07:29:33.837054+0000","last_became_peered":"2024-03-16T07:29:33.837054+0000","last_unstale":"2024-03-16T07:29:35.136204+0000","last_undegraded":"2024-03-16T07:29:35.136204+0000","last_fullsized":"2024-03-16T07:29:35.136204+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:40:38.224614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:35.136010+0000","last_change":"2024-03-16T07:29:33.841582+0000","last_active":"2024-03-16T07:29:35.136010+0000","last_peered":"2024-03-16T07:29:35.136010+0000","last_clean":"2024-03-16T07:29:35.136010+0000","last_became_active":"2024-03-16T07:29:33.841350+0000","last_became_peered":"2024-03-16T07:29:33.841350+0000","last_unstale":"2024-03-16T07:29:35.136010+0000","last_undegraded":"2024-03-16T07:29:35.136010+0000","last_fullsized":"2024-03-16T07:29:35.136010+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:25:07.504235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:35.135977+0000","last_change":"2024-03-16T07:29:33.830360+0000","last_active":"2024-03-16T07:29:35.135977+0000","last_peered":"2024-03-16T07:29:35.135977+0000","last_clean":"2024-03-16T07:29:35.135977+0000","last_became_active":"2024-03-16T07:29:33.829805+0000","last_became_peered":"2024-03-16T07:29:33.829805+0000","last_unstale":"2024-03-16T07:29:35.135977+0000","last_undegraded":"2024-03-16T07:29:35.135977+0000","last_fullsized":"2024-03-16T07:29:35.135977+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:47:45.954148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:34.818888+0000","last_change":"2024-03-16T07:29:33.827090+0000","last_active":"2024-03-16T07:29:34.818888+0000","last_peered":"2024-03-16T07:29:34.818888+0000","last_clean":"2024-03-16T07:29:34.818888+0000","last_became_active":"2024-03-16T07:29:33.826838+0000","last_became_peered":"2024-03-16T07:29:33.826838+0000","last_unstale":"2024-03-16T07:29:34.818888+0000","last_undegraded":"2024-03-16T07:29:34.818888+0000","last_fullsized":"2024-03-16T07:29:34.818888+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:14:55.133041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:35.135346+0000","last_change":"2024-03-16T07:29:33.839839+0000","last_active":"2024-03-16T07:29:35.135346+0000","last_peered":"2024-03-16T07:29:35.135346+0000","last_clean":"2024-03-16T07:29:35.135346+0000","last_became_active":"2024-03-16T07:29:33.839596+0000","last_became_peered":"2024-03-16T07:29:33.839596+0000","last_unstale":"2024-03-16T07:29:35.135346+0000","last_undegraded":"2024-03-16T07:29:35.135346+0000","last_fullsized":"2024-03-16T07:29:35.135346+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:28:05.388099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:35.132438+0000","last_change":"2024-03-16T07:29:33.834583+0000","last_active":"2024-03-16T07:29:35.132438+0000","last_peered":"2024-03-16T07:29:35.132438+0000","last_clean":"2024-03-16T07:29:35.132438+0000","last_became_active":"2024-03-16T07:29:33.834324+0000","last_became_peered":"2024-03-16T07:29:33.834324+0000","last_unstale":"2024-03-16T07:29:35.132438+0000","last_undegraded":"2024-03-16T07:29:35.132438+0000","last_fullsized":"2024-03-16T07:29:35.132438+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:06:40.607068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:35.135161+0000","last_change":"2024-03-16T07:29:33.841155+0000","last_active":"2024-03-16T07:29:35.135161+0000","last_peered":"2024-03-16T07:29:35.135161+0000","last_clean":"2024-03-16T07:29:35.135161+0000","last_became_active":"2024-03-16T07:29:33.840814+0000","last_became_peered":"2024-03-16T07:29:33.840814+0000","last_unstale":"2024-03-16T07:29:35.135161+0000","last_undegraded":"2024-03-16T07:29:35.135161+0000","last_fullsized":"2024-03-16T07:29:35.135161+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:51:01.302406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:35.133847+0000","last_change":"2024-03-16T07:29:33.835448+0000","last_active":"2024-03-16T07:29:35.133847+0000","last_peered":"2024-03-16T07:29:35.133847+0000","last_clean":"2024-03-16T07:29:35.133847+0000","last_became_active":"2024-03-16T07:29:33.834817+0000","last_became_peered":"2024-03-16T07:29:33.834817+0000","last_unstale":"2024-03-16T07:29:35.133847+0000","last_undegraded":"2024-03-16T07:29:35.133847+0000","last_fullsized":"2024-03-16T07:29:35.133847+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:05:33.276056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:35.133544+0000","last_change":"2024-03-16T07:29:33.836688+0000","last_active":"2024-03-16T07:29:35.133544+0000","last_peered":"2024-03-16T07:29:35.133544+0000","last_clean":"2024-03-16T07:29:35.133544+0000","last_became_active":"2024-03-16T07:29:33.836439+0000","last_became_peered":"2024-03-16T07:29:33.836439+0000","last_unstale":"2024-03-16T07:29:35.133544+0000","last_undegraded":"2024-03-16T07:29:35.133544+0000","last_fullsized":"2024-03-16T07:29:35.133544+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:00:43.877183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:35.133458+0000","last_change":"2024-03-16T07:29:33.831962+0000","last_active":"2024-03-16T07:29:35.133458+0000","last_peered":"2024-03-16T07:29:35.133458+0000","last_clean":"2024-03-16T07:29:35.133458+0000","last_became_active":"2024-03-16T07:29:33.831730+0000","last_became_peered":"2024-03-16T07:29:33.831730+0000","last_unstale":"2024-03-16T07:29:35.133458+0000","last_undegraded":"2024-03-16T07:29:35.133458+0000","last_fullsized":"2024-03-16T07:29:35.133458+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:44:31.524367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:35.133020+0000","last_change":"2024-03-16T07:29:33.826162+0000","last_active":"2024-03-16T07:29:35.133020+0000","last_peered":"2024-03-16T07:29:35.133020+0000","last_clean":"2024-03-16T07:29:35.133020+0000","last_became_active":"2024-03-16T07:29:33.825696+0000","last_became_peered":"2024-03-16T07:29:33.825696+0000","last_unstale":"2024-03-16T07:29:35.133020+0000","last_undegraded":"2024-03-16T07:29:35.133020+0000","last_fullsized":"2024-03-16T07:29:35.133020+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:28:45.230768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:34.818976+0000","last_change":"2024-03-16T07:29:33.835797+0000","last_active":"2024-03-16T07:29:34.818976+0000","last_peered":"2024-03-16T07:29:34.818976+0000","last_clean":"2024-03-16T07:29:34.818976+0000","last_became_active":"2024-03-16T07:29:33.835556+0000","last_became_peered":"2024-03-16T07:29:33.835556+0000","last_unstale":"2024-03-16T07:29:34.818976+0000","last_undegraded":"2024-03-16T07:29:34.818976+0000","last_fullsized":"2024-03-16T07:29:34.818976+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:42:44.865750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:34.817861+0000","last_change":"2024-03-16T07:29:33.833025+0000","last_active":"2024-03-16T07:29:34.817861+0000","last_peered":"2024-03-16T07:29:34.817861+0000","last_clean":"2024-03-16T07:29:34.817861+0000","last_became_active":"2024-03-16T07:29:33.832508+0000","last_became_peered":"2024-03-16T07:29:33.832508+0000","last_unstale":"2024-03-16T07:29:34.817861+0000","last_undegraded":"2024-03-16T07:29:34.817861+0000","last_fullsized":"2024-03-16T07:29:34.817861+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:48:56.092113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:35.135337+0000","last_change":"2024-03-16T07:29:33.830404+0000","last_active":"2024-03-16T07:29:35.135337+0000","last_peered":"2024-03-16T07:29:35.135337+0000","last_clean":"2024-03-16T07:29:35.135337+0000","last_became_active":"2024-03-16T07:29:33.830174+0000","last_became_peered":"2024-03-16T07:29:33.830174+0000","last_unstale":"2024-03-16T07:29:35.135337+0000","last_undegraded":"2024-03-16T07:29:35.135337+0000","last_fullsized":"2024-03-16T07:29:35.135337+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:41:12.198698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:34.817689+0000","last_change":"2024-03-16T07:29:33.834147+0000","last_active":"2024-03-16T07:29:34.817689+0000","last_peered":"2024-03-16T07:29:34.817689+0000","last_clean":"2024-03-16T07:29:34.817689+0000","last_became_active":"2024-03-16T07:29:33.833703+0000","last_became_peered":"2024-03-16T07:29:33.833703+0000","last_unstale":"2024-03-16T07:29:34.817689+0000","last_undegraded":"2024-03-16T07:29:34.817689+0000","last_fullsized":"2024-03-16T07:29:34.817689+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:54:08.885808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:34.818466+0000","last_change":"2024-03-16T07:29:33.834992+0000","last_active":"2024-03-16T07:29:34.818466+0000","last_peered":"2024-03-16T07:29:34.818466+0000","last_clean":"2024-03-16T07:29:34.818466+0000","last_became_active":"2024-03-16T07:29:33.834758+0000","last_became_peered":"2024-03-16T07:29:33.834758+0000","last_unstale":"2024-03-16T07:29:34.818466+0000","last_undegraded":"2024-03-16T07:29:34.818466+0000","last_fullsized":"2024-03-16T07:29:34.818466+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:32:15.280635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:35.136380+0000","last_change":"2024-03-16T07:29:33.841057+0000","last_active":"2024-03-16T07:29:35.136380+0000","last_peered":"2024-03-16T07:29:35.136380+0000","last_clean":"2024-03-16T07:29:35.136380+0000","last_became_active":"2024-03-16T07:29:33.840691+0000","last_became_peered":"2024-03-16T07:29:33.840691+0000","last_unstale":"2024-03-16T07:29:35.136380+0000","last_undegraded":"2024-03-16T07:29:35.136380+0000","last_fullsized":"2024-03-16T07:29:35.136380+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:18:02.038888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:35.133534+0000","last_change":"2024-03-16T07:29:33.835192+0000","last_active":"2024-03-16T07:29:35.133534+0000","last_peered":"2024-03-16T07:29:35.133534+0000","last_clean":"2024-03-16T07:29:35.133534+0000","last_became_active":"2024-03-16T07:29:33.834934+0000","last_became_peered":"2024-03-16T07:29:33.834934+0000","last_unstale":"2024-03-16T07:29:35.133534+0000","last_undegraded":"2024-03-16T07:29:35.133534+0000","last_fullsized":"2024-03-16T07:29:35.133534+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:26:32.824858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:35.136215+0000","last_change":"2024-03-16T07:29:33.837983+0000","last_active":"2024-03-16T07:29:35.136215+0000","last_peered":"2024-03-16T07:29:35.136215+0000","last_clean":"2024-03-16T07:29:35.136215+0000","last_became_active":"2024-03-16T07:29:33.837496+0000","last_became_peered":"2024-03-16T07:29:33.837496+0000","last_unstale":"2024-03-16T07:29:35.136215+0000","last_undegraded":"2024-03-16T07:29:35.136215+0000","last_fullsized":"2024-03-16T07:29:35.136215+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:53:25.642839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:35.135790+0000","last_change":"2024-03-16T07:29:33.838573+0000","last_active":"2024-03-16T07:29:35.135790+0000","last_peered":"2024-03-16T07:29:35.135790+0000","last_clean":"2024-03-16T07:29:35.135790+0000","last_became_active":"2024-03-16T07:29:33.837752+0000","last_became_peered":"2024-03-16T07:29:33.837752+0000","last_unstale":"2024-03-16T07:29:35.135790+0000","last_undegraded":"2024-03-16T07:29:35.135790+0000","last_fullsized":"2024-03-16T07:29:35.135790+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:41:10.081251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:34.818035+0000","last_change":"2024-03-16T07:29:33.832836+0000","last_active":"2024-03-16T07:29:34.818035+0000","last_peered":"2024-03-16T07:29:34.818035+0000","last_clean":"2024-03-16T07:29:34.818035+0000","last_became_active":"2024-03-16T07:29:33.832354+0000","last_became_peered":"2024-03-16T07:29:33.832354+0000","last_unstale":"2024-03-16T07:29:34.818035+0000","last_undegraded":"2024-03-16T07:29:34.818035+0000","last_fullsized":"2024-03-16T07:29:34.818035+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:09:01.072871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:35.135475+0000","last_change":"2024-03-16T07:29:33.830827+0000","last_active":"2024-03-16T07:29:35.135475+0000","last_peered":"2024-03-16T07:29:35.135475+0000","last_clean":"2024-03-16T07:29:35.135475+0000","last_became_active":"2024-03-16T07:29:33.829553+0000","last_became_peered":"2024-03-16T07:29:33.829553+0000","last_unstale":"2024-03-16T07:29:35.135475+0000","last_undegraded":"2024-03-16T07:29:35.135475+0000","last_fullsized":"2024-03-16T07:29:35.135475+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:47:12.171754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:35.132398+0000","last_change":"2024-03-16T07:29:33.826298+0000","last_active":"2024-03-16T07:29:35.132398+0000","last_peered":"2024-03-16T07:29:35.132398+0000","last_clean":"2024-03-16T07:29:35.132398+0000","last_became_active":"2024-03-16T07:29:33.826047+0000","last_became_peered":"2024-03-16T07:29:33.826047+0000","last_unstale":"2024-03-16T07:29:35.132398+0000","last_undegraded":"2024-03-16T07:29:35.132398+0000","last_fullsized":"2024-03-16T07:29:35.132398+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:53:30.099446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:35.133675+0000","last_change":"2024-03-16T07:29:33.826129+0000","last_active":"2024-03-16T07:29:35.133675+0000","last_peered":"2024-03-16T07:29:35.133675+0000","last_clean":"2024-03-16T07:29:35.133675+0000","last_became_active":"2024-03-16T07:29:33.825871+0000","last_became_peered":"2024-03-16T07:29:33.825871+0000","last_unstale":"2024-03-16T07:29:35.133675+0000","last_undegraded":"2024-03-16T07:29:35.133675+0000","last_fullsized":"2024-03-16T07:29:35.133675+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:54:08.885808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"95'4","reported_seq":18,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:35.136641+0000","last_change":"2024-03-16T07:29:33.142157+0000","last_active":"2024-03-16T07:29:35.136641+0000","last_peered":"2024-03-16T07:29:35.136641+0000","last_clean":"2024-03-16T07:29:35.136641+0000","last_became_active":"2024-03-16T07:29:33.141750+0000","last_became_peered":"2024-03-16T07:29:33.141750+0000","last_unstale":"2024-03-16T07:29:35.136641+0000","last_undegraded":"2024-03-16T07:29:35.136641+0000","last_fullsized":"2024-03-16T07:29:35.136641+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:15:22.486053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:35.136586+0000","last_change":"2024-03-16T07:29:33.829851+0000","last_active":"2024-03-16T07:29:35.136586+0000","last_peered":"2024-03-16T07:29:35.136586+0000","last_clean":"2024-03-16T07:29:35.136586+0000","last_became_active":"2024-03-16T07:29:33.829620+0000","last_became_peered":"2024-03-16T07:29:33.829620+0000","last_unstale":"2024-03-16T07:29:35.136586+0000","last_undegraded":"2024-03-16T07:29:35.136586+0000","last_fullsized":"2024-03-16T07:29:35.136586+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:03:47.150413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1e","version":"95'1","reported_seq":15,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:34.818272+0000","last_change":"2024-03-16T07:29:33.144641+0000","last_active":"2024-03-16T07:29:34.818272+0000","last_peered":"2024-03-16T07:29:34.818272+0000","last_clean":"2024-03-16T07:29:34.818272+0000","last_became_active":"2024-03-16T07:29:33.144370+0000","last_became_peered":"2024-03-16T07:29:33.144370+0000","last_unstale":"2024-03-16T07:29:34.818272+0000","last_undegraded":"2024-03-16T07:29:34.818272+0000","last_fullsized":"2024-03-16T07:29:34.818272+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:02:47.297486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:35.133169+0000","last_change":"2024-03-16T07:29:33.836419+0000","last_active":"2024-03-16T07:29:35.133169+0000","last_peered":"2024-03-16T07:29:35.133169+0000","last_clean":"2024-03-16T07:29:35.133169+0000","last_became_active":"2024-03-16T07:29:33.836160+0000","last_became_peered":"2024-03-16T07:29:33.836160+0000","last_unstale":"2024-03-16T07:29:35.133169+0000","last_undegraded":"2024-03-16T07:29:35.133169+0000","last_fullsized":"2024-03-16T07:29:35.133169+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:26:07.664599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1d","version":"95'2","reported_seq":16,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:34.818580+0000","last_change":"2024-03-16T07:29:33.145140+0000","last_active":"2024-03-16T07:29:34.818580+0000","last_peered":"2024-03-16T07:29:34.818580+0000","last_clean":"2024-03-16T07:29:34.818580+0000","last_became_active":"2024-03-16T07:29:33.144891+0000","last_became_peered":"2024-03-16T07:29:33.144891+0000","last_unstale":"2024-03-16T07:29:34.818580+0000","last_undegraded":"2024-03-16T07:29:34.818580+0000","last_fullsized":"2024-03-16T07:29:34.818580+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:04:47.579175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:35.133595+0000","last_change":"2024-03-16T07:29:33.828184+0000","last_active":"2024-03-16T07:29:35.133595+0000","last_peered":"2024-03-16T07:29:35.133595+0000","last_clean":"2024-03-16T07:29:35.133595+0000","last_became_active":"2024-03-16T07:29:33.827955+0000","last_became_peered":"2024-03-16T07:29:33.827955+0000","last_unstale":"2024-03-16T07:29:35.133595+0000","last_undegraded":"2024-03-16T07:29:35.133595+0000","last_fullsized":"2024-03-16T07:29:35.133595+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:20:59.190114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"95'2","reported_seq":16,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:34.818130+0000","last_change":"2024-03-16T07:29:33.143477+0000","last_active":"2024-03-16T07:29:34.818130+0000","last_peered":"2024-03-16T07:29:34.818130+0000","last_clean":"2024-03-16T07:29:34.818130+0000","last_became_active":"2024-03-16T07:29:33.143221+0000","last_became_peered":"2024-03-16T07:29:33.143221+0000","last_unstale":"2024-03-16T07:29:34.818130+0000","last_undegraded":"2024-03-16T07:29:34.818130+0000","last_fullsized":"2024-03-16T07:29:34.818130+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:39:36.137228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:35.135450+0000","last_change":"2024-03-16T07:29:33.839989+0000","last_active":"2024-03-16T07:29:35.135450+0000","last_peered":"2024-03-16T07:29:35.135450+0000","last_clean":"2024-03-16T07:29:35.135450+0000","last_became_active":"2024-03-16T07:29:33.839759+0000","last_became_peered":"2024-03-16T07:29:33.839759+0000","last_unstale":"2024-03-16T07:29:35.135450+0000","last_undegraded":"2024-03-16T07:29:35.135450+0000","last_fullsized":"2024-03-16T07:29:35.135450+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:46:33.756833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1b","version":"95'1","reported_seq":15,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:35.132727+0000","last_change":"2024-03-16T07:29:33.151173+0000","last_active":"2024-03-16T07:29:35.132727+0000","last_peered":"2024-03-16T07:29:35.132727+0000","last_clean":"2024-03-16T07:29:35.132727+0000","last_became_active":"2024-03-16T07:29:33.150934+0000","last_became_peered":"2024-03-16T07:29:33.150934+0000","last_unstale":"2024-03-16T07:29:35.132727+0000","last_undegraded":"2024-03-16T07:29:35.132727+0000","last_fullsized":"2024-03-16T07:29:35.132727+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:35:30.259942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:35.135823+0000","last_change":"2024-03-16T07:29:33.838441+0000","last_active":"2024-03-16T07:29:35.135823+0000","last_peered":"2024-03-16T07:29:35.135823+0000","last_clean":"2024-03-16T07:29:35.135823+0000","last_became_active":"2024-03-16T07:29:33.837425+0000","last_became_peered":"2024-03-16T07:29:33.837425+0000","last_unstale":"2024-03-16T07:29:35.135823+0000","last_undegraded":"2024-03-16T07:29:35.135823+0000","last_fullsized":"2024-03-16T07:29:35.135823+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:44:16.567702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"95'1","reported_seq":15,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:34.818276+0000","last_change":"2024-03-16T07:29:33.152347+0000","last_active":"2024-03-16T07:29:34.818276+0000","last_peered":"2024-03-16T07:29:34.818276+0000","last_clean":"2024-03-16T07:29:34.818276+0000","last_became_active":"2024-03-16T07:29:33.152108+0000","last_became_peered":"2024-03-16T07:29:33.152108+0000","last_unstale":"2024-03-16T07:29:34.818276+0000","last_undegraded":"2024-03-16T07:29:34.818276+0000","last_fullsized":"2024-03-16T07:29:34.818276+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:48:09.351303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:35.135222+0000","last_change":"2024-03-16T07:29:33.841426+0000","last_active":"2024-03-16T07:29:35.135222+0000","last_peered":"2024-03-16T07:29:35.135222+0000","last_clean":"2024-03-16T07:29:35.135222+0000","last_became_active":"2024-03-16T07:29:33.841098+0000","last_became_peered":"2024-03-16T07:29:33.841098+0000","last_unstale":"2024-03-16T07:29:35.135222+0000","last_undegraded":"2024-03-16T07:29:35.135222+0000","last_fullsized":"2024-03-16T07:29:35.135222+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:11:40.760659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":14,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:35.132670+0000","last_change":"2024-03-16T07:29:33.149360+0000","last_active":"2024-03-16T07:29:35.132670+0000","last_peered":"2024-03-16T07:29:35.132670+0000","last_clean":"2024-03-16T07:29:35.132670+0000","last_became_active":"2024-03-16T07:29:33.148940+0000","last_became_peered":"2024-03-16T07:29:33.148940+0000","last_unstale":"2024-03-16T07:29:35.132670+0000","last_undegraded":"2024-03-16T07:29:35.132670+0000","last_fullsized":"2024-03-16T07:29:35.132670+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:25:34.455727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:35.132455+0000","last_change":"2024-03-16T07:29:33.827723+0000","last_active":"2024-03-16T07:29:35.132455+0000","last_peered":"2024-03-16T07:29:35.132455+0000","last_clean":"2024-03-16T07:29:35.132455+0000","last_became_active":"2024-03-16T07:29:33.827484+0000","last_became_peered":"2024-03-16T07:29:33.827484+0000","last_unstale":"2024-03-16T07:29:35.132455+0000","last_undegraded":"2024-03-16T07:29:35.132455+0000","last_fullsized":"2024-03-16T07:29:35.132455+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:36:39.935834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":14,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:35.135413+0000","last_change":"2024-03-16T07:29:33.147410+0000","last_active":"2024-03-16T07:29:35.135413+0000","last_peered":"2024-03-16T07:29:35.135413+0000","last_clean":"2024-03-16T07:29:35.135413+0000","last_became_active":"2024-03-16T07:29:33.146998+0000","last_became_peered":"2024-03-16T07:29:33.146998+0000","last_unstale":"2024-03-16T07:29:35.135413+0000","last_undegraded":"2024-03-16T07:29:35.135413+0000","last_fullsized":"2024-03-16T07:29:35.135413+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:24:35.197990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:34.818189+0000","last_change":"2024-03-16T07:29:33.828079+0000","last_active":"2024-03-16T07:29:34.818189+0000","last_peered":"2024-03-16T07:29:34.818189+0000","last_clean":"2024-03-16T07:29:34.818189+0000","last_became_active":"2024-03-16T07:29:33.827356+0000","last_became_peered":"2024-03-16T07:29:33.827356+0000","last_unstale":"2024-03-16T07:29:34.818189+0000","last_undegraded":"2024-03-16T07:29:34.818189+0000","last_fullsized":"2024-03-16T07:29:34.818189+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:54:56.120560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":14,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:34.818692+0000","last_change":"2024-03-16T07:29:33.145570+0000","last_active":"2024-03-16T07:29:34.818692+0000","last_peered":"2024-03-16T07:29:34.818692+0000","last_clean":"2024-03-16T07:29:34.818692+0000","last_became_active":"2024-03-16T07:29:33.145332+0000","last_became_peered":"2024-03-16T07:29:33.145332+0000","last_unstale":"2024-03-16T07:29:34.818692+0000","last_undegraded":"2024-03-16T07:29:34.818692+0000","last_fullsized":"2024-03-16T07:29:34.818692+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:40:36.601881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:34.818553+0000","last_change":"2024-03-16T07:29:33.834489+0000","last_active":"2024-03-16T07:29:34.818553+0000","last_peered":"2024-03-16T07:29:34.818553+0000","last_clean":"2024-03-16T07:29:34.818553+0000","last_became_active":"2024-03-16T07:29:33.833930+0000","last_became_peered":"2024-03-16T07:29:33.833930+0000","last_unstale":"2024-03-16T07:29:34.818553+0000","last_undegraded":"2024-03-16T07:29:34.818553+0000","last_fullsized":"2024-03-16T07:29:34.818553+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:03:50.654257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":14,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:34.818366+0000","last_change":"2024-03-16T07:29:33.145151+0000","last_active":"2024-03-16T07:29:34.818366+0000","last_peered":"2024-03-16T07:29:34.818366+0000","last_clean":"2024-03-16T07:29:34.818366+0000","last_became_active":"2024-03-16T07:29:33.144911+0000","last_became_peered":"2024-03-16T07:29:33.144911+0000","last_unstale":"2024-03-16T07:29:34.818366+0000","last_undegraded":"2024-03-16T07:29:34.818366+0000","last_fullsized":"2024-03-16T07:29:34.818366+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:03:36.227557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:35.133212+0000","last_change":"2024-03-16T07:29:33.826510+0000","last_active":"2024-03-16T07:29:35.133212+0000","last_peered":"2024-03-16T07:29:35.133212+0000","last_clean":"2024-03-16T07:29:35.133212+0000","last_became_active":"2024-03-16T07:29:33.826046+0000","last_became_peered":"2024-03-16T07:29:33.826046+0000","last_unstale":"2024-03-16T07:29:35.133212+0000","last_undegraded":"2024-03-16T07:29:35.133212+0000","last_fullsized":"2024-03-16T07:29:35.133212+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:36:53.332020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.15","version":"95'3","reported_seq":17,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:35.136224+0000","last_change":"2024-03-16T07:29:33.145719+0000","last_active":"2024-03-16T07:29:35.136224+0000","last_peered":"2024-03-16T07:29:35.136224+0000","last_clean":"2024-03-16T07:29:35.136224+0000","last_became_active":"2024-03-16T07:29:33.141978+0000","last_became_peered":"2024-03-16T07:29:33.141978+0000","last_unstale":"2024-03-16T07:29:35.136224+0000","last_undegraded":"2024-03-16T07:29:35.136224+0000","last_fullsized":"2024-03-16T07:29:35.136224+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:00:24.086126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:34.818617+0000","last_change":"2024-03-16T07:29:33.828756+0000","last_active":"2024-03-16T07:29:34.818617+0000","last_peered":"2024-03-16T07:29:34.818617+0000","last_clean":"2024-03-16T07:29:34.818617+0000","last_became_active":"2024-03-16T07:29:33.828504+0000","last_became_peered":"2024-03-16T07:29:33.828504+0000","last_unstale":"2024-03-16T07:29:34.818617+0000","last_undegraded":"2024-03-16T07:29:34.818617+0000","last_fullsized":"2024-03-16T07:29:34.818617+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:18:47.890723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.14","version":"95'6","reported_seq":20,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:35.136602+0000","last_change":"2024-03-16T07:29:33.143457+0000","last_active":"2024-03-16T07:29:35.136602+0000","last_peered":"2024-03-16T07:29:35.136602+0000","last_clean":"2024-03-16T07:29:35.136602+0000","last_became_active":"2024-03-16T07:29:33.143020+0000","last_became_peered":"2024-03-16T07:29:33.143020+0000","last_unstale":"2024-03-16T07:29:35.136602+0000","last_undegraded":"2024-03-16T07:29:35.136602+0000","last_fullsized":"2024-03-16T07:29:35.136602+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:57:06.801078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:34.818177+0000","last_change":"2024-03-16T07:29:33.832881+0000","last_active":"2024-03-16T07:29:34.818177+0000","last_peered":"2024-03-16T07:29:34.818177+0000","last_clean":"2024-03-16T07:29:34.818177+0000","last_became_active":"2024-03-16T07:29:33.832193+0000","last_became_peered":"2024-03-16T07:29:33.832193+0000","last_unstale":"2024-03-16T07:29:34.818177+0000","last_undegraded":"2024-03-16T07:29:34.818177+0000","last_fullsized":"2024-03-16T07:29:34.818177+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:59:00.106225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.13","version":"95'2","reported_seq":16,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:35.132833+0000","last_change":"2024-03-16T07:29:33.150475+0000","last_active":"2024-03-16T07:29:35.132833+0000","last_peered":"2024-03-16T07:29:35.132833+0000","last_clean":"2024-03-16T07:29:35.132833+0000","last_became_active":"2024-03-16T07:29:33.150220+0000","last_became_peered":"2024-03-16T07:29:33.150220+0000","last_unstale":"2024-03-16T07:29:35.132833+0000","last_undegraded":"2024-03-16T07:29:35.132833+0000","last_fullsized":"2024-03-16T07:29:35.132833+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:13:34.679310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:35.135946+0000","last_change":"2024-03-16T07:29:33.838359+0000","last_active":"2024-03-16T07:29:35.135946+0000","last_peered":"2024-03-16T07:29:35.135946+0000","last_clean":"2024-03-16T07:29:35.135946+0000","last_became_active":"2024-03-16T07:29:33.837087+0000","last_became_peered":"2024-03-16T07:29:33.837087+0000","last_unstale":"2024-03-16T07:29:35.135946+0000","last_undegraded":"2024-03-16T07:29:35.135946+0000","last_fullsized":"2024-03-16T07:29:35.135946+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:48:58.147020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":14,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:35.133380+0000","last_change":"2024-03-16T07:29:33.144891+0000","last_active":"2024-03-16T07:29:35.133380+0000","last_peered":"2024-03-16T07:29:35.133380+0000","last_clean":"2024-03-16T07:29:35.133380+0000","last_became_active":"2024-03-16T07:29:33.144574+0000","last_became_peered":"2024-03-16T07:29:33.144574+0000","last_unstale":"2024-03-16T07:29:35.133380+0000","last_undegraded":"2024-03-16T07:29:35.133380+0000","last_fullsized":"2024-03-16T07:29:35.133380+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:31:24.149667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:35.132576+0000","last_change":"2024-03-16T07:29:33.826012+0000","last_active":"2024-03-16T07:29:35.132576+0000","last_peered":"2024-03-16T07:29:35.132576+0000","last_clean":"2024-03-16T07:29:35.132576+0000","last_became_active":"2024-03-16T07:29:33.825764+0000","last_became_peered":"2024-03-16T07:29:33.825764+0000","last_unstale":"2024-03-16T07:29:35.132576+0000","last_undegraded":"2024-03-16T07:29:35.132576+0000","last_fullsized":"2024-03-16T07:29:35.132576+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:12:38.743934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.10","version":"95'8","reported_seq":22,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:34.817831+0000","last_change":"2024-03-16T07:29:33.147235+0000","last_active":"2024-03-16T07:29:34.817831+0000","last_peered":"2024-03-16T07:29:34.817831+0000","last_clean":"2024-03-16T07:29:34.817831+0000","last_became_active":"2024-03-16T07:29:33.146884+0000","last_became_peered":"2024-03-16T07:29:33.146884+0000","last_unstale":"2024-03-16T07:29:34.817831+0000","last_undegraded":"2024-03-16T07:29:34.817831+0000","last_fullsized":"2024-03-16T07:29:34.817831+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:53:29.098123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:34.818347+0000","last_change":"2024-03-16T07:29:33.833822+0000","last_active":"2024-03-16T07:29:34.818347+0000","last_peered":"2024-03-16T07:29:34.818347+0000","last_clean":"2024-03-16T07:29:34.818347+0000","last_became_active":"2024-03-16T07:29:33.833492+0000","last_became_peered":"2024-03-16T07:29:33.833492+0000","last_unstale":"2024-03-16T07:29:34.818347+0000","last_undegraded":"2024-03-16T07:29:34.818347+0000","last_fullsized":"2024-03-16T07:29:34.818347+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:44:43.786263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"95'1","reported_seq":15,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:35.136681+0000","last_change":"2024-03-16T07:29:33.142821+0000","last_active":"2024-03-16T07:29:35.136681+0000","last_peered":"2024-03-16T07:29:35.136681+0000","last_clean":"2024-03-16T07:29:35.136681+0000","last_became_active":"2024-03-16T07:29:33.142350+0000","last_became_peered":"2024-03-16T07:29:33.142350+0000","last_unstale":"2024-03-16T07:29:35.136681+0000","last_undegraded":"2024-03-16T07:29:35.136681+0000","last_fullsized":"2024-03-16T07:29:35.136681+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:32:31.039690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:35.133884+0000","last_change":"2024-03-16T07:29:33.835641+0000","last_active":"2024-03-16T07:29:35.133884+0000","last_peered":"2024-03-16T07:29:35.133884+0000","last_clean":"2024-03-16T07:29:35.133884+0000","last_became_active":"2024-03-16T07:29:33.835125+0000","last_became_peered":"2024-03-16T07:29:33.835125+0000","last_unstale":"2024-03-16T07:29:35.133884+0000","last_undegraded":"2024-03-16T07:29:35.133884+0000","last_fullsized":"2024-03-16T07:29:35.133884+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:45:54.158424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.e","version":"95'2","reported_seq":16,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:34.818451+0000","last_change":"2024-03-16T07:29:33.149722+0000","last_active":"2024-03-16T07:29:34.818451+0000","last_peered":"2024-03-16T07:29:34.818451+0000","last_clean":"2024-03-16T07:29:34.818451+0000","last_became_active":"2024-03-16T07:29:33.149431+0000","last_became_peered":"2024-03-16T07:29:33.149431+0000","last_unstale":"2024-03-16T07:29:34.818451+0000","last_undegraded":"2024-03-16T07:29:34.818451+0000","last_fullsized":"2024-03-16T07:29:34.818451+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:06:39.605745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:35.136363+0000","last_change":"2024-03-16T07:29:33.838194+0000","last_active":"2024-03-16T07:29:35.136363+0000","last_peered":"2024-03-16T07:29:35.136363+0000","last_clean":"2024-03-16T07:29:35.136363+0000","last_became_active":"2024-03-16T07:29:33.837894+0000","last_became_peered":"2024-03-16T07:29:33.837894+0000","last_unstale":"2024-03-16T07:29:35.136363+0000","last_undegraded":"2024-03-16T07:29:35.136363+0000","last_fullsized":"2024-03-16T07:29:35.136363+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:45:22.148380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.d","version":"95'1","reported_seq":15,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:35.136280+0000","last_change":"2024-03-16T07:29:33.142518+0000","last_active":"2024-03-16T07:29:35.136280+0000","last_peered":"2024-03-16T07:29:35.136280+0000","last_clean":"2024-03-16T07:29:35.136280+0000","last_became_active":"2024-03-16T07:29:33.141657+0000","last_became_peered":"2024-03-16T07:29:33.141657+0000","last_unstale":"2024-03-16T07:29:35.136280+0000","last_undegraded":"2024-03-16T07:29:35.136280+0000","last_fullsized":"2024-03-16T07:29:35.136280+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:35:31.339252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:35.136127+0000","last_change":"2024-03-16T07:29:33.840969+0000","last_active":"2024-03-16T07:29:35.136127+0000","last_peered":"2024-03-16T07:29:35.136127+0000","last_clean":"2024-03-16T07:29:35.136127+0000","last_became_active":"2024-03-16T07:29:33.840483+0000","last_became_peered":"2024-03-16T07:29:33.840483+0000","last_unstale":"2024-03-16T07:29:35.136127+0000","last_undegraded":"2024-03-16T07:29:35.136127+0000","last_fullsized":"2024-03-16T07:29:35.136127+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:06:46.263899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":14,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:35.136632+0000","last_change":"2024-03-16T07:29:33.143262+0000","last_active":"2024-03-16T07:29:35.136632+0000","last_peered":"2024-03-16T07:29:35.136632+0000","last_clean":"2024-03-16T07:29:35.136632+0000","last_became_active":"2024-03-16T07:29:33.142682+0000","last_became_peered":"2024-03-16T07:29:33.142682+0000","last_unstale":"2024-03-16T07:29:35.136632+0000","last_undegraded":"2024-03-16T07:29:35.136632+0000","last_fullsized":"2024-03-16T07:29:35.136632+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:48:35.046334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:35.133193+0000","last_change":"2024-03-16T07:29:33.827189+0000","last_active":"2024-03-16T07:29:35.133193+0000","last_peered":"2024-03-16T07:29:35.133193+0000","last_clean":"2024-03-16T07:29:35.133193+0000","last_became_active":"2024-03-16T07:29:33.826953+0000","last_became_peered":"2024-03-16T07:29:33.826953+0000","last_unstale":"2024-03-16T07:29:35.133193+0000","last_undegraded":"2024-03-16T07:29:35.133193+0000","last_fullsized":"2024-03-16T07:29:35.133193+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:34:19.104829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.b","version":"95'2","reported_seq":16,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:35.132939+0000","last_change":"2024-03-16T07:29:33.147427+0000","last_active":"2024-03-16T07:29:35.132939+0000","last_peered":"2024-03-16T07:29:35.132939+0000","last_clean":"2024-03-16T07:29:35.132939+0000","last_became_active":"2024-03-16T07:29:33.147011+0000","last_became_peered":"2024-03-16T07:29:33.147011+0000","last_unstale":"2024-03-16T07:29:35.132939+0000","last_undegraded":"2024-03-16T07:29:35.132939+0000","last_fullsized":"2024-03-16T07:29:35.132939+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:11:47.544575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:35.135975+0000","last_change":"2024-03-16T07:29:33.838647+0000","last_active":"2024-03-16T07:29:35.135975+0000","last_peered":"2024-03-16T07:29:35.135975+0000","last_clean":"2024-03-16T07:29:35.135975+0000","last_became_active":"2024-03-16T07:29:33.838049+0000","last_became_peered":"2024-03-16T07:29:33.838049+0000","last_unstale":"2024-03-16T07:29:35.135975+0000","last_undegraded":"2024-03-16T07:29:35.135975+0000","last_fullsized":"2024-03-16T07:29:35.135975+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:56:26.058572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":14,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:34.818378+0000","last_change":"2024-03-16T07:29:33.152620+0000","last_active":"2024-03-16T07:29:34.818378+0000","last_peered":"2024-03-16T07:29:34.818378+0000","last_clean":"2024-03-16T07:29:34.818378+0000","last_became_active":"2024-03-16T07:29:33.152352+0000","last_became_peered":"2024-03-16T07:29:33.152352+0000","last_unstale":"2024-03-16T07:29:34.818378+0000","last_undegraded":"2024-03-16T07:29:34.818378+0000","last_fullsized":"2024-03-16T07:29:34.818378+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:38:26.656813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:35.135319+0000","last_change":"2024-03-16T07:29:33.831988+0000","last_active":"2024-03-16T07:29:35.135319+0000","last_peered":"2024-03-16T07:29:35.135319+0000","last_clean":"2024-03-16T07:29:35.135319+0000","last_became_active":"2024-03-16T07:29:33.831702+0000","last_became_peered":"2024-03-16T07:29:33.831702+0000","last_unstale":"2024-03-16T07:29:35.135319+0000","last_undegraded":"2024-03-16T07:29:35.135319+0000","last_fullsized":"2024-03-16T07:29:35.135319+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:42:04.449559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":14,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:35.132703+0000","last_change":"2024-03-16T07:29:33.147855+0000","last_active":"2024-03-16T07:29:35.132703+0000","last_peered":"2024-03-16T07:29:35.132703+0000","last_clean":"2024-03-16T07:29:35.132703+0000","last_became_active":"2024-03-16T07:29:33.147615+0000","last_became_peered":"2024-03-16T07:29:33.147615+0000","last_unstale":"2024-03-16T07:29:35.132703+0000","last_undegraded":"2024-03-16T07:29:35.132703+0000","last_fullsized":"2024-03-16T07:29:35.132703+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:20:44.698184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:35.132599+0000","last_change":"2024-03-16T07:29:33.830959+0000","last_active":"2024-03-16T07:29:35.132599+0000","last_peered":"2024-03-16T07:29:35.132599+0000","last_clean":"2024-03-16T07:29:35.132599+0000","last_became_active":"2024-03-16T07:29:33.830655+0000","last_became_peered":"2024-03-16T07:29:33.830655+0000","last_unstale":"2024-03-16T07:29:35.132599+0000","last_undegraded":"2024-03-16T07:29:35.132599+0000","last_fullsized":"2024-03-16T07:29:35.132599+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:12:04.435282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":14,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:35.135509+0000","last_change":"2024-03-16T07:29:33.147292+0000","last_active":"2024-03-16T07:29:35.135509+0000","last_peered":"2024-03-16T07:29:35.135509+0000","last_clean":"2024-03-16T07:29:35.135509+0000","last_became_active":"2024-03-16T07:29:33.146227+0000","last_became_peered":"2024-03-16T07:29:33.146227+0000","last_unstale":"2024-03-16T07:29:35.135509+0000","last_undegraded":"2024-03-16T07:29:35.135509+0000","last_fullsized":"2024-03-16T07:29:35.135509+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:23:09.585751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:35.136493+0000","last_change":"2024-03-16T07:29:33.840859+0000","last_active":"2024-03-16T07:29:35.136493+0000","last_peered":"2024-03-16T07:29:35.136493+0000","last_clean":"2024-03-16T07:29:35.136493+0000","last_became_active":"2024-03-16T07:29:33.840311+0000","last_became_peered":"2024-03-16T07:29:33.840311+0000","last_unstale":"2024-03-16T07:29:35.136493+0000","last_undegraded":"2024-03-16T07:29:35.136493+0000","last_fullsized":"2024-03-16T07:29:35.136493+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:35:56.435081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.7","version":"95'2","reported_seq":16,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:35.133897+0000","last_change":"2024-03-16T07:29:33.150332+0000","last_active":"2024-03-16T07:29:35.133897+0000","last_peered":"2024-03-16T07:29:35.133897+0000","last_clean":"2024-03-16T07:29:35.133897+0000","last_became_active":"2024-03-16T07:29:33.149989+0000","last_became_peered":"2024-03-16T07:29:33.149989+0000","last_unstale":"2024-03-16T07:29:35.133897+0000","last_undegraded":"2024-03-16T07:29:35.133897+0000","last_fullsized":"2024-03-16T07:29:35.133897+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:04:56.622565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:35.136580+0000","last_change":"2024-03-16T07:29:33.826957+0000","last_active":"2024-03-16T07:29:35.136580+0000","last_peered":"2024-03-16T07:29:35.136580+0000","last_clean":"2024-03-16T07:29:35.136580+0000","last_became_active":"2024-03-16T07:29:33.826715+0000","last_became_peered":"2024-03-16T07:29:33.826715+0000","last_unstale":"2024-03-16T07:29:35.136580+0000","last_undegraded":"2024-03-16T07:29:35.136580+0000","last_fullsized":"2024-03-16T07:29:35.136580+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:11:43.923099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.6","version":"96'1","reported_seq":15,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:35.133678+0000","last_change":"2024-03-16T07:29:33.144113+0000","last_active":"2024-03-16T07:29:35.133678+0000","last_peered":"2024-03-16T07:29:35.133678+0000","last_clean":"2024-03-16T07:29:35.133678+0000","last_became_active":"2024-03-16T07:29:33.140102+0000","last_became_peered":"2024-03-16T07:29:33.140102+0000","last_unstale":"2024-03-16T07:29:35.133678+0000","last_undegraded":"2024-03-16T07:29:35.133678+0000","last_fullsized":"2024-03-16T07:29:35.133678+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:35:05.997178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:35.136520+0000","last_change":"2024-03-16T07:29:33.838136+0000","last_active":"2024-03-16T07:29:35.136520+0000","last_peered":"2024-03-16T07:29:35.136520+0000","last_clean":"2024-03-16T07:29:35.136520+0000","last_became_active":"2024-03-16T07:29:33.837685+0000","last_became_peered":"2024-03-16T07:29:33.837685+0000","last_unstale":"2024-03-16T07:29:35.136520+0000","last_undegraded":"2024-03-16T07:29:35.136520+0000","last_fullsized":"2024-03-16T07:29:35.136520+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:45:37.351491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":14,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:35.136343+0000","last_change":"2024-03-16T07:29:33.145636+0000","last_active":"2024-03-16T07:29:35.136343+0000","last_peered":"2024-03-16T07:29:35.136343+0000","last_clean":"2024-03-16T07:29:35.136343+0000","last_became_active":"2024-03-16T07:29:33.143854+0000","last_became_peered":"2024-03-16T07:29:33.143854+0000","last_unstale":"2024-03-16T07:29:35.136343+0000","last_undegraded":"2024-03-16T07:29:35.136343+0000","last_fullsized":"2024-03-16T07:29:35.136343+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:17:24.293590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:35.136184+0000","last_change":"2024-03-16T07:29:33.828294+0000","last_active":"2024-03-16T07:29:35.136184+0000","last_peered":"2024-03-16T07:29:35.136184+0000","last_clean":"2024-03-16T07:29:35.136184+0000","last_became_active":"2024-03-16T07:29:33.828062+0000","last_became_peered":"2024-03-16T07:29:33.828062+0000","last_unstale":"2024-03-16T07:29:35.136184+0000","last_undegraded":"2024-03-16T07:29:35.136184+0000","last_fullsized":"2024-03-16T07:29:35.136184+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:34:48.462965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":14,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:34.818154+0000","last_change":"2024-03-16T07:29:33.144300+0000","last_active":"2024-03-16T07:29:34.818154+0000","last_peered":"2024-03-16T07:29:34.818154+0000","last_clean":"2024-03-16T07:29:34.818154+0000","last_became_active":"2024-03-16T07:29:33.144052+0000","last_became_peered":"2024-03-16T07:29:33.144052+0000","last_unstale":"2024-03-16T07:29:34.818154+0000","last_undegraded":"2024-03-16T07:29:34.818154+0000","last_fullsized":"2024-03-16T07:29:34.818154+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:15:27.170786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:35.133299+0000","last_change":"2024-03-16T07:29:33.831300+0000","last_active":"2024-03-16T07:29:35.133299+0000","last_peered":"2024-03-16T07:29:35.133299+0000","last_clean":"2024-03-16T07:29:35.133299+0000","last_became_active":"2024-03-16T07:29:33.831037+0000","last_became_peered":"2024-03-16T07:29:33.831037+0000","last_unstale":"2024-03-16T07:29:35.133299+0000","last_undegraded":"2024-03-16T07:29:35.133299+0000","last_fullsized":"2024-03-16T07:29:35.133299+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:03:57.669517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":14,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:35.132989+0000","last_change":"2024-03-16T07:29:33.147234+0000","last_active":"2024-03-16T07:29:35.132989+0000","last_peered":"2024-03-16T07:29:35.132989+0000","last_clean":"2024-03-16T07:29:35.132989+0000","last_became_active":"2024-03-16T07:29:33.146693+0000","last_became_peered":"2024-03-16T07:29:33.146693+0000","last_unstale":"2024-03-16T07:29:35.132989+0000","last_undegraded":"2024-03-16T07:29:35.132989+0000","last_fullsized":"2024-03-16T07:29:35.132989+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:43:35.352393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:35.136204+0000","last_change":"2024-03-16T07:29:33.831203+0000","last_active":"2024-03-16T07:29:35.136204+0000","last_peered":"2024-03-16T07:29:35.136204+0000","last_clean":"2024-03-16T07:29:35.136204+0000","last_became_active":"2024-03-16T07:29:33.830953+0000","last_became_peered":"2024-03-16T07:29:33.830953+0000","last_unstale":"2024-03-16T07:29:35.136204+0000","last_undegraded":"2024-03-16T07:29:35.136204+0000","last_fullsized":"2024-03-16T07:29:35.136204+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:28:50.259243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":14,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:35.135544+0000","last_change":"2024-03-16T07:29:33.141889+0000","last_active":"2024-03-16T07:29:35.135544+0000","last_peered":"2024-03-16T07:29:35.135544+0000","last_clean":"2024-03-16T07:29:35.135544+0000","last_became_active":"2024-03-16T07:29:33.141560+0000","last_became_peered":"2024-03-16T07:29:33.141560+0000","last_unstale":"2024-03-16T07:29:35.135544+0000","last_undegraded":"2024-03-16T07:29:35.135544+0000","last_fullsized":"2024-03-16T07:29:35.135544+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:06:48.551747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:35.135443+0000","last_change":"2024-03-16T07:29:33.831593+0000","last_active":"2024-03-16T07:29:35.135443+0000","last_peered":"2024-03-16T07:29:35.135443+0000","last_clean":"2024-03-16T07:29:35.135443+0000","last_became_active":"2024-03-16T07:29:33.831346+0000","last_became_peered":"2024-03-16T07:29:33.831346+0000","last_unstale":"2024-03-16T07:29:35.135443+0000","last_undegraded":"2024-03-16T07:29:35.135443+0000","last_fullsized":"2024-03-16T07:29:35.135443+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:41:58.469024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":14,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:34.817958+0000","last_change":"2024-03-16T07:29:33.143890+0000","last_active":"2024-03-16T07:29:34.817958+0000","last_peered":"2024-03-16T07:29:34.817958+0000","last_clean":"2024-03-16T07:29:34.817958+0000","last_became_active":"2024-03-16T07:29:33.143637+0000","last_became_peered":"2024-03-16T07:29:33.143637+0000","last_unstale":"2024-03-16T07:29:34.817958+0000","last_undegraded":"2024-03-16T07:29:34.817958+0000","last_fullsized":"2024-03-16T07:29:34.817958+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:09:44.522730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:35.135686+0000","last_change":"2024-03-16T07:29:33.840846+0000","last_active":"2024-03-16T07:29:35.135686+0000","last_peered":"2024-03-16T07:29:35.135686+0000","last_clean":"2024-03-16T07:29:35.135686+0000","last_became_active":"2024-03-16T07:29:33.840586+0000","last_became_peered":"2024-03-16T07:29:33.840586+0000","last_unstale":"2024-03-16T07:29:35.135686+0000","last_undegraded":"2024-03-16T07:29:35.135686+0000","last_fullsized":"2024-03-16T07:29:35.135686+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:16:10.018326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":14,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:35.135532+0000","last_change":"2024-03-16T07:29:33.139819+0000","last_active":"2024-03-16T07:29:35.135532+0000","last_peered":"2024-03-16T07:29:35.135532+0000","last_clean":"2024-03-16T07:29:35.135532+0000","last_became_active":"2024-03-16T07:29:33.139567+0000","last_became_peered":"2024-03-16T07:29:33.139567+0000","last_unstale":"2024-03-16T07:29:35.135532+0000","last_undegraded":"2024-03-16T07:29:35.135532+0000","last_fullsized":"2024-03-16T07:29:35.135532+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:16:29.768752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:35.132538+0000","last_change":"2024-03-16T07:29:33.836320+0000","last_active":"2024-03-16T07:29:35.132538+0000","last_peered":"2024-03-16T07:29:35.132538+0000","last_clean":"2024-03-16T07:29:35.132538+0000","last_became_active":"2024-03-16T07:29:33.835776+0000","last_became_peered":"2024-03-16T07:29:33.835776+0000","last_unstale":"2024-03-16T07:29:35.132538+0000","last_undegraded":"2024-03-16T07:29:35.132538+0000","last_fullsized":"2024-03-16T07:29:35.132538+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:44:42.674554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":14,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:34.817847+0000","last_change":"2024-03-16T07:29:33.147194+0000","last_active":"2024-03-16T07:29:34.817847+0000","last_peered":"2024-03-16T07:29:34.817847+0000","last_clean":"2024-03-16T07:29:34.817847+0000","last_became_active":"2024-03-16T07:29:33.146945+0000","last_became_peered":"2024-03-16T07:29:33.146945+0000","last_unstale":"2024-03-16T07:29:34.817847+0000","last_undegraded":"2024-03-16T07:29:34.817847+0000","last_fullsized":"2024-03-16T07:29:34.817847+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:32:59.919891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"80'152","reported_seq":493,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:35.132501+0000","last_change":"2024-03-16T07:24:31.650537+0000","last_active":"2024-03-16T07:29:35.132501+0000","last_peered":"2024-03-16T07:29:35.132501+0000","last_clean":"2024-03-16T07:29:35.132501+0000","last_became_active":"2024-03-16T07:24:31.649574+0000","last_became_peered":"2024-03-16T07:24:31.649574+0000","last_unstale":"2024-03-16T07:29:35.132501+0000","last_undegraded":"2024-03-16T07:29:35.132501+0000","last_fullsized":"2024-03-16T07:29:35.132501+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:29.719970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:29.719970+0000","last_clean_scrub_stamp":"2024-03-16T07:24:29.719970+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:31:35.774554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":586,"num_read_kb":1121,"num_write":237,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":586,"num_read_kb":1121,"num_write":237,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":152,"ondisk_log_size":152,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738429,"num_pgs":63,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":36296,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":104821304,"statfs":{"total":107374182400,"available":107337015296,"internally_reserved":0,"allocated":974848,"data_stored":385211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738429,"num_pgs":63,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":36888,"kb_used_data":1544,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":104820712,"statfs":{"total":107374182400,"available":107336409088,"internally_reserved":0,"allocated":1581056,"data_stored":976747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738429,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":32732,"kb_used_data":1548,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":104824868,"statfs":{"total":107374182400,"available":107340664832,"internally_reserved":0,"allocated":1585152,"data_stored":977317,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-16T07:29:39.795 INFO:tasks.ceph.mds.e.smithi049.stderr:2024-03-16T07:29:39.796+0000 7fb59faf1640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-03-16T07:29:41.854 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-16T07:29:42.360 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:29:42.361 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2024-03-16T07:29:42.371 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":34,"stamp":"2024-03-16T07:29:42.167294+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":586,"num_read_kb":1121,"num_write":282,"num_write_kb":1908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":191,"ondisk_log_size":191,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":314572800,"kb_used":105916,"kb_used_data":4044,"kb_used_omap":4,"kb_used_meta":101819,"kb_avail":314466884,"statfs":{"total":322122547200,"available":322014089216,"internally_reserved":0,"allocated":4141056,"data_stored":2339275,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":104262991},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.353626"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:35.136282+0000","last_change":"2024-03-16T07:29:33.837801+0000","last_active":"2024-03-16T07:29:35.136282+0000","last_peered":"2024-03-16T07:29:35.136282+0000","last_clean":"2024-03-16T07:29:35.136282+0000","last_became_active":"2024-03-16T07:29:33.837541+0000","last_became_peered":"2024-03-16T07:29:33.837541+0000","last_unstale":"2024-03-16T07:29:35.136282+0000","last_undegraded":"2024-03-16T07:29:35.136282+0000","last_fullsized":"2024-03-16T07:29:35.136282+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:04:52.392474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:34.818153+0000","last_change":"2024-03-16T07:29:33.828285+0000","last_active":"2024-03-16T07:29:34.818153+0000","last_peered":"2024-03-16T07:29:34.818153+0000","last_clean":"2024-03-16T07:29:34.818153+0000","last_became_active":"2024-03-16T07:29:33.827699+0000","last_became_peered":"2024-03-16T07:29:33.827699+0000","last_unstale":"2024-03-16T07:29:34.818153+0000","last_undegraded":"2024-03-16T07:29:34.818153+0000","last_fullsized":"2024-03-16T07:29:34.818153+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:26:06.558057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:35.133390+0000","last_change":"2024-03-16T07:29:33.832571+0000","last_active":"2024-03-16T07:29:35.133390+0000","last_peered":"2024-03-16T07:29:35.133390+0000","last_clean":"2024-03-16T07:29:35.133390+0000","last_became_active":"2024-03-16T07:29:33.832329+0000","last_became_peered":"2024-03-16T07:29:33.832329+0000","last_unstale":"2024-03-16T07:29:35.133390+0000","last_undegraded":"2024-03-16T07:29:35.133390+0000","last_fullsized":"2024-03-16T07:29:35.133390+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:45:05.916690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:35.135868+0000","last_change":"2024-03-16T07:29:33.830557+0000","last_active":"2024-03-16T07:29:35.135868+0000","last_peered":"2024-03-16T07:29:35.135868+0000","last_clean":"2024-03-16T07:29:35.135868+0000","last_became_active":"2024-03-16T07:29:33.830122+0000","last_became_peered":"2024-03-16T07:29:33.830122+0000","last_unstale":"2024-03-16T07:29:35.135868+0000","last_undegraded":"2024-03-16T07:29:35.135868+0000","last_fullsized":"2024-03-16T07:29:35.135868+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:35:43.576229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:34.818862+0000","last_change":"2024-03-16T07:29:33.834562+0000","last_active":"2024-03-16T07:29:34.818862+0000","last_peered":"2024-03-16T07:29:34.818862+0000","last_clean":"2024-03-16T07:29:34.818862+0000","last_became_active":"2024-03-16T07:29:33.833200+0000","last_became_peered":"2024-03-16T07:29:33.833200+0000","last_unstale":"2024-03-16T07:29:34.818862+0000","last_undegraded":"2024-03-16T07:29:34.818862+0000","last_fullsized":"2024-03-16T07:29:34.818862+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:07:30.736713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:35.133141+0000","last_change":"2024-03-16T07:29:33.826274+0000","last_active":"2024-03-16T07:29:35.133141+0000","last_peered":"2024-03-16T07:29:35.133141+0000","last_clean":"2024-03-16T07:29:35.133141+0000","last_became_active":"2024-03-16T07:29:33.825821+0000","last_became_peered":"2024-03-16T07:29:33.825821+0000","last_unstale":"2024-03-16T07:29:35.133141+0000","last_undegraded":"2024-03-16T07:29:35.133141+0000","last_fullsized":"2024-03-16T07:29:35.133141+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:54:54.165392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:34.817863+0000","last_change":"2024-03-16T07:29:33.832454+0000","last_active":"2024-03-16T07:29:34.817863+0000","last_peered":"2024-03-16T07:29:34.817863+0000","last_clean":"2024-03-16T07:29:34.817863+0000","last_became_active":"2024-03-16T07:29:33.832205+0000","last_became_peered":"2024-03-16T07:29:33.832205+0000","last_unstale":"2024-03-16T07:29:34.817863+0000","last_undegraded":"2024-03-16T07:29:34.817863+0000","last_fullsized":"2024-03-16T07:29:34.817863+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:45:54.158424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:34.817695+0000","last_change":"2024-03-16T07:29:33.834186+0000","last_active":"2024-03-16T07:29:34.817695+0000","last_peered":"2024-03-16T07:29:34.817695+0000","last_clean":"2024-03-16T07:29:34.817695+0000","last_became_active":"2024-03-16T07:29:33.833939+0000","last_became_peered":"2024-03-16T07:29:33.833939+0000","last_unstale":"2024-03-16T07:29:34.817695+0000","last_undegraded":"2024-03-16T07:29:34.817695+0000","last_fullsized":"2024-03-16T07:29:34.817695+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:05:33.276056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:35.136420+0000","last_change":"2024-03-16T07:29:33.840759+0000","last_active":"2024-03-16T07:29:35.136420+0000","last_peered":"2024-03-16T07:29:35.136420+0000","last_clean":"2024-03-16T07:29:35.136420+0000","last_became_active":"2024-03-16T07:29:33.840493+0000","last_became_peered":"2024-03-16T07:29:33.840493+0000","last_unstale":"2024-03-16T07:29:35.136420+0000","last_undegraded":"2024-03-16T07:29:35.136420+0000","last_fullsized":"2024-03-16T07:29:35.136420+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:28:46.696178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:35.136204+0000","last_change":"2024-03-16T07:29:33.837411+0000","last_active":"2024-03-16T07:29:35.136204+0000","last_peered":"2024-03-16T07:29:35.136204+0000","last_clean":"2024-03-16T07:29:35.136204+0000","last_became_active":"2024-03-16T07:29:33.837054+0000","last_became_peered":"2024-03-16T07:29:33.837054+0000","last_unstale":"2024-03-16T07:29:35.136204+0000","last_undegraded":"2024-03-16T07:29:35.136204+0000","last_fullsized":"2024-03-16T07:29:35.136204+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:40:38.224614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:35.136010+0000","last_change":"2024-03-16T07:29:33.841582+0000","last_active":"2024-03-16T07:29:35.136010+0000","last_peered":"2024-03-16T07:29:35.136010+0000","last_clean":"2024-03-16T07:29:35.136010+0000","last_became_active":"2024-03-16T07:29:33.841350+0000","last_became_peered":"2024-03-16T07:29:33.841350+0000","last_unstale":"2024-03-16T07:29:35.136010+0000","last_undegraded":"2024-03-16T07:29:35.136010+0000","last_fullsized":"2024-03-16T07:29:35.136010+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:25:07.504235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:35.135977+0000","last_change":"2024-03-16T07:29:33.830360+0000","last_active":"2024-03-16T07:29:35.135977+0000","last_peered":"2024-03-16T07:29:35.135977+0000","last_clean":"2024-03-16T07:29:35.135977+0000","last_became_active":"2024-03-16T07:29:33.829805+0000","last_became_peered":"2024-03-16T07:29:33.829805+0000","last_unstale":"2024-03-16T07:29:35.135977+0000","last_undegraded":"2024-03-16T07:29:35.135977+0000","last_fullsized":"2024-03-16T07:29:35.135977+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:47:45.954148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:34.818888+0000","last_change":"2024-03-16T07:29:33.827090+0000","last_active":"2024-03-16T07:29:34.818888+0000","last_peered":"2024-03-16T07:29:34.818888+0000","last_clean":"2024-03-16T07:29:34.818888+0000","last_became_active":"2024-03-16T07:29:33.826838+0000","last_became_peered":"2024-03-16T07:29:33.826838+0000","last_unstale":"2024-03-16T07:29:34.818888+0000","last_undegraded":"2024-03-16T07:29:34.818888+0000","last_fullsized":"2024-03-16T07:29:34.818888+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:14:55.133041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:35.135346+0000","last_change":"2024-03-16T07:29:33.839839+0000","last_active":"2024-03-16T07:29:35.135346+0000","last_peered":"2024-03-16T07:29:35.135346+0000","last_clean":"2024-03-16T07:29:35.135346+0000","last_became_active":"2024-03-16T07:29:33.839596+0000","last_became_peered":"2024-03-16T07:29:33.839596+0000","last_unstale":"2024-03-16T07:29:35.135346+0000","last_undegraded":"2024-03-16T07:29:35.135346+0000","last_fullsized":"2024-03-16T07:29:35.135346+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:28:05.388099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:35.132438+0000","last_change":"2024-03-16T07:29:33.834583+0000","last_active":"2024-03-16T07:29:35.132438+0000","last_peered":"2024-03-16T07:29:35.132438+0000","last_clean":"2024-03-16T07:29:35.132438+0000","last_became_active":"2024-03-16T07:29:33.834324+0000","last_became_peered":"2024-03-16T07:29:33.834324+0000","last_unstale":"2024-03-16T07:29:35.132438+0000","last_undegraded":"2024-03-16T07:29:35.132438+0000","last_fullsized":"2024-03-16T07:29:35.132438+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:06:40.607068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:35.135161+0000","last_change":"2024-03-16T07:29:33.841155+0000","last_active":"2024-03-16T07:29:35.135161+0000","last_peered":"2024-03-16T07:29:35.135161+0000","last_clean":"2024-03-16T07:29:35.135161+0000","last_became_active":"2024-03-16T07:29:33.840814+0000","last_became_peered":"2024-03-16T07:29:33.840814+0000","last_unstale":"2024-03-16T07:29:35.135161+0000","last_undegraded":"2024-03-16T07:29:35.135161+0000","last_fullsized":"2024-03-16T07:29:35.135161+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:51:01.302406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:35.133847+0000","last_change":"2024-03-16T07:29:33.835448+0000","last_active":"2024-03-16T07:29:35.133847+0000","last_peered":"2024-03-16T07:29:35.133847+0000","last_clean":"2024-03-16T07:29:35.133847+0000","last_became_active":"2024-03-16T07:29:33.834817+0000","last_became_peered":"2024-03-16T07:29:33.834817+0000","last_unstale":"2024-03-16T07:29:35.133847+0000","last_undegraded":"2024-03-16T07:29:35.133847+0000","last_fullsized":"2024-03-16T07:29:35.133847+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:05:33.276056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:35.133544+0000","last_change":"2024-03-16T07:29:33.836688+0000","last_active":"2024-03-16T07:29:35.133544+0000","last_peered":"2024-03-16T07:29:35.133544+0000","last_clean":"2024-03-16T07:29:35.133544+0000","last_became_active":"2024-03-16T07:29:33.836439+0000","last_became_peered":"2024-03-16T07:29:33.836439+0000","last_unstale":"2024-03-16T07:29:35.133544+0000","last_undegraded":"2024-03-16T07:29:35.133544+0000","last_fullsized":"2024-03-16T07:29:35.133544+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:00:43.877183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:35.133458+0000","last_change":"2024-03-16T07:29:33.831962+0000","last_active":"2024-03-16T07:29:35.133458+0000","last_peered":"2024-03-16T07:29:35.133458+0000","last_clean":"2024-03-16T07:29:35.133458+0000","last_became_active":"2024-03-16T07:29:33.831730+0000","last_became_peered":"2024-03-16T07:29:33.831730+0000","last_unstale":"2024-03-16T07:29:35.133458+0000","last_undegraded":"2024-03-16T07:29:35.133458+0000","last_fullsized":"2024-03-16T07:29:35.133458+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:44:31.524367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:35.133020+0000","last_change":"2024-03-16T07:29:33.826162+0000","last_active":"2024-03-16T07:29:35.133020+0000","last_peered":"2024-03-16T07:29:35.133020+0000","last_clean":"2024-03-16T07:29:35.133020+0000","last_became_active":"2024-03-16T07:29:33.825696+0000","last_became_peered":"2024-03-16T07:29:33.825696+0000","last_unstale":"2024-03-16T07:29:35.133020+0000","last_undegraded":"2024-03-16T07:29:35.133020+0000","last_fullsized":"2024-03-16T07:29:35.133020+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:28:45.230768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:34.818976+0000","last_change":"2024-03-16T07:29:33.835797+0000","last_active":"2024-03-16T07:29:34.818976+0000","last_peered":"2024-03-16T07:29:34.818976+0000","last_clean":"2024-03-16T07:29:34.818976+0000","last_became_active":"2024-03-16T07:29:33.835556+0000","last_became_peered":"2024-03-16T07:29:33.835556+0000","last_unstale":"2024-03-16T07:29:34.818976+0000","last_undegraded":"2024-03-16T07:29:34.818976+0000","last_fullsized":"2024-03-16T07:29:34.818976+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:42:44.865750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:34.817861+0000","last_change":"2024-03-16T07:29:33.833025+0000","last_active":"2024-03-16T07:29:34.817861+0000","last_peered":"2024-03-16T07:29:34.817861+0000","last_clean":"2024-03-16T07:29:34.817861+0000","last_became_active":"2024-03-16T07:29:33.832508+0000","last_became_peered":"2024-03-16T07:29:33.832508+0000","last_unstale":"2024-03-16T07:29:34.817861+0000","last_undegraded":"2024-03-16T07:29:34.817861+0000","last_fullsized":"2024-03-16T07:29:34.817861+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:48:56.092113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:35.135337+0000","last_change":"2024-03-16T07:29:33.830404+0000","last_active":"2024-03-16T07:29:35.135337+0000","last_peered":"2024-03-16T07:29:35.135337+0000","last_clean":"2024-03-16T07:29:35.135337+0000","last_became_active":"2024-03-16T07:29:33.830174+0000","last_became_peered":"2024-03-16T07:29:33.830174+0000","last_unstale":"2024-03-16T07:29:35.135337+0000","last_undegraded":"2024-03-16T07:29:35.135337+0000","last_fullsized":"2024-03-16T07:29:35.135337+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:41:12.198698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:34.817689+0000","last_change":"2024-03-16T07:29:33.834147+0000","last_active":"2024-03-16T07:29:34.817689+0000","last_peered":"2024-03-16T07:29:34.817689+0000","last_clean":"2024-03-16T07:29:34.817689+0000","last_became_active":"2024-03-16T07:29:33.833703+0000","last_became_peered":"2024-03-16T07:29:33.833703+0000","last_unstale":"2024-03-16T07:29:34.817689+0000","last_undegraded":"2024-03-16T07:29:34.817689+0000","last_fullsized":"2024-03-16T07:29:34.817689+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:54:08.885808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:34.818466+0000","last_change":"2024-03-16T07:29:33.834992+0000","last_active":"2024-03-16T07:29:34.818466+0000","last_peered":"2024-03-16T07:29:34.818466+0000","last_clean":"2024-03-16T07:29:34.818466+0000","last_became_active":"2024-03-16T07:29:33.834758+0000","last_became_peered":"2024-03-16T07:29:33.834758+0000","last_unstale":"2024-03-16T07:29:34.818466+0000","last_undegraded":"2024-03-16T07:29:34.818466+0000","last_fullsized":"2024-03-16T07:29:34.818466+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:32:15.280635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:35.136380+0000","last_change":"2024-03-16T07:29:33.841057+0000","last_active":"2024-03-16T07:29:35.136380+0000","last_peered":"2024-03-16T07:29:35.136380+0000","last_clean":"2024-03-16T07:29:35.136380+0000","last_became_active":"2024-03-16T07:29:33.840691+0000","last_became_peered":"2024-03-16T07:29:33.840691+0000","last_unstale":"2024-03-16T07:29:35.136380+0000","last_undegraded":"2024-03-16T07:29:35.136380+0000","last_fullsized":"2024-03-16T07:29:35.136380+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:18:02.038888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:35.133534+0000","last_change":"2024-03-16T07:29:33.835192+0000","last_active":"2024-03-16T07:29:35.133534+0000","last_peered":"2024-03-16T07:29:35.133534+0000","last_clean":"2024-03-16T07:29:35.133534+0000","last_became_active":"2024-03-16T07:29:33.834934+0000","last_became_peered":"2024-03-16T07:29:33.834934+0000","last_unstale":"2024-03-16T07:29:35.133534+0000","last_undegraded":"2024-03-16T07:29:35.133534+0000","last_fullsized":"2024-03-16T07:29:35.133534+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:26:32.824858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:35.136215+0000","last_change":"2024-03-16T07:29:33.837983+0000","last_active":"2024-03-16T07:29:35.136215+0000","last_peered":"2024-03-16T07:29:35.136215+0000","last_clean":"2024-03-16T07:29:35.136215+0000","last_became_active":"2024-03-16T07:29:33.837496+0000","last_became_peered":"2024-03-16T07:29:33.837496+0000","last_unstale":"2024-03-16T07:29:35.136215+0000","last_undegraded":"2024-03-16T07:29:35.136215+0000","last_fullsized":"2024-03-16T07:29:35.136215+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:53:25.642839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:35.135790+0000","last_change":"2024-03-16T07:29:33.838573+0000","last_active":"2024-03-16T07:29:35.135790+0000","last_peered":"2024-03-16T07:29:35.135790+0000","last_clean":"2024-03-16T07:29:35.135790+0000","last_became_active":"2024-03-16T07:29:33.837752+0000","last_became_peered":"2024-03-16T07:29:33.837752+0000","last_unstale":"2024-03-16T07:29:35.135790+0000","last_undegraded":"2024-03-16T07:29:35.135790+0000","last_fullsized":"2024-03-16T07:29:35.135790+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:41:10.081251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:34.818035+0000","last_change":"2024-03-16T07:29:33.832836+0000","last_active":"2024-03-16T07:29:34.818035+0000","last_peered":"2024-03-16T07:29:34.818035+0000","last_clean":"2024-03-16T07:29:34.818035+0000","last_became_active":"2024-03-16T07:29:33.832354+0000","last_became_peered":"2024-03-16T07:29:33.832354+0000","last_unstale":"2024-03-16T07:29:34.818035+0000","last_undegraded":"2024-03-16T07:29:34.818035+0000","last_fullsized":"2024-03-16T07:29:34.818035+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:09:01.072871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:35.135475+0000","last_change":"2024-03-16T07:29:33.830827+0000","last_active":"2024-03-16T07:29:35.135475+0000","last_peered":"2024-03-16T07:29:35.135475+0000","last_clean":"2024-03-16T07:29:35.135475+0000","last_became_active":"2024-03-16T07:29:33.829553+0000","last_became_peered":"2024-03-16T07:29:33.829553+0000","last_unstale":"2024-03-16T07:29:35.135475+0000","last_undegraded":"2024-03-16T07:29:35.135475+0000","last_fullsized":"2024-03-16T07:29:35.135475+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:47:12.171754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:35.132398+0000","last_change":"2024-03-16T07:29:33.826298+0000","last_active":"2024-03-16T07:29:35.132398+0000","last_peered":"2024-03-16T07:29:35.132398+0000","last_clean":"2024-03-16T07:29:35.132398+0000","last_became_active":"2024-03-16T07:29:33.826047+0000","last_became_peered":"2024-03-16T07:29:33.826047+0000","last_unstale":"2024-03-16T07:29:35.132398+0000","last_undegraded":"2024-03-16T07:29:35.132398+0000","last_fullsized":"2024-03-16T07:29:35.132398+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:53:30.099446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:35.133675+0000","last_change":"2024-03-16T07:29:33.826129+0000","last_active":"2024-03-16T07:29:35.133675+0000","last_peered":"2024-03-16T07:29:35.133675+0000","last_clean":"2024-03-16T07:29:35.133675+0000","last_became_active":"2024-03-16T07:29:33.825871+0000","last_became_peered":"2024-03-16T07:29:33.825871+0000","last_unstale":"2024-03-16T07:29:35.133675+0000","last_undegraded":"2024-03-16T07:29:35.133675+0000","last_fullsized":"2024-03-16T07:29:35.133675+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:54:08.885808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"95'4","reported_seq":18,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:35.136641+0000","last_change":"2024-03-16T07:29:33.142157+0000","last_active":"2024-03-16T07:29:35.136641+0000","last_peered":"2024-03-16T07:29:35.136641+0000","last_clean":"2024-03-16T07:29:35.136641+0000","last_became_active":"2024-03-16T07:29:33.141750+0000","last_became_peered":"2024-03-16T07:29:33.141750+0000","last_unstale":"2024-03-16T07:29:35.136641+0000","last_undegraded":"2024-03-16T07:29:35.136641+0000","last_fullsized":"2024-03-16T07:29:35.136641+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:15:22.486053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:35.136586+0000","last_change":"2024-03-16T07:29:33.829851+0000","last_active":"2024-03-16T07:29:35.136586+0000","last_peered":"2024-03-16T07:29:35.136586+0000","last_clean":"2024-03-16T07:29:35.136586+0000","last_became_active":"2024-03-16T07:29:33.829620+0000","last_became_peered":"2024-03-16T07:29:33.829620+0000","last_unstale":"2024-03-16T07:29:35.136586+0000","last_undegraded":"2024-03-16T07:29:35.136586+0000","last_fullsized":"2024-03-16T07:29:35.136586+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:03:47.150413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1e","version":"95'1","reported_seq":15,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:34.818272+0000","last_change":"2024-03-16T07:29:33.144641+0000","last_active":"2024-03-16T07:29:34.818272+0000","last_peered":"2024-03-16T07:29:34.818272+0000","last_clean":"2024-03-16T07:29:34.818272+0000","last_became_active":"2024-03-16T07:29:33.144370+0000","last_became_peered":"2024-03-16T07:29:33.144370+0000","last_unstale":"2024-03-16T07:29:34.818272+0000","last_undegraded":"2024-03-16T07:29:34.818272+0000","last_fullsized":"2024-03-16T07:29:34.818272+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:02:47.297486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:35.133169+0000","last_change":"2024-03-16T07:29:33.836419+0000","last_active":"2024-03-16T07:29:35.133169+0000","last_peered":"2024-03-16T07:29:35.133169+0000","last_clean":"2024-03-16T07:29:35.133169+0000","last_became_active":"2024-03-16T07:29:33.836160+0000","last_became_peered":"2024-03-16T07:29:33.836160+0000","last_unstale":"2024-03-16T07:29:35.133169+0000","last_undegraded":"2024-03-16T07:29:35.133169+0000","last_fullsized":"2024-03-16T07:29:35.133169+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:26:07.664599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1d","version":"95'2","reported_seq":16,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:34.818580+0000","last_change":"2024-03-16T07:29:33.145140+0000","last_active":"2024-03-16T07:29:34.818580+0000","last_peered":"2024-03-16T07:29:34.818580+0000","last_clean":"2024-03-16T07:29:34.818580+0000","last_became_active":"2024-03-16T07:29:33.144891+0000","last_became_peered":"2024-03-16T07:29:33.144891+0000","last_unstale":"2024-03-16T07:29:34.818580+0000","last_undegraded":"2024-03-16T07:29:34.818580+0000","last_fullsized":"2024-03-16T07:29:34.818580+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:04:47.579175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:35.133595+0000","last_change":"2024-03-16T07:29:33.828184+0000","last_active":"2024-03-16T07:29:35.133595+0000","last_peered":"2024-03-16T07:29:35.133595+0000","last_clean":"2024-03-16T07:29:35.133595+0000","last_became_active":"2024-03-16T07:29:33.827955+0000","last_became_peered":"2024-03-16T07:29:33.827955+0000","last_unstale":"2024-03-16T07:29:35.133595+0000","last_undegraded":"2024-03-16T07:29:35.133595+0000","last_fullsized":"2024-03-16T07:29:35.133595+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:20:59.190114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"95'2","reported_seq":16,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:34.818130+0000","last_change":"2024-03-16T07:29:33.143477+0000","last_active":"2024-03-16T07:29:34.818130+0000","last_peered":"2024-03-16T07:29:34.818130+0000","last_clean":"2024-03-16T07:29:34.818130+0000","last_became_active":"2024-03-16T07:29:33.143221+0000","last_became_peered":"2024-03-16T07:29:33.143221+0000","last_unstale":"2024-03-16T07:29:34.818130+0000","last_undegraded":"2024-03-16T07:29:34.818130+0000","last_fullsized":"2024-03-16T07:29:34.818130+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:39:36.137228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:35.135450+0000","last_change":"2024-03-16T07:29:33.839989+0000","last_active":"2024-03-16T07:29:35.135450+0000","last_peered":"2024-03-16T07:29:35.135450+0000","last_clean":"2024-03-16T07:29:35.135450+0000","last_became_active":"2024-03-16T07:29:33.839759+0000","last_became_peered":"2024-03-16T07:29:33.839759+0000","last_unstale":"2024-03-16T07:29:35.135450+0000","last_undegraded":"2024-03-16T07:29:35.135450+0000","last_fullsized":"2024-03-16T07:29:35.135450+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:46:33.756833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1b","version":"95'1","reported_seq":15,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:35.132727+0000","last_change":"2024-03-16T07:29:33.151173+0000","last_active":"2024-03-16T07:29:35.132727+0000","last_peered":"2024-03-16T07:29:35.132727+0000","last_clean":"2024-03-16T07:29:35.132727+0000","last_became_active":"2024-03-16T07:29:33.150934+0000","last_became_peered":"2024-03-16T07:29:33.150934+0000","last_unstale":"2024-03-16T07:29:35.132727+0000","last_undegraded":"2024-03-16T07:29:35.132727+0000","last_fullsized":"2024-03-16T07:29:35.132727+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:35:30.259942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:35.135823+0000","last_change":"2024-03-16T07:29:33.838441+0000","last_active":"2024-03-16T07:29:35.135823+0000","last_peered":"2024-03-16T07:29:35.135823+0000","last_clean":"2024-03-16T07:29:35.135823+0000","last_became_active":"2024-03-16T07:29:33.837425+0000","last_became_peered":"2024-03-16T07:29:33.837425+0000","last_unstale":"2024-03-16T07:29:35.135823+0000","last_undegraded":"2024-03-16T07:29:35.135823+0000","last_fullsized":"2024-03-16T07:29:35.135823+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:44:16.567702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"95'1","reported_seq":15,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:34.818276+0000","last_change":"2024-03-16T07:29:33.152347+0000","last_active":"2024-03-16T07:29:34.818276+0000","last_peered":"2024-03-16T07:29:34.818276+0000","last_clean":"2024-03-16T07:29:34.818276+0000","last_became_active":"2024-03-16T07:29:33.152108+0000","last_became_peered":"2024-03-16T07:29:33.152108+0000","last_unstale":"2024-03-16T07:29:34.818276+0000","last_undegraded":"2024-03-16T07:29:34.818276+0000","last_fullsized":"2024-03-16T07:29:34.818276+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:48:09.351303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:35.135222+0000","last_change":"2024-03-16T07:29:33.841426+0000","last_active":"2024-03-16T07:29:35.135222+0000","last_peered":"2024-03-16T07:29:35.135222+0000","last_clean":"2024-03-16T07:29:35.135222+0000","last_became_active":"2024-03-16T07:29:33.841098+0000","last_became_peered":"2024-03-16T07:29:33.841098+0000","last_unstale":"2024-03-16T07:29:35.135222+0000","last_undegraded":"2024-03-16T07:29:35.135222+0000","last_fullsized":"2024-03-16T07:29:35.135222+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:11:40.760659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":14,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:35.132670+0000","last_change":"2024-03-16T07:29:33.149360+0000","last_active":"2024-03-16T07:29:35.132670+0000","last_peered":"2024-03-16T07:29:35.132670+0000","last_clean":"2024-03-16T07:29:35.132670+0000","last_became_active":"2024-03-16T07:29:33.148940+0000","last_became_peered":"2024-03-16T07:29:33.148940+0000","last_unstale":"2024-03-16T07:29:35.132670+0000","last_undegraded":"2024-03-16T07:29:35.132670+0000","last_fullsized":"2024-03-16T07:29:35.132670+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:25:34.455727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:35.132455+0000","last_change":"2024-03-16T07:29:33.827723+0000","last_active":"2024-03-16T07:29:35.132455+0000","last_peered":"2024-03-16T07:29:35.132455+0000","last_clean":"2024-03-16T07:29:35.132455+0000","last_became_active":"2024-03-16T07:29:33.827484+0000","last_became_peered":"2024-03-16T07:29:33.827484+0000","last_unstale":"2024-03-16T07:29:35.132455+0000","last_undegraded":"2024-03-16T07:29:35.132455+0000","last_fullsized":"2024-03-16T07:29:35.132455+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:36:39.935834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":14,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:35.135413+0000","last_change":"2024-03-16T07:29:33.147410+0000","last_active":"2024-03-16T07:29:35.135413+0000","last_peered":"2024-03-16T07:29:35.135413+0000","last_clean":"2024-03-16T07:29:35.135413+0000","last_became_active":"2024-03-16T07:29:33.146998+0000","last_became_peered":"2024-03-16T07:29:33.146998+0000","last_unstale":"2024-03-16T07:29:35.135413+0000","last_undegraded":"2024-03-16T07:29:35.135413+0000","last_fullsized":"2024-03-16T07:29:35.135413+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:24:35.197990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:34.818189+0000","last_change":"2024-03-16T07:29:33.828079+0000","last_active":"2024-03-16T07:29:34.818189+0000","last_peered":"2024-03-16T07:29:34.818189+0000","last_clean":"2024-03-16T07:29:34.818189+0000","last_became_active":"2024-03-16T07:29:33.827356+0000","last_became_peered":"2024-03-16T07:29:33.827356+0000","last_unstale":"2024-03-16T07:29:34.818189+0000","last_undegraded":"2024-03-16T07:29:34.818189+0000","last_fullsized":"2024-03-16T07:29:34.818189+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:54:56.120560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":14,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:34.818692+0000","last_change":"2024-03-16T07:29:33.145570+0000","last_active":"2024-03-16T07:29:34.818692+0000","last_peered":"2024-03-16T07:29:34.818692+0000","last_clean":"2024-03-16T07:29:34.818692+0000","last_became_active":"2024-03-16T07:29:33.145332+0000","last_became_peered":"2024-03-16T07:29:33.145332+0000","last_unstale":"2024-03-16T07:29:34.818692+0000","last_undegraded":"2024-03-16T07:29:34.818692+0000","last_fullsized":"2024-03-16T07:29:34.818692+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:40:36.601881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:34.818553+0000","last_change":"2024-03-16T07:29:33.834489+0000","last_active":"2024-03-16T07:29:34.818553+0000","last_peered":"2024-03-16T07:29:34.818553+0000","last_clean":"2024-03-16T07:29:34.818553+0000","last_became_active":"2024-03-16T07:29:33.833930+0000","last_became_peered":"2024-03-16T07:29:33.833930+0000","last_unstale":"2024-03-16T07:29:34.818553+0000","last_undegraded":"2024-03-16T07:29:34.818553+0000","last_fullsized":"2024-03-16T07:29:34.818553+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:03:50.654257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":14,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:34.818366+0000","last_change":"2024-03-16T07:29:33.145151+0000","last_active":"2024-03-16T07:29:34.818366+0000","last_peered":"2024-03-16T07:29:34.818366+0000","last_clean":"2024-03-16T07:29:34.818366+0000","last_became_active":"2024-03-16T07:29:33.144911+0000","last_became_peered":"2024-03-16T07:29:33.144911+0000","last_unstale":"2024-03-16T07:29:34.818366+0000","last_undegraded":"2024-03-16T07:29:34.818366+0000","last_fullsized":"2024-03-16T07:29:34.818366+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:03:36.227557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:35.133212+0000","last_change":"2024-03-16T07:29:33.826510+0000","last_active":"2024-03-16T07:29:35.133212+0000","last_peered":"2024-03-16T07:29:35.133212+0000","last_clean":"2024-03-16T07:29:35.133212+0000","last_became_active":"2024-03-16T07:29:33.826046+0000","last_became_peered":"2024-03-16T07:29:33.826046+0000","last_unstale":"2024-03-16T07:29:35.133212+0000","last_undegraded":"2024-03-16T07:29:35.133212+0000","last_fullsized":"2024-03-16T07:29:35.133212+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:36:53.332020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.15","version":"95'3","reported_seq":17,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:35.136224+0000","last_change":"2024-03-16T07:29:33.145719+0000","last_active":"2024-03-16T07:29:35.136224+0000","last_peered":"2024-03-16T07:29:35.136224+0000","last_clean":"2024-03-16T07:29:35.136224+0000","last_became_active":"2024-03-16T07:29:33.141978+0000","last_became_peered":"2024-03-16T07:29:33.141978+0000","last_unstale":"2024-03-16T07:29:35.136224+0000","last_undegraded":"2024-03-16T07:29:35.136224+0000","last_fullsized":"2024-03-16T07:29:35.136224+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:00:24.086126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:34.818617+0000","last_change":"2024-03-16T07:29:33.828756+0000","last_active":"2024-03-16T07:29:34.818617+0000","last_peered":"2024-03-16T07:29:34.818617+0000","last_clean":"2024-03-16T07:29:34.818617+0000","last_became_active":"2024-03-16T07:29:33.828504+0000","last_became_peered":"2024-03-16T07:29:33.828504+0000","last_unstale":"2024-03-16T07:29:34.818617+0000","last_undegraded":"2024-03-16T07:29:34.818617+0000","last_fullsized":"2024-03-16T07:29:34.818617+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:18:47.890723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.14","version":"95'6","reported_seq":20,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:35.136602+0000","last_change":"2024-03-16T07:29:33.143457+0000","last_active":"2024-03-16T07:29:35.136602+0000","last_peered":"2024-03-16T07:29:35.136602+0000","last_clean":"2024-03-16T07:29:35.136602+0000","last_became_active":"2024-03-16T07:29:33.143020+0000","last_became_peered":"2024-03-16T07:29:33.143020+0000","last_unstale":"2024-03-16T07:29:35.136602+0000","last_undegraded":"2024-03-16T07:29:35.136602+0000","last_fullsized":"2024-03-16T07:29:35.136602+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:57:06.801078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:34.818177+0000","last_change":"2024-03-16T07:29:33.832881+0000","last_active":"2024-03-16T07:29:34.818177+0000","last_peered":"2024-03-16T07:29:34.818177+0000","last_clean":"2024-03-16T07:29:34.818177+0000","last_became_active":"2024-03-16T07:29:33.832193+0000","last_became_peered":"2024-03-16T07:29:33.832193+0000","last_unstale":"2024-03-16T07:29:34.818177+0000","last_undegraded":"2024-03-16T07:29:34.818177+0000","last_fullsized":"2024-03-16T07:29:34.818177+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:59:00.106225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.13","version":"95'2","reported_seq":16,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:35.132833+0000","last_change":"2024-03-16T07:29:33.150475+0000","last_active":"2024-03-16T07:29:35.132833+0000","last_peered":"2024-03-16T07:29:35.132833+0000","last_clean":"2024-03-16T07:29:35.132833+0000","last_became_active":"2024-03-16T07:29:33.150220+0000","last_became_peered":"2024-03-16T07:29:33.150220+0000","last_unstale":"2024-03-16T07:29:35.132833+0000","last_undegraded":"2024-03-16T07:29:35.132833+0000","last_fullsized":"2024-03-16T07:29:35.132833+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:13:34.679310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:35.135946+0000","last_change":"2024-03-16T07:29:33.838359+0000","last_active":"2024-03-16T07:29:35.135946+0000","last_peered":"2024-03-16T07:29:35.135946+0000","last_clean":"2024-03-16T07:29:35.135946+0000","last_became_active":"2024-03-16T07:29:33.837087+0000","last_became_peered":"2024-03-16T07:29:33.837087+0000","last_unstale":"2024-03-16T07:29:35.135946+0000","last_undegraded":"2024-03-16T07:29:35.135946+0000","last_fullsized":"2024-03-16T07:29:35.135946+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:48:58.147020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":14,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:35.133380+0000","last_change":"2024-03-16T07:29:33.144891+0000","last_active":"2024-03-16T07:29:35.133380+0000","last_peered":"2024-03-16T07:29:35.133380+0000","last_clean":"2024-03-16T07:29:35.133380+0000","last_became_active":"2024-03-16T07:29:33.144574+0000","last_became_peered":"2024-03-16T07:29:33.144574+0000","last_unstale":"2024-03-16T07:29:35.133380+0000","last_undegraded":"2024-03-16T07:29:35.133380+0000","last_fullsized":"2024-03-16T07:29:35.133380+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:31:24.149667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:35.132576+0000","last_change":"2024-03-16T07:29:33.826012+0000","last_active":"2024-03-16T07:29:35.132576+0000","last_peered":"2024-03-16T07:29:35.132576+0000","last_clean":"2024-03-16T07:29:35.132576+0000","last_became_active":"2024-03-16T07:29:33.825764+0000","last_became_peered":"2024-03-16T07:29:33.825764+0000","last_unstale":"2024-03-16T07:29:35.132576+0000","last_undegraded":"2024-03-16T07:29:35.132576+0000","last_fullsized":"2024-03-16T07:29:35.132576+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:12:38.743934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.10","version":"95'8","reported_seq":22,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:34.817831+0000","last_change":"2024-03-16T07:29:33.147235+0000","last_active":"2024-03-16T07:29:34.817831+0000","last_peered":"2024-03-16T07:29:34.817831+0000","last_clean":"2024-03-16T07:29:34.817831+0000","last_became_active":"2024-03-16T07:29:33.146884+0000","last_became_peered":"2024-03-16T07:29:33.146884+0000","last_unstale":"2024-03-16T07:29:34.817831+0000","last_undegraded":"2024-03-16T07:29:34.817831+0000","last_fullsized":"2024-03-16T07:29:34.817831+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:53:29.098123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:34.818347+0000","last_change":"2024-03-16T07:29:33.833822+0000","last_active":"2024-03-16T07:29:34.818347+0000","last_peered":"2024-03-16T07:29:34.818347+0000","last_clean":"2024-03-16T07:29:34.818347+0000","last_became_active":"2024-03-16T07:29:33.833492+0000","last_became_peered":"2024-03-16T07:29:33.833492+0000","last_unstale":"2024-03-16T07:29:34.818347+0000","last_undegraded":"2024-03-16T07:29:34.818347+0000","last_fullsized":"2024-03-16T07:29:34.818347+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:44:43.786263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"95'1","reported_seq":15,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:35.136681+0000","last_change":"2024-03-16T07:29:33.142821+0000","last_active":"2024-03-16T07:29:35.136681+0000","last_peered":"2024-03-16T07:29:35.136681+0000","last_clean":"2024-03-16T07:29:35.136681+0000","last_became_active":"2024-03-16T07:29:33.142350+0000","last_became_peered":"2024-03-16T07:29:33.142350+0000","last_unstale":"2024-03-16T07:29:35.136681+0000","last_undegraded":"2024-03-16T07:29:35.136681+0000","last_fullsized":"2024-03-16T07:29:35.136681+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:32:31.039690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:35.133884+0000","last_change":"2024-03-16T07:29:33.835641+0000","last_active":"2024-03-16T07:29:35.133884+0000","last_peered":"2024-03-16T07:29:35.133884+0000","last_clean":"2024-03-16T07:29:35.133884+0000","last_became_active":"2024-03-16T07:29:33.835125+0000","last_became_peered":"2024-03-16T07:29:33.835125+0000","last_unstale":"2024-03-16T07:29:35.133884+0000","last_undegraded":"2024-03-16T07:29:35.133884+0000","last_fullsized":"2024-03-16T07:29:35.133884+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:45:54.158424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.e","version":"95'2","reported_seq":16,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:34.818451+0000","last_change":"2024-03-16T07:29:33.149722+0000","last_active":"2024-03-16T07:29:34.818451+0000","last_peered":"2024-03-16T07:29:34.818451+0000","last_clean":"2024-03-16T07:29:34.818451+0000","last_became_active":"2024-03-16T07:29:33.149431+0000","last_became_peered":"2024-03-16T07:29:33.149431+0000","last_unstale":"2024-03-16T07:29:34.818451+0000","last_undegraded":"2024-03-16T07:29:34.818451+0000","last_fullsized":"2024-03-16T07:29:34.818451+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:06:39.605745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:35.136363+0000","last_change":"2024-03-16T07:29:33.838194+0000","last_active":"2024-03-16T07:29:35.136363+0000","last_peered":"2024-03-16T07:29:35.136363+0000","last_clean":"2024-03-16T07:29:35.136363+0000","last_became_active":"2024-03-16T07:29:33.837894+0000","last_became_peered":"2024-03-16T07:29:33.837894+0000","last_unstale":"2024-03-16T07:29:35.136363+0000","last_undegraded":"2024-03-16T07:29:35.136363+0000","last_fullsized":"2024-03-16T07:29:35.136363+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:45:22.148380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.d","version":"95'1","reported_seq":15,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:35.136280+0000","last_change":"2024-03-16T07:29:33.142518+0000","last_active":"2024-03-16T07:29:35.136280+0000","last_peered":"2024-03-16T07:29:35.136280+0000","last_clean":"2024-03-16T07:29:35.136280+0000","last_became_active":"2024-03-16T07:29:33.141657+0000","last_became_peered":"2024-03-16T07:29:33.141657+0000","last_unstale":"2024-03-16T07:29:35.136280+0000","last_undegraded":"2024-03-16T07:29:35.136280+0000","last_fullsized":"2024-03-16T07:29:35.136280+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:35:31.339252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:35.136127+0000","last_change":"2024-03-16T07:29:33.840969+0000","last_active":"2024-03-16T07:29:35.136127+0000","last_peered":"2024-03-16T07:29:35.136127+0000","last_clean":"2024-03-16T07:29:35.136127+0000","last_became_active":"2024-03-16T07:29:33.840483+0000","last_became_peered":"2024-03-16T07:29:33.840483+0000","last_unstale":"2024-03-16T07:29:35.136127+0000","last_undegraded":"2024-03-16T07:29:35.136127+0000","last_fullsized":"2024-03-16T07:29:35.136127+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:06:46.263899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":14,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:35.136632+0000","last_change":"2024-03-16T07:29:33.143262+0000","last_active":"2024-03-16T07:29:35.136632+0000","last_peered":"2024-03-16T07:29:35.136632+0000","last_clean":"2024-03-16T07:29:35.136632+0000","last_became_active":"2024-03-16T07:29:33.142682+0000","last_became_peered":"2024-03-16T07:29:33.142682+0000","last_unstale":"2024-03-16T07:29:35.136632+0000","last_undegraded":"2024-03-16T07:29:35.136632+0000","last_fullsized":"2024-03-16T07:29:35.136632+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:48:35.046334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:35.133193+0000","last_change":"2024-03-16T07:29:33.827189+0000","last_active":"2024-03-16T07:29:35.133193+0000","last_peered":"2024-03-16T07:29:35.133193+0000","last_clean":"2024-03-16T07:29:35.133193+0000","last_became_active":"2024-03-16T07:29:33.826953+0000","last_became_peered":"2024-03-16T07:29:33.826953+0000","last_unstale":"2024-03-16T07:29:35.133193+0000","last_undegraded":"2024-03-16T07:29:35.133193+0000","last_fullsized":"2024-03-16T07:29:35.133193+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:34:19.104829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.b","version":"95'2","reported_seq":16,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:35.132939+0000","last_change":"2024-03-16T07:29:33.147427+0000","last_active":"2024-03-16T07:29:35.132939+0000","last_peered":"2024-03-16T07:29:35.132939+0000","last_clean":"2024-03-16T07:29:35.132939+0000","last_became_active":"2024-03-16T07:29:33.147011+0000","last_became_peered":"2024-03-16T07:29:33.147011+0000","last_unstale":"2024-03-16T07:29:35.132939+0000","last_undegraded":"2024-03-16T07:29:35.132939+0000","last_fullsized":"2024-03-16T07:29:35.132939+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:11:47.544575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:35.135975+0000","last_change":"2024-03-16T07:29:33.838647+0000","last_active":"2024-03-16T07:29:35.135975+0000","last_peered":"2024-03-16T07:29:35.135975+0000","last_clean":"2024-03-16T07:29:35.135975+0000","last_became_active":"2024-03-16T07:29:33.838049+0000","last_became_peered":"2024-03-16T07:29:33.838049+0000","last_unstale":"2024-03-16T07:29:35.135975+0000","last_undegraded":"2024-03-16T07:29:35.135975+0000","last_fullsized":"2024-03-16T07:29:35.135975+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:56:26.058572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":14,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:34.818378+0000","last_change":"2024-03-16T07:29:33.152620+0000","last_active":"2024-03-16T07:29:34.818378+0000","last_peered":"2024-03-16T07:29:34.818378+0000","last_clean":"2024-03-16T07:29:34.818378+0000","last_became_active":"2024-03-16T07:29:33.152352+0000","last_became_peered":"2024-03-16T07:29:33.152352+0000","last_unstale":"2024-03-16T07:29:34.818378+0000","last_undegraded":"2024-03-16T07:29:34.818378+0000","last_fullsized":"2024-03-16T07:29:34.818378+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:38:26.656813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:35.135319+0000","last_change":"2024-03-16T07:29:33.831988+0000","last_active":"2024-03-16T07:29:35.135319+0000","last_peered":"2024-03-16T07:29:35.135319+0000","last_clean":"2024-03-16T07:29:35.135319+0000","last_became_active":"2024-03-16T07:29:33.831702+0000","last_became_peered":"2024-03-16T07:29:33.831702+0000","last_unstale":"2024-03-16T07:29:35.135319+0000","last_undegraded":"2024-03-16T07:29:35.135319+0000","last_fullsized":"2024-03-16T07:29:35.135319+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:42:04.449559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":14,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:35.132703+0000","last_change":"2024-03-16T07:29:33.147855+0000","last_active":"2024-03-16T07:29:35.132703+0000","last_peered":"2024-03-16T07:29:35.132703+0000","last_clean":"2024-03-16T07:29:35.132703+0000","last_became_active":"2024-03-16T07:29:33.147615+0000","last_became_peered":"2024-03-16T07:29:33.147615+0000","last_unstale":"2024-03-16T07:29:35.132703+0000","last_undegraded":"2024-03-16T07:29:35.132703+0000","last_fullsized":"2024-03-16T07:29:35.132703+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:20:44.698184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:35.132599+0000","last_change":"2024-03-16T07:29:33.830959+0000","last_active":"2024-03-16T07:29:35.132599+0000","last_peered":"2024-03-16T07:29:35.132599+0000","last_clean":"2024-03-16T07:29:35.132599+0000","last_became_active":"2024-03-16T07:29:33.830655+0000","last_became_peered":"2024-03-16T07:29:33.830655+0000","last_unstale":"2024-03-16T07:29:35.132599+0000","last_undegraded":"2024-03-16T07:29:35.132599+0000","last_fullsized":"2024-03-16T07:29:35.132599+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:12:04.435282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":14,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:35.135509+0000","last_change":"2024-03-16T07:29:33.147292+0000","last_active":"2024-03-16T07:29:35.135509+0000","last_peered":"2024-03-16T07:29:35.135509+0000","last_clean":"2024-03-16T07:29:35.135509+0000","last_became_active":"2024-03-16T07:29:33.146227+0000","last_became_peered":"2024-03-16T07:29:33.146227+0000","last_unstale":"2024-03-16T07:29:35.135509+0000","last_undegraded":"2024-03-16T07:29:35.135509+0000","last_fullsized":"2024-03-16T07:29:35.135509+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:23:09.585751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:35.136493+0000","last_change":"2024-03-16T07:29:33.840859+0000","last_active":"2024-03-16T07:29:35.136493+0000","last_peered":"2024-03-16T07:29:35.136493+0000","last_clean":"2024-03-16T07:29:35.136493+0000","last_became_active":"2024-03-16T07:29:33.840311+0000","last_became_peered":"2024-03-16T07:29:33.840311+0000","last_unstale":"2024-03-16T07:29:35.136493+0000","last_undegraded":"2024-03-16T07:29:35.136493+0000","last_fullsized":"2024-03-16T07:29:35.136493+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:35:56.435081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.7","version":"95'2","reported_seq":16,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:35.133897+0000","last_change":"2024-03-16T07:29:33.150332+0000","last_active":"2024-03-16T07:29:35.133897+0000","last_peered":"2024-03-16T07:29:35.133897+0000","last_clean":"2024-03-16T07:29:35.133897+0000","last_became_active":"2024-03-16T07:29:33.149989+0000","last_became_peered":"2024-03-16T07:29:33.149989+0000","last_unstale":"2024-03-16T07:29:35.133897+0000","last_undegraded":"2024-03-16T07:29:35.133897+0000","last_fullsized":"2024-03-16T07:29:35.133897+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:04:56.622565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:35.136580+0000","last_change":"2024-03-16T07:29:33.826957+0000","last_active":"2024-03-16T07:29:35.136580+0000","last_peered":"2024-03-16T07:29:35.136580+0000","last_clean":"2024-03-16T07:29:35.136580+0000","last_became_active":"2024-03-16T07:29:33.826715+0000","last_became_peered":"2024-03-16T07:29:33.826715+0000","last_unstale":"2024-03-16T07:29:35.136580+0000","last_undegraded":"2024-03-16T07:29:35.136580+0000","last_fullsized":"2024-03-16T07:29:35.136580+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:11:43.923099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.6","version":"96'1","reported_seq":15,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:35.133678+0000","last_change":"2024-03-16T07:29:33.144113+0000","last_active":"2024-03-16T07:29:35.133678+0000","last_peered":"2024-03-16T07:29:35.133678+0000","last_clean":"2024-03-16T07:29:35.133678+0000","last_became_active":"2024-03-16T07:29:33.140102+0000","last_became_peered":"2024-03-16T07:29:33.140102+0000","last_unstale":"2024-03-16T07:29:35.133678+0000","last_undegraded":"2024-03-16T07:29:35.133678+0000","last_fullsized":"2024-03-16T07:29:35.133678+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:35:05.997178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:35.136520+0000","last_change":"2024-03-16T07:29:33.838136+0000","last_active":"2024-03-16T07:29:35.136520+0000","last_peered":"2024-03-16T07:29:35.136520+0000","last_clean":"2024-03-16T07:29:35.136520+0000","last_became_active":"2024-03-16T07:29:33.837685+0000","last_became_peered":"2024-03-16T07:29:33.837685+0000","last_unstale":"2024-03-16T07:29:35.136520+0000","last_undegraded":"2024-03-16T07:29:35.136520+0000","last_fullsized":"2024-03-16T07:29:35.136520+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:45:37.351491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":14,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:35.136343+0000","last_change":"2024-03-16T07:29:33.145636+0000","last_active":"2024-03-16T07:29:35.136343+0000","last_peered":"2024-03-16T07:29:35.136343+0000","last_clean":"2024-03-16T07:29:35.136343+0000","last_became_active":"2024-03-16T07:29:33.143854+0000","last_became_peered":"2024-03-16T07:29:33.143854+0000","last_unstale":"2024-03-16T07:29:35.136343+0000","last_undegraded":"2024-03-16T07:29:35.136343+0000","last_fullsized":"2024-03-16T07:29:35.136343+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:17:24.293590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:35.136184+0000","last_change":"2024-03-16T07:29:33.828294+0000","last_active":"2024-03-16T07:29:35.136184+0000","last_peered":"2024-03-16T07:29:35.136184+0000","last_clean":"2024-03-16T07:29:35.136184+0000","last_became_active":"2024-03-16T07:29:33.828062+0000","last_became_peered":"2024-03-16T07:29:33.828062+0000","last_unstale":"2024-03-16T07:29:35.136184+0000","last_undegraded":"2024-03-16T07:29:35.136184+0000","last_fullsized":"2024-03-16T07:29:35.136184+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:34:48.462965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":14,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:34.818154+0000","last_change":"2024-03-16T07:29:33.144300+0000","last_active":"2024-03-16T07:29:34.818154+0000","last_peered":"2024-03-16T07:29:34.818154+0000","last_clean":"2024-03-16T07:29:34.818154+0000","last_became_active":"2024-03-16T07:29:33.144052+0000","last_became_peered":"2024-03-16T07:29:33.144052+0000","last_unstale":"2024-03-16T07:29:34.818154+0000","last_undegraded":"2024-03-16T07:29:34.818154+0000","last_fullsized":"2024-03-16T07:29:34.818154+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:15:27.170786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:35.133299+0000","last_change":"2024-03-16T07:29:33.831300+0000","last_active":"2024-03-16T07:29:35.133299+0000","last_peered":"2024-03-16T07:29:35.133299+0000","last_clean":"2024-03-16T07:29:35.133299+0000","last_became_active":"2024-03-16T07:29:33.831037+0000","last_became_peered":"2024-03-16T07:29:33.831037+0000","last_unstale":"2024-03-16T07:29:35.133299+0000","last_undegraded":"2024-03-16T07:29:35.133299+0000","last_fullsized":"2024-03-16T07:29:35.133299+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:03:57.669517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":14,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:35.132989+0000","last_change":"2024-03-16T07:29:33.147234+0000","last_active":"2024-03-16T07:29:35.132989+0000","last_peered":"2024-03-16T07:29:35.132989+0000","last_clean":"2024-03-16T07:29:35.132989+0000","last_became_active":"2024-03-16T07:29:33.146693+0000","last_became_peered":"2024-03-16T07:29:33.146693+0000","last_unstale":"2024-03-16T07:29:35.132989+0000","last_undegraded":"2024-03-16T07:29:35.132989+0000","last_fullsized":"2024-03-16T07:29:35.132989+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:43:35.352393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:35.136204+0000","last_change":"2024-03-16T07:29:33.831203+0000","last_active":"2024-03-16T07:29:35.136204+0000","last_peered":"2024-03-16T07:29:35.136204+0000","last_clean":"2024-03-16T07:29:35.136204+0000","last_became_active":"2024-03-16T07:29:33.830953+0000","last_became_peered":"2024-03-16T07:29:33.830953+0000","last_unstale":"2024-03-16T07:29:35.136204+0000","last_undegraded":"2024-03-16T07:29:35.136204+0000","last_fullsized":"2024-03-16T07:29:35.136204+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:28:50.259243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":14,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:35.135544+0000","last_change":"2024-03-16T07:29:33.141889+0000","last_active":"2024-03-16T07:29:35.135544+0000","last_peered":"2024-03-16T07:29:35.135544+0000","last_clean":"2024-03-16T07:29:35.135544+0000","last_became_active":"2024-03-16T07:29:33.141560+0000","last_became_peered":"2024-03-16T07:29:33.141560+0000","last_unstale":"2024-03-16T07:29:35.135544+0000","last_undegraded":"2024-03-16T07:29:35.135544+0000","last_fullsized":"2024-03-16T07:29:35.135544+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:06:48.551747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:35.135443+0000","last_change":"2024-03-16T07:29:33.831593+0000","last_active":"2024-03-16T07:29:35.135443+0000","last_peered":"2024-03-16T07:29:35.135443+0000","last_clean":"2024-03-16T07:29:35.135443+0000","last_became_active":"2024-03-16T07:29:33.831346+0000","last_became_peered":"2024-03-16T07:29:33.831346+0000","last_unstale":"2024-03-16T07:29:35.135443+0000","last_undegraded":"2024-03-16T07:29:35.135443+0000","last_fullsized":"2024-03-16T07:29:35.135443+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:41:58.469024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":14,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:34.817958+0000","last_change":"2024-03-16T07:29:33.143890+0000","last_active":"2024-03-16T07:29:34.817958+0000","last_peered":"2024-03-16T07:29:34.817958+0000","last_clean":"2024-03-16T07:29:34.817958+0000","last_became_active":"2024-03-16T07:29:33.143637+0000","last_became_peered":"2024-03-16T07:29:33.143637+0000","last_unstale":"2024-03-16T07:29:34.817958+0000","last_undegraded":"2024-03-16T07:29:34.817958+0000","last_fullsized":"2024-03-16T07:29:34.817958+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:09:44.522730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:35.135686+0000","last_change":"2024-03-16T07:29:33.840846+0000","last_active":"2024-03-16T07:29:35.135686+0000","last_peered":"2024-03-16T07:29:35.135686+0000","last_clean":"2024-03-16T07:29:35.135686+0000","last_became_active":"2024-03-16T07:29:33.840586+0000","last_became_peered":"2024-03-16T07:29:33.840586+0000","last_unstale":"2024-03-16T07:29:35.135686+0000","last_undegraded":"2024-03-16T07:29:35.135686+0000","last_fullsized":"2024-03-16T07:29:35.135686+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:16:10.018326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":14,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:35.135532+0000","last_change":"2024-03-16T07:29:33.139819+0000","last_active":"2024-03-16T07:29:35.135532+0000","last_peered":"2024-03-16T07:29:35.135532+0000","last_clean":"2024-03-16T07:29:35.135532+0000","last_became_active":"2024-03-16T07:29:33.139567+0000","last_became_peered":"2024-03-16T07:29:33.139567+0000","last_unstale":"2024-03-16T07:29:35.135532+0000","last_undegraded":"2024-03-16T07:29:35.135532+0000","last_fullsized":"2024-03-16T07:29:35.135532+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:16:29.768752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":12,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:35.132538+0000","last_change":"2024-03-16T07:29:33.836320+0000","last_active":"2024-03-16T07:29:35.132538+0000","last_peered":"2024-03-16T07:29:35.132538+0000","last_clean":"2024-03-16T07:29:35.132538+0000","last_became_active":"2024-03-16T07:29:33.835776+0000","last_became_peered":"2024-03-16T07:29:33.835776+0000","last_unstale":"2024-03-16T07:29:35.132538+0000","last_undegraded":"2024-03-16T07:29:35.132538+0000","last_fullsized":"2024-03-16T07:29:35.132538+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:44:42.674554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":14,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:34.817847+0000","last_change":"2024-03-16T07:29:33.147194+0000","last_active":"2024-03-16T07:29:34.817847+0000","last_peered":"2024-03-16T07:29:34.817847+0000","last_clean":"2024-03-16T07:29:34.817847+0000","last_became_active":"2024-03-16T07:29:33.146945+0000","last_became_peered":"2024-03-16T07:29:33.146945+0000","last_unstale":"2024-03-16T07:29:34.817847+0000","last_undegraded":"2024-03-16T07:29:34.817847+0000","last_fullsized":"2024-03-16T07:29:34.817847+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:32:59.919891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"80'152","reported_seq":493,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-03-16T07:29:35.132501+0000","last_change":"2024-03-16T07:24:31.650537+0000","last_active":"2024-03-16T07:29:35.132501+0000","last_peered":"2024-03-16T07:29:35.132501+0000","last_clean":"2024-03-16T07:29:35.132501+0000","last_became_active":"2024-03-16T07:24:31.649574+0000","last_became_peered":"2024-03-16T07:24:31.649574+0000","last_unstale":"2024-03-16T07:29:35.132501+0000","last_undegraded":"2024-03-16T07:29:35.132501+0000","last_fullsized":"2024-03-16T07:29:35.132501+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:29.719970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:29.719970+0000","last_clean_scrub_stamp":"2024-03-16T07:24:29.719970+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:31:35.774554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":586,"num_read_kb":1121,"num_write":237,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":586,"num_read_kb":1121,"num_write":237,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":152,"ondisk_log_size":152,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738429,"num_pgs":63,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":36296,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":104821304,"statfs":{"total":107374182400,"available":107337015296,"internally_reserved":0,"allocated":974848,"data_stored":385211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738429,"num_pgs":63,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":36888,"kb_used_data":1544,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":104820712,"statfs":{"total":107374182400,"available":107336409088,"internally_reserved":0,"allocated":1581056,"data_stored":976747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738429,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":32732,"kb_used_data":1548,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":104824868,"statfs":{"total":107374182400,"available":107340664832,"internally_reserved":0,"allocated":1585152,"data_stored":977317,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-16T07:29:42.375 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-03-16T07:29:42.375 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-03-16T07:29:42.794 INFO:teuthology.orchestra.run.smithi049.stdout:[client.0] 2024-03-16T07:29:42.795 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQAaSfVlmBmvGRAAaxdhkajaioVlq23dyv/g4g== 2024-03-16T07:29:42.795 INFO:teuthology.orchestra.run.smithi049.stdout: caps mds = "allow" 2024-03-16T07:29:42.795 INFO:teuthology.orchestra.run.smithi049.stdout: caps mon = "allow r" 2024-03-16T07:29:42.795 INFO:teuthology.orchestra.run.smithi049.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-03-16T07:29:42.795 INFO:teuthology.orchestra.run.smithi049.stderr:updated caps for client.0 2024-03-16T07:29:42.807 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T07:29:43.148 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:29:43.148 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":65,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5588,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6827/1816248233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":1816248233},{"type":"v1","addr":"172.21.15.49:6827","nonce":1816248233}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62},{"gid":5589,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6829/2028370121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":2028370121},{"type":"v1","addr":"172.21.15.49:6829","nonce":2028370121}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62},{"gid":5596,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6831/2282357763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":2282357763},{"type":"v1","addr":"172.21.15.49:6831","nonce":2282357763}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62},{"gid":5597,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6833/2335462758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":2335462758},{"type":"v1","addr":"172.21.15.49:6833","nonce":2335462758}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62}],"filesystems":[{"mdsmap":{"epoch":65,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-16T07:29:33.503199+0000","modified":"2024-03-16T07:29:35.492553+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5598},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5598":{"gid":5598,"name":"e","rank":0,"incarnation":63,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6835/2451687435","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":2451687435},{"type":"v1","addr":"172.21.15.49:6835","nonce":2451687435}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5598,"qdb_cluster":[5598]},"id":8}]} 2024-03-16T07:29:43.148 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 65 2024-03-16T07:29:43.667 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 65, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-03-16T07:29:33.503199+0000', 'modified': '2024-03-16T07:29:35.492553+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5598}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5598': {'gid': 5598, 'name': 'e', 'rank': 0, 'incarnation': 63, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.49:6835/2451687435', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.49:6834', 'nonce': 2451687435}, {'type': 'v1', 'addr': '172.21.15.49:6835', 'nonce': 2451687435}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [17], 'metadata_pool': 16, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5598, 'qdb_cluster': [5598]} 2024-03-16T07:29:43.667 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-03-16T07:29:43.667 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.e status 2024-03-16T07:29:43.792 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-16T07:29:43.794+0000 7ff6edffb640 0 client.5669 ms_handle_reset on v2:172.21.15.49:6834/2451687435 2024-03-16T07:29:43.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-16T07:29:43.818+0000 7ff6edffb640 0 client.5671 ms_handle_reset on v2:172.21.15.49:6834/2451687435 2024-03-16T07:29:43.816 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-03-16T07:29:43.816 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_fsid": "f91af061-9eac-4793-87fa-8d27ae3d242f", 2024-03-16T07:29:43.816 INFO:teuthology.orchestra.run.smithi049.stdout: "whoami": 0, 2024-03-16T07:29:43.817 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 5598, 2024-03-16T07:29:43.817 INFO:teuthology.orchestra.run.smithi049.stdout: "want_state": "up:active", 2024-03-16T07:29:43.817 INFO:teuthology.orchestra.run.smithi049.stdout: "state": "up:active", 2024-03-16T07:29:43.817 INFO:teuthology.orchestra.run.smithi049.stdout: "fs_name": "cephfs", 2024-03-16T07:29:43.817 INFO:teuthology.orchestra.run.smithi049.stdout: "rank_uptime": 9.6906075890000007, 2024-03-16T07:29:43.817 INFO:teuthology.orchestra.run.smithi049.stdout: "mdsmap_epoch": 65, 2024-03-16T07:29:43.817 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch": 96, 2024-03-16T07:29:43.817 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch_barrier": 96, 2024-03-16T07:29:43.817 INFO:teuthology.orchestra.run.smithi049.stdout: "uptime": 14.997520012000001 2024-03-16T07:29:43.817 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-03-16T07:29:43.827 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-03-16T07:29:44.166 INFO:teuthology.orchestra.run.smithi049.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-03-16T07:29:44.179 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-03-16T07:29:44.179 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-03-16T07:29:44.179 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi049.front.sepia.ceph.com 2024-03-16T07:29:44.179 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-03-16T07:29:44.179 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-03-16T07:29:44.179 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-03-16T07:29:44.179 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-03-16T07:29:44.179 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-03-16T07:29:44.179 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-03-16T07:29:44.180 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:29:44.180 DEBUG:teuthology.orchestra.run.smithi049:> ip addr 2024-03-16T07:29:44.195 INFO:teuthology.orchestra.run.smithi049.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-16T07:29:44.195 INFO:teuthology.orchestra.run.smithi049.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-16T07:29:44.195 INFO:teuthology.orchestra.run.smithi049.stdout: inet 127.0.0.1/8 scope host lo 2024-03-16T07:29:44.195 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-03-16T07:29:44.195 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 ::1/128 scope host 2024-03-16T07:29:44.196 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-03-16T07:29:44.196 INFO:teuthology.orchestra.run.smithi049.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-16T07:29:44.196 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:6b:ff:84 brd ff:ff:ff:ff:ff:ff 2024-03-16T07:29:44.196 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp7s0f0 2024-03-16T07:29:44.196 INFO:teuthology.orchestra.run.smithi049.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-16T07:29:44.196 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:6b:ff:85 brd ff:ff:ff:ff:ff:ff 2024-03-16T07:29:44.196 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp7s0f1 2024-03-16T07:29:44.196 INFO:teuthology.orchestra.run.smithi049.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-03-16T07:29:44.196 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:bd:15:66 brd ff:ff:ff:ff:ff:ff 2024-03-16T07:29:44.196 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp1s0f0 2024-03-16T07:29:44.196 INFO:teuthology.orchestra.run.smithi049.stdout: inet 172.21.15.49/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-03-16T07:29:44.196 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft 42123sec preferred_lft 42123sec 2024-03-16T07:29:44.196 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::ec4:7aff:febd:1566/64 scope link noprefixroute 2024-03-16T07:29:44.196 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-03-16T07:29:44.196 INFO:teuthology.orchestra.run.smithi049.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-16T07:29:44.197 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:bd:15:67 brd ff:ff:ff:ff:ff:ff 2024-03-16T07:29:44.197 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp1s0f1 2024-03-16T07:29:44.197 INFO:teuthology.orchestra.run.smithi049.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-03-16T07:29:44.197 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether a2:f1:88:c1:22:e7 brd ff:ff:ff:ff:ff:ff 2024-03-16T07:29:44.197 INFO:teuthology.orchestra.run.smithi049.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-03-16T07:29:44.197 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-03-16T07:29:44.197 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::e0e6:55ff:fe4d:1d68/64 scope link 2024-03-16T07:29:44.197 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-03-16T07:29:44.197 INFO:teuthology.orchestra.run.smithi049.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-03-16T07:29:44.197 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether ee:10:71:d7:68:c4 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-16T07:29:44.197 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::ec10:71ff:fed7:68c4/64 scope link 2024-03-16T07:29:44.197 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-03-16T07:29:44.197 INFO:teuthology.orchestra.run.smithi049.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-03-16T07:29:44.197 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether a2:f1:88:c1:22:e7 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-16T07:29:44.197 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::a0f1:88ff:fec1:22e7/64 scope link 2024-03-16T07:29:44.198 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-03-16T07:29:44.198 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:29:44.198 DEBUG:teuthology.orchestra.run.smithi049:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-03-16T07:29:44.264 INFO:teuthology.orchestra.run.smithi049.stdout:1 2024-03-16T07:29:44.266 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:29:44.266 DEBUG:teuthology.orchestra.run.smithi049:> route 2024-03-16T07:29:44.325 INFO:teuthology.orchestra.run.smithi049.stdout:Kernel IP routing table 2024-03-16T07:29:44.325 INFO:teuthology.orchestra.run.smithi049.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-03-16T07:29:44.325 INFO:teuthology.orchestra.run.smithi049.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-03-16T07:29:44.325 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-03-16T07:29:44.325 INFO:teuthology.orchestra.run.smithi049.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-03-16T07:29:44.325 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-16T07:29:44.326 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-03-16T07:29:44.326 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-03-16T07:29:44.326 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-03-16T07:29:44.326 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-03-16T07:29:44.326 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-03-16T07:29:44.414 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-16T07:29:44 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-16T07:29:44.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-16T07:29:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-16T07:29:44.471 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:29:44.471 DEBUG:teuthology.orchestra.run.smithi049:> ip netns list 2024-03-16T07:29:44.486 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 1) 2024-03-16T07:29:44.486 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-03-16T07:29:44.486 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-03-16T07:29:44.487 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:29:44.487 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link set brx.0 up 2024-03-16T07:29:44.556 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-03-16T07:29:44.556 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-16T07:29:44.556 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-03-16T07:29:44.611 INFO:teuthology.orchestra.run.smithi049.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-03-16T07:29:44.611 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-16T07:29:44.611 DEBUG:teuthology.orchestra.run.smithi049:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-03-16T07:29:44.665 DEBUG:teuthology.orchestra.run.smithi049:> sudo modprobe fuse 2024-03-16T07:29:44.737 DEBUG:teuthology.orchestra.run.smithi049:> cat /proc/self/mounts | awk '{print $2}' 2024-03-16T07:29:44.793 INFO:teuthology.orchestra.run.smithi049.stdout:/proc 2024-03-16T07:29:44.793 INFO:teuthology.orchestra.run.smithi049.stdout:/sys 2024-03-16T07:29:44.793 INFO:teuthology.orchestra.run.smithi049.stdout:/dev 2024-03-16T07:29:44.793 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/security 2024-03-16T07:29:44.793 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/shm 2024-03-16T07:29:44.793 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/pts 2024-03-16T07:29:44.793 INFO:teuthology.orchestra.run.smithi049.stdout:/run 2024-03-16T07:29:44.793 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/cgroup 2024-03-16T07:29:44.793 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/pstore 2024-03-16T07:29:44.793 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/bpf 2024-03-16T07:29:44.793 INFO:teuthology.orchestra.run.smithi049.stdout:/ 2024-03-16T07:29:44.793 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/selinux 2024-03-16T07:29:44.794 INFO:teuthology.orchestra.run.smithi049.stdout:/proc/sys/fs/binfmt_misc 2024-03-16T07:29:44.794 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/mqueue 2024-03-16T07:29:44.794 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/hugepages 2024-03-16T07:29:44.794 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/debug 2024-03-16T07:29:44.794 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/tracing 2024-03-16T07:29:44.794 INFO:teuthology.orchestra.run.smithi049.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-03-16T07:29:44.794 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/fuse/connections 2024-03-16T07:29:44.794 INFO:teuthology.orchestra.run.smithi049.stdout:/run/credentials/systemd-sysctl.service 2024-03-16T07:29:44.794 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/config 2024-03-16T07:29:44.794 INFO:teuthology.orchestra.run.smithi049.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-03-16T07:29:44.794 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/nfs/rpc_pipefs 2024-03-16T07:29:44.794 INFO:teuthology.orchestra.run.smithi049.stdout:/run/user/1000 2024-03-16T07:29:44.794 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph 2024-03-16T07:29:44.794 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-0 2024-03-16T07:29:44.794 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-1 2024-03-16T07:29:44.795 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-2 2024-03-16T07:29:44.795 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns 2024-03-16T07:29:44.795 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-16T07:29:44.795 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-16T07:29:44.795 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-16T07:29:44.795 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-16T07:29:44.795 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:29:44.795 DEBUG:teuthology.orchestra.run.smithi049:> ls /sys/fs/fuse/connections 2024-03-16T07:29:44.848 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-03-16T07:29:44.848 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-03-16T07:29:44.891 DEBUG:teuthology.orchestra.run.smithi049:> sudo modprobe fuse 2024-03-16T07:29:44.922 DEBUG:teuthology.orchestra.run.smithi049:> cat /proc/self/mounts | awk '{print $2}' 2024-03-16T07:29:44.978 INFO:teuthology.orchestra.run.smithi049.stdout:/proc 2024-03-16T07:29:44.978 INFO:teuthology.orchestra.run.smithi049.stdout:/sys 2024-03-16T07:29:44.978 INFO:teuthology.orchestra.run.smithi049.stdout:/dev 2024-03-16T07:29:44.978 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/security 2024-03-16T07:29:44.978 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/shm 2024-03-16T07:29:44.978 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/pts 2024-03-16T07:29:44.978 INFO:teuthology.orchestra.run.smithi049.stdout:/run 2024-03-16T07:29:44.978 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/cgroup 2024-03-16T07:29:44.978 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/pstore 2024-03-16T07:29:44.979 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/bpf 2024-03-16T07:29:44.979 INFO:teuthology.orchestra.run.smithi049.stdout:/ 2024-03-16T07:29:44.979 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/selinux 2024-03-16T07:29:44.979 INFO:teuthology.orchestra.run.smithi049.stdout:/proc/sys/fs/binfmt_misc 2024-03-16T07:29:44.979 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/mqueue 2024-03-16T07:29:44.979 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/hugepages 2024-03-16T07:29:44.979 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/debug 2024-03-16T07:29:44.979 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/tracing 2024-03-16T07:29:44.979 INFO:teuthology.orchestra.run.smithi049.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-03-16T07:29:44.979 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/fuse/connections 2024-03-16T07:29:44.979 INFO:teuthology.orchestra.run.smithi049.stdout:/run/credentials/systemd-sysctl.service 2024-03-16T07:29:44.979 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/config 2024-03-16T07:29:44.979 INFO:teuthology.orchestra.run.smithi049.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-03-16T07:29:44.979 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/nfs/rpc_pipefs 2024-03-16T07:29:44.979 INFO:teuthology.orchestra.run.smithi049.stdout:/run/user/1000 2024-03-16T07:29:44.980 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph 2024-03-16T07:29:44.980 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-0 2024-03-16T07:29:44.980 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-1 2024-03-16T07:29:44.980 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-2 2024-03-16T07:29:44.980 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns 2024-03-16T07:29:44.980 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-16T07:29:44.980 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-16T07:29:44.980 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-16T07:29:44.980 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-16T07:29:44.980 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:29:44.980 DEBUG:teuthology.orchestra.run.smithi049:> ls /sys/fs/fuse/connections 2024-03-16T07:29:44.995 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi049.stderr:2024-03-16T07:29:44.996+0000 7f48daebb480 -1 init, newargv = 0x55ea02df7e00 newargc=15 2024-03-16T07:29:44.995 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi049.stderr:ceph-fuse[64436]: starting ceph client 2024-03-16T07:29:44.998 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi049.stderr:ceph-fuse[64436]: starting fuse 2024-03-16T07:29:45.010 INFO:teuthology.orchestra.run.smithi049.stdout:41 2024-03-16T07:29:45.010 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2024-03-16T07:29:45.010 DEBUG:teuthology.orchestra.run.smithi049:> sudo stdin-killer -- python3 -c ' 2024-03-16T07:29:45.010 DEBUG:teuthology.orchestra.run.smithi049:> import glob 2024-03-16T07:29:45.010 DEBUG:teuthology.orchestra.run.smithi049:> import re 2024-03-16T07:29:45.010 DEBUG:teuthology.orchestra.run.smithi049:> import os 2024-03-16T07:29:45.010 DEBUG:teuthology.orchestra.run.smithi049:> import subprocess 2024-03-16T07:29:45.011 DEBUG:teuthology.orchestra.run.smithi049:> 2024-03-16T07:29:45.011 DEBUG:teuthology.orchestra.run.smithi049:> def _find_admin_socket(client_name): 2024-03-16T07:29:45.011 DEBUG:teuthology.orchestra.run.smithi049:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-03-16T07:29:45.011 DEBUG:teuthology.orchestra.run.smithi049:> files = glob.glob(asok_path) 2024-03-16T07:29:45.011 DEBUG:teuthology.orchestra.run.smithi049:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-03-16T07:29:45.011 DEBUG:teuthology.orchestra.run.smithi049:> 2024-03-16T07:29:45.011 DEBUG:teuthology.orchestra.run.smithi049:> # Given a non-glob path, it better be there 2024-03-16T07:29:45.011 DEBUG:teuthology.orchestra.run.smithi049:> if "*" not in asok_path: 2024-03-16T07:29:45.011 DEBUG:teuthology.orchestra.run.smithi049:> assert(len(files) == 1) 2024-03-16T07:29:45.011 DEBUG:teuthology.orchestra.run.smithi049:> return files[0] 2024-03-16T07:29:45.011 DEBUG:teuthology.orchestra.run.smithi049:> 2024-03-16T07:29:45.011 DEBUG:teuthology.orchestra.run.smithi049:> for f in files: 2024-03-16T07:29:45.011 DEBUG:teuthology.orchestra.run.smithi049:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-03-16T07:29:45.011 DEBUG:teuthology.orchestra.run.smithi049:> if os.path.exists("/proc/{0}".format(pid)): 2024-03-16T07:29:45.011 DEBUG:teuthology.orchestra.run.smithi049:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-03-16T07:29:45.011 DEBUG:teuthology.orchestra.run.smithi049:> contents = proc_f.read() 2024-03-16T07:29:45.012 DEBUG:teuthology.orchestra.run.smithi049:> if mountpoint in contents: 2024-03-16T07:29:45.012 DEBUG:teuthology.orchestra.run.smithi049:> return f 2024-03-16T07:29:45.012 DEBUG:teuthology.orchestra.run.smithi049:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-03-16T07:29:45.012 DEBUG:teuthology.orchestra.run.smithi049:> 2024-03-16T07:29:45.012 DEBUG:teuthology.orchestra.run.smithi049:> print(_find_admin_socket("client.0")) 2024-03-16T07:29:45.012 DEBUG:teuthology.orchestra.run.smithi049:> ' 2024-03-16T07:29:45.136 INFO:teuthology.orchestra.run.smithi049.stdout:/var/run/ceph/ceph-client.0.64436.asok 2024-03-16T07:29:45.139 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-16T07:29:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-16T07:29:45.146 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.64436.asok 2024-03-16T07:29:45.146 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:29:45.147 DEBUG:teuthology.orchestra.run.smithi049:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.64436.asok status 2024-03-16T07:29:45.289 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-03-16T07:29:45.290 INFO:teuthology.orchestra.run.smithi049.stdout: "metadata": { 2024-03-16T07:29:45.290 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph_sha1": "3d78f5ba07bf18880172c07d4d7b4ac00c9d30af", 2024-03-16T07:29:45.290 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph_version": "ceph version 19.0.0-2162-g3d78f5ba (3d78f5ba07bf18880172c07d4d7b4ac00c9d30af) squid (dev)", 2024-03-16T07:29:45.290 INFO:teuthology.orchestra.run.smithi049.stdout: "entity_id": "0", 2024-03-16T07:29:45.290 INFO:teuthology.orchestra.run.smithi049.stdout: "hostname": "smithi049", 2024-03-16T07:29:45.290 INFO:teuthology.orchestra.run.smithi049.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-03-16T07:29:45.290 INFO:teuthology.orchestra.run.smithi049.stdout: "pid": "64436", 2024-03-16T07:29:45.290 INFO:teuthology.orchestra.run.smithi049.stdout: "root": "/" 2024-03-16T07:29:45.290 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:29:45.290 INFO:teuthology.orchestra.run.smithi049.stdout: "dentry_count": 0, 2024-03-16T07:29:45.290 INFO:teuthology.orchestra.run.smithi049.stdout: "dentry_pinned_count": 0, 2024-03-16T07:29:45.290 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 5677, 2024-03-16T07:29:45.290 INFO:teuthology.orchestra.run.smithi049.stdout: "inst": { 2024-03-16T07:29:45.291 INFO:teuthology.orchestra.run.smithi049.stdout: "name": { 2024-03-16T07:29:45.291 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "client", 2024-03-16T07:29:45.291 INFO:teuthology.orchestra.run.smithi049.stdout: "num": 5677 2024-03-16T07:29:45.291 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:29:45.291 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": { 2024-03-16T07:29:45.291 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2024-03-16T07:29:45.291 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "192.168.0.1:0", 2024-03-16T07:29:45.291 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 901038422 2024-03-16T07:29:45.291 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:29:45.291 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:29:45.291 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": { 2024-03-16T07:29:45.291 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2024-03-16T07:29:45.291 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "192.168.0.1:0", 2024-03-16T07:29:45.291 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 901038422 2024-03-16T07:29:45.291 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:29:45.292 INFO:teuthology.orchestra.run.smithi049.stdout: "inst_str": "client.5677 192.168.0.1:0/901038422", 2024-03-16T07:29:45.292 INFO:teuthology.orchestra.run.smithi049.stdout: "addr_str": "192.168.0.1:0/901038422", 2024-03-16T07:29:45.292 INFO:teuthology.orchestra.run.smithi049.stdout: "inode_count": 1, 2024-03-16T07:29:45.292 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_epoch": 65, 2024-03-16T07:29:45.292 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_epoch": 96, 2024-03-16T07:29:45.292 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_epoch_barrier": 0, 2024-03-16T07:29:45.292 INFO:teuthology.orchestra.run.smithi049.stdout: "blocklisted": false, 2024-03-16T07:29:45.292 INFO:teuthology.orchestra.run.smithi049.stdout: "fs_name": "cephfs" 2024-03-16T07:29:45.292 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-03-16T07:29:45.298 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:29:45.298 DEBUG:teuthology.orchestra.run.smithi049:> stat --file-system '--printf=%T 2024-03-16T07:29:45.298 DEBUG:teuthology.orchestra.run.smithi049:> ' -- /home/ubuntu/cephtest/mnt.0 2024-03-16T07:29:45.314 INFO:teuthology.orchestra.run.smithi049.stdout:fuseblk 2024-03-16T07:29:45.314 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-03-16T07:29:45.314 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:29:45.314 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-03-16T07:29:45.385 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-03-16T07:29:45.808 INFO:teuthology.orchestra.run.smithi049.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-03-16T07:29:45.821 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-03-16T07:29:45.821 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-03-16T07:29:45.821 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi049.front.sepia.ceph.com 2024-03-16T07:29:45.821 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-03-16T07:29:45.821 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-03-16T07:29:45.821 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-03-16T07:29:45.821 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-03-16T07:29:45.821 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-03-16T07:29:45.821 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-03-16T07:29:45.821 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:29:45.821 DEBUG:teuthology.orchestra.run.smithi049:> ip addr 2024-03-16T07:29:45.837 INFO:teuthology.orchestra.run.smithi049.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-16T07:29:45.837 INFO:teuthology.orchestra.run.smithi049.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-16T07:29:45.837 INFO:teuthology.orchestra.run.smithi049.stdout: inet 127.0.0.1/8 scope host lo 2024-03-16T07:29:45.837 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-03-16T07:29:45.837 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 ::1/128 scope host 2024-03-16T07:29:45.837 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-03-16T07:29:45.837 INFO:teuthology.orchestra.run.smithi049.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-16T07:29:45.837 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:6b:ff:84 brd ff:ff:ff:ff:ff:ff 2024-03-16T07:29:45.838 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp7s0f0 2024-03-16T07:29:45.838 INFO:teuthology.orchestra.run.smithi049.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-16T07:29:45.838 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:6b:ff:85 brd ff:ff:ff:ff:ff:ff 2024-03-16T07:29:45.838 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp7s0f1 2024-03-16T07:29:45.838 INFO:teuthology.orchestra.run.smithi049.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-03-16T07:29:45.838 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:bd:15:66 brd ff:ff:ff:ff:ff:ff 2024-03-16T07:29:45.838 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp1s0f0 2024-03-16T07:29:45.838 INFO:teuthology.orchestra.run.smithi049.stdout: inet 172.21.15.49/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-03-16T07:29:45.838 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft 42122sec preferred_lft 42122sec 2024-03-16T07:29:45.838 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::ec4:7aff:febd:1566/64 scope link noprefixroute 2024-03-16T07:29:45.838 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-03-16T07:29:45.838 INFO:teuthology.orchestra.run.smithi049.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-16T07:29:45.838 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:bd:15:67 brd ff:ff:ff:ff:ff:ff 2024-03-16T07:29:45.839 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp1s0f1 2024-03-16T07:29:45.839 INFO:teuthology.orchestra.run.smithi049.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-03-16T07:29:45.839 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether a2:f1:88:c1:22:e7 brd ff:ff:ff:ff:ff:ff 2024-03-16T07:29:45.839 INFO:teuthology.orchestra.run.smithi049.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-03-16T07:29:45.839 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-03-16T07:29:45.839 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::e0e6:55ff:fe4d:1d68/64 scope link 2024-03-16T07:29:45.839 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-03-16T07:29:45.839 INFO:teuthology.orchestra.run.smithi049.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-03-16T07:29:45.839 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether ee:10:71:d7:68:c4 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-16T07:29:45.839 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::ec10:71ff:fed7:68c4/64 scope link 2024-03-16T07:29:45.839 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-03-16T07:29:45.839 INFO:teuthology.orchestra.run.smithi049.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-03-16T07:29:45.839 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether a2:f1:88:c1:22:e7 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-16T07:29:45.839 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::a0f1:88ff:fec1:22e7/64 scope link 2024-03-16T07:29:45.840 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-03-16T07:29:45.840 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:29:45.840 DEBUG:teuthology.orchestra.run.smithi049:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-03-16T07:29:45.906 INFO:teuthology.orchestra.run.smithi049.stdout:1 2024-03-16T07:29:45.907 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:29:45.907 DEBUG:teuthology.orchestra.run.smithi049:> route 2024-03-16T07:29:45.964 INFO:teuthology.orchestra.run.smithi049.stdout:Kernel IP routing table 2024-03-16T07:29:45.964 INFO:teuthology.orchestra.run.smithi049.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-03-16T07:29:45.964 INFO:teuthology.orchestra.run.smithi049.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-03-16T07:29:45.964 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-03-16T07:29:45.964 INFO:teuthology.orchestra.run.smithi049.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-03-16T07:29:45.964 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-16T07:29:45.964 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-03-16T07:29:45.964 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-03-16T07:29:45.965 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-03-16T07:29:45.965 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-03-16T07:29:45.965 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-03-16T07:29:46.053 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-16T07:29:46 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-16T07:29:46.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-16T07:29:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-16T07:29:46.113 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:29:46.113 DEBUG:teuthology.orchestra.run.smithi049:> ip netns list 2024-03-16T07:29:46.129 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 1) 2024-03-16T07:29:46.129 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-03-16T07:29:46.129 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-03-16T07:29:46.129 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:29:46.129 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link set brx.1 up 2024-03-16T07:29:46.200 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-03-16T07:29:46.200 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-16T07:29:46.200 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-03-16T07:29:46.255 INFO:teuthology.orchestra.run.smithi049.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-03-16T07:29:46.255 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-16T07:29:46.255 DEBUG:teuthology.orchestra.run.smithi049:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-03-16T07:29:46.309 DEBUG:teuthology.orchestra.run.smithi049:> sudo modprobe fuse 2024-03-16T07:29:46.381 DEBUG:teuthology.orchestra.run.smithi049:> cat /proc/self/mounts | awk '{print $2}' 2024-03-16T07:29:46.437 INFO:teuthology.orchestra.run.smithi049.stdout:/proc 2024-03-16T07:29:46.437 INFO:teuthology.orchestra.run.smithi049.stdout:/sys 2024-03-16T07:29:46.437 INFO:teuthology.orchestra.run.smithi049.stdout:/dev 2024-03-16T07:29:46.437 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/security 2024-03-16T07:29:46.437 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/shm 2024-03-16T07:29:46.437 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/pts 2024-03-16T07:29:46.437 INFO:teuthology.orchestra.run.smithi049.stdout:/run 2024-03-16T07:29:46.437 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/cgroup 2024-03-16T07:29:46.437 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/pstore 2024-03-16T07:29:46.437 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/bpf 2024-03-16T07:29:46.438 INFO:teuthology.orchestra.run.smithi049.stdout:/ 2024-03-16T07:29:46.438 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/selinux 2024-03-16T07:29:46.438 INFO:teuthology.orchestra.run.smithi049.stdout:/proc/sys/fs/binfmt_misc 2024-03-16T07:29:46.438 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/mqueue 2024-03-16T07:29:46.438 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/hugepages 2024-03-16T07:29:46.438 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/debug 2024-03-16T07:29:46.438 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/tracing 2024-03-16T07:29:46.438 INFO:teuthology.orchestra.run.smithi049.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-03-16T07:29:46.438 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/fuse/connections 2024-03-16T07:29:46.438 INFO:teuthology.orchestra.run.smithi049.stdout:/run/credentials/systemd-sysctl.service 2024-03-16T07:29:46.438 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/config 2024-03-16T07:29:46.439 INFO:teuthology.orchestra.run.smithi049.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-03-16T07:29:46.439 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/nfs/rpc_pipefs 2024-03-16T07:29:46.439 INFO:teuthology.orchestra.run.smithi049.stdout:/run/user/1000 2024-03-16T07:29:46.439 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph 2024-03-16T07:29:46.439 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-0 2024-03-16T07:29:46.439 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-1 2024-03-16T07:29:46.439 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-2 2024-03-16T07:29:46.439 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns 2024-03-16T07:29:46.440 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-16T07:29:46.440 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-16T07:29:46.440 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-16T07:29:46.440 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-16T07:29:46.440 INFO:teuthology.orchestra.run.smithi049.stdout:/home/ubuntu/cephtest/mnt.0 2024-03-16T07:29:46.440 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:29:46.441 DEBUG:teuthology.orchestra.run.smithi049:> ls /sys/fs/fuse/connections 2024-03-16T07:29:46.492 INFO:teuthology.orchestra.run.smithi049.stdout:41 2024-03-16T07:29:46.493 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [41] 2024-03-16T07:29:46.493 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-03-16T07:29:46.535 DEBUG:teuthology.orchestra.run.smithi049:> sudo modprobe fuse 2024-03-16T07:29:46.566 DEBUG:teuthology.orchestra.run.smithi049:> cat /proc/self/mounts | awk '{print $2}' 2024-03-16T07:29:46.624 INFO:teuthology.orchestra.run.smithi049.stdout:/proc 2024-03-16T07:29:46.624 INFO:teuthology.orchestra.run.smithi049.stdout:/sys 2024-03-16T07:29:46.624 INFO:teuthology.orchestra.run.smithi049.stdout:/dev 2024-03-16T07:29:46.624 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/security 2024-03-16T07:29:46.624 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/shm 2024-03-16T07:29:46.624 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/pts 2024-03-16T07:29:46.624 INFO:teuthology.orchestra.run.smithi049.stdout:/run 2024-03-16T07:29:46.625 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/cgroup 2024-03-16T07:29:46.625 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/pstore 2024-03-16T07:29:46.625 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/bpf 2024-03-16T07:29:46.625 INFO:teuthology.orchestra.run.smithi049.stdout:/ 2024-03-16T07:29:46.625 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/selinux 2024-03-16T07:29:46.625 INFO:teuthology.orchestra.run.smithi049.stdout:/proc/sys/fs/binfmt_misc 2024-03-16T07:29:46.625 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/mqueue 2024-03-16T07:29:46.625 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/hugepages 2024-03-16T07:29:46.625 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/debug 2024-03-16T07:29:46.625 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/tracing 2024-03-16T07:29:46.625 INFO:teuthology.orchestra.run.smithi049.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-03-16T07:29:46.625 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/fuse/connections 2024-03-16T07:29:46.625 INFO:teuthology.orchestra.run.smithi049.stdout:/run/credentials/systemd-sysctl.service 2024-03-16T07:29:46.625 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/config 2024-03-16T07:29:46.625 INFO:teuthology.orchestra.run.smithi049.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-03-16T07:29:46.626 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/nfs/rpc_pipefs 2024-03-16T07:29:46.626 INFO:teuthology.orchestra.run.smithi049.stdout:/run/user/1000 2024-03-16T07:29:46.626 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph 2024-03-16T07:29:46.626 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-0 2024-03-16T07:29:46.626 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-1 2024-03-16T07:29:46.626 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-2 2024-03-16T07:29:46.626 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns 2024-03-16T07:29:46.626 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-16T07:29:46.626 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-16T07:29:46.626 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-16T07:29:46.626 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-16T07:29:46.626 INFO:teuthology.orchestra.run.smithi049.stdout:/home/ubuntu/cephtest/mnt.0 2024-03-16T07:29:46.627 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:29:46.627 DEBUG:teuthology.orchestra.run.smithi049:> ls /sys/fs/fuse/connections 2024-03-16T07:29:46.630 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi049.stderr:2024-03-16T07:29:46.631+0000 7fea7ac3f480 -1 init, newargv = 0x55cc209f2e00 newargc=15 2024-03-16T07:29:46.630 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi049.stderr:ceph-fuse[64839]: starting ceph client 2024-03-16T07:29:46.633 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi049.stderr:ceph-fuse[64839]: starting fuse 2024-03-16T07:29:46.646 INFO:teuthology.orchestra.run.smithi049.stdout:41 2024-03-16T07:29:46.646 INFO:teuthology.orchestra.run.smithi049.stdout:44 2024-03-16T07:29:46.646 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41, 44] 2024-03-16T07:29:46.646 DEBUG:teuthology.orchestra.run.smithi049:> sudo stdin-killer -- python3 -c ' 2024-03-16T07:29:46.646 DEBUG:teuthology.orchestra.run.smithi049:> import glob 2024-03-16T07:29:46.646 DEBUG:teuthology.orchestra.run.smithi049:> import re 2024-03-16T07:29:46.646 DEBUG:teuthology.orchestra.run.smithi049:> import os 2024-03-16T07:29:46.646 DEBUG:teuthology.orchestra.run.smithi049:> import subprocess 2024-03-16T07:29:46.647 DEBUG:teuthology.orchestra.run.smithi049:> 2024-03-16T07:29:46.647 DEBUG:teuthology.orchestra.run.smithi049:> def _find_admin_socket(client_name): 2024-03-16T07:29:46.647 DEBUG:teuthology.orchestra.run.smithi049:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-03-16T07:29:46.647 DEBUG:teuthology.orchestra.run.smithi049:> files = glob.glob(asok_path) 2024-03-16T07:29:46.647 DEBUG:teuthology.orchestra.run.smithi049:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-03-16T07:29:46.647 DEBUG:teuthology.orchestra.run.smithi049:> 2024-03-16T07:29:46.647 DEBUG:teuthology.orchestra.run.smithi049:> # Given a non-glob path, it better be there 2024-03-16T07:29:46.647 DEBUG:teuthology.orchestra.run.smithi049:> if "*" not in asok_path: 2024-03-16T07:29:46.647 DEBUG:teuthology.orchestra.run.smithi049:> assert(len(files) == 1) 2024-03-16T07:29:46.647 DEBUG:teuthology.orchestra.run.smithi049:> return files[0] 2024-03-16T07:29:46.647 DEBUG:teuthology.orchestra.run.smithi049:> 2024-03-16T07:29:46.647 DEBUG:teuthology.orchestra.run.smithi049:> for f in files: 2024-03-16T07:29:46.647 DEBUG:teuthology.orchestra.run.smithi049:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-03-16T07:29:46.647 DEBUG:teuthology.orchestra.run.smithi049:> if os.path.exists("/proc/{0}".format(pid)): 2024-03-16T07:29:46.647 DEBUG:teuthology.orchestra.run.smithi049:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-03-16T07:29:46.647 DEBUG:teuthology.orchestra.run.smithi049:> contents = proc_f.read() 2024-03-16T07:29:46.647 DEBUG:teuthology.orchestra.run.smithi049:> if mountpoint in contents: 2024-03-16T07:29:46.648 DEBUG:teuthology.orchestra.run.smithi049:> return f 2024-03-16T07:29:46.648 DEBUG:teuthology.orchestra.run.smithi049:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-03-16T07:29:46.648 DEBUG:teuthology.orchestra.run.smithi049:> 2024-03-16T07:29:46.648 DEBUG:teuthology.orchestra.run.smithi049:> print(_find_admin_socket("client.1")) 2024-03-16T07:29:46.648 DEBUG:teuthology.orchestra.run.smithi049:> ' 2024-03-16T07:29:46.771 INFO:teuthology.orchestra.run.smithi049.stdout:/var/run/ceph/ceph-client.1.64839.asok 2024-03-16T07:29:46.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-16T07:29:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-16T07:29:46.782 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.64839.asok 2024-03-16T07:29:46.782 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:29:46.782 DEBUG:teuthology.orchestra.run.smithi049:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.64839.asok status 2024-03-16T07:29:46.924 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-03-16T07:29:46.925 INFO:teuthology.orchestra.run.smithi049.stdout: "metadata": { 2024-03-16T07:29:46.925 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph_sha1": "3d78f5ba07bf18880172c07d4d7b4ac00c9d30af", 2024-03-16T07:29:46.925 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph_version": "ceph version 19.0.0-2162-g3d78f5ba (3d78f5ba07bf18880172c07d4d7b4ac00c9d30af) squid (dev)", 2024-03-16T07:29:46.925 INFO:teuthology.orchestra.run.smithi049.stdout: "entity_id": "1", 2024-03-16T07:29:46.925 INFO:teuthology.orchestra.run.smithi049.stdout: "hostname": "smithi049", 2024-03-16T07:29:46.925 INFO:teuthology.orchestra.run.smithi049.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-03-16T07:29:46.925 INFO:teuthology.orchestra.run.smithi049.stdout: "pid": "64839", 2024-03-16T07:29:46.925 INFO:teuthology.orchestra.run.smithi049.stdout: "root": "/" 2024-03-16T07:29:46.925 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:29:46.925 INFO:teuthology.orchestra.run.smithi049.stdout: "dentry_count": 0, 2024-03-16T07:29:46.925 INFO:teuthology.orchestra.run.smithi049.stdout: "dentry_pinned_count": 0, 2024-03-16T07:29:46.925 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 5683, 2024-03-16T07:29:46.925 INFO:teuthology.orchestra.run.smithi049.stdout: "inst": { 2024-03-16T07:29:46.925 INFO:teuthology.orchestra.run.smithi049.stdout: "name": { 2024-03-16T07:29:46.926 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "client", 2024-03-16T07:29:46.926 INFO:teuthology.orchestra.run.smithi049.stdout: "num": 5683 2024-03-16T07:29:46.926 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:29:46.926 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": { 2024-03-16T07:29:46.926 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2024-03-16T07:29:46.926 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "192.168.0.2:0", 2024-03-16T07:29:46.926 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 610231949 2024-03-16T07:29:46.926 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:29:46.926 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:29:46.926 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": { 2024-03-16T07:29:46.926 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2024-03-16T07:29:46.926 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "192.168.0.2:0", 2024-03-16T07:29:46.926 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 610231949 2024-03-16T07:29:46.927 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:29:46.927 INFO:teuthology.orchestra.run.smithi049.stdout: "inst_str": "client.5683 192.168.0.2:0/610231949", 2024-03-16T07:29:46.927 INFO:teuthology.orchestra.run.smithi049.stdout: "addr_str": "192.168.0.2:0/610231949", 2024-03-16T07:29:46.927 INFO:teuthology.orchestra.run.smithi049.stdout: "inode_count": 1, 2024-03-16T07:29:46.927 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_epoch": 65, 2024-03-16T07:29:46.927 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_epoch": 96, 2024-03-16T07:29:46.927 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_epoch_barrier": 0, 2024-03-16T07:29:46.927 INFO:teuthology.orchestra.run.smithi049.stdout: "blocklisted": false, 2024-03-16T07:29:46.927 INFO:teuthology.orchestra.run.smithi049.stdout: "fs_name": "cephfs" 2024-03-16T07:29:46.927 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-03-16T07:29:46.933 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:29:46.933 DEBUG:teuthology.orchestra.run.smithi049:> stat --file-system '--printf=%T 2024-03-16T07:29:46.933 DEBUG:teuthology.orchestra.run.smithi049:> ' -- /home/ubuntu/cephtest/mnt.1 2024-03-16T07:29:46.948 INFO:teuthology.orchestra.run.smithi049.stdout:fuseblk 2024-03-16T07:29:46.949 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-03-16T07:29:46.949 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:29:46.949 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-03-16T07:29:47.020 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2024-03-16T07:29:48.237 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T07:29:48.540 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:29:48.540 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":96,"fsid":"f91af061-9eac-4793-87fa-8d27ae3d242f","created":"2024-03-16T07:24:20.357868+0000","modified":"2024-03-16T07:29:34.813554+0000","last_up_change":"2024-03-16T07:24:27.474980+0000","last_in_change":"2024-03-16T07:24:21.254179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T07:24:28.947521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-03-16T07:29:31.811291+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-03-16T07:29:32.483018+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"96","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3600000143051147,"score_stable":1.3600000143051147,"optimal_score":1,"raw_score_acting":1.3600000143051147,"raw_score_stable":1.3600000143051147,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2df14aac-98dc-4e3c-ae7e-9eb677aa30be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6801","nonce":2744935777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6803","nonce":2744935777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6807","nonce":2744935777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6805","nonce":2744935777}]},"public_addr":"172.21.15.49:6801/2744935777","cluster_addr":"172.21.15.49:6803/2744935777","heartbeat_back_addr":"172.21.15.49:6807/2744935777","heartbeat_front_addr":"172.21.15.49:6805/2744935777","state":["exists","up"]},{"osd":1,"uuid":"80461bd9-59ef-46df-9eea-bad92d960c57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6811","nonce":1655120118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6815","nonce":1655120118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6821","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6823","nonce":1655120118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6817","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6819","nonce":1655120118}]},"public_addr":"172.21.15.49:6811/1655120118","cluster_addr":"172.21.15.49:6815/1655120118","heartbeat_back_addr":"172.21.15.49:6823/1655120118","heartbeat_front_addr":"172.21.15.49:6819/1655120118","state":["exists","up"]},{"osd":2,"uuid":"d6bf40eb-6e42-4ec9-8b3d-0b6c5a6def79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6810","nonce":3815472376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6814","nonce":3815472376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6822","nonce":3815472376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6818","nonce":3815472376}]},"public_addr":"172.21.15.49:6810/3815472376","cluster_addr":"172.21.15.49:6814/3815472376","heartbeat_back_addr":"172.21.15.49:6822/3815472376","heartbeat_front_addr":"172.21.15.49:6818/3815472376","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.641492+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.668598+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.614940+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T07:29:48.552 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-16T07:24:28.947521+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-16T07:29:31.811291+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '95', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 17, 'pool_name': 'cephfs_data', 'create_time': '2024-03-16T07:29:32.483018+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '96', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3600000143051147, 'score_stable': 1.3600000143051147, 'optimal_score': 1, 'raw_score_acting': 1.3600000143051147, 'raw_score_stable': 1.3600000143051147, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-16T07:29:48.552 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-16T07:29:48.873 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2024-03-16T07:29:48.886 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-16T07:29:49.203 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2024-03-16T07:29:49.217 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-16T07:29:49.519 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2024-03-16T07:29:49.532 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-03-16T07:29:49.840 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:29:49.841 INFO:teuthology.orchestra.run.smithi049.stdout:[ 2024-03-16T07:29:49.841 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:29:49.841 INFO:teuthology.orchestra.run.smithi049.stdout: "poolnum": 1, 2024-03-16T07:29:49.841 INFO:teuthology.orchestra.run.smithi049.stdout: "poolname": ".mgr" 2024-03-16T07:29:49.841 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:29:49.842 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:29:49.842 INFO:teuthology.orchestra.run.smithi049.stdout: "poolnum": 16, 2024-03-16T07:29:49.842 INFO:teuthology.orchestra.run.smithi049.stdout: "poolname": "cephfs_metadata" 2024-03-16T07:29:49.842 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:29:49.842 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:29:49.842 INFO:teuthology.orchestra.run.smithi049.stdout: "poolnum": 17, 2024-03-16T07:29:49.842 INFO:teuthology.orchestra.run.smithi049.stdout: "poolname": "cephfs_data" 2024-03-16T07:29:49.842 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:29:49.842 INFO:teuthology.orchestra.run.smithi049.stdout:] 2024-03-16T07:29:49.852 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'backup_fs' 2024-03-16T07:29:49.853 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create backup_fs_metadata --pg_num_min 64 2024-03-16T07:29:50.227 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'backup_fs_metadata' created 2024-03-16T07:29:50.247 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create backup_fs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-03-16T07:29:51.228 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'backup_fs_data' created 2024-03-16T07:29:51.260 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new backup_fs backup_fs_metadata backup_fs_data 2024-03-16T07:29:52.240 INFO:teuthology.orchestra.run.smithi049.stderr:new fs with metadata pool 18 and data pool 19 2024-03-16T07:29:52.273 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T07:29:52.653 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:29:52.653 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":99,"fsid":"f91af061-9eac-4793-87fa-8d27ae3d242f","created":"2024-03-16T07:24:20.357868+0000","modified":"2024-03-16T07:29:51.607360+0000","last_up_change":"2024-03-16T07:24:27.474980+0000","last_in_change":"2024-03-16T07:24:21.254179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T07:24:28.947521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-03-16T07:29:31.811291+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-03-16T07:29:32.483018+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"96","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3600000143051147,"score_stable":1.3600000143051147,"optimal_score":1,"raw_score_acting":1.3600000143051147,"raw_score_stable":1.3600000143051147,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"backup_fs_metadata","create_time":"2024-03-16T07:29:50.191529+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"99","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"backup_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.4099999666213989,"score_stable":1.4099999666213989,"optimal_score":1,"raw_score_acting":1.4099999666213989,"raw_score_stable":1.4099999666213989,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"backup_fs_data","create_time":"2024-03-16T07:29:50.589589+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"99","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"backup_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.0800000429153442,"score_stable":1.0800000429153442,"optimal_score":1,"raw_score_acting":1.0800000429153442,"raw_score_stable":1.0800000429153442,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2df14aac-98dc-4e3c-ae7e-9eb677aa30be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6801","nonce":2744935777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6803","nonce":2744935777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6807","nonce":2744935777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6805","nonce":2744935777}]},"public_addr":"172.21.15.49:6801/2744935777","cluster_addr":"172.21.15.49:6803/2744935777","heartbeat_back_addr":"172.21.15.49:6807/2744935777","heartbeat_front_addr":"172.21.15.49:6805/2744935777","state":["exists","up"]},{"osd":1,"uuid":"80461bd9-59ef-46df-9eea-bad92d960c57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6811","nonce":1655120118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6815","nonce":1655120118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6821","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6823","nonce":1655120118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6817","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6819","nonce":1655120118}]},"public_addr":"172.21.15.49:6811/1655120118","cluster_addr":"172.21.15.49:6815/1655120118","heartbeat_back_addr":"172.21.15.49:6823/1655120118","heartbeat_front_addr":"172.21.15.49:6819/1655120118","state":["exists","up"]},{"osd":2,"uuid":"d6bf40eb-6e42-4ec9-8b3d-0b6c5a6def79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6810","nonce":3815472376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6814","nonce":3815472376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6822","nonce":3815472376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6818","nonce":3815472376}]},"public_addr":"172.21.15.49:6810/3815472376","cluster_addr":"172.21.15.49:6814/3815472376","heartbeat_back_addr":"172.21.15.49:6822/3815472376","heartbeat_front_addr":"172.21.15.49:6818/3815472376","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.641492+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.668598+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.614940+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T07:29:52.666 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T07:29:52.990 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:29:52.990 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":99,"fsid":"f91af061-9eac-4793-87fa-8d27ae3d242f","created":"2024-03-16T07:24:20.357868+0000","modified":"2024-03-16T07:29:51.607360+0000","last_up_change":"2024-03-16T07:24:27.474980+0000","last_in_change":"2024-03-16T07:24:21.254179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T07:24:28.947521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-03-16T07:29:31.811291+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-03-16T07:29:32.483018+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"96","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3600000143051147,"score_stable":1.3600000143051147,"optimal_score":1,"raw_score_acting":1.3600000143051147,"raw_score_stable":1.3600000143051147,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"backup_fs_metadata","create_time":"2024-03-16T07:29:50.191529+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"99","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"backup_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.4099999666213989,"score_stable":1.4099999666213989,"optimal_score":1,"raw_score_acting":1.4099999666213989,"raw_score_stable":1.4099999666213989,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"backup_fs_data","create_time":"2024-03-16T07:29:50.589589+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"99","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"backup_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.0800000429153442,"score_stable":1.0800000429153442,"optimal_score":1,"raw_score_acting":1.0800000429153442,"raw_score_stable":1.0800000429153442,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2df14aac-98dc-4e3c-ae7e-9eb677aa30be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6801","nonce":2744935777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6803","nonce":2744935777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6807","nonce":2744935777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6805","nonce":2744935777}]},"public_addr":"172.21.15.49:6801/2744935777","cluster_addr":"172.21.15.49:6803/2744935777","heartbeat_back_addr":"172.21.15.49:6807/2744935777","heartbeat_front_addr":"172.21.15.49:6805/2744935777","state":["exists","up"]},{"osd":1,"uuid":"80461bd9-59ef-46df-9eea-bad92d960c57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6811","nonce":1655120118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6815","nonce":1655120118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6821","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6823","nonce":1655120118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6817","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6819","nonce":1655120118}]},"public_addr":"172.21.15.49:6811/1655120118","cluster_addr":"172.21.15.49:6815/1655120118","heartbeat_back_addr":"172.21.15.49:6823/1655120118","heartbeat_front_addr":"172.21.15.49:6819/1655120118","state":["exists","up"]},{"osd":2,"uuid":"d6bf40eb-6e42-4ec9-8b3d-0b6c5a6def79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6810","nonce":3815472376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6814","nonce":3815472376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6822","nonce":3815472376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6818","nonce":3815472376}]},"public_addr":"172.21.15.49:6810/3815472376","cluster_addr":"172.21.15.49:6814/3815472376","heartbeat_back_addr":"172.21.15.49:6822/3815472376","heartbeat_front_addr":"172.21.15.49:6818/3815472376","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.641492+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.668598+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.614940+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T07:29:53.003 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set backup_fs standby_count_wanted 0 2024-03-16T07:29:54.263 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-03-16T07:29:54.263 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set backup_fs allow_standby_replay false 2024-03-16T07:29:54.795 INFO:tasks.ceph.mds.a.smithi049.stderr:2024-03-16T07:29:54.797+0000 7f4b130cc640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-03-16T07:29:55.260 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'backup_fs' 2024-03-16T07:29:55.261 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T07:29:55.691 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:29:55.691 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":71,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5588,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6827/1816248233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":1816248233},{"type":"v1","addr":"172.21.15.49:6827","nonce":1816248233}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62},{"gid":5589,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6829/2028370121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":2028370121},{"type":"v1","addr":"172.21.15.49:6829","nonce":2028370121}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62},{"gid":5596,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6831/2282357763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":2282357763},{"type":"v1","addr":"172.21.15.49:6831","nonce":2282357763}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62}],"filesystems":[{"mdsmap":{"epoch":65,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-16T07:29:33.503199+0000","modified":"2024-03-16T07:29:35.492553+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5598},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5598":{"gid":5598,"name":"e","rank":0,"incarnation":63,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6835/2451687435","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":2451687435},{"type":"v1","addr":"172.21.15.49:6835","nonce":2451687435}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5598,"qdb_cluster":[5598]},"id":8},{"mdsmap":{"epoch":71,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-16T07:29:51.607653+0000","modified":"2024-03-16T07:29:54.609298+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5597},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5597":{"gid":5597,"name":"a","rank":0,"incarnation":67,"state":"up:active","state_seq":7,"addr":"172.21.15.49:6833/2335462758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":2335462758},{"type":"v1","addr":"172.21.15.49:6833","nonce":2335462758}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"backup_fs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5597,"qdb_cluster":[5597]},"id":9}]} 2024-03-16T07:29:55.691 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 71 2024-03-16T07:29:55.708 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T07:29:56.009 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:29:56.010 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":100,"fsid":"f91af061-9eac-4793-87fa-8d27ae3d242f","created":"2024-03-16T07:24:20.357868+0000","modified":"2024-03-16T07:29:53.241507+0000","last_up_change":"2024-03-16T07:24:27.474980+0000","last_in_change":"2024-03-16T07:24:21.254179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T07:24:28.947521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-03-16T07:29:31.811291+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-03-16T07:29:32.483018+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"96","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3600000143051147,"score_stable":1.3600000143051147,"optimal_score":1,"raw_score_acting":1.3600000143051147,"raw_score_stable":1.3600000143051147,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"backup_fs_metadata","create_time":"2024-03-16T07:29:50.191529+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"99","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"backup_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.4099999666213989,"score_stable":1.4099999666213989,"optimal_score":1,"raw_score_acting":1.4099999666213989,"raw_score_stable":1.4099999666213989,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"backup_fs_data","create_time":"2024-03-16T07:29:50.589589+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"100","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"backup_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.0800000429153442,"score_stable":1.0800000429153442,"optimal_score":1,"raw_score_acting":1.0800000429153442,"raw_score_stable":1.0800000429153442,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2df14aac-98dc-4e3c-ae7e-9eb677aa30be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6801","nonce":2744935777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6803","nonce":2744935777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6807","nonce":2744935777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6805","nonce":2744935777}]},"public_addr":"172.21.15.49:6801/2744935777","cluster_addr":"172.21.15.49:6803/2744935777","heartbeat_back_addr":"172.21.15.49:6807/2744935777","heartbeat_front_addr":"172.21.15.49:6805/2744935777","state":["exists","up"]},{"osd":1,"uuid":"80461bd9-59ef-46df-9eea-bad92d960c57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6811","nonce":1655120118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6815","nonce":1655120118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6821","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6823","nonce":1655120118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6817","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6819","nonce":1655120118}]},"public_addr":"172.21.15.49:6811/1655120118","cluster_addr":"172.21.15.49:6815/1655120118","heartbeat_back_addr":"172.21.15.49:6823/1655120118","heartbeat_front_addr":"172.21.15.49:6819/1655120118","state":["exists","up"]},{"osd":2,"uuid":"d6bf40eb-6e42-4ec9-8b3d-0b6c5a6def79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6810","nonce":3815472376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6814","nonce":3815472376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6822","nonce":3815472376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6818","nonce":3815472376}]},"public_addr":"172.21.15.49:6810/3815472376","cluster_addr":"172.21.15.49:6814/3815472376","heartbeat_back_addr":"172.21.15.49:6822/3815472376","heartbeat_front_addr":"172.21.15.49:6818/3815472376","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.641492+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.668598+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.614940+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T07:29:56.022 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-03-16T07:29:56.022 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-16T07:29:56.498 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:29:56.502 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2024-03-16T07:29:56.513 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":45,"stamp":"2024-03-16T07:29:56.169663+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596885,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":586,"num_read_kb":1121,"num_write":328,"num_write_kb":1925,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":231,"ondisk_log_size":231,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":321,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":314572800,"kb_used":110236,"kb_used_data":4204,"kb_used_omap":4,"kb_used_meta":105979,"kb_avail":314462564,"statfs":{"total":322122547200,"available":322009665536,"internally_reserved":0,"allocated":4304896,"data_stored":2391187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":108522831},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.940110"},"pg_stats":[{"pgid":"19.3d","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.278663+0000","last_change":"2024-03-16T07:29:52.270163+0000","last_active":"2024-03-16T07:29:52.278663+0000","last_peered":"2024-03-16T07:29:52.278663+0000","last_clean":"2024-03-16T07:29:52.278663+0000","last_became_active":"2024-03-16T07:29:52.269928+0000","last_became_peered":"2024-03-16T07:29:52.269928+0000","last_unstale":"2024-03-16T07:29:52.278663+0000","last_undegraded":"2024-03-16T07:29:52.278663+0000","last_fullsized":"2024-03-16T07:29:52.278663+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_clean_scrub_stamp":"2024-03-16T07:29:51.229201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:21:09.677951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3f","version":"0'0","reported_seq":18,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.241037+0000","last_change":"2024-03-16T07:29:33.837801+0000","last_active":"2024-03-16T07:29:52.241037+0000","last_peered":"2024-03-16T07:29:52.241037+0000","last_clean":"2024-03-16T07:29:52.241037+0000","last_became_active":"2024-03-16T07:29:33.837541+0000","last_became_peered":"2024-03-16T07:29:33.837541+0000","last_unstale":"2024-03-16T07:29:52.241037+0000","last_undegraded":"2024-03-16T07:29:52.241037+0000","last_fullsized":"2024-03-16T07:29:52.241037+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:04:52.392474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.279549+0000","last_change":"2024-03-16T07:29:52.275530+0000","last_active":"2024-03-16T07:29:52.279549+0000","last_peered":"2024-03-16T07:29:52.279549+0000","last_clean":"2024-03-16T07:29:52.279549+0000","last_became_active":"2024-03-16T07:29:52.275282+0000","last_became_peered":"2024-03-16T07:29:52.275282+0000","last_unstale":"2024-03-16T07:29:52.279549+0000","last_undegraded":"2024-03-16T07:29:52.279549+0000","last_fullsized":"2024-03-16T07:29:52.279549+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_clean_scrub_stamp":"2024-03-16T07:29:51.229201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:49:24.787124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":18,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.248724+0000","last_change":"2024-03-16T07:29:33.828285+0000","last_active":"2024-03-16T07:29:52.248724+0000","last_peered":"2024-03-16T07:29:52.248724+0000","last_clean":"2024-03-16T07:29:52.248724+0000","last_became_active":"2024-03-16T07:29:33.827699+0000","last_became_peered":"2024-03-16T07:29:33.827699+0000","last_unstale":"2024-03-16T07:29:52.248724+0000","last_undegraded":"2024-03-16T07:29:52.248724+0000","last_fullsized":"2024-03-16T07:29:52.248724+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:26:06.558057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3f","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.279830+0000","last_change":"2024-03-16T07:29:52.277215+0000","last_active":"2024-03-16T07:29:52.279830+0000","last_peered":"2024-03-16T07:29:52.279830+0000","last_clean":"2024-03-16T07:29:52.279830+0000","last_became_active":"2024-03-16T07:29:52.276293+0000","last_became_peered":"2024-03-16T07:29:52.276293+0000","last_unstale":"2024-03-16T07:29:52.279830+0000","last_undegraded":"2024-03-16T07:29:52.279830+0000","last_fullsized":"2024-03-16T07:29:52.279830+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_clean_scrub_stamp":"2024-03-16T07:29:51.229201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:40:11.434508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":18,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.256446+0000","last_change":"2024-03-16T07:29:33.832571+0000","last_active":"2024-03-16T07:29:52.256446+0000","last_peered":"2024-03-16T07:29:52.256446+0000","last_clean":"2024-03-16T07:29:52.256446+0000","last_became_active":"2024-03-16T07:29:33.832329+0000","last_became_peered":"2024-03-16T07:29:33.832329+0000","last_unstale":"2024-03-16T07:29:52.256446+0000","last_undegraded":"2024-03-16T07:29:52.256446+0000","last_fullsized":"2024-03-16T07:29:52.256446+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:45:05.916690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.269377+0000","last_change":"2024-03-16T07:29:52.265441+0000","last_active":"2024-03-16T07:29:52.269377+0000","last_peered":"2024-03-16T07:29:52.269377+0000","last_clean":"2024-03-16T07:29:52.269377+0000","last_became_active":"2024-03-16T07:29:52.264428+0000","last_became_peered":"2024-03-16T07:29:52.264428+0000","last_unstale":"2024-03-16T07:29:52.269377+0000","last_undegraded":"2024-03-16T07:29:52.269377+0000","last_fullsized":"2024-03-16T07:29:52.269377+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_clean_scrub_stamp":"2024-03-16T07:29:51.229201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:49:24.787124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":18,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.240974+0000","last_change":"2024-03-16T07:29:33.830557+0000","last_active":"2024-03-16T07:29:52.240974+0000","last_peered":"2024-03-16T07:29:52.240974+0000","last_clean":"2024-03-16T07:29:52.240974+0000","last_became_active":"2024-03-16T07:29:33.830122+0000","last_became_peered":"2024-03-16T07:29:33.830122+0000","last_unstale":"2024-03-16T07:29:52.240974+0000","last_undegraded":"2024-03-16T07:29:52.240974+0000","last_fullsized":"2024-03-16T07:29:52.240974+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:35:43.576229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.271981+0000","last_change":"2024-03-16T07:29:52.269168+0000","last_active":"2024-03-16T07:29:52.271981+0000","last_peered":"2024-03-16T07:29:52.271981+0000","last_clean":"2024-03-16T07:29:52.271981+0000","last_became_active":"2024-03-16T07:29:52.268946+0000","last_became_peered":"2024-03-16T07:29:52.268946+0000","last_unstale":"2024-03-16T07:29:52.271981+0000","last_undegraded":"2024-03-16T07:29:52.271981+0000","last_fullsized":"2024-03-16T07:29:52.271981+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_clean_scrub_stamp":"2024-03-16T07:29:51.229201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:35:12.787336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":18,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.257761+0000","last_change":"2024-03-16T07:29:33.834562+0000","last_active":"2024-03-16T07:29:52.257761+0000","last_peered":"2024-03-16T07:29:52.257761+0000","last_clean":"2024-03-16T07:29:52.257761+0000","last_became_active":"2024-03-16T07:29:33.833200+0000","last_became_peered":"2024-03-16T07:29:33.833200+0000","last_unstale":"2024-03-16T07:29:52.257761+0000","last_undegraded":"2024-03-16T07:29:52.257761+0000","last_fullsized":"2024-03-16T07:29:52.257761+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:07:30.736713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.281966+0000","last_change":"2024-03-16T07:29:52.279048+0000","last_active":"2024-03-16T07:29:52.281966+0000","last_peered":"2024-03-16T07:29:52.281966+0000","last_clean":"2024-03-16T07:29:52.281966+0000","last_became_active":"2024-03-16T07:29:52.278233+0000","last_became_peered":"2024-03-16T07:29:52.278233+0000","last_unstale":"2024-03-16T07:29:52.281966+0000","last_undegraded":"2024-03-16T07:29:52.281966+0000","last_fullsized":"2024-03-16T07:29:52.281966+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_clean_scrub_stamp":"2024-03-16T07:29:51.229201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:33:33.984229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":18,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.246696+0000","last_change":"2024-03-16T07:29:33.826274+0000","last_active":"2024-03-16T07:29:52.246696+0000","last_peered":"2024-03-16T07:29:52.246696+0000","last_clean":"2024-03-16T07:29:52.246696+0000","last_became_active":"2024-03-16T07:29:33.825821+0000","last_became_peered":"2024-03-16T07:29:33.825821+0000","last_unstale":"2024-03-16T07:29:52.246696+0000","last_undegraded":"2024-03-16T07:29:52.246696+0000","last_fullsized":"2024-03-16T07:29:52.246696+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:54:54.165392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.285623+0000","last_change":"2024-03-16T07:29:52.285001+0000","last_active":"2024-03-16T07:29:52.285623+0000","last_peered":"2024-03-16T07:29:52.285623+0000","last_clean":"2024-03-16T07:29:52.285623+0000","last_became_active":"2024-03-16T07:29:52.284454+0000","last_became_peered":"2024-03-16T07:29:52.284454+0000","last_unstale":"2024-03-16T07:29:52.285623+0000","last_undegraded":"2024-03-16T07:29:52.285623+0000","last_fullsized":"2024-03-16T07:29:52.285623+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_clean_scrub_stamp":"2024-03-16T07:29:51.229201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:54:27.625231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":18,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.249322+0000","last_change":"2024-03-16T07:29:33.832454+0000","last_active":"2024-03-16T07:29:52.249322+0000","last_peered":"2024-03-16T07:29:52.249322+0000","last_clean":"2024-03-16T07:29:52.249322+0000","last_became_active":"2024-03-16T07:29:33.832205+0000","last_became_peered":"2024-03-16T07:29:33.832205+0000","last_unstale":"2024-03-16T07:29:52.249322+0000","last_undegraded":"2024-03-16T07:29:52.249322+0000","last_fullsized":"2024-03-16T07:29:52.249322+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:45:54.158424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.277053+0000","last_change":"2024-03-16T07:29:52.273907+0000","last_active":"2024-03-16T07:29:52.277053+0000","last_peered":"2024-03-16T07:29:52.277053+0000","last_clean":"2024-03-16T07:29:52.277053+0000","last_became_active":"2024-03-16T07:29:52.273679+0000","last_became_peered":"2024-03-16T07:29:52.273679+0000","last_unstale":"2024-03-16T07:29:52.277053+0000","last_undegraded":"2024-03-16T07:29:52.277053+0000","last_fullsized":"2024-03-16T07:29:52.277053+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_clean_scrub_stamp":"2024-03-16T07:29:51.229201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:49:32.359753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":18,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.245888+0000","last_change":"2024-03-16T07:29:33.834186+0000","last_active":"2024-03-16T07:29:52.245888+0000","last_peered":"2024-03-16T07:29:52.245888+0000","last_clean":"2024-03-16T07:29:52.245888+0000","last_became_active":"2024-03-16T07:29:33.833939+0000","last_became_peered":"2024-03-16T07:29:33.833939+0000","last_unstale":"2024-03-16T07:29:52.245888+0000","last_undegraded":"2024-03-16T07:29:52.245888+0000","last_fullsized":"2024-03-16T07:29:52.245888+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:05:33.276056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.278681+0000","last_change":"2024-03-16T07:29:52.272796+0000","last_active":"2024-03-16T07:29:52.278681+0000","last_peered":"2024-03-16T07:29:52.278681+0000","last_clean":"2024-03-16T07:29:52.278681+0000","last_became_active":"2024-03-16T07:29:52.271857+0000","last_became_peered":"2024-03-16T07:29:52.271857+0000","last_unstale":"2024-03-16T07:29:52.278681+0000","last_undegraded":"2024-03-16T07:29:52.278681+0000","last_fullsized":"2024-03-16T07:29:52.278681+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_clean_scrub_stamp":"2024-03-16T07:29:51.229201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:20:39.294503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":18,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.243842+0000","last_change":"2024-03-16T07:29:33.840759+0000","last_active":"2024-03-16T07:29:52.243842+0000","last_peered":"2024-03-16T07:29:52.243842+0000","last_clean":"2024-03-16T07:29:52.243842+0000","last_became_active":"2024-03-16T07:29:33.840493+0000","last_became_peered":"2024-03-16T07:29:33.840493+0000","last_unstale":"2024-03-16T07:29:52.243842+0000","last_undegraded":"2024-03-16T07:29:52.243842+0000","last_fullsized":"2024-03-16T07:29:52.243842+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:28:46.696178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.276077+0000","last_change":"2024-03-16T07:29:52.269883+0000","last_active":"2024-03-16T07:29:52.276077+0000","last_peered":"2024-03-16T07:29:52.276077+0000","last_clean":"2024-03-16T07:29:52.276077+0000","last_became_active":"2024-03-16T07:29:52.265994+0000","last_became_peered":"2024-03-16T07:29:52.265994+0000","last_unstale":"2024-03-16T07:29:52.276077+0000","last_undegraded":"2024-03-16T07:29:52.276077+0000","last_fullsized":"2024-03-16T07:29:52.276077+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_clean_scrub_stamp":"2024-03-16T07:29:51.229201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:04:33.522327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":18,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.240908+0000","last_change":"2024-03-16T07:29:33.837411+0000","last_active":"2024-03-16T07:29:52.240908+0000","last_peered":"2024-03-16T07:29:52.240908+0000","last_clean":"2024-03-16T07:29:52.240908+0000","last_became_active":"2024-03-16T07:29:33.837054+0000","last_became_peered":"2024-03-16T07:29:33.837054+0000","last_unstale":"2024-03-16T07:29:52.240908+0000","last_undegraded":"2024-03-16T07:29:52.240908+0000","last_fullsized":"2024-03-16T07:29:52.240908+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:40:38.224614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.279846+0000","last_change":"2024-03-16T07:29:52.277413+0000","last_active":"2024-03-16T07:29:52.279846+0000","last_peered":"2024-03-16T07:29:52.279846+0000","last_clean":"2024-03-16T07:29:52.279846+0000","last_became_active":"2024-03-16T07:29:52.276578+0000","last_became_peered":"2024-03-16T07:29:52.276578+0000","last_unstale":"2024-03-16T07:29:52.279846+0000","last_undegraded":"2024-03-16T07:29:52.279846+0000","last_fullsized":"2024-03-16T07:29:52.279846+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_clean_scrub_stamp":"2024-03-16T07:29:51.229201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:16:53.738018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":18,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.242576+0000","last_change":"2024-03-16T07:29:33.841582+0000","last_active":"2024-03-16T07:29:52.242576+0000","last_peered":"2024-03-16T07:29:52.242576+0000","last_clean":"2024-03-16T07:29:52.242576+0000","last_became_active":"2024-03-16T07:29:33.841350+0000","last_became_peered":"2024-03-16T07:29:33.841350+0000","last_unstale":"2024-03-16T07:29:52.242576+0000","last_undegraded":"2024-03-16T07:29:52.242576+0000","last_fullsized":"2024-03-16T07:29:52.242576+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:25:07.504235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.275015+0000","last_change":"2024-03-16T07:29:52.273507+0000","last_active":"2024-03-16T07:29:52.275015+0000","last_peered":"2024-03-16T07:29:52.275015+0000","last_clean":"2024-03-16T07:29:52.275015+0000","last_became_active":"2024-03-16T07:29:52.273264+0000","last_became_peered":"2024-03-16T07:29:52.273264+0000","last_unstale":"2024-03-16T07:29:52.275015+0000","last_undegraded":"2024-03-16T07:29:52.275015+0000","last_fullsized":"2024-03-16T07:29:52.275015+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_clean_scrub_stamp":"2024-03-16T07:29:51.229201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:42:00.720071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":18,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.241018+0000","last_change":"2024-03-16T07:29:33.830360+0000","last_active":"2024-03-16T07:29:52.241018+0000","last_peered":"2024-03-16T07:29:52.241018+0000","last_clean":"2024-03-16T07:29:52.241018+0000","last_became_active":"2024-03-16T07:29:33.829805+0000","last_became_peered":"2024-03-16T07:29:33.829805+0000","last_unstale":"2024-03-16T07:29:52.241018+0000","last_undegraded":"2024-03-16T07:29:52.241018+0000","last_fullsized":"2024-03-16T07:29:52.241018+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:47:45.954148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.279579+0000","last_change":"2024-03-16T07:29:52.275988+0000","last_active":"2024-03-16T07:29:52.279579+0000","last_peered":"2024-03-16T07:29:52.279579+0000","last_clean":"2024-03-16T07:29:52.279579+0000","last_became_active":"2024-03-16T07:29:52.275757+0000","last_became_peered":"2024-03-16T07:29:52.275757+0000","last_unstale":"2024-03-16T07:29:52.279579+0000","last_undegraded":"2024-03-16T07:29:52.279579+0000","last_fullsized":"2024-03-16T07:29:52.279579+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_clean_scrub_stamp":"2024-03-16T07:29:51.229201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:42:00.720071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":18,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.257853+0000","last_change":"2024-03-16T07:29:33.827090+0000","last_active":"2024-03-16T07:29:52.257853+0000","last_peered":"2024-03-16T07:29:52.257853+0000","last_clean":"2024-03-16T07:29:52.257853+0000","last_became_active":"2024-03-16T07:29:33.826838+0000","last_became_peered":"2024-03-16T07:29:33.826838+0000","last_unstale":"2024-03-16T07:29:52.257853+0000","last_undegraded":"2024-03-16T07:29:52.257853+0000","last_fullsized":"2024-03-16T07:29:52.257853+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:14:55.133041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.281986+0000","last_change":"2024-03-16T07:29:52.279232+0000","last_active":"2024-03-16T07:29:52.281986+0000","last_peered":"2024-03-16T07:29:52.281986+0000","last_clean":"2024-03-16T07:29:52.281986+0000","last_became_active":"2024-03-16T07:29:52.278525+0000","last_became_peered":"2024-03-16T07:29:52.278525+0000","last_unstale":"2024-03-16T07:29:52.281986+0000","last_undegraded":"2024-03-16T07:29:52.281986+0000","last_fullsized":"2024-03-16T07:29:52.281986+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_clean_scrub_stamp":"2024-03-16T07:29:51.229201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:03:43.189937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":18,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.239757+0000","last_change":"2024-03-16T07:29:33.839839+0000","last_active":"2024-03-16T07:29:52.239757+0000","last_peered":"2024-03-16T07:29:52.239757+0000","last_clean":"2024-03-16T07:29:52.239757+0000","last_became_active":"2024-03-16T07:29:33.839596+0000","last_became_peered":"2024-03-16T07:29:33.839596+0000","last_unstale":"2024-03-16T07:29:52.239757+0000","last_undegraded":"2024-03-16T07:29:52.239757+0000","last_fullsized":"2024-03-16T07:29:52.239757+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:28:05.388099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.272048+0000","last_change":"2024-03-16T07:29:52.268287+0000","last_active":"2024-03-16T07:29:52.272048+0000","last_peered":"2024-03-16T07:29:52.272048+0000","last_clean":"2024-03-16T07:29:52.272048+0000","last_became_active":"2024-03-16T07:29:52.268057+0000","last_became_peered":"2024-03-16T07:29:52.268057+0000","last_unstale":"2024-03-16T07:29:52.272048+0000","last_undegraded":"2024-03-16T07:29:52.272048+0000","last_fullsized":"2024-03-16T07:29:52.272048+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_clean_scrub_stamp":"2024-03-16T07:29:51.229201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:29:45.248666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":18,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.253369+0000","last_change":"2024-03-16T07:29:33.834583+0000","last_active":"2024-03-16T07:29:52.253369+0000","last_peered":"2024-03-16T07:29:52.253369+0000","last_clean":"2024-03-16T07:29:52.253369+0000","last_became_active":"2024-03-16T07:29:33.834324+0000","last_became_peered":"2024-03-16T07:29:33.834324+0000","last_unstale":"2024-03-16T07:29:52.253369+0000","last_undegraded":"2024-03-16T07:29:52.253369+0000","last_fullsized":"2024-03-16T07:29:52.253369+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:06:40.607068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.264976+0000","last_change":"2024-03-16T07:29:52.262312+0000","last_active":"2024-03-16T07:29:52.264976+0000","last_peered":"2024-03-16T07:29:52.264976+0000","last_clean":"2024-03-16T07:29:52.264976+0000","last_became_active":"2024-03-16T07:29:52.262069+0000","last_became_peered":"2024-03-16T07:29:52.262069+0000","last_unstale":"2024-03-16T07:29:52.264976+0000","last_undegraded":"2024-03-16T07:29:52.264976+0000","last_fullsized":"2024-03-16T07:29:52.264976+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_clean_scrub_stamp":"2024-03-16T07:29:51.229201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:46:15.856661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":18,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.238629+0000","last_change":"2024-03-16T07:29:33.841155+0000","last_active":"2024-03-16T07:29:52.238629+0000","last_peered":"2024-03-16T07:29:52.238629+0000","last_clean":"2024-03-16T07:29:52.238629+0000","last_became_active":"2024-03-16T07:29:33.840814+0000","last_became_peered":"2024-03-16T07:29:33.840814+0000","last_unstale":"2024-03-16T07:29:52.238629+0000","last_undegraded":"2024-03-16T07:29:52.238629+0000","last_fullsized":"2024-03-16T07:29:52.238629+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:51:01.302406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.270274+0000","last_change":"2024-03-16T07:29:52.264705+0000","last_active":"2024-03-16T07:29:52.270274+0000","last_peered":"2024-03-16T07:29:52.270274+0000","last_clean":"2024-03-16T07:29:52.270274+0000","last_became_active":"2024-03-16T07:29:52.264470+0000","last_became_peered":"2024-03-16T07:29:52.264470+0000","last_unstale":"2024-03-16T07:29:52.270274+0000","last_undegraded":"2024-03-16T07:29:52.270274+0000","last_fullsized":"2024-03-16T07:29:52.270274+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_clean_scrub_stamp":"2024-03-16T07:29:51.229201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:56:10.362531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":18,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.255721+0000","last_change":"2024-03-16T07:29:33.835448+0000","last_active":"2024-03-16T07:29:52.255721+0000","last_peered":"2024-03-16T07:29:52.255721+0000","last_clean":"2024-03-16T07:29:52.255721+0000","last_became_active":"2024-03-16T07:29:33.834817+0000","last_became_peered":"2024-03-16T07:29:33.834817+0000","last_unstale":"2024-03-16T07:29:52.255721+0000","last_undegraded":"2024-03-16T07:29:52.255721+0000","last_fullsized":"2024-03-16T07:29:52.255721+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:05:33.276056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.265018+0000","last_change":"2024-03-16T07:29:52.262907+0000","last_active":"2024-03-16T07:29:52.265018+0000","last_peered":"2024-03-16T07:29:52.265018+0000","last_clean":"2024-03-16T07:29:52.265018+0000","last_became_active":"2024-03-16T07:29:52.262640+0000","last_became_peered":"2024-03-16T07:29:52.262640+0000","last_unstale":"2024-03-16T07:29:52.265018+0000","last_undegraded":"2024-03-16T07:29:52.265018+0000","last_fullsized":"2024-03-16T07:29:52.265018+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_clean_scrub_stamp":"2024-03-16T07:29:51.229201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:48:58.012856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":18,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.257380+0000","last_change":"2024-03-16T07:29:33.836688+0000","last_active":"2024-03-16T07:29:52.257380+0000","last_peered":"2024-03-16T07:29:52.257380+0000","last_clean":"2024-03-16T07:29:52.257380+0000","last_became_active":"2024-03-16T07:29:33.836439+0000","last_became_peered":"2024-03-16T07:29:33.836439+0000","last_unstale":"2024-03-16T07:29:52.257380+0000","last_undegraded":"2024-03-16T07:29:52.257380+0000","last_fullsized":"2024-03-16T07:29:52.257380+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:00:43.877183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.260369+0000","last_change":"2024-03-16T07:29:52.258059+0000","last_active":"2024-03-16T07:29:52.260369+0000","last_peered":"2024-03-16T07:29:52.260369+0000","last_clean":"2024-03-16T07:29:52.260369+0000","last_became_active":"2024-03-16T07:29:52.257801+0000","last_became_peered":"2024-03-16T07:29:52.257801+0000","last_unstale":"2024-03-16T07:29:52.260369+0000","last_undegraded":"2024-03-16T07:29:52.260369+0000","last_fullsized":"2024-03-16T07:29:52.260369+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_clean_scrub_stamp":"2024-03-16T07:29:51.229201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:07:07.657852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":18,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.256588+0000","last_change":"2024-03-16T07:29:33.831962+0000","last_active":"2024-03-16T07:29:52.256588+0000","last_peered":"2024-03-16T07:29:52.256588+0000","last_clean":"2024-03-16T07:29:52.256588+0000","last_became_active":"2024-03-16T07:29:33.831730+0000","last_became_peered":"2024-03-16T07:29:33.831730+0000","last_unstale":"2024-03-16T07:29:52.256588+0000","last_undegraded":"2024-03-16T07:29:52.256588+0000","last_fullsized":"2024-03-16T07:29:52.256588+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:44:31.524367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.269357+0000","last_change":"2024-03-16T07:29:52.265252+0000","last_active":"2024-03-16T07:29:52.269357+0000","last_peered":"2024-03-16T07:29:52.269357+0000","last_clean":"2024-03-16T07:29:52.269357+0000","last_became_active":"2024-03-16T07:29:52.264105+0000","last_became_peered":"2024-03-16T07:29:52.264105+0000","last_unstale":"2024-03-16T07:29:52.269357+0000","last_undegraded":"2024-03-16T07:29:52.269357+0000","last_fullsized":"2024-03-16T07:29:52.269357+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_clean_scrub_stamp":"2024-03-16T07:29:51.229201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:26:55.625129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":18,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.253726+0000","last_change":"2024-03-16T07:29:33.826162+0000","last_active":"2024-03-16T07:29:52.253726+0000","last_peered":"2024-03-16T07:29:52.253726+0000","last_clean":"2024-03-16T07:29:52.253726+0000","last_became_active":"2024-03-16T07:29:33.825696+0000","last_became_peered":"2024-03-16T07:29:33.825696+0000","last_unstale":"2024-03-16T07:29:52.253726+0000","last_undegraded":"2024-03-16T07:29:52.253726+0000","last_fullsized":"2024-03-16T07:29:52.253726+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:28:45.230768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.267696+0000","last_change":"2024-03-16T07:29:52.263627+0000","last_active":"2024-03-16T07:29:52.267696+0000","last_peered":"2024-03-16T07:29:52.267696+0000","last_clean":"2024-03-16T07:29:52.267696+0000","last_became_active":"2024-03-16T07:29:52.263242+0000","last_became_peered":"2024-03-16T07:29:52.263242+0000","last_unstale":"2024-03-16T07:29:52.267696+0000","last_undegraded":"2024-03-16T07:29:52.267696+0000","last_fullsized":"2024-03-16T07:29:52.267696+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_clean_scrub_stamp":"2024-03-16T07:29:51.229201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:04:02.778503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":18,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.258451+0000","last_change":"2024-03-16T07:29:33.835797+0000","last_active":"2024-03-16T07:29:52.258451+0000","last_peered":"2024-03-16T07:29:52.258451+0000","last_clean":"2024-03-16T07:29:52.258451+0000","last_became_active":"2024-03-16T07:29:33.835556+0000","last_became_peered":"2024-03-16T07:29:33.835556+0000","last_unstale":"2024-03-16T07:29:52.258451+0000","last_undegraded":"2024-03-16T07:29:52.258451+0000","last_fullsized":"2024-03-16T07:29:52.258451+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:42:44.865750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.267744+0000","last_change":"2024-03-16T07:29:52.264325+0000","last_active":"2024-03-16T07:29:52.267744+0000","last_peered":"2024-03-16T07:29:52.267744+0000","last_clean":"2024-03-16T07:29:52.267744+0000","last_became_active":"2024-03-16T07:29:52.264031+0000","last_became_peered":"2024-03-16T07:29:52.264031+0000","last_unstale":"2024-03-16T07:29:52.267744+0000","last_undegraded":"2024-03-16T07:29:52.267744+0000","last_fullsized":"2024-03-16T07:29:52.267744+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_clean_scrub_stamp":"2024-03-16T07:29:51.229201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:08:48.854030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":18,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.249165+0000","last_change":"2024-03-16T07:29:33.833025+0000","last_active":"2024-03-16T07:29:52.249165+0000","last_peered":"2024-03-16T07:29:52.249165+0000","last_clean":"2024-03-16T07:29:52.249165+0000","last_became_active":"2024-03-16T07:29:33.832508+0000","last_became_peered":"2024-03-16T07:29:33.832508+0000","last_unstale":"2024-03-16T07:29:52.249165+0000","last_undegraded":"2024-03-16T07:29:52.249165+0000","last_fullsized":"2024-03-16T07:29:52.249165+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:48:56.092113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.279263+0000","last_change":"2024-03-16T07:29:52.278260+0000","last_active":"2024-03-16T07:29:52.279263+0000","last_peered":"2024-03-16T07:29:52.279263+0000","last_clean":"2024-03-16T07:29:52.279263+0000","last_became_active":"2024-03-16T07:29:52.275947+0000","last_became_peered":"2024-03-16T07:29:52.275947+0000","last_unstale":"2024-03-16T07:29:52.279263+0000","last_undegraded":"2024-03-16T07:29:52.279263+0000","last_fullsized":"2024-03-16T07:29:52.279263+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_clean_scrub_stamp":"2024-03-16T07:29:51.229201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:45:47.196926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":18,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.238756+0000","last_change":"2024-03-16T07:29:33.830404+0000","last_active":"2024-03-16T07:29:52.238756+0000","last_peered":"2024-03-16T07:29:52.238756+0000","last_clean":"2024-03-16T07:29:52.238756+0000","last_became_active":"2024-03-16T07:29:33.830174+0000","last_became_peered":"2024-03-16T07:29:33.830174+0000","last_unstale":"2024-03-16T07:29:52.238756+0000","last_undegraded":"2024-03-16T07:29:52.238756+0000","last_fullsized":"2024-03-16T07:29:52.238756+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:41:12.198698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.272814+0000","last_change":"2024-03-16T07:29:52.265876+0000","last_active":"2024-03-16T07:29:52.272814+0000","last_peered":"2024-03-16T07:29:52.272814+0000","last_clean":"2024-03-16T07:29:52.272814+0000","last_became_active":"2024-03-16T07:29:52.265363+0000","last_became_peered":"2024-03-16T07:29:52.265363+0000","last_unstale":"2024-03-16T07:29:52.272814+0000","last_undegraded":"2024-03-16T07:29:52.272814+0000","last_fullsized":"2024-03-16T07:29:52.272814+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_clean_scrub_stamp":"2024-03-16T07:29:51.229201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:33:10.764721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":18,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.245984+0000","last_change":"2024-03-16T07:29:33.834147+0000","last_active":"2024-03-16T07:29:52.245984+0000","last_peered":"2024-03-16T07:29:52.245984+0000","last_clean":"2024-03-16T07:29:52.245984+0000","last_became_active":"2024-03-16T07:29:33.833703+0000","last_became_peered":"2024-03-16T07:29:33.833703+0000","last_unstale":"2024-03-16T07:29:52.245984+0000","last_undegraded":"2024-03-16T07:29:52.245984+0000","last_fullsized":"2024-03-16T07:29:52.245984+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:54:08.885808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.282069+0000","last_change":"2024-03-16T07:29:52.281574+0000","last_active":"2024-03-16T07:29:52.282069+0000","last_peered":"2024-03-16T07:29:52.282069+0000","last_clean":"2024-03-16T07:29:52.282069+0000","last_became_active":"2024-03-16T07:29:52.281322+0000","last_became_peered":"2024-03-16T07:29:52.281322+0000","last_unstale":"2024-03-16T07:29:52.282069+0000","last_undegraded":"2024-03-16T07:29:52.282069+0000","last_fullsized":"2024-03-16T07:29:52.282069+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_clean_scrub_stamp":"2024-03-16T07:29:51.229201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:05:53.362432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":18,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.247768+0000","last_change":"2024-03-16T07:29:33.834992+0000","last_active":"2024-03-16T07:29:52.247768+0000","last_peered":"2024-03-16T07:29:52.247768+0000","last_clean":"2024-03-16T07:29:52.247768+0000","last_became_active":"2024-03-16T07:29:33.834758+0000","last_became_peered":"2024-03-16T07:29:33.834758+0000","last_unstale":"2024-03-16T07:29:52.247768+0000","last_undegraded":"2024-03-16T07:29:52.247768+0000","last_fullsized":"2024-03-16T07:29:52.247768+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:32:15.280635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.274998+0000","last_change":"2024-03-16T07:29:52.273634+0000","last_active":"2024-03-16T07:29:52.274998+0000","last_peered":"2024-03-16T07:29:52.274998+0000","last_clean":"2024-03-16T07:29:52.274998+0000","last_became_active":"2024-03-16T07:29:52.273401+0000","last_became_peered":"2024-03-16T07:29:52.273401+0000","last_unstale":"2024-03-16T07:29:52.274998+0000","last_undegraded":"2024-03-16T07:29:52.274998+0000","last_fullsized":"2024-03-16T07:29:52.274998+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_clean_scrub_stamp":"2024-03-16T07:29:51.229201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:41:53.607140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":18,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.241002+0000","last_change":"2024-03-16T07:29:33.841057+0000","last_active":"2024-03-16T07:29:52.241002+0000","last_peered":"2024-03-16T07:29:52.241002+0000","last_clean":"2024-03-16T07:29:52.241002+0000","last_became_active":"2024-03-16T07:29:33.840691+0000","last_became_peered":"2024-03-16T07:29:33.840691+0000","last_unstale":"2024-03-16T07:29:52.241002+0000","last_undegraded":"2024-03-16T07:29:52.241002+0000","last_fullsized":"2024-03-16T07:29:52.241002+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:18:02.038888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.265036+0000","last_change":"2024-03-16T07:29:52.262169+0000","last_active":"2024-03-16T07:29:52.265036+0000","last_peered":"2024-03-16T07:29:52.265036+0000","last_clean":"2024-03-16T07:29:52.265036+0000","last_became_active":"2024-03-16T07:29:52.261934+0000","last_became_peered":"2024-03-16T07:29:52.261934+0000","last_unstale":"2024-03-16T07:29:52.265036+0000","last_undegraded":"2024-03-16T07:29:52.265036+0000","last_fullsized":"2024-03-16T07:29:52.265036+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_clean_scrub_stamp":"2024-03-16T07:29:51.229201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:20:02.125493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":18,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.256816+0000","last_change":"2024-03-16T07:29:33.835192+0000","last_active":"2024-03-16T07:29:52.256816+0000","last_peered":"2024-03-16T07:29:52.256816+0000","last_clean":"2024-03-16T07:29:52.256816+0000","last_became_active":"2024-03-16T07:29:33.834934+0000","last_became_peered":"2024-03-16T07:29:33.834934+0000","last_unstale":"2024-03-16T07:29:52.256816+0000","last_undegraded":"2024-03-16T07:29:52.256816+0000","last_fullsized":"2024-03-16T07:29:52.256816+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:26:32.824858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.269334+0000","last_change":"2024-03-16T07:29:52.264683+0000","last_active":"2024-03-16T07:29:52.269334+0000","last_peered":"2024-03-16T07:29:52.269334+0000","last_clean":"2024-03-16T07:29:52.269334+0000","last_became_active":"2024-03-16T07:29:52.263776+0000","last_became_peered":"2024-03-16T07:29:52.263776+0000","last_unstale":"2024-03-16T07:29:52.269334+0000","last_undegraded":"2024-03-16T07:29:52.269334+0000","last_fullsized":"2024-03-16T07:29:52.269334+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_clean_scrub_stamp":"2024-03-16T07:29:51.229201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:24:27.553640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":18,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.241686+0000","last_change":"2024-03-16T07:29:33.837983+0000","last_active":"2024-03-16T07:29:52.241686+0000","last_peered":"2024-03-16T07:29:52.241686+0000","last_clean":"2024-03-16T07:29:52.241686+0000","last_became_active":"2024-03-16T07:29:33.837496+0000","last_became_peered":"2024-03-16T07:29:33.837496+0000","last_unstale":"2024-03-16T07:29:52.241686+0000","last_undegraded":"2024-03-16T07:29:52.241686+0000","last_fullsized":"2024-03-16T07:29:52.241686+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:53:25.642839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.272477+0000","last_change":"2024-03-16T07:29:52.269931+0000","last_active":"2024-03-16T07:29:52.272477+0000","last_peered":"2024-03-16T07:29:52.272477+0000","last_clean":"2024-03-16T07:29:52.272477+0000","last_became_active":"2024-03-16T07:29:52.269686+0000","last_became_peered":"2024-03-16T07:29:52.269686+0000","last_unstale":"2024-03-16T07:29:52.272477+0000","last_undegraded":"2024-03-16T07:29:52.272477+0000","last_fullsized":"2024-03-16T07:29:52.272477+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_clean_scrub_stamp":"2024-03-16T07:29:51.229201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:37:39.294970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":18,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.241058+0000","last_change":"2024-03-16T07:29:33.838573+0000","last_active":"2024-03-16T07:29:52.241058+0000","last_peered":"2024-03-16T07:29:52.241058+0000","last_clean":"2024-03-16T07:29:52.241058+0000","last_became_active":"2024-03-16T07:29:33.837752+0000","last_became_peered":"2024-03-16T07:29:33.837752+0000","last_unstale":"2024-03-16T07:29:52.241058+0000","last_undegraded":"2024-03-16T07:29:52.241058+0000","last_fullsized":"2024-03-16T07:29:52.241058+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:41:10.081251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.260371+0000","last_change":"2024-03-16T07:29:52.259189+0000","last_active":"2024-03-16T07:29:52.260371+0000","last_peered":"2024-03-16T07:29:52.260371+0000","last_clean":"2024-03-16T07:29:52.260371+0000","last_became_active":"2024-03-16T07:29:52.258968+0000","last_became_peered":"2024-03-16T07:29:52.258968+0000","last_unstale":"2024-03-16T07:29:52.260371+0000","last_undegraded":"2024-03-16T07:29:52.260371+0000","last_fullsized":"2024-03-16T07:29:52.260371+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_clean_scrub_stamp":"2024-03-16T07:29:51.229201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:16:48.874856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":18,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.249263+0000","last_change":"2024-03-16T07:29:33.832836+0000","last_active":"2024-03-16T07:29:52.249263+0000","last_peered":"2024-03-16T07:29:52.249263+0000","last_clean":"2024-03-16T07:29:52.249263+0000","last_became_active":"2024-03-16T07:29:33.832354+0000","last_became_peered":"2024-03-16T07:29:33.832354+0000","last_unstale":"2024-03-16T07:29:52.249263+0000","last_undegraded":"2024-03-16T07:29:52.249263+0000","last_fullsized":"2024-03-16T07:29:52.249263+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:09:01.072871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.285642+0000","last_change":"2024-03-16T07:29:52.285066+0000","last_active":"2024-03-16T07:29:52.285642+0000","last_peered":"2024-03-16T07:29:52.285642+0000","last_clean":"2024-03-16T07:29:52.285642+0000","last_became_active":"2024-03-16T07:29:52.284676+0000","last_became_peered":"2024-03-16T07:29:52.284676+0000","last_unstale":"2024-03-16T07:29:52.285642+0000","last_undegraded":"2024-03-16T07:29:52.285642+0000","last_fullsized":"2024-03-16T07:29:52.285642+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_clean_scrub_stamp":"2024-03-16T07:29:51.229201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:53:45.532905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":18,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.238862+0000","last_change":"2024-03-16T07:29:33.830827+0000","last_active":"2024-03-16T07:29:52.238862+0000","last_peered":"2024-03-16T07:29:52.238862+0000","last_clean":"2024-03-16T07:29:52.238862+0000","last_became_active":"2024-03-16T07:29:33.829553+0000","last_became_peered":"2024-03-16T07:29:33.829553+0000","last_unstale":"2024-03-16T07:29:52.238862+0000","last_undegraded":"2024-03-16T07:29:52.238862+0000","last_fullsized":"2024-03-16T07:29:52.238862+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:47:12.171754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.276047+0000","last_change":"2024-03-16T07:29:52.274502+0000","last_active":"2024-03-16T07:29:52.276047+0000","last_peered":"2024-03-16T07:29:52.276047+0000","last_clean":"2024-03-16T07:29:52.276047+0000","last_became_active":"2024-03-16T07:29:52.274219+0000","last_became_peered":"2024-03-16T07:29:52.274219+0000","last_unstale":"2024-03-16T07:29:52.276047+0000","last_undegraded":"2024-03-16T07:29:52.276047+0000","last_fullsized":"2024-03-16T07:29:52.276047+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_clean_scrub_stamp":"2024-03-16T07:29:51.229201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:24:27.553640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":18,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.250743+0000","last_change":"2024-03-16T07:29:33.826298+0000","last_active":"2024-03-16T07:29:52.250743+0000","last_peered":"2024-03-16T07:29:52.250743+0000","last_clean":"2024-03-16T07:29:52.250743+0000","last_became_active":"2024-03-16T07:29:33.826047+0000","last_became_peered":"2024-03-16T07:29:33.826047+0000","last_unstale":"2024-03-16T07:29:52.250743+0000","last_undegraded":"2024-03-16T07:29:52.250743+0000","last_fullsized":"2024-03-16T07:29:52.250743+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:53:30.099446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.271241+0000","last_change":"2024-03-16T07:29:52.269439+0000","last_active":"2024-03-16T07:29:52.271241+0000","last_peered":"2024-03-16T07:29:52.271241+0000","last_clean":"2024-03-16T07:29:52.271241+0000","last_became_active":"2024-03-16T07:29:52.269223+0000","last_became_peered":"2024-03-16T07:29:52.269223+0000","last_unstale":"2024-03-16T07:29:52.271241+0000","last_undegraded":"2024-03-16T07:29:52.271241+0000","last_fullsized":"2024-03-16T07:29:52.271241+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_clean_scrub_stamp":"2024-03-16T07:29:51.229201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:48:58.012856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.1d","version":"99'2","reported_seq":14,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.286620+0000","last_change":"2024-03-16T07:29:51.257576+0000","last_active":"2024-03-16T07:29:52.286620+0000","last_peered":"2024-03-16T07:29:52.286620+0000","last_clean":"2024-03-16T07:29:52.286620+0000","last_became_active":"2024-03-16T07:29:51.257341+0000","last_became_peered":"2024-03-16T07:29:51.257341+0000","last_unstale":"2024-03-16T07:29:52.286620+0000","last_undegraded":"2024-03-16T07:29:52.286620+0000","last_fullsized":"2024-03-16T07:29:52.286620+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:50.226649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:50.226649+0000","last_clean_scrub_stamp":"2024-03-16T07:29:50.226649+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:01:26.573221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":18,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.257528+0000","last_change":"2024-03-16T07:29:33.826129+0000","last_active":"2024-03-16T07:29:52.257528+0000","last_peered":"2024-03-16T07:29:52.257528+0000","last_clean":"2024-03-16T07:29:52.257528+0000","last_became_active":"2024-03-16T07:29:33.825871+0000","last_became_peered":"2024-03-16T07:29:33.825871+0000","last_unstale":"2024-03-16T07:29:52.257528+0000","last_undegraded":"2024-03-16T07:29:52.257528+0000","last_fullsized":"2024-03-16T07:29:52.257528+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:54:08.885808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"95'4","reported_seq":24,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.244087+0000","last_change":"2024-03-16T07:29:33.142157+0000","last_active":"2024-03-16T07:29:52.244087+0000","last_peered":"2024-03-16T07:29:52.244087+0000","last_clean":"2024-03-16T07:29:52.244087+0000","last_became_active":"2024-03-16T07:29:33.141750+0000","last_became_peered":"2024-03-16T07:29:33.141750+0000","last_unstale":"2024-03-16T07:29:52.244087+0000","last_undegraded":"2024-03-16T07:29:52.244087+0000","last_fullsized":"2024-03-16T07:29:52.244087+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:15:22.486053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.278643+0000","last_change":"2024-03-16T07:29:52.268771+0000","last_active":"2024-03-16T07:29:52.278643+0000","last_peered":"2024-03-16T07:29:52.278643+0000","last_clean":"2024-03-16T07:29:52.278643+0000","last_became_active":"2024-03-16T07:29:52.268539+0000","last_became_peered":"2024-03-16T07:29:52.268539+0000","last_unstale":"2024-03-16T07:29:52.278643+0000","last_undegraded":"2024-03-16T07:29:52.278643+0000","last_fullsized":"2024-03-16T07:29:52.278643+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_clean_scrub_stamp":"2024-03-16T07:29:51.229201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:24:31.348860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1c","version":"99'2","reported_seq":14,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.281166+0000","last_change":"2024-03-16T07:29:51.251898+0000","last_active":"2024-03-16T07:29:52.281166+0000","last_peered":"2024-03-16T07:29:52.281166+0000","last_clean":"2024-03-16T07:29:52.281166+0000","last_became_active":"2024-03-16T07:29:51.251630+0000","last_became_peered":"2024-03-16T07:29:51.251630+0000","last_unstale":"2024-03-16T07:29:52.281166+0000","last_undegraded":"2024-03-16T07:29:52.281166+0000","last_fullsized":"2024-03-16T07:29:52.281166+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:50.226649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:50.226649+0000","last_clean_scrub_stamp":"2024-03-16T07:29:50.226649+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:02:09.604872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":18,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.243926+0000","last_change":"2024-03-16T07:29:33.829851+0000","last_active":"2024-03-16T07:29:52.243926+0000","last_peered":"2024-03-16T07:29:52.243926+0000","last_clean":"2024-03-16T07:29:52.243926+0000","last_became_active":"2024-03-16T07:29:33.829620+0000","last_became_peered":"2024-03-16T07:29:33.829620+0000","last_unstale":"2024-03-16T07:29:52.243926+0000","last_undegraded":"2024-03-16T07:29:52.243926+0000","last_fullsized":"2024-03-16T07:29:52.243926+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:03:47.150413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1e","version":"95'1","reported_seq":21,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.249025+0000","last_change":"2024-03-16T07:29:33.144641+0000","last_active":"2024-03-16T07:29:52.249025+0000","last_peered":"2024-03-16T07:29:52.249025+0000","last_clean":"2024-03-16T07:29:52.249025+0000","last_became_active":"2024-03-16T07:29:33.144370+0000","last_became_peered":"2024-03-16T07:29:33.144370+0000","last_unstale":"2024-03-16T07:29:52.249025+0000","last_undegraded":"2024-03-16T07:29:52.249025+0000","last_fullsized":"2024-03-16T07:29:52.249025+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:02:47.297486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.270806+0000","last_change":"2024-03-16T07:29:52.264996+0000","last_active":"2024-03-16T07:29:52.270806+0000","last_peered":"2024-03-16T07:29:52.270806+0000","last_clean":"2024-03-16T07:29:52.270806+0000","last_became_active":"2024-03-16T07:29:52.264787+0000","last_became_peered":"2024-03-16T07:29:52.264787+0000","last_unstale":"2024-03-16T07:29:52.270806+0000","last_undegraded":"2024-03-16T07:29:52.270806+0000","last_fullsized":"2024-03-16T07:29:52.270806+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_clean_scrub_stamp":"2024-03-16T07:29:51.229201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:14:51.568780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1f","version":"99'4","reported_seq":16,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.282222+0000","last_change":"2024-03-16T07:29:51.260281+0000","last_active":"2024-03-16T07:29:52.282222+0000","last_peered":"2024-03-16T07:29:52.282222+0000","last_clean":"2024-03-16T07:29:52.282222+0000","last_became_active":"2024-03-16T07:29:51.259902+0000","last_became_peered":"2024-03-16T07:29:51.259902+0000","last_unstale":"2024-03-16T07:29:52.282222+0000","last_undegraded":"2024-03-16T07:29:52.282222+0000","last_fullsized":"2024-03-16T07:29:52.282222+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:50.226649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:50.226649+0000","last_clean_scrub_stamp":"2024-03-16T07:29:50.226649+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:48:53.149886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":18,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.253810+0000","last_change":"2024-03-16T07:29:33.836419+0000","last_active":"2024-03-16T07:29:52.253810+0000","last_peered":"2024-03-16T07:29:52.253810+0000","last_clean":"2024-03-16T07:29:52.253810+0000","last_became_active":"2024-03-16T07:29:33.836160+0000","last_became_peered":"2024-03-16T07:29:33.836160+0000","last_unstale":"2024-03-16T07:29:52.253810+0000","last_undegraded":"2024-03-16T07:29:52.253810+0000","last_fullsized":"2024-03-16T07:29:52.253810+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:26:07.664599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1d","version":"95'2","reported_seq":22,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.248658+0000","last_change":"2024-03-16T07:29:33.145140+0000","last_active":"2024-03-16T07:29:52.248658+0000","last_peered":"2024-03-16T07:29:52.248658+0000","last_clean":"2024-03-16T07:29:52.248658+0000","last_became_active":"2024-03-16T07:29:33.144891+0000","last_became_peered":"2024-03-16T07:29:33.144891+0000","last_unstale":"2024-03-16T07:29:52.248658+0000","last_undegraded":"2024-03-16T07:29:52.248658+0000","last_fullsized":"2024-03-16T07:29:52.248658+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:04:47.579175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.279814+0000","last_change":"2024-03-16T07:29:52.277026+0000","last_active":"2024-03-16T07:29:52.279814+0000","last_peered":"2024-03-16T07:29:52.279814+0000","last_clean":"2024-03-16T07:29:52.279814+0000","last_became_active":"2024-03-16T07:29:52.275898+0000","last_became_peered":"2024-03-16T07:29:52.275898+0000","last_unstale":"2024-03-16T07:29:52.279814+0000","last_undegraded":"2024-03-16T07:29:52.279814+0000","last_fullsized":"2024-03-16T07:29:52.279814+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_clean_scrub_stamp":"2024-03-16T07:29:51.229201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:06:00.586416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.1e","version":"99'1","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.280368+0000","last_change":"2024-03-16T07:29:51.255225+0000","last_active":"2024-03-16T07:29:52.280368+0000","last_peered":"2024-03-16T07:29:52.280368+0000","last_clean":"2024-03-16T07:29:52.280368+0000","last_became_active":"2024-03-16T07:29:51.255000+0000","last_became_peered":"2024-03-16T07:29:51.255000+0000","last_unstale":"2024-03-16T07:29:52.280368+0000","last_undegraded":"2024-03-16T07:29:52.280368+0000","last_fullsized":"2024-03-16T07:29:52.280368+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:50.226649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:50.226649+0000","last_clean_scrub_stamp":"2024-03-16T07:29:50.226649+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:15:40.589606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":18,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.256902+0000","last_change":"2024-03-16T07:29:33.828184+0000","last_active":"2024-03-16T07:29:52.256902+0000","last_peered":"2024-03-16T07:29:52.256902+0000","last_clean":"2024-03-16T07:29:52.256902+0000","last_became_active":"2024-03-16T07:29:33.827955+0000","last_became_peered":"2024-03-16T07:29:33.827955+0000","last_unstale":"2024-03-16T07:29:52.256902+0000","last_undegraded":"2024-03-16T07:29:52.256902+0000","last_fullsized":"2024-03-16T07:29:52.256902+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:20:59.190114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"95'2","reported_seq":22,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.252714+0000","last_change":"2024-03-16T07:29:33.143477+0000","last_active":"2024-03-16T07:29:52.252714+0000","last_peered":"2024-03-16T07:29:52.252714+0000","last_clean":"2024-03-16T07:29:52.252714+0000","last_became_active":"2024-03-16T07:29:33.143221+0000","last_became_peered":"2024-03-16T07:29:33.143221+0000","last_unstale":"2024-03-16T07:29:52.252714+0000","last_undegraded":"2024-03-16T07:29:52.252714+0000","last_fullsized":"2024-03-16T07:29:52.252714+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:39:36.137228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.273601+0000","last_change":"2024-03-16T07:29:52.265707+0000","last_active":"2024-03-16T07:29:52.273601+0000","last_peered":"2024-03-16T07:29:52.273601+0000","last_clean":"2024-03-16T07:29:52.273601+0000","last_became_active":"2024-03-16T07:29:52.265407+0000","last_became_peered":"2024-03-16T07:29:52.265407+0000","last_unstale":"2024-03-16T07:29:52.273601+0000","last_undegraded":"2024-03-16T07:29:52.273601+0000","last_fullsized":"2024-03-16T07:29:52.273601+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_clean_scrub_stamp":"2024-03-16T07:29:51.229201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:09:09.632224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.238717+0000","last_change":"2024-03-16T07:29:51.246676+0000","last_active":"2024-03-16T07:29:52.238717+0000","last_peered":"2024-03-16T07:29:52.238717+0000","last_clean":"2024-03-16T07:29:52.238717+0000","last_became_active":"2024-03-16T07:29:51.246420+0000","last_became_peered":"2024-03-16T07:29:51.246420+0000","last_unstale":"2024-03-16T07:29:52.238717+0000","last_undegraded":"2024-03-16T07:29:52.238717+0000","last_fullsized":"2024-03-16T07:29:52.238717+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:50.226649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:50.226649+0000","last_clean_scrub_stamp":"2024-03-16T07:29:50.226649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:55:24.899384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":18,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.239935+0000","last_change":"2024-03-16T07:29:33.839989+0000","last_active":"2024-03-16T07:29:52.239935+0000","last_peered":"2024-03-16T07:29:52.239935+0000","last_clean":"2024-03-16T07:29:52.239935+0000","last_became_active":"2024-03-16T07:29:33.839759+0000","last_became_peered":"2024-03-16T07:29:33.839759+0000","last_unstale":"2024-03-16T07:29:52.239935+0000","last_undegraded":"2024-03-16T07:29:52.239935+0000","last_fullsized":"2024-03-16T07:29:52.239935+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:46:33.756833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1b","version":"95'1","reported_seq":21,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.245445+0000","last_change":"2024-03-16T07:29:33.151173+0000","last_active":"2024-03-16T07:29:52.245445+0000","last_peered":"2024-03-16T07:29:52.245445+0000","last_clean":"2024-03-16T07:29:52.245445+0000","last_became_active":"2024-03-16T07:29:33.150934+0000","last_became_peered":"2024-03-16T07:29:33.150934+0000","last_unstale":"2024-03-16T07:29:52.245445+0000","last_undegraded":"2024-03-16T07:29:52.245445+0000","last_fullsized":"2024-03-16T07:29:52.245445+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:35:30.259942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.259880+0000","last_change":"2024-03-16T07:29:52.257876+0000","last_active":"2024-03-16T07:29:52.259880+0000","last_peered":"2024-03-16T07:29:52.259880+0000","last_clean":"2024-03-16T07:29:52.259880+0000","last_became_active":"2024-03-16T07:29:52.257637+0000","last_became_peered":"2024-03-16T07:29:52.257637+0000","last_unstale":"2024-03-16T07:29:52.259880+0000","last_undegraded":"2024-03-16T07:29:52.259880+0000","last_fullsized":"2024-03-16T07:29:52.259880+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_clean_scrub_stamp":"2024-03-16T07:29:51.229201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:48:54.152438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.250574+0000","last_change":"2024-03-16T07:29:51.252555+0000","last_active":"2024-03-16T07:29:52.250574+0000","last_peered":"2024-03-16T07:29:52.250574+0000","last_clean":"2024-03-16T07:29:52.250574+0000","last_became_active":"2024-03-16T07:29:51.252307+0000","last_became_peered":"2024-03-16T07:29:51.252307+0000","last_unstale":"2024-03-16T07:29:52.250574+0000","last_undegraded":"2024-03-16T07:29:52.250574+0000","last_fullsized":"2024-03-16T07:29:52.250574+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:50.226649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:50.226649+0000","last_clean_scrub_stamp":"2024-03-16T07:29:50.226649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:01:24.897707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":18,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.242918+0000","last_change":"2024-03-16T07:29:33.838441+0000","last_active":"2024-03-16T07:29:52.242918+0000","last_peered":"2024-03-16T07:29:52.242918+0000","last_clean":"2024-03-16T07:29:52.242918+0000","last_became_active":"2024-03-16T07:29:33.837425+0000","last_became_peered":"2024-03-16T07:29:33.837425+0000","last_unstale":"2024-03-16T07:29:52.242918+0000","last_undegraded":"2024-03-16T07:29:52.242918+0000","last_fullsized":"2024-03-16T07:29:52.242918+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:44:16.567702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"95'1","reported_seq":21,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.252060+0000","last_change":"2024-03-16T07:29:33.152347+0000","last_active":"2024-03-16T07:29:52.252060+0000","last_peered":"2024-03-16T07:29:52.252060+0000","last_clean":"2024-03-16T07:29:52.252060+0000","last_became_active":"2024-03-16T07:29:33.152108+0000","last_became_peered":"2024-03-16T07:29:33.152108+0000","last_unstale":"2024-03-16T07:29:52.252060+0000","last_undegraded":"2024-03-16T07:29:52.252060+0000","last_fullsized":"2024-03-16T07:29:52.252060+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:48:09.351303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.271201+0000","last_change":"2024-03-16T07:29:52.267375+0000","last_active":"2024-03-16T07:29:52.271201+0000","last_peered":"2024-03-16T07:29:52.271201+0000","last_clean":"2024-03-16T07:29:52.271201+0000","last_became_active":"2024-03-16T07:29:52.267150+0000","last_became_peered":"2024-03-16T07:29:52.267150+0000","last_unstale":"2024-03-16T07:29:52.271201+0000","last_undegraded":"2024-03-16T07:29:52.271201+0000","last_fullsized":"2024-03-16T07:29:52.271201+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_clean_scrub_stamp":"2024-03-16T07:29:51.229201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:46:15.856661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.1b","version":"99'1","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.282660+0000","last_change":"2024-03-16T07:29:51.258990+0000","last_active":"2024-03-16T07:29:52.282660+0000","last_peered":"2024-03-16T07:29:52.282660+0000","last_clean":"2024-03-16T07:29:52.282660+0000","last_became_active":"2024-03-16T07:29:51.258321+0000","last_became_peered":"2024-03-16T07:29:51.258321+0000","last_unstale":"2024-03-16T07:29:52.282660+0000","last_undegraded":"2024-03-16T07:29:52.282660+0000","last_fullsized":"2024-03-16T07:29:52.282660+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:50.226649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:50.226649+0000","last_clean_scrub_stamp":"2024-03-16T07:29:50.226649+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:04:50.357548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":18,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.239241+0000","last_change":"2024-03-16T07:29:33.841426+0000","last_active":"2024-03-16T07:29:52.239241+0000","last_peered":"2024-03-16T07:29:52.239241+0000","last_clean":"2024-03-16T07:29:52.239241+0000","last_became_active":"2024-03-16T07:29:33.841098+0000","last_became_peered":"2024-03-16T07:29:33.841098+0000","last_unstale":"2024-03-16T07:29:52.239241+0000","last_undegraded":"2024-03-16T07:29:52.239241+0000","last_fullsized":"2024-03-16T07:29:52.239241+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:11:40.760659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":20,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.253770+0000","last_change":"2024-03-16T07:29:33.149360+0000","last_active":"2024-03-16T07:29:52.253770+0000","last_peered":"2024-03-16T07:29:52.253770+0000","last_clean":"2024-03-16T07:29:52.253770+0000","last_became_active":"2024-03-16T07:29:33.148940+0000","last_became_peered":"2024-03-16T07:29:33.148940+0000","last_unstale":"2024-03-16T07:29:52.253770+0000","last_undegraded":"2024-03-16T07:29:52.253770+0000","last_fullsized":"2024-03-16T07:29:52.253770+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:25:34.455727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.279676+0000","last_change":"2024-03-16T07:29:52.278905+0000","last_active":"2024-03-16T07:29:52.279676+0000","last_peered":"2024-03-16T07:29:52.279676+0000","last_clean":"2024-03-16T07:29:52.279676+0000","last_became_active":"2024-03-16T07:29:52.278661+0000","last_became_peered":"2024-03-16T07:29:52.278661+0000","last_unstale":"2024-03-16T07:29:52.279676+0000","last_undegraded":"2024-03-16T07:29:52.279676+0000","last_fullsized":"2024-03-16T07:29:52.279676+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_clean_scrub_stamp":"2024-03-16T07:29:51.229201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:11:21.869661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"99'1","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.272743+0000","last_change":"2024-03-16T07:29:51.255282+0000","last_active":"2024-03-16T07:29:52.272743+0000","last_peered":"2024-03-16T07:29:52.272743+0000","last_clean":"2024-03-16T07:29:52.272743+0000","last_became_active":"2024-03-16T07:29:51.255036+0000","last_became_peered":"2024-03-16T07:29:51.255036+0000","last_unstale":"2024-03-16T07:29:52.272743+0000","last_undegraded":"2024-03-16T07:29:52.272743+0000","last_fullsized":"2024-03-16T07:29:52.272743+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:50.226649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:50.226649+0000","last_clean_scrub_stamp":"2024-03-16T07:29:50.226649+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:43:34.943745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":18,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.253493+0000","last_change":"2024-03-16T07:29:33.827723+0000","last_active":"2024-03-16T07:29:52.253493+0000","last_peered":"2024-03-16T07:29:52.253493+0000","last_clean":"2024-03-16T07:29:52.253493+0000","last_became_active":"2024-03-16T07:29:33.827484+0000","last_became_peered":"2024-03-16T07:29:33.827484+0000","last_unstale":"2024-03-16T07:29:52.253493+0000","last_undegraded":"2024-03-16T07:29:52.253493+0000","last_fullsized":"2024-03-16T07:29:52.253493+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:36:39.935834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":20,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.238999+0000","last_change":"2024-03-16T07:29:33.147410+0000","last_active":"2024-03-16T07:29:52.238999+0000","last_peered":"2024-03-16T07:29:52.238999+0000","last_clean":"2024-03-16T07:29:52.238999+0000","last_became_active":"2024-03-16T07:29:33.146998+0000","last_became_peered":"2024-03-16T07:29:33.146998+0000","last_unstale":"2024-03-16T07:29:52.238999+0000","last_undegraded":"2024-03-16T07:29:52.238999+0000","last_fullsized":"2024-03-16T07:29:52.238999+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:24:35.197990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.276058+0000","last_change":"2024-03-16T07:29:52.268372+0000","last_active":"2024-03-16T07:29:52.276058+0000","last_peered":"2024-03-16T07:29:52.276058+0000","last_clean":"2024-03-16T07:29:52.276058+0000","last_became_active":"2024-03-16T07:29:52.265686+0000","last_became_peered":"2024-03-16T07:29:52.265686+0000","last_unstale":"2024-03-16T07:29:52.276058+0000","last_undegraded":"2024-03-16T07:29:52.276058+0000","last_fullsized":"2024-03-16T07:29:52.276058+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_clean_scrub_stamp":"2024-03-16T07:29:51.229201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:30:00.135629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.15","version":"99'3","reported_seq":15,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.281238+0000","last_change":"2024-03-16T07:29:51.261374+0000","last_active":"2024-03-16T07:29:52.281238+0000","last_peered":"2024-03-16T07:29:52.281238+0000","last_clean":"2024-03-16T07:29:52.281238+0000","last_became_active":"2024-03-16T07:29:51.261154+0000","last_became_peered":"2024-03-16T07:29:51.261154+0000","last_unstale":"2024-03-16T07:29:52.281238+0000","last_undegraded":"2024-03-16T07:29:52.281238+0000","last_fullsized":"2024-03-16T07:29:52.281238+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:50.226649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:50.226649+0000","last_clean_scrub_stamp":"2024-03-16T07:29:50.226649+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:57:24.904631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":18,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.248826+0000","last_change":"2024-03-16T07:29:33.828079+0000","last_active":"2024-03-16T07:29:52.248826+0000","last_peered":"2024-03-16T07:29:52.248826+0000","last_clean":"2024-03-16T07:29:52.248826+0000","last_became_active":"2024-03-16T07:29:33.827356+0000","last_became_peered":"2024-03-16T07:29:33.827356+0000","last_unstale":"2024-03-16T07:29:52.248826+0000","last_undegraded":"2024-03-16T07:29:52.248826+0000","last_fullsized":"2024-03-16T07:29:52.248826+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:54:56.120560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":20,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.248788+0000","last_change":"2024-03-16T07:29:33.145570+0000","last_active":"2024-03-16T07:29:52.248788+0000","last_peered":"2024-03-16T07:29:52.248788+0000","last_clean":"2024-03-16T07:29:52.248788+0000","last_became_active":"2024-03-16T07:29:33.145332+0000","last_became_peered":"2024-03-16T07:29:33.145332+0000","last_unstale":"2024-03-16T07:29:52.248788+0000","last_undegraded":"2024-03-16T07:29:52.248788+0000","last_fullsized":"2024-03-16T07:29:52.248788+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:40:36.601881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.260391+0000","last_change":"2024-03-16T07:29:52.258292+0000","last_active":"2024-03-16T07:29:52.260391+0000","last_peered":"2024-03-16T07:29:52.260391+0000","last_clean":"2024-03-16T07:29:52.260391+0000","last_became_active":"2024-03-16T07:29:52.257530+0000","last_became_peered":"2024-03-16T07:29:52.257530+0000","last_unstale":"2024-03-16T07:29:52.260391+0000","last_undegraded":"2024-03-16T07:29:52.260391+0000","last_fullsized":"2024-03-16T07:29:52.260391+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_clean_scrub_stamp":"2024-03-16T07:29:51.229201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:24:54.304095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.14","version":"99'6","reported_seq":18,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.284260+0000","last_change":"2024-03-16T07:29:51.251619+0000","last_active":"2024-03-16T07:29:52.284260+0000","last_peered":"2024-03-16T07:29:52.284260+0000","last_clean":"2024-03-16T07:29:52.284260+0000","last_became_active":"2024-03-16T07:29:51.251334+0000","last_became_peered":"2024-03-16T07:29:51.251334+0000","last_unstale":"2024-03-16T07:29:52.284260+0000","last_undegraded":"2024-03-16T07:29:52.284260+0000","last_fullsized":"2024-03-16T07:29:52.284260+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:50.226649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:50.226649+0000","last_clean_scrub_stamp":"2024-03-16T07:29:50.226649+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:00:42.189679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":18,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.247863+0000","last_change":"2024-03-16T07:29:33.834489+0000","last_active":"2024-03-16T07:29:52.247863+0000","last_peered":"2024-03-16T07:29:52.247863+0000","last_clean":"2024-03-16T07:29:52.247863+0000","last_became_active":"2024-03-16T07:29:33.833930+0000","last_became_peered":"2024-03-16T07:29:33.833930+0000","last_unstale":"2024-03-16T07:29:52.247863+0000","last_undegraded":"2024-03-16T07:29:52.247863+0000","last_fullsized":"2024-03-16T07:29:52.247863+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:03:50.654257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":20,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.249138+0000","last_change":"2024-03-16T07:29:33.145151+0000","last_active":"2024-03-16T07:29:52.249138+0000","last_peered":"2024-03-16T07:29:52.249138+0000","last_clean":"2024-03-16T07:29:52.249138+0000","last_became_active":"2024-03-16T07:29:33.144911+0000","last_became_peered":"2024-03-16T07:29:33.144911+0000","last_unstale":"2024-03-16T07:29:52.249138+0000","last_undegraded":"2024-03-16T07:29:52.249138+0000","last_fullsized":"2024-03-16T07:29:52.249138+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:03:36.227557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.279600+0000","last_change":"2024-03-16T07:29:52.275818+0000","last_active":"2024-03-16T07:29:52.279600+0000","last_peered":"2024-03-16T07:29:52.279600+0000","last_clean":"2024-03-16T07:29:52.279600+0000","last_became_active":"2024-03-16T07:29:52.275245+0000","last_became_peered":"2024-03-16T07:29:52.275245+0000","last_unstale":"2024-03-16T07:29:52.279600+0000","last_undegraded":"2024-03-16T07:29:52.279600+0000","last_fullsized":"2024-03-16T07:29:52.279600+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_clean_scrub_stamp":"2024-03-16T07:29:51.229201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:37:39.294970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.240423+0000","last_change":"2024-03-16T07:29:51.246351+0000","last_active":"2024-03-16T07:29:52.240423+0000","last_peered":"2024-03-16T07:29:52.240423+0000","last_clean":"2024-03-16T07:29:52.240423+0000","last_became_active":"2024-03-16T07:29:51.245991+0000","last_became_peered":"2024-03-16T07:29:51.245991+0000","last_unstale":"2024-03-16T07:29:52.240423+0000","last_undegraded":"2024-03-16T07:29:52.240423+0000","last_fullsized":"2024-03-16T07:29:52.240423+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:50.226649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:50.226649+0000","last_clean_scrub_stamp":"2024-03-16T07:29:50.226649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:31:30.343227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":18,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.253905+0000","last_change":"2024-03-16T07:29:33.826510+0000","last_active":"2024-03-16T07:29:52.253905+0000","last_peered":"2024-03-16T07:29:52.253905+0000","last_clean":"2024-03-16T07:29:52.253905+0000","last_became_active":"2024-03-16T07:29:33.826046+0000","last_became_peered":"2024-03-16T07:29:33.826046+0000","last_unstale":"2024-03-16T07:29:52.253905+0000","last_undegraded":"2024-03-16T07:29:52.253905+0000","last_fullsized":"2024-03-16T07:29:52.253905+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:36:53.332020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.15","version":"95'3","reported_seq":23,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.242696+0000","last_change":"2024-03-16T07:29:33.145719+0000","last_active":"2024-03-16T07:29:52.242696+0000","last_peered":"2024-03-16T07:29:52.242696+0000","last_clean":"2024-03-16T07:29:52.242696+0000","last_became_active":"2024-03-16T07:29:33.141978+0000","last_became_peered":"2024-03-16T07:29:33.141978+0000","last_unstale":"2024-03-16T07:29:52.242696+0000","last_undegraded":"2024-03-16T07:29:52.242696+0000","last_fullsized":"2024-03-16T07:29:52.242696+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:00:24.086126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.271943+0000","last_change":"2024-03-16T07:29:52.267088+0000","last_active":"2024-03-16T07:29:52.271943+0000","last_peered":"2024-03-16T07:29:52.271943+0000","last_clean":"2024-03-16T07:29:52.271943+0000","last_became_active":"2024-03-16T07:29:52.266829+0000","last_became_peered":"2024-03-16T07:29:52.266829+0000","last_unstale":"2024-03-16T07:29:52.271943+0000","last_undegraded":"2024-03-16T07:29:52.271943+0000","last_fullsized":"2024-03-16T07:29:52.271943+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_clean_scrub_stamp":"2024-03-16T07:29:51.229201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:20:02.125493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.240466+0000","last_change":"2024-03-16T07:29:51.255852+0000","last_active":"2024-03-16T07:29:52.240466+0000","last_peered":"2024-03-16T07:29:52.240466+0000","last_clean":"2024-03-16T07:29:52.240466+0000","last_became_active":"2024-03-16T07:29:51.255588+0000","last_became_peered":"2024-03-16T07:29:51.255588+0000","last_unstale":"2024-03-16T07:29:52.240466+0000","last_undegraded":"2024-03-16T07:29:52.240466+0000","last_fullsized":"2024-03-16T07:29:52.240466+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:50.226649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:50.226649+0000","last_clean_scrub_stamp":"2024-03-16T07:29:50.226649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:59:39.170816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":18,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.248555+0000","last_change":"2024-03-16T07:29:33.828756+0000","last_active":"2024-03-16T07:29:52.248555+0000","last_peered":"2024-03-16T07:29:52.248555+0000","last_clean":"2024-03-16T07:29:52.248555+0000","last_became_active":"2024-03-16T07:29:33.828504+0000","last_became_peered":"2024-03-16T07:29:33.828504+0000","last_unstale":"2024-03-16T07:29:52.248555+0000","last_undegraded":"2024-03-16T07:29:52.248555+0000","last_fullsized":"2024-03-16T07:29:52.248555+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:18:47.890723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.14","version":"96'8","reported_seq":28,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.241861+0000","last_change":"2024-03-16T07:29:33.143457+0000","last_active":"2024-03-16T07:29:52.241861+0000","last_peered":"2024-03-16T07:29:52.241861+0000","last_clean":"2024-03-16T07:29:52.241861+0000","last_became_active":"2024-03-16T07:29:33.143020+0000","last_became_peered":"2024-03-16T07:29:33.143020+0000","last_unstale":"2024-03-16T07:29:52.241861+0000","last_undegraded":"2024-03-16T07:29:52.241861+0000","last_fullsized":"2024-03-16T07:29:52.241861+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:57:06.801078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3309,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.260536+0000","last_change":"2024-03-16T07:29:52.260030+0000","last_active":"2024-03-16T07:29:52.260536+0000","last_peered":"2024-03-16T07:29:52.260536+0000","last_clean":"2024-03-16T07:29:52.260536+0000","last_became_active":"2024-03-16T07:29:52.258521+0000","last_became_peered":"2024-03-16T07:29:52.258521+0000","last_unstale":"2024-03-16T07:29:52.260536+0000","last_undegraded":"2024-03-16T07:29:52.260536+0000","last_fullsized":"2024-03-16T07:29:52.260536+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_clean_scrub_stamp":"2024-03-16T07:29:51.229201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:04:22.252526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.254065+0000","last_change":"2024-03-16T07:29:51.251721+0000","last_active":"2024-03-16T07:29:52.254065+0000","last_peered":"2024-03-16T07:29:52.254065+0000","last_clean":"2024-03-16T07:29:52.254065+0000","last_became_active":"2024-03-16T07:29:51.251494+0000","last_became_peered":"2024-03-16T07:29:51.251494+0000","last_unstale":"2024-03-16T07:29:52.254065+0000","last_undegraded":"2024-03-16T07:29:52.254065+0000","last_fullsized":"2024-03-16T07:29:52.254065+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:50.226649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:50.226649+0000","last_clean_scrub_stamp":"2024-03-16T07:29:50.226649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:35:49.442804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":18,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.251908+0000","last_change":"2024-03-16T07:29:33.832881+0000","last_active":"2024-03-16T07:29:52.251908+0000","last_peered":"2024-03-16T07:29:52.251908+0000","last_clean":"2024-03-16T07:29:52.251908+0000","last_became_active":"2024-03-16T07:29:33.832193+0000","last_became_peered":"2024-03-16T07:29:33.832193+0000","last_unstale":"2024-03-16T07:29:52.251908+0000","last_undegraded":"2024-03-16T07:29:52.251908+0000","last_fullsized":"2024-03-16T07:29:52.251908+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:59:00.106225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.13","version":"95'2","reported_seq":22,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.245547+0000","last_change":"2024-03-16T07:29:33.150475+0000","last_active":"2024-03-16T07:29:52.245547+0000","last_peered":"2024-03-16T07:29:52.245547+0000","last_clean":"2024-03-16T07:29:52.245547+0000","last_became_active":"2024-03-16T07:29:33.150220+0000","last_became_peered":"2024-03-16T07:29:33.150220+0000","last_unstale":"2024-03-16T07:29:52.245547+0000","last_undegraded":"2024-03-16T07:29:52.245547+0000","last_fullsized":"2024-03-16T07:29:52.245547+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:13:34.679310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.273031+0000","last_change":"2024-03-16T07:29:52.267975+0000","last_active":"2024-03-16T07:29:52.273031+0000","last_peered":"2024-03-16T07:29:52.273031+0000","last_clean":"2024-03-16T07:29:52.273031+0000","last_became_active":"2024-03-16T07:29:52.267585+0000","last_became_peered":"2024-03-16T07:29:52.267585+0000","last_unstale":"2024-03-16T07:29:52.273031+0000","last_undegraded":"2024-03-16T07:29:52.273031+0000","last_fullsized":"2024-03-16T07:29:52.273031+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_clean_scrub_stamp":"2024-03-16T07:29:51.229201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:46:36.232905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.10","version":"99'8","reported_seq":20,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.287380+0000","last_change":"2024-03-16T07:29:51.241850+0000","last_active":"2024-03-16T07:29:52.287380+0000","last_peered":"2024-03-16T07:29:52.287380+0000","last_clean":"2024-03-16T07:29:52.287380+0000","last_became_active":"2024-03-16T07:29:51.241603+0000","last_became_peered":"2024-03-16T07:29:51.241603+0000","last_unstale":"2024-03-16T07:29:52.287380+0000","last_undegraded":"2024-03-16T07:29:52.287380+0000","last_fullsized":"2024-03-16T07:29:52.287380+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:50.226649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:50.226649+0000","last_clean_scrub_stamp":"2024-03-16T07:29:50.226649+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:20:05.631350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":18,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.243007+0000","last_change":"2024-03-16T07:29:33.838359+0000","last_active":"2024-03-16T07:29:52.243007+0000","last_peered":"2024-03-16T07:29:52.243007+0000","last_clean":"2024-03-16T07:29:52.243007+0000","last_became_active":"2024-03-16T07:29:33.837087+0000","last_became_peered":"2024-03-16T07:29:33.837087+0000","last_unstale":"2024-03-16T07:29:52.243007+0000","last_undegraded":"2024-03-16T07:29:52.243007+0000","last_fullsized":"2024-03-16T07:29:52.243007+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:48:58.147020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":20,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.247019+0000","last_change":"2024-03-16T07:29:33.144891+0000","last_active":"2024-03-16T07:29:52.247019+0000","last_peered":"2024-03-16T07:29:52.247019+0000","last_clean":"2024-03-16T07:29:52.247019+0000","last_became_active":"2024-03-16T07:29:33.144574+0000","last_became_peered":"2024-03-16T07:29:33.144574+0000","last_unstale":"2024-03-16T07:29:52.247019+0000","last_undegraded":"2024-03-16T07:29:52.247019+0000","last_fullsized":"2024-03-16T07:29:52.247019+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:31:24.149667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.285659+0000","last_change":"2024-03-16T07:29:52.285214+0000","last_active":"2024-03-16T07:29:52.285659+0000","last_peered":"2024-03-16T07:29:52.285659+0000","last_clean":"2024-03-16T07:29:52.285659+0000","last_became_active":"2024-03-16T07:29:52.284822+0000","last_became_peered":"2024-03-16T07:29:52.284822+0000","last_unstale":"2024-03-16T07:29:52.285659+0000","last_undegraded":"2024-03-16T07:29:52.285659+0000","last_fullsized":"2024-03-16T07:29:52.285659+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_clean_scrub_stamp":"2024-03-16T07:29:51.229201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:20:25.515903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.248531+0000","last_change":"2024-03-16T07:29:51.260603+0000","last_active":"2024-03-16T07:29:52.248531+0000","last_peered":"2024-03-16T07:29:52.248531+0000","last_clean":"2024-03-16T07:29:52.248531+0000","last_became_active":"2024-03-16T07:29:51.260310+0000","last_became_peered":"2024-03-16T07:29:51.260310+0000","last_unstale":"2024-03-16T07:29:52.248531+0000","last_undegraded":"2024-03-16T07:29:52.248531+0000","last_fullsized":"2024-03-16T07:29:52.248531+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:50.226649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:50.226649+0000","last_clean_scrub_stamp":"2024-03-16T07:29:50.226649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:24:53.301543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":18,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.253600+0000","last_change":"2024-03-16T07:29:33.826012+0000","last_active":"2024-03-16T07:29:52.253600+0000","last_peered":"2024-03-16T07:29:52.253600+0000","last_clean":"2024-03-16T07:29:52.253600+0000","last_became_active":"2024-03-16T07:29:33.825764+0000","last_became_peered":"2024-03-16T07:29:33.825764+0000","last_unstale":"2024-03-16T07:29:52.253600+0000","last_undegraded":"2024-03-16T07:29:52.253600+0000","last_fullsized":"2024-03-16T07:29:52.253600+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:12:38.743934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.10","version":"95'8","reported_seq":28,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.246144+0000","last_change":"2024-03-16T07:29:33.147235+0000","last_active":"2024-03-16T07:29:52.246144+0000","last_peered":"2024-03-16T07:29:52.246144+0000","last_clean":"2024-03-16T07:29:52.246144+0000","last_became_active":"2024-03-16T07:29:33.146884+0000","last_became_peered":"2024-03-16T07:29:33.146884+0000","last_unstale":"2024-03-16T07:29:52.246144+0000","last_undegraded":"2024-03-16T07:29:52.246144+0000","last_fullsized":"2024-03-16T07:29:52.246144+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:53:29.098123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.279326+0000","last_change":"2024-03-16T07:29:52.277964+0000","last_active":"2024-03-16T07:29:52.279326+0000","last_peered":"2024-03-16T07:29:52.279326+0000","last_clean":"2024-03-16T07:29:52.279326+0000","last_became_active":"2024-03-16T07:29:52.275757+0000","last_became_peered":"2024-03-16T07:29:52.275757+0000","last_unstale":"2024-03-16T07:29:52.279326+0000","last_undegraded":"2024-03-16T07:29:52.279326+0000","last_fullsized":"2024-03-16T07:29:52.279326+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_clean_scrub_stamp":"2024-03-16T07:29:51.229201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:22:02.578710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.d","version":"99'1","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.272644+0000","last_change":"2024-03-16T07:29:51.256824+0000","last_active":"2024-03-16T07:29:52.272644+0000","last_peered":"2024-03-16T07:29:52.272644+0000","last_clean":"2024-03-16T07:29:52.272644+0000","last_became_active":"2024-03-16T07:29:51.256429+0000","last_became_peered":"2024-03-16T07:29:51.256429+0000","last_unstale":"2024-03-16T07:29:52.272644+0000","last_undegraded":"2024-03-16T07:29:52.272644+0000","last_fullsized":"2024-03-16T07:29:52.272644+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:50.226649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:50.226649+0000","last_clean_scrub_stamp":"2024-03-16T07:29:50.226649+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:04:15.242366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":18,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.248925+0000","last_change":"2024-03-16T07:29:33.833822+0000","last_active":"2024-03-16T07:29:52.248925+0000","last_peered":"2024-03-16T07:29:52.248925+0000","last_clean":"2024-03-16T07:29:52.248925+0000","last_became_active":"2024-03-16T07:29:33.833492+0000","last_became_peered":"2024-03-16T07:29:33.833492+0000","last_unstale":"2024-03-16T07:29:52.248925+0000","last_undegraded":"2024-03-16T07:29:52.248925+0000","last_fullsized":"2024-03-16T07:29:52.248925+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:44:43.786263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"95'1","reported_seq":21,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.244183+0000","last_change":"2024-03-16T07:29:33.142821+0000","last_active":"2024-03-16T07:29:52.244183+0000","last_peered":"2024-03-16T07:29:52.244183+0000","last_clean":"2024-03-16T07:29:52.244183+0000","last_became_active":"2024-03-16T07:29:33.142350+0000","last_became_peered":"2024-03-16T07:29:33.142350+0000","last_unstale":"2024-03-16T07:29:52.244183+0000","last_undegraded":"2024-03-16T07:29:52.244183+0000","last_fullsized":"2024-03-16T07:29:52.244183+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:32:31.039690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.266226+0000","last_change":"2024-03-16T07:29:52.262717+0000","last_active":"2024-03-16T07:29:52.266226+0000","last_peered":"2024-03-16T07:29:52.266226+0000","last_clean":"2024-03-16T07:29:52.266226+0000","last_became_active":"2024-03-16T07:29:52.262479+0000","last_became_peered":"2024-03-16T07:29:52.262479+0000","last_unstale":"2024-03-16T07:29:52.266226+0000","last_undegraded":"2024-03-16T07:29:52.266226+0000","last_fullsized":"2024-03-16T07:29:52.266226+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_clean_scrub_stamp":"2024-03-16T07:29:51.229201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:29:45.248666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.247382+0000","last_change":"2024-03-16T07:29:51.253879+0000","last_active":"2024-03-16T07:29:52.247382+0000","last_peered":"2024-03-16T07:29:52.247382+0000","last_clean":"2024-03-16T07:29:52.247382+0000","last_became_active":"2024-03-16T07:29:51.253651+0000","last_became_peered":"2024-03-16T07:29:51.253651+0000","last_unstale":"2024-03-16T07:29:52.247382+0000","last_undegraded":"2024-03-16T07:29:52.247382+0000","last_fullsized":"2024-03-16T07:29:52.247382+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:50.226649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:50.226649+0000","last_clean_scrub_stamp":"2024-03-16T07:29:50.226649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:32:49.143242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":18,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.255819+0000","last_change":"2024-03-16T07:29:33.835641+0000","last_active":"2024-03-16T07:29:52.255819+0000","last_peered":"2024-03-16T07:29:52.255819+0000","last_clean":"2024-03-16T07:29:52.255819+0000","last_became_active":"2024-03-16T07:29:33.835125+0000","last_became_peered":"2024-03-16T07:29:33.835125+0000","last_unstale":"2024-03-16T07:29:52.255819+0000","last_undegraded":"2024-03-16T07:29:52.255819+0000","last_fullsized":"2024-03-16T07:29:52.255819+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:45:54.158424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.e","version":"95'2","reported_seq":22,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.249251+0000","last_change":"2024-03-16T07:29:33.149722+0000","last_active":"2024-03-16T07:29:52.249251+0000","last_peered":"2024-03-16T07:29:52.249251+0000","last_clean":"2024-03-16T07:29:52.249251+0000","last_became_active":"2024-03-16T07:29:33.149431+0000","last_became_peered":"2024-03-16T07:29:33.149431+0000","last_unstale":"2024-03-16T07:29:52.249251+0000","last_undegraded":"2024-03-16T07:29:52.249251+0000","last_fullsized":"2024-03-16T07:29:52.249251+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:06:39.605745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.282780+0000","last_change":"2024-03-16T07:29:52.282138+0000","last_active":"2024-03-16T07:29:52.282780+0000","last_peered":"2024-03-16T07:29:52.282780+0000","last_clean":"2024-03-16T07:29:52.282780+0000","last_became_active":"2024-03-16T07:29:52.281863+0000","last_became_peered":"2024-03-16T07:29:52.281863+0000","last_unstale":"2024-03-16T07:29:52.282780+0000","last_undegraded":"2024-03-16T07:29:52.282780+0000","last_fullsized":"2024-03-16T07:29:52.282780+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_clean_scrub_stamp":"2024-03-16T07:29:51.229201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:34:35.152966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.f","version":"99'1","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.271574+0000","last_change":"2024-03-16T07:29:51.259680+0000","last_active":"2024-03-16T07:29:52.271574+0000","last_peered":"2024-03-16T07:29:52.271574+0000","last_clean":"2024-03-16T07:29:52.271574+0000","last_became_active":"2024-03-16T07:29:51.259421+0000","last_became_peered":"2024-03-16T07:29:51.259421+0000","last_unstale":"2024-03-16T07:29:52.271574+0000","last_undegraded":"2024-03-16T07:29:52.271574+0000","last_fullsized":"2024-03-16T07:29:52.271574+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:50.226649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:50.226649+0000","last_clean_scrub_stamp":"2024-03-16T07:29:50.226649+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:36:49.269822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":18,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.241748+0000","last_change":"2024-03-16T07:29:33.838194+0000","last_active":"2024-03-16T07:29:52.241748+0000","last_peered":"2024-03-16T07:29:52.241748+0000","last_clean":"2024-03-16T07:29:52.241748+0000","last_became_active":"2024-03-16T07:29:33.837894+0000","last_became_peered":"2024-03-16T07:29:33.837894+0000","last_unstale":"2024-03-16T07:29:52.241748+0000","last_undegraded":"2024-03-16T07:29:52.241748+0000","last_fullsized":"2024-03-16T07:29:52.241748+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:45:22.148380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.d","version":"95'1","reported_seq":21,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.242808+0000","last_change":"2024-03-16T07:29:33.142518+0000","last_active":"2024-03-16T07:29:52.242808+0000","last_peered":"2024-03-16T07:29:52.242808+0000","last_clean":"2024-03-16T07:29:52.242808+0000","last_became_active":"2024-03-16T07:29:33.141657+0000","last_became_peered":"2024-03-16T07:29:33.141657+0000","last_unstale":"2024-03-16T07:29:52.242808+0000","last_undegraded":"2024-03-16T07:29:52.242808+0000","last_fullsized":"2024-03-16T07:29:52.242808+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:35:31.339252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.279794+0000","last_change":"2024-03-16T07:29:52.276838+0000","last_active":"2024-03-16T07:29:52.279794+0000","last_peered":"2024-03-16T07:29:52.279794+0000","last_clean":"2024-03-16T07:29:52.279794+0000","last_became_active":"2024-03-16T07:29:52.275552+0000","last_became_peered":"2024-03-16T07:29:52.275552+0000","last_unstale":"2024-03-16T07:29:52.279794+0000","last_undegraded":"2024-03-16T07:29:52.279794+0000","last_fullsized":"2024-03-16T07:29:52.279794+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_clean_scrub_stamp":"2024-03-16T07:29:51.229201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:41:53.607140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"99'2","reported_seq":14,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.271673+0000","last_change":"2024-03-16T07:29:51.255445+0000","last_active":"2024-03-16T07:29:52.271673+0000","last_peered":"2024-03-16T07:29:52.271673+0000","last_clean":"2024-03-16T07:29:52.271673+0000","last_became_active":"2024-03-16T07:29:51.255204+0000","last_became_peered":"2024-03-16T07:29:51.255204+0000","last_unstale":"2024-03-16T07:29:52.271673+0000","last_undegraded":"2024-03-16T07:29:52.271673+0000","last_fullsized":"2024-03-16T07:29:52.271673+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:50.226649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:50.226649+0000","last_clean_scrub_stamp":"2024-03-16T07:29:50.226649+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:05:44.369221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":18,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.242600+0000","last_change":"2024-03-16T07:29:33.840969+0000","last_active":"2024-03-16T07:29:52.242600+0000","last_peered":"2024-03-16T07:29:52.242600+0000","last_clean":"2024-03-16T07:29:52.242600+0000","last_became_active":"2024-03-16T07:29:33.840483+0000","last_became_peered":"2024-03-16T07:29:33.840483+0000","last_unstale":"2024-03-16T07:29:52.242600+0000","last_undegraded":"2024-03-16T07:29:52.242600+0000","last_fullsized":"2024-03-16T07:29:52.242600+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:06:46.263899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":20,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.241883+0000","last_change":"2024-03-16T07:29:33.143262+0000","last_active":"2024-03-16T07:29:52.241883+0000","last_peered":"2024-03-16T07:29:52.241883+0000","last_clean":"2024-03-16T07:29:52.241883+0000","last_became_active":"2024-03-16T07:29:33.142682+0000","last_became_peered":"2024-03-16T07:29:33.142682+0000","last_unstale":"2024-03-16T07:29:52.241883+0000","last_undegraded":"2024-03-16T07:29:52.241883+0000","last_fullsized":"2024-03-16T07:29:52.241883+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:48:35.046334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.260134+0000","last_change":"2024-03-16T07:29:52.258113+0000","last_active":"2024-03-16T07:29:52.260134+0000","last_peered":"2024-03-16T07:29:52.260134+0000","last_clean":"2024-03-16T07:29:52.260134+0000","last_became_active":"2024-03-16T07:29:52.256431+0000","last_became_peered":"2024-03-16T07:29:52.256431+0000","last_unstale":"2024-03-16T07:29:52.260134+0000","last_undegraded":"2024-03-16T07:29:52.260134+0000","last_fullsized":"2024-03-16T07:29:52.260134+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_clean_scrub_stamp":"2024-03-16T07:29:51.229201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:57:25.907183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.249171+0000","last_change":"2024-03-16T07:29:51.253861+0000","last_active":"2024-03-16T07:29:52.249171+0000","last_peered":"2024-03-16T07:29:52.249171+0000","last_clean":"2024-03-16T07:29:52.249171+0000","last_became_active":"2024-03-16T07:29:51.253596+0000","last_became_peered":"2024-03-16T07:29:51.253596+0000","last_unstale":"2024-03-16T07:29:52.249171+0000","last_undegraded":"2024-03-16T07:29:52.249171+0000","last_fullsized":"2024-03-16T07:29:52.249171+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:50.226649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:50.226649+0000","last_clean_scrub_stamp":"2024-03-16T07:29:50.226649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:04:21.249974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":18,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.246788+0000","last_change":"2024-03-16T07:29:33.827189+0000","last_active":"2024-03-16T07:29:52.246788+0000","last_peered":"2024-03-16T07:29:52.246788+0000","last_clean":"2024-03-16T07:29:52.246788+0000","last_became_active":"2024-03-16T07:29:33.826953+0000","last_became_peered":"2024-03-16T07:29:33.826953+0000","last_unstale":"2024-03-16T07:29:52.246788+0000","last_undegraded":"2024-03-16T07:29:52.246788+0000","last_fullsized":"2024-03-16T07:29:52.246788+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:34:19.104829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.b","version":"95'2","reported_seq":22,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.245656+0000","last_change":"2024-03-16T07:29:33.147427+0000","last_active":"2024-03-16T07:29:52.245656+0000","last_peered":"2024-03-16T07:29:52.245656+0000","last_clean":"2024-03-16T07:29:52.245656+0000","last_became_active":"2024-03-16T07:29:33.147011+0000","last_became_peered":"2024-03-16T07:29:33.147011+0000","last_unstale":"2024-03-16T07:29:52.245656+0000","last_undegraded":"2024-03-16T07:29:52.245656+0000","last_fullsized":"2024-03-16T07:29:52.245656+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:11:47.544575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.265144+0000","last_change":"2024-03-16T07:29:52.264177+0000","last_active":"2024-03-16T07:29:52.265144+0000","last_peered":"2024-03-16T07:29:52.265144+0000","last_clean":"2024-03-16T07:29:52.265144+0000","last_became_active":"2024-03-16T07:29:52.263871+0000","last_became_peered":"2024-03-16T07:29:52.263871+0000","last_unstale":"2024-03-16T07:29:52.265144+0000","last_undegraded":"2024-03-16T07:29:52.265144+0000","last_fullsized":"2024-03-16T07:29:52.265144+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_clean_scrub_stamp":"2024-03-16T07:29:51.229201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:29:43.798522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.238449+0000","last_change":"2024-03-16T07:29:51.241781+0000","last_active":"2024-03-16T07:29:52.238449+0000","last_peered":"2024-03-16T07:29:52.238449+0000","last_clean":"2024-03-16T07:29:52.238449+0000","last_became_active":"2024-03-16T07:29:51.241321+0000","last_became_peered":"2024-03-16T07:29:51.241321+0000","last_unstale":"2024-03-16T07:29:52.238449+0000","last_undegraded":"2024-03-16T07:29:52.238449+0000","last_fullsized":"2024-03-16T07:29:52.238449+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:50.226649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:50.226649+0000","last_clean_scrub_stamp":"2024-03-16T07:29:50.226649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:09:18.008626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":18,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.243089+0000","last_change":"2024-03-16T07:29:33.838647+0000","last_active":"2024-03-16T07:29:52.243089+0000","last_peered":"2024-03-16T07:29:52.243089+0000","last_clean":"2024-03-16T07:29:52.243089+0000","last_became_active":"2024-03-16T07:29:33.838049+0000","last_became_peered":"2024-03-16T07:29:33.838049+0000","last_unstale":"2024-03-16T07:29:52.243089+0000","last_undegraded":"2024-03-16T07:29:52.243089+0000","last_fullsized":"2024-03-16T07:29:52.243089+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:56:26.058572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":20,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.252445+0000","last_change":"2024-03-16T07:29:33.152620+0000","last_active":"2024-03-16T07:29:52.252445+0000","last_peered":"2024-03-16T07:29:52.252445+0000","last_clean":"2024-03-16T07:29:52.252445+0000","last_became_active":"2024-03-16T07:29:33.152352+0000","last_became_peered":"2024-03-16T07:29:33.152352+0000","last_unstale":"2024-03-16T07:29:52.252445+0000","last_undegraded":"2024-03-16T07:29:52.252445+0000","last_fullsized":"2024-03-16T07:29:52.252445+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:38:26.656813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.276065+0000","last_change":"2024-03-16T07:29:52.274900+0000","last_active":"2024-03-16T07:29:52.276065+0000","last_peered":"2024-03-16T07:29:52.276065+0000","last_clean":"2024-03-16T07:29:52.276065+0000","last_became_active":"2024-03-16T07:29:52.274644+0000","last_became_peered":"2024-03-16T07:29:52.274644+0000","last_unstale":"2024-03-16T07:29:52.276065+0000","last_undegraded":"2024-03-16T07:29:52.276065+0000","last_fullsized":"2024-03-16T07:29:52.276065+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_clean_scrub_stamp":"2024-03-16T07:29:51.229201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:26:55.625129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.b","version":"99'2","reported_seq":14,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.282850+0000","last_change":"2024-03-16T07:29:51.258873+0000","last_active":"2024-03-16T07:29:52.282850+0000","last_peered":"2024-03-16T07:29:52.282850+0000","last_clean":"2024-03-16T07:29:52.282850+0000","last_became_active":"2024-03-16T07:29:51.258008+0000","last_became_peered":"2024-03-16T07:29:51.258008+0000","last_unstale":"2024-03-16T07:29:52.282850+0000","last_undegraded":"2024-03-16T07:29:52.282850+0000","last_fullsized":"2024-03-16T07:29:52.282850+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:50.226649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:50.226649+0000","last_clean_scrub_stamp":"2024-03-16T07:29:50.226649+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:57:23.624463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":18,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.238734+0000","last_change":"2024-03-16T07:29:33.831988+0000","last_active":"2024-03-16T07:29:52.238734+0000","last_peered":"2024-03-16T07:29:52.238734+0000","last_clean":"2024-03-16T07:29:52.238734+0000","last_became_active":"2024-03-16T07:29:33.831702+0000","last_became_peered":"2024-03-16T07:29:33.831702+0000","last_unstale":"2024-03-16T07:29:52.238734+0000","last_undegraded":"2024-03-16T07:29:52.238734+0000","last_fullsized":"2024-03-16T07:29:52.238734+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:42:04.449559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":20,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.253853+0000","last_change":"2024-03-16T07:29:33.147855+0000","last_active":"2024-03-16T07:29:52.253853+0000","last_peered":"2024-03-16T07:29:52.253853+0000","last_clean":"2024-03-16T07:29:52.253853+0000","last_became_active":"2024-03-16T07:29:33.147615+0000","last_became_peered":"2024-03-16T07:29:33.147615+0000","last_unstale":"2024-03-16T07:29:52.253853+0000","last_undegraded":"2024-03-16T07:29:52.253853+0000","last_fullsized":"2024-03-16T07:29:52.253853+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:20:44.698184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.260285+0000","last_change":"2024-03-16T07:29:52.258806+0000","last_active":"2024-03-16T07:29:52.260285+0000","last_peered":"2024-03-16T07:29:52.260285+0000","last_clean":"2024-03-16T07:29:52.260285+0000","last_became_active":"2024-03-16T07:29:52.258567+0000","last_became_peered":"2024-03-16T07:29:52.258567+0000","last_unstale":"2024-03-16T07:29:52.260285+0000","last_undegraded":"2024-03-16T07:29:52.260285+0000","last_fullsized":"2024-03-16T07:29:52.260285+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_clean_scrub_stamp":"2024-03-16T07:29:51.229201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:23:28.691856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.248999+0000","last_change":"2024-03-16T07:29:51.253873+0000","last_active":"2024-03-16T07:29:52.248999+0000","last_peered":"2024-03-16T07:29:52.248999+0000","last_clean":"2024-03-16T07:29:52.248999+0000","last_became_active":"2024-03-16T07:29:51.253636+0000","last_became_peered":"2024-03-16T07:29:51.253636+0000","last_unstale":"2024-03-16T07:29:52.248999+0000","last_undegraded":"2024-03-16T07:29:52.248999+0000","last_fullsized":"2024-03-16T07:29:52.248999+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:50.226649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:50.226649+0000","last_clean_scrub_stamp":"2024-03-16T07:29:50.226649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:16:47.872304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":18,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.253686+0000","last_change":"2024-03-16T07:29:33.830959+0000","last_active":"2024-03-16T07:29:52.253686+0000","last_peered":"2024-03-16T07:29:52.253686+0000","last_clean":"2024-03-16T07:29:52.253686+0000","last_became_active":"2024-03-16T07:29:33.830655+0000","last_became_peered":"2024-03-16T07:29:33.830655+0000","last_unstale":"2024-03-16T07:29:52.253686+0000","last_undegraded":"2024-03-16T07:29:52.253686+0000","last_fullsized":"2024-03-16T07:29:52.253686+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:12:04.435282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":20,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.239092+0000","last_change":"2024-03-16T07:29:33.147292+0000","last_active":"2024-03-16T07:29:52.239092+0000","last_peered":"2024-03-16T07:29:52.239092+0000","last_clean":"2024-03-16T07:29:52.239092+0000","last_became_active":"2024-03-16T07:29:33.146227+0000","last_became_peered":"2024-03-16T07:29:33.146227+0000","last_unstale":"2024-03-16T07:29:52.239092+0000","last_undegraded":"2024-03-16T07:29:52.239092+0000","last_fullsized":"2024-03-16T07:29:52.239092+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:23:09.585751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.264998+0000","last_change":"2024-03-16T07:29:52.262876+0000","last_active":"2024-03-16T07:29:52.264998+0000","last_peered":"2024-03-16T07:29:52.264998+0000","last_clean":"2024-03-16T07:29:52.264998+0000","last_became_active":"2024-03-16T07:29:52.262661+0000","last_became_peered":"2024-03-16T07:29:52.262661+0000","last_unstale":"2024-03-16T07:29:52.264998+0000","last_undegraded":"2024-03-16T07:29:52.264998+0000","last_fullsized":"2024-03-16T07:29:52.264998+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_clean_scrub_stamp":"2024-03-16T07:29:51.229201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:35:12.787336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.256771+0000","last_change":"2024-03-16T07:29:51.253233+0000","last_active":"2024-03-16T07:29:52.256771+0000","last_peered":"2024-03-16T07:29:52.256771+0000","last_clean":"2024-03-16T07:29:52.256771+0000","last_became_active":"2024-03-16T07:29:51.252980+0000","last_became_peered":"2024-03-16T07:29:51.252980+0000","last_unstale":"2024-03-16T07:29:52.256771+0000","last_undegraded":"2024-03-16T07:29:52.256771+0000","last_fullsized":"2024-03-16T07:29:52.256771+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:50.226649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:50.226649+0000","last_clean_scrub_stamp":"2024-03-16T07:29:50.226649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:17:42.397143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":18,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.241874+0000","last_change":"2024-03-16T07:29:33.840859+0000","last_active":"2024-03-16T07:29:52.241874+0000","last_peered":"2024-03-16T07:29:52.241874+0000","last_clean":"2024-03-16T07:29:52.241874+0000","last_became_active":"2024-03-16T07:29:33.840311+0000","last_became_peered":"2024-03-16T07:29:33.840311+0000","last_unstale":"2024-03-16T07:29:52.241874+0000","last_undegraded":"2024-03-16T07:29:52.241874+0000","last_fullsized":"2024-03-16T07:29:52.241874+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:35:56.435081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.7","version":"95'2","reported_seq":22,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.255915+0000","last_change":"2024-03-16T07:29:33.150332+0000","last_active":"2024-03-16T07:29:52.255915+0000","last_peered":"2024-03-16T07:29:52.255915+0000","last_clean":"2024-03-16T07:29:52.255915+0000","last_became_active":"2024-03-16T07:29:33.149989+0000","last_became_peered":"2024-03-16T07:29:33.149989+0000","last_unstale":"2024-03-16T07:29:52.255915+0000","last_undegraded":"2024-03-16T07:29:52.255915+0000","last_fullsized":"2024-03-16T07:29:52.255915+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:04:56.622565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.279492+0000","last_change":"2024-03-16T07:29:52.278787+0000","last_active":"2024-03-16T07:29:52.279492+0000","last_peered":"2024-03-16T07:29:52.279492+0000","last_clean":"2024-03-16T07:29:52.279492+0000","last_became_active":"2024-03-16T07:29:52.276271+0000","last_became_peered":"2024-03-16T07:29:52.276271+0000","last_unstale":"2024-03-16T07:29:52.279492+0000","last_undegraded":"2024-03-16T07:29:52.279492+0000","last_fullsized":"2024-03-16T07:29:52.279492+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_clean_scrub_stamp":"2024-03-16T07:29:51.229201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:47:18.381337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.240862+0000","last_change":"2024-03-16T07:29:51.255983+0000","last_active":"2024-03-16T07:29:52.240862+0000","last_peered":"2024-03-16T07:29:52.240862+0000","last_clean":"2024-03-16T07:29:52.240862+0000","last_became_active":"2024-03-16T07:29:51.255738+0000","last_became_peered":"2024-03-16T07:29:51.255738+0000","last_unstale":"2024-03-16T07:29:52.240862+0000","last_undegraded":"2024-03-16T07:29:52.240862+0000","last_fullsized":"2024-03-16T07:29:52.240862+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:50.226649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:50.226649+0000","last_clean_scrub_stamp":"2024-03-16T07:29:50.226649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:57:00.370336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":18,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.244003+0000","last_change":"2024-03-16T07:29:33.826957+0000","last_active":"2024-03-16T07:29:52.244003+0000","last_peered":"2024-03-16T07:29:52.244003+0000","last_clean":"2024-03-16T07:29:52.244003+0000","last_became_active":"2024-03-16T07:29:33.826715+0000","last_became_peered":"2024-03-16T07:29:33.826715+0000","last_unstale":"2024-03-16T07:29:52.244003+0000","last_undegraded":"2024-03-16T07:29:52.244003+0000","last_fullsized":"2024-03-16T07:29:52.244003+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:11:43.923099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.6","version":"96'1","reported_seq":21,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.257626+0000","last_change":"2024-03-16T07:29:33.144113+0000","last_active":"2024-03-16T07:29:52.257626+0000","last_peered":"2024-03-16T07:29:52.257626+0000","last_clean":"2024-03-16T07:29:52.257626+0000","last_became_active":"2024-03-16T07:29:33.140102+0000","last_became_peered":"2024-03-16T07:29:33.140102+0000","last_unstale":"2024-03-16T07:29:52.257626+0000","last_undegraded":"2024-03-16T07:29:52.257626+0000","last_fullsized":"2024-03-16T07:29:52.257626+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:35:05.997178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.275035+0000","last_change":"2024-03-16T07:29:52.273851+0000","last_active":"2024-03-16T07:29:52.275035+0000","last_peered":"2024-03-16T07:29:52.275035+0000","last_clean":"2024-03-16T07:29:52.275035+0000","last_became_active":"2024-03-16T07:29:52.273599+0000","last_became_peered":"2024-03-16T07:29:52.273599+0000","last_unstale":"2024-03-16T07:29:52.275035+0000","last_undegraded":"2024-03-16T07:29:52.275035+0000","last_fullsized":"2024-03-16T07:29:52.275035+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_clean_scrub_stamp":"2024-03-16T07:29:51.229201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:06:00.586416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.7","version":"99'2","reported_seq":14,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.281868+0000","last_change":"2024-03-16T07:29:51.260453+0000","last_active":"2024-03-16T07:29:52.281868+0000","last_peered":"2024-03-16T07:29:52.281868+0000","last_clean":"2024-03-16T07:29:52.281868+0000","last_became_active":"2024-03-16T07:29:51.260220+0000","last_became_peered":"2024-03-16T07:29:51.260220+0000","last_unstale":"2024-03-16T07:29:52.281868+0000","last_undegraded":"2024-03-16T07:29:52.281868+0000","last_fullsized":"2024-03-16T07:29:52.281868+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:50.226649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:50.226649+0000","last_clean_scrub_stamp":"2024-03-16T07:29:50.226649+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:07:06.655300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":18,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.241788+0000","last_change":"2024-03-16T07:29:33.838136+0000","last_active":"2024-03-16T07:29:52.241788+0000","last_peered":"2024-03-16T07:29:52.241788+0000","last_clean":"2024-03-16T07:29:52.241788+0000","last_became_active":"2024-03-16T07:29:33.837685+0000","last_became_peered":"2024-03-16T07:29:33.837685+0000","last_unstale":"2024-03-16T07:29:52.241788+0000","last_undegraded":"2024-03-16T07:29:52.241788+0000","last_fullsized":"2024-03-16T07:29:52.241788+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:45:37.351491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":20,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.242804+0000","last_change":"2024-03-16T07:29:33.145636+0000","last_active":"2024-03-16T07:29:52.242804+0000","last_peered":"2024-03-16T07:29:52.242804+0000","last_clean":"2024-03-16T07:29:52.242804+0000","last_became_active":"2024-03-16T07:29:33.143854+0000","last_became_peered":"2024-03-16T07:29:33.143854+0000","last_unstale":"2024-03-16T07:29:52.242804+0000","last_undegraded":"2024-03-16T07:29:52.242804+0000","last_fullsized":"2024-03-16T07:29:52.242804+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:17:24.293590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.274578+0000","last_change":"2024-03-16T07:29:52.270864+0000","last_active":"2024-03-16T07:29:52.274578+0000","last_peered":"2024-03-16T07:29:52.274578+0000","last_clean":"2024-03-16T07:29:52.274578+0000","last_became_active":"2024-03-16T07:29:52.270325+0000","last_became_peered":"2024-03-16T07:29:52.270325+0000","last_unstale":"2024-03-16T07:29:52.274578+0000","last_undegraded":"2024-03-16T07:29:52.274578+0000","last_fullsized":"2024-03-16T07:29:52.274578+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_clean_scrub_stamp":"2024-03-16T07:29:51.229201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:04:02.778503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.248537+0000","last_change":"2024-03-16T07:29:51.254557+0000","last_active":"2024-03-16T07:29:52.248537+0000","last_peered":"2024-03-16T07:29:52.248537+0000","last_clean":"2024-03-16T07:29:52.248537+0000","last_became_active":"2024-03-16T07:29:51.254155+0000","last_became_peered":"2024-03-16T07:29:51.254155+0000","last_unstale":"2024-03-16T07:29:52.248537+0000","last_undegraded":"2024-03-16T07:29:52.248537+0000","last_fullsized":"2024-03-16T07:29:52.248537+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:50.226649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:50.226649+0000","last_clean_scrub_stamp":"2024-03-16T07:29:50.226649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:23:27.689304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":18,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.242694+0000","last_change":"2024-03-16T07:29:33.828294+0000","last_active":"2024-03-16T07:29:52.242694+0000","last_peered":"2024-03-16T07:29:52.242694+0000","last_clean":"2024-03-16T07:29:52.242694+0000","last_became_active":"2024-03-16T07:29:33.828062+0000","last_became_peered":"2024-03-16T07:29:33.828062+0000","last_unstale":"2024-03-16T07:29:52.242694+0000","last_undegraded":"2024-03-16T07:29:52.242694+0000","last_fullsized":"2024-03-16T07:29:52.242694+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:34:48.462965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":20,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.252980+0000","last_change":"2024-03-16T07:29:33.144300+0000","last_active":"2024-03-16T07:29:52.252980+0000","last_peered":"2024-03-16T07:29:52.252980+0000","last_clean":"2024-03-16T07:29:52.252980+0000","last_became_active":"2024-03-16T07:29:33.144052+0000","last_became_peered":"2024-03-16T07:29:33.144052+0000","last_unstale":"2024-03-16T07:29:52.252980+0000","last_undegraded":"2024-03-16T07:29:52.252980+0000","last_fullsized":"2024-03-16T07:29:52.252980+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:15:27.170786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.282004+0000","last_change":"2024-03-16T07:29:52.279413+0000","last_active":"2024-03-16T07:29:52.282004+0000","last_peered":"2024-03-16T07:29:52.282004+0000","last_clean":"2024-03-16T07:29:52.282004+0000","last_became_active":"2024-03-16T07:29:52.278819+0000","last_became_peered":"2024-03-16T07:29:52.278819+0000","last_unstale":"2024-03-16T07:29:52.282004+0000","last_undegraded":"2024-03-16T07:29:52.282004+0000","last_fullsized":"2024-03-16T07:29:52.282004+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_clean_scrub_stamp":"2024-03-16T07:29:51.229201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:48:28.409096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.238884+0000","last_change":"2024-03-16T07:29:51.245011+0000","last_active":"2024-03-16T07:29:52.238884+0000","last_peered":"2024-03-16T07:29:52.238884+0000","last_clean":"2024-03-16T07:29:52.238884+0000","last_became_active":"2024-03-16T07:29:51.244769+0000","last_became_peered":"2024-03-16T07:29:51.244769+0000","last_unstale":"2024-03-16T07:29:52.238884+0000","last_undegraded":"2024-03-16T07:29:52.238884+0000","last_fullsized":"2024-03-16T07:29:52.238884+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:50.226649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:50.226649+0000","last_clean_scrub_stamp":"2024-03-16T07:29:50.226649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:25:07.032586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":18,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.246875+0000","last_change":"2024-03-16T07:29:33.831300+0000","last_active":"2024-03-16T07:29:52.246875+0000","last_peered":"2024-03-16T07:29:52.246875+0000","last_clean":"2024-03-16T07:29:52.246875+0000","last_became_active":"2024-03-16T07:29:33.831037+0000","last_became_peered":"2024-03-16T07:29:33.831037+0000","last_unstale":"2024-03-16T07:29:52.246875+0000","last_undegraded":"2024-03-16T07:29:52.246875+0000","last_fullsized":"2024-03-16T07:29:52.246875+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:03:57.669517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":20,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.245753+0000","last_change":"2024-03-16T07:29:33.147234+0000","last_active":"2024-03-16T07:29:52.245753+0000","last_peered":"2024-03-16T07:29:52.245753+0000","last_clean":"2024-03-16T07:29:52.245753+0000","last_became_active":"2024-03-16T07:29:33.146693+0000","last_became_peered":"2024-03-16T07:29:33.146693+0000","last_unstale":"2024-03-16T07:29:52.245753+0000","last_undegraded":"2024-03-16T07:29:52.245753+0000","last_fullsized":"2024-03-16T07:29:52.245753+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:43:35.352393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.259857+0000","last_change":"2024-03-16T07:29:52.257195+0000","last_active":"2024-03-16T07:29:52.259857+0000","last_peered":"2024-03-16T07:29:52.259857+0000","last_clean":"2024-03-16T07:29:52.259857+0000","last_became_active":"2024-03-16T07:29:52.256953+0000","last_became_peered":"2024-03-16T07:29:52.256953+0000","last_unstale":"2024-03-16T07:29:52.259857+0000","last_undegraded":"2024-03-16T07:29:52.259857+0000","last_fullsized":"2024-03-16T07:29:52.259857+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_clean_scrub_stamp":"2024-03-16T07:29:51.229201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:32:50.145794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.238658+0000","last_change":"2024-03-16T07:29:51.241572+0000","last_active":"2024-03-16T07:29:52.238658+0000","last_peered":"2024-03-16T07:29:52.238658+0000","last_clean":"2024-03-16T07:29:52.238658+0000","last_became_active":"2024-03-16T07:29:51.241012+0000","last_became_peered":"2024-03-16T07:29:51.241012+0000","last_unstale":"2024-03-16T07:29:52.238658+0000","last_undegraded":"2024-03-16T07:29:52.238658+0000","last_fullsized":"2024-03-16T07:29:52.238658+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:50.226649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:50.226649+0000","last_clean_scrub_stamp":"2024-03-16T07:29:50.226649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:55:06.029276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":18,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.243166+0000","last_change":"2024-03-16T07:29:33.831203+0000","last_active":"2024-03-16T07:29:52.243166+0000","last_peered":"2024-03-16T07:29:52.243166+0000","last_clean":"2024-03-16T07:29:52.243166+0000","last_became_active":"2024-03-16T07:29:33.830953+0000","last_became_peered":"2024-03-16T07:29:33.830953+0000","last_unstale":"2024-03-16T07:29:52.243166+0000","last_undegraded":"2024-03-16T07:29:52.243166+0000","last_fullsized":"2024-03-16T07:29:52.243166+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:28:50.259243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":20,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.240055+0000","last_change":"2024-03-16T07:29:33.141889+0000","last_active":"2024-03-16T07:29:52.240055+0000","last_peered":"2024-03-16T07:29:52.240055+0000","last_clean":"2024-03-16T07:29:52.240055+0000","last_became_active":"2024-03-16T07:29:33.141560+0000","last_became_peered":"2024-03-16T07:29:33.141560+0000","last_unstale":"2024-03-16T07:29:52.240055+0000","last_undegraded":"2024-03-16T07:29:52.240055+0000","last_fullsized":"2024-03-16T07:29:52.240055+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:06:48.551747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.274998+0000","last_change":"2024-03-16T07:29:52.273498+0000","last_active":"2024-03-16T07:29:52.274998+0000","last_peered":"2024-03-16T07:29:52.274998+0000","last_clean":"2024-03-16T07:29:52.274998+0000","last_became_active":"2024-03-16T07:29:52.273102+0000","last_became_peered":"2024-03-16T07:29:52.273102+0000","last_unstale":"2024-03-16T07:29:52.274998+0000","last_undegraded":"2024-03-16T07:29:52.274998+0000","last_fullsized":"2024-03-16T07:29:52.274998+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_clean_scrub_stamp":"2024-03-16T07:29:51.229201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:55:31.792205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.245330+0000","last_change":"2024-03-16T07:29:51.258673+0000","last_active":"2024-03-16T07:29:52.245330+0000","last_peered":"2024-03-16T07:29:52.245330+0000","last_clean":"2024-03-16T07:29:52.245330+0000","last_became_active":"2024-03-16T07:29:51.257497+0000","last_became_peered":"2024-03-16T07:29:51.257497+0000","last_unstale":"2024-03-16T07:29:52.245330+0000","last_undegraded":"2024-03-16T07:29:52.245330+0000","last_fullsized":"2024-03-16T07:29:52.245330+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:50.226649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:50.226649+0000","last_clean_scrub_stamp":"2024-03-16T07:29:50.226649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:53:21.982058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":18,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.238908+0000","last_change":"2024-03-16T07:29:33.831593+0000","last_active":"2024-03-16T07:29:52.238908+0000","last_peered":"2024-03-16T07:29:52.238908+0000","last_clean":"2024-03-16T07:29:52.238908+0000","last_became_active":"2024-03-16T07:29:33.831346+0000","last_became_peered":"2024-03-16T07:29:33.831346+0000","last_unstale":"2024-03-16T07:29:52.238908+0000","last_undegraded":"2024-03-16T07:29:52.238908+0000","last_fullsized":"2024-03-16T07:29:52.238908+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:41:58.469024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":20,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.252214+0000","last_change":"2024-03-16T07:29:33.143890+0000","last_active":"2024-03-16T07:29:52.252214+0000","last_peered":"2024-03-16T07:29:52.252214+0000","last_clean":"2024-03-16T07:29:52.252214+0000","last_became_active":"2024-03-16T07:29:33.143637+0000","last_became_peered":"2024-03-16T07:29:33.143637+0000","last_unstale":"2024-03-16T07:29:52.252214+0000","last_undegraded":"2024-03-16T07:29:52.252214+0000","last_fullsized":"2024-03-16T07:29:52.252214+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:09:44.522730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.279281+0000","last_change":"2024-03-16T07:29:52.278444+0000","last_active":"2024-03-16T07:29:52.279281+0000","last_peered":"2024-03-16T07:29:52.279281+0000","last_clean":"2024-03-16T07:29:52.279281+0000","last_became_active":"2024-03-16T07:29:52.278023+0000","last_became_peered":"2024-03-16T07:29:52.278023+0000","last_unstale":"2024-03-16T07:29:52.279281+0000","last_undegraded":"2024-03-16T07:29:52.279281+0000","last_fullsized":"2024-03-16T07:29:52.279281+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_clean_scrub_stamp":"2024-03-16T07:29:51.229201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:29:00.141729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.239264+0000","last_change":"2024-03-16T07:29:51.244599+0000","last_active":"2024-03-16T07:29:52.239264+0000","last_peered":"2024-03-16T07:29:52.239264+0000","last_clean":"2024-03-16T07:29:52.239264+0000","last_became_active":"2024-03-16T07:29:51.244379+0000","last_became_peered":"2024-03-16T07:29:51.244379+0000","last_unstale":"2024-03-16T07:29:52.239264+0000","last_undegraded":"2024-03-16T07:29:52.239264+0000","last_fullsized":"2024-03-16T07:29:52.239264+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:50.226649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:50.226649+0000","last_clean_scrub_stamp":"2024-03-16T07:29:50.226649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:54:38.471122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":18,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.239026+0000","last_change":"2024-03-16T07:29:33.840846+0000","last_active":"2024-03-16T07:29:52.239026+0000","last_peered":"2024-03-16T07:29:52.239026+0000","last_clean":"2024-03-16T07:29:52.239026+0000","last_became_active":"2024-03-16T07:29:33.840586+0000","last_became_peered":"2024-03-16T07:29:33.840586+0000","last_unstale":"2024-03-16T07:29:52.239026+0000","last_undegraded":"2024-03-16T07:29:52.239026+0000","last_fullsized":"2024-03-16T07:29:52.239026+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:16:10.018326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":20,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.239205+0000","last_change":"2024-03-16T07:29:33.139819+0000","last_active":"2024-03-16T07:29:52.239205+0000","last_peered":"2024-03-16T07:29:52.239205+0000","last_clean":"2024-03-16T07:29:52.239205+0000","last_became_active":"2024-03-16T07:29:33.139567+0000","last_became_peered":"2024-03-16T07:29:33.139567+0000","last_unstale":"2024-03-16T07:29:52.239205+0000","last_undegraded":"2024-03-16T07:29:52.239205+0000","last_fullsized":"2024-03-16T07:29:52.239205+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:16:29.768752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.272833+0000","last_change":"2024-03-16T07:29:52.266043+0000","last_active":"2024-03-16T07:29:52.272833+0000","last_peered":"2024-03-16T07:29:52.272833+0000","last_clean":"2024-03-16T07:29:52.272833+0000","last_became_active":"2024-03-16T07:29:52.265666+0000","last_became_peered":"2024-03-16T07:29:52.265666+0000","last_unstale":"2024-03-16T07:29:52.272833+0000","last_undegraded":"2024-03-16T07:29:52.272833+0000","last_fullsized":"2024-03-16T07:29:52.272833+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_clean_scrub_stamp":"2024-03-16T07:29:51.229201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:05:43.527439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.13","version":"99'2","reported_seq":14,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.286620+0000","last_change":"2024-03-16T07:29:51.241231+0000","last_active":"2024-03-16T07:29:52.286620+0000","last_peered":"2024-03-16T07:29:52.286620+0000","last_clean":"2024-03-16T07:29:52.286620+0000","last_became_active":"2024-03-16T07:29:51.240982+0000","last_became_peered":"2024-03-16T07:29:51.240982+0000","last_unstale":"2024-03-16T07:29:52.286620+0000","last_undegraded":"2024-03-16T07:29:52.286620+0000","last_fullsized":"2024-03-16T07:29:52.286620+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:50.226649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:50.226649+0000","last_clean_scrub_stamp":"2024-03-16T07:29:50.226649+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:10:53.388471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":18,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.250962+0000","last_change":"2024-03-16T07:29:33.836320+0000","last_active":"2024-03-16T07:29:52.250962+0000","last_peered":"2024-03-16T07:29:52.250962+0000","last_clean":"2024-03-16T07:29:52.250962+0000","last_became_active":"2024-03-16T07:29:33.835776+0000","last_became_peered":"2024-03-16T07:29:33.835776+0000","last_unstale":"2024-03-16T07:29:52.250962+0000","last_undegraded":"2024-03-16T07:29:52.250962+0000","last_fullsized":"2024-03-16T07:29:52.250962+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:44:42.674554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":20,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.251915+0000","last_change":"2024-03-16T07:29:33.147194+0000","last_active":"2024-03-16T07:29:52.251915+0000","last_peered":"2024-03-16T07:29:52.251915+0000","last_clean":"2024-03-16T07:29:52.251915+0000","last_became_active":"2024-03-16T07:29:33.146945+0000","last_became_peered":"2024-03-16T07:29:33.146945+0000","last_unstale":"2024-03-16T07:29:52.251915+0000","last_undegraded":"2024-03-16T07:29:52.251915+0000","last_fullsized":"2024-03-16T07:29:52.251915+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:32:59.919891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"80'152","reported_seq":499,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.251060+0000","last_change":"2024-03-16T07:24:31.650537+0000","last_active":"2024-03-16T07:29:52.251060+0000","last_peered":"2024-03-16T07:29:52.251060+0000","last_clean":"2024-03-16T07:29:52.251060+0000","last_became_active":"2024-03-16T07:24:31.649574+0000","last_became_peered":"2024-03-16T07:24:31.649574+0000","last_unstale":"2024-03-16T07:29:52.251060+0000","last_undegraded":"2024-03-16T07:29:52.251060+0000","last_fullsized":"2024-03-16T07:29:52.251060+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:29.719970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:29.719970+0000","last_clean_scrub_stamp":"2024-03-16T07:24:29.719970+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:31:35.774554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":586,"num_read_kb":1121,"num_write":237,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":3},{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":4107,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":8214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":586,"num_read_kb":1121,"num_write":237,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":152,"ondisk_log_size":152,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738432,"num_pgs":63,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":36340,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":104821260,"statfs":{"total":107374182400,"available":107336970240,"internally_reserved":0,"allocated":1019904,"data_stored":400483,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738432,"num_pgs":117,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":36948,"kb_used_data":1604,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":104820652,"statfs":{"total":107374182400,"available":107336347648,"internally_reserved":0,"allocated":1642496,"data_stored":995386,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738432,"num_pgs":141,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":36948,"kb_used_data":1604,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":104820652,"statfs":{"total":107374182400,"available":107336347648,"internally_reserved":0,"allocated":1642496,"data_stored":995318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":3503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-16T07:29:56.521 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-16T07:29:56.871 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:29:56.874 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2024-03-16T07:29:56.881 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":45,"stamp":"2024-03-16T07:29:56.169663+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596885,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":586,"num_read_kb":1121,"num_write":328,"num_write_kb":1925,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":231,"ondisk_log_size":231,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":321,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":314572800,"kb_used":110236,"kb_used_data":4204,"kb_used_omap":4,"kb_used_meta":105979,"kb_avail":314462564,"statfs":{"total":322122547200,"available":322009665536,"internally_reserved":0,"allocated":4304896,"data_stored":2391187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":108522831},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.940110"},"pg_stats":[{"pgid":"19.3d","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.278663+0000","last_change":"2024-03-16T07:29:52.270163+0000","last_active":"2024-03-16T07:29:52.278663+0000","last_peered":"2024-03-16T07:29:52.278663+0000","last_clean":"2024-03-16T07:29:52.278663+0000","last_became_active":"2024-03-16T07:29:52.269928+0000","last_became_peered":"2024-03-16T07:29:52.269928+0000","last_unstale":"2024-03-16T07:29:52.278663+0000","last_undegraded":"2024-03-16T07:29:52.278663+0000","last_fullsized":"2024-03-16T07:29:52.278663+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_clean_scrub_stamp":"2024-03-16T07:29:51.229201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:21:09.677951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3f","version":"0'0","reported_seq":18,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.241037+0000","last_change":"2024-03-16T07:29:33.837801+0000","last_active":"2024-03-16T07:29:52.241037+0000","last_peered":"2024-03-16T07:29:52.241037+0000","last_clean":"2024-03-16T07:29:52.241037+0000","last_became_active":"2024-03-16T07:29:33.837541+0000","last_became_peered":"2024-03-16T07:29:33.837541+0000","last_unstale":"2024-03-16T07:29:52.241037+0000","last_undegraded":"2024-03-16T07:29:52.241037+0000","last_fullsized":"2024-03-16T07:29:52.241037+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:04:52.392474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.279549+0000","last_change":"2024-03-16T07:29:52.275530+0000","last_active":"2024-03-16T07:29:52.279549+0000","last_peered":"2024-03-16T07:29:52.279549+0000","last_clean":"2024-03-16T07:29:52.279549+0000","last_became_active":"2024-03-16T07:29:52.275282+0000","last_became_peered":"2024-03-16T07:29:52.275282+0000","last_unstale":"2024-03-16T07:29:52.279549+0000","last_undegraded":"2024-03-16T07:29:52.279549+0000","last_fullsized":"2024-03-16T07:29:52.279549+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_clean_scrub_stamp":"2024-03-16T07:29:51.229201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:49:24.787124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":18,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.248724+0000","last_change":"2024-03-16T07:29:33.828285+0000","last_active":"2024-03-16T07:29:52.248724+0000","last_peered":"2024-03-16T07:29:52.248724+0000","last_clean":"2024-03-16T07:29:52.248724+0000","last_became_active":"2024-03-16T07:29:33.827699+0000","last_became_peered":"2024-03-16T07:29:33.827699+0000","last_unstale":"2024-03-16T07:29:52.248724+0000","last_undegraded":"2024-03-16T07:29:52.248724+0000","last_fullsized":"2024-03-16T07:29:52.248724+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:26:06.558057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3f","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.279830+0000","last_change":"2024-03-16T07:29:52.277215+0000","last_active":"2024-03-16T07:29:52.279830+0000","last_peered":"2024-03-16T07:29:52.279830+0000","last_clean":"2024-03-16T07:29:52.279830+0000","last_became_active":"2024-03-16T07:29:52.276293+0000","last_became_peered":"2024-03-16T07:29:52.276293+0000","last_unstale":"2024-03-16T07:29:52.279830+0000","last_undegraded":"2024-03-16T07:29:52.279830+0000","last_fullsized":"2024-03-16T07:29:52.279830+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_clean_scrub_stamp":"2024-03-16T07:29:51.229201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:40:11.434508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":18,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.256446+0000","last_change":"2024-03-16T07:29:33.832571+0000","last_active":"2024-03-16T07:29:52.256446+0000","last_peered":"2024-03-16T07:29:52.256446+0000","last_clean":"2024-03-16T07:29:52.256446+0000","last_became_active":"2024-03-16T07:29:33.832329+0000","last_became_peered":"2024-03-16T07:29:33.832329+0000","last_unstale":"2024-03-16T07:29:52.256446+0000","last_undegraded":"2024-03-16T07:29:52.256446+0000","last_fullsized":"2024-03-16T07:29:52.256446+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:45:05.916690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.269377+0000","last_change":"2024-03-16T07:29:52.265441+0000","last_active":"2024-03-16T07:29:52.269377+0000","last_peered":"2024-03-16T07:29:52.269377+0000","last_clean":"2024-03-16T07:29:52.269377+0000","last_became_active":"2024-03-16T07:29:52.264428+0000","last_became_peered":"2024-03-16T07:29:52.264428+0000","last_unstale":"2024-03-16T07:29:52.269377+0000","last_undegraded":"2024-03-16T07:29:52.269377+0000","last_fullsized":"2024-03-16T07:29:52.269377+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_clean_scrub_stamp":"2024-03-16T07:29:51.229201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:49:24.787124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":18,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.240974+0000","last_change":"2024-03-16T07:29:33.830557+0000","last_active":"2024-03-16T07:29:52.240974+0000","last_peered":"2024-03-16T07:29:52.240974+0000","last_clean":"2024-03-16T07:29:52.240974+0000","last_became_active":"2024-03-16T07:29:33.830122+0000","last_became_peered":"2024-03-16T07:29:33.830122+0000","last_unstale":"2024-03-16T07:29:52.240974+0000","last_undegraded":"2024-03-16T07:29:52.240974+0000","last_fullsized":"2024-03-16T07:29:52.240974+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:35:43.576229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.271981+0000","last_change":"2024-03-16T07:29:52.269168+0000","last_active":"2024-03-16T07:29:52.271981+0000","last_peered":"2024-03-16T07:29:52.271981+0000","last_clean":"2024-03-16T07:29:52.271981+0000","last_became_active":"2024-03-16T07:29:52.268946+0000","last_became_peered":"2024-03-16T07:29:52.268946+0000","last_unstale":"2024-03-16T07:29:52.271981+0000","last_undegraded":"2024-03-16T07:29:52.271981+0000","last_fullsized":"2024-03-16T07:29:52.271981+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_clean_scrub_stamp":"2024-03-16T07:29:51.229201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:35:12.787336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":18,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.257761+0000","last_change":"2024-03-16T07:29:33.834562+0000","last_active":"2024-03-16T07:29:52.257761+0000","last_peered":"2024-03-16T07:29:52.257761+0000","last_clean":"2024-03-16T07:29:52.257761+0000","last_became_active":"2024-03-16T07:29:33.833200+0000","last_became_peered":"2024-03-16T07:29:33.833200+0000","last_unstale":"2024-03-16T07:29:52.257761+0000","last_undegraded":"2024-03-16T07:29:52.257761+0000","last_fullsized":"2024-03-16T07:29:52.257761+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:07:30.736713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.281966+0000","last_change":"2024-03-16T07:29:52.279048+0000","last_active":"2024-03-16T07:29:52.281966+0000","last_peered":"2024-03-16T07:29:52.281966+0000","last_clean":"2024-03-16T07:29:52.281966+0000","last_became_active":"2024-03-16T07:29:52.278233+0000","last_became_peered":"2024-03-16T07:29:52.278233+0000","last_unstale":"2024-03-16T07:29:52.281966+0000","last_undegraded":"2024-03-16T07:29:52.281966+0000","last_fullsized":"2024-03-16T07:29:52.281966+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_clean_scrub_stamp":"2024-03-16T07:29:51.229201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:33:33.984229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":18,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.246696+0000","last_change":"2024-03-16T07:29:33.826274+0000","last_active":"2024-03-16T07:29:52.246696+0000","last_peered":"2024-03-16T07:29:52.246696+0000","last_clean":"2024-03-16T07:29:52.246696+0000","last_became_active":"2024-03-16T07:29:33.825821+0000","last_became_peered":"2024-03-16T07:29:33.825821+0000","last_unstale":"2024-03-16T07:29:52.246696+0000","last_undegraded":"2024-03-16T07:29:52.246696+0000","last_fullsized":"2024-03-16T07:29:52.246696+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:54:54.165392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.285623+0000","last_change":"2024-03-16T07:29:52.285001+0000","last_active":"2024-03-16T07:29:52.285623+0000","last_peered":"2024-03-16T07:29:52.285623+0000","last_clean":"2024-03-16T07:29:52.285623+0000","last_became_active":"2024-03-16T07:29:52.284454+0000","last_became_peered":"2024-03-16T07:29:52.284454+0000","last_unstale":"2024-03-16T07:29:52.285623+0000","last_undegraded":"2024-03-16T07:29:52.285623+0000","last_fullsized":"2024-03-16T07:29:52.285623+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_clean_scrub_stamp":"2024-03-16T07:29:51.229201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:54:27.625231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":18,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.249322+0000","last_change":"2024-03-16T07:29:33.832454+0000","last_active":"2024-03-16T07:29:52.249322+0000","last_peered":"2024-03-16T07:29:52.249322+0000","last_clean":"2024-03-16T07:29:52.249322+0000","last_became_active":"2024-03-16T07:29:33.832205+0000","last_became_peered":"2024-03-16T07:29:33.832205+0000","last_unstale":"2024-03-16T07:29:52.249322+0000","last_undegraded":"2024-03-16T07:29:52.249322+0000","last_fullsized":"2024-03-16T07:29:52.249322+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:45:54.158424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.277053+0000","last_change":"2024-03-16T07:29:52.273907+0000","last_active":"2024-03-16T07:29:52.277053+0000","last_peered":"2024-03-16T07:29:52.277053+0000","last_clean":"2024-03-16T07:29:52.277053+0000","last_became_active":"2024-03-16T07:29:52.273679+0000","last_became_peered":"2024-03-16T07:29:52.273679+0000","last_unstale":"2024-03-16T07:29:52.277053+0000","last_undegraded":"2024-03-16T07:29:52.277053+0000","last_fullsized":"2024-03-16T07:29:52.277053+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_clean_scrub_stamp":"2024-03-16T07:29:51.229201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:49:32.359753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":18,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.245888+0000","last_change":"2024-03-16T07:29:33.834186+0000","last_active":"2024-03-16T07:29:52.245888+0000","last_peered":"2024-03-16T07:29:52.245888+0000","last_clean":"2024-03-16T07:29:52.245888+0000","last_became_active":"2024-03-16T07:29:33.833939+0000","last_became_peered":"2024-03-16T07:29:33.833939+0000","last_unstale":"2024-03-16T07:29:52.245888+0000","last_undegraded":"2024-03-16T07:29:52.245888+0000","last_fullsized":"2024-03-16T07:29:52.245888+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:05:33.276056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.278681+0000","last_change":"2024-03-16T07:29:52.272796+0000","last_active":"2024-03-16T07:29:52.278681+0000","last_peered":"2024-03-16T07:29:52.278681+0000","last_clean":"2024-03-16T07:29:52.278681+0000","last_became_active":"2024-03-16T07:29:52.271857+0000","last_became_peered":"2024-03-16T07:29:52.271857+0000","last_unstale":"2024-03-16T07:29:52.278681+0000","last_undegraded":"2024-03-16T07:29:52.278681+0000","last_fullsized":"2024-03-16T07:29:52.278681+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_clean_scrub_stamp":"2024-03-16T07:29:51.229201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:20:39.294503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":18,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.243842+0000","last_change":"2024-03-16T07:29:33.840759+0000","last_active":"2024-03-16T07:29:52.243842+0000","last_peered":"2024-03-16T07:29:52.243842+0000","last_clean":"2024-03-16T07:29:52.243842+0000","last_became_active":"2024-03-16T07:29:33.840493+0000","last_became_peered":"2024-03-16T07:29:33.840493+0000","last_unstale":"2024-03-16T07:29:52.243842+0000","last_undegraded":"2024-03-16T07:29:52.243842+0000","last_fullsized":"2024-03-16T07:29:52.243842+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:28:46.696178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.276077+0000","last_change":"2024-03-16T07:29:52.269883+0000","last_active":"2024-03-16T07:29:52.276077+0000","last_peered":"2024-03-16T07:29:52.276077+0000","last_clean":"2024-03-16T07:29:52.276077+0000","last_became_active":"2024-03-16T07:29:52.265994+0000","last_became_peered":"2024-03-16T07:29:52.265994+0000","last_unstale":"2024-03-16T07:29:52.276077+0000","last_undegraded":"2024-03-16T07:29:52.276077+0000","last_fullsized":"2024-03-16T07:29:52.276077+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_clean_scrub_stamp":"2024-03-16T07:29:51.229201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:04:33.522327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":18,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.240908+0000","last_change":"2024-03-16T07:29:33.837411+0000","last_active":"2024-03-16T07:29:52.240908+0000","last_peered":"2024-03-16T07:29:52.240908+0000","last_clean":"2024-03-16T07:29:52.240908+0000","last_became_active":"2024-03-16T07:29:33.837054+0000","last_became_peered":"2024-03-16T07:29:33.837054+0000","last_unstale":"2024-03-16T07:29:52.240908+0000","last_undegraded":"2024-03-16T07:29:52.240908+0000","last_fullsized":"2024-03-16T07:29:52.240908+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:40:38.224614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.279846+0000","last_change":"2024-03-16T07:29:52.277413+0000","last_active":"2024-03-16T07:29:52.279846+0000","last_peered":"2024-03-16T07:29:52.279846+0000","last_clean":"2024-03-16T07:29:52.279846+0000","last_became_active":"2024-03-16T07:29:52.276578+0000","last_became_peered":"2024-03-16T07:29:52.276578+0000","last_unstale":"2024-03-16T07:29:52.279846+0000","last_undegraded":"2024-03-16T07:29:52.279846+0000","last_fullsized":"2024-03-16T07:29:52.279846+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_clean_scrub_stamp":"2024-03-16T07:29:51.229201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:16:53.738018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":18,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.242576+0000","last_change":"2024-03-16T07:29:33.841582+0000","last_active":"2024-03-16T07:29:52.242576+0000","last_peered":"2024-03-16T07:29:52.242576+0000","last_clean":"2024-03-16T07:29:52.242576+0000","last_became_active":"2024-03-16T07:29:33.841350+0000","last_became_peered":"2024-03-16T07:29:33.841350+0000","last_unstale":"2024-03-16T07:29:52.242576+0000","last_undegraded":"2024-03-16T07:29:52.242576+0000","last_fullsized":"2024-03-16T07:29:52.242576+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:25:07.504235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.275015+0000","last_change":"2024-03-16T07:29:52.273507+0000","last_active":"2024-03-16T07:29:52.275015+0000","last_peered":"2024-03-16T07:29:52.275015+0000","last_clean":"2024-03-16T07:29:52.275015+0000","last_became_active":"2024-03-16T07:29:52.273264+0000","last_became_peered":"2024-03-16T07:29:52.273264+0000","last_unstale":"2024-03-16T07:29:52.275015+0000","last_undegraded":"2024-03-16T07:29:52.275015+0000","last_fullsized":"2024-03-16T07:29:52.275015+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_clean_scrub_stamp":"2024-03-16T07:29:51.229201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:42:00.720071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":18,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.241018+0000","last_change":"2024-03-16T07:29:33.830360+0000","last_active":"2024-03-16T07:29:52.241018+0000","last_peered":"2024-03-16T07:29:52.241018+0000","last_clean":"2024-03-16T07:29:52.241018+0000","last_became_active":"2024-03-16T07:29:33.829805+0000","last_became_peered":"2024-03-16T07:29:33.829805+0000","last_unstale":"2024-03-16T07:29:52.241018+0000","last_undegraded":"2024-03-16T07:29:52.241018+0000","last_fullsized":"2024-03-16T07:29:52.241018+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:47:45.954148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.279579+0000","last_change":"2024-03-16T07:29:52.275988+0000","last_active":"2024-03-16T07:29:52.279579+0000","last_peered":"2024-03-16T07:29:52.279579+0000","last_clean":"2024-03-16T07:29:52.279579+0000","last_became_active":"2024-03-16T07:29:52.275757+0000","last_became_peered":"2024-03-16T07:29:52.275757+0000","last_unstale":"2024-03-16T07:29:52.279579+0000","last_undegraded":"2024-03-16T07:29:52.279579+0000","last_fullsized":"2024-03-16T07:29:52.279579+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_clean_scrub_stamp":"2024-03-16T07:29:51.229201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:42:00.720071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":18,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.257853+0000","last_change":"2024-03-16T07:29:33.827090+0000","last_active":"2024-03-16T07:29:52.257853+0000","last_peered":"2024-03-16T07:29:52.257853+0000","last_clean":"2024-03-16T07:29:52.257853+0000","last_became_active":"2024-03-16T07:29:33.826838+0000","last_became_peered":"2024-03-16T07:29:33.826838+0000","last_unstale":"2024-03-16T07:29:52.257853+0000","last_undegraded":"2024-03-16T07:29:52.257853+0000","last_fullsized":"2024-03-16T07:29:52.257853+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:14:55.133041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.281986+0000","last_change":"2024-03-16T07:29:52.279232+0000","last_active":"2024-03-16T07:29:52.281986+0000","last_peered":"2024-03-16T07:29:52.281986+0000","last_clean":"2024-03-16T07:29:52.281986+0000","last_became_active":"2024-03-16T07:29:52.278525+0000","last_became_peered":"2024-03-16T07:29:52.278525+0000","last_unstale":"2024-03-16T07:29:52.281986+0000","last_undegraded":"2024-03-16T07:29:52.281986+0000","last_fullsized":"2024-03-16T07:29:52.281986+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_clean_scrub_stamp":"2024-03-16T07:29:51.229201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:03:43.189937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":18,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.239757+0000","last_change":"2024-03-16T07:29:33.839839+0000","last_active":"2024-03-16T07:29:52.239757+0000","last_peered":"2024-03-16T07:29:52.239757+0000","last_clean":"2024-03-16T07:29:52.239757+0000","last_became_active":"2024-03-16T07:29:33.839596+0000","last_became_peered":"2024-03-16T07:29:33.839596+0000","last_unstale":"2024-03-16T07:29:52.239757+0000","last_undegraded":"2024-03-16T07:29:52.239757+0000","last_fullsized":"2024-03-16T07:29:52.239757+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:28:05.388099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.272048+0000","last_change":"2024-03-16T07:29:52.268287+0000","last_active":"2024-03-16T07:29:52.272048+0000","last_peered":"2024-03-16T07:29:52.272048+0000","last_clean":"2024-03-16T07:29:52.272048+0000","last_became_active":"2024-03-16T07:29:52.268057+0000","last_became_peered":"2024-03-16T07:29:52.268057+0000","last_unstale":"2024-03-16T07:29:52.272048+0000","last_undegraded":"2024-03-16T07:29:52.272048+0000","last_fullsized":"2024-03-16T07:29:52.272048+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_clean_scrub_stamp":"2024-03-16T07:29:51.229201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:29:45.248666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":18,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.253369+0000","last_change":"2024-03-16T07:29:33.834583+0000","last_active":"2024-03-16T07:29:52.253369+0000","last_peered":"2024-03-16T07:29:52.253369+0000","last_clean":"2024-03-16T07:29:52.253369+0000","last_became_active":"2024-03-16T07:29:33.834324+0000","last_became_peered":"2024-03-16T07:29:33.834324+0000","last_unstale":"2024-03-16T07:29:52.253369+0000","last_undegraded":"2024-03-16T07:29:52.253369+0000","last_fullsized":"2024-03-16T07:29:52.253369+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:06:40.607068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.264976+0000","last_change":"2024-03-16T07:29:52.262312+0000","last_active":"2024-03-16T07:29:52.264976+0000","last_peered":"2024-03-16T07:29:52.264976+0000","last_clean":"2024-03-16T07:29:52.264976+0000","last_became_active":"2024-03-16T07:29:52.262069+0000","last_became_peered":"2024-03-16T07:29:52.262069+0000","last_unstale":"2024-03-16T07:29:52.264976+0000","last_undegraded":"2024-03-16T07:29:52.264976+0000","last_fullsized":"2024-03-16T07:29:52.264976+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_clean_scrub_stamp":"2024-03-16T07:29:51.229201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:46:15.856661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":18,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.238629+0000","last_change":"2024-03-16T07:29:33.841155+0000","last_active":"2024-03-16T07:29:52.238629+0000","last_peered":"2024-03-16T07:29:52.238629+0000","last_clean":"2024-03-16T07:29:52.238629+0000","last_became_active":"2024-03-16T07:29:33.840814+0000","last_became_peered":"2024-03-16T07:29:33.840814+0000","last_unstale":"2024-03-16T07:29:52.238629+0000","last_undegraded":"2024-03-16T07:29:52.238629+0000","last_fullsized":"2024-03-16T07:29:52.238629+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:51:01.302406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.270274+0000","last_change":"2024-03-16T07:29:52.264705+0000","last_active":"2024-03-16T07:29:52.270274+0000","last_peered":"2024-03-16T07:29:52.270274+0000","last_clean":"2024-03-16T07:29:52.270274+0000","last_became_active":"2024-03-16T07:29:52.264470+0000","last_became_peered":"2024-03-16T07:29:52.264470+0000","last_unstale":"2024-03-16T07:29:52.270274+0000","last_undegraded":"2024-03-16T07:29:52.270274+0000","last_fullsized":"2024-03-16T07:29:52.270274+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_clean_scrub_stamp":"2024-03-16T07:29:51.229201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:56:10.362531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":18,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.255721+0000","last_change":"2024-03-16T07:29:33.835448+0000","last_active":"2024-03-16T07:29:52.255721+0000","last_peered":"2024-03-16T07:29:52.255721+0000","last_clean":"2024-03-16T07:29:52.255721+0000","last_became_active":"2024-03-16T07:29:33.834817+0000","last_became_peered":"2024-03-16T07:29:33.834817+0000","last_unstale":"2024-03-16T07:29:52.255721+0000","last_undegraded":"2024-03-16T07:29:52.255721+0000","last_fullsized":"2024-03-16T07:29:52.255721+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:05:33.276056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.265018+0000","last_change":"2024-03-16T07:29:52.262907+0000","last_active":"2024-03-16T07:29:52.265018+0000","last_peered":"2024-03-16T07:29:52.265018+0000","last_clean":"2024-03-16T07:29:52.265018+0000","last_became_active":"2024-03-16T07:29:52.262640+0000","last_became_peered":"2024-03-16T07:29:52.262640+0000","last_unstale":"2024-03-16T07:29:52.265018+0000","last_undegraded":"2024-03-16T07:29:52.265018+0000","last_fullsized":"2024-03-16T07:29:52.265018+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_clean_scrub_stamp":"2024-03-16T07:29:51.229201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:48:58.012856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":18,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.257380+0000","last_change":"2024-03-16T07:29:33.836688+0000","last_active":"2024-03-16T07:29:52.257380+0000","last_peered":"2024-03-16T07:29:52.257380+0000","last_clean":"2024-03-16T07:29:52.257380+0000","last_became_active":"2024-03-16T07:29:33.836439+0000","last_became_peered":"2024-03-16T07:29:33.836439+0000","last_unstale":"2024-03-16T07:29:52.257380+0000","last_undegraded":"2024-03-16T07:29:52.257380+0000","last_fullsized":"2024-03-16T07:29:52.257380+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:00:43.877183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.260369+0000","last_change":"2024-03-16T07:29:52.258059+0000","last_active":"2024-03-16T07:29:52.260369+0000","last_peered":"2024-03-16T07:29:52.260369+0000","last_clean":"2024-03-16T07:29:52.260369+0000","last_became_active":"2024-03-16T07:29:52.257801+0000","last_became_peered":"2024-03-16T07:29:52.257801+0000","last_unstale":"2024-03-16T07:29:52.260369+0000","last_undegraded":"2024-03-16T07:29:52.260369+0000","last_fullsized":"2024-03-16T07:29:52.260369+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_clean_scrub_stamp":"2024-03-16T07:29:51.229201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:07:07.657852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":18,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.256588+0000","last_change":"2024-03-16T07:29:33.831962+0000","last_active":"2024-03-16T07:29:52.256588+0000","last_peered":"2024-03-16T07:29:52.256588+0000","last_clean":"2024-03-16T07:29:52.256588+0000","last_became_active":"2024-03-16T07:29:33.831730+0000","last_became_peered":"2024-03-16T07:29:33.831730+0000","last_unstale":"2024-03-16T07:29:52.256588+0000","last_undegraded":"2024-03-16T07:29:52.256588+0000","last_fullsized":"2024-03-16T07:29:52.256588+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:44:31.524367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.269357+0000","last_change":"2024-03-16T07:29:52.265252+0000","last_active":"2024-03-16T07:29:52.269357+0000","last_peered":"2024-03-16T07:29:52.269357+0000","last_clean":"2024-03-16T07:29:52.269357+0000","last_became_active":"2024-03-16T07:29:52.264105+0000","last_became_peered":"2024-03-16T07:29:52.264105+0000","last_unstale":"2024-03-16T07:29:52.269357+0000","last_undegraded":"2024-03-16T07:29:52.269357+0000","last_fullsized":"2024-03-16T07:29:52.269357+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_clean_scrub_stamp":"2024-03-16T07:29:51.229201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:26:55.625129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":18,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.253726+0000","last_change":"2024-03-16T07:29:33.826162+0000","last_active":"2024-03-16T07:29:52.253726+0000","last_peered":"2024-03-16T07:29:52.253726+0000","last_clean":"2024-03-16T07:29:52.253726+0000","last_became_active":"2024-03-16T07:29:33.825696+0000","last_became_peered":"2024-03-16T07:29:33.825696+0000","last_unstale":"2024-03-16T07:29:52.253726+0000","last_undegraded":"2024-03-16T07:29:52.253726+0000","last_fullsized":"2024-03-16T07:29:52.253726+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:28:45.230768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.267696+0000","last_change":"2024-03-16T07:29:52.263627+0000","last_active":"2024-03-16T07:29:52.267696+0000","last_peered":"2024-03-16T07:29:52.267696+0000","last_clean":"2024-03-16T07:29:52.267696+0000","last_became_active":"2024-03-16T07:29:52.263242+0000","last_became_peered":"2024-03-16T07:29:52.263242+0000","last_unstale":"2024-03-16T07:29:52.267696+0000","last_undegraded":"2024-03-16T07:29:52.267696+0000","last_fullsized":"2024-03-16T07:29:52.267696+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_clean_scrub_stamp":"2024-03-16T07:29:51.229201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:04:02.778503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":18,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.258451+0000","last_change":"2024-03-16T07:29:33.835797+0000","last_active":"2024-03-16T07:29:52.258451+0000","last_peered":"2024-03-16T07:29:52.258451+0000","last_clean":"2024-03-16T07:29:52.258451+0000","last_became_active":"2024-03-16T07:29:33.835556+0000","last_became_peered":"2024-03-16T07:29:33.835556+0000","last_unstale":"2024-03-16T07:29:52.258451+0000","last_undegraded":"2024-03-16T07:29:52.258451+0000","last_fullsized":"2024-03-16T07:29:52.258451+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:42:44.865750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.267744+0000","last_change":"2024-03-16T07:29:52.264325+0000","last_active":"2024-03-16T07:29:52.267744+0000","last_peered":"2024-03-16T07:29:52.267744+0000","last_clean":"2024-03-16T07:29:52.267744+0000","last_became_active":"2024-03-16T07:29:52.264031+0000","last_became_peered":"2024-03-16T07:29:52.264031+0000","last_unstale":"2024-03-16T07:29:52.267744+0000","last_undegraded":"2024-03-16T07:29:52.267744+0000","last_fullsized":"2024-03-16T07:29:52.267744+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_clean_scrub_stamp":"2024-03-16T07:29:51.229201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:08:48.854030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":18,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.249165+0000","last_change":"2024-03-16T07:29:33.833025+0000","last_active":"2024-03-16T07:29:52.249165+0000","last_peered":"2024-03-16T07:29:52.249165+0000","last_clean":"2024-03-16T07:29:52.249165+0000","last_became_active":"2024-03-16T07:29:33.832508+0000","last_became_peered":"2024-03-16T07:29:33.832508+0000","last_unstale":"2024-03-16T07:29:52.249165+0000","last_undegraded":"2024-03-16T07:29:52.249165+0000","last_fullsized":"2024-03-16T07:29:52.249165+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:48:56.092113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.279263+0000","last_change":"2024-03-16T07:29:52.278260+0000","last_active":"2024-03-16T07:29:52.279263+0000","last_peered":"2024-03-16T07:29:52.279263+0000","last_clean":"2024-03-16T07:29:52.279263+0000","last_became_active":"2024-03-16T07:29:52.275947+0000","last_became_peered":"2024-03-16T07:29:52.275947+0000","last_unstale":"2024-03-16T07:29:52.279263+0000","last_undegraded":"2024-03-16T07:29:52.279263+0000","last_fullsized":"2024-03-16T07:29:52.279263+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_clean_scrub_stamp":"2024-03-16T07:29:51.229201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:45:47.196926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":18,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.238756+0000","last_change":"2024-03-16T07:29:33.830404+0000","last_active":"2024-03-16T07:29:52.238756+0000","last_peered":"2024-03-16T07:29:52.238756+0000","last_clean":"2024-03-16T07:29:52.238756+0000","last_became_active":"2024-03-16T07:29:33.830174+0000","last_became_peered":"2024-03-16T07:29:33.830174+0000","last_unstale":"2024-03-16T07:29:52.238756+0000","last_undegraded":"2024-03-16T07:29:52.238756+0000","last_fullsized":"2024-03-16T07:29:52.238756+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:41:12.198698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.272814+0000","last_change":"2024-03-16T07:29:52.265876+0000","last_active":"2024-03-16T07:29:52.272814+0000","last_peered":"2024-03-16T07:29:52.272814+0000","last_clean":"2024-03-16T07:29:52.272814+0000","last_became_active":"2024-03-16T07:29:52.265363+0000","last_became_peered":"2024-03-16T07:29:52.265363+0000","last_unstale":"2024-03-16T07:29:52.272814+0000","last_undegraded":"2024-03-16T07:29:52.272814+0000","last_fullsized":"2024-03-16T07:29:52.272814+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_clean_scrub_stamp":"2024-03-16T07:29:51.229201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:33:10.764721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":18,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.245984+0000","last_change":"2024-03-16T07:29:33.834147+0000","last_active":"2024-03-16T07:29:52.245984+0000","last_peered":"2024-03-16T07:29:52.245984+0000","last_clean":"2024-03-16T07:29:52.245984+0000","last_became_active":"2024-03-16T07:29:33.833703+0000","last_became_peered":"2024-03-16T07:29:33.833703+0000","last_unstale":"2024-03-16T07:29:52.245984+0000","last_undegraded":"2024-03-16T07:29:52.245984+0000","last_fullsized":"2024-03-16T07:29:52.245984+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:54:08.885808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.282069+0000","last_change":"2024-03-16T07:29:52.281574+0000","last_active":"2024-03-16T07:29:52.282069+0000","last_peered":"2024-03-16T07:29:52.282069+0000","last_clean":"2024-03-16T07:29:52.282069+0000","last_became_active":"2024-03-16T07:29:52.281322+0000","last_became_peered":"2024-03-16T07:29:52.281322+0000","last_unstale":"2024-03-16T07:29:52.282069+0000","last_undegraded":"2024-03-16T07:29:52.282069+0000","last_fullsized":"2024-03-16T07:29:52.282069+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_clean_scrub_stamp":"2024-03-16T07:29:51.229201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:05:53.362432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":18,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.247768+0000","last_change":"2024-03-16T07:29:33.834992+0000","last_active":"2024-03-16T07:29:52.247768+0000","last_peered":"2024-03-16T07:29:52.247768+0000","last_clean":"2024-03-16T07:29:52.247768+0000","last_became_active":"2024-03-16T07:29:33.834758+0000","last_became_peered":"2024-03-16T07:29:33.834758+0000","last_unstale":"2024-03-16T07:29:52.247768+0000","last_undegraded":"2024-03-16T07:29:52.247768+0000","last_fullsized":"2024-03-16T07:29:52.247768+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:32:15.280635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.274998+0000","last_change":"2024-03-16T07:29:52.273634+0000","last_active":"2024-03-16T07:29:52.274998+0000","last_peered":"2024-03-16T07:29:52.274998+0000","last_clean":"2024-03-16T07:29:52.274998+0000","last_became_active":"2024-03-16T07:29:52.273401+0000","last_became_peered":"2024-03-16T07:29:52.273401+0000","last_unstale":"2024-03-16T07:29:52.274998+0000","last_undegraded":"2024-03-16T07:29:52.274998+0000","last_fullsized":"2024-03-16T07:29:52.274998+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_clean_scrub_stamp":"2024-03-16T07:29:51.229201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:41:53.607140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":18,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.241002+0000","last_change":"2024-03-16T07:29:33.841057+0000","last_active":"2024-03-16T07:29:52.241002+0000","last_peered":"2024-03-16T07:29:52.241002+0000","last_clean":"2024-03-16T07:29:52.241002+0000","last_became_active":"2024-03-16T07:29:33.840691+0000","last_became_peered":"2024-03-16T07:29:33.840691+0000","last_unstale":"2024-03-16T07:29:52.241002+0000","last_undegraded":"2024-03-16T07:29:52.241002+0000","last_fullsized":"2024-03-16T07:29:52.241002+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:18:02.038888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.265036+0000","last_change":"2024-03-16T07:29:52.262169+0000","last_active":"2024-03-16T07:29:52.265036+0000","last_peered":"2024-03-16T07:29:52.265036+0000","last_clean":"2024-03-16T07:29:52.265036+0000","last_became_active":"2024-03-16T07:29:52.261934+0000","last_became_peered":"2024-03-16T07:29:52.261934+0000","last_unstale":"2024-03-16T07:29:52.265036+0000","last_undegraded":"2024-03-16T07:29:52.265036+0000","last_fullsized":"2024-03-16T07:29:52.265036+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_clean_scrub_stamp":"2024-03-16T07:29:51.229201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:20:02.125493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":18,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.256816+0000","last_change":"2024-03-16T07:29:33.835192+0000","last_active":"2024-03-16T07:29:52.256816+0000","last_peered":"2024-03-16T07:29:52.256816+0000","last_clean":"2024-03-16T07:29:52.256816+0000","last_became_active":"2024-03-16T07:29:33.834934+0000","last_became_peered":"2024-03-16T07:29:33.834934+0000","last_unstale":"2024-03-16T07:29:52.256816+0000","last_undegraded":"2024-03-16T07:29:52.256816+0000","last_fullsized":"2024-03-16T07:29:52.256816+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:26:32.824858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.269334+0000","last_change":"2024-03-16T07:29:52.264683+0000","last_active":"2024-03-16T07:29:52.269334+0000","last_peered":"2024-03-16T07:29:52.269334+0000","last_clean":"2024-03-16T07:29:52.269334+0000","last_became_active":"2024-03-16T07:29:52.263776+0000","last_became_peered":"2024-03-16T07:29:52.263776+0000","last_unstale":"2024-03-16T07:29:52.269334+0000","last_undegraded":"2024-03-16T07:29:52.269334+0000","last_fullsized":"2024-03-16T07:29:52.269334+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_clean_scrub_stamp":"2024-03-16T07:29:51.229201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:24:27.553640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":18,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.241686+0000","last_change":"2024-03-16T07:29:33.837983+0000","last_active":"2024-03-16T07:29:52.241686+0000","last_peered":"2024-03-16T07:29:52.241686+0000","last_clean":"2024-03-16T07:29:52.241686+0000","last_became_active":"2024-03-16T07:29:33.837496+0000","last_became_peered":"2024-03-16T07:29:33.837496+0000","last_unstale":"2024-03-16T07:29:52.241686+0000","last_undegraded":"2024-03-16T07:29:52.241686+0000","last_fullsized":"2024-03-16T07:29:52.241686+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:53:25.642839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.272477+0000","last_change":"2024-03-16T07:29:52.269931+0000","last_active":"2024-03-16T07:29:52.272477+0000","last_peered":"2024-03-16T07:29:52.272477+0000","last_clean":"2024-03-16T07:29:52.272477+0000","last_became_active":"2024-03-16T07:29:52.269686+0000","last_became_peered":"2024-03-16T07:29:52.269686+0000","last_unstale":"2024-03-16T07:29:52.272477+0000","last_undegraded":"2024-03-16T07:29:52.272477+0000","last_fullsized":"2024-03-16T07:29:52.272477+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_clean_scrub_stamp":"2024-03-16T07:29:51.229201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:37:39.294970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":18,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.241058+0000","last_change":"2024-03-16T07:29:33.838573+0000","last_active":"2024-03-16T07:29:52.241058+0000","last_peered":"2024-03-16T07:29:52.241058+0000","last_clean":"2024-03-16T07:29:52.241058+0000","last_became_active":"2024-03-16T07:29:33.837752+0000","last_became_peered":"2024-03-16T07:29:33.837752+0000","last_unstale":"2024-03-16T07:29:52.241058+0000","last_undegraded":"2024-03-16T07:29:52.241058+0000","last_fullsized":"2024-03-16T07:29:52.241058+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:41:10.081251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.260371+0000","last_change":"2024-03-16T07:29:52.259189+0000","last_active":"2024-03-16T07:29:52.260371+0000","last_peered":"2024-03-16T07:29:52.260371+0000","last_clean":"2024-03-16T07:29:52.260371+0000","last_became_active":"2024-03-16T07:29:52.258968+0000","last_became_peered":"2024-03-16T07:29:52.258968+0000","last_unstale":"2024-03-16T07:29:52.260371+0000","last_undegraded":"2024-03-16T07:29:52.260371+0000","last_fullsized":"2024-03-16T07:29:52.260371+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_clean_scrub_stamp":"2024-03-16T07:29:51.229201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:16:48.874856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":18,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.249263+0000","last_change":"2024-03-16T07:29:33.832836+0000","last_active":"2024-03-16T07:29:52.249263+0000","last_peered":"2024-03-16T07:29:52.249263+0000","last_clean":"2024-03-16T07:29:52.249263+0000","last_became_active":"2024-03-16T07:29:33.832354+0000","last_became_peered":"2024-03-16T07:29:33.832354+0000","last_unstale":"2024-03-16T07:29:52.249263+0000","last_undegraded":"2024-03-16T07:29:52.249263+0000","last_fullsized":"2024-03-16T07:29:52.249263+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:09:01.072871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.285642+0000","last_change":"2024-03-16T07:29:52.285066+0000","last_active":"2024-03-16T07:29:52.285642+0000","last_peered":"2024-03-16T07:29:52.285642+0000","last_clean":"2024-03-16T07:29:52.285642+0000","last_became_active":"2024-03-16T07:29:52.284676+0000","last_became_peered":"2024-03-16T07:29:52.284676+0000","last_unstale":"2024-03-16T07:29:52.285642+0000","last_undegraded":"2024-03-16T07:29:52.285642+0000","last_fullsized":"2024-03-16T07:29:52.285642+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_clean_scrub_stamp":"2024-03-16T07:29:51.229201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:53:45.532905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":18,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.238862+0000","last_change":"2024-03-16T07:29:33.830827+0000","last_active":"2024-03-16T07:29:52.238862+0000","last_peered":"2024-03-16T07:29:52.238862+0000","last_clean":"2024-03-16T07:29:52.238862+0000","last_became_active":"2024-03-16T07:29:33.829553+0000","last_became_peered":"2024-03-16T07:29:33.829553+0000","last_unstale":"2024-03-16T07:29:52.238862+0000","last_undegraded":"2024-03-16T07:29:52.238862+0000","last_fullsized":"2024-03-16T07:29:52.238862+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:47:12.171754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.276047+0000","last_change":"2024-03-16T07:29:52.274502+0000","last_active":"2024-03-16T07:29:52.276047+0000","last_peered":"2024-03-16T07:29:52.276047+0000","last_clean":"2024-03-16T07:29:52.276047+0000","last_became_active":"2024-03-16T07:29:52.274219+0000","last_became_peered":"2024-03-16T07:29:52.274219+0000","last_unstale":"2024-03-16T07:29:52.276047+0000","last_undegraded":"2024-03-16T07:29:52.276047+0000","last_fullsized":"2024-03-16T07:29:52.276047+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_clean_scrub_stamp":"2024-03-16T07:29:51.229201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:24:27.553640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":18,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.250743+0000","last_change":"2024-03-16T07:29:33.826298+0000","last_active":"2024-03-16T07:29:52.250743+0000","last_peered":"2024-03-16T07:29:52.250743+0000","last_clean":"2024-03-16T07:29:52.250743+0000","last_became_active":"2024-03-16T07:29:33.826047+0000","last_became_peered":"2024-03-16T07:29:33.826047+0000","last_unstale":"2024-03-16T07:29:52.250743+0000","last_undegraded":"2024-03-16T07:29:52.250743+0000","last_fullsized":"2024-03-16T07:29:52.250743+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:53:30.099446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.271241+0000","last_change":"2024-03-16T07:29:52.269439+0000","last_active":"2024-03-16T07:29:52.271241+0000","last_peered":"2024-03-16T07:29:52.271241+0000","last_clean":"2024-03-16T07:29:52.271241+0000","last_became_active":"2024-03-16T07:29:52.269223+0000","last_became_peered":"2024-03-16T07:29:52.269223+0000","last_unstale":"2024-03-16T07:29:52.271241+0000","last_undegraded":"2024-03-16T07:29:52.271241+0000","last_fullsized":"2024-03-16T07:29:52.271241+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_clean_scrub_stamp":"2024-03-16T07:29:51.229201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:48:58.012856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.1d","version":"99'2","reported_seq":14,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.286620+0000","last_change":"2024-03-16T07:29:51.257576+0000","last_active":"2024-03-16T07:29:52.286620+0000","last_peered":"2024-03-16T07:29:52.286620+0000","last_clean":"2024-03-16T07:29:52.286620+0000","last_became_active":"2024-03-16T07:29:51.257341+0000","last_became_peered":"2024-03-16T07:29:51.257341+0000","last_unstale":"2024-03-16T07:29:52.286620+0000","last_undegraded":"2024-03-16T07:29:52.286620+0000","last_fullsized":"2024-03-16T07:29:52.286620+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:50.226649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:50.226649+0000","last_clean_scrub_stamp":"2024-03-16T07:29:50.226649+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:01:26.573221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":18,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.257528+0000","last_change":"2024-03-16T07:29:33.826129+0000","last_active":"2024-03-16T07:29:52.257528+0000","last_peered":"2024-03-16T07:29:52.257528+0000","last_clean":"2024-03-16T07:29:52.257528+0000","last_became_active":"2024-03-16T07:29:33.825871+0000","last_became_peered":"2024-03-16T07:29:33.825871+0000","last_unstale":"2024-03-16T07:29:52.257528+0000","last_undegraded":"2024-03-16T07:29:52.257528+0000","last_fullsized":"2024-03-16T07:29:52.257528+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:54:08.885808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"95'4","reported_seq":24,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.244087+0000","last_change":"2024-03-16T07:29:33.142157+0000","last_active":"2024-03-16T07:29:52.244087+0000","last_peered":"2024-03-16T07:29:52.244087+0000","last_clean":"2024-03-16T07:29:52.244087+0000","last_became_active":"2024-03-16T07:29:33.141750+0000","last_became_peered":"2024-03-16T07:29:33.141750+0000","last_unstale":"2024-03-16T07:29:52.244087+0000","last_undegraded":"2024-03-16T07:29:52.244087+0000","last_fullsized":"2024-03-16T07:29:52.244087+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:15:22.486053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.278643+0000","last_change":"2024-03-16T07:29:52.268771+0000","last_active":"2024-03-16T07:29:52.278643+0000","last_peered":"2024-03-16T07:29:52.278643+0000","last_clean":"2024-03-16T07:29:52.278643+0000","last_became_active":"2024-03-16T07:29:52.268539+0000","last_became_peered":"2024-03-16T07:29:52.268539+0000","last_unstale":"2024-03-16T07:29:52.278643+0000","last_undegraded":"2024-03-16T07:29:52.278643+0000","last_fullsized":"2024-03-16T07:29:52.278643+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_clean_scrub_stamp":"2024-03-16T07:29:51.229201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:24:31.348860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1c","version":"99'2","reported_seq":14,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.281166+0000","last_change":"2024-03-16T07:29:51.251898+0000","last_active":"2024-03-16T07:29:52.281166+0000","last_peered":"2024-03-16T07:29:52.281166+0000","last_clean":"2024-03-16T07:29:52.281166+0000","last_became_active":"2024-03-16T07:29:51.251630+0000","last_became_peered":"2024-03-16T07:29:51.251630+0000","last_unstale":"2024-03-16T07:29:52.281166+0000","last_undegraded":"2024-03-16T07:29:52.281166+0000","last_fullsized":"2024-03-16T07:29:52.281166+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:50.226649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:50.226649+0000","last_clean_scrub_stamp":"2024-03-16T07:29:50.226649+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:02:09.604872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":18,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.243926+0000","last_change":"2024-03-16T07:29:33.829851+0000","last_active":"2024-03-16T07:29:52.243926+0000","last_peered":"2024-03-16T07:29:52.243926+0000","last_clean":"2024-03-16T07:29:52.243926+0000","last_became_active":"2024-03-16T07:29:33.829620+0000","last_became_peered":"2024-03-16T07:29:33.829620+0000","last_unstale":"2024-03-16T07:29:52.243926+0000","last_undegraded":"2024-03-16T07:29:52.243926+0000","last_fullsized":"2024-03-16T07:29:52.243926+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:03:47.150413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1e","version":"95'1","reported_seq":21,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.249025+0000","last_change":"2024-03-16T07:29:33.144641+0000","last_active":"2024-03-16T07:29:52.249025+0000","last_peered":"2024-03-16T07:29:52.249025+0000","last_clean":"2024-03-16T07:29:52.249025+0000","last_became_active":"2024-03-16T07:29:33.144370+0000","last_became_peered":"2024-03-16T07:29:33.144370+0000","last_unstale":"2024-03-16T07:29:52.249025+0000","last_undegraded":"2024-03-16T07:29:52.249025+0000","last_fullsized":"2024-03-16T07:29:52.249025+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:02:47.297486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.270806+0000","last_change":"2024-03-16T07:29:52.264996+0000","last_active":"2024-03-16T07:29:52.270806+0000","last_peered":"2024-03-16T07:29:52.270806+0000","last_clean":"2024-03-16T07:29:52.270806+0000","last_became_active":"2024-03-16T07:29:52.264787+0000","last_became_peered":"2024-03-16T07:29:52.264787+0000","last_unstale":"2024-03-16T07:29:52.270806+0000","last_undegraded":"2024-03-16T07:29:52.270806+0000","last_fullsized":"2024-03-16T07:29:52.270806+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_clean_scrub_stamp":"2024-03-16T07:29:51.229201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:14:51.568780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1f","version":"99'4","reported_seq":16,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.282222+0000","last_change":"2024-03-16T07:29:51.260281+0000","last_active":"2024-03-16T07:29:52.282222+0000","last_peered":"2024-03-16T07:29:52.282222+0000","last_clean":"2024-03-16T07:29:52.282222+0000","last_became_active":"2024-03-16T07:29:51.259902+0000","last_became_peered":"2024-03-16T07:29:51.259902+0000","last_unstale":"2024-03-16T07:29:52.282222+0000","last_undegraded":"2024-03-16T07:29:52.282222+0000","last_fullsized":"2024-03-16T07:29:52.282222+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:50.226649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:50.226649+0000","last_clean_scrub_stamp":"2024-03-16T07:29:50.226649+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:48:53.149886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":18,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.253810+0000","last_change":"2024-03-16T07:29:33.836419+0000","last_active":"2024-03-16T07:29:52.253810+0000","last_peered":"2024-03-16T07:29:52.253810+0000","last_clean":"2024-03-16T07:29:52.253810+0000","last_became_active":"2024-03-16T07:29:33.836160+0000","last_became_peered":"2024-03-16T07:29:33.836160+0000","last_unstale":"2024-03-16T07:29:52.253810+0000","last_undegraded":"2024-03-16T07:29:52.253810+0000","last_fullsized":"2024-03-16T07:29:52.253810+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:26:07.664599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1d","version":"95'2","reported_seq":22,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.248658+0000","last_change":"2024-03-16T07:29:33.145140+0000","last_active":"2024-03-16T07:29:52.248658+0000","last_peered":"2024-03-16T07:29:52.248658+0000","last_clean":"2024-03-16T07:29:52.248658+0000","last_became_active":"2024-03-16T07:29:33.144891+0000","last_became_peered":"2024-03-16T07:29:33.144891+0000","last_unstale":"2024-03-16T07:29:52.248658+0000","last_undegraded":"2024-03-16T07:29:52.248658+0000","last_fullsized":"2024-03-16T07:29:52.248658+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:04:47.579175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.279814+0000","last_change":"2024-03-16T07:29:52.277026+0000","last_active":"2024-03-16T07:29:52.279814+0000","last_peered":"2024-03-16T07:29:52.279814+0000","last_clean":"2024-03-16T07:29:52.279814+0000","last_became_active":"2024-03-16T07:29:52.275898+0000","last_became_peered":"2024-03-16T07:29:52.275898+0000","last_unstale":"2024-03-16T07:29:52.279814+0000","last_undegraded":"2024-03-16T07:29:52.279814+0000","last_fullsized":"2024-03-16T07:29:52.279814+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_clean_scrub_stamp":"2024-03-16T07:29:51.229201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:06:00.586416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.1e","version":"99'1","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.280368+0000","last_change":"2024-03-16T07:29:51.255225+0000","last_active":"2024-03-16T07:29:52.280368+0000","last_peered":"2024-03-16T07:29:52.280368+0000","last_clean":"2024-03-16T07:29:52.280368+0000","last_became_active":"2024-03-16T07:29:51.255000+0000","last_became_peered":"2024-03-16T07:29:51.255000+0000","last_unstale":"2024-03-16T07:29:52.280368+0000","last_undegraded":"2024-03-16T07:29:52.280368+0000","last_fullsized":"2024-03-16T07:29:52.280368+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:50.226649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:50.226649+0000","last_clean_scrub_stamp":"2024-03-16T07:29:50.226649+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:15:40.589606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":18,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.256902+0000","last_change":"2024-03-16T07:29:33.828184+0000","last_active":"2024-03-16T07:29:52.256902+0000","last_peered":"2024-03-16T07:29:52.256902+0000","last_clean":"2024-03-16T07:29:52.256902+0000","last_became_active":"2024-03-16T07:29:33.827955+0000","last_became_peered":"2024-03-16T07:29:33.827955+0000","last_unstale":"2024-03-16T07:29:52.256902+0000","last_undegraded":"2024-03-16T07:29:52.256902+0000","last_fullsized":"2024-03-16T07:29:52.256902+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:20:59.190114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"95'2","reported_seq":22,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.252714+0000","last_change":"2024-03-16T07:29:33.143477+0000","last_active":"2024-03-16T07:29:52.252714+0000","last_peered":"2024-03-16T07:29:52.252714+0000","last_clean":"2024-03-16T07:29:52.252714+0000","last_became_active":"2024-03-16T07:29:33.143221+0000","last_became_peered":"2024-03-16T07:29:33.143221+0000","last_unstale":"2024-03-16T07:29:52.252714+0000","last_undegraded":"2024-03-16T07:29:52.252714+0000","last_fullsized":"2024-03-16T07:29:52.252714+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:39:36.137228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.273601+0000","last_change":"2024-03-16T07:29:52.265707+0000","last_active":"2024-03-16T07:29:52.273601+0000","last_peered":"2024-03-16T07:29:52.273601+0000","last_clean":"2024-03-16T07:29:52.273601+0000","last_became_active":"2024-03-16T07:29:52.265407+0000","last_became_peered":"2024-03-16T07:29:52.265407+0000","last_unstale":"2024-03-16T07:29:52.273601+0000","last_undegraded":"2024-03-16T07:29:52.273601+0000","last_fullsized":"2024-03-16T07:29:52.273601+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_clean_scrub_stamp":"2024-03-16T07:29:51.229201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:09:09.632224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.238717+0000","last_change":"2024-03-16T07:29:51.246676+0000","last_active":"2024-03-16T07:29:52.238717+0000","last_peered":"2024-03-16T07:29:52.238717+0000","last_clean":"2024-03-16T07:29:52.238717+0000","last_became_active":"2024-03-16T07:29:51.246420+0000","last_became_peered":"2024-03-16T07:29:51.246420+0000","last_unstale":"2024-03-16T07:29:52.238717+0000","last_undegraded":"2024-03-16T07:29:52.238717+0000","last_fullsized":"2024-03-16T07:29:52.238717+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:50.226649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:50.226649+0000","last_clean_scrub_stamp":"2024-03-16T07:29:50.226649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:55:24.899384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":18,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.239935+0000","last_change":"2024-03-16T07:29:33.839989+0000","last_active":"2024-03-16T07:29:52.239935+0000","last_peered":"2024-03-16T07:29:52.239935+0000","last_clean":"2024-03-16T07:29:52.239935+0000","last_became_active":"2024-03-16T07:29:33.839759+0000","last_became_peered":"2024-03-16T07:29:33.839759+0000","last_unstale":"2024-03-16T07:29:52.239935+0000","last_undegraded":"2024-03-16T07:29:52.239935+0000","last_fullsized":"2024-03-16T07:29:52.239935+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:46:33.756833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1b","version":"95'1","reported_seq":21,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.245445+0000","last_change":"2024-03-16T07:29:33.151173+0000","last_active":"2024-03-16T07:29:52.245445+0000","last_peered":"2024-03-16T07:29:52.245445+0000","last_clean":"2024-03-16T07:29:52.245445+0000","last_became_active":"2024-03-16T07:29:33.150934+0000","last_became_peered":"2024-03-16T07:29:33.150934+0000","last_unstale":"2024-03-16T07:29:52.245445+0000","last_undegraded":"2024-03-16T07:29:52.245445+0000","last_fullsized":"2024-03-16T07:29:52.245445+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:35:30.259942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.259880+0000","last_change":"2024-03-16T07:29:52.257876+0000","last_active":"2024-03-16T07:29:52.259880+0000","last_peered":"2024-03-16T07:29:52.259880+0000","last_clean":"2024-03-16T07:29:52.259880+0000","last_became_active":"2024-03-16T07:29:52.257637+0000","last_became_peered":"2024-03-16T07:29:52.257637+0000","last_unstale":"2024-03-16T07:29:52.259880+0000","last_undegraded":"2024-03-16T07:29:52.259880+0000","last_fullsized":"2024-03-16T07:29:52.259880+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_clean_scrub_stamp":"2024-03-16T07:29:51.229201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:48:54.152438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.250574+0000","last_change":"2024-03-16T07:29:51.252555+0000","last_active":"2024-03-16T07:29:52.250574+0000","last_peered":"2024-03-16T07:29:52.250574+0000","last_clean":"2024-03-16T07:29:52.250574+0000","last_became_active":"2024-03-16T07:29:51.252307+0000","last_became_peered":"2024-03-16T07:29:51.252307+0000","last_unstale":"2024-03-16T07:29:52.250574+0000","last_undegraded":"2024-03-16T07:29:52.250574+0000","last_fullsized":"2024-03-16T07:29:52.250574+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:50.226649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:50.226649+0000","last_clean_scrub_stamp":"2024-03-16T07:29:50.226649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:01:24.897707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":18,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.242918+0000","last_change":"2024-03-16T07:29:33.838441+0000","last_active":"2024-03-16T07:29:52.242918+0000","last_peered":"2024-03-16T07:29:52.242918+0000","last_clean":"2024-03-16T07:29:52.242918+0000","last_became_active":"2024-03-16T07:29:33.837425+0000","last_became_peered":"2024-03-16T07:29:33.837425+0000","last_unstale":"2024-03-16T07:29:52.242918+0000","last_undegraded":"2024-03-16T07:29:52.242918+0000","last_fullsized":"2024-03-16T07:29:52.242918+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:44:16.567702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"95'1","reported_seq":21,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.252060+0000","last_change":"2024-03-16T07:29:33.152347+0000","last_active":"2024-03-16T07:29:52.252060+0000","last_peered":"2024-03-16T07:29:52.252060+0000","last_clean":"2024-03-16T07:29:52.252060+0000","last_became_active":"2024-03-16T07:29:33.152108+0000","last_became_peered":"2024-03-16T07:29:33.152108+0000","last_unstale":"2024-03-16T07:29:52.252060+0000","last_undegraded":"2024-03-16T07:29:52.252060+0000","last_fullsized":"2024-03-16T07:29:52.252060+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:48:09.351303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.271201+0000","last_change":"2024-03-16T07:29:52.267375+0000","last_active":"2024-03-16T07:29:52.271201+0000","last_peered":"2024-03-16T07:29:52.271201+0000","last_clean":"2024-03-16T07:29:52.271201+0000","last_became_active":"2024-03-16T07:29:52.267150+0000","last_became_peered":"2024-03-16T07:29:52.267150+0000","last_unstale":"2024-03-16T07:29:52.271201+0000","last_undegraded":"2024-03-16T07:29:52.271201+0000","last_fullsized":"2024-03-16T07:29:52.271201+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_clean_scrub_stamp":"2024-03-16T07:29:51.229201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:46:15.856661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.1b","version":"99'1","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.282660+0000","last_change":"2024-03-16T07:29:51.258990+0000","last_active":"2024-03-16T07:29:52.282660+0000","last_peered":"2024-03-16T07:29:52.282660+0000","last_clean":"2024-03-16T07:29:52.282660+0000","last_became_active":"2024-03-16T07:29:51.258321+0000","last_became_peered":"2024-03-16T07:29:51.258321+0000","last_unstale":"2024-03-16T07:29:52.282660+0000","last_undegraded":"2024-03-16T07:29:52.282660+0000","last_fullsized":"2024-03-16T07:29:52.282660+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:50.226649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:50.226649+0000","last_clean_scrub_stamp":"2024-03-16T07:29:50.226649+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:04:50.357548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":18,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.239241+0000","last_change":"2024-03-16T07:29:33.841426+0000","last_active":"2024-03-16T07:29:52.239241+0000","last_peered":"2024-03-16T07:29:52.239241+0000","last_clean":"2024-03-16T07:29:52.239241+0000","last_became_active":"2024-03-16T07:29:33.841098+0000","last_became_peered":"2024-03-16T07:29:33.841098+0000","last_unstale":"2024-03-16T07:29:52.239241+0000","last_undegraded":"2024-03-16T07:29:52.239241+0000","last_fullsized":"2024-03-16T07:29:52.239241+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:11:40.760659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":20,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.253770+0000","last_change":"2024-03-16T07:29:33.149360+0000","last_active":"2024-03-16T07:29:52.253770+0000","last_peered":"2024-03-16T07:29:52.253770+0000","last_clean":"2024-03-16T07:29:52.253770+0000","last_became_active":"2024-03-16T07:29:33.148940+0000","last_became_peered":"2024-03-16T07:29:33.148940+0000","last_unstale":"2024-03-16T07:29:52.253770+0000","last_undegraded":"2024-03-16T07:29:52.253770+0000","last_fullsized":"2024-03-16T07:29:52.253770+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:25:34.455727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.279676+0000","last_change":"2024-03-16T07:29:52.278905+0000","last_active":"2024-03-16T07:29:52.279676+0000","last_peered":"2024-03-16T07:29:52.279676+0000","last_clean":"2024-03-16T07:29:52.279676+0000","last_became_active":"2024-03-16T07:29:52.278661+0000","last_became_peered":"2024-03-16T07:29:52.278661+0000","last_unstale":"2024-03-16T07:29:52.279676+0000","last_undegraded":"2024-03-16T07:29:52.279676+0000","last_fullsized":"2024-03-16T07:29:52.279676+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_clean_scrub_stamp":"2024-03-16T07:29:51.229201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:11:21.869661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"99'1","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.272743+0000","last_change":"2024-03-16T07:29:51.255282+0000","last_active":"2024-03-16T07:29:52.272743+0000","last_peered":"2024-03-16T07:29:52.272743+0000","last_clean":"2024-03-16T07:29:52.272743+0000","last_became_active":"2024-03-16T07:29:51.255036+0000","last_became_peered":"2024-03-16T07:29:51.255036+0000","last_unstale":"2024-03-16T07:29:52.272743+0000","last_undegraded":"2024-03-16T07:29:52.272743+0000","last_fullsized":"2024-03-16T07:29:52.272743+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:50.226649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:50.226649+0000","last_clean_scrub_stamp":"2024-03-16T07:29:50.226649+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:43:34.943745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":18,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.253493+0000","last_change":"2024-03-16T07:29:33.827723+0000","last_active":"2024-03-16T07:29:52.253493+0000","last_peered":"2024-03-16T07:29:52.253493+0000","last_clean":"2024-03-16T07:29:52.253493+0000","last_became_active":"2024-03-16T07:29:33.827484+0000","last_became_peered":"2024-03-16T07:29:33.827484+0000","last_unstale":"2024-03-16T07:29:52.253493+0000","last_undegraded":"2024-03-16T07:29:52.253493+0000","last_fullsized":"2024-03-16T07:29:52.253493+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:36:39.935834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":20,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.238999+0000","last_change":"2024-03-16T07:29:33.147410+0000","last_active":"2024-03-16T07:29:52.238999+0000","last_peered":"2024-03-16T07:29:52.238999+0000","last_clean":"2024-03-16T07:29:52.238999+0000","last_became_active":"2024-03-16T07:29:33.146998+0000","last_became_peered":"2024-03-16T07:29:33.146998+0000","last_unstale":"2024-03-16T07:29:52.238999+0000","last_undegraded":"2024-03-16T07:29:52.238999+0000","last_fullsized":"2024-03-16T07:29:52.238999+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:24:35.197990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.276058+0000","last_change":"2024-03-16T07:29:52.268372+0000","last_active":"2024-03-16T07:29:52.276058+0000","last_peered":"2024-03-16T07:29:52.276058+0000","last_clean":"2024-03-16T07:29:52.276058+0000","last_became_active":"2024-03-16T07:29:52.265686+0000","last_became_peered":"2024-03-16T07:29:52.265686+0000","last_unstale":"2024-03-16T07:29:52.276058+0000","last_undegraded":"2024-03-16T07:29:52.276058+0000","last_fullsized":"2024-03-16T07:29:52.276058+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_clean_scrub_stamp":"2024-03-16T07:29:51.229201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:30:00.135629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.15","version":"99'3","reported_seq":15,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.281238+0000","last_change":"2024-03-16T07:29:51.261374+0000","last_active":"2024-03-16T07:29:52.281238+0000","last_peered":"2024-03-16T07:29:52.281238+0000","last_clean":"2024-03-16T07:29:52.281238+0000","last_became_active":"2024-03-16T07:29:51.261154+0000","last_became_peered":"2024-03-16T07:29:51.261154+0000","last_unstale":"2024-03-16T07:29:52.281238+0000","last_undegraded":"2024-03-16T07:29:52.281238+0000","last_fullsized":"2024-03-16T07:29:52.281238+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:50.226649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:50.226649+0000","last_clean_scrub_stamp":"2024-03-16T07:29:50.226649+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:57:24.904631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":18,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.248826+0000","last_change":"2024-03-16T07:29:33.828079+0000","last_active":"2024-03-16T07:29:52.248826+0000","last_peered":"2024-03-16T07:29:52.248826+0000","last_clean":"2024-03-16T07:29:52.248826+0000","last_became_active":"2024-03-16T07:29:33.827356+0000","last_became_peered":"2024-03-16T07:29:33.827356+0000","last_unstale":"2024-03-16T07:29:52.248826+0000","last_undegraded":"2024-03-16T07:29:52.248826+0000","last_fullsized":"2024-03-16T07:29:52.248826+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:54:56.120560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":20,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.248788+0000","last_change":"2024-03-16T07:29:33.145570+0000","last_active":"2024-03-16T07:29:52.248788+0000","last_peered":"2024-03-16T07:29:52.248788+0000","last_clean":"2024-03-16T07:29:52.248788+0000","last_became_active":"2024-03-16T07:29:33.145332+0000","last_became_peered":"2024-03-16T07:29:33.145332+0000","last_unstale":"2024-03-16T07:29:52.248788+0000","last_undegraded":"2024-03-16T07:29:52.248788+0000","last_fullsized":"2024-03-16T07:29:52.248788+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:40:36.601881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.260391+0000","last_change":"2024-03-16T07:29:52.258292+0000","last_active":"2024-03-16T07:29:52.260391+0000","last_peered":"2024-03-16T07:29:52.260391+0000","last_clean":"2024-03-16T07:29:52.260391+0000","last_became_active":"2024-03-16T07:29:52.257530+0000","last_became_peered":"2024-03-16T07:29:52.257530+0000","last_unstale":"2024-03-16T07:29:52.260391+0000","last_undegraded":"2024-03-16T07:29:52.260391+0000","last_fullsized":"2024-03-16T07:29:52.260391+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_clean_scrub_stamp":"2024-03-16T07:29:51.229201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:24:54.304095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.14","version":"99'6","reported_seq":18,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.284260+0000","last_change":"2024-03-16T07:29:51.251619+0000","last_active":"2024-03-16T07:29:52.284260+0000","last_peered":"2024-03-16T07:29:52.284260+0000","last_clean":"2024-03-16T07:29:52.284260+0000","last_became_active":"2024-03-16T07:29:51.251334+0000","last_became_peered":"2024-03-16T07:29:51.251334+0000","last_unstale":"2024-03-16T07:29:52.284260+0000","last_undegraded":"2024-03-16T07:29:52.284260+0000","last_fullsized":"2024-03-16T07:29:52.284260+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:50.226649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:50.226649+0000","last_clean_scrub_stamp":"2024-03-16T07:29:50.226649+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:00:42.189679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":18,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.247863+0000","last_change":"2024-03-16T07:29:33.834489+0000","last_active":"2024-03-16T07:29:52.247863+0000","last_peered":"2024-03-16T07:29:52.247863+0000","last_clean":"2024-03-16T07:29:52.247863+0000","last_became_active":"2024-03-16T07:29:33.833930+0000","last_became_peered":"2024-03-16T07:29:33.833930+0000","last_unstale":"2024-03-16T07:29:52.247863+0000","last_undegraded":"2024-03-16T07:29:52.247863+0000","last_fullsized":"2024-03-16T07:29:52.247863+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:03:50.654257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":20,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.249138+0000","last_change":"2024-03-16T07:29:33.145151+0000","last_active":"2024-03-16T07:29:52.249138+0000","last_peered":"2024-03-16T07:29:52.249138+0000","last_clean":"2024-03-16T07:29:52.249138+0000","last_became_active":"2024-03-16T07:29:33.144911+0000","last_became_peered":"2024-03-16T07:29:33.144911+0000","last_unstale":"2024-03-16T07:29:52.249138+0000","last_undegraded":"2024-03-16T07:29:52.249138+0000","last_fullsized":"2024-03-16T07:29:52.249138+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:03:36.227557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.279600+0000","last_change":"2024-03-16T07:29:52.275818+0000","last_active":"2024-03-16T07:29:52.279600+0000","last_peered":"2024-03-16T07:29:52.279600+0000","last_clean":"2024-03-16T07:29:52.279600+0000","last_became_active":"2024-03-16T07:29:52.275245+0000","last_became_peered":"2024-03-16T07:29:52.275245+0000","last_unstale":"2024-03-16T07:29:52.279600+0000","last_undegraded":"2024-03-16T07:29:52.279600+0000","last_fullsized":"2024-03-16T07:29:52.279600+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_clean_scrub_stamp":"2024-03-16T07:29:51.229201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:37:39.294970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.240423+0000","last_change":"2024-03-16T07:29:51.246351+0000","last_active":"2024-03-16T07:29:52.240423+0000","last_peered":"2024-03-16T07:29:52.240423+0000","last_clean":"2024-03-16T07:29:52.240423+0000","last_became_active":"2024-03-16T07:29:51.245991+0000","last_became_peered":"2024-03-16T07:29:51.245991+0000","last_unstale":"2024-03-16T07:29:52.240423+0000","last_undegraded":"2024-03-16T07:29:52.240423+0000","last_fullsized":"2024-03-16T07:29:52.240423+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:50.226649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:50.226649+0000","last_clean_scrub_stamp":"2024-03-16T07:29:50.226649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:31:30.343227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":18,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.253905+0000","last_change":"2024-03-16T07:29:33.826510+0000","last_active":"2024-03-16T07:29:52.253905+0000","last_peered":"2024-03-16T07:29:52.253905+0000","last_clean":"2024-03-16T07:29:52.253905+0000","last_became_active":"2024-03-16T07:29:33.826046+0000","last_became_peered":"2024-03-16T07:29:33.826046+0000","last_unstale":"2024-03-16T07:29:52.253905+0000","last_undegraded":"2024-03-16T07:29:52.253905+0000","last_fullsized":"2024-03-16T07:29:52.253905+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:36:53.332020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.15","version":"95'3","reported_seq":23,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.242696+0000","last_change":"2024-03-16T07:29:33.145719+0000","last_active":"2024-03-16T07:29:52.242696+0000","last_peered":"2024-03-16T07:29:52.242696+0000","last_clean":"2024-03-16T07:29:52.242696+0000","last_became_active":"2024-03-16T07:29:33.141978+0000","last_became_peered":"2024-03-16T07:29:33.141978+0000","last_unstale":"2024-03-16T07:29:52.242696+0000","last_undegraded":"2024-03-16T07:29:52.242696+0000","last_fullsized":"2024-03-16T07:29:52.242696+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:00:24.086126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.271943+0000","last_change":"2024-03-16T07:29:52.267088+0000","last_active":"2024-03-16T07:29:52.271943+0000","last_peered":"2024-03-16T07:29:52.271943+0000","last_clean":"2024-03-16T07:29:52.271943+0000","last_became_active":"2024-03-16T07:29:52.266829+0000","last_became_peered":"2024-03-16T07:29:52.266829+0000","last_unstale":"2024-03-16T07:29:52.271943+0000","last_undegraded":"2024-03-16T07:29:52.271943+0000","last_fullsized":"2024-03-16T07:29:52.271943+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_clean_scrub_stamp":"2024-03-16T07:29:51.229201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:20:02.125493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.240466+0000","last_change":"2024-03-16T07:29:51.255852+0000","last_active":"2024-03-16T07:29:52.240466+0000","last_peered":"2024-03-16T07:29:52.240466+0000","last_clean":"2024-03-16T07:29:52.240466+0000","last_became_active":"2024-03-16T07:29:51.255588+0000","last_became_peered":"2024-03-16T07:29:51.255588+0000","last_unstale":"2024-03-16T07:29:52.240466+0000","last_undegraded":"2024-03-16T07:29:52.240466+0000","last_fullsized":"2024-03-16T07:29:52.240466+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:50.226649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:50.226649+0000","last_clean_scrub_stamp":"2024-03-16T07:29:50.226649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:59:39.170816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":18,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.248555+0000","last_change":"2024-03-16T07:29:33.828756+0000","last_active":"2024-03-16T07:29:52.248555+0000","last_peered":"2024-03-16T07:29:52.248555+0000","last_clean":"2024-03-16T07:29:52.248555+0000","last_became_active":"2024-03-16T07:29:33.828504+0000","last_became_peered":"2024-03-16T07:29:33.828504+0000","last_unstale":"2024-03-16T07:29:52.248555+0000","last_undegraded":"2024-03-16T07:29:52.248555+0000","last_fullsized":"2024-03-16T07:29:52.248555+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:18:47.890723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.14","version":"96'8","reported_seq":28,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.241861+0000","last_change":"2024-03-16T07:29:33.143457+0000","last_active":"2024-03-16T07:29:52.241861+0000","last_peered":"2024-03-16T07:29:52.241861+0000","last_clean":"2024-03-16T07:29:52.241861+0000","last_became_active":"2024-03-16T07:29:33.143020+0000","last_became_peered":"2024-03-16T07:29:33.143020+0000","last_unstale":"2024-03-16T07:29:52.241861+0000","last_undegraded":"2024-03-16T07:29:52.241861+0000","last_fullsized":"2024-03-16T07:29:52.241861+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:57:06.801078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3309,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.260536+0000","last_change":"2024-03-16T07:29:52.260030+0000","last_active":"2024-03-16T07:29:52.260536+0000","last_peered":"2024-03-16T07:29:52.260536+0000","last_clean":"2024-03-16T07:29:52.260536+0000","last_became_active":"2024-03-16T07:29:52.258521+0000","last_became_peered":"2024-03-16T07:29:52.258521+0000","last_unstale":"2024-03-16T07:29:52.260536+0000","last_undegraded":"2024-03-16T07:29:52.260536+0000","last_fullsized":"2024-03-16T07:29:52.260536+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_clean_scrub_stamp":"2024-03-16T07:29:51.229201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:04:22.252526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.254065+0000","last_change":"2024-03-16T07:29:51.251721+0000","last_active":"2024-03-16T07:29:52.254065+0000","last_peered":"2024-03-16T07:29:52.254065+0000","last_clean":"2024-03-16T07:29:52.254065+0000","last_became_active":"2024-03-16T07:29:51.251494+0000","last_became_peered":"2024-03-16T07:29:51.251494+0000","last_unstale":"2024-03-16T07:29:52.254065+0000","last_undegraded":"2024-03-16T07:29:52.254065+0000","last_fullsized":"2024-03-16T07:29:52.254065+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:50.226649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:50.226649+0000","last_clean_scrub_stamp":"2024-03-16T07:29:50.226649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:35:49.442804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":18,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.251908+0000","last_change":"2024-03-16T07:29:33.832881+0000","last_active":"2024-03-16T07:29:52.251908+0000","last_peered":"2024-03-16T07:29:52.251908+0000","last_clean":"2024-03-16T07:29:52.251908+0000","last_became_active":"2024-03-16T07:29:33.832193+0000","last_became_peered":"2024-03-16T07:29:33.832193+0000","last_unstale":"2024-03-16T07:29:52.251908+0000","last_undegraded":"2024-03-16T07:29:52.251908+0000","last_fullsized":"2024-03-16T07:29:52.251908+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:59:00.106225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.13","version":"95'2","reported_seq":22,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.245547+0000","last_change":"2024-03-16T07:29:33.150475+0000","last_active":"2024-03-16T07:29:52.245547+0000","last_peered":"2024-03-16T07:29:52.245547+0000","last_clean":"2024-03-16T07:29:52.245547+0000","last_became_active":"2024-03-16T07:29:33.150220+0000","last_became_peered":"2024-03-16T07:29:33.150220+0000","last_unstale":"2024-03-16T07:29:52.245547+0000","last_undegraded":"2024-03-16T07:29:52.245547+0000","last_fullsized":"2024-03-16T07:29:52.245547+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:13:34.679310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.273031+0000","last_change":"2024-03-16T07:29:52.267975+0000","last_active":"2024-03-16T07:29:52.273031+0000","last_peered":"2024-03-16T07:29:52.273031+0000","last_clean":"2024-03-16T07:29:52.273031+0000","last_became_active":"2024-03-16T07:29:52.267585+0000","last_became_peered":"2024-03-16T07:29:52.267585+0000","last_unstale":"2024-03-16T07:29:52.273031+0000","last_undegraded":"2024-03-16T07:29:52.273031+0000","last_fullsized":"2024-03-16T07:29:52.273031+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_clean_scrub_stamp":"2024-03-16T07:29:51.229201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:46:36.232905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.10","version":"99'8","reported_seq":20,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.287380+0000","last_change":"2024-03-16T07:29:51.241850+0000","last_active":"2024-03-16T07:29:52.287380+0000","last_peered":"2024-03-16T07:29:52.287380+0000","last_clean":"2024-03-16T07:29:52.287380+0000","last_became_active":"2024-03-16T07:29:51.241603+0000","last_became_peered":"2024-03-16T07:29:51.241603+0000","last_unstale":"2024-03-16T07:29:52.287380+0000","last_undegraded":"2024-03-16T07:29:52.287380+0000","last_fullsized":"2024-03-16T07:29:52.287380+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:50.226649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:50.226649+0000","last_clean_scrub_stamp":"2024-03-16T07:29:50.226649+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:20:05.631350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":18,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.243007+0000","last_change":"2024-03-16T07:29:33.838359+0000","last_active":"2024-03-16T07:29:52.243007+0000","last_peered":"2024-03-16T07:29:52.243007+0000","last_clean":"2024-03-16T07:29:52.243007+0000","last_became_active":"2024-03-16T07:29:33.837087+0000","last_became_peered":"2024-03-16T07:29:33.837087+0000","last_unstale":"2024-03-16T07:29:52.243007+0000","last_undegraded":"2024-03-16T07:29:52.243007+0000","last_fullsized":"2024-03-16T07:29:52.243007+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:48:58.147020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":20,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.247019+0000","last_change":"2024-03-16T07:29:33.144891+0000","last_active":"2024-03-16T07:29:52.247019+0000","last_peered":"2024-03-16T07:29:52.247019+0000","last_clean":"2024-03-16T07:29:52.247019+0000","last_became_active":"2024-03-16T07:29:33.144574+0000","last_became_peered":"2024-03-16T07:29:33.144574+0000","last_unstale":"2024-03-16T07:29:52.247019+0000","last_undegraded":"2024-03-16T07:29:52.247019+0000","last_fullsized":"2024-03-16T07:29:52.247019+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:31:24.149667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.285659+0000","last_change":"2024-03-16T07:29:52.285214+0000","last_active":"2024-03-16T07:29:52.285659+0000","last_peered":"2024-03-16T07:29:52.285659+0000","last_clean":"2024-03-16T07:29:52.285659+0000","last_became_active":"2024-03-16T07:29:52.284822+0000","last_became_peered":"2024-03-16T07:29:52.284822+0000","last_unstale":"2024-03-16T07:29:52.285659+0000","last_undegraded":"2024-03-16T07:29:52.285659+0000","last_fullsized":"2024-03-16T07:29:52.285659+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_clean_scrub_stamp":"2024-03-16T07:29:51.229201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:20:25.515903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.248531+0000","last_change":"2024-03-16T07:29:51.260603+0000","last_active":"2024-03-16T07:29:52.248531+0000","last_peered":"2024-03-16T07:29:52.248531+0000","last_clean":"2024-03-16T07:29:52.248531+0000","last_became_active":"2024-03-16T07:29:51.260310+0000","last_became_peered":"2024-03-16T07:29:51.260310+0000","last_unstale":"2024-03-16T07:29:52.248531+0000","last_undegraded":"2024-03-16T07:29:52.248531+0000","last_fullsized":"2024-03-16T07:29:52.248531+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:50.226649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:50.226649+0000","last_clean_scrub_stamp":"2024-03-16T07:29:50.226649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:24:53.301543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":18,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.253600+0000","last_change":"2024-03-16T07:29:33.826012+0000","last_active":"2024-03-16T07:29:52.253600+0000","last_peered":"2024-03-16T07:29:52.253600+0000","last_clean":"2024-03-16T07:29:52.253600+0000","last_became_active":"2024-03-16T07:29:33.825764+0000","last_became_peered":"2024-03-16T07:29:33.825764+0000","last_unstale":"2024-03-16T07:29:52.253600+0000","last_undegraded":"2024-03-16T07:29:52.253600+0000","last_fullsized":"2024-03-16T07:29:52.253600+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:12:38.743934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.10","version":"95'8","reported_seq":28,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.246144+0000","last_change":"2024-03-16T07:29:33.147235+0000","last_active":"2024-03-16T07:29:52.246144+0000","last_peered":"2024-03-16T07:29:52.246144+0000","last_clean":"2024-03-16T07:29:52.246144+0000","last_became_active":"2024-03-16T07:29:33.146884+0000","last_became_peered":"2024-03-16T07:29:33.146884+0000","last_unstale":"2024-03-16T07:29:52.246144+0000","last_undegraded":"2024-03-16T07:29:52.246144+0000","last_fullsized":"2024-03-16T07:29:52.246144+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:53:29.098123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.279326+0000","last_change":"2024-03-16T07:29:52.277964+0000","last_active":"2024-03-16T07:29:52.279326+0000","last_peered":"2024-03-16T07:29:52.279326+0000","last_clean":"2024-03-16T07:29:52.279326+0000","last_became_active":"2024-03-16T07:29:52.275757+0000","last_became_peered":"2024-03-16T07:29:52.275757+0000","last_unstale":"2024-03-16T07:29:52.279326+0000","last_undegraded":"2024-03-16T07:29:52.279326+0000","last_fullsized":"2024-03-16T07:29:52.279326+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_clean_scrub_stamp":"2024-03-16T07:29:51.229201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:22:02.578710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.d","version":"99'1","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.272644+0000","last_change":"2024-03-16T07:29:51.256824+0000","last_active":"2024-03-16T07:29:52.272644+0000","last_peered":"2024-03-16T07:29:52.272644+0000","last_clean":"2024-03-16T07:29:52.272644+0000","last_became_active":"2024-03-16T07:29:51.256429+0000","last_became_peered":"2024-03-16T07:29:51.256429+0000","last_unstale":"2024-03-16T07:29:52.272644+0000","last_undegraded":"2024-03-16T07:29:52.272644+0000","last_fullsized":"2024-03-16T07:29:52.272644+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:50.226649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:50.226649+0000","last_clean_scrub_stamp":"2024-03-16T07:29:50.226649+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:04:15.242366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":18,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.248925+0000","last_change":"2024-03-16T07:29:33.833822+0000","last_active":"2024-03-16T07:29:52.248925+0000","last_peered":"2024-03-16T07:29:52.248925+0000","last_clean":"2024-03-16T07:29:52.248925+0000","last_became_active":"2024-03-16T07:29:33.833492+0000","last_became_peered":"2024-03-16T07:29:33.833492+0000","last_unstale":"2024-03-16T07:29:52.248925+0000","last_undegraded":"2024-03-16T07:29:52.248925+0000","last_fullsized":"2024-03-16T07:29:52.248925+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:44:43.786263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"95'1","reported_seq":21,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.244183+0000","last_change":"2024-03-16T07:29:33.142821+0000","last_active":"2024-03-16T07:29:52.244183+0000","last_peered":"2024-03-16T07:29:52.244183+0000","last_clean":"2024-03-16T07:29:52.244183+0000","last_became_active":"2024-03-16T07:29:33.142350+0000","last_became_peered":"2024-03-16T07:29:33.142350+0000","last_unstale":"2024-03-16T07:29:52.244183+0000","last_undegraded":"2024-03-16T07:29:52.244183+0000","last_fullsized":"2024-03-16T07:29:52.244183+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:32:31.039690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.266226+0000","last_change":"2024-03-16T07:29:52.262717+0000","last_active":"2024-03-16T07:29:52.266226+0000","last_peered":"2024-03-16T07:29:52.266226+0000","last_clean":"2024-03-16T07:29:52.266226+0000","last_became_active":"2024-03-16T07:29:52.262479+0000","last_became_peered":"2024-03-16T07:29:52.262479+0000","last_unstale":"2024-03-16T07:29:52.266226+0000","last_undegraded":"2024-03-16T07:29:52.266226+0000","last_fullsized":"2024-03-16T07:29:52.266226+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_clean_scrub_stamp":"2024-03-16T07:29:51.229201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:29:45.248666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.247382+0000","last_change":"2024-03-16T07:29:51.253879+0000","last_active":"2024-03-16T07:29:52.247382+0000","last_peered":"2024-03-16T07:29:52.247382+0000","last_clean":"2024-03-16T07:29:52.247382+0000","last_became_active":"2024-03-16T07:29:51.253651+0000","last_became_peered":"2024-03-16T07:29:51.253651+0000","last_unstale":"2024-03-16T07:29:52.247382+0000","last_undegraded":"2024-03-16T07:29:52.247382+0000","last_fullsized":"2024-03-16T07:29:52.247382+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:50.226649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:50.226649+0000","last_clean_scrub_stamp":"2024-03-16T07:29:50.226649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:32:49.143242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":18,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.255819+0000","last_change":"2024-03-16T07:29:33.835641+0000","last_active":"2024-03-16T07:29:52.255819+0000","last_peered":"2024-03-16T07:29:52.255819+0000","last_clean":"2024-03-16T07:29:52.255819+0000","last_became_active":"2024-03-16T07:29:33.835125+0000","last_became_peered":"2024-03-16T07:29:33.835125+0000","last_unstale":"2024-03-16T07:29:52.255819+0000","last_undegraded":"2024-03-16T07:29:52.255819+0000","last_fullsized":"2024-03-16T07:29:52.255819+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:45:54.158424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.e","version":"95'2","reported_seq":22,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.249251+0000","last_change":"2024-03-16T07:29:33.149722+0000","last_active":"2024-03-16T07:29:52.249251+0000","last_peered":"2024-03-16T07:29:52.249251+0000","last_clean":"2024-03-16T07:29:52.249251+0000","last_became_active":"2024-03-16T07:29:33.149431+0000","last_became_peered":"2024-03-16T07:29:33.149431+0000","last_unstale":"2024-03-16T07:29:52.249251+0000","last_undegraded":"2024-03-16T07:29:52.249251+0000","last_fullsized":"2024-03-16T07:29:52.249251+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:06:39.605745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.282780+0000","last_change":"2024-03-16T07:29:52.282138+0000","last_active":"2024-03-16T07:29:52.282780+0000","last_peered":"2024-03-16T07:29:52.282780+0000","last_clean":"2024-03-16T07:29:52.282780+0000","last_became_active":"2024-03-16T07:29:52.281863+0000","last_became_peered":"2024-03-16T07:29:52.281863+0000","last_unstale":"2024-03-16T07:29:52.282780+0000","last_undegraded":"2024-03-16T07:29:52.282780+0000","last_fullsized":"2024-03-16T07:29:52.282780+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_clean_scrub_stamp":"2024-03-16T07:29:51.229201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:34:35.152966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.f","version":"99'1","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.271574+0000","last_change":"2024-03-16T07:29:51.259680+0000","last_active":"2024-03-16T07:29:52.271574+0000","last_peered":"2024-03-16T07:29:52.271574+0000","last_clean":"2024-03-16T07:29:52.271574+0000","last_became_active":"2024-03-16T07:29:51.259421+0000","last_became_peered":"2024-03-16T07:29:51.259421+0000","last_unstale":"2024-03-16T07:29:52.271574+0000","last_undegraded":"2024-03-16T07:29:52.271574+0000","last_fullsized":"2024-03-16T07:29:52.271574+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:50.226649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:50.226649+0000","last_clean_scrub_stamp":"2024-03-16T07:29:50.226649+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:36:49.269822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":18,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.241748+0000","last_change":"2024-03-16T07:29:33.838194+0000","last_active":"2024-03-16T07:29:52.241748+0000","last_peered":"2024-03-16T07:29:52.241748+0000","last_clean":"2024-03-16T07:29:52.241748+0000","last_became_active":"2024-03-16T07:29:33.837894+0000","last_became_peered":"2024-03-16T07:29:33.837894+0000","last_unstale":"2024-03-16T07:29:52.241748+0000","last_undegraded":"2024-03-16T07:29:52.241748+0000","last_fullsized":"2024-03-16T07:29:52.241748+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:45:22.148380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.d","version":"95'1","reported_seq":21,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.242808+0000","last_change":"2024-03-16T07:29:33.142518+0000","last_active":"2024-03-16T07:29:52.242808+0000","last_peered":"2024-03-16T07:29:52.242808+0000","last_clean":"2024-03-16T07:29:52.242808+0000","last_became_active":"2024-03-16T07:29:33.141657+0000","last_became_peered":"2024-03-16T07:29:33.141657+0000","last_unstale":"2024-03-16T07:29:52.242808+0000","last_undegraded":"2024-03-16T07:29:52.242808+0000","last_fullsized":"2024-03-16T07:29:52.242808+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:35:31.339252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.279794+0000","last_change":"2024-03-16T07:29:52.276838+0000","last_active":"2024-03-16T07:29:52.279794+0000","last_peered":"2024-03-16T07:29:52.279794+0000","last_clean":"2024-03-16T07:29:52.279794+0000","last_became_active":"2024-03-16T07:29:52.275552+0000","last_became_peered":"2024-03-16T07:29:52.275552+0000","last_unstale":"2024-03-16T07:29:52.279794+0000","last_undegraded":"2024-03-16T07:29:52.279794+0000","last_fullsized":"2024-03-16T07:29:52.279794+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_clean_scrub_stamp":"2024-03-16T07:29:51.229201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:41:53.607140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"99'2","reported_seq":14,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.271673+0000","last_change":"2024-03-16T07:29:51.255445+0000","last_active":"2024-03-16T07:29:52.271673+0000","last_peered":"2024-03-16T07:29:52.271673+0000","last_clean":"2024-03-16T07:29:52.271673+0000","last_became_active":"2024-03-16T07:29:51.255204+0000","last_became_peered":"2024-03-16T07:29:51.255204+0000","last_unstale":"2024-03-16T07:29:52.271673+0000","last_undegraded":"2024-03-16T07:29:52.271673+0000","last_fullsized":"2024-03-16T07:29:52.271673+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:50.226649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:50.226649+0000","last_clean_scrub_stamp":"2024-03-16T07:29:50.226649+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:05:44.369221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":18,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.242600+0000","last_change":"2024-03-16T07:29:33.840969+0000","last_active":"2024-03-16T07:29:52.242600+0000","last_peered":"2024-03-16T07:29:52.242600+0000","last_clean":"2024-03-16T07:29:52.242600+0000","last_became_active":"2024-03-16T07:29:33.840483+0000","last_became_peered":"2024-03-16T07:29:33.840483+0000","last_unstale":"2024-03-16T07:29:52.242600+0000","last_undegraded":"2024-03-16T07:29:52.242600+0000","last_fullsized":"2024-03-16T07:29:52.242600+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:06:46.263899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":20,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.241883+0000","last_change":"2024-03-16T07:29:33.143262+0000","last_active":"2024-03-16T07:29:52.241883+0000","last_peered":"2024-03-16T07:29:52.241883+0000","last_clean":"2024-03-16T07:29:52.241883+0000","last_became_active":"2024-03-16T07:29:33.142682+0000","last_became_peered":"2024-03-16T07:29:33.142682+0000","last_unstale":"2024-03-16T07:29:52.241883+0000","last_undegraded":"2024-03-16T07:29:52.241883+0000","last_fullsized":"2024-03-16T07:29:52.241883+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:48:35.046334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.260134+0000","last_change":"2024-03-16T07:29:52.258113+0000","last_active":"2024-03-16T07:29:52.260134+0000","last_peered":"2024-03-16T07:29:52.260134+0000","last_clean":"2024-03-16T07:29:52.260134+0000","last_became_active":"2024-03-16T07:29:52.256431+0000","last_became_peered":"2024-03-16T07:29:52.256431+0000","last_unstale":"2024-03-16T07:29:52.260134+0000","last_undegraded":"2024-03-16T07:29:52.260134+0000","last_fullsized":"2024-03-16T07:29:52.260134+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_clean_scrub_stamp":"2024-03-16T07:29:51.229201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:57:25.907183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.249171+0000","last_change":"2024-03-16T07:29:51.253861+0000","last_active":"2024-03-16T07:29:52.249171+0000","last_peered":"2024-03-16T07:29:52.249171+0000","last_clean":"2024-03-16T07:29:52.249171+0000","last_became_active":"2024-03-16T07:29:51.253596+0000","last_became_peered":"2024-03-16T07:29:51.253596+0000","last_unstale":"2024-03-16T07:29:52.249171+0000","last_undegraded":"2024-03-16T07:29:52.249171+0000","last_fullsized":"2024-03-16T07:29:52.249171+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:50.226649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:50.226649+0000","last_clean_scrub_stamp":"2024-03-16T07:29:50.226649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:04:21.249974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":18,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.246788+0000","last_change":"2024-03-16T07:29:33.827189+0000","last_active":"2024-03-16T07:29:52.246788+0000","last_peered":"2024-03-16T07:29:52.246788+0000","last_clean":"2024-03-16T07:29:52.246788+0000","last_became_active":"2024-03-16T07:29:33.826953+0000","last_became_peered":"2024-03-16T07:29:33.826953+0000","last_unstale":"2024-03-16T07:29:52.246788+0000","last_undegraded":"2024-03-16T07:29:52.246788+0000","last_fullsized":"2024-03-16T07:29:52.246788+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:34:19.104829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.b","version":"95'2","reported_seq":22,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.245656+0000","last_change":"2024-03-16T07:29:33.147427+0000","last_active":"2024-03-16T07:29:52.245656+0000","last_peered":"2024-03-16T07:29:52.245656+0000","last_clean":"2024-03-16T07:29:52.245656+0000","last_became_active":"2024-03-16T07:29:33.147011+0000","last_became_peered":"2024-03-16T07:29:33.147011+0000","last_unstale":"2024-03-16T07:29:52.245656+0000","last_undegraded":"2024-03-16T07:29:52.245656+0000","last_fullsized":"2024-03-16T07:29:52.245656+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:11:47.544575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.265144+0000","last_change":"2024-03-16T07:29:52.264177+0000","last_active":"2024-03-16T07:29:52.265144+0000","last_peered":"2024-03-16T07:29:52.265144+0000","last_clean":"2024-03-16T07:29:52.265144+0000","last_became_active":"2024-03-16T07:29:52.263871+0000","last_became_peered":"2024-03-16T07:29:52.263871+0000","last_unstale":"2024-03-16T07:29:52.265144+0000","last_undegraded":"2024-03-16T07:29:52.265144+0000","last_fullsized":"2024-03-16T07:29:52.265144+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_clean_scrub_stamp":"2024-03-16T07:29:51.229201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:29:43.798522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.238449+0000","last_change":"2024-03-16T07:29:51.241781+0000","last_active":"2024-03-16T07:29:52.238449+0000","last_peered":"2024-03-16T07:29:52.238449+0000","last_clean":"2024-03-16T07:29:52.238449+0000","last_became_active":"2024-03-16T07:29:51.241321+0000","last_became_peered":"2024-03-16T07:29:51.241321+0000","last_unstale":"2024-03-16T07:29:52.238449+0000","last_undegraded":"2024-03-16T07:29:52.238449+0000","last_fullsized":"2024-03-16T07:29:52.238449+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:50.226649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:50.226649+0000","last_clean_scrub_stamp":"2024-03-16T07:29:50.226649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:09:18.008626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":18,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.243089+0000","last_change":"2024-03-16T07:29:33.838647+0000","last_active":"2024-03-16T07:29:52.243089+0000","last_peered":"2024-03-16T07:29:52.243089+0000","last_clean":"2024-03-16T07:29:52.243089+0000","last_became_active":"2024-03-16T07:29:33.838049+0000","last_became_peered":"2024-03-16T07:29:33.838049+0000","last_unstale":"2024-03-16T07:29:52.243089+0000","last_undegraded":"2024-03-16T07:29:52.243089+0000","last_fullsized":"2024-03-16T07:29:52.243089+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:56:26.058572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":20,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.252445+0000","last_change":"2024-03-16T07:29:33.152620+0000","last_active":"2024-03-16T07:29:52.252445+0000","last_peered":"2024-03-16T07:29:52.252445+0000","last_clean":"2024-03-16T07:29:52.252445+0000","last_became_active":"2024-03-16T07:29:33.152352+0000","last_became_peered":"2024-03-16T07:29:33.152352+0000","last_unstale":"2024-03-16T07:29:52.252445+0000","last_undegraded":"2024-03-16T07:29:52.252445+0000","last_fullsized":"2024-03-16T07:29:52.252445+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:38:26.656813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.276065+0000","last_change":"2024-03-16T07:29:52.274900+0000","last_active":"2024-03-16T07:29:52.276065+0000","last_peered":"2024-03-16T07:29:52.276065+0000","last_clean":"2024-03-16T07:29:52.276065+0000","last_became_active":"2024-03-16T07:29:52.274644+0000","last_became_peered":"2024-03-16T07:29:52.274644+0000","last_unstale":"2024-03-16T07:29:52.276065+0000","last_undegraded":"2024-03-16T07:29:52.276065+0000","last_fullsized":"2024-03-16T07:29:52.276065+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_clean_scrub_stamp":"2024-03-16T07:29:51.229201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:26:55.625129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.b","version":"99'2","reported_seq":14,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.282850+0000","last_change":"2024-03-16T07:29:51.258873+0000","last_active":"2024-03-16T07:29:52.282850+0000","last_peered":"2024-03-16T07:29:52.282850+0000","last_clean":"2024-03-16T07:29:52.282850+0000","last_became_active":"2024-03-16T07:29:51.258008+0000","last_became_peered":"2024-03-16T07:29:51.258008+0000","last_unstale":"2024-03-16T07:29:52.282850+0000","last_undegraded":"2024-03-16T07:29:52.282850+0000","last_fullsized":"2024-03-16T07:29:52.282850+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:50.226649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:50.226649+0000","last_clean_scrub_stamp":"2024-03-16T07:29:50.226649+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:57:23.624463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":18,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.238734+0000","last_change":"2024-03-16T07:29:33.831988+0000","last_active":"2024-03-16T07:29:52.238734+0000","last_peered":"2024-03-16T07:29:52.238734+0000","last_clean":"2024-03-16T07:29:52.238734+0000","last_became_active":"2024-03-16T07:29:33.831702+0000","last_became_peered":"2024-03-16T07:29:33.831702+0000","last_unstale":"2024-03-16T07:29:52.238734+0000","last_undegraded":"2024-03-16T07:29:52.238734+0000","last_fullsized":"2024-03-16T07:29:52.238734+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:42:04.449559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":20,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.253853+0000","last_change":"2024-03-16T07:29:33.147855+0000","last_active":"2024-03-16T07:29:52.253853+0000","last_peered":"2024-03-16T07:29:52.253853+0000","last_clean":"2024-03-16T07:29:52.253853+0000","last_became_active":"2024-03-16T07:29:33.147615+0000","last_became_peered":"2024-03-16T07:29:33.147615+0000","last_unstale":"2024-03-16T07:29:52.253853+0000","last_undegraded":"2024-03-16T07:29:52.253853+0000","last_fullsized":"2024-03-16T07:29:52.253853+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:20:44.698184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.260285+0000","last_change":"2024-03-16T07:29:52.258806+0000","last_active":"2024-03-16T07:29:52.260285+0000","last_peered":"2024-03-16T07:29:52.260285+0000","last_clean":"2024-03-16T07:29:52.260285+0000","last_became_active":"2024-03-16T07:29:52.258567+0000","last_became_peered":"2024-03-16T07:29:52.258567+0000","last_unstale":"2024-03-16T07:29:52.260285+0000","last_undegraded":"2024-03-16T07:29:52.260285+0000","last_fullsized":"2024-03-16T07:29:52.260285+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_clean_scrub_stamp":"2024-03-16T07:29:51.229201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:23:28.691856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.248999+0000","last_change":"2024-03-16T07:29:51.253873+0000","last_active":"2024-03-16T07:29:52.248999+0000","last_peered":"2024-03-16T07:29:52.248999+0000","last_clean":"2024-03-16T07:29:52.248999+0000","last_became_active":"2024-03-16T07:29:51.253636+0000","last_became_peered":"2024-03-16T07:29:51.253636+0000","last_unstale":"2024-03-16T07:29:52.248999+0000","last_undegraded":"2024-03-16T07:29:52.248999+0000","last_fullsized":"2024-03-16T07:29:52.248999+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:50.226649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:50.226649+0000","last_clean_scrub_stamp":"2024-03-16T07:29:50.226649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:16:47.872304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":18,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.253686+0000","last_change":"2024-03-16T07:29:33.830959+0000","last_active":"2024-03-16T07:29:52.253686+0000","last_peered":"2024-03-16T07:29:52.253686+0000","last_clean":"2024-03-16T07:29:52.253686+0000","last_became_active":"2024-03-16T07:29:33.830655+0000","last_became_peered":"2024-03-16T07:29:33.830655+0000","last_unstale":"2024-03-16T07:29:52.253686+0000","last_undegraded":"2024-03-16T07:29:52.253686+0000","last_fullsized":"2024-03-16T07:29:52.253686+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:12:04.435282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":20,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.239092+0000","last_change":"2024-03-16T07:29:33.147292+0000","last_active":"2024-03-16T07:29:52.239092+0000","last_peered":"2024-03-16T07:29:52.239092+0000","last_clean":"2024-03-16T07:29:52.239092+0000","last_became_active":"2024-03-16T07:29:33.146227+0000","last_became_peered":"2024-03-16T07:29:33.146227+0000","last_unstale":"2024-03-16T07:29:52.239092+0000","last_undegraded":"2024-03-16T07:29:52.239092+0000","last_fullsized":"2024-03-16T07:29:52.239092+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:23:09.585751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.264998+0000","last_change":"2024-03-16T07:29:52.262876+0000","last_active":"2024-03-16T07:29:52.264998+0000","last_peered":"2024-03-16T07:29:52.264998+0000","last_clean":"2024-03-16T07:29:52.264998+0000","last_became_active":"2024-03-16T07:29:52.262661+0000","last_became_peered":"2024-03-16T07:29:52.262661+0000","last_unstale":"2024-03-16T07:29:52.264998+0000","last_undegraded":"2024-03-16T07:29:52.264998+0000","last_fullsized":"2024-03-16T07:29:52.264998+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_clean_scrub_stamp":"2024-03-16T07:29:51.229201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:35:12.787336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.256771+0000","last_change":"2024-03-16T07:29:51.253233+0000","last_active":"2024-03-16T07:29:52.256771+0000","last_peered":"2024-03-16T07:29:52.256771+0000","last_clean":"2024-03-16T07:29:52.256771+0000","last_became_active":"2024-03-16T07:29:51.252980+0000","last_became_peered":"2024-03-16T07:29:51.252980+0000","last_unstale":"2024-03-16T07:29:52.256771+0000","last_undegraded":"2024-03-16T07:29:52.256771+0000","last_fullsized":"2024-03-16T07:29:52.256771+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:50.226649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:50.226649+0000","last_clean_scrub_stamp":"2024-03-16T07:29:50.226649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:17:42.397143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":18,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.241874+0000","last_change":"2024-03-16T07:29:33.840859+0000","last_active":"2024-03-16T07:29:52.241874+0000","last_peered":"2024-03-16T07:29:52.241874+0000","last_clean":"2024-03-16T07:29:52.241874+0000","last_became_active":"2024-03-16T07:29:33.840311+0000","last_became_peered":"2024-03-16T07:29:33.840311+0000","last_unstale":"2024-03-16T07:29:52.241874+0000","last_undegraded":"2024-03-16T07:29:52.241874+0000","last_fullsized":"2024-03-16T07:29:52.241874+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:35:56.435081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.7","version":"95'2","reported_seq":22,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.255915+0000","last_change":"2024-03-16T07:29:33.150332+0000","last_active":"2024-03-16T07:29:52.255915+0000","last_peered":"2024-03-16T07:29:52.255915+0000","last_clean":"2024-03-16T07:29:52.255915+0000","last_became_active":"2024-03-16T07:29:33.149989+0000","last_became_peered":"2024-03-16T07:29:33.149989+0000","last_unstale":"2024-03-16T07:29:52.255915+0000","last_undegraded":"2024-03-16T07:29:52.255915+0000","last_fullsized":"2024-03-16T07:29:52.255915+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:04:56.622565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.279492+0000","last_change":"2024-03-16T07:29:52.278787+0000","last_active":"2024-03-16T07:29:52.279492+0000","last_peered":"2024-03-16T07:29:52.279492+0000","last_clean":"2024-03-16T07:29:52.279492+0000","last_became_active":"2024-03-16T07:29:52.276271+0000","last_became_peered":"2024-03-16T07:29:52.276271+0000","last_unstale":"2024-03-16T07:29:52.279492+0000","last_undegraded":"2024-03-16T07:29:52.279492+0000","last_fullsized":"2024-03-16T07:29:52.279492+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_clean_scrub_stamp":"2024-03-16T07:29:51.229201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:47:18.381337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.240862+0000","last_change":"2024-03-16T07:29:51.255983+0000","last_active":"2024-03-16T07:29:52.240862+0000","last_peered":"2024-03-16T07:29:52.240862+0000","last_clean":"2024-03-16T07:29:52.240862+0000","last_became_active":"2024-03-16T07:29:51.255738+0000","last_became_peered":"2024-03-16T07:29:51.255738+0000","last_unstale":"2024-03-16T07:29:52.240862+0000","last_undegraded":"2024-03-16T07:29:52.240862+0000","last_fullsized":"2024-03-16T07:29:52.240862+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:50.226649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:50.226649+0000","last_clean_scrub_stamp":"2024-03-16T07:29:50.226649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:57:00.370336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":18,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.244003+0000","last_change":"2024-03-16T07:29:33.826957+0000","last_active":"2024-03-16T07:29:52.244003+0000","last_peered":"2024-03-16T07:29:52.244003+0000","last_clean":"2024-03-16T07:29:52.244003+0000","last_became_active":"2024-03-16T07:29:33.826715+0000","last_became_peered":"2024-03-16T07:29:33.826715+0000","last_unstale":"2024-03-16T07:29:52.244003+0000","last_undegraded":"2024-03-16T07:29:52.244003+0000","last_fullsized":"2024-03-16T07:29:52.244003+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:11:43.923099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.6","version":"96'1","reported_seq":21,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.257626+0000","last_change":"2024-03-16T07:29:33.144113+0000","last_active":"2024-03-16T07:29:52.257626+0000","last_peered":"2024-03-16T07:29:52.257626+0000","last_clean":"2024-03-16T07:29:52.257626+0000","last_became_active":"2024-03-16T07:29:33.140102+0000","last_became_peered":"2024-03-16T07:29:33.140102+0000","last_unstale":"2024-03-16T07:29:52.257626+0000","last_undegraded":"2024-03-16T07:29:52.257626+0000","last_fullsized":"2024-03-16T07:29:52.257626+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:35:05.997178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.275035+0000","last_change":"2024-03-16T07:29:52.273851+0000","last_active":"2024-03-16T07:29:52.275035+0000","last_peered":"2024-03-16T07:29:52.275035+0000","last_clean":"2024-03-16T07:29:52.275035+0000","last_became_active":"2024-03-16T07:29:52.273599+0000","last_became_peered":"2024-03-16T07:29:52.273599+0000","last_unstale":"2024-03-16T07:29:52.275035+0000","last_undegraded":"2024-03-16T07:29:52.275035+0000","last_fullsized":"2024-03-16T07:29:52.275035+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_clean_scrub_stamp":"2024-03-16T07:29:51.229201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:06:00.586416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.7","version":"99'2","reported_seq":14,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.281868+0000","last_change":"2024-03-16T07:29:51.260453+0000","last_active":"2024-03-16T07:29:52.281868+0000","last_peered":"2024-03-16T07:29:52.281868+0000","last_clean":"2024-03-16T07:29:52.281868+0000","last_became_active":"2024-03-16T07:29:51.260220+0000","last_became_peered":"2024-03-16T07:29:51.260220+0000","last_unstale":"2024-03-16T07:29:52.281868+0000","last_undegraded":"2024-03-16T07:29:52.281868+0000","last_fullsized":"2024-03-16T07:29:52.281868+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:50.226649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:50.226649+0000","last_clean_scrub_stamp":"2024-03-16T07:29:50.226649+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:07:06.655300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":18,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.241788+0000","last_change":"2024-03-16T07:29:33.838136+0000","last_active":"2024-03-16T07:29:52.241788+0000","last_peered":"2024-03-16T07:29:52.241788+0000","last_clean":"2024-03-16T07:29:52.241788+0000","last_became_active":"2024-03-16T07:29:33.837685+0000","last_became_peered":"2024-03-16T07:29:33.837685+0000","last_unstale":"2024-03-16T07:29:52.241788+0000","last_undegraded":"2024-03-16T07:29:52.241788+0000","last_fullsized":"2024-03-16T07:29:52.241788+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:45:37.351491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":20,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.242804+0000","last_change":"2024-03-16T07:29:33.145636+0000","last_active":"2024-03-16T07:29:52.242804+0000","last_peered":"2024-03-16T07:29:52.242804+0000","last_clean":"2024-03-16T07:29:52.242804+0000","last_became_active":"2024-03-16T07:29:33.143854+0000","last_became_peered":"2024-03-16T07:29:33.143854+0000","last_unstale":"2024-03-16T07:29:52.242804+0000","last_undegraded":"2024-03-16T07:29:52.242804+0000","last_fullsized":"2024-03-16T07:29:52.242804+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:17:24.293590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.274578+0000","last_change":"2024-03-16T07:29:52.270864+0000","last_active":"2024-03-16T07:29:52.274578+0000","last_peered":"2024-03-16T07:29:52.274578+0000","last_clean":"2024-03-16T07:29:52.274578+0000","last_became_active":"2024-03-16T07:29:52.270325+0000","last_became_peered":"2024-03-16T07:29:52.270325+0000","last_unstale":"2024-03-16T07:29:52.274578+0000","last_undegraded":"2024-03-16T07:29:52.274578+0000","last_fullsized":"2024-03-16T07:29:52.274578+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_clean_scrub_stamp":"2024-03-16T07:29:51.229201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:04:02.778503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.248537+0000","last_change":"2024-03-16T07:29:51.254557+0000","last_active":"2024-03-16T07:29:52.248537+0000","last_peered":"2024-03-16T07:29:52.248537+0000","last_clean":"2024-03-16T07:29:52.248537+0000","last_became_active":"2024-03-16T07:29:51.254155+0000","last_became_peered":"2024-03-16T07:29:51.254155+0000","last_unstale":"2024-03-16T07:29:52.248537+0000","last_undegraded":"2024-03-16T07:29:52.248537+0000","last_fullsized":"2024-03-16T07:29:52.248537+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:50.226649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:50.226649+0000","last_clean_scrub_stamp":"2024-03-16T07:29:50.226649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:23:27.689304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":18,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.242694+0000","last_change":"2024-03-16T07:29:33.828294+0000","last_active":"2024-03-16T07:29:52.242694+0000","last_peered":"2024-03-16T07:29:52.242694+0000","last_clean":"2024-03-16T07:29:52.242694+0000","last_became_active":"2024-03-16T07:29:33.828062+0000","last_became_peered":"2024-03-16T07:29:33.828062+0000","last_unstale":"2024-03-16T07:29:52.242694+0000","last_undegraded":"2024-03-16T07:29:52.242694+0000","last_fullsized":"2024-03-16T07:29:52.242694+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:34:48.462965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":20,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.252980+0000","last_change":"2024-03-16T07:29:33.144300+0000","last_active":"2024-03-16T07:29:52.252980+0000","last_peered":"2024-03-16T07:29:52.252980+0000","last_clean":"2024-03-16T07:29:52.252980+0000","last_became_active":"2024-03-16T07:29:33.144052+0000","last_became_peered":"2024-03-16T07:29:33.144052+0000","last_unstale":"2024-03-16T07:29:52.252980+0000","last_undegraded":"2024-03-16T07:29:52.252980+0000","last_fullsized":"2024-03-16T07:29:52.252980+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:15:27.170786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.282004+0000","last_change":"2024-03-16T07:29:52.279413+0000","last_active":"2024-03-16T07:29:52.282004+0000","last_peered":"2024-03-16T07:29:52.282004+0000","last_clean":"2024-03-16T07:29:52.282004+0000","last_became_active":"2024-03-16T07:29:52.278819+0000","last_became_peered":"2024-03-16T07:29:52.278819+0000","last_unstale":"2024-03-16T07:29:52.282004+0000","last_undegraded":"2024-03-16T07:29:52.282004+0000","last_fullsized":"2024-03-16T07:29:52.282004+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_clean_scrub_stamp":"2024-03-16T07:29:51.229201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:48:28.409096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.238884+0000","last_change":"2024-03-16T07:29:51.245011+0000","last_active":"2024-03-16T07:29:52.238884+0000","last_peered":"2024-03-16T07:29:52.238884+0000","last_clean":"2024-03-16T07:29:52.238884+0000","last_became_active":"2024-03-16T07:29:51.244769+0000","last_became_peered":"2024-03-16T07:29:51.244769+0000","last_unstale":"2024-03-16T07:29:52.238884+0000","last_undegraded":"2024-03-16T07:29:52.238884+0000","last_fullsized":"2024-03-16T07:29:52.238884+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:50.226649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:50.226649+0000","last_clean_scrub_stamp":"2024-03-16T07:29:50.226649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:25:07.032586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":18,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.246875+0000","last_change":"2024-03-16T07:29:33.831300+0000","last_active":"2024-03-16T07:29:52.246875+0000","last_peered":"2024-03-16T07:29:52.246875+0000","last_clean":"2024-03-16T07:29:52.246875+0000","last_became_active":"2024-03-16T07:29:33.831037+0000","last_became_peered":"2024-03-16T07:29:33.831037+0000","last_unstale":"2024-03-16T07:29:52.246875+0000","last_undegraded":"2024-03-16T07:29:52.246875+0000","last_fullsized":"2024-03-16T07:29:52.246875+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:03:57.669517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":20,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.245753+0000","last_change":"2024-03-16T07:29:33.147234+0000","last_active":"2024-03-16T07:29:52.245753+0000","last_peered":"2024-03-16T07:29:52.245753+0000","last_clean":"2024-03-16T07:29:52.245753+0000","last_became_active":"2024-03-16T07:29:33.146693+0000","last_became_peered":"2024-03-16T07:29:33.146693+0000","last_unstale":"2024-03-16T07:29:52.245753+0000","last_undegraded":"2024-03-16T07:29:52.245753+0000","last_fullsized":"2024-03-16T07:29:52.245753+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:43:35.352393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.259857+0000","last_change":"2024-03-16T07:29:52.257195+0000","last_active":"2024-03-16T07:29:52.259857+0000","last_peered":"2024-03-16T07:29:52.259857+0000","last_clean":"2024-03-16T07:29:52.259857+0000","last_became_active":"2024-03-16T07:29:52.256953+0000","last_became_peered":"2024-03-16T07:29:52.256953+0000","last_unstale":"2024-03-16T07:29:52.259857+0000","last_undegraded":"2024-03-16T07:29:52.259857+0000","last_fullsized":"2024-03-16T07:29:52.259857+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_clean_scrub_stamp":"2024-03-16T07:29:51.229201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:32:50.145794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.238658+0000","last_change":"2024-03-16T07:29:51.241572+0000","last_active":"2024-03-16T07:29:52.238658+0000","last_peered":"2024-03-16T07:29:52.238658+0000","last_clean":"2024-03-16T07:29:52.238658+0000","last_became_active":"2024-03-16T07:29:51.241012+0000","last_became_peered":"2024-03-16T07:29:51.241012+0000","last_unstale":"2024-03-16T07:29:52.238658+0000","last_undegraded":"2024-03-16T07:29:52.238658+0000","last_fullsized":"2024-03-16T07:29:52.238658+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:50.226649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:50.226649+0000","last_clean_scrub_stamp":"2024-03-16T07:29:50.226649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:55:06.029276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":18,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.243166+0000","last_change":"2024-03-16T07:29:33.831203+0000","last_active":"2024-03-16T07:29:52.243166+0000","last_peered":"2024-03-16T07:29:52.243166+0000","last_clean":"2024-03-16T07:29:52.243166+0000","last_became_active":"2024-03-16T07:29:33.830953+0000","last_became_peered":"2024-03-16T07:29:33.830953+0000","last_unstale":"2024-03-16T07:29:52.243166+0000","last_undegraded":"2024-03-16T07:29:52.243166+0000","last_fullsized":"2024-03-16T07:29:52.243166+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:28:50.259243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":20,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.240055+0000","last_change":"2024-03-16T07:29:33.141889+0000","last_active":"2024-03-16T07:29:52.240055+0000","last_peered":"2024-03-16T07:29:52.240055+0000","last_clean":"2024-03-16T07:29:52.240055+0000","last_became_active":"2024-03-16T07:29:33.141560+0000","last_became_peered":"2024-03-16T07:29:33.141560+0000","last_unstale":"2024-03-16T07:29:52.240055+0000","last_undegraded":"2024-03-16T07:29:52.240055+0000","last_fullsized":"2024-03-16T07:29:52.240055+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:06:48.551747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.274998+0000","last_change":"2024-03-16T07:29:52.273498+0000","last_active":"2024-03-16T07:29:52.274998+0000","last_peered":"2024-03-16T07:29:52.274998+0000","last_clean":"2024-03-16T07:29:52.274998+0000","last_became_active":"2024-03-16T07:29:52.273102+0000","last_became_peered":"2024-03-16T07:29:52.273102+0000","last_unstale":"2024-03-16T07:29:52.274998+0000","last_undegraded":"2024-03-16T07:29:52.274998+0000","last_fullsized":"2024-03-16T07:29:52.274998+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_clean_scrub_stamp":"2024-03-16T07:29:51.229201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:55:31.792205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.245330+0000","last_change":"2024-03-16T07:29:51.258673+0000","last_active":"2024-03-16T07:29:52.245330+0000","last_peered":"2024-03-16T07:29:52.245330+0000","last_clean":"2024-03-16T07:29:52.245330+0000","last_became_active":"2024-03-16T07:29:51.257497+0000","last_became_peered":"2024-03-16T07:29:51.257497+0000","last_unstale":"2024-03-16T07:29:52.245330+0000","last_undegraded":"2024-03-16T07:29:52.245330+0000","last_fullsized":"2024-03-16T07:29:52.245330+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:50.226649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:50.226649+0000","last_clean_scrub_stamp":"2024-03-16T07:29:50.226649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:53:21.982058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":18,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.238908+0000","last_change":"2024-03-16T07:29:33.831593+0000","last_active":"2024-03-16T07:29:52.238908+0000","last_peered":"2024-03-16T07:29:52.238908+0000","last_clean":"2024-03-16T07:29:52.238908+0000","last_became_active":"2024-03-16T07:29:33.831346+0000","last_became_peered":"2024-03-16T07:29:33.831346+0000","last_unstale":"2024-03-16T07:29:52.238908+0000","last_undegraded":"2024-03-16T07:29:52.238908+0000","last_fullsized":"2024-03-16T07:29:52.238908+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:41:58.469024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":20,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.252214+0000","last_change":"2024-03-16T07:29:33.143890+0000","last_active":"2024-03-16T07:29:52.252214+0000","last_peered":"2024-03-16T07:29:52.252214+0000","last_clean":"2024-03-16T07:29:52.252214+0000","last_became_active":"2024-03-16T07:29:33.143637+0000","last_became_peered":"2024-03-16T07:29:33.143637+0000","last_unstale":"2024-03-16T07:29:52.252214+0000","last_undegraded":"2024-03-16T07:29:52.252214+0000","last_fullsized":"2024-03-16T07:29:52.252214+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:09:44.522730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.279281+0000","last_change":"2024-03-16T07:29:52.278444+0000","last_active":"2024-03-16T07:29:52.279281+0000","last_peered":"2024-03-16T07:29:52.279281+0000","last_clean":"2024-03-16T07:29:52.279281+0000","last_became_active":"2024-03-16T07:29:52.278023+0000","last_became_peered":"2024-03-16T07:29:52.278023+0000","last_unstale":"2024-03-16T07:29:52.279281+0000","last_undegraded":"2024-03-16T07:29:52.279281+0000","last_fullsized":"2024-03-16T07:29:52.279281+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_clean_scrub_stamp":"2024-03-16T07:29:51.229201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:29:00.141729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.239264+0000","last_change":"2024-03-16T07:29:51.244599+0000","last_active":"2024-03-16T07:29:52.239264+0000","last_peered":"2024-03-16T07:29:52.239264+0000","last_clean":"2024-03-16T07:29:52.239264+0000","last_became_active":"2024-03-16T07:29:51.244379+0000","last_became_peered":"2024-03-16T07:29:51.244379+0000","last_unstale":"2024-03-16T07:29:52.239264+0000","last_undegraded":"2024-03-16T07:29:52.239264+0000","last_fullsized":"2024-03-16T07:29:52.239264+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:50.226649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:50.226649+0000","last_clean_scrub_stamp":"2024-03-16T07:29:50.226649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:54:38.471122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":18,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.239026+0000","last_change":"2024-03-16T07:29:33.840846+0000","last_active":"2024-03-16T07:29:52.239026+0000","last_peered":"2024-03-16T07:29:52.239026+0000","last_clean":"2024-03-16T07:29:52.239026+0000","last_became_active":"2024-03-16T07:29:33.840586+0000","last_became_peered":"2024-03-16T07:29:33.840586+0000","last_unstale":"2024-03-16T07:29:52.239026+0000","last_undegraded":"2024-03-16T07:29:52.239026+0000","last_fullsized":"2024-03-16T07:29:52.239026+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:16:10.018326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":20,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.239205+0000","last_change":"2024-03-16T07:29:33.139819+0000","last_active":"2024-03-16T07:29:52.239205+0000","last_peered":"2024-03-16T07:29:52.239205+0000","last_clean":"2024-03-16T07:29:52.239205+0000","last_became_active":"2024-03-16T07:29:33.139567+0000","last_became_peered":"2024-03-16T07:29:33.139567+0000","last_unstale":"2024-03-16T07:29:52.239205+0000","last_undegraded":"2024-03-16T07:29:52.239205+0000","last_fullsized":"2024-03-16T07:29:52.239205+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:16:29.768752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.272833+0000","last_change":"2024-03-16T07:29:52.266043+0000","last_active":"2024-03-16T07:29:52.272833+0000","last_peered":"2024-03-16T07:29:52.272833+0000","last_clean":"2024-03-16T07:29:52.272833+0000","last_became_active":"2024-03-16T07:29:52.265666+0000","last_became_peered":"2024-03-16T07:29:52.265666+0000","last_unstale":"2024-03-16T07:29:52.272833+0000","last_undegraded":"2024-03-16T07:29:52.272833+0000","last_fullsized":"2024-03-16T07:29:52.272833+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:51.229201+0000","last_clean_scrub_stamp":"2024-03-16T07:29:51.229201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:05:43.527439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.13","version":"99'2","reported_seq":14,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.286620+0000","last_change":"2024-03-16T07:29:51.241231+0000","last_active":"2024-03-16T07:29:52.286620+0000","last_peered":"2024-03-16T07:29:52.286620+0000","last_clean":"2024-03-16T07:29:52.286620+0000","last_became_active":"2024-03-16T07:29:51.240982+0000","last_became_peered":"2024-03-16T07:29:51.240982+0000","last_unstale":"2024-03-16T07:29:52.286620+0000","last_undegraded":"2024-03-16T07:29:52.286620+0000","last_fullsized":"2024-03-16T07:29:52.286620+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:50.226649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:50.226649+0000","last_clean_scrub_stamp":"2024-03-16T07:29:50.226649+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:10:53.388471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":18,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.250962+0000","last_change":"2024-03-16T07:29:33.836320+0000","last_active":"2024-03-16T07:29:52.250962+0000","last_peered":"2024-03-16T07:29:52.250962+0000","last_clean":"2024-03-16T07:29:52.250962+0000","last_became_active":"2024-03-16T07:29:33.835776+0000","last_became_peered":"2024-03-16T07:29:33.835776+0000","last_unstale":"2024-03-16T07:29:52.250962+0000","last_undegraded":"2024-03-16T07:29:52.250962+0000","last_fullsized":"2024-03-16T07:29:52.250962+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:33.124420+0000","last_clean_scrub_stamp":"2024-03-16T07:29:33.124420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:44:42.674554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":20,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.251915+0000","last_change":"2024-03-16T07:29:33.147194+0000","last_active":"2024-03-16T07:29:52.251915+0000","last_peered":"2024-03-16T07:29:52.251915+0000","last_clean":"2024-03-16T07:29:52.251915+0000","last_became_active":"2024-03-16T07:29:33.146945+0000","last_became_peered":"2024-03-16T07:29:33.146945+0000","last_unstale":"2024-03-16T07:29:52.251915+0000","last_undegraded":"2024-03-16T07:29:52.251915+0000","last_fullsized":"2024-03-16T07:29:52.251915+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:29:32.123097+0000","last_clean_scrub_stamp":"2024-03-16T07:29:32.123097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:32:59.919891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"80'152","reported_seq":499,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-03-16T07:29:52.251060+0000","last_change":"2024-03-16T07:24:31.650537+0000","last_active":"2024-03-16T07:29:52.251060+0000","last_peered":"2024-03-16T07:29:52.251060+0000","last_clean":"2024-03-16T07:29:52.251060+0000","last_became_active":"2024-03-16T07:24:31.649574+0000","last_became_peered":"2024-03-16T07:24:31.649574+0000","last_unstale":"2024-03-16T07:29:52.251060+0000","last_undegraded":"2024-03-16T07:29:52.251060+0000","last_fullsized":"2024-03-16T07:29:52.251060+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:29.719970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:29.719970+0000","last_clean_scrub_stamp":"2024-03-16T07:24:29.719970+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:31:35.774554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":586,"num_read_kb":1121,"num_write":237,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":3},{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":4107,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":8214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":586,"num_read_kb":1121,"num_write":237,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":152,"ondisk_log_size":152,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738432,"num_pgs":63,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":36340,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":104821260,"statfs":{"total":107374182400,"available":107336970240,"internally_reserved":0,"allocated":1019904,"data_stored":400483,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738432,"num_pgs":117,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":36948,"kb_used_data":1604,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":104820652,"statfs":{"total":107374182400,"available":107336347648,"internally_reserved":0,"allocated":1642496,"data_stored":995386,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738432,"num_pgs":141,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":36948,"kb_used_data":1604,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":104820652,"statfs":{"total":107374182400,"available":107336347648,"internally_reserved":0,"allocated":1642496,"data_stored":995318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":3503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-16T07:29:56.887 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-03-16T07:29:56.887 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T07:29:57.287 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:29:57.287 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":71,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5588,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6827/1816248233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":1816248233},{"type":"v1","addr":"172.21.15.49:6827","nonce":1816248233}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62},{"gid":5589,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6829/2028370121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":2028370121},{"type":"v1","addr":"172.21.15.49:6829","nonce":2028370121}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62},{"gid":5596,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6831/2282357763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":2282357763},{"type":"v1","addr":"172.21.15.49:6831","nonce":2282357763}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62}],"filesystems":[{"mdsmap":{"epoch":65,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-16T07:29:33.503199+0000","modified":"2024-03-16T07:29:35.492553+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5598},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5598":{"gid":5598,"name":"e","rank":0,"incarnation":63,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6835/2451687435","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":2451687435},{"type":"v1","addr":"172.21.15.49:6835","nonce":2451687435}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5598,"qdb_cluster":[5598]},"id":8},{"mdsmap":{"epoch":71,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-16T07:29:51.607653+0000","modified":"2024-03-16T07:29:54.609298+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5597},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5597":{"gid":5597,"name":"a","rank":0,"incarnation":67,"state":"up:active","state_seq":7,"addr":"172.21.15.49:6833/2335462758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":2335462758},{"type":"v1","addr":"172.21.15.49:6833","nonce":2335462758}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"backup_fs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5597,"qdb_cluster":[5597]},"id":9}]} 2024-03-16T07:29:57.287 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 71 2024-03-16T07:29:57.802 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 71, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-03-16T07:29:51.607653+0000', 'modified': '2024-03-16T07:29:54.609298+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5597}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5597': {'gid': 5597, 'name': 'a', 'rank': 0, 'incarnation': 67, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.49:6833/2335462758', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.49:6832', 'nonce': 2335462758}, {'type': 'v1', 'addr': '172.21.15.49:6833', 'nonce': 2335462758}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [19], 'metadata_pool': 18, 'enabled': True, 'fs_name': 'backup_fs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5597, 'qdb_cluster': [5597]} 2024-03-16T07:29:57.803 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-03-16T07:29:57.803 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-03-16T07:29:57.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-16T07:29:57.938+0000 7fde39ffb640 0 client.5742 ms_handle_reset on v2:172.21.15.49:6832/2335462758 2024-03-16T07:29:57.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-16T07:29:57.961+0000 7fde39ffb640 0 client.5744 ms_handle_reset on v2:172.21.15.49:6832/2335462758 2024-03-16T07:29:57.960 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-03-16T07:29:57.960 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_fsid": "f91af061-9eac-4793-87fa-8d27ae3d242f", 2024-03-16T07:29:57.960 INFO:teuthology.orchestra.run.smithi049.stdout: "whoami": 0, 2024-03-16T07:29:57.960 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 5597, 2024-03-16T07:29:57.960 INFO:teuthology.orchestra.run.smithi049.stdout: "want_state": "up:active", 2024-03-16T07:29:57.960 INFO:teuthology.orchestra.run.smithi049.stdout: "state": "up:active", 2024-03-16T07:29:57.960 INFO:teuthology.orchestra.run.smithi049.stdout: "fs_name": "backup_fs", 2024-03-16T07:29:57.960 INFO:teuthology.orchestra.run.smithi049.stdout: "rank_uptime": 5.71588721, 2024-03-16T07:29:57.960 INFO:teuthology.orchestra.run.smithi049.stdout: "mdsmap_epoch": 71, 2024-03-16T07:29:57.960 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch": 100, 2024-03-16T07:29:57.961 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch_barrier": 100, 2024-03-16T07:29:57.961 INFO:teuthology.orchestra.run.smithi049.stdout: "uptime": 29.142213655999999 2024-03-16T07:29:57.961 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-03-16T07:29:57.971 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable mirroring 2024-03-16T07:29:59.271 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-03-16T07:29:59.271 DEBUG:teuthology.orchestra.run.smithi049:counter dump for fs: cephfs> ceph --admin-daemon /var/run/ceph/cephfs-mirror.asok counter dump 2024-03-16T07:29:59.397 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-03-16T07:29:59.397 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker": [ 2024-03-16T07:29:59.397 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:29:59.398 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:29:59.398 INFO:teuthology.orchestra.run.smithi049.stdout: "id": "0" 2024-03-16T07:29:59.398 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:29:59.398 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:29:59.398 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_ready_timeouts": 0, 2024-03-16T07:29:59.398 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_idle_timeouts": 0 2024-03-16T07:29:59.398 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:29:59.398 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:29:59.398 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:29:59.398 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:29:59.398 INFO:teuthology.orchestra.run.smithi049.stdout: "id": "1" 2024-03-16T07:29:59.398 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:29:59.398 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:29:59.399 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_ready_timeouts": 0, 2024-03-16T07:29:59.399 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_idle_timeouts": 0 2024-03-16T07:29:59.399 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:29:59.399 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:29:59.399 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:29:59.399 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:29:59.399 INFO:teuthology.orchestra.run.smithi049.stdout: "id": "2" 2024-03-16T07:29:59.399 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:29:59.399 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:29:59.399 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_ready_timeouts": 0, 2024-03-16T07:29:59.399 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_idle_timeouts": 0 2024-03-16T07:29:59.399 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:29:59.399 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:29:59.399 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:29:59.400 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-0": [ 2024-03-16T07:29:59.400 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:29:59.400 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:29:59.400 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:29:59.400 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 6, 2024-03-16T07:29:59.400 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 65, 2024-03-16T07:29:59.400 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 864, 2024-03-16T07:29:59.400 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 488112, 2024-03-16T07:29:59.400 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 13, 2024-03-16T07:29:59.400 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 2, 2024-03-16T07:29:59.400 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 0.246399571, 2024-03-16T07:29:59.400 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.072847938, 2024-03-16T07:29:59.400 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 0.141378856, 2024-03-16T07:29:59.400 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-03-16T07:29:59.400 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T07:29:59.401 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 59, 2024-03-16T07:29:59.401 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.152230716, 2024-03-16T07:29:59.401 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.002580181 2024-03-16T07:29:59.401 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:29:59.401 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-03-16T07:29:59.401 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:29:59.401 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:29:59.401 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:29:59.401 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:29:59.401 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 864, 2024-03-16T07:29:59.402 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 488112 2024-03-16T07:29:59.402 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:29:59.402 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:29:59.402 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:29:59.402 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-1": [ 2024-03-16T07:29:59.402 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:29:59.402 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:29:59.402 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:29:59.402 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 66, 2024-03-16T07:29:59.402 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 4, 2024-03-16T07:29:59.402 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 271696, 2024-03-16T07:29:59.402 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 800, 2024-03-16T07:29:59.402 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 3, 2024-03-16T07:29:59.402 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 0, 2024-03-16T07:29:59.403 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 0.374833856, 2024-03-16T07:29:59.403 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.003333996, 2024-03-16T07:29:59.403 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 0.242608373, 2024-03-16T07:29:59.403 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.116414841, 2024-03-16T07:29:59.403 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T07:29:59.403 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 4, 2024-03-16T07:29:59.403 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.054597811, 2024-03-16T07:29:59.403 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.013649452 2024-03-16T07:29:59.403 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:29:59.403 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-03-16T07:29:59.403 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:29:59.403 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:29:59.403 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:29:59.403 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:29:59.403 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 271696, 2024-03-16T07:29:59.404 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 800 2024-03-16T07:29:59.404 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:29:59.404 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:29:59.404 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:29:59.404 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-2": [ 2024-03-16T07:29:59.404 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:29:59.404 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:29:59.404 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:29:59.404 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 37, 2024-03-16T07:29:59.404 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 7, 2024-03-16T07:29:59.404 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 1327056, 2024-03-16T07:29:59.404 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 1264, 2024-03-16T07:29:59.404 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 2, 2024-03-16T07:29:59.404 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 1, 2024-03-16T07:29:59.404 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 0.706464953, 2024-03-16T07:29:59.405 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.006197033, 2024-03-16T07:29:59.405 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 1.363260067, 2024-03-16T07:29:59.405 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-03-16T07:29:59.405 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T07:29:59.405 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 7, 2024-03-16T07:29:59.405 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.160821353, 2024-03-16T07:29:59.405 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.022974479 2024-03-16T07:29:59.405 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:29:59.405 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-03-16T07:29:59.405 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:29:59.405 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:29:59.405 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:29:59.405 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:29:59.405 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 1327056, 2024-03-16T07:29:59.405 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 1264 2024-03-16T07:29:59.406 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:29:59.406 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:29:59.406 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:29:59.406 INFO:teuthology.orchestra.run.smithi049.stdout: "cct": [ 2024-03-16T07:29:59.406 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:29:59.406 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:29:59.406 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:29:59.406 INFO:teuthology.orchestra.run.smithi049.stdout: "total_workers": 0, 2024-03-16T07:29:59.406 INFO:teuthology.orchestra.run.smithi049.stdout: "unhealthy_workers": 0 2024-03-16T07:29:59.406 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:29:59.406 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:29:59.406 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:29:59.406 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs_mirror": [ 2024-03-16T07:29:59.406 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:29:59.407 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:29:59.407 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:29:59.407 INFO:teuthology.orchestra.run.smithi049.stdout: "mirrored_filesystems": 0, 2024-03-16T07:29:59.407 INFO:teuthology.orchestra.run.smithi049.stdout: "mirror_enable_failures": 0 2024-03-16T07:29:59.407 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:29:59.407 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:29:59.407 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:29:59.407 INFO:teuthology.orchestra.run.smithi049.stdout: "mempool": [ 2024-03-16T07:29:59.407 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:29:59.407 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:29:59.407 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:29:59.408 INFO:teuthology.orchestra.run.smithi049.stdout: "bloom_filter_bytes": 0, 2024-03-16T07:29:59.408 INFO:teuthology.orchestra.run.smithi049.stdout: "bloom_filter_items": 0, 2024-03-16T07:29:59.408 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_alloc_bytes": 0, 2024-03-16T07:29:59.408 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_alloc_items": 0, 2024-03-16T07:29:59.408 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_data_bytes": 0, 2024-03-16T07:29:59.408 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_data_items": 0, 2024-03-16T07:29:59.408 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_onode_bytes": 0, 2024-03-16T07:29:59.408 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_onode_items": 0, 2024-03-16T07:29:59.408 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_meta_bytes": 0, 2024-03-16T07:29:59.408 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_meta_items": 0, 2024-03-16T07:29:59.408 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_other_bytes": 0, 2024-03-16T07:29:59.408 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_other_items": 0, 2024-03-16T07:29:59.408 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_buffer_bytes": 0, 2024-03-16T07:29:59.408 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_buffer_items": 0, 2024-03-16T07:29:59.408 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_extent_bytes": 0, 2024-03-16T07:29:59.409 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_extent_items": 0, 2024-03-16T07:29:59.409 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_blob_bytes": 0, 2024-03-16T07:29:59.409 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_blob_items": 0, 2024-03-16T07:29:59.409 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_shared_blob_bytes": 0, 2024-03-16T07:29:59.409 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_shared_blob_items": 0, 2024-03-16T07:29:59.409 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_inline_bl_bytes": 0, 2024-03-16T07:29:59.409 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_inline_bl_items": 0, 2024-03-16T07:29:59.409 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_fsck_bytes": 0, 2024-03-16T07:29:59.409 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_fsck_items": 0, 2024-03-16T07:29:59.409 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_txc_bytes": 0, 2024-03-16T07:29:59.409 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_txc_items": 0, 2024-03-16T07:29:59.409 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_deferred_bytes": 0, 2024-03-16T07:29:59.409 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_deferred_items": 0, 2024-03-16T07:29:59.409 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_bytes": 0, 2024-03-16T07:29:59.409 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_items": 0, 2024-03-16T07:29:59.410 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_bytes": 0, 2024-03-16T07:29:59.410 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_items": 0, 2024-03-16T07:29:59.410 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_reader_bytes": 0, 2024-03-16T07:29:59.410 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_reader_items": 0, 2024-03-16T07:29:59.410 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_writer_bytes": 0, 2024-03-16T07:29:59.410 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_writer_items": 0, 2024-03-16T07:29:59.410 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_anon_bytes": 149234, 2024-03-16T07:29:59.410 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_anon_items": 26, 2024-03-16T07:29:59.410 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_meta_bytes": 0, 2024-03-16T07:29:59.410 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_meta_items": 0, 2024-03-16T07:29:59.410 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_bytes": 0, 2024-03-16T07:29:59.410 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_items": 0, 2024-03-16T07:29:59.410 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_mapbl_bytes": 0, 2024-03-16T07:29:59.411 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_mapbl_items": 0, 2024-03-16T07:29:59.411 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pglog_bytes": 0, 2024-03-16T07:29:59.411 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pglog_items": 0, 2024-03-16T07:29:59.411 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_bytes": 4824, 2024-03-16T07:29:59.411 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_items": 52, 2024-03-16T07:29:59.411 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_mapping_bytes": 0, 2024-03-16T07:29:59.411 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_mapping_items": 0, 2024-03-16T07:29:59.411 INFO:teuthology.orchestra.run.smithi049.stdout: "pgmap_bytes": 0, 2024-03-16T07:29:59.411 INFO:teuthology.orchestra.run.smithi049.stdout: "pgmap_items": 0, 2024-03-16T07:29:59.411 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_co_bytes": 0, 2024-03-16T07:29:59.411 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_co_items": 0, 2024-03-16T07:29:59.411 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_1_bytes": 0, 2024-03-16T07:29:59.411 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_1_items": 0, 2024-03-16T07:29:59.411 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_2_bytes": 0, 2024-03-16T07:29:59.411 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_2_items": 0 2024-03-16T07:29:59.412 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:29:59.412 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:29:59.412 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:29:59.412 INFO:teuthology.orchestra.run.smithi049.stdout: "objecter": [ 2024-03-16T07:29:59.412 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:29:59.412 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:29:59.412 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:29:59.412 INFO:teuthology.orchestra.run.smithi049.stdout: "op_active": 0, 2024-03-16T07:29:59.412 INFO:teuthology.orchestra.run.smithi049.stdout: "op_laggy": 0, 2024-03-16T07:29:59.412 INFO:teuthology.orchestra.run.smithi049.stdout: "op_send": 0, 2024-03-16T07:29:59.412 INFO:teuthology.orchestra.run.smithi049.stdout: "op_send_bytes": 0, 2024-03-16T07:29:59.412 INFO:teuthology.orchestra.run.smithi049.stdout: "op_resend": 0, 2024-03-16T07:29:59.412 INFO:teuthology.orchestra.run.smithi049.stdout: "op_reply": 0, 2024-03-16T07:29:59.412 INFO:teuthology.orchestra.run.smithi049.stdout: "op_latency": { 2024-03-16T07:29:59.412 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:29:59.412 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:29:59.413 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:29:59.413 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:29:59.413 INFO:teuthology.orchestra.run.smithi049.stdout: "op_inflight": 0, 2024-03-16T07:29:59.413 INFO:teuthology.orchestra.run.smithi049.stdout: "oplen_avg": { 2024-03-16T07:29:59.413 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:29:59.413 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0 2024-03-16T07:29:59.413 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:29:59.413 INFO:teuthology.orchestra.run.smithi049.stdout: "op": 0, 2024-03-16T07:29:59.413 INFO:teuthology.orchestra.run.smithi049.stdout: "op_r": 0, 2024-03-16T07:29:59.413 INFO:teuthology.orchestra.run.smithi049.stdout: "op_w": 0, 2024-03-16T07:29:59.413 INFO:teuthology.orchestra.run.smithi049.stdout: "op_rmw": 0, 2024-03-16T07:29:59.413 INFO:teuthology.orchestra.run.smithi049.stdout: "op_pg": 0, 2024-03-16T07:29:59.413 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_stat": 0, 2024-03-16T07:29:59.413 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_create": 0, 2024-03-16T07:29:59.413 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_read": 0, 2024-03-16T07:29:59.413 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_write": 0, 2024-03-16T07:29:59.414 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_writefull": 0, 2024-03-16T07:29:59.414 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_writesame": 0, 2024-03-16T07:29:59.414 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_append": 0, 2024-03-16T07:29:59.414 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_zero": 0, 2024-03-16T07:29:59.414 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_truncate": 0, 2024-03-16T07:29:59.414 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_delete": 0, 2024-03-16T07:29:59.414 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_mapext": 0, 2024-03-16T07:29:59.414 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_sparse_read": 0, 2024-03-16T07:29:59.414 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_clonerange": 0, 2024-03-16T07:29:59.414 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_getxattr": 0, 2024-03-16T07:29:59.414 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_setxattr": 0, 2024-03-16T07:29:59.414 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_cmpxattr": 0, 2024-03-16T07:29:59.414 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_rmxattr": 0, 2024-03-16T07:29:59.414 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_resetxattrs": 0, 2024-03-16T07:29:59.415 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_call": 0, 2024-03-16T07:29:59.415 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_watch": 0, 2024-03-16T07:29:59.415 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_notify": 0, 2024-03-16T07:29:59.415 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_src_cmpxattr": 0, 2024-03-16T07:29:59.415 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_pgls": 0, 2024-03-16T07:29:59.415 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_pgls_filter": 0, 2024-03-16T07:29:59.415 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_other": 0, 2024-03-16T07:29:59.415 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_active": 0, 2024-03-16T07:29:59.415 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_send": 0, 2024-03-16T07:29:59.415 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_resend": 0, 2024-03-16T07:29:59.415 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_ping": 0, 2024-03-16T07:29:59.415 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_active": 0, 2024-03-16T07:29:59.415 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_send": 0, 2024-03-16T07:29:59.415 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_resend": 0, 2024-03-16T07:29:59.415 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_active": 0, 2024-03-16T07:29:59.416 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_send": 0, 2024-03-16T07:29:59.416 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_resend": 0, 2024-03-16T07:29:59.416 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_active": 0, 2024-03-16T07:29:59.416 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_send": 0, 2024-03-16T07:29:59.416 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_resend": 0, 2024-03-16T07:29:59.416 INFO:teuthology.orchestra.run.smithi049.stdout: "command_active": 0, 2024-03-16T07:29:59.416 INFO:teuthology.orchestra.run.smithi049.stdout: "command_send": 0, 2024-03-16T07:29:59.416 INFO:teuthology.orchestra.run.smithi049.stdout: "command_resend": 0, 2024-03-16T07:29:59.416 INFO:teuthology.orchestra.run.smithi049.stdout: "map_epoch": 0, 2024-03-16T07:29:59.416 INFO:teuthology.orchestra.run.smithi049.stdout: "map_full": 0, 2024-03-16T07:29:59.416 INFO:teuthology.orchestra.run.smithi049.stdout: "map_inc": 0, 2024-03-16T07:29:59.416 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_sessions": 0, 2024-03-16T07:29:59.416 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_session_open": 0, 2024-03-16T07:29:59.416 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_session_close": 0, 2024-03-16T07:29:59.416 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_laggy": 0, 2024-03-16T07:29:59.417 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_wr": 0, 2024-03-16T07:29:59.417 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_rd": 0, 2024-03-16T07:29:59.417 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_del": 0 2024-03-16T07:29:59.417 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:29:59.417 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:29:59.417 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:29:59.417 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-msgr_dispatch_throttler-client": [ 2024-03-16T07:29:59.417 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:29:59.417 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:29:59.417 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:29:59.417 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:29:59.417 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-03-16T07:29:59.417 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:29:59.417 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 66, 2024-03-16T07:29:59.417 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 262731, 2024-03-16T07:29:59.418 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:29:59.418 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 66, 2024-03-16T07:29:59.418 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:29:59.418 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:29:59.418 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 66, 2024-03-16T07:29:59.418 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 262731, 2024-03-16T07:29:59.418 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:29:59.418 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:29:59.418 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:29:59.418 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:29:59.418 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:29:59.418 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:29:59.418 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:29:59.418 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:29:59.418 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-msgr_dispatch_throttler-radosclient": [ 2024-03-16T07:29:59.418 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:29:59.419 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:29:59.419 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:29:59.419 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:29:59.419 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-03-16T07:29:59.419 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:29:59.419 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 40, 2024-03-16T07:29:59.419 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 1321637, 2024-03-16T07:29:59.419 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:29:59.419 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 40, 2024-03-16T07:29:59.419 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:29:59.419 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:29:59.419 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 40, 2024-03-16T07:29:59.419 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 1321637, 2024-03-16T07:29:59.419 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:29:59.419 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:29:59.419 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:29:59.420 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:29:59.420 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:29:59.420 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:29:59.420 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:29:59.420 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:29:59.420 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-objecter_bytes": [ 2024-03-16T07:29:59.420 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:29:59.420 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:29:59.420 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:29:59.420 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:29:59.420 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-03-16T07:29:59.420 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:29:59.420 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 0, 2024-03-16T07:29:59.420 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 0, 2024-03-16T07:29:59.420 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:29:59.421 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 0, 2024-03-16T07:29:59.421 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:29:59.421 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:29:59.421 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 0, 2024-03-16T07:29:59.421 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 0, 2024-03-16T07:29:59.421 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:29:59.421 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:29:59.421 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:29:59.421 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:29:59.421 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:29:59.421 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:29:59.421 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:29:59.421 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:29:59.421 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-objecter_ops": [ 2024-03-16T07:29:59.421 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:29:59.422 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:29:59.422 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:29:59.422 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:29:59.422 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 1024, 2024-03-16T07:29:59.422 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:29:59.422 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 0, 2024-03-16T07:29:59.422 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 0, 2024-03-16T07:29:59.422 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:29:59.422 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 0, 2024-03-16T07:29:59.422 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:29:59.422 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:29:59.422 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 0, 2024-03-16T07:29:59.422 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 0, 2024-03-16T07:29:59.422 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:29:59.422 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:29:59.423 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:29:59.423 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:29:59.423 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:29:59.423 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:29:59.423 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:29:59.423 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2024-03-16T07:29:59.423 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-03-16T07:29:59.424 DEBUG:tasks.cephfs.test_mirroring:command returned={ "AsyncMessenger::Worker": [ { "labels": { "id": "0" }, "counters": { "msgr_connection_ready_timeouts": 0, "msgr_connection_idle_timeouts": 0 } }, { "labels": { "id": "1" }, "counters": { "msgr_connection_ready_timeouts": 0, "msgr_connection_idle_timeouts": 0 } }, { "labels": { "id": "2" }, "counters": { "msgr_connection_ready_timeouts": 0, "msgr_connection_idle_timeouts": 0 } } ], "AsyncMessenger::Worker-0": [ { "labels": {}, "counters": { "msgr_recv_messages": 6, "msgr_send_messages": 65, "msgr_recv_bytes": 864, "msgr_send_bytes": 488112, "msgr_created_connections": 13, "msgr_active_connections": 2, "msgr_running_total_time": 0.246399571, "msgr_running_send_time": 0.072847938, "msgr_running_recv_time": 0.141378856, "msgr_running_fast_dispatch_time": 0.000000000, "msgr_send_messages_queue_lat": { "avgcount": 59, "sum": 0.152230716, "avgtime": 0.002580181 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "msgr_recv_encrypted_bytes": 864, "msgr_send_encrypted_bytes": 488112 } } ], "AsyncMessenger::Worker-1": [ { "labels": {}, "counters": { "msgr_recv_messages": 66, "msgr_send_messages": 4, "msgr_recv_bytes": 271696, "msgr_send_bytes": 800, "msgr_created_connections": 3, "msgr_active_connections": 0, "msgr_running_total_time": 0.374833856, "msgr_running_send_time": 0.003333996, "msgr_running_recv_time": 0.242608373, "msgr_running_fast_dispatch_time": 0.116414841, "msgr_send_messages_queue_lat": { "avgcount": 4, "sum": 0.054597811, "avgtime": 0.013649452 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "msgr_recv_encrypted_bytes": 271696, "msgr_send_encrypted_bytes": 800 } } ], "AsyncMessenger::Worker-2": [ { "labels": {}, "counters": { "msgr_recv_messages": 37, "msgr_send_messages": 7, "msgr_recv_bytes": 1327056, "msgr_send_bytes": 1264, "msgr_created_connections": 2, "msgr_active_connections": 1, "msgr_running_total_time": 0.706464953, "msgr_running_send_time": 0.006197033, "msgr_running_recv_time": 1.363260067, "msgr_running_fast_dispatch_time": 0.000000000, "msgr_send_messages_queue_lat": { "avgcount": 7, "sum": 0.160821353, "avgtime": 0.022974479 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "msgr_recv_encrypted_bytes": 1327056, "msgr_send_encrypted_bytes": 1264 } } ], "cct": [ { "labels": {}, "counters": { "total_workers": 0, "unhealthy_workers": 0 } } ], "cephfs_mirror": [ { "labels": {}, "counters": { "mirrored_filesystems": 0, "mirror_enable_failures": 0 } } ], "mempool": [ { "labels": {}, "counters": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_cache_buffer_bytes": 0, "bluestore_cache_buffer_items": 0, "bluestore_extent_bytes": 0, "bluestore_extent_items": 0, "bluestore_blob_bytes": 0, "bluestore_blob_items": 0, "bluestore_shared_blob_bytes": 0, "bluestore_shared_blob_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_items": 0, "bluefs_bytes": 0, "bluefs_items": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "buffer_anon_bytes": 149234, "buffer_anon_items": 26, "buffer_meta_bytes": 0, "buffer_meta_items": 0, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 4824, "osdmap_items": 52, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "mds_co_bytes": 0, "mds_co_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 } } ], "objecter": [ { "labels": {}, "counters": { "op_active": 0, "op_laggy": 0, "op_send": 0, "op_send_bytes": 0, "op_resend": 0, "op_reply": 0, "op_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "op_inflight": 0, "oplen_avg": { "avgcount": 0, "sum": 0 }, "op": 0, "op_r": 0, "op_w": 0, "op_rmw": 0, "op_pg": 0, "osdop_stat": 0, "osdop_create": 0, "osdop_read": 0, "osdop_write": 0, "osdop_writefull": 0, "osdop_writesame": 0, "osdop_append": 0, "osdop_zero": 0, "osdop_truncate": 0, "osdop_delete": 0, "osdop_mapext": 0, "osdop_sparse_read": 0, "osdop_clonerange": 0, "osdop_getxattr": 0, "osdop_setxattr": 0, "osdop_cmpxattr": 0, "osdop_rmxattr": 0, "osdop_resetxattrs": 0, "osdop_call": 0, "osdop_watch": 0, "osdop_notify": 0, "osdop_src_cmpxattr": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_other": 0, "linger_active": 0, "linger_send": 0, "linger_resend": 0, "linger_ping": 0, "poolop_active": 0, "poolop_send": 0, "poolop_resend": 0, "poolstat_active": 0, "poolstat_send": 0, "poolstat_resend": 0, "statfs_active": 0, "statfs_send": 0, "statfs_resend": 0, "command_active": 0, "command_send": 0, "command_resend": 0, "map_epoch": 0, "map_full": 0, "map_inc": 0, "osd_sessions": 0, "osd_session_open": 0, "osd_session_close": 0, "osd_laggy": 0, "omap_wr": 0, "omap_rd": 0, "omap_del": 0 } } ], "throttle-msgr_dispatch_throttler-client": [ { "labels": {}, "counters": { "val": 0, "max": 104857600, "get_started": 0, "get": 66, "get_sum": 262731, "get_or_fail_fail": 0, "get_or_fail_success": 66, "take": 0, "take_sum": 0, "put": 66, "put_sum": 262731, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ], "throttle-msgr_dispatch_throttler-radosclient": [ { "labels": {}, "counters": { "val": 0, "max": 104857600, "get_started": 0, "get": 40, "get_sum": 1321637, "get_or_fail_fail": 0, "get_or_fail_success": 40, "take": 0, "take_sum": 0, "put": 40, "put_sum": 1321637, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ], "throttle-objecter_bytes": [ { "labels": {}, "counters": { "val": 0, "max": 104857600, "get_started": 0, "get": 0, "get_sum": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "take": 0, "take_sum": 0, "put": 0, "put_sum": 0, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ], "throttle-objecter_ops": [ { "labels": {}, "counters": { "val": 0, "max": 1024, "get_started": 0, "get": 0, "get_sum": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "take": 0, "take_sum": 0, "put": 0, "put_sum": 0, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ] } 2024-03-16T07:29:59.424 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snapshot mirror enable cephfs 2024-03-16T07:29:59.731 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:29:59.731+0000 7fd05404b040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-16T07:29:59.780 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:29:59.780+0000 7fd05404b040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-16T07:30:00.291 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:30:00.291+0000 7fd05404b040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-16T07:30:00.337 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:30:00.338+0000 7fd05404b040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-16T07:30:00.382 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:30:00.383+0000 7fd05404b040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-16T07:30:00.458 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:30:00.459+0000 7fd05404b040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-16T07:30:00.502 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:30:00.503+0000 7fd05404b040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-16T07:30:00.621 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:30:00.621+0000 7fd05404b040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-16T07:30:00.676 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:30:00.677+0000 7fd05404b040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-16T07:30:00.721 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:30:00.721+0000 7fd05404b040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-16T07:30:00.772 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:30:00.772+0000 7fd05404b040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-16T07:30:00.829 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:30:00.829+0000 7fd05404b040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-16T07:30:01.326 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:30:01.327+0000 7fd05404b040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-16T07:30:01.471 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:30:01.472+0000 7fd05404b040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-16T07:30:01.595 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:30:01.595+0000 7fd05404b040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-16T07:30:01.640 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:30:01.640+0000 7fd05404b040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-16T07:30:01.756 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:30:01.756+0000 7fd05404b040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-16T07:30:01.852 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:30:01.853+0000 7fd05404b040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-16T07:30:02.012 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:30:02.013+0000 7fd05404b040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-16T07:30:02.056 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:30:02.057+0000 7fd05404b040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-16T07:30:02.188 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:30:02.189+0000 7fd05404b040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-16T07:30:02.940 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:30:02.940+0000 7fd05404b040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-16T07:30:03.222 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:30:03.222+0000 7fd05404b040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-16T07:30:03.273 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:30:03.274+0000 7fd05404b040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-16T07:30:03.394 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:30:03.394+0000 7fd05404b040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-16T07:30:03.487 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:30:03.487+0000 7fcfd3b19640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:30:03.487 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:30:03.487+0000 7fcfd3b19640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:30:03.487 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:30:03.487+0000 7fcfd3b19640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:30:03.487 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:30:03.487+0000 7fcfd3b19640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:30:03.487 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:30:03.487+0000 7fcfd3b19640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:30:03.488 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:30:03.489+0000 7fcfd0b13640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:30:03.489 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:30:03.489+0000 7fcfd0b13640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:30:03.489 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:30:03.489+0000 7fcfd0b13640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:30:03.489 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:30:03.489+0000 7fcfd0b13640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:30:03.489 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:30:03.489+0000 7fcfd0b13640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:30:03.499 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:30:03.500+0000 7fcfd3b19640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:30:03.499 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:30:03.500+0000 7fcfd3b19640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:30:03.499 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:30:03.500+0000 7fcfd3b19640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:30:03.499 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:30:03.500+0000 7fcfd3b19640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:30:03.499 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:30:03.500+0000 7fcfd3b19640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:30:03.503 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:30:03.503+0000 7fcfd0b13640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:30:03.503 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:30:03.503+0000 7fcfd0b13640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:30:03.503 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:30:03.503+0000 7fcfd0b13640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:30:03.503 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:30:03.503+0000 7fcfd0b13640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:30:03.503 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:30:03.503+0000 7fcfd0b13640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:30:05.420 INFO:teuthology.orchestra.run.smithi049.stdout:{} 2024-03-16T07:30:08.630 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T07:30:15.434 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-03-16T07:30:15.434 DEBUG:teuthology.orchestra.run.smithi049:mirror status for fs: cephfs> ceph --admin-daemon /var/run/ceph/cephfs-mirror.asok fs mirror status cephfs@8 2024-03-16T07:30:15.532 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-03-16T07:30:15.532 INFO:teuthology.orchestra.run.smithi049.stdout: "rados_inst": "172.21.15.49:0/1873377254", 2024-03-16T07:30:15.532 INFO:teuthology.orchestra.run.smithi049.stdout: "peers": {}, 2024-03-16T07:30:15.532 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_dirs": { 2024-03-16T07:30:15.532 INFO:teuthology.orchestra.run.smithi049.stdout: "dir_count": 0 2024-03-16T07:30:15.532 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:30:15.532 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-03-16T07:30:15.543 DEBUG:tasks.cephfs.test_mirroring:command returned={ "rados_inst": "172.21.15.49:0/1873377254", "peers": {}, "snap_dirs": { "dir_count": 0 } } 2024-03-16T07:30:15.543 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-03-16T07:30:15.543 DEBUG:teuthology.orchestra.run.smithi049:counter dump for fs: cephfs> ceph --admin-daemon /var/run/ceph/cephfs-mirror.asok counter dump 2024-03-16T07:30:15.647 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-03-16T07:30:15.647 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker": [ 2024-03-16T07:30:15.647 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:30:15.647 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:30:15.647 INFO:teuthology.orchestra.run.smithi049.stdout: "id": "0" 2024-03-16T07:30:15.647 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:30:15.647 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:30:15.647 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_ready_timeouts": 0, 2024-03-16T07:30:15.647 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_idle_timeouts": 0 2024-03-16T07:30:15.647 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:30:15.648 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:30:15.648 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:30:15.648 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:30:15.648 INFO:teuthology.orchestra.run.smithi049.stdout: "id": "1" 2024-03-16T07:30:15.648 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:30:15.648 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:30:15.648 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_ready_timeouts": 0, 2024-03-16T07:30:15.648 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_idle_timeouts": 0 2024-03-16T07:30:15.648 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:30:15.648 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:30:15.648 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:30:15.648 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:30:15.648 INFO:teuthology.orchestra.run.smithi049.stdout: "id": "2" 2024-03-16T07:30:15.648 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:30:15.648 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:30:15.648 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_ready_timeouts": 0, 2024-03-16T07:30:15.649 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_idle_timeouts": 0 2024-03-16T07:30:15.649 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:30:15.649 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:30:15.649 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:30:15.649 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-0": [ 2024-03-16T07:30:15.649 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:30:15.649 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:30:15.649 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:30:15.649 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 7, 2024-03-16T07:30:15.649 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 69, 2024-03-16T07:30:15.649 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 1008, 2024-03-16T07:30:15.649 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 567792, 2024-03-16T07:30:15.649 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 14, 2024-03-16T07:30:15.649 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 3, 2024-03-16T07:30:15.649 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 0.257920297, 2024-03-16T07:30:15.649 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.078822473, 2024-03-16T07:30:15.650 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 0.144527859, 2024-03-16T07:30:15.650 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-03-16T07:30:15.650 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T07:30:15.650 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 63, 2024-03-16T07:30:15.650 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.156735564, 2024-03-16T07:30:15.650 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.002487866 2024-03-16T07:30:15.650 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:30:15.650 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-03-16T07:30:15.650 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:30:15.650 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:30:15.650 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:30:15.650 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:30:15.650 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 1008, 2024-03-16T07:30:15.650 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 567792 2024-03-16T07:30:15.651 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:30:15.651 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:30:15.651 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:30:15.651 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-1": [ 2024-03-16T07:30:15.651 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:30:15.651 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:30:15.651 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:30:15.651 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 67, 2024-03-16T07:30:15.651 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 4, 2024-03-16T07:30:15.651 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 276576, 2024-03-16T07:30:15.651 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 800, 2024-03-16T07:30:15.651 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 3, 2024-03-16T07:30:15.651 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 0, 2024-03-16T07:30:15.651 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 0.379638589, 2024-03-16T07:30:15.651 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.003474020, 2024-03-16T07:30:15.651 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 0.244947455, 2024-03-16T07:30:15.651 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.118183893, 2024-03-16T07:30:15.652 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T07:30:15.652 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 4, 2024-03-16T07:30:15.652 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.054597811, 2024-03-16T07:30:15.652 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.013649452 2024-03-16T07:30:15.652 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:30:15.652 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-03-16T07:30:15.652 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:30:15.652 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:30:15.652 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:30:15.652 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:30:15.652 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 276576, 2024-03-16T07:30:15.652 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 800 2024-03-16T07:30:15.652 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:30:15.652 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:30:15.652 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:30:15.652 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-2": [ 2024-03-16T07:30:15.652 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:30:15.653 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:30:15.653 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:30:15.653 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 41, 2024-03-16T07:30:15.653 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 7, 2024-03-16T07:30:15.653 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 1509200, 2024-03-16T07:30:15.653 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 1264, 2024-03-16T07:30:15.653 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 2, 2024-03-16T07:30:15.653 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 1, 2024-03-16T07:30:15.653 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 0.777542990, 2024-03-16T07:30:15.653 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.006317901, 2024-03-16T07:30:15.653 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 1.502526872, 2024-03-16T07:30:15.653 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-03-16T07:30:15.653 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T07:30:15.653 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 7, 2024-03-16T07:30:15.654 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.160821353, 2024-03-16T07:30:15.654 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.022974479 2024-03-16T07:30:15.654 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:30:15.654 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-03-16T07:30:15.654 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:30:15.654 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:30:15.654 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:30:15.654 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:30:15.654 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 1509200, 2024-03-16T07:30:15.654 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 1264 2024-03-16T07:30:15.654 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:30:15.654 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:30:15.654 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:30:15.655 INFO:teuthology.orchestra.run.smithi049.stdout: "cct": [ 2024-03-16T07:30:15.655 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:30:15.655 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:30:15.655 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:30:15.655 INFO:teuthology.orchestra.run.smithi049.stdout: "total_workers": 0, 2024-03-16T07:30:15.655 INFO:teuthology.orchestra.run.smithi049.stdout: "unhealthy_workers": 0 2024-03-16T07:30:15.655 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:30:15.655 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:30:15.655 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:30:15.655 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs_mirror": [ 2024-03-16T07:30:15.655 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:30:15.655 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:30:15.655 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:30:15.655 INFO:teuthology.orchestra.run.smithi049.stdout: "mirrored_filesystems": 1, 2024-03-16T07:30:15.655 INFO:teuthology.orchestra.run.smithi049.stdout: "mirror_enable_failures": 0 2024-03-16T07:30:15.656 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:30:15.656 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:30:15.656 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:30:15.656 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs_mirror_mirrored_filesystems": [ 2024-03-16T07:30:15.656 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:30:15.656 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:30:15.656 INFO:teuthology.orchestra.run.smithi049.stdout: "filesystem": "cephfs" 2024-03-16T07:30:15.656 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:30:15.656 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:30:15.656 INFO:teuthology.orchestra.run.smithi049.stdout: "mirroring_peers": 0, 2024-03-16T07:30:15.656 INFO:teuthology.orchestra.run.smithi049.stdout: "directory_count": 0 2024-03-16T07:30:15.656 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:30:15.656 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:30:15.656 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:30:15.656 INFO:teuthology.orchestra.run.smithi049.stdout: "mempool": [ 2024-03-16T07:30:15.657 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:30:15.657 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:30:15.657 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:30:15.657 INFO:teuthology.orchestra.run.smithi049.stdout: "bloom_filter_bytes": 0, 2024-03-16T07:30:15.657 INFO:teuthology.orchestra.run.smithi049.stdout: "bloom_filter_items": 0, 2024-03-16T07:30:15.657 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_alloc_bytes": 0, 2024-03-16T07:30:15.657 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_alloc_items": 0, 2024-03-16T07:30:15.657 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_data_bytes": 0, 2024-03-16T07:30:15.657 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_data_items": 0, 2024-03-16T07:30:15.657 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_onode_bytes": 0, 2024-03-16T07:30:15.657 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_onode_items": 0, 2024-03-16T07:30:15.657 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_meta_bytes": 0, 2024-03-16T07:30:15.657 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_meta_items": 0, 2024-03-16T07:30:15.657 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_other_bytes": 0, 2024-03-16T07:30:15.657 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_other_items": 0, 2024-03-16T07:30:15.658 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_buffer_bytes": 0, 2024-03-16T07:30:15.658 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_buffer_items": 0, 2024-03-16T07:30:15.658 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_extent_bytes": 0, 2024-03-16T07:30:15.658 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_extent_items": 0, 2024-03-16T07:30:15.658 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_blob_bytes": 0, 2024-03-16T07:30:15.658 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_blob_items": 0, 2024-03-16T07:30:15.658 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_shared_blob_bytes": 0, 2024-03-16T07:30:15.658 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_shared_blob_items": 0, 2024-03-16T07:30:15.658 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_inline_bl_bytes": 0, 2024-03-16T07:30:15.658 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_inline_bl_items": 0, 2024-03-16T07:30:15.658 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_fsck_bytes": 0, 2024-03-16T07:30:15.658 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_fsck_items": 0, 2024-03-16T07:30:15.658 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_txc_bytes": 0, 2024-03-16T07:30:15.658 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_txc_items": 0, 2024-03-16T07:30:15.658 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_deferred_bytes": 0, 2024-03-16T07:30:15.658 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_deferred_items": 0, 2024-03-16T07:30:15.659 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_bytes": 0, 2024-03-16T07:30:15.659 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_items": 0, 2024-03-16T07:30:15.659 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_bytes": 0, 2024-03-16T07:30:15.659 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_items": 0, 2024-03-16T07:30:15.659 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_reader_bytes": 0, 2024-03-16T07:30:15.659 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_reader_items": 0, 2024-03-16T07:30:15.659 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_writer_bytes": 0, 2024-03-16T07:30:15.659 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_writer_items": 0, 2024-03-16T07:30:15.659 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_anon_bytes": 175487, 2024-03-16T07:30:15.659 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_anon_items": 51, 2024-03-16T07:30:15.659 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_meta_bytes": 0, 2024-03-16T07:30:15.659 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_meta_items": 0, 2024-03-16T07:30:15.659 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_bytes": 0, 2024-03-16T07:30:15.659 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_items": 0, 2024-03-16T07:30:15.659 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_mapbl_bytes": 0, 2024-03-16T07:30:15.660 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_mapbl_items": 0, 2024-03-16T07:30:15.660 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pglog_bytes": 0, 2024-03-16T07:30:15.660 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pglog_items": 0, 2024-03-16T07:30:15.660 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_bytes": 18952, 2024-03-16T07:30:15.660 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_items": 184, 2024-03-16T07:30:15.660 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_mapping_bytes": 0, 2024-03-16T07:30:15.660 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_mapping_items": 0, 2024-03-16T07:30:15.660 INFO:teuthology.orchestra.run.smithi049.stdout: "pgmap_bytes": 0, 2024-03-16T07:30:15.660 INFO:teuthology.orchestra.run.smithi049.stdout: "pgmap_items": 0, 2024-03-16T07:30:15.660 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_co_bytes": 0, 2024-03-16T07:30:15.660 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_co_items": 0, 2024-03-16T07:30:15.660 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_1_bytes": 0, 2024-03-16T07:30:15.660 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_1_items": 0, 2024-03-16T07:30:15.660 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_2_bytes": 0, 2024-03-16T07:30:15.660 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_2_items": 0 2024-03-16T07:30:15.661 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:30:15.661 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:30:15.661 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:30:15.661 INFO:teuthology.orchestra.run.smithi049.stdout: "objecter": [ 2024-03-16T07:30:15.661 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:30:15.661 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:30:15.661 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:30:15.661 INFO:teuthology.orchestra.run.smithi049.stdout: "op_active": 0, 2024-03-16T07:30:15.661 INFO:teuthology.orchestra.run.smithi049.stdout: "op_laggy": 0, 2024-03-16T07:30:15.661 INFO:teuthology.orchestra.run.smithi049.stdout: "op_send": 0, 2024-03-16T07:30:15.661 INFO:teuthology.orchestra.run.smithi049.stdout: "op_send_bytes": 0, 2024-03-16T07:30:15.661 INFO:teuthology.orchestra.run.smithi049.stdout: "op_resend": 0, 2024-03-16T07:30:15.661 INFO:teuthology.orchestra.run.smithi049.stdout: "op_reply": 0, 2024-03-16T07:30:15.661 INFO:teuthology.orchestra.run.smithi049.stdout: "op_latency": { 2024-03-16T07:30:15.661 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:30:15.662 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:30:15.662 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:30:15.662 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:30:15.662 INFO:teuthology.orchestra.run.smithi049.stdout: "op_inflight": 0, 2024-03-16T07:30:15.662 INFO:teuthology.orchestra.run.smithi049.stdout: "oplen_avg": { 2024-03-16T07:30:15.662 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:30:15.662 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0 2024-03-16T07:30:15.662 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:30:15.662 INFO:teuthology.orchestra.run.smithi049.stdout: "op": 0, 2024-03-16T07:30:15.662 INFO:teuthology.orchestra.run.smithi049.stdout: "op_r": 0, 2024-03-16T07:30:15.662 INFO:teuthology.orchestra.run.smithi049.stdout: "op_w": 0, 2024-03-16T07:30:15.662 INFO:teuthology.orchestra.run.smithi049.stdout: "op_rmw": 0, 2024-03-16T07:30:15.662 INFO:teuthology.orchestra.run.smithi049.stdout: "op_pg": 0, 2024-03-16T07:30:15.662 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_stat": 0, 2024-03-16T07:30:15.662 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_create": 0, 2024-03-16T07:30:15.663 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_read": 0, 2024-03-16T07:30:15.663 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_write": 0, 2024-03-16T07:30:15.663 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_writefull": 0, 2024-03-16T07:30:15.663 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_writesame": 0, 2024-03-16T07:30:15.663 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_append": 0, 2024-03-16T07:30:15.663 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_zero": 0, 2024-03-16T07:30:15.663 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_truncate": 0, 2024-03-16T07:30:15.663 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_delete": 0, 2024-03-16T07:30:15.663 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_mapext": 0, 2024-03-16T07:30:15.663 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_sparse_read": 0, 2024-03-16T07:30:15.663 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_clonerange": 0, 2024-03-16T07:30:15.663 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_getxattr": 0, 2024-03-16T07:30:15.663 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_setxattr": 0, 2024-03-16T07:30:15.663 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_cmpxattr": 0, 2024-03-16T07:30:15.663 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_rmxattr": 0, 2024-03-16T07:30:15.663 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_resetxattrs": 0, 2024-03-16T07:30:15.664 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_call": 0, 2024-03-16T07:30:15.664 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_watch": 0, 2024-03-16T07:30:15.664 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_notify": 0, 2024-03-16T07:30:15.664 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_src_cmpxattr": 0, 2024-03-16T07:30:15.664 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_pgls": 0, 2024-03-16T07:30:15.664 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_pgls_filter": 0, 2024-03-16T07:30:15.664 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_other": 0, 2024-03-16T07:30:15.664 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_active": 0, 2024-03-16T07:30:15.664 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_send": 0, 2024-03-16T07:30:15.664 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_resend": 0, 2024-03-16T07:30:15.664 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_ping": 0, 2024-03-16T07:30:15.664 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_active": 0, 2024-03-16T07:30:15.664 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_send": 0, 2024-03-16T07:30:15.664 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_resend": 0, 2024-03-16T07:30:15.664 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_active": 0, 2024-03-16T07:30:15.665 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_send": 0, 2024-03-16T07:30:15.665 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_resend": 0, 2024-03-16T07:30:15.665 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_active": 0, 2024-03-16T07:30:15.665 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_send": 0, 2024-03-16T07:30:15.665 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_resend": 0, 2024-03-16T07:30:15.665 INFO:teuthology.orchestra.run.smithi049.stdout: "command_active": 0, 2024-03-16T07:30:15.665 INFO:teuthology.orchestra.run.smithi049.stdout: "command_send": 0, 2024-03-16T07:30:15.665 INFO:teuthology.orchestra.run.smithi049.stdout: "command_resend": 0, 2024-03-16T07:30:15.665 INFO:teuthology.orchestra.run.smithi049.stdout: "map_epoch": 0, 2024-03-16T07:30:15.665 INFO:teuthology.orchestra.run.smithi049.stdout: "map_full": 0, 2024-03-16T07:30:15.665 INFO:teuthology.orchestra.run.smithi049.stdout: "map_inc": 0, 2024-03-16T07:30:15.665 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_sessions": 0, 2024-03-16T07:30:15.665 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_session_open": 0, 2024-03-16T07:30:15.665 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_session_close": 0, 2024-03-16T07:30:15.665 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_laggy": 0, 2024-03-16T07:30:15.666 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_wr": 0, 2024-03-16T07:30:15.666 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_rd": 0, 2024-03-16T07:30:15.666 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_del": 0 2024-03-16T07:30:15.666 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:30:15.666 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:30:15.666 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:30:15.666 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-msgr_dispatch_throttler-client": [ 2024-03-16T07:30:15.666 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:30:15.666 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:30:15.666 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:30:15.666 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:30:15.666 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-03-16T07:30:15.666 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:30:15.666 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 67, 2024-03-16T07:30:15.667 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 267477, 2024-03-16T07:30:15.667 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:30:15.667 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 67, 2024-03-16T07:30:15.667 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:30:15.667 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:30:15.667 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 67, 2024-03-16T07:30:15.667 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 267477, 2024-03-16T07:30:15.667 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:30:15.667 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:30:15.667 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:30:15.667 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:30:15.667 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:30:15.667 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:30:15.667 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:30:15.667 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:30:15.667 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-msgr_dispatch_throttler-radosclient": [ 2024-03-16T07:30:15.668 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:30:15.668 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:30:15.668 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:30:15.668 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:30:15.668 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-03-16T07:30:15.668 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:30:15.668 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 45, 2024-03-16T07:30:15.668 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 1503237, 2024-03-16T07:30:15.668 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:30:15.668 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 45, 2024-03-16T07:30:15.668 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:30:15.668 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:30:15.668 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 45, 2024-03-16T07:30:15.668 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 1503237, 2024-03-16T07:30:15.668 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:30:15.668 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:30:15.668 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:30:15.669 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:30:15.669 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:30:15.669 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:30:15.669 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:30:15.669 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:30:15.669 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-objecter_bytes": [ 2024-03-16T07:30:15.669 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:30:15.669 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:30:15.669 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:30:15.669 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:30:15.669 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-03-16T07:30:15.669 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:30:15.669 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 0, 2024-03-16T07:30:15.669 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 0, 2024-03-16T07:30:15.669 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:30:15.669 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 0, 2024-03-16T07:30:15.670 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:30:15.670 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:30:15.670 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 0, 2024-03-16T07:30:15.670 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 0, 2024-03-16T07:30:15.670 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:30:15.670 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:30:15.670 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:30:15.670 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:30:15.670 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:30:15.670 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:30:15.670 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:30:15.670 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:30:15.670 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-objecter_ops": [ 2024-03-16T07:30:15.670 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:30:15.670 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:30:15.671 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:30:15.671 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:30:15.671 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 1024, 2024-03-16T07:30:15.671 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:30:15.671 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 0, 2024-03-16T07:30:15.671 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 0, 2024-03-16T07:30:15.671 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:30:15.671 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 0, 2024-03-16T07:30:15.671 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:30:15.671 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:30:15.671 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 0, 2024-03-16T07:30:15.671 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 0, 2024-03-16T07:30:15.671 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:30:15.671 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:30:15.671 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:30:15.671 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:30:15.671 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:30:15.672 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:30:15.672 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:30:15.672 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2024-03-16T07:30:15.672 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-03-16T07:30:15.673 DEBUG:tasks.cephfs.test_mirroring:command returned={ "AsyncMessenger::Worker": [ { "labels": { "id": "0" }, "counters": { "msgr_connection_ready_timeouts": 0, "msgr_connection_idle_timeouts": 0 } }, { "labels": { "id": "1" }, "counters": { "msgr_connection_ready_timeouts": 0, "msgr_connection_idle_timeouts": 0 } }, { "labels": { "id": "2" }, "counters": { "msgr_connection_ready_timeouts": 0, "msgr_connection_idle_timeouts": 0 } } ], "AsyncMessenger::Worker-0": [ { "labels": {}, "counters": { "msgr_recv_messages": 7, "msgr_send_messages": 69, "msgr_recv_bytes": 1008, "msgr_send_bytes": 567792, "msgr_created_connections": 14, "msgr_active_connections": 3, "msgr_running_total_time": 0.257920297, "msgr_running_send_time": 0.078822473, "msgr_running_recv_time": 0.144527859, "msgr_running_fast_dispatch_time": 0.000000000, "msgr_send_messages_queue_lat": { "avgcount": 63, "sum": 0.156735564, "avgtime": 0.002487866 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "msgr_recv_encrypted_bytes": 1008, "msgr_send_encrypted_bytes": 567792 } } ], "AsyncMessenger::Worker-1": [ { "labels": {}, "counters": { "msgr_recv_messages": 67, "msgr_send_messages": 4, "msgr_recv_bytes": 276576, "msgr_send_bytes": 800, "msgr_created_connections": 3, "msgr_active_connections": 0, "msgr_running_total_time": 0.379638589, "msgr_running_send_time": 0.003474020, "msgr_running_recv_time": 0.244947455, "msgr_running_fast_dispatch_time": 0.118183893, "msgr_send_messages_queue_lat": { "avgcount": 4, "sum": 0.054597811, "avgtime": 0.013649452 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "msgr_recv_encrypted_bytes": 276576, "msgr_send_encrypted_bytes": 800 } } ], "AsyncMessenger::Worker-2": [ { "labels": {}, "counters": { "msgr_recv_messages": 41, "msgr_send_messages": 7, "msgr_recv_bytes": 1509200, "msgr_send_bytes": 1264, "msgr_created_connections": 2, "msgr_active_connections": 1, "msgr_running_total_time": 0.777542990, "msgr_running_send_time": 0.006317901, "msgr_running_recv_time": 1.502526872, "msgr_running_fast_dispatch_time": 0.000000000, "msgr_send_messages_queue_lat": { "avgcount": 7, "sum": 0.160821353, "avgtime": 0.022974479 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "msgr_recv_encrypted_bytes": 1509200, "msgr_send_encrypted_bytes": 1264 } } ], "cct": [ { "labels": {}, "counters": { "total_workers": 0, "unhealthy_workers": 0 } } ], "cephfs_mirror": [ { "labels": {}, "counters": { "mirrored_filesystems": 1, "mirror_enable_failures": 0 } } ], "cephfs_mirror_mirrored_filesystems": [ { "labels": { "filesystem": "cephfs" }, "counters": { "mirroring_peers": 0, "directory_count": 0 } } ], "mempool": [ { "labels": {}, "counters": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_cache_buffer_bytes": 0, "bluestore_cache_buffer_items": 0, "bluestore_extent_bytes": 0, "bluestore_extent_items": 0, "bluestore_blob_bytes": 0, "bluestore_blob_items": 0, "bluestore_shared_blob_bytes": 0, "bluestore_shared_blob_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_items": 0, "bluefs_bytes": 0, "bluefs_items": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "buffer_anon_bytes": 175487, "buffer_anon_items": 51, "buffer_meta_bytes": 0, "buffer_meta_items": 0, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 18952, "osdmap_items": 184, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "mds_co_bytes": 0, "mds_co_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 } } ], "objecter": [ { "labels": {}, "counters": { "op_active": 0, "op_laggy": 0, "op_send": 0, "op_send_bytes": 0, "op_resend": 0, "op_reply": 0, "op_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "op_inflight": 0, "oplen_avg": { "avgcount": 0, "sum": 0 }, "op": 0, "op_r": 0, "op_w": 0, "op_rmw": 0, "op_pg": 0, "osdop_stat": 0, "osdop_create": 0, "osdop_read": 0, "osdop_write": 0, "osdop_writefull": 0, "osdop_writesame": 0, "osdop_append": 0, "osdop_zero": 0, "osdop_truncate": 0, "osdop_delete": 0, "osdop_mapext": 0, "osdop_sparse_read": 0, "osdop_clonerange": 0, "osdop_getxattr": 0, "osdop_setxattr": 0, "osdop_cmpxattr": 0, "osdop_rmxattr": 0, "osdop_resetxattrs": 0, "osdop_call": 0, "osdop_watch": 0, "osdop_notify": 0, "osdop_src_cmpxattr": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_other": 0, "linger_active": 0, "linger_send": 0, "linger_resend": 0, "linger_ping": 0, "poolop_active": 0, "poolop_send": 0, "poolop_resend": 0, "poolstat_active": 0, "poolstat_send": 0, "poolstat_resend": 0, "statfs_active": 0, "statfs_send": 0, "statfs_resend": 0, "command_active": 0, "command_send": 0, "command_resend": 0, "map_epoch": 0, "map_full": 0, "map_inc": 0, "osd_sessions": 0, "osd_session_open": 0, "osd_session_close": 0, "osd_laggy": 0, "omap_wr": 0, "omap_rd": 0, "omap_del": 0 } } ], "throttle-msgr_dispatch_throttler-client": [ { "labels": {}, "counters": { "val": 0, "max": 104857600, "get_started": 0, "get": 67, "get_sum": 267477, "get_or_fail_fail": 0, "get_or_fail_success": 67, "take": 0, "take_sum": 0, "put": 67, "put_sum": 267477, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ], "throttle-msgr_dispatch_throttler-radosclient": [ { "labels": {}, "counters": { "val": 0, "max": 104857600, "get_started": 0, "get": 45, "get_sum": 1503237, "get_or_fail_fail": 0, "get_or_fail_success": 45, "take": 0, "take_sum": 0, "put": 45, "put_sum": 1503237, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ], "throttle-objecter_bytes": [ { "labels": {}, "counters": { "val": 0, "max": 104857600, "get_started": 0, "get": 0, "get_sum": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "take": 0, "take_sum": 0, "put": 0, "put_sum": 0, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ], "throttle-objecter_ops": [ { "labels": {}, "counters": { "val": 0, "max": 1024, "get_started": 0, "get": 0, "get_sum": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "take": 0, "take_sum": 0, "put": 0, "put_sum": 0, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ] } 2024-03-16T07:30:15.673 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-03-16T07:30:15.674 DEBUG:teuthology.orchestra.run.smithi049:mirror status for fs: cephfs> ceph --admin-daemon /var/run/ceph/cephfs-mirror.asok fs mirror status cephfs@8 2024-03-16T07:30:15.768 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-03-16T07:30:15.769 INFO:teuthology.orchestra.run.smithi049.stdout: "rados_inst": "172.21.15.49:0/1873377254", 2024-03-16T07:30:15.769 INFO:teuthology.orchestra.run.smithi049.stdout: "peers": {}, 2024-03-16T07:30:15.769 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_dirs": { 2024-03-16T07:30:15.769 INFO:teuthology.orchestra.run.smithi049.stdout: "dir_count": 0 2024-03-16T07:30:15.769 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:30:15.769 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-03-16T07:30:15.776 DEBUG:tasks.cephfs.test_mirroring:command returned={ "rados_inst": "172.21.15.49:0/1873377254", "peers": {}, "snap_dirs": { "dir_count": 0 } } 2024-03-16T07:30:15.776 DEBUG:tasks.cephfs.test_mirroring:initial dir_count=0 2024-03-16T07:30:15.776 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snapshot mirror add cephfs ./d1 2024-03-16T07:30:16.224 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:30:16.226+0000 7fcfe6bbf640 -1 mgr.server reply reply (22) Invalid argument ./d1 should be an absolute path 2024-03-16T07:30:16.224 INFO:teuthology.orchestra.run.smithi049.stderr:Error EINVAL: ./d1 should be an absolute path 2024-03-16T07:30:16.229 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-03-16T07:30:16.230 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-03-16T07:30:16.230 DEBUG:teuthology.orchestra.run.smithi049:counter dump for fs: cephfs> ceph --admin-daemon /var/run/ceph/cephfs-mirror.asok counter dump 2024-03-16T07:30:16.358 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-03-16T07:30:16.358 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker": [ 2024-03-16T07:30:16.359 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:30:16.359 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:30:16.359 INFO:teuthology.orchestra.run.smithi049.stdout: "id": "0" 2024-03-16T07:30:16.359 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:30:16.359 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:30:16.359 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_ready_timeouts": 0, 2024-03-16T07:30:16.359 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_idle_timeouts": 0 2024-03-16T07:30:16.359 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:30:16.359 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:30:16.359 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:30:16.359 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:30:16.359 INFO:teuthology.orchestra.run.smithi049.stdout: "id": "1" 2024-03-16T07:30:16.359 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:30:16.359 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:30:16.359 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_ready_timeouts": 0, 2024-03-16T07:30:16.360 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_idle_timeouts": 0 2024-03-16T07:30:16.360 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:30:16.360 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:30:16.360 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:30:16.360 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:30:16.360 INFO:teuthology.orchestra.run.smithi049.stdout: "id": "2" 2024-03-16T07:30:16.360 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:30:16.360 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:30:16.360 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_ready_timeouts": 0, 2024-03-16T07:30:16.360 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_idle_timeouts": 0 2024-03-16T07:30:16.360 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:30:16.360 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:30:16.360 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:30:16.360 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-0": [ 2024-03-16T07:30:16.360 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:30:16.361 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:30:16.361 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:30:16.361 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 7, 2024-03-16T07:30:16.361 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 69, 2024-03-16T07:30:16.361 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 1008, 2024-03-16T07:30:16.361 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 567792, 2024-03-16T07:30:16.361 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 14, 2024-03-16T07:30:16.361 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 3, 2024-03-16T07:30:16.361 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 0.257920297, 2024-03-16T07:30:16.361 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.078822473, 2024-03-16T07:30:16.361 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 0.144527859, 2024-03-16T07:30:16.361 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-03-16T07:30:16.361 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T07:30:16.361 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 63, 2024-03-16T07:30:16.362 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.156735564, 2024-03-16T07:30:16.362 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.002487866 2024-03-16T07:30:16.362 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:30:16.362 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-03-16T07:30:16.362 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:30:16.362 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:30:16.362 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:30:16.362 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:30:16.362 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 1008, 2024-03-16T07:30:16.362 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 567792 2024-03-16T07:30:16.362 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:30:16.362 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:30:16.362 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:30:16.362 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-1": [ 2024-03-16T07:30:16.363 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:30:16.363 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:30:16.363 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:30:16.363 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 67, 2024-03-16T07:30:16.363 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 4, 2024-03-16T07:30:16.363 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 276576, 2024-03-16T07:30:16.363 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 800, 2024-03-16T07:30:16.363 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 3, 2024-03-16T07:30:16.363 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 0, 2024-03-16T07:30:16.363 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 0.379638589, 2024-03-16T07:30:16.363 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.003474020, 2024-03-16T07:30:16.363 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 0.244947455, 2024-03-16T07:30:16.363 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.118183893, 2024-03-16T07:30:16.364 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T07:30:16.364 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 4, 2024-03-16T07:30:16.364 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.054597811, 2024-03-16T07:30:16.364 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.013649452 2024-03-16T07:30:16.364 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:30:16.364 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-03-16T07:30:16.364 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:30:16.364 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:30:16.364 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:30:16.364 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:30:16.364 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 276576, 2024-03-16T07:30:16.364 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 800 2024-03-16T07:30:16.364 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:30:16.364 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:30:16.364 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:30:16.365 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-2": [ 2024-03-16T07:30:16.365 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:30:16.365 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:30:16.365 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:30:16.365 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 41, 2024-03-16T07:30:16.365 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 7, 2024-03-16T07:30:16.365 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 1509200, 2024-03-16T07:30:16.365 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 1264, 2024-03-16T07:30:16.365 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 2, 2024-03-16T07:30:16.365 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 1, 2024-03-16T07:30:16.365 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 0.777542990, 2024-03-16T07:30:16.365 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.006317901, 2024-03-16T07:30:16.365 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 1.502526872, 2024-03-16T07:30:16.365 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-03-16T07:30:16.365 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T07:30:16.365 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 7, 2024-03-16T07:30:16.366 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.160821353, 2024-03-16T07:30:16.366 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.022974479 2024-03-16T07:30:16.366 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:30:16.366 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-03-16T07:30:16.366 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:30:16.366 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:30:16.366 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:30:16.366 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:30:16.366 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 1509200, 2024-03-16T07:30:16.366 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 1264 2024-03-16T07:30:16.366 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:30:16.366 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:30:16.366 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:30:16.366 INFO:teuthology.orchestra.run.smithi049.stdout: "cct": [ 2024-03-16T07:30:16.367 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:30:16.367 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:30:16.367 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:30:16.367 INFO:teuthology.orchestra.run.smithi049.stdout: "total_workers": 0, 2024-03-16T07:30:16.367 INFO:teuthology.orchestra.run.smithi049.stdout: "unhealthy_workers": 0 2024-03-16T07:30:16.367 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:30:16.367 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:30:16.367 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:30:16.367 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs_mirror": [ 2024-03-16T07:30:16.367 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:30:16.367 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:30:16.367 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:30:16.367 INFO:teuthology.orchestra.run.smithi049.stdout: "mirrored_filesystems": 1, 2024-03-16T07:30:16.367 INFO:teuthology.orchestra.run.smithi049.stdout: "mirror_enable_failures": 0 2024-03-16T07:30:16.367 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:30:16.368 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:30:16.368 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:30:16.368 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs_mirror_mirrored_filesystems": [ 2024-03-16T07:30:16.368 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:30:16.368 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:30:16.368 INFO:teuthology.orchestra.run.smithi049.stdout: "filesystem": "cephfs" 2024-03-16T07:30:16.368 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:30:16.368 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:30:16.368 INFO:teuthology.orchestra.run.smithi049.stdout: "mirroring_peers": 0, 2024-03-16T07:30:16.368 INFO:teuthology.orchestra.run.smithi049.stdout: "directory_count": 0 2024-03-16T07:30:16.368 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:30:16.368 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:30:16.368 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:30:16.368 INFO:teuthology.orchestra.run.smithi049.stdout: "mempool": [ 2024-03-16T07:30:16.368 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:30:16.368 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:30:16.369 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:30:16.369 INFO:teuthology.orchestra.run.smithi049.stdout: "bloom_filter_bytes": 0, 2024-03-16T07:30:16.369 INFO:teuthology.orchestra.run.smithi049.stdout: "bloom_filter_items": 0, 2024-03-16T07:30:16.369 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_alloc_bytes": 0, 2024-03-16T07:30:16.369 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_alloc_items": 0, 2024-03-16T07:30:16.369 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_data_bytes": 0, 2024-03-16T07:30:16.369 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_data_items": 0, 2024-03-16T07:30:16.369 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_onode_bytes": 0, 2024-03-16T07:30:16.369 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_onode_items": 0, 2024-03-16T07:30:16.369 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_meta_bytes": 0, 2024-03-16T07:30:16.369 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_meta_items": 0, 2024-03-16T07:30:16.369 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_other_bytes": 0, 2024-03-16T07:30:16.369 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_other_items": 0, 2024-03-16T07:30:16.369 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_buffer_bytes": 0, 2024-03-16T07:30:16.369 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_buffer_items": 0, 2024-03-16T07:30:16.369 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_extent_bytes": 0, 2024-03-16T07:30:16.370 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_extent_items": 0, 2024-03-16T07:30:16.370 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_blob_bytes": 0, 2024-03-16T07:30:16.370 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_blob_items": 0, 2024-03-16T07:30:16.370 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_shared_blob_bytes": 0, 2024-03-16T07:30:16.370 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_shared_blob_items": 0, 2024-03-16T07:30:16.370 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_inline_bl_bytes": 0, 2024-03-16T07:30:16.370 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_inline_bl_items": 0, 2024-03-16T07:30:16.370 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_fsck_bytes": 0, 2024-03-16T07:30:16.370 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_fsck_items": 0, 2024-03-16T07:30:16.370 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_txc_bytes": 0, 2024-03-16T07:30:16.370 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_txc_items": 0, 2024-03-16T07:30:16.370 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_deferred_bytes": 0, 2024-03-16T07:30:16.370 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_deferred_items": 0, 2024-03-16T07:30:16.370 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_bytes": 0, 2024-03-16T07:30:16.370 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_items": 0, 2024-03-16T07:30:16.371 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_bytes": 0, 2024-03-16T07:30:16.371 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_items": 0, 2024-03-16T07:30:16.371 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_reader_bytes": 0, 2024-03-16T07:30:16.371 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_reader_items": 0, 2024-03-16T07:30:16.371 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_writer_bytes": 0, 2024-03-16T07:30:16.371 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_writer_items": 0, 2024-03-16T07:30:16.371 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_anon_bytes": 175487, 2024-03-16T07:30:16.371 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_anon_items": 51, 2024-03-16T07:30:16.371 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_meta_bytes": 0, 2024-03-16T07:30:16.371 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_meta_items": 0, 2024-03-16T07:30:16.371 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_bytes": 0, 2024-03-16T07:30:16.371 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_items": 0, 2024-03-16T07:30:16.371 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_mapbl_bytes": 0, 2024-03-16T07:30:16.371 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_mapbl_items": 0, 2024-03-16T07:30:16.371 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pglog_bytes": 0, 2024-03-16T07:30:16.371 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pglog_items": 0, 2024-03-16T07:30:16.371 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_bytes": 18952, 2024-03-16T07:30:16.372 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_items": 184, 2024-03-16T07:30:16.372 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_mapping_bytes": 0, 2024-03-16T07:30:16.372 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_mapping_items": 0, 2024-03-16T07:30:16.372 INFO:teuthology.orchestra.run.smithi049.stdout: "pgmap_bytes": 0, 2024-03-16T07:30:16.372 INFO:teuthology.orchestra.run.smithi049.stdout: "pgmap_items": 0, 2024-03-16T07:30:16.372 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_co_bytes": 0, 2024-03-16T07:30:16.372 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_co_items": 0, 2024-03-16T07:30:16.372 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_1_bytes": 0, 2024-03-16T07:30:16.372 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_1_items": 0, 2024-03-16T07:30:16.372 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_2_bytes": 0, 2024-03-16T07:30:16.372 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_2_items": 0 2024-03-16T07:30:16.372 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:30:16.372 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:30:16.372 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:30:16.372 INFO:teuthology.orchestra.run.smithi049.stdout: "objecter": [ 2024-03-16T07:30:16.373 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:30:16.373 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:30:16.373 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:30:16.373 INFO:teuthology.orchestra.run.smithi049.stdout: "op_active": 0, 2024-03-16T07:30:16.373 INFO:teuthology.orchestra.run.smithi049.stdout: "op_laggy": 0, 2024-03-16T07:30:16.373 INFO:teuthology.orchestra.run.smithi049.stdout: "op_send": 0, 2024-03-16T07:30:16.373 INFO:teuthology.orchestra.run.smithi049.stdout: "op_send_bytes": 0, 2024-03-16T07:30:16.373 INFO:teuthology.orchestra.run.smithi049.stdout: "op_resend": 0, 2024-03-16T07:30:16.373 INFO:teuthology.orchestra.run.smithi049.stdout: "op_reply": 0, 2024-03-16T07:30:16.373 INFO:teuthology.orchestra.run.smithi049.stdout: "op_latency": { 2024-03-16T07:30:16.373 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:30:16.373 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:30:16.373 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:30:16.373 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:30:16.373 INFO:teuthology.orchestra.run.smithi049.stdout: "op_inflight": 0, 2024-03-16T07:30:16.373 INFO:teuthology.orchestra.run.smithi049.stdout: "oplen_avg": { 2024-03-16T07:30:16.374 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:30:16.374 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0 2024-03-16T07:30:16.374 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:30:16.374 INFO:teuthology.orchestra.run.smithi049.stdout: "op": 0, 2024-03-16T07:30:16.374 INFO:teuthology.orchestra.run.smithi049.stdout: "op_r": 0, 2024-03-16T07:30:16.374 INFO:teuthology.orchestra.run.smithi049.stdout: "op_w": 0, 2024-03-16T07:30:16.374 INFO:teuthology.orchestra.run.smithi049.stdout: "op_rmw": 0, 2024-03-16T07:30:16.374 INFO:teuthology.orchestra.run.smithi049.stdout: "op_pg": 0, 2024-03-16T07:30:16.374 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_stat": 0, 2024-03-16T07:30:16.374 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_create": 0, 2024-03-16T07:30:16.374 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_read": 0, 2024-03-16T07:30:16.374 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_write": 0, 2024-03-16T07:30:16.374 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_writefull": 0, 2024-03-16T07:30:16.374 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_writesame": 0, 2024-03-16T07:30:16.374 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_append": 0, 2024-03-16T07:30:16.374 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_zero": 0, 2024-03-16T07:30:16.375 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_truncate": 0, 2024-03-16T07:30:16.375 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_delete": 0, 2024-03-16T07:30:16.375 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_mapext": 0, 2024-03-16T07:30:16.375 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_sparse_read": 0, 2024-03-16T07:30:16.375 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_clonerange": 0, 2024-03-16T07:30:16.375 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_getxattr": 0, 2024-03-16T07:30:16.375 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_setxattr": 0, 2024-03-16T07:30:16.375 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_cmpxattr": 0, 2024-03-16T07:30:16.375 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_rmxattr": 0, 2024-03-16T07:30:16.375 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_resetxattrs": 0, 2024-03-16T07:30:16.375 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_call": 0, 2024-03-16T07:30:16.375 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_watch": 0, 2024-03-16T07:30:16.375 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_notify": 0, 2024-03-16T07:30:16.375 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_src_cmpxattr": 0, 2024-03-16T07:30:16.375 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_pgls": 0, 2024-03-16T07:30:16.375 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_pgls_filter": 0, 2024-03-16T07:30:16.376 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_other": 0, 2024-03-16T07:30:16.376 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_active": 0, 2024-03-16T07:30:16.376 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_send": 0, 2024-03-16T07:30:16.376 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_resend": 0, 2024-03-16T07:30:16.376 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_ping": 0, 2024-03-16T07:30:16.376 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_active": 0, 2024-03-16T07:30:16.376 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_send": 0, 2024-03-16T07:30:16.376 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_resend": 0, 2024-03-16T07:30:16.376 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_active": 0, 2024-03-16T07:30:16.376 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_send": 0, 2024-03-16T07:30:16.376 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_resend": 0, 2024-03-16T07:30:16.376 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_active": 0, 2024-03-16T07:30:16.376 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_send": 0, 2024-03-16T07:30:16.376 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_resend": 0, 2024-03-16T07:30:16.376 INFO:teuthology.orchestra.run.smithi049.stdout: "command_active": 0, 2024-03-16T07:30:16.376 INFO:teuthology.orchestra.run.smithi049.stdout: "command_send": 0, 2024-03-16T07:30:16.376 INFO:teuthology.orchestra.run.smithi049.stdout: "command_resend": 0, 2024-03-16T07:30:16.377 INFO:teuthology.orchestra.run.smithi049.stdout: "map_epoch": 0, 2024-03-16T07:30:16.377 INFO:teuthology.orchestra.run.smithi049.stdout: "map_full": 0, 2024-03-16T07:30:16.377 INFO:teuthology.orchestra.run.smithi049.stdout: "map_inc": 0, 2024-03-16T07:30:16.377 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_sessions": 0, 2024-03-16T07:30:16.377 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_session_open": 0, 2024-03-16T07:30:16.377 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_session_close": 0, 2024-03-16T07:30:16.377 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_laggy": 0, 2024-03-16T07:30:16.377 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_wr": 0, 2024-03-16T07:30:16.377 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_rd": 0, 2024-03-16T07:30:16.377 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_del": 0 2024-03-16T07:30:16.377 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:30:16.377 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:30:16.377 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:30:16.377 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-msgr_dispatch_throttler-client": [ 2024-03-16T07:30:16.377 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:30:16.377 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:30:16.378 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:30:16.378 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:30:16.378 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-03-16T07:30:16.378 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:30:16.378 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 67, 2024-03-16T07:30:16.378 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 267477, 2024-03-16T07:30:16.378 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:30:16.378 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 67, 2024-03-16T07:30:16.378 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:30:16.378 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:30:16.378 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 67, 2024-03-16T07:30:16.378 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 267477, 2024-03-16T07:30:16.378 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:30:16.378 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:30:16.378 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:30:16.378 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:30:16.379 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:30:16.379 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:30:16.379 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:30:16.379 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:30:16.379 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-msgr_dispatch_throttler-radosclient": [ 2024-03-16T07:30:16.379 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:30:16.379 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:30:16.379 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:30:16.379 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:30:16.379 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-03-16T07:30:16.379 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:30:16.379 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 45, 2024-03-16T07:30:16.379 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 1503237, 2024-03-16T07:30:16.379 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:30:16.380 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 45, 2024-03-16T07:30:16.380 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:30:16.380 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:30:16.380 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 45, 2024-03-16T07:30:16.380 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 1503237, 2024-03-16T07:30:16.380 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:30:16.380 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:30:16.380 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:30:16.380 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:30:16.380 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:30:16.380 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:30:16.380 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:30:16.380 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:30:16.380 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-objecter_bytes": [ 2024-03-16T07:30:16.380 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:30:16.380 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:30:16.380 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:30:16.381 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:30:16.381 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-03-16T07:30:16.381 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:30:16.381 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 0, 2024-03-16T07:30:16.381 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 0, 2024-03-16T07:30:16.381 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:30:16.381 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 0, 2024-03-16T07:30:16.381 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:30:16.381 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:30:16.381 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 0, 2024-03-16T07:30:16.381 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 0, 2024-03-16T07:30:16.381 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:30:16.381 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:30:16.381 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:30:16.381 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:30:16.381 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:30:16.382 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:30:16.382 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:30:16.382 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:30:16.382 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-objecter_ops": [ 2024-03-16T07:30:16.382 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:30:16.382 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:30:16.382 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:30:16.382 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:30:16.382 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 1024, 2024-03-16T07:30:16.382 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:30:16.382 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 0, 2024-03-16T07:30:16.382 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 0, 2024-03-16T07:30:16.382 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:30:16.382 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 0, 2024-03-16T07:30:16.382 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:30:16.382 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:30:16.383 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 0, 2024-03-16T07:30:16.383 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 0, 2024-03-16T07:30:16.383 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:30:16.383 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:30:16.383 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:30:16.383 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:30:16.383 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:30:16.383 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:30:16.383 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:30:16.383 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2024-03-16T07:30:16.383 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-03-16T07:30:16.384 DEBUG:tasks.cephfs.test_mirroring:command returned={ "AsyncMessenger::Worker": [ { "labels": { "id": "0" }, "counters": { "msgr_connection_ready_timeouts": 0, "msgr_connection_idle_timeouts": 0 } }, { "labels": { "id": "1" }, "counters": { "msgr_connection_ready_timeouts": 0, "msgr_connection_idle_timeouts": 0 } }, { "labels": { "id": "2" }, "counters": { "msgr_connection_ready_timeouts": 0, "msgr_connection_idle_timeouts": 0 } } ], "AsyncMessenger::Worker-0": [ { "labels": {}, "counters": { "msgr_recv_messages": 7, "msgr_send_messages": 69, "msgr_recv_bytes": 1008, "msgr_send_bytes": 567792, "msgr_created_connections": 14, "msgr_active_connections": 3, "msgr_running_total_time": 0.257920297, "msgr_running_send_time": 0.078822473, "msgr_running_recv_time": 0.144527859, "msgr_running_fast_dispatch_time": 0.000000000, "msgr_send_messages_queue_lat": { "avgcount": 63, "sum": 0.156735564, "avgtime": 0.002487866 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "msgr_recv_encrypted_bytes": 1008, "msgr_send_encrypted_bytes": 567792 } } ], "AsyncMessenger::Worker-1": [ { "labels": {}, "counters": { "msgr_recv_messages": 67, "msgr_send_messages": 4, "msgr_recv_bytes": 276576, "msgr_send_bytes": 800, "msgr_created_connections": 3, "msgr_active_connections": 0, "msgr_running_total_time": 0.379638589, "msgr_running_send_time": 0.003474020, "msgr_running_recv_time": 0.244947455, "msgr_running_fast_dispatch_time": 0.118183893, "msgr_send_messages_queue_lat": { "avgcount": 4, "sum": 0.054597811, "avgtime": 0.013649452 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "msgr_recv_encrypted_bytes": 276576, "msgr_send_encrypted_bytes": 800 } } ], "AsyncMessenger::Worker-2": [ { "labels": {}, "counters": { "msgr_recv_messages": 41, "msgr_send_messages": 7, "msgr_recv_bytes": 1509200, "msgr_send_bytes": 1264, "msgr_created_connections": 2, "msgr_active_connections": 1, "msgr_running_total_time": 0.777542990, "msgr_running_send_time": 0.006317901, "msgr_running_recv_time": 1.502526872, "msgr_running_fast_dispatch_time": 0.000000000, "msgr_send_messages_queue_lat": { "avgcount": 7, "sum": 0.160821353, "avgtime": 0.022974479 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "msgr_recv_encrypted_bytes": 1509200, "msgr_send_encrypted_bytes": 1264 } } ], "cct": [ { "labels": {}, "counters": { "total_workers": 0, "unhealthy_workers": 0 } } ], "cephfs_mirror": [ { "labels": {}, "counters": { "mirrored_filesystems": 1, "mirror_enable_failures": 0 } } ], "cephfs_mirror_mirrored_filesystems": [ { "labels": { "filesystem": "cephfs" }, "counters": { "mirroring_peers": 0, "directory_count": 0 } } ], "mempool": [ { "labels": {}, "counters": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_cache_buffer_bytes": 0, "bluestore_cache_buffer_items": 0, "bluestore_extent_bytes": 0, "bluestore_extent_items": 0, "bluestore_blob_bytes": 0, "bluestore_blob_items": 0, "bluestore_shared_blob_bytes": 0, "bluestore_shared_blob_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_items": 0, "bluefs_bytes": 0, "bluefs_items": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "buffer_anon_bytes": 175487, "buffer_anon_items": 51, "buffer_meta_bytes": 0, "buffer_meta_items": 0, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 18952, "osdmap_items": 184, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "mds_co_bytes": 0, "mds_co_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 } } ], "objecter": [ { "labels": {}, "counters": { "op_active": 0, "op_laggy": 0, "op_send": 0, "op_send_bytes": 0, "op_resend": 0, "op_reply": 0, "op_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "op_inflight": 0, "oplen_avg": { "avgcount": 0, "sum": 0 }, "op": 0, "op_r": 0, "op_w": 0, "op_rmw": 0, "op_pg": 0, "osdop_stat": 0, "osdop_create": 0, "osdop_read": 0, "osdop_write": 0, "osdop_writefull": 0, "osdop_writesame": 0, "osdop_append": 0, "osdop_zero": 0, "osdop_truncate": 0, "osdop_delete": 0, "osdop_mapext": 0, "osdop_sparse_read": 0, "osdop_clonerange": 0, "osdop_getxattr": 0, "osdop_setxattr": 0, "osdop_cmpxattr": 0, "osdop_rmxattr": 0, "osdop_resetxattrs": 0, "osdop_call": 0, "osdop_watch": 0, "osdop_notify": 0, "osdop_src_cmpxattr": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_other": 0, "linger_active": 0, "linger_send": 0, "linger_resend": 0, "linger_ping": 0, "poolop_active": 0, "poolop_send": 0, "poolop_resend": 0, "poolstat_active": 0, "poolstat_send": 0, "poolstat_resend": 0, "statfs_active": 0, "statfs_send": 0, "statfs_resend": 0, "command_active": 0, "command_send": 0, "command_resend": 0, "map_epoch": 0, "map_full": 0, "map_inc": 0, "osd_sessions": 0, "osd_session_open": 0, "osd_session_close": 0, "osd_laggy": 0, "omap_wr": 0, "omap_rd": 0, "omap_del": 0 } } ], "throttle-msgr_dispatch_throttler-client": [ { "labels": {}, "counters": { "val": 0, "max": 104857600, "get_started": 0, "get": 67, "get_sum": 267477, "get_or_fail_fail": 0, "get_or_fail_success": 67, "take": 0, "take_sum": 0, "put": 67, "put_sum": 267477, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ], "throttle-msgr_dispatch_throttler-radosclient": [ { "labels": {}, "counters": { "val": 0, "max": 104857600, "get_started": 0, "get": 45, "get_sum": 1503237, "get_or_fail_fail": 0, "get_or_fail_success": 45, "take": 0, "take_sum": 0, "put": 45, "put_sum": 1503237, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ], "throttle-objecter_bytes": [ { "labels": {}, "counters": { "val": 0, "max": 104857600, "get_started": 0, "get": 0, "get_sum": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "take": 0, "take_sum": 0, "put": 0, "put_sum": 0, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ], "throttle-objecter_ops": [ { "labels": {}, "counters": { "val": 0, "max": 1024, "get_started": 0, "get": 0, "get_sum": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "take": 0, "take_sum": 0, "put": 0, "put_sum": 0, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ] } 2024-03-16T07:30:16.385 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snapshot mirror disable cephfs 2024-03-16T07:30:17.472 INFO:teuthology.orchestra.run.smithi049.stdout:{} 2024-03-16T07:30:27.487 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-03-16T07:30:27.487 DEBUG:teuthology.orchestra.run.smithi049:mirror status for fs: cephfs> ceph --admin-daemon /var/run/ceph/cephfs-mirror.asok fs mirror status cephfs@8 2024-03-16T07:30:27.585 INFO:teuthology.orchestra.run.smithi049.stderr:no valid command found; 10 closest matches: 2024-03-16T07:30:27.585 INFO:teuthology.orchestra.run.smithi049.stderr:0 2024-03-16T07:30:27.585 INFO:teuthology.orchestra.run.smithi049.stderr:1 2024-03-16T07:30:27.585 INFO:teuthology.orchestra.run.smithi049.stderr:2 2024-03-16T07:30:27.585 INFO:teuthology.orchestra.run.smithi049.stderr:abort 2024-03-16T07:30:27.585 INFO:teuthology.orchestra.run.smithi049.stderr:assert 2024-03-16T07:30:27.585 INFO:teuthology.orchestra.run.smithi049.stderr:config diff 2024-03-16T07:30:27.585 INFO:teuthology.orchestra.run.smithi049.stderr:config diff get 2024-03-16T07:30:27.585 INFO:teuthology.orchestra.run.smithi049.stderr:config get 2024-03-16T07:30:27.585 INFO:teuthology.orchestra.run.smithi049.stderr:config help [] 2024-03-16T07:30:27.586 INFO:teuthology.orchestra.run.smithi049.stderr:config set ... 2024-03-16T07:30:27.586 INFO:teuthology.orchestra.run.smithi049.stderr:admin_socket: invalid command 2024-03-16T07:30:27.586 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-03-16T07:30:27.587 WARNING:tasks.cephfs.test_mirroring:mirror daemon command with label "mirror status for fs: cephfs" failed: Command failed (mirror status for fs: cephfs) on smithi049 with status 22: 'ceph --admin-daemon /var/run/ceph/cephfs-mirror.asok fs mirror status cephfs@8' 2024-03-16T07:30:27.587 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-03-16T07:30:27.587 DEBUG:teuthology.orchestra.run.smithi049:counter dump for fs: cephfs> ceph --admin-daemon /var/run/ceph/cephfs-mirror.asok counter dump 2024-03-16T07:30:27.706 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-03-16T07:30:27.706 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker": [ 2024-03-16T07:30:27.706 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:30:27.706 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:30:27.706 INFO:teuthology.orchestra.run.smithi049.stdout: "id": "0" 2024-03-16T07:30:27.706 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:30:27.706 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:30:27.706 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_ready_timeouts": 0, 2024-03-16T07:30:27.707 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_idle_timeouts": 0 2024-03-16T07:30:27.707 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:30:27.707 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:30:27.707 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:30:27.707 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:30:27.707 INFO:teuthology.orchestra.run.smithi049.stdout: "id": "1" 2024-03-16T07:30:27.707 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:30:27.707 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:30:27.707 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_ready_timeouts": 0, 2024-03-16T07:30:27.707 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_idle_timeouts": 0 2024-03-16T07:30:27.707 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:30:27.707 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:30:27.707 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:30:27.707 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:30:27.708 INFO:teuthology.orchestra.run.smithi049.stdout: "id": "2" 2024-03-16T07:30:27.708 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:30:27.708 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:30:27.708 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_ready_timeouts": 0, 2024-03-16T07:30:27.708 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_idle_timeouts": 0 2024-03-16T07:30:27.708 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:30:27.708 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:30:27.708 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:30:27.708 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-0": [ 2024-03-16T07:30:27.708 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:30:27.708 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:30:27.708 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:30:27.708 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 7, 2024-03-16T07:30:27.709 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 71, 2024-03-16T07:30:27.709 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 1008, 2024-03-16T07:30:27.709 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 568304, 2024-03-16T07:30:27.709 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 14, 2024-03-16T07:30:27.709 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 3, 2024-03-16T07:30:27.709 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 0.258695819, 2024-03-16T07:30:27.709 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.079527608, 2024-03-16T07:30:27.709 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 0.144527859, 2024-03-16T07:30:27.709 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-03-16T07:30:27.709 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T07:30:27.709 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 65, 2024-03-16T07:30:27.709 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.157055568, 2024-03-16T07:30:27.709 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.002416239 2024-03-16T07:30:27.709 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:30:27.710 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-03-16T07:30:27.710 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:30:27.710 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:30:27.710 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:30:27.710 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:30:27.710 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 1008, 2024-03-16T07:30:27.710 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 568304 2024-03-16T07:30:27.710 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:30:27.710 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:30:27.710 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:30:27.710 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-1": [ 2024-03-16T07:30:27.710 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:30:27.710 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:30:27.711 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:30:27.711 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 68, 2024-03-16T07:30:27.711 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 4, 2024-03-16T07:30:27.711 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 281456, 2024-03-16T07:30:27.711 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 800, 2024-03-16T07:30:27.711 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 3, 2024-03-16T07:30:27.711 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 0, 2024-03-16T07:30:27.711 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 0.383801282, 2024-03-16T07:30:27.711 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.003538898, 2024-03-16T07:30:27.711 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 0.247321096, 2024-03-16T07:30:27.711 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.119509684, 2024-03-16T07:30:27.711 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T07:30:27.711 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 4, 2024-03-16T07:30:27.711 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.054597811, 2024-03-16T07:30:27.711 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.013649452 2024-03-16T07:30:27.712 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:30:27.712 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-03-16T07:30:27.712 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:30:27.712 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:30:27.712 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:30:27.712 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:30:27.712 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 281456, 2024-03-16T07:30:27.712 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 800 2024-03-16T07:30:27.712 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:30:27.712 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:30:27.712 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:30:27.712 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-2": [ 2024-03-16T07:30:27.712 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:30:27.712 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:30:27.712 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:30:27.713 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 41, 2024-03-16T07:30:27.713 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 7, 2024-03-16T07:30:27.713 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 1509200, 2024-03-16T07:30:27.713 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 1264, 2024-03-16T07:30:27.713 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 2, 2024-03-16T07:30:27.713 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 1, 2024-03-16T07:30:27.713 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 0.778013916, 2024-03-16T07:30:27.713 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.006365147, 2024-03-16T07:30:27.713 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 1.502675228, 2024-03-16T07:30:27.713 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-03-16T07:30:27.713 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T07:30:27.713 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 7, 2024-03-16T07:30:27.713 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.160821353, 2024-03-16T07:30:27.713 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.022974479 2024-03-16T07:30:27.714 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:30:27.714 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-03-16T07:30:27.714 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:30:27.714 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:30:27.714 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:30:27.714 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:30:27.714 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 1509200, 2024-03-16T07:30:27.714 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 1264 2024-03-16T07:30:27.714 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:30:27.714 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:30:27.714 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:30:27.714 INFO:teuthology.orchestra.run.smithi049.stdout: "cct": [ 2024-03-16T07:30:27.714 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:30:27.714 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:30:27.714 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:30:27.715 INFO:teuthology.orchestra.run.smithi049.stdout: "total_workers": 0, 2024-03-16T07:30:27.715 INFO:teuthology.orchestra.run.smithi049.stdout: "unhealthy_workers": 0 2024-03-16T07:30:27.715 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:30:27.715 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:30:27.715 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:30:27.715 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs_mirror": [ 2024-03-16T07:30:27.715 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:30:27.715 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:30:27.715 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:30:27.715 INFO:teuthology.orchestra.run.smithi049.stdout: "mirrored_filesystems": 0, 2024-03-16T07:30:27.715 INFO:teuthology.orchestra.run.smithi049.stdout: "mirror_enable_failures": 0 2024-03-16T07:30:27.715 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:30:27.715 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:30:27.715 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:30:27.715 INFO:teuthology.orchestra.run.smithi049.stdout: "mempool": [ 2024-03-16T07:30:27.716 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:30:27.716 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:30:27.716 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:30:27.716 INFO:teuthology.orchestra.run.smithi049.stdout: "bloom_filter_bytes": 0, 2024-03-16T07:30:27.716 INFO:teuthology.orchestra.run.smithi049.stdout: "bloom_filter_items": 0, 2024-03-16T07:30:27.716 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_alloc_bytes": 0, 2024-03-16T07:30:27.716 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_alloc_items": 0, 2024-03-16T07:30:27.716 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_data_bytes": 0, 2024-03-16T07:30:27.716 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_data_items": 0, 2024-03-16T07:30:27.716 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_onode_bytes": 0, 2024-03-16T07:30:27.716 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_onode_items": 0, 2024-03-16T07:30:27.716 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_meta_bytes": 0, 2024-03-16T07:30:27.716 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_meta_items": 0, 2024-03-16T07:30:27.716 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_other_bytes": 0, 2024-03-16T07:30:27.716 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_other_items": 0, 2024-03-16T07:30:27.717 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_buffer_bytes": 0, 2024-03-16T07:30:27.717 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_buffer_items": 0, 2024-03-16T07:30:27.717 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_extent_bytes": 0, 2024-03-16T07:30:27.717 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_extent_items": 0, 2024-03-16T07:30:27.717 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_blob_bytes": 0, 2024-03-16T07:30:27.717 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_blob_items": 0, 2024-03-16T07:30:27.717 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_shared_blob_bytes": 0, 2024-03-16T07:30:27.717 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_shared_blob_items": 0, 2024-03-16T07:30:27.717 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_inline_bl_bytes": 0, 2024-03-16T07:30:27.717 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_inline_bl_items": 0, 2024-03-16T07:30:27.717 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_fsck_bytes": 0, 2024-03-16T07:30:27.717 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_fsck_items": 0, 2024-03-16T07:30:27.717 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_txc_bytes": 0, 2024-03-16T07:30:27.717 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_txc_items": 0, 2024-03-16T07:30:27.717 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_deferred_bytes": 0, 2024-03-16T07:30:27.718 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_deferred_items": 0, 2024-03-16T07:30:27.718 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_bytes": 0, 2024-03-16T07:30:27.718 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_items": 0, 2024-03-16T07:30:27.718 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_bytes": 0, 2024-03-16T07:30:27.718 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_items": 0, 2024-03-16T07:30:27.718 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_reader_bytes": 0, 2024-03-16T07:30:27.718 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_reader_items": 0, 2024-03-16T07:30:27.718 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_writer_bytes": 0, 2024-03-16T07:30:27.718 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_writer_items": 0, 2024-03-16T07:30:27.718 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_anon_bytes": 149234, 2024-03-16T07:30:27.718 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_anon_items": 26, 2024-03-16T07:30:27.718 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_meta_bytes": 0, 2024-03-16T07:30:27.719 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_meta_items": 0, 2024-03-16T07:30:27.719 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_bytes": 0, 2024-03-16T07:30:27.719 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_items": 0, 2024-03-16T07:30:27.719 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_mapbl_bytes": 0, 2024-03-16T07:30:27.719 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_mapbl_items": 0, 2024-03-16T07:30:27.719 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pglog_bytes": 0, 2024-03-16T07:30:27.719 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pglog_items": 0, 2024-03-16T07:30:27.719 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_bytes": 4824, 2024-03-16T07:30:27.719 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_items": 52, 2024-03-16T07:30:27.719 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_mapping_bytes": 0, 2024-03-16T07:30:27.720 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_mapping_items": 0, 2024-03-16T07:30:27.720 INFO:teuthology.orchestra.run.smithi049.stdout: "pgmap_bytes": 0, 2024-03-16T07:30:27.720 INFO:teuthology.orchestra.run.smithi049.stdout: "pgmap_items": 0, 2024-03-16T07:30:27.720 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_co_bytes": 0, 2024-03-16T07:30:27.720 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_co_items": 0, 2024-03-16T07:30:27.720 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_1_bytes": 0, 2024-03-16T07:30:27.720 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_1_items": 0, 2024-03-16T07:30:27.720 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_2_bytes": 0, 2024-03-16T07:30:27.720 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_2_items": 0 2024-03-16T07:30:27.720 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:30:27.720 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:30:27.720 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:30:27.720 INFO:teuthology.orchestra.run.smithi049.stdout: "objecter": [ 2024-03-16T07:30:27.720 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:30:27.721 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:30:27.721 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:30:27.721 INFO:teuthology.orchestra.run.smithi049.stdout: "op_active": 0, 2024-03-16T07:30:27.721 INFO:teuthology.orchestra.run.smithi049.stdout: "op_laggy": 0, 2024-03-16T07:30:27.721 INFO:teuthology.orchestra.run.smithi049.stdout: "op_send": 0, 2024-03-16T07:30:27.721 INFO:teuthology.orchestra.run.smithi049.stdout: "op_send_bytes": 0, 2024-03-16T07:30:27.721 INFO:teuthology.orchestra.run.smithi049.stdout: "op_resend": 0, 2024-03-16T07:30:27.721 INFO:teuthology.orchestra.run.smithi049.stdout: "op_reply": 0, 2024-03-16T07:30:27.721 INFO:teuthology.orchestra.run.smithi049.stdout: "op_latency": { 2024-03-16T07:30:27.721 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:30:27.721 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:30:27.721 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:30:27.722 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:30:27.722 INFO:teuthology.orchestra.run.smithi049.stdout: "op_inflight": 0, 2024-03-16T07:30:27.722 INFO:teuthology.orchestra.run.smithi049.stdout: "oplen_avg": { 2024-03-16T07:30:27.722 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:30:27.722 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0 2024-03-16T07:30:27.722 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:30:27.722 INFO:teuthology.orchestra.run.smithi049.stdout: "op": 0, 2024-03-16T07:30:27.722 INFO:teuthology.orchestra.run.smithi049.stdout: "op_r": 0, 2024-03-16T07:30:27.722 INFO:teuthology.orchestra.run.smithi049.stdout: "op_w": 0, 2024-03-16T07:30:27.722 INFO:teuthology.orchestra.run.smithi049.stdout: "op_rmw": 0, 2024-03-16T07:30:27.722 INFO:teuthology.orchestra.run.smithi049.stdout: "op_pg": 0, 2024-03-16T07:30:27.722 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_stat": 0, 2024-03-16T07:30:27.722 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_create": 0, 2024-03-16T07:30:27.723 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_read": 0, 2024-03-16T07:30:27.723 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_write": 0, 2024-03-16T07:30:27.723 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_writefull": 0, 2024-03-16T07:30:27.723 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_writesame": 0, 2024-03-16T07:30:27.723 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_append": 0, 2024-03-16T07:30:27.723 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_zero": 0, 2024-03-16T07:30:27.723 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_truncate": 0, 2024-03-16T07:30:27.723 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_delete": 0, 2024-03-16T07:30:27.723 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_mapext": 0, 2024-03-16T07:30:27.723 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_sparse_read": 0, 2024-03-16T07:30:27.723 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_clonerange": 0, 2024-03-16T07:30:27.723 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_getxattr": 0, 2024-03-16T07:30:27.724 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_setxattr": 0, 2024-03-16T07:30:27.724 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_cmpxattr": 0, 2024-03-16T07:30:27.724 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_rmxattr": 0, 2024-03-16T07:30:27.724 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_resetxattrs": 0, 2024-03-16T07:30:27.724 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_call": 0, 2024-03-16T07:30:27.724 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_watch": 0, 2024-03-16T07:30:27.724 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_notify": 0, 2024-03-16T07:30:27.724 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_src_cmpxattr": 0, 2024-03-16T07:30:27.724 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_pgls": 0, 2024-03-16T07:30:27.724 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_pgls_filter": 0, 2024-03-16T07:30:27.724 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_other": 0, 2024-03-16T07:30:27.724 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_active": 0, 2024-03-16T07:30:27.724 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_send": 0, 2024-03-16T07:30:27.724 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_resend": 0, 2024-03-16T07:30:27.725 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_ping": 0, 2024-03-16T07:30:27.725 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_active": 0, 2024-03-16T07:30:27.725 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_send": 0, 2024-03-16T07:30:27.725 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_resend": 0, 2024-03-16T07:30:27.725 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_active": 0, 2024-03-16T07:30:27.725 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_send": 0, 2024-03-16T07:30:27.725 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_resend": 0, 2024-03-16T07:30:27.725 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_active": 0, 2024-03-16T07:30:27.725 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_send": 0, 2024-03-16T07:30:27.725 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_resend": 0, 2024-03-16T07:30:27.725 INFO:teuthology.orchestra.run.smithi049.stdout: "command_active": 0, 2024-03-16T07:30:27.725 INFO:teuthology.orchestra.run.smithi049.stdout: "command_send": 0, 2024-03-16T07:30:27.725 INFO:teuthology.orchestra.run.smithi049.stdout: "command_resend": 0, 2024-03-16T07:30:27.725 INFO:teuthology.orchestra.run.smithi049.stdout: "map_epoch": 0, 2024-03-16T07:30:27.726 INFO:teuthology.orchestra.run.smithi049.stdout: "map_full": 0, 2024-03-16T07:30:27.726 INFO:teuthology.orchestra.run.smithi049.stdout: "map_inc": 0, 2024-03-16T07:30:27.726 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_sessions": 0, 2024-03-16T07:30:27.726 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_session_open": 0, 2024-03-16T07:30:27.726 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_session_close": 0, 2024-03-16T07:30:27.726 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_laggy": 0, 2024-03-16T07:30:27.726 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_wr": 0, 2024-03-16T07:30:27.726 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_rd": 0, 2024-03-16T07:30:27.726 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_del": 0 2024-03-16T07:30:27.726 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:30:27.726 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:30:27.726 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:30:27.726 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-msgr_dispatch_throttler-client": [ 2024-03-16T07:30:27.727 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:30:27.727 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:30:27.727 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:30:27.727 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:30:27.727 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-03-16T07:30:27.727 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:30:27.727 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 68, 2024-03-16T07:30:27.727 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 272223, 2024-03-16T07:30:27.727 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:30:27.727 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 68, 2024-03-16T07:30:27.727 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:30:27.727 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:30:27.727 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 68, 2024-03-16T07:30:27.727 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 272223, 2024-03-16T07:30:27.727 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:30:27.728 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:30:27.728 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:30:27.728 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:30:27.728 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:30:27.728 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:30:27.728 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:30:27.728 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:30:27.728 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-msgr_dispatch_throttler-radosclient": [ 2024-03-16T07:30:27.728 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:30:27.728 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:30:27.728 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:30:27.728 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:30:27.728 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-03-16T07:30:27.728 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:30:27.729 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 45, 2024-03-16T07:30:27.729 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 1503237, 2024-03-16T07:30:27.729 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:30:27.729 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 45, 2024-03-16T07:30:27.729 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:30:27.729 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:30:27.729 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 45, 2024-03-16T07:30:27.729 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 1503237, 2024-03-16T07:30:27.729 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:30:27.729 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:30:27.729 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:30:27.729 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:30:27.729 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:30:27.729 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:30:27.729 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:30:27.730 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:30:27.730 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-objecter_bytes": [ 2024-03-16T07:30:27.730 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:30:27.730 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:30:27.730 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:30:27.730 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:30:27.730 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-03-16T07:30:27.730 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:30:27.730 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 0, 2024-03-16T07:30:27.730 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 0, 2024-03-16T07:30:27.730 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:30:27.730 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 0, 2024-03-16T07:30:27.730 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:30:27.730 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:30:27.731 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 0, 2024-03-16T07:30:27.731 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 0, 2024-03-16T07:30:27.731 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:30:27.731 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:30:27.731 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:30:27.731 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:30:27.731 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:30:27.731 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:30:27.731 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:30:27.731 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:30:27.731 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-objecter_ops": [ 2024-03-16T07:30:27.731 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:30:27.731 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:30:27.731 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:30:27.731 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:30:27.731 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 1024, 2024-03-16T07:30:27.732 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:30:27.732 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 0, 2024-03-16T07:30:27.732 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 0, 2024-03-16T07:30:27.732 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:30:27.732 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 0, 2024-03-16T07:30:27.732 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:30:27.732 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:30:27.732 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 0, 2024-03-16T07:30:27.732 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 0, 2024-03-16T07:30:27.732 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:30:27.732 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:30:27.732 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:30:27.732 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:30:27.733 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:30:27.733 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:30:27.733 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:30:27.733 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2024-03-16T07:30:27.733 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-03-16T07:30:27.734 DEBUG:tasks.cephfs.test_mirroring:command returned={ "AsyncMessenger::Worker": [ { "labels": { "id": "0" }, "counters": { "msgr_connection_ready_timeouts": 0, "msgr_connection_idle_timeouts": 0 } }, { "labels": { "id": "1" }, "counters": { "msgr_connection_ready_timeouts": 0, "msgr_connection_idle_timeouts": 0 } }, { "labels": { "id": "2" }, "counters": { "msgr_connection_ready_timeouts": 0, "msgr_connection_idle_timeouts": 0 } } ], "AsyncMessenger::Worker-0": [ { "labels": {}, "counters": { "msgr_recv_messages": 7, "msgr_send_messages": 71, "msgr_recv_bytes": 1008, "msgr_send_bytes": 568304, "msgr_created_connections": 14, "msgr_active_connections": 3, "msgr_running_total_time": 0.258695819, "msgr_running_send_time": 0.079527608, "msgr_running_recv_time": 0.144527859, "msgr_running_fast_dispatch_time": 0.000000000, "msgr_send_messages_queue_lat": { "avgcount": 65, "sum": 0.157055568, "avgtime": 0.002416239 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "msgr_recv_encrypted_bytes": 1008, "msgr_send_encrypted_bytes": 568304 } } ], "AsyncMessenger::Worker-1": [ { "labels": {}, "counters": { "msgr_recv_messages": 68, "msgr_send_messages": 4, "msgr_recv_bytes": 281456, "msgr_send_bytes": 800, "msgr_created_connections": 3, "msgr_active_connections": 0, "msgr_running_total_time": 0.383801282, "msgr_running_send_time": 0.003538898, "msgr_running_recv_time": 0.247321096, "msgr_running_fast_dispatch_time": 0.119509684, "msgr_send_messages_queue_lat": { "avgcount": 4, "sum": 0.054597811, "avgtime": 0.013649452 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "msgr_recv_encrypted_bytes": 281456, "msgr_send_encrypted_bytes": 800 } } ], "AsyncMessenger::Worker-2": [ { "labels": {}, "counters": { "msgr_recv_messages": 41, "msgr_send_messages": 7, "msgr_recv_bytes": 1509200, "msgr_send_bytes": 1264, "msgr_created_connections": 2, "msgr_active_connections": 1, "msgr_running_total_time": 0.778013916, "msgr_running_send_time": 0.006365147, "msgr_running_recv_time": 1.502675228, "msgr_running_fast_dispatch_time": 0.000000000, "msgr_send_messages_queue_lat": { "avgcount": 7, "sum": 0.160821353, "avgtime": 0.022974479 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "msgr_recv_encrypted_bytes": 1509200, "msgr_send_encrypted_bytes": 1264 } } ], "cct": [ { "labels": {}, "counters": { "total_workers": 0, "unhealthy_workers": 0 } } ], "cephfs_mirror": [ { "labels": {}, "counters": { "mirrored_filesystems": 0, "mirror_enable_failures": 0 } } ], "mempool": [ { "labels": {}, "counters": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_cache_buffer_bytes": 0, "bluestore_cache_buffer_items": 0, "bluestore_extent_bytes": 0, "bluestore_extent_items": 0, "bluestore_blob_bytes": 0, "bluestore_blob_items": 0, "bluestore_shared_blob_bytes": 0, "bluestore_shared_blob_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_items": 0, "bluefs_bytes": 0, "bluefs_items": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "buffer_anon_bytes": 149234, "buffer_anon_items": 26, "buffer_meta_bytes": 0, "buffer_meta_items": 0, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 4824, "osdmap_items": 52, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "mds_co_bytes": 0, "mds_co_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 } } ], "objecter": [ { "labels": {}, "counters": { "op_active": 0, "op_laggy": 0, "op_send": 0, "op_send_bytes": 0, "op_resend": 0, "op_reply": 0, "op_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "op_inflight": 0, "oplen_avg": { "avgcount": 0, "sum": 0 }, "op": 0, "op_r": 0, "op_w": 0, "op_rmw": 0, "op_pg": 0, "osdop_stat": 0, "osdop_create": 0, "osdop_read": 0, "osdop_write": 0, "osdop_writefull": 0, "osdop_writesame": 0, "osdop_append": 0, "osdop_zero": 0, "osdop_truncate": 0, "osdop_delete": 0, "osdop_mapext": 0, "osdop_sparse_read": 0, "osdop_clonerange": 0, "osdop_getxattr": 0, "osdop_setxattr": 0, "osdop_cmpxattr": 0, "osdop_rmxattr": 0, "osdop_resetxattrs": 0, "osdop_call": 0, "osdop_watch": 0, "osdop_notify": 0, "osdop_src_cmpxattr": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_other": 0, "linger_active": 0, "linger_send": 0, "linger_resend": 0, "linger_ping": 0, "poolop_active": 0, "poolop_send": 0, "poolop_resend": 0, "poolstat_active": 0, "poolstat_send": 0, "poolstat_resend": 0, "statfs_active": 0, "statfs_send": 0, "statfs_resend": 0, "command_active": 0, "command_send": 0, "command_resend": 0, "map_epoch": 0, "map_full": 0, "map_inc": 0, "osd_sessions": 0, "osd_session_open": 0, "osd_session_close": 0, "osd_laggy": 0, "omap_wr": 0, "omap_rd": 0, "omap_del": 0 } } ], "throttle-msgr_dispatch_throttler-client": [ { "labels": {}, "counters": { "val": 0, "max": 104857600, "get_started": 0, "get": 68, "get_sum": 272223, "get_or_fail_fail": 0, "get_or_fail_success": 68, "take": 0, "take_sum": 0, "put": 68, "put_sum": 272223, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ], "throttle-msgr_dispatch_throttler-radosclient": [ { "labels": {}, "counters": { "val": 0, "max": 104857600, "get_started": 0, "get": 45, "get_sum": 1503237, "get_or_fail_fail": 0, "get_or_fail_success": 45, "take": 0, "take_sum": 0, "put": 45, "put_sum": 1503237, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ], "throttle-objecter_bytes": [ { "labels": {}, "counters": { "val": 0, "max": 104857600, "get_started": 0, "get": 0, "get_sum": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "take": 0, "take_sum": 0, "put": 0, "put_sum": 0, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ], "throttle-objecter_ops": [ { "labels": {}, "counters": { "val": 0, "max": 1024, "get_started": 0, "get": 0, "get_sum": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "take": 0, "take_sum": 0, "put": 0, "put_sum": 0, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ] } 2024-03-16T07:30:27.734 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable mirroring 2024-03-16T07:30:28.494 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-03-16T07:30:28.494 DEBUG:teuthology.orchestra.run.smithi049:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-03-16T07:30:28.540 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-03-16T07:30:28.540 INFO:tasks.cephfs.mount:Terminating background process 2024-03-16T07:30:28.541 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-03-16T07:30:28.541 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-16T07:30:28.558 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T07:30:28.910 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:30:28.910 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":102,"fsid":"f91af061-9eac-4793-87fa-8d27ae3d242f","created":"2024-03-16T07:24:20.357868+0000","modified":"2024-03-16T07:30:19.472590+0000","last_up_change":"2024-03-16T07:24:27.474980+0000","last_in_change":"2024-03-16T07:24:21.254179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T07:24:28.947521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-03-16T07:29:31.811291+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-03-16T07:29:32.483018+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"96","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3600000143051147,"score_stable":1.3600000143051147,"optimal_score":1,"raw_score_acting":1.3600000143051147,"raw_score_stable":1.3600000143051147,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"backup_fs_metadata","create_time":"2024-03-16T07:29:50.191529+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"99","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"backup_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.4099999666213989,"score_stable":1.4099999666213989,"optimal_score":1,"raw_score_acting":1.4099999666213989,"raw_score_stable":1.4099999666213989,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"backup_fs_data","create_time":"2024-03-16T07:29:50.589589+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"100","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"backup_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.0800000429153442,"score_stable":1.0800000429153442,"optimal_score":1,"raw_score_acting":1.0800000429153442,"raw_score_stable":1.0800000429153442,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2df14aac-98dc-4e3c-ae7e-9eb677aa30be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6801","nonce":2744935777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6803","nonce":2744935777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6807","nonce":2744935777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6805","nonce":2744935777}]},"public_addr":"172.21.15.49:6801/2744935777","cluster_addr":"172.21.15.49:6803/2744935777","heartbeat_back_addr":"172.21.15.49:6807/2744935777","heartbeat_front_addr":"172.21.15.49:6805/2744935777","state":["exists","up"]},{"osd":1,"uuid":"80461bd9-59ef-46df-9eea-bad92d960c57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6811","nonce":1655120118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6815","nonce":1655120118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6821","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6823","nonce":1655120118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6817","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6819","nonce":1655120118}]},"public_addr":"172.21.15.49:6811/1655120118","cluster_addr":"172.21.15.49:6815/1655120118","heartbeat_back_addr":"172.21.15.49:6823/1655120118","heartbeat_front_addr":"172.21.15.49:6819/1655120118","state":["exists","up"]},{"osd":2,"uuid":"d6bf40eb-6e42-4ec9-8b3d-0b6c5a6def79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6810","nonce":3815472376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6814","nonce":3815472376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6822","nonce":3815472376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6818","nonce":3815472376}]},"public_addr":"172.21.15.49:6810/3815472376","cluster_addr":"172.21.15.49:6814/3815472376","heartbeat_back_addr":"172.21.15.49:6822/3815472376","heartbeat_front_addr":"172.21.15.49:6818/3815472376","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.641492+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.668598+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.614940+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.49:0/1873377254":"2024-03-16T08:30:19.454615+0000","172.21.15.49:0/466449902":"2024-03-17T07:30:03.409856+0000","172.21.15.49:0/3635332552":"2024-03-17T07:30:03.409856+0000","172.21.15.49:0/4220167359":"2024-03-17T07:30:03.409856+0000","172.21.15.49:0/2790567351":"2024-03-17T07:30:03.409856+0000","172.21.15.49:0/354741927":"2024-03-17T07:30:03.409856+0000","172.21.15.49:0/2885009482":"2024-03-17T07:30:03.409856+0000","172.21.15.49:0/710615353":"2024-03-17T07:30:03.409856+0000","172.21.15.49:6825/3567684888":"2024-03-17T07:30:03.409856+0000","172.21.15.49:0/253037853":"2024-03-17T07:30:03.409856+0000","172.21.15.49:6824/3567684888":"2024-03-17T07:30:03.409856+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T07:30:28.924 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-16T07:24:28.947521+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-16T07:29:31.811291+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '95', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 17, 'pool_name': 'cephfs_data', 'create_time': '2024-03-16T07:29:32.483018+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '96', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3600000143051147, 'score_stable': 1.3600000143051147, 'optimal_score': 1, 'raw_score_acting': 1.3600000143051147, 'raw_score_stable': 1.3600000143051147, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 18, 'pool_name': 'backup_fs_metadata', 'create_time': '2024-03-16T07:29:50.191529+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '99', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'backup_fs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.409999966621399, 'score_stable': 1.409999966621399, 'optimal_score': 1, 'raw_score_acting': 1.409999966621399, 'raw_score_stable': 1.409999966621399, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 19, 'pool_name': 'backup_fs_data', 'create_time': '2024-03-16T07:29:50.589589+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '100', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'backup_fs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.0800000429153442, 'score_stable': 1.0800000429153442, 'optimal_score': 1, 'raw_score_acting': 1.0800000429153442, 'raw_score_stable': 1.0800000429153442, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-16T07:30:28.924 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-16T07:30:28.966 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:30:28.967+0000 7f1da4e2b040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-16T07:30:29.029 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:30:29.030+0000 7f1da4e2b040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-16T07:30:29.319 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2024-03-16T07:30:29.332 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-16T07:30:29.547 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:30:29.549+0000 7f1da4e2b040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-16T07:30:29.594 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:30:29.596+0000 7f1da4e2b040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-16T07:30:29.640 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:30:29.641+0000 7f1da4e2b040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-16T07:30:29.694 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:30:29.696+0000 7f1da4e2b040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-16T07:30:29.738 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:30:29.740+0000 7f1da4e2b040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-16T07:30:29.833 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2024-03-16T07:30:29.852 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-16T07:30:29.864 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:30:29.866+0000 7f1da4e2b040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-16T07:30:29.922 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:30:29.924+0000 7f1da4e2b040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-16T07:30:29.968 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:30:29.970+0000 7f1da4e2b040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-16T07:30:30.020 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:30:30.022+0000 7f1da4e2b040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-16T07:30:30.072 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:30:30.073+0000 7f1da4e2b040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-16T07:30:30.160 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2024-03-16T07:30:30.173 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get backup_fs_metadata pg_num 2024-03-16T07:30:30.479 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:30:30.480+0000 7f1da4e2b040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-16T07:30:30.521 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2024-03-16T07:30:30.538 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get backup_fs_data pg_num 2024-03-16T07:30:30.723 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:30:30.725+0000 7f1da4e2b040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-16T07:30:30.853 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:30:30.854+0000 7f1da4e2b040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-16T07:30:30.894 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2024-03-16T07:30:30.908 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-16T07:30:30.923 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:30:30.925+0000 7f1da4e2b040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-16T07:30:31.079 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:30:31.080+0000 7f1da4e2b040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-16T07:30:31.176 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:30:31.177+0000 7f1da4e2b040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-16T07:30:31.349 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/1873377254 2024-03-16T08:30:19.454615+0000 2024-03-16T07:30:31.350 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/466449902 2024-03-17T07:30:03.409856+0000 2024-03-16T07:30:31.350 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/3635332552 2024-03-17T07:30:03.409856+0000 2024-03-16T07:30:31.350 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/4220167359 2024-03-17T07:30:03.409856+0000 2024-03-16T07:30:31.350 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/2790567351 2024-03-17T07:30:03.409856+0000 2024-03-16T07:30:31.350 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/354741927 2024-03-17T07:30:03.409856+0000 2024-03-16T07:30:31.350 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/2885009482 2024-03-17T07:30:03.409856+0000 2024-03-16T07:30:31.350 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/710615353 2024-03-17T07:30:03.409856+0000 2024-03-16T07:30:31.350 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:6825/3567684888 2024-03-17T07:30:03.409856+0000 2024-03-16T07:30:31.350 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/253037853 2024-03-17T07:30:03.409856+0000 2024-03-16T07:30:31.350 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:6824/3567684888 2024-03-17T07:30:03.409856+0000 2024-03-16T07:30:31.351 INFO:teuthology.orchestra.run.smithi049.stderr:listed 11 entries 2024-03-16T07:30:31.365 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi049.front.sepia.ceph.com... 2024-03-16T07:30:31.365 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:30:31.365 DEBUG:teuthology.orchestra.run.smithi049:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-03-16T07:30:31.416 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:30:31.418+0000 7f1da4e2b040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-16T07:30:31.435 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi049.stderr:ceph-fuse[64436]: fuse finished with error 0 and tester_r 0 2024-03-16T07:30:31.437 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi049.front.sepia.ceph.com 2024-03-16T07:30:31.437 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:30:31.437 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-03-16T07:30:31.463 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:30:31.465+0000 7f1da4e2b040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-16T07:30:31.588 INFO:tasks.cephfs.mount:Terminating background process 2024-03-16T07:30:31.588 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-03-16T07:30:31.588 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-16T07:30:31.591 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:30:31.593+0000 7f1da4e2b040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-16T07:30:31.606 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T07:30:31.959 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:30:31.959 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":102,"fsid":"f91af061-9eac-4793-87fa-8d27ae3d242f","created":"2024-03-16T07:24:20.357868+0000","modified":"2024-03-16T07:30:19.472590+0000","last_up_change":"2024-03-16T07:24:27.474980+0000","last_in_change":"2024-03-16T07:24:21.254179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T07:24:28.947521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-03-16T07:29:31.811291+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-03-16T07:29:32.483018+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"96","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3600000143051147,"score_stable":1.3600000143051147,"optimal_score":1,"raw_score_acting":1.3600000143051147,"raw_score_stable":1.3600000143051147,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"backup_fs_metadata","create_time":"2024-03-16T07:29:50.191529+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"99","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"backup_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.4099999666213989,"score_stable":1.4099999666213989,"optimal_score":1,"raw_score_acting":1.4099999666213989,"raw_score_stable":1.4099999666213989,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"backup_fs_data","create_time":"2024-03-16T07:29:50.589589+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"100","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"backup_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.0800000429153442,"score_stable":1.0800000429153442,"optimal_score":1,"raw_score_acting":1.0800000429153442,"raw_score_stable":1.0800000429153442,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2df14aac-98dc-4e3c-ae7e-9eb677aa30be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6801","nonce":2744935777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6803","nonce":2744935777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6807","nonce":2744935777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6805","nonce":2744935777}]},"public_addr":"172.21.15.49:6801/2744935777","cluster_addr":"172.21.15.49:6803/2744935777","heartbeat_back_addr":"172.21.15.49:6807/2744935777","heartbeat_front_addr":"172.21.15.49:6805/2744935777","state":["exists","up"]},{"osd":1,"uuid":"80461bd9-59ef-46df-9eea-bad92d960c57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6811","nonce":1655120118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6815","nonce":1655120118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6821","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6823","nonce":1655120118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6817","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6819","nonce":1655120118}]},"public_addr":"172.21.15.49:6811/1655120118","cluster_addr":"172.21.15.49:6815/1655120118","heartbeat_back_addr":"172.21.15.49:6823/1655120118","heartbeat_front_addr":"172.21.15.49:6819/1655120118","state":["exists","up"]},{"osd":2,"uuid":"d6bf40eb-6e42-4ec9-8b3d-0b6c5a6def79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6810","nonce":3815472376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6814","nonce":3815472376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6822","nonce":3815472376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6818","nonce":3815472376}]},"public_addr":"172.21.15.49:6810/3815472376","cluster_addr":"172.21.15.49:6814/3815472376","heartbeat_back_addr":"172.21.15.49:6822/3815472376","heartbeat_front_addr":"172.21.15.49:6818/3815472376","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.641492+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.668598+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.614940+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.49:0/1873377254":"2024-03-16T08:30:19.454615+0000","172.21.15.49:0/466449902":"2024-03-17T07:30:03.409856+0000","172.21.15.49:0/3635332552":"2024-03-17T07:30:03.409856+0000","172.21.15.49:0/4220167359":"2024-03-17T07:30:03.409856+0000","172.21.15.49:0/2790567351":"2024-03-17T07:30:03.409856+0000","172.21.15.49:0/354741927":"2024-03-17T07:30:03.409856+0000","172.21.15.49:0/2885009482":"2024-03-17T07:30:03.409856+0000","172.21.15.49:0/710615353":"2024-03-17T07:30:03.409856+0000","172.21.15.49:6825/3567684888":"2024-03-17T07:30:03.409856+0000","172.21.15.49:0/253037853":"2024-03-17T07:30:03.409856+0000","172.21.15.49:6824/3567684888":"2024-03-17T07:30:03.409856+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T07:30:31.977 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-16T07:24:28.947521+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-16T07:29:31.811291+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '95', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 17, 'pool_name': 'cephfs_data', 'create_time': '2024-03-16T07:29:32.483018+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '96', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3600000143051147, 'score_stable': 1.3600000143051147, 'optimal_score': 1, 'raw_score_acting': 1.3600000143051147, 'raw_score_stable': 1.3600000143051147, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 18, 'pool_name': 'backup_fs_metadata', 'create_time': '2024-03-16T07:29:50.191529+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '99', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'backup_fs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.409999966621399, 'score_stable': 1.409999966621399, 'optimal_score': 1, 'raw_score_acting': 1.409999966621399, 'raw_score_stable': 1.409999966621399, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 19, 'pool_name': 'backup_fs_data', 'create_time': '2024-03-16T07:29:50.589589+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '100', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'backup_fs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.0800000429153442, 'score_stable': 1.0800000429153442, 'optimal_score': 1, 'raw_score_acting': 1.0800000429153442, 'raw_score_stable': 1.0800000429153442, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-16T07:30:31.978 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-16T07:30:32.354 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2024-03-16T07:30:32.367 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-16T07:30:32.376 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:30:32.378+0000 7f1da4e2b040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-16T07:30:32.664 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:30:32.665+0000 7f1da4e2b040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-16T07:30:32.674 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2024-03-16T07:30:32.688 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-16T07:30:32.717 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:30:32.719+0000 7f1da4e2b040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-16T07:30:32.847 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:30:32.849+0000 7f1da4e2b040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-16T07:30:32.944 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:30:32.945+0000 7f1d262c7640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:30:32.944 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:30:32.945+0000 7f1d262c7640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:30:32.944 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:30:32.945+0000 7f1d262c7640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:30:32.944 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:30:32.945+0000 7f1d262c7640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:30:32.944 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:30:32.945+0000 7f1d262c7640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:30:32.944 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:30:32.945+0000 7f1d292cd640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:30:32.945 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:30:32.945+0000 7f1d292cd640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:30:32.945 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:30:32.945+0000 7f1d292cd640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:30:32.945 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:30:32.945+0000 7f1d292cd640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:30:32.945 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:30:32.945+0000 7f1d292cd640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:30:32.954 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:30:32.955+0000 7f1d262c7640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:30:32.954 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:30:32.955+0000 7f1d262c7640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:30:32.954 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:30:32.955+0000 7f1d262c7640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:30:32.954 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:30:32.955+0000 7f1d262c7640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:30:32.954 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:30:32.955+0000 7f1d262c7640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:30:32.954 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:30:32.955+0000 7f1d292cd640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:30:32.954 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:30:32.955+0000 7f1d292cd640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:30:32.954 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:30:32.955+0000 7f1d292cd640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:30:32.954 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:30:32.955+0000 7f1d292cd640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:30:32.954 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:30:32.955+0000 7f1d292cd640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:30:33.095 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2024-03-16T07:30:33.114 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get backup_fs_metadata pg_num 2024-03-16T07:30:33.480 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2024-03-16T07:30:33.493 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get backup_fs_data pg_num 2024-03-16T07:30:33.800 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2024-03-16T07:30:33.814 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-16T07:30:34.210 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/1717904824 2024-03-17T07:30:32.863755+0000 2024-03-16T07:30:34.211 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/20996336 2024-03-17T07:30:32.863755+0000 2024-03-16T07:30:34.211 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/1405739933 2024-03-17T07:30:32.863755+0000 2024-03-16T07:30:34.211 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/4185379996 2024-03-17T07:30:32.863755+0000 2024-03-16T07:30:34.211 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/2006333319 2024-03-17T07:30:32.863755+0000 2024-03-16T07:30:34.211 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:6824/2582467015 2024-03-17T07:30:32.863755+0000 2024-03-16T07:30:34.211 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/1297516931 2024-03-17T07:30:32.863755+0000 2024-03-16T07:30:34.211 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/1974454350 2024-03-17T07:30:32.863755+0000 2024-03-16T07:30:34.211 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/3725181441 2024-03-17T07:30:32.863755+0000 2024-03-16T07:30:34.211 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/1873377254 2024-03-16T08:30:19.454615+0000 2024-03-16T07:30:34.211 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/466449902 2024-03-17T07:30:03.409856+0000 2024-03-16T07:30:34.211 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:6825/2582467015 2024-03-17T07:30:32.863755+0000 2024-03-16T07:30:34.211 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/3678959046 2024-03-17T07:30:32.863755+0000 2024-03-16T07:30:34.211 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/3635332552 2024-03-17T07:30:03.409856+0000 2024-03-16T07:30:34.212 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/4220167359 2024-03-17T07:30:03.409856+0000 2024-03-16T07:30:34.212 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/2790567351 2024-03-17T07:30:03.409856+0000 2024-03-16T07:30:34.212 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/354741927 2024-03-17T07:30:03.409856+0000 2024-03-16T07:30:34.212 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/2885009482 2024-03-17T07:30:03.409856+0000 2024-03-16T07:30:34.212 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/710615353 2024-03-17T07:30:03.409856+0000 2024-03-16T07:30:34.212 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:6825/3567684888 2024-03-17T07:30:03.409856+0000 2024-03-16T07:30:34.212 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/253037853 2024-03-17T07:30:03.409856+0000 2024-03-16T07:30:34.212 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:6824/3567684888 2024-03-17T07:30:03.409856+0000 2024-03-16T07:30:34.212 INFO:teuthology.orchestra.run.smithi049.stderr:listed 22 entries 2024-03-16T07:30:34.223 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi049.front.sepia.ceph.com... 2024-03-16T07:30:34.223 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:30:34.223 DEBUG:teuthology.orchestra.run.smithi049:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2024-03-16T07:30:34.251 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi049.stderr:ceph-fuse[64839]: fuse finished with error 0 and tester_r 0 2024-03-16T07:30:34.253 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi049.front.sepia.ceph.com 2024-03-16T07:30:34.253 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:30:34.253 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-03-16T07:30:34.419 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T07:30:34.823 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:30:34.823 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":73,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5588,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6827/1816248233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":1816248233},{"type":"v1","addr":"172.21.15.49:6827","nonce":1816248233}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62},{"gid":5589,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6829/2028370121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":2028370121},{"type":"v1","addr":"172.21.15.49:6829","nonce":2028370121}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62},{"gid":5596,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6831/2282357763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":2282357763},{"type":"v1","addr":"172.21.15.49:6831","nonce":2282357763}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62}],"filesystems":[{"mdsmap":{"epoch":73,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-16T07:29:33.503199+0000","modified":"2024-03-16T07:30:16.927712+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5598},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5598":{"gid":5598,"name":"e","rank":0,"incarnation":63,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6835/2451687435","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":2451687435},{"type":"v1","addr":"172.21.15.49:6835","nonce":2451687435}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5598,"qdb_cluster":[5598]},"id":8},{"mdsmap":{"epoch":71,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-16T07:29:51.607653+0000","modified":"2024-03-16T07:29:54.609298+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5597},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5597":{"gid":5597,"name":"a","rank":0,"incarnation":67,"state":"up:active","state_seq":7,"addr":"172.21.15.49:6833/2335462758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":2335462758},{"type":"v1","addr":"172.21.15.49:6833","nonce":2335462758}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"backup_fs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5597,"qdb_cluster":[5597]},"id":9}]} 2024-03-16T07:30:34.823 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 73 2024-03-16T07:30:34.836 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T07:30:35.165 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:30:35.166 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":103,"fsid":"f91af061-9eac-4793-87fa-8d27ae3d242f","created":"2024-03-16T07:24:20.357868+0000","modified":"2024-03-16T07:30:32.863815+0000","last_up_change":"2024-03-16T07:24:27.474980+0000","last_in_change":"2024-03-16T07:24:21.254179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T07:24:28.947521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-03-16T07:29:31.811291+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-03-16T07:29:32.483018+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"96","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3600000143051147,"score_stable":1.3600000143051147,"optimal_score":1,"raw_score_acting":1.3600000143051147,"raw_score_stable":1.3600000143051147,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"backup_fs_metadata","create_time":"2024-03-16T07:29:50.191529+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"99","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"backup_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.4099999666213989,"score_stable":1.4099999666213989,"optimal_score":1,"raw_score_acting":1.4099999666213989,"raw_score_stable":1.4099999666213989,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"backup_fs_data","create_time":"2024-03-16T07:29:50.589589+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"100","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"backup_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.0800000429153442,"score_stable":1.0800000429153442,"optimal_score":1,"raw_score_acting":1.0800000429153442,"raw_score_stable":1.0800000429153442,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2df14aac-98dc-4e3c-ae7e-9eb677aa30be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6801","nonce":2744935777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6803","nonce":2744935777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6807","nonce":2744935777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6805","nonce":2744935777}]},"public_addr":"172.21.15.49:6801/2744935777","cluster_addr":"172.21.15.49:6803/2744935777","heartbeat_back_addr":"172.21.15.49:6807/2744935777","heartbeat_front_addr":"172.21.15.49:6805/2744935777","state":["exists","up"]},{"osd":1,"uuid":"80461bd9-59ef-46df-9eea-bad92d960c57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6811","nonce":1655120118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6815","nonce":1655120118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6821","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6823","nonce":1655120118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6817","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6819","nonce":1655120118}]},"public_addr":"172.21.15.49:6811/1655120118","cluster_addr":"172.21.15.49:6815/1655120118","heartbeat_back_addr":"172.21.15.49:6823/1655120118","heartbeat_front_addr":"172.21.15.49:6819/1655120118","state":["exists","up"]},{"osd":2,"uuid":"d6bf40eb-6e42-4ec9-8b3d-0b6c5a6def79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6810","nonce":3815472376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6814","nonce":3815472376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6822","nonce":3815472376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6818","nonce":3815472376}]},"public_addr":"172.21.15.49:6810/3815472376","cluster_addr":"172.21.15.49:6814/3815472376","heartbeat_back_addr":"172.21.15.49:6822/3815472376","heartbeat_front_addr":"172.21.15.49:6818/3815472376","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.641492+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.668598+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.614940+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.49:0/1717904824":"2024-03-17T07:30:32.863755+0000","172.21.15.49:0/20996336":"2024-03-17T07:30:32.863755+0000","172.21.15.49:0/1405739933":"2024-03-17T07:30:32.863755+0000","172.21.15.49:0/4185379996":"2024-03-17T07:30:32.863755+0000","172.21.15.49:0/2006333319":"2024-03-17T07:30:32.863755+0000","172.21.15.49:6824/2582467015":"2024-03-17T07:30:32.863755+0000","172.21.15.49:0/1297516931":"2024-03-17T07:30:32.863755+0000","172.21.15.49:0/1974454350":"2024-03-17T07:30:32.863755+0000","172.21.15.49:0/3725181441":"2024-03-17T07:30:32.863755+0000","172.21.15.49:0/1873377254":"2024-03-16T08:30:19.454615+0000","172.21.15.49:0/466449902":"2024-03-17T07:30:03.409856+0000","172.21.15.49:6825/2582467015":"2024-03-17T07:30:32.863755+0000","172.21.15.49:0/3678959046":"2024-03-17T07:30:32.863755+0000","172.21.15.49:0/3635332552":"2024-03-17T07:30:03.409856+0000","172.21.15.49:0/4220167359":"2024-03-17T07:30:03.409856+0000","172.21.15.49:0/2790567351":"2024-03-17T07:30:03.409856+0000","172.21.15.49:0/354741927":"2024-03-17T07:30:03.409856+0000","172.21.15.49:0/2885009482":"2024-03-17T07:30:03.409856+0000","172.21.15.49:0/710615353":"2024-03-17T07:30:03.409856+0000","172.21.15.49:6825/3567684888":"2024-03-17T07:30:03.409856+0000","172.21.15.49:0/253037853":"2024-03-17T07:30:03.409856+0000","172.21.15.49:6824/3567684888":"2024-03-17T07:30:03.409856+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T07:30:35.179 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-16T07:24:28.947521+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-16T07:29:31.811291+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '95', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 17, 'pool_name': 'cephfs_data', 'create_time': '2024-03-16T07:29:32.483018+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '96', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3600000143051147, 'score_stable': 1.3600000143051147, 'optimal_score': 1, 'raw_score_acting': 1.3600000143051147, 'raw_score_stable': 1.3600000143051147, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 18, 'pool_name': 'backup_fs_metadata', 'create_time': '2024-03-16T07:29:50.191529+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '99', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'backup_fs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.409999966621399, 'score_stable': 1.409999966621399, 'optimal_score': 1, 'raw_score_acting': 1.409999966621399, 'raw_score_stable': 1.409999966621399, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 19, 'pool_name': 'backup_fs_data', 'create_time': '2024-03-16T07:29:50.589589+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '100', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'backup_fs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.0800000429153442, 'score_stable': 1.0800000429153442, 'optimal_score': 1, 'raw_score_acting': 1.0800000429153442, 'raw_score_stable': 1.0800000429153442, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-16T07:30:35.179 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-16T07:30:35.491 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2024-03-16T07:30:35.504 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-16T07:30:35.811 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2024-03-16T07:30:35.824 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-16T07:30:36.191 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2024-03-16T07:30:36.204 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get backup_fs_metadata pg_num 2024-03-16T07:30:36.520 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2024-03-16T07:30:36.532 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get backup_fs_data pg_num 2024-03-16T07:30:36.835 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2024-03-16T07:30:36.849 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T07:30:37.247 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:30:37.247 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":73,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5588,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6827/1816248233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":1816248233},{"type":"v1","addr":"172.21.15.49:6827","nonce":1816248233}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62},{"gid":5589,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6829/2028370121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":2028370121},{"type":"v1","addr":"172.21.15.49:6829","nonce":2028370121}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62},{"gid":5596,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6831/2282357763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":2282357763},{"type":"v1","addr":"172.21.15.49:6831","nonce":2282357763}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62}],"filesystems":[{"mdsmap":{"epoch":73,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-16T07:29:33.503199+0000","modified":"2024-03-16T07:30:16.927712+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5598},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5598":{"gid":5598,"name":"e","rank":0,"incarnation":63,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6835/2451687435","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":2451687435},{"type":"v1","addr":"172.21.15.49:6835","nonce":2451687435}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5598,"qdb_cluster":[5598]},"id":8},{"mdsmap":{"epoch":71,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-16T07:29:51.607653+0000","modified":"2024-03-16T07:29:54.609298+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5597},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5597":{"gid":5597,"name":"a","rank":0,"incarnation":67,"state":"up:active","state_seq":7,"addr":"172.21.15.49:6833/2335462758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":2335462758},{"type":"v1","addr":"172.21.15.49:6833","nonce":2335462758}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"backup_fs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5597,"qdb_cluster":[5597]},"id":9}]} 2024-03-16T07:30:37.247 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 73 2024-03-16T07:30:37.264 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T07:30:37.593 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:30:37.593 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":103,"fsid":"f91af061-9eac-4793-87fa-8d27ae3d242f","created":"2024-03-16T07:24:20.357868+0000","modified":"2024-03-16T07:30:32.863815+0000","last_up_change":"2024-03-16T07:24:27.474980+0000","last_in_change":"2024-03-16T07:24:21.254179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T07:24:28.947521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-03-16T07:29:31.811291+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-03-16T07:29:32.483018+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"96","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3600000143051147,"score_stable":1.3600000143051147,"optimal_score":1,"raw_score_acting":1.3600000143051147,"raw_score_stable":1.3600000143051147,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"backup_fs_metadata","create_time":"2024-03-16T07:29:50.191529+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"99","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"backup_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.4099999666213989,"score_stable":1.4099999666213989,"optimal_score":1,"raw_score_acting":1.4099999666213989,"raw_score_stable":1.4099999666213989,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"backup_fs_data","create_time":"2024-03-16T07:29:50.589589+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"100","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"backup_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.0800000429153442,"score_stable":1.0800000429153442,"optimal_score":1,"raw_score_acting":1.0800000429153442,"raw_score_stable":1.0800000429153442,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2df14aac-98dc-4e3c-ae7e-9eb677aa30be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6801","nonce":2744935777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6803","nonce":2744935777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6807","nonce":2744935777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6805","nonce":2744935777}]},"public_addr":"172.21.15.49:6801/2744935777","cluster_addr":"172.21.15.49:6803/2744935777","heartbeat_back_addr":"172.21.15.49:6807/2744935777","heartbeat_front_addr":"172.21.15.49:6805/2744935777","state":["exists","up"]},{"osd":1,"uuid":"80461bd9-59ef-46df-9eea-bad92d960c57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6811","nonce":1655120118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6815","nonce":1655120118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6821","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6823","nonce":1655120118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6817","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6819","nonce":1655120118}]},"public_addr":"172.21.15.49:6811/1655120118","cluster_addr":"172.21.15.49:6815/1655120118","heartbeat_back_addr":"172.21.15.49:6823/1655120118","heartbeat_front_addr":"172.21.15.49:6819/1655120118","state":["exists","up"]},{"osd":2,"uuid":"d6bf40eb-6e42-4ec9-8b3d-0b6c5a6def79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6810","nonce":3815472376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6814","nonce":3815472376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6822","nonce":3815472376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6818","nonce":3815472376}]},"public_addr":"172.21.15.49:6810/3815472376","cluster_addr":"172.21.15.49:6814/3815472376","heartbeat_back_addr":"172.21.15.49:6822/3815472376","heartbeat_front_addr":"172.21.15.49:6818/3815472376","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.641492+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.668598+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.614940+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.49:0/1717904824":"2024-03-17T07:30:32.863755+0000","172.21.15.49:0/20996336":"2024-03-17T07:30:32.863755+0000","172.21.15.49:0/1405739933":"2024-03-17T07:30:32.863755+0000","172.21.15.49:0/4185379996":"2024-03-17T07:30:32.863755+0000","172.21.15.49:0/2006333319":"2024-03-17T07:30:32.863755+0000","172.21.15.49:6824/2582467015":"2024-03-17T07:30:32.863755+0000","172.21.15.49:0/1297516931":"2024-03-17T07:30:32.863755+0000","172.21.15.49:0/1974454350":"2024-03-17T07:30:32.863755+0000","172.21.15.49:0/3725181441":"2024-03-17T07:30:32.863755+0000","172.21.15.49:0/1873377254":"2024-03-16T08:30:19.454615+0000","172.21.15.49:0/466449902":"2024-03-17T07:30:03.409856+0000","172.21.15.49:6825/2582467015":"2024-03-17T07:30:32.863755+0000","172.21.15.49:0/3678959046":"2024-03-17T07:30:32.863755+0000","172.21.15.49:0/3635332552":"2024-03-17T07:30:03.409856+0000","172.21.15.49:0/4220167359":"2024-03-17T07:30:03.409856+0000","172.21.15.49:0/2790567351":"2024-03-17T07:30:03.409856+0000","172.21.15.49:0/354741927":"2024-03-17T07:30:03.409856+0000","172.21.15.49:0/2885009482":"2024-03-17T07:30:03.409856+0000","172.21.15.49:0/710615353":"2024-03-17T07:30:03.409856+0000","172.21.15.49:6825/3567684888":"2024-03-17T07:30:03.409856+0000","172.21.15.49:0/253037853":"2024-03-17T07:30:03.409856+0000","172.21.15.49:6824/3567684888":"2024-03-17T07:30:03.409856+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T07:30:37.607 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-03-16T07:30:37.607 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T07:30:37.956 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:30:37.956 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":73,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5588,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6827/1816248233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":1816248233},{"type":"v1","addr":"172.21.15.49:6827","nonce":1816248233}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62},{"gid":5589,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6829/2028370121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":2028370121},{"type":"v1","addr":"172.21.15.49:6829","nonce":2028370121}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62},{"gid":5596,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6831/2282357763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":2282357763},{"type":"v1","addr":"172.21.15.49:6831","nonce":2282357763}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62}],"filesystems":[{"mdsmap":{"epoch":73,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-16T07:29:33.503199+0000","modified":"2024-03-16T07:30:16.927712+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5598},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5598":{"gid":5598,"name":"e","rank":0,"incarnation":63,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6835/2451687435","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":2451687435},{"type":"v1","addr":"172.21.15.49:6835","nonce":2451687435}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5598,"qdb_cluster":[5598]},"id":8},{"mdsmap":{"epoch":71,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-16T07:29:51.607653+0000","modified":"2024-03-16T07:29:54.609298+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5597},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5597":{"gid":5597,"name":"a","rank":0,"incarnation":67,"state":"up:active","state_seq":7,"addr":"172.21.15.49:6833/2335462758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":2335462758},{"type":"v1","addr":"172.21.15.49:6833","nonce":2335462758}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"backup_fs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5597,"qdb_cluster":[5597]},"id":9}]} 2024-03-16T07:30:37.956 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 73 2024-03-16T07:30:37.970 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T07:30:38.358 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:30:38.358 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":73,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5588,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6827/1816248233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":1816248233},{"type":"v1","addr":"172.21.15.49:6827","nonce":1816248233}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62},{"gid":5589,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6829/2028370121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":2028370121},{"type":"v1","addr":"172.21.15.49:6829","nonce":2028370121}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62},{"gid":5596,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6831/2282357763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":2282357763},{"type":"v1","addr":"172.21.15.49:6831","nonce":2282357763}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62}],"filesystems":[{"mdsmap":{"epoch":73,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-16T07:29:33.503199+0000","modified":"2024-03-16T07:30:16.927712+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5598},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5598":{"gid":5598,"name":"e","rank":0,"incarnation":63,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6835/2451687435","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":2451687435},{"type":"v1","addr":"172.21.15.49:6835","nonce":2451687435}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5598,"qdb_cluster":[5598]},"id":8},{"mdsmap":{"epoch":71,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-16T07:29:51.607653+0000","modified":"2024-03-16T07:29:54.609298+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5597},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5597":{"gid":5597,"name":"a","rank":0,"incarnation":67,"state":"up:active","state_seq":7,"addr":"172.21.15.49:6833/2335462758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":2335462758},{"type":"v1","addr":"172.21.15.49:6833","nonce":2335462758}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"backup_fs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5597,"qdb_cluster":[5597]},"id":9}]} 2024-03-16T07:30:38.358 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 73 2024-03-16T07:30:38.371 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T07:30:38.690 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T07:30:38.708 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:30:38.708 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":103,"fsid":"f91af061-9eac-4793-87fa-8d27ae3d242f","created":"2024-03-16T07:24:20.357868+0000","modified":"2024-03-16T07:30:32.863815+0000","last_up_change":"2024-03-16T07:24:27.474980+0000","last_in_change":"2024-03-16T07:24:21.254179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T07:24:28.947521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-03-16T07:29:31.811291+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-03-16T07:29:32.483018+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"96","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3600000143051147,"score_stable":1.3600000143051147,"optimal_score":1,"raw_score_acting":1.3600000143051147,"raw_score_stable":1.3600000143051147,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"backup_fs_metadata","create_time":"2024-03-16T07:29:50.191529+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"99","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"backup_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.4099999666213989,"score_stable":1.4099999666213989,"optimal_score":1,"raw_score_acting":1.4099999666213989,"raw_score_stable":1.4099999666213989,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"backup_fs_data","create_time":"2024-03-16T07:29:50.589589+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"100","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"backup_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.0800000429153442,"score_stable":1.0800000429153442,"optimal_score":1,"raw_score_acting":1.0800000429153442,"raw_score_stable":1.0800000429153442,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2df14aac-98dc-4e3c-ae7e-9eb677aa30be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6801","nonce":2744935777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6803","nonce":2744935777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6807","nonce":2744935777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6805","nonce":2744935777}]},"public_addr":"172.21.15.49:6801/2744935777","cluster_addr":"172.21.15.49:6803/2744935777","heartbeat_back_addr":"172.21.15.49:6807/2744935777","heartbeat_front_addr":"172.21.15.49:6805/2744935777","state":["exists","up"]},{"osd":1,"uuid":"80461bd9-59ef-46df-9eea-bad92d960c57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6811","nonce":1655120118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6815","nonce":1655120118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6821","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6823","nonce":1655120118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6817","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6819","nonce":1655120118}]},"public_addr":"172.21.15.49:6811/1655120118","cluster_addr":"172.21.15.49:6815/1655120118","heartbeat_back_addr":"172.21.15.49:6823/1655120118","heartbeat_front_addr":"172.21.15.49:6819/1655120118","state":["exists","up"]},{"osd":2,"uuid":"d6bf40eb-6e42-4ec9-8b3d-0b6c5a6def79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6810","nonce":3815472376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6814","nonce":3815472376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6822","nonce":3815472376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6818","nonce":3815472376}]},"public_addr":"172.21.15.49:6810/3815472376","cluster_addr":"172.21.15.49:6814/3815472376","heartbeat_back_addr":"172.21.15.49:6822/3815472376","heartbeat_front_addr":"172.21.15.49:6818/3815472376","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.641492+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.668598+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.614940+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.49:0/1717904824":"2024-03-17T07:30:32.863755+0000","172.21.15.49:0/20996336":"2024-03-17T07:30:32.863755+0000","172.21.15.49:0/1405739933":"2024-03-17T07:30:32.863755+0000","172.21.15.49:0/4185379996":"2024-03-17T07:30:32.863755+0000","172.21.15.49:0/2006333319":"2024-03-17T07:30:32.863755+0000","172.21.15.49:6824/2582467015":"2024-03-17T07:30:32.863755+0000","172.21.15.49:0/1297516931":"2024-03-17T07:30:32.863755+0000","172.21.15.49:0/1974454350":"2024-03-17T07:30:32.863755+0000","172.21.15.49:0/3725181441":"2024-03-17T07:30:32.863755+0000","172.21.15.49:0/1873377254":"2024-03-16T08:30:19.454615+0000","172.21.15.49:0/466449902":"2024-03-17T07:30:03.409856+0000","172.21.15.49:6825/2582467015":"2024-03-17T07:30:32.863755+0000","172.21.15.49:0/3678959046":"2024-03-17T07:30:32.863755+0000","172.21.15.49:0/3635332552":"2024-03-17T07:30:03.409856+0000","172.21.15.49:0/4220167359":"2024-03-17T07:30:03.409856+0000","172.21.15.49:0/2790567351":"2024-03-17T07:30:03.409856+0000","172.21.15.49:0/354741927":"2024-03-17T07:30:03.409856+0000","172.21.15.49:0/2885009482":"2024-03-17T07:30:03.409856+0000","172.21.15.49:0/710615353":"2024-03-17T07:30:03.409856+0000","172.21.15.49:6825/3567684888":"2024-03-17T07:30:03.409856+0000","172.21.15.49:0/253037853":"2024-03-17T07:30:03.409856+0000","172.21.15.49:6824/3567684888":"2024-03-17T07:30:03.409856+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T07:30:38.725 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-03-16T07:30:39.177 INFO:tasks.ceph.mon.a.smithi049.stderr:2024-03-16T07:30:39.177+0000 7feb67011640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-03-16T07:30:39.177 INFO:teuthology.orchestra.run.smithi049.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-03-16T07:30:39.179 INFO:tasks.ceph.mds.e.smithi049.stderr: -430> 2024-03-16T07:29:39.796+0000 7fb59faf1640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-03-16T07:30:39.193 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-03-16T07:30:39.206 INFO:tasks.ceph.mds.e.smithi049.stdout:starting mds.e at 2024-03-16T07:30:40.191 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-03-16T07:30:41.495 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_metadata' removed 2024-03-16T07:30:41.514 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-03-16T07:30:42.498 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_data' removed 2024-03-16T07:30:42.518 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T07:30:42.819 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:30:42.820 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":106,"fsid":"f91af061-9eac-4793-87fa-8d27ae3d242f","created":"2024-03-16T07:24:20.357868+0000","modified":"2024-03-16T07:30:42.497860+0000","last_up_change":"2024-03-16T07:24:27.474980+0000","last_in_change":"2024-03-16T07:24:21.254179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T07:24:28.947521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"backup_fs_metadata","create_time":"2024-03-16T07:29:50.191529+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"99","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"backup_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.4099999666213989,"score_stable":1.4099999666213989,"optimal_score":1,"raw_score_acting":1.4099999666213989,"raw_score_stable":1.4099999666213989,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"backup_fs_data","create_time":"2024-03-16T07:29:50.589589+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"100","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"backup_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.0800000429153442,"score_stable":1.0800000429153442,"optimal_score":1,"raw_score_acting":1.0800000429153442,"raw_score_stable":1.0800000429153442,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2df14aac-98dc-4e3c-ae7e-9eb677aa30be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6801","nonce":2744935777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6803","nonce":2744935777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6807","nonce":2744935777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6805","nonce":2744935777}]},"public_addr":"172.21.15.49:6801/2744935777","cluster_addr":"172.21.15.49:6803/2744935777","heartbeat_back_addr":"172.21.15.49:6807/2744935777","heartbeat_front_addr":"172.21.15.49:6805/2744935777","state":["exists","up"]},{"osd":1,"uuid":"80461bd9-59ef-46df-9eea-bad92d960c57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6811","nonce":1655120118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6815","nonce":1655120118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6821","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6823","nonce":1655120118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6817","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6819","nonce":1655120118}]},"public_addr":"172.21.15.49:6811/1655120118","cluster_addr":"172.21.15.49:6815/1655120118","heartbeat_back_addr":"172.21.15.49:6823/1655120118","heartbeat_front_addr":"172.21.15.49:6819/1655120118","state":["exists","up"]},{"osd":2,"uuid":"d6bf40eb-6e42-4ec9-8b3d-0b6c5a6def79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6810","nonce":3815472376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6814","nonce":3815472376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6822","nonce":3815472376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6818","nonce":3815472376}]},"public_addr":"172.21.15.49:6810/3815472376","cluster_addr":"172.21.15.49:6814/3815472376","heartbeat_back_addr":"172.21.15.49:6822/3815472376","heartbeat_front_addr":"172.21.15.49:6818/3815472376","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.641492+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.668598+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.614940+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.49:0/1717904824":"2024-03-17T07:30:32.863755+0000","172.21.15.49:0/20996336":"2024-03-17T07:30:32.863755+0000","172.21.15.49:0/1405739933":"2024-03-17T07:30:32.863755+0000","172.21.15.49:6835/2451687435":"2024-03-17T07:30:39.178944+0000","172.21.15.49:0/4185379996":"2024-03-17T07:30:32.863755+0000","172.21.15.49:0/2006333319":"2024-03-17T07:30:32.863755+0000","172.21.15.49:6824/2582467015":"2024-03-17T07:30:32.863755+0000","172.21.15.49:0/1297516931":"2024-03-17T07:30:32.863755+0000","172.21.15.49:0/1974454350":"2024-03-17T07:30:32.863755+0000","172.21.15.49:0/3725181441":"2024-03-17T07:30:32.863755+0000","172.21.15.49:0/1873377254":"2024-03-16T08:30:19.454615+0000","172.21.15.49:0/466449902":"2024-03-17T07:30:03.409856+0000","172.21.15.49:6825/2582467015":"2024-03-17T07:30:32.863755+0000","172.21.15.49:0/3678959046":"2024-03-17T07:30:32.863755+0000","172.21.15.49:0/3635332552":"2024-03-17T07:30:03.409856+0000","172.21.15.49:0/4220167359":"2024-03-17T07:30:03.409856+0000","172.21.15.49:0/2790567351":"2024-03-17T07:30:03.409856+0000","172.21.15.49:6834/2451687435":"2024-03-17T07:30:39.178944+0000","172.21.15.49:0/354741927":"2024-03-17T07:30:03.409856+0000","172.21.15.49:0/2885009482":"2024-03-17T07:30:03.409856+0000","172.21.15.49:0/710615353":"2024-03-17T07:30:03.409856+0000","172.21.15.49:6825/3567684888":"2024-03-17T07:30:03.409856+0000","172.21.15.49:0/253037853":"2024-03-17T07:30:03.409856+0000","172.21.15.49:6824/3567684888":"2024-03-17T07:30:03.409856+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T07:30:42.833 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-16T07:24:28.947521+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 18, 'pool_name': 'backup_fs_metadata', 'create_time': '2024-03-16T07:29:50.191529+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '99', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'backup_fs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.409999966621399, 'score_stable': 1.409999966621399, 'optimal_score': 1, 'raw_score_acting': 1.409999966621399, 'raw_score_stable': 1.409999966621399, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 19, 'pool_name': 'backup_fs_data', 'create_time': '2024-03-16T07:29:50.589589+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '100', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'backup_fs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.0800000429153442, 'score_stable': 1.0800000429153442, 'optimal_score': 1, 'raw_score_acting': 1.0800000429153442, 'raw_score_stable': 1.0800000429153442, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-16T07:30:42.834 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-16T07:30:43.138 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2024-03-16T07:30:43.150 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get backup_fs_metadata pg_num 2024-03-16T07:30:43.461 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2024-03-16T07:30:43.474 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get backup_fs_data pg_num 2024-03-16T07:30:43.937 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2024-03-16T07:30:43.951 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T07:30:44.379 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:30:44.380 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":75,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5588,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6827/1816248233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":1816248233},{"type":"v1","addr":"172.21.15.49:6827","nonce":1816248233}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62},{"gid":5589,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6829/2028370121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":2028370121},{"type":"v1","addr":"172.21.15.49:6829","nonce":2028370121}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62},{"gid":5596,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6831/2282357763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":2282357763},{"type":"v1","addr":"172.21.15.49:6831","nonce":2282357763}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62},{"gid":5883,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/754183518","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":754183518},{"type":"v1","addr":"172.21.15.49:6835","nonce":754183518}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":75}],"filesystems":[{"mdsmap":{"epoch":71,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-16T07:29:51.607653+0000","modified":"2024-03-16T07:29:54.609298+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5597},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5597":{"gid":5597,"name":"a","rank":0,"incarnation":67,"state":"up:active","state_seq":7,"addr":"172.21.15.49:6833/2335462758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":2335462758},{"type":"v1","addr":"172.21.15.49:6833","nonce":2335462758}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"backup_fs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5597,"qdb_cluster":[5597]},"id":9}]} 2024-03-16T07:30:44.380 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 75 2024-03-16T07:30:44.394 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T07:30:44.698 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:30:44.698 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":106,"fsid":"f91af061-9eac-4793-87fa-8d27ae3d242f","created":"2024-03-16T07:24:20.357868+0000","modified":"2024-03-16T07:30:42.497860+0000","last_up_change":"2024-03-16T07:24:27.474980+0000","last_in_change":"2024-03-16T07:24:21.254179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T07:24:28.947521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"backup_fs_metadata","create_time":"2024-03-16T07:29:50.191529+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"99","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"backup_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.4099999666213989,"score_stable":1.4099999666213989,"optimal_score":1,"raw_score_acting":1.4099999666213989,"raw_score_stable":1.4099999666213989,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"backup_fs_data","create_time":"2024-03-16T07:29:50.589589+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"100","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"backup_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.0800000429153442,"score_stable":1.0800000429153442,"optimal_score":1,"raw_score_acting":1.0800000429153442,"raw_score_stable":1.0800000429153442,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2df14aac-98dc-4e3c-ae7e-9eb677aa30be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6801","nonce":2744935777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6803","nonce":2744935777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6807","nonce":2744935777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6805","nonce":2744935777}]},"public_addr":"172.21.15.49:6801/2744935777","cluster_addr":"172.21.15.49:6803/2744935777","heartbeat_back_addr":"172.21.15.49:6807/2744935777","heartbeat_front_addr":"172.21.15.49:6805/2744935777","state":["exists","up"]},{"osd":1,"uuid":"80461bd9-59ef-46df-9eea-bad92d960c57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6811","nonce":1655120118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6815","nonce":1655120118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6821","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6823","nonce":1655120118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6817","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6819","nonce":1655120118}]},"public_addr":"172.21.15.49:6811/1655120118","cluster_addr":"172.21.15.49:6815/1655120118","heartbeat_back_addr":"172.21.15.49:6823/1655120118","heartbeat_front_addr":"172.21.15.49:6819/1655120118","state":["exists","up"]},{"osd":2,"uuid":"d6bf40eb-6e42-4ec9-8b3d-0b6c5a6def79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6810","nonce":3815472376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6814","nonce":3815472376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6822","nonce":3815472376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6818","nonce":3815472376}]},"public_addr":"172.21.15.49:6810/3815472376","cluster_addr":"172.21.15.49:6814/3815472376","heartbeat_back_addr":"172.21.15.49:6822/3815472376","heartbeat_front_addr":"172.21.15.49:6818/3815472376","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.641492+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.668598+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.614940+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.49:0/1717904824":"2024-03-17T07:30:32.863755+0000","172.21.15.49:0/20996336":"2024-03-17T07:30:32.863755+0000","172.21.15.49:0/1405739933":"2024-03-17T07:30:32.863755+0000","172.21.15.49:6835/2451687435":"2024-03-17T07:30:39.178944+0000","172.21.15.49:0/4185379996":"2024-03-17T07:30:32.863755+0000","172.21.15.49:0/2006333319":"2024-03-17T07:30:32.863755+0000","172.21.15.49:6824/2582467015":"2024-03-17T07:30:32.863755+0000","172.21.15.49:0/1297516931":"2024-03-17T07:30:32.863755+0000","172.21.15.49:0/1974454350":"2024-03-17T07:30:32.863755+0000","172.21.15.49:0/3725181441":"2024-03-17T07:30:32.863755+0000","172.21.15.49:0/1873377254":"2024-03-16T08:30:19.454615+0000","172.21.15.49:0/466449902":"2024-03-17T07:30:03.409856+0000","172.21.15.49:6825/2582467015":"2024-03-17T07:30:32.863755+0000","172.21.15.49:0/3678959046":"2024-03-17T07:30:32.863755+0000","172.21.15.49:0/3635332552":"2024-03-17T07:30:03.409856+0000","172.21.15.49:0/4220167359":"2024-03-17T07:30:03.409856+0000","172.21.15.49:0/2790567351":"2024-03-17T07:30:03.409856+0000","172.21.15.49:6834/2451687435":"2024-03-17T07:30:39.178944+0000","172.21.15.49:0/354741927":"2024-03-17T07:30:03.409856+0000","172.21.15.49:0/2885009482":"2024-03-17T07:30:03.409856+0000","172.21.15.49:0/710615353":"2024-03-17T07:30:03.409856+0000","172.21.15.49:6825/3567684888":"2024-03-17T07:30:03.409856+0000","172.21.15.49:0/253037853":"2024-03-17T07:30:03.409856+0000","172.21.15.49:6824/3567684888":"2024-03-17T07:30:03.409856+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T07:30:44.711 INFO:tasks.cephfs.filesystem:Destroying file system backup_fs and related pools 2024-03-16T07:30:44.711 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T07:30:45.195 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:30:45.195 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":75,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5588,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6827/1816248233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":1816248233},{"type":"v1","addr":"172.21.15.49:6827","nonce":1816248233}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62},{"gid":5589,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6829/2028370121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":2028370121},{"type":"v1","addr":"172.21.15.49:6829","nonce":2028370121}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62},{"gid":5596,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6831/2282357763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":2282357763},{"type":"v1","addr":"172.21.15.49:6831","nonce":2282357763}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62},{"gid":5883,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/754183518","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":754183518},{"type":"v1","addr":"172.21.15.49:6835","nonce":754183518}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":75}],"filesystems":[{"mdsmap":{"epoch":71,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-16T07:29:51.607653+0000","modified":"2024-03-16T07:29:54.609298+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5597},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5597":{"gid":5597,"name":"a","rank":0,"incarnation":67,"state":"up:active","state_seq":7,"addr":"172.21.15.49:6833/2335462758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":2335462758},{"type":"v1","addr":"172.21.15.49:6833","nonce":2335462758}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"backup_fs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5597,"qdb_cluster":[5597]},"id":9}]} 2024-03-16T07:30:45.195 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 75 2024-03-16T07:30:45.208 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T07:30:45.588 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:30:45.588 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":75,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5588,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6827/1816248233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":1816248233},{"type":"v1","addr":"172.21.15.49:6827","nonce":1816248233}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62},{"gid":5589,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6829/2028370121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":2028370121},{"type":"v1","addr":"172.21.15.49:6829","nonce":2028370121}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62},{"gid":5596,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6831/2282357763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":2282357763},{"type":"v1","addr":"172.21.15.49:6831","nonce":2282357763}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62},{"gid":5883,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/754183518","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":754183518},{"type":"v1","addr":"172.21.15.49:6835","nonce":754183518}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":75}],"filesystems":[{"mdsmap":{"epoch":71,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-16T07:29:51.607653+0000","modified":"2024-03-16T07:29:54.609298+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5597},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5597":{"gid":5597,"name":"a","rank":0,"incarnation":67,"state":"up:active","state_seq":7,"addr":"172.21.15.49:6833/2335462758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":2335462758},{"type":"v1","addr":"172.21.15.49:6833","nonce":2335462758}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"backup_fs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5597,"qdb_cluster":[5597]},"id":9}]} 2024-03-16T07:30:45.588 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 75 2024-03-16T07:30:45.600 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T07:30:45.913 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:30:45.914 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":106,"fsid":"f91af061-9eac-4793-87fa-8d27ae3d242f","created":"2024-03-16T07:24:20.357868+0000","modified":"2024-03-16T07:30:42.497860+0000","last_up_change":"2024-03-16T07:24:27.474980+0000","last_in_change":"2024-03-16T07:24:21.254179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T07:24:28.947521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"backup_fs_metadata","create_time":"2024-03-16T07:29:50.191529+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"99","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"backup_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.4099999666213989,"score_stable":1.4099999666213989,"optimal_score":1,"raw_score_acting":1.4099999666213989,"raw_score_stable":1.4099999666213989,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"backup_fs_data","create_time":"2024-03-16T07:29:50.589589+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"100","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"backup_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.0800000429153442,"score_stable":1.0800000429153442,"optimal_score":1,"raw_score_acting":1.0800000429153442,"raw_score_stable":1.0800000429153442,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2df14aac-98dc-4e3c-ae7e-9eb677aa30be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6801","nonce":2744935777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6803","nonce":2744935777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6807","nonce":2744935777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6805","nonce":2744935777}]},"public_addr":"172.21.15.49:6801/2744935777","cluster_addr":"172.21.15.49:6803/2744935777","heartbeat_back_addr":"172.21.15.49:6807/2744935777","heartbeat_front_addr":"172.21.15.49:6805/2744935777","state":["exists","up"]},{"osd":1,"uuid":"80461bd9-59ef-46df-9eea-bad92d960c57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6811","nonce":1655120118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6815","nonce":1655120118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6821","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6823","nonce":1655120118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6817","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6819","nonce":1655120118}]},"public_addr":"172.21.15.49:6811/1655120118","cluster_addr":"172.21.15.49:6815/1655120118","heartbeat_back_addr":"172.21.15.49:6823/1655120118","heartbeat_front_addr":"172.21.15.49:6819/1655120118","state":["exists","up"]},{"osd":2,"uuid":"d6bf40eb-6e42-4ec9-8b3d-0b6c5a6def79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6810","nonce":3815472376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6814","nonce":3815472376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6822","nonce":3815472376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6818","nonce":3815472376}]},"public_addr":"172.21.15.49:6810/3815472376","cluster_addr":"172.21.15.49:6814/3815472376","heartbeat_back_addr":"172.21.15.49:6822/3815472376","heartbeat_front_addr":"172.21.15.49:6818/3815472376","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.641492+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.668598+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.614940+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.49:0/1717904824":"2024-03-17T07:30:32.863755+0000","172.21.15.49:0/20996336":"2024-03-17T07:30:32.863755+0000","172.21.15.49:0/1405739933":"2024-03-17T07:30:32.863755+0000","172.21.15.49:6835/2451687435":"2024-03-17T07:30:39.178944+0000","172.21.15.49:0/4185379996":"2024-03-17T07:30:32.863755+0000","172.21.15.49:0/2006333319":"2024-03-17T07:30:32.863755+0000","172.21.15.49:6824/2582467015":"2024-03-17T07:30:32.863755+0000","172.21.15.49:0/1297516931":"2024-03-17T07:30:32.863755+0000","172.21.15.49:0/1974454350":"2024-03-17T07:30:32.863755+0000","172.21.15.49:0/3725181441":"2024-03-17T07:30:32.863755+0000","172.21.15.49:0/1873377254":"2024-03-16T08:30:19.454615+0000","172.21.15.49:0/466449902":"2024-03-17T07:30:03.409856+0000","172.21.15.49:6825/2582467015":"2024-03-17T07:30:32.863755+0000","172.21.15.49:0/3678959046":"2024-03-17T07:30:32.863755+0000","172.21.15.49:0/3635332552":"2024-03-17T07:30:03.409856+0000","172.21.15.49:0/4220167359":"2024-03-17T07:30:03.409856+0000","172.21.15.49:0/2790567351":"2024-03-17T07:30:03.409856+0000","172.21.15.49:6834/2451687435":"2024-03-17T07:30:39.178944+0000","172.21.15.49:0/354741927":"2024-03-17T07:30:03.409856+0000","172.21.15.49:0/2885009482":"2024-03-17T07:30:03.409856+0000","172.21.15.49:0/710615353":"2024-03-17T07:30:03.409856+0000","172.21.15.49:6825/3567684888":"2024-03-17T07:30:03.409856+0000","172.21.15.49:0/253037853":"2024-03-17T07:30:03.409856+0000","172.21.15.49:6824/3567684888":"2024-03-17T07:30:03.409856+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T07:30:45.926 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail backup_fs 2024-03-16T07:30:46.402 INFO:tasks.ceph.mon.a.smithi049.stderr:2024-03-16T07:30:46.403+0000 7feb67011640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-03-16T07:30:46.402 INFO:teuthology.orchestra.run.smithi049.stderr:backup_fs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-03-16T07:30:46.404 INFO:tasks.ceph.mds.a.smithi049.stderr: -347> 2024-03-16T07:29:54.797+0000 7f4b130cc640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-03-16T07:30:46.418 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm backup_fs --yes-i-really-mean-it 2024-03-16T07:30:46.429 INFO:tasks.ceph.mds.a.smithi049.stdout:starting mds.a at 2024-03-16T07:30:47.420 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm backup_fs_metadata backup_fs_metadata --yes-i-really-really-mean-it 2024-03-16T07:30:48.506 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'backup_fs_metadata' removed 2024-03-16T07:30:48.525 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm backup_fs_data backup_fs_data --yes-i-really-really-mean-it 2024-03-16T07:30:49.513 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'backup_fs_data' removed 2024-03-16T07:30:49.535 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-03-16T07:30:49.856 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_mirroring.TestMirroring.test_add_relative_directory_path' 2024-03-16T07:30:50.528 INFO:tasks.cephfs_test_runner:test_add_relative_directory_path (tasks.cephfs.test_mirroring.TestMirroring) ... ok 2024-03-16T07:30:50.528 INFO:tasks.cephfs_test_runner:Starting test: test_basic_mirror_commands (tasks.cephfs.test_mirroring.TestMirroring) 2024-03-16T07:30:50.529 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T07:30:50.834 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:30:50.834 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":109,"fsid":"f91af061-9eac-4793-87fa-8d27ae3d242f","created":"2024-03-16T07:24:20.357868+0000","modified":"2024-03-16T07:30:49.513327+0000","last_up_change":"2024-03-16T07:24:27.474980+0000","last_in_change":"2024-03-16T07:24:21.254179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T07:24:28.947521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2df14aac-98dc-4e3c-ae7e-9eb677aa30be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6801","nonce":2744935777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6803","nonce":2744935777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6807","nonce":2744935777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6805","nonce":2744935777}]},"public_addr":"172.21.15.49:6801/2744935777","cluster_addr":"172.21.15.49:6803/2744935777","heartbeat_back_addr":"172.21.15.49:6807/2744935777","heartbeat_front_addr":"172.21.15.49:6805/2744935777","state":["exists","up"]},{"osd":1,"uuid":"80461bd9-59ef-46df-9eea-bad92d960c57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6811","nonce":1655120118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6815","nonce":1655120118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6821","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6823","nonce":1655120118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6817","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6819","nonce":1655120118}]},"public_addr":"172.21.15.49:6811/1655120118","cluster_addr":"172.21.15.49:6815/1655120118","heartbeat_back_addr":"172.21.15.49:6823/1655120118","heartbeat_front_addr":"172.21.15.49:6819/1655120118","state":["exists","up"]},{"osd":2,"uuid":"d6bf40eb-6e42-4ec9-8b3d-0b6c5a6def79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6810","nonce":3815472376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6814","nonce":3815472376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6822","nonce":3815472376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6818","nonce":3815472376}]},"public_addr":"172.21.15.49:6810/3815472376","cluster_addr":"172.21.15.49:6814/3815472376","heartbeat_back_addr":"172.21.15.49:6822/3815472376","heartbeat_front_addr":"172.21.15.49:6818/3815472376","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.641492+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.668598+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.614940+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.49:6833/2335462758":"2024-03-17T07:30:46.404472+0000","172.21.15.49:6832/2335462758":"2024-03-17T07:30:46.404472+0000","172.21.15.49:0/1717904824":"2024-03-17T07:30:32.863755+0000","172.21.15.49:0/20996336":"2024-03-17T07:30:32.863755+0000","172.21.15.49:0/1405739933":"2024-03-17T07:30:32.863755+0000","172.21.15.49:6835/2451687435":"2024-03-17T07:30:39.178944+0000","172.21.15.49:0/4185379996":"2024-03-17T07:30:32.863755+0000","172.21.15.49:0/2006333319":"2024-03-17T07:30:32.863755+0000","172.21.15.49:6824/2582467015":"2024-03-17T07:30:32.863755+0000","172.21.15.49:0/1297516931":"2024-03-17T07:30:32.863755+0000","172.21.15.49:0/1974454350":"2024-03-17T07:30:32.863755+0000","172.21.15.49:0/3725181441":"2024-03-17T07:30:32.863755+0000","172.21.15.49:0/1873377254":"2024-03-16T08:30:19.454615+0000","172.21.15.49:0/466449902":"2024-03-17T07:30:03.409856+0000","172.21.15.49:6825/2582467015":"2024-03-17T07:30:32.863755+0000","172.21.15.49:0/3678959046":"2024-03-17T07:30:32.863755+0000","172.21.15.49:0/3635332552":"2024-03-17T07:30:03.409856+0000","172.21.15.49:0/4220167359":"2024-03-17T07:30:03.409856+0000","172.21.15.49:0/2790567351":"2024-03-17T07:30:03.409856+0000","172.21.15.49:6834/2451687435":"2024-03-17T07:30:39.178944+0000","172.21.15.49:0/354741927":"2024-03-17T07:30:03.409856+0000","172.21.15.49:0/2885009482":"2024-03-17T07:30:03.409856+0000","172.21.15.49:0/710615353":"2024-03-17T07:30:03.409856+0000","172.21.15.49:6825/3567684888":"2024-03-17T07:30:03.409856+0000","172.21.15.49:0/253037853":"2024-03-17T07:30:03.409856+0000","172.21.15.49:6824/3567684888":"2024-03-17T07:30:03.409856+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T07:30:50.846 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-16T07:24:28.947521+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-16T07:30:50.847 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-16T07:30:51.148 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2024-03-16T07:30:51.161 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_mirroring.TestMirroring.test_basic_mirror_commands' 2024-03-16T07:30:52.533 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-03-16T07:30:52.859 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-03-16T07:30:52.859 DEBUG:teuthology.orchestra.run.smithi049:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-03-16T07:30:52.925 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-03-16T07:30:52.926 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-03-16T07:30:52.926 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-16T07:30:52.941 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056354,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497664k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=13886 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248828k,nr_inodes=812207,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497664k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2024-03-16T07:30:52.941 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-03-16T07:30:52.941 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-16T07:30:52.997 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056354,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497664k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=13886 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248828k,nr_inodes=812207,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497664k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2024-03-16T07:30:52.997 INFO:tasks.cephfs.cephfs_test_case:[, ] 2024-03-16T07:30:52.998 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T07:30:53.376 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:30:53.376 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":77,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5588,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6827/1816248233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":1816248233},{"type":"v1","addr":"172.21.15.49:6827","nonce":1816248233}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62},{"gid":5589,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6829/2028370121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":2028370121},{"type":"v1","addr":"172.21.15.49:6829","nonce":2028370121}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62},{"gid":5596,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6831/2282357763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":2282357763},{"type":"v1","addr":"172.21.15.49:6831","nonce":2282357763}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62},{"gid":5883,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/754183518","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":754183518},{"type":"v1","addr":"172.21.15.49:6835","nonce":754183518}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":75},{"gid":5924,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6833/1275525362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":1275525362},{"type":"v1","addr":"172.21.15.49:6833","nonce":1275525362}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":77}],"filesystems":[]} 2024-03-16T07:30:53.376 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 77 2024-03-16T07:30:53.389 INFO:tasks.ceph.mds.a:Restarting daemon 2024-03-16T07:30:53.390 INFO:tasks.ceph.mds.a:Stopping old one... 2024-03-16T07:30:53.390 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-03-16T07:30:53.390 INFO:teuthology.orchestra.run:waiting for 300 2024-03-16T07:30:53.390 INFO:tasks.ceph.mds.b:Restarting daemon 2024-03-16T07:30:53.390 INFO:tasks.ceph.mds.b:Stopping old one... 2024-03-16T07:30:53.390 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-03-16T07:30:53.390 INFO:teuthology.orchestra.run:waiting for 300 2024-03-16T07:30:53.391 INFO:tasks.ceph.mds.c:Restarting daemon 2024-03-16T07:30:53.391 INFO:tasks.ceph.mds.c:Stopping old one... 2024-03-16T07:30:53.391 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-03-16T07:30:53.391 INFO:teuthology.orchestra.run:waiting for 300 2024-03-16T07:30:53.391 INFO:tasks.ceph.mds.d:Restarting daemon 2024-03-16T07:30:53.391 INFO:tasks.ceph.mds.d:Stopping old one... 2024-03-16T07:30:53.391 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-03-16T07:30:53.391 INFO:teuthology.orchestra.run:waiting for 300 2024-03-16T07:30:53.392 INFO:tasks.ceph.mds.e:Restarting daemon 2024-03-16T07:30:53.392 INFO:tasks.ceph.mds.e:Stopping old one... 2024-03-16T07:30:53.392 DEBUG:tasks.ceph.mds.e:waiting for process to exit 2024-03-16T07:30:53.392 INFO:teuthology.orchestra.run:waiting for 300 2024-03-16T07:30:53.401 INFO:tasks.ceph.mds.b:Stopped 2024-03-16T07:30:53.402 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-03-16T07:30:53.403 INFO:tasks.ceph.mds.e:Stopped 2024-03-16T07:30:53.403 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i e 2024-03-16T07:30:53.404 INFO:tasks.ceph.mds.d:Stopped 2024-03-16T07:30:53.404 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-03-16T07:30:53.405 INFO:tasks.ceph.mds.a:Stopped 2024-03-16T07:30:53.405 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-03-16T07:30:53.406 INFO:tasks.ceph.mds.c:Stopped 2024-03-16T07:30:53.406 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-03-16T07:30:53.407 INFO:tasks.ceph.mds.b:Started 2024-03-16T07:30:53.407 DEBUG:teuthology.parallel:result is None 2024-03-16T07:30:53.448 INFO:tasks.ceph.mds.e:Started 2024-03-16T07:30:53.448 INFO:tasks.ceph.mds.d:Started 2024-03-16T07:30:53.449 DEBUG:teuthology.parallel:result is None 2024-03-16T07:30:53.449 DEBUG:teuthology.parallel:result is None 2024-03-16T07:30:53.449 INFO:tasks.ceph.mds.a:Started 2024-03-16T07:30:53.450 DEBUG:teuthology.parallel:result is None 2024-03-16T07:30:53.450 INFO:tasks.ceph.mds.c:Started 2024-03-16T07:30:53.450 DEBUG:teuthology.parallel:result is None 2024-03-16T07:30:53.451 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-03-16T07:30:53.502 INFO:tasks.ceph.mds.b.smithi049.stdout:starting mds.b at 2024-03-16T07:30:53.505 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2024-03-16T07:30:53.543 INFO:tasks.ceph.mds.e.smithi049.stdout:starting mds.e at 2024-03-16T07:30:53.549 INFO:tasks.ceph.mds.a.smithi049.stdout:starting mds.a at 2024-03-16T07:30:53.553 INFO:tasks.ceph.mds.c.smithi049.stdout:starting mds.c at 2024-03-16T07:30:53.562 INFO:tasks.ceph.mds.d.smithi049.stdout:starting mds.d at 2024-03-16T07:30:54.853 INFO:teuthology.orchestra.run.smithi049.stderr: removed all blocklist entries 2024-03-16T07:30:54.869 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-03-16T07:30:55.250 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:30:55.250 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-03-16T07:30:55.250 INFO:teuthology.orchestra.run.smithi049.stdout: "auth_dump": [ 2024-03-16T07:30:55.250 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:30:55.250 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.a", 2024-03-16T07:30:55.250 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAZSfVlKDkWLhAAVo2ZJMZSwTGLhocUPcHaUw==", 2024-03-16T07:30:55.250 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-03-16T07:30:55.250 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2024-03-16T07:30:55.251 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2024-03-16T07:30:55.251 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2024-03-16T07:30:55.251 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-03-16T07:30:55.251 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:30:55.251 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:30:55.251 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:30:55.251 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.b", 2024-03-16T07:30:55.251 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAZSfVl53IaNhAATOLh8Lzad03tyKQph1oowQ==", 2024-03-16T07:30:55.251 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-03-16T07:30:55.251 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2024-03-16T07:30:55.251 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2024-03-16T07:30:55.251 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2024-03-16T07:30:55.251 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-03-16T07:30:55.251 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:30:55.251 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:30:55.252 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:30:55.252 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.c", 2024-03-16T07:30:55.252 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAaSfVlI3p/AhAAZEetRkGlMLMEI7hMN7pS5w==", 2024-03-16T07:30:55.252 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-03-16T07:30:55.252 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2024-03-16T07:30:55.252 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2024-03-16T07:30:55.252 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2024-03-16T07:30:55.252 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-03-16T07:30:55.252 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:30:55.252 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:30:55.252 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:30:55.252 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.d", 2024-03-16T07:30:55.252 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAaSfVl3ueIChAA640lcZj8yUgH9jq7r7B+bA==", 2024-03-16T07:30:55.252 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-03-16T07:30:55.252 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2024-03-16T07:30:55.252 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2024-03-16T07:30:55.252 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2024-03-16T07:30:55.253 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-03-16T07:30:55.253 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:30:55.253 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:30:55.253 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:30:55.253 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.e", 2024-03-16T07:30:55.253 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAaSfVl8OySEhAAyF3ScxdSuQ0jhZhRbJ2gEg==", 2024-03-16T07:30:55.253 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-03-16T07:30:55.253 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2024-03-16T07:30:55.253 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2024-03-16T07:30:55.253 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2024-03-16T07:30:55.253 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-03-16T07:30:55.253 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:30:55.253 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:30:55.253 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:30:55.253 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.0", 2024-03-16T07:30:55.253 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAbSfVlNhmeKBAAVnxZbeNKU/kVViG2vb2+tQ==", 2024-03-16T07:30:55.254 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-03-16T07:30:55.254 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2024-03-16T07:30:55.254 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2024-03-16T07:30:55.254 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-03-16T07:30:55.254 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:30:55.254 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:30:55.254 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:30:55.254 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.1", 2024-03-16T07:30:55.254 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAdSfVlNNNkNhAAKhYH9tWxFT8HH6ZLMnaK7A==", 2024-03-16T07:30:55.254 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-03-16T07:30:55.254 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2024-03-16T07:30:55.254 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2024-03-16T07:30:55.254 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-03-16T07:30:55.254 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:30:55.254 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:30:55.254 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:30:55.255 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.2", 2024-03-16T07:30:55.255 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAgSfVlXJh1BxAAEOX+brDLOLTkp0thYQgMrw==", 2024-03-16T07:30:55.255 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-03-16T07:30:55.255 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2024-03-16T07:30:55.255 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2024-03-16T07:30:55.255 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-03-16T07:30:55.255 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:30:55.255 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:30:55.255 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:30:55.255 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.0", 2024-03-16T07:30:55.255 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAaSfVlmBmvGRAAaxdhkajaioVlq23dyv/g4g==", 2024-03-16T07:30:55.255 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-03-16T07:30:55.255 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2024-03-16T07:30:55.255 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow r", 2024-03-16T07:30:55.255 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-03-16T07:30:55.255 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:30:55.255 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:30:55.256 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:30:55.256 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.1", 2024-03-16T07:30:55.256 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAaSfVlCp2DHRAAdVsc+jh/QA74EBwffEqP5g==", 2024-03-16T07:30:55.256 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-03-16T07:30:55.256 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2024-03-16T07:30:55.256 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow r", 2024-03-16T07:30:55.256 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow rw", 2024-03-16T07:30:55.256 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rwx" 2024-03-16T07:30:55.256 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:30:55.256 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:30:55.256 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:30:55.256 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.admin", 2024-03-16T07:30:55.256 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAZSfVl0iRiFxAArXglVmR8MpJZNrXNv5tS7A==", 2024-03-16T07:30:55.256 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-03-16T07:30:55.256 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow *", 2024-03-16T07:30:55.256 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2024-03-16T07:30:55.256 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2024-03-16T07:30:55.257 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-03-16T07:30:55.257 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:30:55.257 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:30:55.257 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:30:55.257 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.mirror", 2024-03-16T07:30:55.257 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAaSfVldspUIRAAa1kAy23ZdMBfbhy+7HMVqA==", 2024-03-16T07:30:55.257 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-03-16T07:30:55.257 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow r", 2024-03-16T07:30:55.257 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow r", 2024-03-16T07:30:55.257 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "profile cephfs-mirror", 2024-03-16T07:30:55.257 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rw tag cephfs metadata=*, allow r tag cephfs data=*" 2024-03-16T07:30:55.257 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:30:55.257 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:30:55.257 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:30:55.257 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.mirror_remote", 2024-03-16T07:30:55.257 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAaSfVlaygzJRAAJVP9XACdC2Wikb4ZtKci9g==", 2024-03-16T07:30:55.257 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-03-16T07:30:55.258 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow rwps", 2024-03-16T07:30:55.258 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow r", 2024-03-16T07:30:55.258 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow r", 2024-03-16T07:30:55.258 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rw tag cephfs *=*" 2024-03-16T07:30:55.258 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:30:55.258 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:30:55.258 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:30:55.258 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mgr.x", 2024-03-16T07:30:55.258 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAZSfVlX9BEKhAAftDfT7+IPsQFhrTPl2h0SQ==", 2024-03-16T07:30:55.258 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-03-16T07:30:55.258 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow *", 2024-03-16T07:30:55.258 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile mgr", 2024-03-16T07:30:55.258 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-03-16T07:30:55.258 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:30:55.258 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:30:55.258 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2024-03-16T07:30:55.259 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-03-16T07:30:55.263 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T07:30:55.566 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:30:55.566 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":115,"fsid":"f91af061-9eac-4793-87fa-8d27ae3d242f","created":"2024-03-16T07:24:20.357868+0000","modified":"2024-03-16T07:30:54.854536+0000","last_up_change":"2024-03-16T07:24:27.474980+0000","last_in_change":"2024-03-16T07:24:21.254179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T07:24:28.947521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2df14aac-98dc-4e3c-ae7e-9eb677aa30be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6801","nonce":2744935777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6803","nonce":2744935777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6807","nonce":2744935777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6805","nonce":2744935777}]},"public_addr":"172.21.15.49:6801/2744935777","cluster_addr":"172.21.15.49:6803/2744935777","heartbeat_back_addr":"172.21.15.49:6807/2744935777","heartbeat_front_addr":"172.21.15.49:6805/2744935777","state":["exists","up"]},{"osd":1,"uuid":"80461bd9-59ef-46df-9eea-bad92d960c57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6811","nonce":1655120118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6815","nonce":1655120118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6821","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6823","nonce":1655120118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6817","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6819","nonce":1655120118}]},"public_addr":"172.21.15.49:6811/1655120118","cluster_addr":"172.21.15.49:6815/1655120118","heartbeat_back_addr":"172.21.15.49:6823/1655120118","heartbeat_front_addr":"172.21.15.49:6819/1655120118","state":["exists","up"]},{"osd":2,"uuid":"d6bf40eb-6e42-4ec9-8b3d-0b6c5a6def79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6810","nonce":3815472376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6814","nonce":3815472376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6822","nonce":3815472376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6818","nonce":3815472376}]},"public_addr":"172.21.15.49:6810/3815472376","cluster_addr":"172.21.15.49:6814/3815472376","heartbeat_back_addr":"172.21.15.49:6822/3815472376","heartbeat_front_addr":"172.21.15.49:6818/3815472376","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.641492+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.668598+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.614940+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T07:30:55.579 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-16T07:24:28.947521+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-16T07:30:55.579 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-16T07:30:55.880 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2024-03-16T07:30:55.893 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-03-16T07:30:56.195 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:30:56.195 INFO:teuthology.orchestra.run.smithi049.stdout:[ 2024-03-16T07:30:56.195 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:30:56.195 INFO:teuthology.orchestra.run.smithi049.stdout: "poolnum": 1, 2024-03-16T07:30:56.195 INFO:teuthology.orchestra.run.smithi049.stdout: "poolname": ".mgr" 2024-03-16T07:30:56.195 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:30:56.196 INFO:teuthology.orchestra.run.smithi049.stdout:] 2024-03-16T07:30:56.207 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-03-16T07:30:56.207 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-03-16T07:30:56.854 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_metadata' created 2024-03-16T07:30:56.872 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-03-16T07:30:57.857 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_data' created 2024-03-16T07:30:57.892 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-03-16T07:30:58.857 INFO:teuthology.orchestra.run.smithi049.stderr:new fs with metadata pool 20 and data pool 21 2024-03-16T07:30:58.878 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T07:30:59.182 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:30:59.182 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":118,"fsid":"f91af061-9eac-4793-87fa-8d27ae3d242f","created":"2024-03-16T07:24:20.357868+0000","modified":"2024-03-16T07:30:58.238143+0000","last_up_change":"2024-03-16T07:24:27.474980+0000","last_in_change":"2024-03-16T07:24:21.254179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T07:24:28.947521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2024-03-16T07:30:56.548783+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2024-03-16T07:30:57.216365+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2df14aac-98dc-4e3c-ae7e-9eb677aa30be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6801","nonce":2744935777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6803","nonce":2744935777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6807","nonce":2744935777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6805","nonce":2744935777}]},"public_addr":"172.21.15.49:6801/2744935777","cluster_addr":"172.21.15.49:6803/2744935777","heartbeat_back_addr":"172.21.15.49:6807/2744935777","heartbeat_front_addr":"172.21.15.49:6805/2744935777","state":["exists","up"]},{"osd":1,"uuid":"80461bd9-59ef-46df-9eea-bad92d960c57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6811","nonce":1655120118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6815","nonce":1655120118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6821","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6823","nonce":1655120118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6817","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6819","nonce":1655120118}]},"public_addr":"172.21.15.49:6811/1655120118","cluster_addr":"172.21.15.49:6815/1655120118","heartbeat_back_addr":"172.21.15.49:6823/1655120118","heartbeat_front_addr":"172.21.15.49:6819/1655120118","state":["exists","up"]},{"osd":2,"uuid":"d6bf40eb-6e42-4ec9-8b3d-0b6c5a6def79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6810","nonce":3815472376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6814","nonce":3815472376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6822","nonce":3815472376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6818","nonce":3815472376}]},"public_addr":"172.21.15.49:6810/3815472376","cluster_addr":"172.21.15.49:6814/3815472376","heartbeat_back_addr":"172.21.15.49:6822/3815472376","heartbeat_front_addr":"172.21.15.49:6818/3815472376","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.641492+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.668598+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.614940+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T07:30:59.194 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T07:30:59.501 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:30:59.501 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":118,"fsid":"f91af061-9eac-4793-87fa-8d27ae3d242f","created":"2024-03-16T07:24:20.357868+0000","modified":"2024-03-16T07:30:58.238143+0000","last_up_change":"2024-03-16T07:24:27.474980+0000","last_in_change":"2024-03-16T07:24:21.254179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T07:24:28.947521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2024-03-16T07:30:56.548783+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2024-03-16T07:30:57.216365+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2df14aac-98dc-4e3c-ae7e-9eb677aa30be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6801","nonce":2744935777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6803","nonce":2744935777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6807","nonce":2744935777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6805","nonce":2744935777}]},"public_addr":"172.21.15.49:6801/2744935777","cluster_addr":"172.21.15.49:6803/2744935777","heartbeat_back_addr":"172.21.15.49:6807/2744935777","heartbeat_front_addr":"172.21.15.49:6805/2744935777","state":["exists","up"]},{"osd":1,"uuid":"80461bd9-59ef-46df-9eea-bad92d960c57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6811","nonce":1655120118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6815","nonce":1655120118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6821","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6823","nonce":1655120118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6817","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6819","nonce":1655120118}]},"public_addr":"172.21.15.49:6811/1655120118","cluster_addr":"172.21.15.49:6815/1655120118","heartbeat_back_addr":"172.21.15.49:6823/1655120118","heartbeat_front_addr":"172.21.15.49:6819/1655120118","state":["exists","up"]},{"osd":2,"uuid":"d6bf40eb-6e42-4ec9-8b3d-0b6c5a6def79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6810","nonce":3815472376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6814","nonce":3815472376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6822","nonce":3815472376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6818","nonce":3815472376}]},"public_addr":"172.21.15.49:6810/3815472376","cluster_addr":"172.21.15.49:6814/3815472376","heartbeat_back_addr":"172.21.15.49:6822/3815472376","heartbeat_front_addr":"172.21.15.49:6818/3815472376","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.641492+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.668598+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.614940+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T07:30:59.511 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d has been restored 2024-03-16T07:30:59.512 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-03-16T07:30:59.874 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-03-16T07:30:59.874 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-03-16T07:31:00.873 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-03-16T07:31:00.874 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T07:31:01.219 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:31:01.219 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":81,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5957,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6827/2832753094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":2832753094},{"type":"v1","addr":"172.21.15.49:6827","nonce":2832753094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":78},{"gid":5961,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6829/3236120377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":3236120377},{"type":"v1","addr":"172.21.15.49:6829","nonce":3236120377}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":78},{"gid":5964,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6831/1238434429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":1238434429},{"type":"v1","addr":"172.21.15.49:6831","nonce":1238434429}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":78},{"gid":5965,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6833/4146414383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":4146414383},{"type":"v1","addr":"172.21.15.49:6833","nonce":4146414383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":78}],"filesystems":[{"mdsmap":{"epoch":81,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-16T07:30:58.238420+0000","modified":"2024-03-16T07:31:00.495716+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5968},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5968":{"gid":5968,"name":"d","rank":0,"incarnation":79,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6835/790210824","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":790210824},{"type":"v1","addr":"172.21.15.49:6835","nonce":790210824}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5968,"qdb_cluster":[5968]},"id":10}]} 2024-03-16T07:31:01.219 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 81 2024-03-16T07:31:01.231 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T07:31:01.550 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:31:01.550 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":119,"fsid":"f91af061-9eac-4793-87fa-8d27ae3d242f","created":"2024-03-16T07:24:20.357868+0000","modified":"2024-03-16T07:30:59.550794+0000","last_up_change":"2024-03-16T07:24:27.474980+0000","last_in_change":"2024-03-16T07:24:21.254179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T07:24:28.947521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2024-03-16T07:30:56.548783+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2024-03-16T07:30:57.216365+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"119","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2df14aac-98dc-4e3c-ae7e-9eb677aa30be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6801","nonce":2744935777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6803","nonce":2744935777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6807","nonce":2744935777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6805","nonce":2744935777}]},"public_addr":"172.21.15.49:6801/2744935777","cluster_addr":"172.21.15.49:6803/2744935777","heartbeat_back_addr":"172.21.15.49:6807/2744935777","heartbeat_front_addr":"172.21.15.49:6805/2744935777","state":["exists","up"]},{"osd":1,"uuid":"80461bd9-59ef-46df-9eea-bad92d960c57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6811","nonce":1655120118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6815","nonce":1655120118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6821","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6823","nonce":1655120118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6817","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6819","nonce":1655120118}]},"public_addr":"172.21.15.49:6811/1655120118","cluster_addr":"172.21.15.49:6815/1655120118","heartbeat_back_addr":"172.21.15.49:6823/1655120118","heartbeat_front_addr":"172.21.15.49:6819/1655120118","state":["exists","up"]},{"osd":2,"uuid":"d6bf40eb-6e42-4ec9-8b3d-0b6c5a6def79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6810","nonce":3815472376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6814","nonce":3815472376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6822","nonce":3815472376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6818","nonce":3815472376}]},"public_addr":"172.21.15.49:6810/3815472376","cluster_addr":"172.21.15.49:6814/3815472376","heartbeat_back_addr":"172.21.15.49:6822/3815472376","heartbeat_front_addr":"172.21.15.49:6818/3815472376","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.641492+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.668598+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.614940+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T07:31:01.563 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-03-16T07:31:01.563 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-16T07:31:01.870 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:31:01.872 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2024-03-16T07:31:01.881 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":33,"stamp":"2024-03-16T07:31:00.888499+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":778,"num_read_kb":1533,"num_write":321,"num_write_kb":1908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":212,"ondisk_log_size":212,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":58,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":314572800,"kb_used":110708,"kb_used_data":4676,"kb_used_omap":4,"kb_used_meta":105979,"kb_avail":314462092,"statfs":{"total":322122547200,"available":322009182208,"internally_reserved":0,"allocated":4788224,"data_stored":2638055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":108522831},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.031791"},"pg_stats":[{"pgid":"21.3f","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.572853+0000","last_change":"2024-03-16T07:30:58.571155+0000","last_active":"2024-03-16T07:30:58.572853+0000","last_peered":"2024-03-16T07:30:58.572853+0000","last_clean":"2024-03-16T07:30:58.572853+0000","last_became_active":"2024-03-16T07:30:58.570907+0000","last_became_peered":"2024-03-16T07:30:58.570907+0000","last_unstale":"2024-03-16T07:30:58.572853+0000","last_undegraded":"2024-03-16T07:30:58.572853+0000","last_fullsized":"2024-03-16T07:30:58.572853+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:10:16.259637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.569142+0000","last_change":"2024-03-16T07:30:58.567565+0000","last_active":"2024-03-16T07:30:58.569142+0000","last_peered":"2024-03-16T07:30:58.569142+0000","last_clean":"2024-03-16T07:30:58.569142+0000","last_became_active":"2024-03-16T07:30:58.567322+0000","last_became_peered":"2024-03-16T07:30:58.567322+0000","last_unstale":"2024-03-16T07:30:58.569142+0000","last_undegraded":"2024-03-16T07:30:58.569142+0000","last_fullsized":"2024-03-16T07:30:58.569142+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:42:30.823514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.566233+0000","last_change":"2024-03-16T07:30:58.563537+0000","last_active":"2024-03-16T07:30:58.566233+0000","last_peered":"2024-03-16T07:30:58.566233+0000","last_clean":"2024-03-16T07:30:58.566233+0000","last_became_active":"2024-03-16T07:30:58.562673+0000","last_became_peered":"2024-03-16T07:30:58.562673+0000","last_unstale":"2024-03-16T07:30:58.566233+0000","last_undegraded":"2024-03-16T07:30:58.566233+0000","last_fullsized":"2024-03-16T07:30:58.566233+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:02:34.203186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3c","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.575540+0000","last_change":"2024-03-16T07:30:58.572946+0000","last_active":"2024-03-16T07:30:58.575540+0000","last_peered":"2024-03-16T07:30:58.575540+0000","last_clean":"2024-03-16T07:30:58.575540+0000","last_became_active":"2024-03-16T07:30:58.572626+0000","last_became_peered":"2024-03-16T07:30:58.572626+0000","last_unstale":"2024-03-16T07:30:58.575540+0000","last_undegraded":"2024-03-16T07:30:58.575540+0000","last_fullsized":"2024-03-16T07:30:58.575540+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:57:16.989944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.3b","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.572857+0000","last_change":"2024-03-16T07:30:58.571437+0000","last_active":"2024-03-16T07:30:58.572857+0000","last_peered":"2024-03-16T07:30:58.572857+0000","last_clean":"2024-03-16T07:30:58.572857+0000","last_became_active":"2024-03-16T07:30:58.571200+0000","last_became_peered":"2024-03-16T07:30:58.571200+0000","last_unstale":"2024-03-16T07:30:58.572857+0000","last_undegraded":"2024-03-16T07:30:58.572857+0000","last_fullsized":"2024-03-16T07:30:58.572857+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:25:37.976273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3a","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.571462+0000","last_change":"2024-03-16T07:30:58.570783+0000","last_active":"2024-03-16T07:30:58.571462+0000","last_peered":"2024-03-16T07:30:58.571462+0000","last_clean":"2024-03-16T07:30:58.571462+0000","last_became_active":"2024-03-16T07:30:58.570527+0000","last_became_peered":"2024-03-16T07:30:58.570527+0000","last_unstale":"2024-03-16T07:30:58.571462+0000","last_undegraded":"2024-03-16T07:30:58.571462+0000","last_fullsized":"2024-03-16T07:30:58.571462+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:06:50.154852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.574503+0000","last_change":"2024-03-16T07:30:58.572802+0000","last_active":"2024-03-16T07:30:58.574503+0000","last_peered":"2024-03-16T07:30:58.574503+0000","last_clean":"2024-03-16T07:30:58.574503+0000","last_became_active":"2024-03-16T07:30:58.572430+0000","last_became_peered":"2024-03-16T07:30:58.572430+0000","last_unstale":"2024-03-16T07:30:58.574503+0000","last_undegraded":"2024-03-16T07:30:58.574503+0000","last_fullsized":"2024-03-16T07:30:58.574503+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:37:36.499442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.566984+0000","last_change":"2024-03-16T07:30:58.563881+0000","last_active":"2024-03-16T07:30:58.566984+0000","last_peered":"2024-03-16T07:30:58.566984+0000","last_clean":"2024-03-16T07:30:58.566984+0000","last_became_active":"2024-03-16T07:30:58.563112+0000","last_became_peered":"2024-03-16T07:30:58.563112+0000","last_unstale":"2024-03-16T07:30:58.566984+0000","last_undegraded":"2024-03-16T07:30:58.566984+0000","last_fullsized":"2024-03-16T07:30:58.566984+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:05:22.872331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.572127+0000","last_change":"2024-03-16T07:30:58.571043+0000","last_active":"2024-03-16T07:30:58.572127+0000","last_peered":"2024-03-16T07:30:58.572127+0000","last_clean":"2024-03-16T07:30:58.572127+0000","last_became_active":"2024-03-16T07:30:58.570796+0000","last_became_peered":"2024-03-16T07:30:58.570796+0000","last_unstale":"2024-03-16T07:30:58.572127+0000","last_undegraded":"2024-03-16T07:30:58.572127+0000","last_fullsized":"2024-03-16T07:30:58.572127+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:47:42.860318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.564965+0000","last_change":"2024-03-16T07:30:58.563510+0000","last_active":"2024-03-16T07:30:58.564965+0000","last_peered":"2024-03-16T07:30:58.564965+0000","last_clean":"2024-03-16T07:30:58.564965+0000","last_became_active":"2024-03-16T07:30:58.563192+0000","last_became_peered":"2024-03-16T07:30:58.563192+0000","last_unstale":"2024-03-16T07:30:58.564965+0000","last_undegraded":"2024-03-16T07:30:58.564965+0000","last_fullsized":"2024-03-16T07:30:58.564965+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:12:01.018436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.570465+0000","last_change":"2024-03-16T07:30:58.569050+0000","last_active":"2024-03-16T07:30:58.570465+0000","last_peered":"2024-03-16T07:30:58.570465+0000","last_clean":"2024-03-16T07:30:58.570465+0000","last_became_active":"2024-03-16T07:30:58.568635+0000","last_became_peered":"2024-03-16T07:30:58.568635+0000","last_unstale":"2024-03-16T07:30:58.570465+0000","last_undegraded":"2024-03-16T07:30:58.570465+0000","last_fullsized":"2024-03-16T07:30:58.570465+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:57:16.989944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.34","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.574598+0000","last_change":"2024-03-16T07:30:58.572517+0000","last_active":"2024-03-16T07:30:58.574598+0000","last_peered":"2024-03-16T07:30:58.574598+0000","last_clean":"2024-03-16T07:30:58.574598+0000","last_became_active":"2024-03-16T07:30:58.570337+0000","last_became_peered":"2024-03-16T07:30:58.570337+0000","last_unstale":"2024-03-16T07:30:58.574598+0000","last_undegraded":"2024-03-16T07:30:58.574598+0000","last_fullsized":"2024-03-16T07:30:58.574598+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:24:48.479190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.33","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.572834+0000","last_change":"2024-03-16T07:30:58.571283+0000","last_active":"2024-03-16T07:30:58.572834+0000","last_peered":"2024-03-16T07:30:58.572834+0000","last_clean":"2024-03-16T07:30:58.572834+0000","last_became_active":"2024-03-16T07:30:58.570972+0000","last_became_peered":"2024-03-16T07:30:58.570972+0000","last_unstale":"2024-03-16T07:30:58.572834+0000","last_undegraded":"2024-03-16T07:30:58.572834+0000","last_fullsized":"2024-03-16T07:30:58.572834+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:31:06.763042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.575365+0000","last_change":"2024-03-16T07:30:58.574666+0000","last_active":"2024-03-16T07:30:58.575365+0000","last_peered":"2024-03-16T07:30:58.575365+0000","last_clean":"2024-03-16T07:30:58.575365+0000","last_became_active":"2024-03-16T07:30:58.573873+0000","last_became_peered":"2024-03-16T07:30:58.573873+0000","last_unstale":"2024-03-16T07:30:58.575365+0000","last_undegraded":"2024-03-16T07:30:58.575365+0000","last_fullsized":"2024-03-16T07:30:58.575365+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:15:16.124364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.571796+0000","last_change":"2024-03-16T07:30:58.570258+0000","last_active":"2024-03-16T07:30:58.571796+0000","last_peered":"2024-03-16T07:30:58.571796+0000","last_clean":"2024-03-16T07:30:58.571796+0000","last_became_active":"2024-03-16T07:30:58.570020+0000","last_became_peered":"2024-03-16T07:30:58.570020+0000","last_unstale":"2024-03-16T07:30:58.571796+0000","last_undegraded":"2024-03-16T07:30:58.571796+0000","last_fullsized":"2024-03-16T07:30:58.571796+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:34:17.392134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.30","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.576334+0000","last_change":"2024-03-16T07:30:58.574365+0000","last_active":"2024-03-16T07:30:58.576334+0000","last_peered":"2024-03-16T07:30:58.576334+0000","last_clean":"2024-03-16T07:30:58.576334+0000","last_became_active":"2024-03-16T07:30:58.574133+0000","last_became_peered":"2024-03-16T07:30:58.574133+0000","last_unstale":"2024-03-16T07:30:58.576334+0000","last_undegraded":"2024-03-16T07:30:58.576334+0000","last_fullsized":"2024-03-16T07:30:58.576334+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:31:06.763042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.578097+0000","last_change":"2024-03-16T07:30:58.576696+0000","last_active":"2024-03-16T07:30:58.578097+0000","last_peered":"2024-03-16T07:30:58.578097+0000","last_clean":"2024-03-16T07:30:58.578097+0000","last_became_active":"2024-03-16T07:30:58.576438+0000","last_became_peered":"2024-03-16T07:30:58.576438+0000","last_unstale":"2024-03-16T07:30:58.578097+0000","last_undegraded":"2024-03-16T07:30:58.578097+0000","last_fullsized":"2024-03-16T07:30:58.578097+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:12:28.497074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.573265+0000","last_change":"2024-03-16T07:30:58.572031+0000","last_active":"2024-03-16T07:30:58.573265+0000","last_peered":"2024-03-16T07:30:58.573265+0000","last_clean":"2024-03-16T07:30:58.573265+0000","last_became_active":"2024-03-16T07:30:58.571663+0000","last_became_peered":"2024-03-16T07:30:58.571663+0000","last_unstale":"2024-03-16T07:30:58.573265+0000","last_undegraded":"2024-03-16T07:30:58.573265+0000","last_fullsized":"2024-03-16T07:30:58.573265+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:21:45.921916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2d","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.571000+0000","last_change":"2024-03-16T07:30:58.569822+0000","last_active":"2024-03-16T07:30:58.571000+0000","last_peered":"2024-03-16T07:30:58.571000+0000","last_clean":"2024-03-16T07:30:58.571000+0000","last_became_active":"2024-03-16T07:30:58.569585+0000","last_became_peered":"2024-03-16T07:30:58.569585+0000","last_unstale":"2024-03-16T07:30:58.571000+0000","last_undegraded":"2024-03-16T07:30:58.571000+0000","last_fullsized":"2024-03-16T07:30:58.571000+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:15:58.196193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.576055+0000","last_change":"2024-03-16T07:30:58.573838+0000","last_active":"2024-03-16T07:30:58.576055+0000","last_peered":"2024-03-16T07:30:58.576055+0000","last_clean":"2024-03-16T07:30:58.576055+0000","last_became_active":"2024-03-16T07:30:58.573583+0000","last_became_peered":"2024-03-16T07:30:58.573583+0000","last_unstale":"2024-03-16T07:30:58.576055+0000","last_undegraded":"2024-03-16T07:30:58.576055+0000","last_fullsized":"2024-03-16T07:30:58.576055+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:47:42.860318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2b","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.577034+0000","last_change":"2024-03-16T07:30:58.576167+0000","last_active":"2024-03-16T07:30:58.577034+0000","last_peered":"2024-03-16T07:30:58.577034+0000","last_clean":"2024-03-16T07:30:58.577034+0000","last_became_active":"2024-03-16T07:30:58.575924+0000","last_became_peered":"2024-03-16T07:30:58.575924+0000","last_unstale":"2024-03-16T07:30:58.577034+0000","last_undegraded":"2024-03-16T07:30:58.577034+0000","last_fullsized":"2024-03-16T07:30:58.577034+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:30:06.769142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.575350+0000","last_change":"2024-03-16T07:30:58.574457+0000","last_active":"2024-03-16T07:30:58.575350+0000","last_peered":"2024-03-16T07:30:58.575350+0000","last_clean":"2024-03-16T07:30:58.575350+0000","last_became_active":"2024-03-16T07:30:58.573573+0000","last_became_peered":"2024-03-16T07:30:58.573573+0000","last_unstale":"2024-03-16T07:30:58.575350+0000","last_undegraded":"2024-03-16T07:30:58.575350+0000","last_fullsized":"2024-03-16T07:30:58.575350+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:28:15.356904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.579382+0000","last_change":"2024-03-16T07:30:58.575945+0000","last_active":"2024-03-16T07:30:58.579382+0000","last_peered":"2024-03-16T07:30:58.579382+0000","last_clean":"2024-03-16T07:30:58.579382+0000","last_became_active":"2024-03-16T07:30:58.575414+0000","last_became_peered":"2024-03-16T07:30:58.575414+0000","last_unstale":"2024-03-16T07:30:58.579382+0000","last_undegraded":"2024-03-16T07:30:58.579382+0000","last_fullsized":"2024-03-16T07:30:58.579382+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:23:09.206123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.566963+0000","last_change":"2024-03-16T07:30:58.563542+0000","last_active":"2024-03-16T07:30:58.566963+0000","last_peered":"2024-03-16T07:30:58.566963+0000","last_clean":"2024-03-16T07:30:58.566963+0000","last_became_active":"2024-03-16T07:30:58.562883+0000","last_became_peered":"2024-03-16T07:30:58.562883+0000","last_unstale":"2024-03-16T07:30:58.566963+0000","last_undegraded":"2024-03-16T07:30:58.566963+0000","last_fullsized":"2024-03-16T07:30:58.566963+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:58:08.000301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.576825+0000","last_change":"2024-03-16T07:30:58.574409+0000","last_active":"2024-03-16T07:30:58.576825+0000","last_peered":"2024-03-16T07:30:58.576825+0000","last_clean":"2024-03-16T07:30:58.576825+0000","last_became_active":"2024-03-16T07:30:58.573829+0000","last_became_peered":"2024-03-16T07:30:58.573829+0000","last_unstale":"2024-03-16T07:30:58.576825+0000","last_undegraded":"2024-03-16T07:30:58.576825+0000","last_fullsized":"2024-03-16T07:30:58.576825+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:25:37.976273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.573249+0000","last_change":"2024-03-16T07:30:58.571970+0000","last_active":"2024-03-16T07:30:58.573249+0000","last_peered":"2024-03-16T07:30:58.573249+0000","last_clean":"2024-03-16T07:30:58.573249+0000","last_became_active":"2024-03-16T07:30:58.571516+0000","last_became_peered":"2024-03-16T07:30:58.571516+0000","last_unstale":"2024-03-16T07:30:58.573249+0000","last_undegraded":"2024-03-16T07:30:58.573249+0000","last_fullsized":"2024-03-16T07:30:58.573249+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:22:16.305364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.576350+0000","last_change":"2024-03-16T07:30:58.575126+0000","last_active":"2024-03-16T07:30:58.576350+0000","last_peered":"2024-03-16T07:30:58.576350+0000","last_clean":"2024-03-16T07:30:58.576350+0000","last_became_active":"2024-03-16T07:30:58.574934+0000","last_became_peered":"2024-03-16T07:30:58.574934+0000","last_unstale":"2024-03-16T07:30:58.576350+0000","last_undegraded":"2024-03-16T07:30:58.576350+0000","last_fullsized":"2024-03-16T07:30:58.576350+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:21:45.921916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.574575+0000","last_change":"2024-03-16T07:30:58.572025+0000","last_active":"2024-03-16T07:30:58.574575+0000","last_peered":"2024-03-16T07:30:58.574575+0000","last_clean":"2024-03-16T07:30:58.574575+0000","last_became_active":"2024-03-16T07:30:58.569977+0000","last_became_peered":"2024-03-16T07:30:58.569977+0000","last_unstale":"2024-03-16T07:30:58.574575+0000","last_undegraded":"2024-03-16T07:30:58.574575+0000","last_fullsized":"2024-03-16T07:30:58.574575+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:52:29.384844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.563399+0000","last_change":"2024-03-16T07:30:58.560398+0000","last_active":"2024-03-16T07:30:58.563399+0000","last_peered":"2024-03-16T07:30:58.563399+0000","last_clean":"2024-03-16T07:30:58.563399+0000","last_became_active":"2024-03-16T07:30:58.560136+0000","last_became_peered":"2024-03-16T07:30:58.560136+0000","last_unstale":"2024-03-16T07:30:58.563399+0000","last_undegraded":"2024-03-16T07:30:58.563399+0000","last_fullsized":"2024-03-16T07:30:58.563399+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:37:56.899787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.566071+0000","last_change":"2024-03-16T07:30:58.564792+0000","last_active":"2024-03-16T07:30:58.566071+0000","last_peered":"2024-03-16T07:30:58.566071+0000","last_clean":"2024-03-16T07:30:58.566071+0000","last_became_active":"2024-03-16T07:30:58.564542+0000","last_became_peered":"2024-03-16T07:30:58.564542+0000","last_unstale":"2024-03-16T07:30:58.566071+0000","last_undegraded":"2024-03-16T07:30:58.566071+0000","last_fullsized":"2024-03-16T07:30:58.566071+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:01:00.056073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.566804+0000","last_change":"2024-03-16T07:30:58.562033+0000","last_active":"2024-03-16T07:30:58.566804+0000","last_peered":"2024-03-16T07:30:58.566804+0000","last_clean":"2024-03-16T07:30:58.566804+0000","last_became_active":"2024-03-16T07:30:58.561807+0000","last_became_peered":"2024-03-16T07:30:58.561807+0000","last_unstale":"2024-03-16T07:30:58.566804+0000","last_undegraded":"2024-03-16T07:30:58.566804+0000","last_fullsized":"2024-03-16T07:30:58.566804+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:19:04.077741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.576368+0000","last_change":"2024-03-16T07:30:58.575428+0000","last_active":"2024-03-16T07:30:58.576368+0000","last_peered":"2024-03-16T07:30:58.576368+0000","last_clean":"2024-03-16T07:30:58.576368+0000","last_became_active":"2024-03-16T07:30:58.575207+0000","last_became_peered":"2024-03-16T07:30:58.575207+0000","last_unstale":"2024-03-16T07:30:58.576368+0000","last_undegraded":"2024-03-16T07:30:58.576368+0000","last_fullsized":"2024-03-16T07:30:58.576368+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:50:38.987166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.573228+0000","last_change":"2024-03-16T07:30:58.571761+0000","last_active":"2024-03-16T07:30:58.573228+0000","last_peered":"2024-03-16T07:30:58.573228+0000","last_clean":"2024-03-16T07:30:58.573228+0000","last_became_active":"2024-03-16T07:30:58.570852+0000","last_became_peered":"2024-03-16T07:30:58.570852+0000","last_unstale":"2024-03-16T07:30:58.573228+0000","last_undegraded":"2024-03-16T07:30:58.573228+0000","last_fullsized":"2024-03-16T07:30:58.573228+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:05:40.149740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1f","version":"118'4","reported_seq":16,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.870834+0000","last_change":"2024-03-16T07:30:57.875122+0000","last_active":"2024-03-16T07:30:58.870834+0000","last_peered":"2024-03-16T07:30:58.870834+0000","last_clean":"2024-03-16T07:30:58.870834+0000","last_became_active":"2024-03-16T07:30:57.874848+0000","last_became_peered":"2024-03-16T07:30:57.874848+0000","last_unstale":"2024-03-16T07:30:58.870834+0000","last_undegraded":"2024-03-16T07:30:58.870834+0000","last_fullsized":"2024-03-16T07:30:58.870834+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_clean_scrub_stamp":"2024-03-16T07:30:56.855668+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:27:04.801331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.578114+0000","last_change":"2024-03-16T07:30:58.576923+0000","last_active":"2024-03-16T07:30:58.578114+0000","last_peered":"2024-03-16T07:30:58.578114+0000","last_clean":"2024-03-16T07:30:58.578114+0000","last_became_active":"2024-03-16T07:30:58.576662+0000","last_became_peered":"2024-03-16T07:30:58.576662+0000","last_unstale":"2024-03-16T07:30:58.578114+0000","last_undegraded":"2024-03-16T07:30:58.578114+0000","last_fullsized":"2024-03-16T07:30:58.578114+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:25:23.575079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1e","version":"118'1","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.870345+0000","last_change":"2024-03-16T07:30:57.876067+0000","last_active":"2024-03-16T07:30:58.870345+0000","last_peered":"2024-03-16T07:30:58.870345+0000","last_clean":"2024-03-16T07:30:58.870345+0000","last_became_active":"2024-03-16T07:30:57.875777+0000","last_became_peered":"2024-03-16T07:30:57.875777+0000","last_unstale":"2024-03-16T07:30:58.870345+0000","last_undegraded":"2024-03-16T07:30:58.870345+0000","last_fullsized":"2024-03-16T07:30:58.870345+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_clean_scrub_stamp":"2024-03-16T07:30:56.855668+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:09:20.828638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.563560+0000","last_change":"2024-03-16T07:30:58.562404+0000","last_active":"2024-03-16T07:30:58.563560+0000","last_peered":"2024-03-16T07:30:58.563560+0000","last_clean":"2024-03-16T07:30:58.563560+0000","last_became_active":"2024-03-16T07:30:58.561934+0000","last_became_peered":"2024-03-16T07:30:58.561934+0000","last_unstale":"2024-03-16T07:30:58.563560+0000","last_undegraded":"2024-03-16T07:30:58.563560+0000","last_fullsized":"2024-03-16T07:30:58.563560+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:00:46.800781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1d","version":"118'2","reported_seq":14,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.870203+0000","last_change":"2024-03-16T07:30:57.880613+0000","last_active":"2024-03-16T07:30:58.870203+0000","last_peered":"2024-03-16T07:30:58.870203+0000","last_clean":"2024-03-16T07:30:58.870203+0000","last_became_active":"2024-03-16T07:30:57.880338+0000","last_became_peered":"2024-03-16T07:30:57.880338+0000","last_unstale":"2024-03-16T07:30:58.870203+0000","last_undegraded":"2024-03-16T07:30:58.870203+0000","last_fullsized":"2024-03-16T07:30:58.870203+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_clean_scrub_stamp":"2024-03-16T07:30:56.855668+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:44:41.572764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.576370+0000","last_change":"2024-03-16T07:30:58.575257+0000","last_active":"2024-03-16T07:30:58.576370+0000","last_peered":"2024-03-16T07:30:58.576370+0000","last_clean":"2024-03-16T07:30:58.576370+0000","last_became_active":"2024-03-16T07:30:58.575059+0000","last_became_peered":"2024-03-16T07:30:58.575059+0000","last_unstale":"2024-03-16T07:30:58.576370+0000","last_undegraded":"2024-03-16T07:30:58.576370+0000","last_fullsized":"2024-03-16T07:30:58.576370+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:56:38.419618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1c","version":"118'2","reported_seq":14,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.870246+0000","last_change":"2024-03-16T07:30:57.883046+0000","last_active":"2024-03-16T07:30:58.870246+0000","last_peered":"2024-03-16T07:30:58.870246+0000","last_clean":"2024-03-16T07:30:58.870246+0000","last_became_active":"2024-03-16T07:30:57.882833+0000","last_became_peered":"2024-03-16T07:30:57.882833+0000","last_unstale":"2024-03-16T07:30:58.870246+0000","last_undegraded":"2024-03-16T07:30:58.870246+0000","last_fullsized":"2024-03-16T07:30:58.870246+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_clean_scrub_stamp":"2024-03-16T07:30:56.855668+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:32:36.972246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.574830+0000","last_change":"2024-03-16T07:30:58.574103+0000","last_active":"2024-03-16T07:30:58.574830+0000","last_peered":"2024-03-16T07:30:58.574830+0000","last_clean":"2024-03-16T07:30:58.574830+0000","last_became_active":"2024-03-16T07:30:58.573253+0000","last_became_peered":"2024-03-16T07:30:58.573253+0000","last_unstale":"2024-03-16T07:30:58.574830+0000","last_undegraded":"2024-03-16T07:30:58.574830+0000","last_fullsized":"2024-03-16T07:30:58.574830+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:00:27.704551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.1b","version":"118'1","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.869788+0000","last_change":"2024-03-16T07:30:57.877500+0000","last_active":"2024-03-16T07:30:58.869788+0000","last_peered":"2024-03-16T07:30:58.869788+0000","last_clean":"2024-03-16T07:30:58.869788+0000","last_became_active":"2024-03-16T07:30:57.877227+0000","last_became_peered":"2024-03-16T07:30:57.877227+0000","last_unstale":"2024-03-16T07:30:58.869788+0000","last_undegraded":"2024-03-16T07:30:58.869788+0000","last_fullsized":"2024-03-16T07:30:58.869788+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_clean_scrub_stamp":"2024-03-16T07:30:56.855668+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:58:06.999355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.575604+0000","last_change":"2024-03-16T07:30:58.572972+0000","last_active":"2024-03-16T07:30:58.575604+0000","last_peered":"2024-03-16T07:30:58.575604+0000","last_clean":"2024-03-16T07:30:58.575604+0000","last_became_active":"2024-03-16T07:30:58.572740+0000","last_became_peered":"2024-03-16T07:30:58.572740+0000","last_unstale":"2024-03-16T07:30:58.575604+0000","last_undegraded":"2024-03-16T07:30:58.575604+0000","last_fullsized":"2024-03-16T07:30:58.575604+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:15:58.196193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1a","version":"118'1","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.869626+0000","last_change":"2024-03-16T07:30:57.877180+0000","last_active":"2024-03-16T07:30:58.869626+0000","last_peered":"2024-03-16T07:30:58.869626+0000","last_clean":"2024-03-16T07:30:58.869626+0000","last_became_active":"2024-03-16T07:30:57.874453+0000","last_became_peered":"2024-03-16T07:30:57.874453+0000","last_unstale":"2024-03-16T07:30:58.869626+0000","last_undegraded":"2024-03-16T07:30:58.869626+0000","last_fullsized":"2024-03-16T07:30:58.869626+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_clean_scrub_stamp":"2024-03-16T07:30:56.855668+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:08:51.971603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.564929+0000","last_change":"2024-03-16T07:30:58.563319+0000","last_active":"2024-03-16T07:30:58.564929+0000","last_peered":"2024-03-16T07:30:58.564929+0000","last_clean":"2024-03-16T07:30:58.564929+0000","last_became_active":"2024-03-16T07:30:58.560355+0000","last_became_peered":"2024-03-16T07:30:58.560355+0000","last_unstale":"2024-03-16T07:30:58.564929+0000","last_undegraded":"2024-03-16T07:30:58.564929+0000","last_fullsized":"2024-03-16T07:30:58.564929+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:06:51.999186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":12,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.566897+0000","last_change":"2024-03-16T07:30:57.880819+0000","last_active":"2024-03-16T07:30:58.566897+0000","last_peered":"2024-03-16T07:30:58.566897+0000","last_clean":"2024-03-16T07:30:58.566897+0000","last_became_active":"2024-03-16T07:30:57.879895+0000","last_became_peered":"2024-03-16T07:30:57.879895+0000","last_unstale":"2024-03-16T07:30:58.566897+0000","last_undegraded":"2024-03-16T07:30:58.566897+0000","last_fullsized":"2024-03-16T07:30:58.566897+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_clean_scrub_stamp":"2024-03-16T07:30:56.855668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:05:21.871385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.579419+0000","last_change":"2024-03-16T07:30:58.578447+0000","last_active":"2024-03-16T07:30:58.579419+0000","last_peered":"2024-03-16T07:30:58.579419+0000","last_clean":"2024-03-16T07:30:58.579419+0000","last_became_active":"2024-03-16T07:30:58.576907+0000","last_became_peered":"2024-03-16T07:30:58.576907+0000","last_unstale":"2024-03-16T07:30:58.579419+0000","last_undegraded":"2024-03-16T07:30:58.579419+0000","last_fullsized":"2024-03-16T07:30:58.579419+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:44:15.784720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":12,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.558270+0000","last_change":"2024-03-16T07:30:57.876311+0000","last_active":"2024-03-16T07:30:58.558270+0000","last_peered":"2024-03-16T07:30:58.558270+0000","last_clean":"2024-03-16T07:30:58.558270+0000","last_became_active":"2024-03-16T07:30:57.875731+0000","last_became_peered":"2024-03-16T07:30:57.875731+0000","last_unstale":"2024-03-16T07:30:58.558270+0000","last_undegraded":"2024-03-16T07:30:58.558270+0000","last_fullsized":"2024-03-16T07:30:58.558270+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_clean_scrub_stamp":"2024-03-16T07:30:56.855668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:05:56.490504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.576289+0000","last_change":"2024-03-16T07:30:58.574189+0000","last_active":"2024-03-16T07:30:58.576289+0000","last_peered":"2024-03-16T07:30:58.576289+0000","last_clean":"2024-03-16T07:30:58.576289+0000","last_became_active":"2024-03-16T07:30:58.573886+0000","last_became_peered":"2024-03-16T07:30:58.573886+0000","last_unstale":"2024-03-16T07:30:58.576289+0000","last_undegraded":"2024-03-16T07:30:58.576289+0000","last_fullsized":"2024-03-16T07:30:58.576289+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:10:16.259637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":12,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.553539+0000","last_change":"2024-03-16T07:30:57.880020+0000","last_active":"2024-03-16T07:30:58.553539+0000","last_peered":"2024-03-16T07:30:58.553539+0000","last_clean":"2024-03-16T07:30:58.553539+0000","last_became_active":"2024-03-16T07:30:57.877991+0000","last_became_peered":"2024-03-16T07:30:57.877991+0000","last_unstale":"2024-03-16T07:30:58.553539+0000","last_undegraded":"2024-03-16T07:30:58.553539+0000","last_fullsized":"2024-03-16T07:30:58.553539+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_clean_scrub_stamp":"2024-03-16T07:30:56.855668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:59:19.537450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.565573+0000","last_change":"2024-03-16T07:30:58.560911+0000","last_active":"2024-03-16T07:30:58.565573+0000","last_peered":"2024-03-16T07:30:58.565573+0000","last_clean":"2024-03-16T07:30:58.565573+0000","last_became_active":"2024-03-16T07:30:58.560672+0000","last_became_peered":"2024-03-16T07:30:58.560672+0000","last_unstale":"2024-03-16T07:30:58.565573+0000","last_undegraded":"2024-03-16T07:30:58.565573+0000","last_fullsized":"2024-03-16T07:30:58.565573+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:08:08.558438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":12,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.554632+0000","last_change":"2024-03-16T07:30:57.883569+0000","last_active":"2024-03-16T07:30:58.554632+0000","last_peered":"2024-03-16T07:30:58.554632+0000","last_clean":"2024-03-16T07:30:58.554632+0000","last_became_active":"2024-03-16T07:30:57.881021+0000","last_became_peered":"2024-03-16T07:30:57.881021+0000","last_unstale":"2024-03-16T07:30:58.554632+0000","last_undegraded":"2024-03-16T07:30:58.554632+0000","last_fullsized":"2024-03-16T07:30:58.554632+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_clean_scrub_stamp":"2024-03-16T07:30:56.855668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:10:24.637645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.578094+0000","last_change":"2024-03-16T07:30:58.577305+0000","last_active":"2024-03-16T07:30:58.578094+0000","last_peered":"2024-03-16T07:30:58.578094+0000","last_clean":"2024-03-16T07:30:58.578094+0000","last_became_active":"2024-03-16T07:30:58.577050+0000","last_became_peered":"2024-03-16T07:30:58.577050+0000","last_unstale":"2024-03-16T07:30:58.578094+0000","last_undegraded":"2024-03-16T07:30:58.578094+0000","last_fullsized":"2024-03-16T07:30:58.578094+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:02:09.725846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.14","version":"118'6","reported_seq":18,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.873760+0000","last_change":"2024-03-16T07:30:57.875270+0000","last_active":"2024-03-16T07:30:58.873760+0000","last_peered":"2024-03-16T07:30:58.873760+0000","last_clean":"2024-03-16T07:30:58.873760+0000","last_became_active":"2024-03-16T07:30:57.874794+0000","last_became_peered":"2024-03-16T07:30:57.874794+0000","last_unstale":"2024-03-16T07:30:58.873760+0000","last_undegraded":"2024-03-16T07:30:58.873760+0000","last_fullsized":"2024-03-16T07:30:58.873760+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_clean_scrub_stamp":"2024-03-16T07:30:56.855668+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:26:41.488241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.578536+0000","last_change":"2024-03-16T07:30:58.577837+0000","last_active":"2024-03-16T07:30:58.578536+0000","last_peered":"2024-03-16T07:30:58.578536+0000","last_clean":"2024-03-16T07:30:58.578536+0000","last_became_active":"2024-03-16T07:30:58.577593+0000","last_became_peered":"2024-03-16T07:30:58.577593+0000","last_unstale":"2024-03-16T07:30:58.578536+0000","last_undegraded":"2024-03-16T07:30:58.578536+0000","last_fullsized":"2024-03-16T07:30:58.578536+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:27:03.691637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.13","version":"118'2","reported_seq":14,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.871940+0000","last_change":"2024-03-16T07:30:57.876973+0000","last_active":"2024-03-16T07:30:58.871940+0000","last_peered":"2024-03-16T07:30:58.871940+0000","last_clean":"2024-03-16T07:30:58.871940+0000","last_became_active":"2024-03-16T07:30:57.876549+0000","last_became_peered":"2024-03-16T07:30:57.876549+0000","last_unstale":"2024-03-16T07:30:58.871940+0000","last_undegraded":"2024-03-16T07:30:58.871940+0000","last_fullsized":"2024-03-16T07:30:58.871940+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_clean_scrub_stamp":"2024-03-16T07:30:56.855668+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:22:06.397991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.563107+0000","last_change":"2024-03-16T07:30:58.560202+0000","last_active":"2024-03-16T07:30:58.563107+0000","last_peered":"2024-03-16T07:30:58.563107+0000","last_clean":"2024-03-16T07:30:58.563107+0000","last_became_active":"2024-03-16T07:30:58.559912+0000","last_became_peered":"2024-03-16T07:30:58.559912+0000","last_unstale":"2024-03-16T07:30:58.563107+0000","last_undegraded":"2024-03-16T07:30:58.563107+0000","last_fullsized":"2024-03-16T07:30:58.563107+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:44:42.573710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":12,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.557777+0000","last_change":"2024-03-16T07:30:57.873985+0000","last_active":"2024-03-16T07:30:58.557777+0000","last_peered":"2024-03-16T07:30:58.557777+0000","last_clean":"2024-03-16T07:30:58.557777+0000","last_became_active":"2024-03-16T07:30:57.873398+0000","last_became_peered":"2024-03-16T07:30:57.873398+0000","last_unstale":"2024-03-16T07:30:58.557777+0000","last_undegraded":"2024-03-16T07:30:58.557777+0000","last_fullsized":"2024-03-16T07:30:58.557777+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_clean_scrub_stamp":"2024-03-16T07:30:56.855668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:46:10.971699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.575535+0000","last_change":"2024-03-16T07:30:58.573178+0000","last_active":"2024-03-16T07:30:58.575535+0000","last_peered":"2024-03-16T07:30:58.575535+0000","last_clean":"2024-03-16T07:30:58.575535+0000","last_became_active":"2024-03-16T07:30:58.571970+0000","last_became_peered":"2024-03-16T07:30:58.571970+0000","last_unstale":"2024-03-16T07:30:58.575535+0000","last_undegraded":"2024-03-16T07:30:58.575535+0000","last_fullsized":"2024-03-16T07:30:58.575535+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:34:17.392134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":12,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.553540+0000","last_change":"2024-03-16T07:30:57.876093+0000","last_active":"2024-03-16T07:30:58.553540+0000","last_peered":"2024-03-16T07:30:58.553540+0000","last_clean":"2024-03-16T07:30:58.553540+0000","last_became_active":"2024-03-16T07:30:57.875436+0000","last_became_peered":"2024-03-16T07:30:57.875436+0000","last_unstale":"2024-03-16T07:30:58.553540+0000","last_undegraded":"2024-03-16T07:30:58.553540+0000","last_fullsized":"2024-03-16T07:30:58.553540+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_clean_scrub_stamp":"2024-03-16T07:30:56.855668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:32:20.139876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.579403+0000","last_change":"2024-03-16T07:30:58.576156+0000","last_active":"2024-03-16T07:30:58.579403+0000","last_peered":"2024-03-16T07:30:58.579403+0000","last_clean":"2024-03-16T07:30:58.579403+0000","last_became_active":"2024-03-16T07:30:58.575849+0000","last_became_peered":"2024-03-16T07:30:58.575849+0000","last_unstale":"2024-03-16T07:30:58.579403+0000","last_undegraded":"2024-03-16T07:30:58.579403+0000","last_fullsized":"2024-03-16T07:30:58.579403+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:46:53.824339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.10","version":"118'8","reported_seq":20,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.873263+0000","last_change":"2024-03-16T07:30:57.879389+0000","last_active":"2024-03-16T07:30:58.873263+0000","last_peered":"2024-03-16T07:30:58.873263+0000","last_clean":"2024-03-16T07:30:58.873263+0000","last_became_active":"2024-03-16T07:30:57.879149+0000","last_became_peered":"2024-03-16T07:30:57.879149+0000","last_unstale":"2024-03-16T07:30:58.873263+0000","last_undegraded":"2024-03-16T07:30:58.873263+0000","last_fullsized":"2024-03-16T07:30:58.873263+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_clean_scrub_stamp":"2024-03-16T07:30:56.855668+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:55:45.100141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.568059+0000","last_change":"2024-03-16T07:30:58.566955+0000","last_active":"2024-03-16T07:30:58.568059+0000","last_peered":"2024-03-16T07:30:58.568059+0000","last_clean":"2024-03-16T07:30:58.568059+0000","last_became_active":"2024-03-16T07:30:58.563826+0000","last_became_peered":"2024-03-16T07:30:58.563826+0000","last_unstale":"2024-03-16T07:30:58.568059+0000","last_undegraded":"2024-03-16T07:30:58.568059+0000","last_fullsized":"2024-03-16T07:30:58.568059+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:30:50.425935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.f","version":"118'1","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.871750+0000","last_change":"2024-03-16T07:30:57.879349+0000","last_active":"2024-03-16T07:30:58.871750+0000","last_peered":"2024-03-16T07:30:58.871750+0000","last_clean":"2024-03-16T07:30:58.871750+0000","last_became_active":"2024-03-16T07:30:57.879060+0000","last_became_peered":"2024-03-16T07:30:57.879060+0000","last_unstale":"2024-03-16T07:30:58.871750+0000","last_undegraded":"2024-03-16T07:30:58.871750+0000","last_fullsized":"2024-03-16T07:30:58.871750+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_clean_scrub_stamp":"2024-03-16T07:30:56.855668+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:30:49.424989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.576844+0000","last_change":"2024-03-16T07:30:58.574600+0000","last_active":"2024-03-16T07:30:58.576844+0000","last_peered":"2024-03-16T07:30:58.576844+0000","last_clean":"2024-03-16T07:30:58.576844+0000","last_became_active":"2024-03-16T07:30:58.574152+0000","last_became_peered":"2024-03-16T07:30:58.574152+0000","last_unstale":"2024-03-16T07:30:58.576844+0000","last_undegraded":"2024-03-16T07:30:58.576844+0000","last_fullsized":"2024-03-16T07:30:58.576844+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:05:40.149740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"118'2","reported_seq":14,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.869689+0000","last_change":"2024-03-16T07:30:57.881691+0000","last_active":"2024-03-16T07:30:58.869689+0000","last_peered":"2024-03-16T07:30:58.869689+0000","last_clean":"2024-03-16T07:30:58.869689+0000","last_became_active":"2024-03-16T07:30:57.880871+0000","last_became_peered":"2024-03-16T07:30:57.880871+0000","last_unstale":"2024-03-16T07:30:58.869689+0000","last_undegraded":"2024-03-16T07:30:58.869689+0000","last_fullsized":"2024-03-16T07:30:58.869689+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_clean_scrub_stamp":"2024-03-16T07:30:56.855668+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:56:12.658295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.563461+0000","last_change":"2024-03-16T07:30:58.562180+0000","last_active":"2024-03-16T07:30:58.563461+0000","last_peered":"2024-03-16T07:30:58.563461+0000","last_clean":"2024-03-16T07:30:58.563461+0000","last_became_active":"2024-03-16T07:30:58.560416+0000","last_became_peered":"2024-03-16T07:30:58.560416+0000","last_unstale":"2024-03-16T07:30:58.563461+0000","last_undegraded":"2024-03-16T07:30:58.563461+0000","last_fullsized":"2024-03-16T07:30:58.563461+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:26:14.662551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.d","version":"118'1","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.869385+0000","last_change":"2024-03-16T07:30:57.878006+0000","last_active":"2024-03-16T07:30:58.869385+0000","last_peered":"2024-03-16T07:30:58.869385+0000","last_clean":"2024-03-16T07:30:58.869385+0000","last_became_active":"2024-03-16T07:30:57.877534+0000","last_became_peered":"2024-03-16T07:30:57.877534+0000","last_unstale":"2024-03-16T07:30:58.869385+0000","last_undegraded":"2024-03-16T07:30:58.869385+0000","last_fullsized":"2024-03-16T07:30:58.869385+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_clean_scrub_stamp":"2024-03-16T07:30:56.855668+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:00:45.799835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.563358+0000","last_change":"2024-03-16T07:30:58.562773+0000","last_active":"2024-03-16T07:30:58.563358+0000","last_peered":"2024-03-16T07:30:58.563358+0000","last_clean":"2024-03-16T07:30:58.563358+0000","last_became_active":"2024-03-16T07:30:58.562520+0000","last_became_peered":"2024-03-16T07:30:58.562520+0000","last_unstale":"2024-03-16T07:30:58.563358+0000","last_undegraded":"2024-03-16T07:30:58.563358+0000","last_fullsized":"2024-03-16T07:30:58.563358+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:32:37.973192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":12,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.553123+0000","last_change":"2024-03-16T07:30:57.877782+0000","last_active":"2024-03-16T07:30:58.553123+0000","last_peered":"2024-03-16T07:30:58.553123+0000","last_clean":"2024-03-16T07:30:58.553123+0000","last_became_active":"2024-03-16T07:30:57.876843+0000","last_became_peered":"2024-03-16T07:30:57.876843+0000","last_unstale":"2024-03-16T07:30:58.553123+0000","last_undegraded":"2024-03-16T07:30:58.553123+0000","last_fullsized":"2024-03-16T07:30:58.553123+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_clean_scrub_stamp":"2024-03-16T07:30:56.855668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:26:20.745771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.565603+0000","last_change":"2024-03-16T07:30:58.561355+0000","last_active":"2024-03-16T07:30:58.565603+0000","last_peered":"2024-03-16T07:30:58.565603+0000","last_clean":"2024-03-16T07:30:58.565603+0000","last_became_active":"2024-03-16T07:30:58.561123+0000","last_became_peered":"2024-03-16T07:30:58.561123+0000","last_unstale":"2024-03-16T07:30:58.565603+0000","last_undegraded":"2024-03-16T07:30:58.565603+0000","last_fullsized":"2024-03-16T07:30:58.565603+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:49:43.840977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.b","version":"118'2","reported_seq":14,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.871789+0000","last_change":"2024-03-16T07:30:57.876715+0000","last_active":"2024-03-16T07:30:58.871789+0000","last_peered":"2024-03-16T07:30:58.871789+0000","last_clean":"2024-03-16T07:30:58.871789+0000","last_became_active":"2024-03-16T07:30:57.876348+0000","last_became_peered":"2024-03-16T07:30:57.876348+0000","last_unstale":"2024-03-16T07:30:58.871789+0000","last_undegraded":"2024-03-16T07:30:58.871789+0000","last_fullsized":"2024-03-16T07:30:58.871789+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_clean_scrub_stamp":"2024-03-16T07:30:56.855668+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:59:13.050997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.565510+0000","last_change":"2024-03-16T07:30:58.561031+0000","last_active":"2024-03-16T07:30:58.565510+0000","last_peered":"2024-03-16T07:30:58.565510+0000","last_clean":"2024-03-16T07:30:58.565510+0000","last_became_active":"2024-03-16T07:30:58.560717+0000","last_became_peered":"2024-03-16T07:30:58.560717+0000","last_unstale":"2024-03-16T07:30:58.565510+0000","last_undegraded":"2024-03-16T07:30:58.565510+0000","last_fullsized":"2024-03-16T07:30:58.565510+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:43:10.162391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":12,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.566181+0000","last_change":"2024-03-16T07:30:57.876974+0000","last_active":"2024-03-16T07:30:58.566181+0000","last_peered":"2024-03-16T07:30:58.566181+0000","last_clean":"2024-03-16T07:30:58.566181+0000","last_became_active":"2024-03-16T07:30:57.876350+0000","last_became_peered":"2024-03-16T07:30:57.876350+0000","last_unstale":"2024-03-16T07:30:58.566181+0000","last_undegraded":"2024-03-16T07:30:58.566181+0000","last_fullsized":"2024-03-16T07:30:58.566181+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_clean_scrub_stamp":"2024-03-16T07:30:56.855668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:12:00.017490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.565679+0000","last_change":"2024-03-16T07:30:58.561986+0000","last_active":"2024-03-16T07:30:58.565679+0000","last_peered":"2024-03-16T07:30:58.565679+0000","last_clean":"2024-03-16T07:30:58.565679+0000","last_became_active":"2024-03-16T07:30:58.561661+0000","last_became_peered":"2024-03-16T07:30:58.561661+0000","last_unstale":"2024-03-16T07:30:58.565679+0000","last_undegraded":"2024-03-16T07:30:58.565679+0000","last_fullsized":"2024-03-16T07:30:58.565679+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:51:34.702543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":12,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.566754+0000","last_change":"2024-03-16T07:30:57.880017+0000","last_active":"2024-03-16T07:30:58.566754+0000","last_peered":"2024-03-16T07:30:58.566754+0000","last_clean":"2024-03-16T07:30:58.566754+0000","last_became_active":"2024-03-16T07:30:57.879752+0000","last_became_peered":"2024-03-16T07:30:57.879752+0000","last_unstale":"2024-03-16T07:30:58.566754+0000","last_undegraded":"2024-03-16T07:30:58.566754+0000","last_fullsized":"2024-03-16T07:30:58.566754+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_clean_scrub_stamp":"2024-03-16T07:30:56.855668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:02:33.202240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.569162+0000","last_change":"2024-03-16T07:30:58.566963+0000","last_active":"2024-03-16T07:30:58.569162+0000","last_peered":"2024-03-16T07:30:58.569162+0000","last_clean":"2024-03-16T07:30:58.569162+0000","last_became_active":"2024-03-16T07:30:58.566661+0000","last_became_peered":"2024-03-16T07:30:58.566661+0000","last_unstale":"2024-03-16T07:30:58.569162+0000","last_undegraded":"2024-03-16T07:30:58.569162+0000","last_fullsized":"2024-03-16T07:30:58.569162+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:01:42.242569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":12,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.565267+0000","last_change":"2024-03-16T07:30:57.881392+0000","last_active":"2024-03-16T07:30:58.565267+0000","last_peered":"2024-03-16T07:30:58.565267+0000","last_clean":"2024-03-16T07:30:58.565267+0000","last_became_active":"2024-03-16T07:30:57.881148+0000","last_became_peered":"2024-03-16T07:30:57.881148+0000","last_unstale":"2024-03-16T07:30:58.565267+0000","last_undegraded":"2024-03-16T07:30:58.565267+0000","last_fullsized":"2024-03-16T07:30:58.565267+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_clean_scrub_stamp":"2024-03-16T07:30:56.855668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:37:55.898841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.579499+0000","last_change":"2024-03-16T07:30:58.576511+0000","last_active":"2024-03-16T07:30:58.579499+0000","last_peered":"2024-03-16T07:30:58.579499+0000","last_clean":"2024-03-16T07:30:58.579499+0000","last_became_active":"2024-03-16T07:30:58.576275+0000","last_became_peered":"2024-03-16T07:30:58.576275+0000","last_unstale":"2024-03-16T07:30:58.579499+0000","last_undegraded":"2024-03-16T07:30:58.579499+0000","last_fullsized":"2024-03-16T07:30:58.579499+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:48:25.008750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.7","version":"118'2","reported_seq":14,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.870144+0000","last_change":"2024-03-16T07:30:57.876924+0000","last_active":"2024-03-16T07:30:58.870144+0000","last_peered":"2024-03-16T07:30:58.870144+0000","last_clean":"2024-03-16T07:30:58.870144+0000","last_became_active":"2024-03-16T07:30:57.876507+0000","last_became_peered":"2024-03-16T07:30:57.876507+0000","last_unstale":"2024-03-16T07:30:58.870144+0000","last_undegraded":"2024-03-16T07:30:58.870144+0000","last_fullsized":"2024-03-16T07:30:58.870144+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_clean_scrub_stamp":"2024-03-16T07:30:56.855668+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:09:54.480497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.576862+0000","last_change":"2024-03-16T07:30:58.574706+0000","last_active":"2024-03-16T07:30:58.576862+0000","last_peered":"2024-03-16T07:30:58.576862+0000","last_clean":"2024-03-16T07:30:58.576862+0000","last_became_active":"2024-03-16T07:30:58.574447+0000","last_became_peered":"2024-03-16T07:30:58.574447+0000","last_unstale":"2024-03-16T07:30:58.576862+0000","last_undegraded":"2024-03-16T07:30:58.576862+0000","last_fullsized":"2024-03-16T07:30:58.576862+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:22:16.305364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":12,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.554958+0000","last_change":"2024-03-16T07:30:57.883769+0000","last_active":"2024-03-16T07:30:58.554958+0000","last_peered":"2024-03-16T07:30:58.554958+0000","last_clean":"2024-03-16T07:30:58.554958+0000","last_became_active":"2024-03-16T07:30:57.881218+0000","last_became_peered":"2024-03-16T07:30:57.881218+0000","last_unstale":"2024-03-16T07:30:58.554958+0000","last_undegraded":"2024-03-16T07:30:58.554958+0000","last_fullsized":"2024-03-16T07:30:58.554958+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_clean_scrub_stamp":"2024-03-16T07:30:56.855668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:56:31.528403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.563541+0000","last_change":"2024-03-16T07:30:58.562495+0000","last_active":"2024-03-16T07:30:58.563541+0000","last_peered":"2024-03-16T07:30:58.563541+0000","last_clean":"2024-03-16T07:30:58.563541+0000","last_became_active":"2024-03-16T07:30:58.562227+0000","last_became_peered":"2024-03-16T07:30:58.562227+0000","last_unstale":"2024-03-16T07:30:58.563541+0000","last_undegraded":"2024-03-16T07:30:58.563541+0000","last_fullsized":"2024-03-16T07:30:58.563541+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:55:46.101087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":12,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.553894+0000","last_change":"2024-03-16T07:30:57.875030+0000","last_active":"2024-03-16T07:30:58.553894+0000","last_peered":"2024-03-16T07:30:58.553894+0000","last_clean":"2024-03-16T07:30:58.553894+0000","last_became_active":"2024-03-16T07:30:57.874778+0000","last_became_peered":"2024-03-16T07:30:57.874778+0000","last_unstale":"2024-03-16T07:30:58.553894+0000","last_undegraded":"2024-03-16T07:30:58.553894+0000","last_fullsized":"2024-03-16T07:30:58.553894+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_clean_scrub_stamp":"2024-03-16T07:30:56.855668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:21:12.260369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.569920+0000","last_change":"2024-03-16T07:30:58.568858+0000","last_active":"2024-03-16T07:30:58.569920+0000","last_peered":"2024-03-16T07:30:58.569920+0000","last_clean":"2024-03-16T07:30:58.569920+0000","last_became_active":"2024-03-16T07:30:58.568307+0000","last_became_peered":"2024-03-16T07:30:58.568307+0000","last_unstale":"2024-03-16T07:30:58.569920+0000","last_undegraded":"2024-03-16T07:30:58.569920+0000","last_fullsized":"2024-03-16T07:30:58.569920+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:09:55.481444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":12,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.553497+0000","last_change":"2024-03-16T07:30:57.877529+0000","last_active":"2024-03-16T07:30:58.553497+0000","last_peered":"2024-03-16T07:30:58.553497+0000","last_clean":"2024-03-16T07:30:58.553497+0000","last_became_active":"2024-03-16T07:30:57.876528+0000","last_became_peered":"2024-03-16T07:30:57.876528+0000","last_unstale":"2024-03-16T07:30:58.553497+0000","last_undegraded":"2024-03-16T07:30:58.553497+0000","last_fullsized":"2024-03-16T07:30:58.553497+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_clean_scrub_stamp":"2024-03-16T07:30:56.855668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:21:55.125566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.578555+0000","last_change":"2024-03-16T07:30:58.577875+0000","last_active":"2024-03-16T07:30:58.578555+0000","last_peered":"2024-03-16T07:30:58.578555+0000","last_clean":"2024-03-16T07:30:58.578555+0000","last_became_active":"2024-03-16T07:30:58.577623+0000","last_became_peered":"2024-03-16T07:30:58.577623+0000","last_unstale":"2024-03-16T07:30:58.578555+0000","last_undegraded":"2024-03-16T07:30:58.578555+0000","last_fullsized":"2024-03-16T07:30:58.578555+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:31:58.669992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":12,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.557103+0000","last_change":"2024-03-16T07:30:57.875740+0000","last_active":"2024-03-16T07:30:58.557103+0000","last_peered":"2024-03-16T07:30:58.557103+0000","last_clean":"2024-03-16T07:30:58.557103+0000","last_became_active":"2024-03-16T07:30:57.875469+0000","last_became_peered":"2024-03-16T07:30:57.875469+0000","last_unstale":"2024-03-16T07:30:58.557103+0000","last_undegraded":"2024-03-16T07:30:58.557103+0000","last_fullsized":"2024-03-16T07:30:58.557103+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_clean_scrub_stamp":"2024-03-16T07:30:56.855668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:19:36.033244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.578600+0000","last_change":"2024-03-16T07:30:58.577788+0000","last_active":"2024-03-16T07:30:58.578600+0000","last_peered":"2024-03-16T07:30:58.578600+0000","last_clean":"2024-03-16T07:30:58.578600+0000","last_became_active":"2024-03-16T07:30:58.577528+0000","last_became_peered":"2024-03-16T07:30:58.577528+0000","last_unstale":"2024-03-16T07:30:58.578600+0000","last_undegraded":"2024-03-16T07:30:58.578600+0000","last_fullsized":"2024-03-16T07:30:58.578600+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:37:16.741567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":12,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.557777+0000","last_change":"2024-03-16T07:30:57.874192+0000","last_active":"2024-03-16T07:30:58.557777+0000","last_peered":"2024-03-16T07:30:58.557777+0000","last_clean":"2024-03-16T07:30:58.557777+0000","last_became_active":"2024-03-16T07:30:57.873741+0000","last_became_peered":"2024-03-16T07:30:57.873741+0000","last_unstale":"2024-03-16T07:30:58.557777+0000","last_undegraded":"2024-03-16T07:30:58.557777+0000","last_fullsized":"2024-03-16T07:30:58.557777+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_clean_scrub_stamp":"2024-03-16T07:30:56.855668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:45:10.776890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.576010+0000","last_change":"2024-03-16T07:30:58.573475+0000","last_active":"2024-03-16T07:30:58.576010+0000","last_peered":"2024-03-16T07:30:58.576010+0000","last_clean":"2024-03-16T07:30:58.576010+0000","last_became_active":"2024-03-16T07:30:58.572303+0000","last_became_peered":"2024-03-16T07:30:58.572303+0000","last_unstale":"2024-03-16T07:30:58.576010+0000","last_undegraded":"2024-03-16T07:30:58.576010+0000","last_fullsized":"2024-03-16T07:30:58.576010+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:06:50.154852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":12,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.557054+0000","last_change":"2024-03-16T07:30:57.875574+0000","last_active":"2024-03-16T07:30:58.557054+0000","last_peered":"2024-03-16T07:30:58.557054+0000","last_clean":"2024-03-16T07:30:58.557054+0000","last_became_active":"2024-03-16T07:30:57.875325+0000","last_became_peered":"2024-03-16T07:30:57.875325+0000","last_unstale":"2024-03-16T07:30:58.557054+0000","last_undegraded":"2024-03-16T07:30:58.557054+0000","last_fullsized":"2024-03-16T07:30:58.557054+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_clean_scrub_stamp":"2024-03-16T07:30:56.855668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:18:36.802383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.566822+0000","last_change":"2024-03-16T07:30:58.564067+0000","last_active":"2024-03-16T07:30:58.566822+0000","last_peered":"2024-03-16T07:30:58.566822+0000","last_clean":"2024-03-16T07:30:58.566822+0000","last_became_active":"2024-03-16T07:30:58.563838+0000","last_became_peered":"2024-03-16T07:30:58.563838+0000","last_unstale":"2024-03-16T07:30:58.566822+0000","last_undegraded":"2024-03-16T07:30:58.566822+0000","last_fullsized":"2024-03-16T07:30:58.566822+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:51:01.471752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":12,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.565404+0000","last_change":"2024-03-16T07:30:57.883190+0000","last_active":"2024-03-16T07:30:58.565404+0000","last_peered":"2024-03-16T07:30:58.565404+0000","last_clean":"2024-03-16T07:30:58.565404+0000","last_became_active":"2024-03-16T07:30:57.882925+0000","last_became_peered":"2024-03-16T07:30:57.882925+0000","last_unstale":"2024-03-16T07:30:58.565404+0000","last_undegraded":"2024-03-16T07:30:58.565404+0000","last_fullsized":"2024-03-16T07:30:58.565404+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_clean_scrub_stamp":"2024-03-16T07:30:56.855668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:06:50.998240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.565675+0000","last_change":"2024-03-16T07:30:58.561416+0000","last_active":"2024-03-16T07:30:58.565675+0000","last_peered":"2024-03-16T07:30:58.565675+0000","last_clean":"2024-03-16T07:30:58.565675+0000","last_became_active":"2024-03-16T07:30:58.561163+0000","last_became_peered":"2024-03-16T07:30:58.561163+0000","last_unstale":"2024-03-16T07:30:58.565675+0000","last_undegraded":"2024-03-16T07:30:58.565675+0000","last_fullsized":"2024-03-16T07:30:58.565675+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:31:32.097584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.15","version":"118'3","reported_seq":15,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.871634+0000","last_change":"2024-03-16T07:30:57.875401+0000","last_active":"2024-03-16T07:30:58.871634+0000","last_peered":"2024-03-16T07:30:58.871634+0000","last_clean":"2024-03-16T07:30:58.871634+0000","last_became_active":"2024-03-16T07:30:57.875032+0000","last_became_peered":"2024-03-16T07:30:57.875032+0000","last_unstale":"2024-03-16T07:30:58.871634+0000","last_undegraded":"2024-03-16T07:30:58.871634+0000","last_fullsized":"2024-03-16T07:30:58.871634+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_clean_scrub_stamp":"2024-03-16T07:30:56.855668+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:39:09.736811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"103'174","reported_seq":612,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.553582+0000","last_change":"2024-03-16T07:24:31.650537+0000","last_active":"2024-03-16T07:30:58.553582+0000","last_peered":"2024-03-16T07:30:58.553582+0000","last_clean":"2024-03-16T07:30:58.553582+0000","last_became_active":"2024-03-16T07:24:31.649574+0000","last_became_peered":"2024-03-16T07:24:31.649574+0000","last_unstale":"2024-03-16T07:30:58.553582+0000","last_undegraded":"2024-03-16T07:30:58.553582+0000","last_fullsized":"2024-03-16T07:30:58.553582+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:29.719970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:29.719970+0000","last_clean_scrub_stamp":"2024-03-16T07:24:29.719970+0000","objects_scrubbed":0,"log_size":174,"log_dups_size":0,"ondisk_log_size":174,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:31:35.774554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":778,"num_read_kb":1533,"num_write":277,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":20,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":778,"num_read_kb":1533,"num_write":277,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":174,"ondisk_log_size":174,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738444,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":36516,"kb_used_data":1172,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":104821084,"statfs":{"total":107374182400,"available":107336790016,"internally_reserved":0,"allocated":1200128,"data_stored":485773,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738444,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":37096,"kb_used_data":1752,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":104820504,"statfs":{"total":107374182400,"available":107336196096,"internally_reserved":0,"allocated":1794048,"data_stored":1076141,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738444,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":37096,"kb_used_data":1752,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":104820504,"statfs":{"total":107374182400,"available":107336196096,"internally_reserved":0,"allocated":1794048,"data_stored":1076141,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2286,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-16T07:31:01.885 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-16T07:31:02.231 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:31:02.232 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2024-03-16T07:31:02.243 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":33,"stamp":"2024-03-16T07:31:00.888499+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":778,"num_read_kb":1533,"num_write":321,"num_write_kb":1908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":212,"ondisk_log_size":212,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":58,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":314572800,"kb_used":110708,"kb_used_data":4676,"kb_used_omap":4,"kb_used_meta":105979,"kb_avail":314462092,"statfs":{"total":322122547200,"available":322009182208,"internally_reserved":0,"allocated":4788224,"data_stored":2638055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":108522831},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.031791"},"pg_stats":[{"pgid":"21.3f","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.572853+0000","last_change":"2024-03-16T07:30:58.571155+0000","last_active":"2024-03-16T07:30:58.572853+0000","last_peered":"2024-03-16T07:30:58.572853+0000","last_clean":"2024-03-16T07:30:58.572853+0000","last_became_active":"2024-03-16T07:30:58.570907+0000","last_became_peered":"2024-03-16T07:30:58.570907+0000","last_unstale":"2024-03-16T07:30:58.572853+0000","last_undegraded":"2024-03-16T07:30:58.572853+0000","last_fullsized":"2024-03-16T07:30:58.572853+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:10:16.259637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.569142+0000","last_change":"2024-03-16T07:30:58.567565+0000","last_active":"2024-03-16T07:30:58.569142+0000","last_peered":"2024-03-16T07:30:58.569142+0000","last_clean":"2024-03-16T07:30:58.569142+0000","last_became_active":"2024-03-16T07:30:58.567322+0000","last_became_peered":"2024-03-16T07:30:58.567322+0000","last_unstale":"2024-03-16T07:30:58.569142+0000","last_undegraded":"2024-03-16T07:30:58.569142+0000","last_fullsized":"2024-03-16T07:30:58.569142+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:42:30.823514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.566233+0000","last_change":"2024-03-16T07:30:58.563537+0000","last_active":"2024-03-16T07:30:58.566233+0000","last_peered":"2024-03-16T07:30:58.566233+0000","last_clean":"2024-03-16T07:30:58.566233+0000","last_became_active":"2024-03-16T07:30:58.562673+0000","last_became_peered":"2024-03-16T07:30:58.562673+0000","last_unstale":"2024-03-16T07:30:58.566233+0000","last_undegraded":"2024-03-16T07:30:58.566233+0000","last_fullsized":"2024-03-16T07:30:58.566233+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:02:34.203186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3c","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.575540+0000","last_change":"2024-03-16T07:30:58.572946+0000","last_active":"2024-03-16T07:30:58.575540+0000","last_peered":"2024-03-16T07:30:58.575540+0000","last_clean":"2024-03-16T07:30:58.575540+0000","last_became_active":"2024-03-16T07:30:58.572626+0000","last_became_peered":"2024-03-16T07:30:58.572626+0000","last_unstale":"2024-03-16T07:30:58.575540+0000","last_undegraded":"2024-03-16T07:30:58.575540+0000","last_fullsized":"2024-03-16T07:30:58.575540+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:57:16.989944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.3b","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.572857+0000","last_change":"2024-03-16T07:30:58.571437+0000","last_active":"2024-03-16T07:30:58.572857+0000","last_peered":"2024-03-16T07:30:58.572857+0000","last_clean":"2024-03-16T07:30:58.572857+0000","last_became_active":"2024-03-16T07:30:58.571200+0000","last_became_peered":"2024-03-16T07:30:58.571200+0000","last_unstale":"2024-03-16T07:30:58.572857+0000","last_undegraded":"2024-03-16T07:30:58.572857+0000","last_fullsized":"2024-03-16T07:30:58.572857+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:25:37.976273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3a","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.571462+0000","last_change":"2024-03-16T07:30:58.570783+0000","last_active":"2024-03-16T07:30:58.571462+0000","last_peered":"2024-03-16T07:30:58.571462+0000","last_clean":"2024-03-16T07:30:58.571462+0000","last_became_active":"2024-03-16T07:30:58.570527+0000","last_became_peered":"2024-03-16T07:30:58.570527+0000","last_unstale":"2024-03-16T07:30:58.571462+0000","last_undegraded":"2024-03-16T07:30:58.571462+0000","last_fullsized":"2024-03-16T07:30:58.571462+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:06:50.154852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.574503+0000","last_change":"2024-03-16T07:30:58.572802+0000","last_active":"2024-03-16T07:30:58.574503+0000","last_peered":"2024-03-16T07:30:58.574503+0000","last_clean":"2024-03-16T07:30:58.574503+0000","last_became_active":"2024-03-16T07:30:58.572430+0000","last_became_peered":"2024-03-16T07:30:58.572430+0000","last_unstale":"2024-03-16T07:30:58.574503+0000","last_undegraded":"2024-03-16T07:30:58.574503+0000","last_fullsized":"2024-03-16T07:30:58.574503+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:37:36.499442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.566984+0000","last_change":"2024-03-16T07:30:58.563881+0000","last_active":"2024-03-16T07:30:58.566984+0000","last_peered":"2024-03-16T07:30:58.566984+0000","last_clean":"2024-03-16T07:30:58.566984+0000","last_became_active":"2024-03-16T07:30:58.563112+0000","last_became_peered":"2024-03-16T07:30:58.563112+0000","last_unstale":"2024-03-16T07:30:58.566984+0000","last_undegraded":"2024-03-16T07:30:58.566984+0000","last_fullsized":"2024-03-16T07:30:58.566984+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:05:22.872331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.572127+0000","last_change":"2024-03-16T07:30:58.571043+0000","last_active":"2024-03-16T07:30:58.572127+0000","last_peered":"2024-03-16T07:30:58.572127+0000","last_clean":"2024-03-16T07:30:58.572127+0000","last_became_active":"2024-03-16T07:30:58.570796+0000","last_became_peered":"2024-03-16T07:30:58.570796+0000","last_unstale":"2024-03-16T07:30:58.572127+0000","last_undegraded":"2024-03-16T07:30:58.572127+0000","last_fullsized":"2024-03-16T07:30:58.572127+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:47:42.860318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.564965+0000","last_change":"2024-03-16T07:30:58.563510+0000","last_active":"2024-03-16T07:30:58.564965+0000","last_peered":"2024-03-16T07:30:58.564965+0000","last_clean":"2024-03-16T07:30:58.564965+0000","last_became_active":"2024-03-16T07:30:58.563192+0000","last_became_peered":"2024-03-16T07:30:58.563192+0000","last_unstale":"2024-03-16T07:30:58.564965+0000","last_undegraded":"2024-03-16T07:30:58.564965+0000","last_fullsized":"2024-03-16T07:30:58.564965+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:12:01.018436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.570465+0000","last_change":"2024-03-16T07:30:58.569050+0000","last_active":"2024-03-16T07:30:58.570465+0000","last_peered":"2024-03-16T07:30:58.570465+0000","last_clean":"2024-03-16T07:30:58.570465+0000","last_became_active":"2024-03-16T07:30:58.568635+0000","last_became_peered":"2024-03-16T07:30:58.568635+0000","last_unstale":"2024-03-16T07:30:58.570465+0000","last_undegraded":"2024-03-16T07:30:58.570465+0000","last_fullsized":"2024-03-16T07:30:58.570465+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:57:16.989944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.34","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.574598+0000","last_change":"2024-03-16T07:30:58.572517+0000","last_active":"2024-03-16T07:30:58.574598+0000","last_peered":"2024-03-16T07:30:58.574598+0000","last_clean":"2024-03-16T07:30:58.574598+0000","last_became_active":"2024-03-16T07:30:58.570337+0000","last_became_peered":"2024-03-16T07:30:58.570337+0000","last_unstale":"2024-03-16T07:30:58.574598+0000","last_undegraded":"2024-03-16T07:30:58.574598+0000","last_fullsized":"2024-03-16T07:30:58.574598+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:24:48.479190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.33","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.572834+0000","last_change":"2024-03-16T07:30:58.571283+0000","last_active":"2024-03-16T07:30:58.572834+0000","last_peered":"2024-03-16T07:30:58.572834+0000","last_clean":"2024-03-16T07:30:58.572834+0000","last_became_active":"2024-03-16T07:30:58.570972+0000","last_became_peered":"2024-03-16T07:30:58.570972+0000","last_unstale":"2024-03-16T07:30:58.572834+0000","last_undegraded":"2024-03-16T07:30:58.572834+0000","last_fullsized":"2024-03-16T07:30:58.572834+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:31:06.763042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.575365+0000","last_change":"2024-03-16T07:30:58.574666+0000","last_active":"2024-03-16T07:30:58.575365+0000","last_peered":"2024-03-16T07:30:58.575365+0000","last_clean":"2024-03-16T07:30:58.575365+0000","last_became_active":"2024-03-16T07:30:58.573873+0000","last_became_peered":"2024-03-16T07:30:58.573873+0000","last_unstale":"2024-03-16T07:30:58.575365+0000","last_undegraded":"2024-03-16T07:30:58.575365+0000","last_fullsized":"2024-03-16T07:30:58.575365+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:15:16.124364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.571796+0000","last_change":"2024-03-16T07:30:58.570258+0000","last_active":"2024-03-16T07:30:58.571796+0000","last_peered":"2024-03-16T07:30:58.571796+0000","last_clean":"2024-03-16T07:30:58.571796+0000","last_became_active":"2024-03-16T07:30:58.570020+0000","last_became_peered":"2024-03-16T07:30:58.570020+0000","last_unstale":"2024-03-16T07:30:58.571796+0000","last_undegraded":"2024-03-16T07:30:58.571796+0000","last_fullsized":"2024-03-16T07:30:58.571796+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:34:17.392134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.30","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.576334+0000","last_change":"2024-03-16T07:30:58.574365+0000","last_active":"2024-03-16T07:30:58.576334+0000","last_peered":"2024-03-16T07:30:58.576334+0000","last_clean":"2024-03-16T07:30:58.576334+0000","last_became_active":"2024-03-16T07:30:58.574133+0000","last_became_peered":"2024-03-16T07:30:58.574133+0000","last_unstale":"2024-03-16T07:30:58.576334+0000","last_undegraded":"2024-03-16T07:30:58.576334+0000","last_fullsized":"2024-03-16T07:30:58.576334+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:31:06.763042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.578097+0000","last_change":"2024-03-16T07:30:58.576696+0000","last_active":"2024-03-16T07:30:58.578097+0000","last_peered":"2024-03-16T07:30:58.578097+0000","last_clean":"2024-03-16T07:30:58.578097+0000","last_became_active":"2024-03-16T07:30:58.576438+0000","last_became_peered":"2024-03-16T07:30:58.576438+0000","last_unstale":"2024-03-16T07:30:58.578097+0000","last_undegraded":"2024-03-16T07:30:58.578097+0000","last_fullsized":"2024-03-16T07:30:58.578097+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:12:28.497074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.573265+0000","last_change":"2024-03-16T07:30:58.572031+0000","last_active":"2024-03-16T07:30:58.573265+0000","last_peered":"2024-03-16T07:30:58.573265+0000","last_clean":"2024-03-16T07:30:58.573265+0000","last_became_active":"2024-03-16T07:30:58.571663+0000","last_became_peered":"2024-03-16T07:30:58.571663+0000","last_unstale":"2024-03-16T07:30:58.573265+0000","last_undegraded":"2024-03-16T07:30:58.573265+0000","last_fullsized":"2024-03-16T07:30:58.573265+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:21:45.921916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2d","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.571000+0000","last_change":"2024-03-16T07:30:58.569822+0000","last_active":"2024-03-16T07:30:58.571000+0000","last_peered":"2024-03-16T07:30:58.571000+0000","last_clean":"2024-03-16T07:30:58.571000+0000","last_became_active":"2024-03-16T07:30:58.569585+0000","last_became_peered":"2024-03-16T07:30:58.569585+0000","last_unstale":"2024-03-16T07:30:58.571000+0000","last_undegraded":"2024-03-16T07:30:58.571000+0000","last_fullsized":"2024-03-16T07:30:58.571000+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:15:58.196193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.576055+0000","last_change":"2024-03-16T07:30:58.573838+0000","last_active":"2024-03-16T07:30:58.576055+0000","last_peered":"2024-03-16T07:30:58.576055+0000","last_clean":"2024-03-16T07:30:58.576055+0000","last_became_active":"2024-03-16T07:30:58.573583+0000","last_became_peered":"2024-03-16T07:30:58.573583+0000","last_unstale":"2024-03-16T07:30:58.576055+0000","last_undegraded":"2024-03-16T07:30:58.576055+0000","last_fullsized":"2024-03-16T07:30:58.576055+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:47:42.860318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2b","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.577034+0000","last_change":"2024-03-16T07:30:58.576167+0000","last_active":"2024-03-16T07:30:58.577034+0000","last_peered":"2024-03-16T07:30:58.577034+0000","last_clean":"2024-03-16T07:30:58.577034+0000","last_became_active":"2024-03-16T07:30:58.575924+0000","last_became_peered":"2024-03-16T07:30:58.575924+0000","last_unstale":"2024-03-16T07:30:58.577034+0000","last_undegraded":"2024-03-16T07:30:58.577034+0000","last_fullsized":"2024-03-16T07:30:58.577034+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:30:06.769142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.575350+0000","last_change":"2024-03-16T07:30:58.574457+0000","last_active":"2024-03-16T07:30:58.575350+0000","last_peered":"2024-03-16T07:30:58.575350+0000","last_clean":"2024-03-16T07:30:58.575350+0000","last_became_active":"2024-03-16T07:30:58.573573+0000","last_became_peered":"2024-03-16T07:30:58.573573+0000","last_unstale":"2024-03-16T07:30:58.575350+0000","last_undegraded":"2024-03-16T07:30:58.575350+0000","last_fullsized":"2024-03-16T07:30:58.575350+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:28:15.356904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.579382+0000","last_change":"2024-03-16T07:30:58.575945+0000","last_active":"2024-03-16T07:30:58.579382+0000","last_peered":"2024-03-16T07:30:58.579382+0000","last_clean":"2024-03-16T07:30:58.579382+0000","last_became_active":"2024-03-16T07:30:58.575414+0000","last_became_peered":"2024-03-16T07:30:58.575414+0000","last_unstale":"2024-03-16T07:30:58.579382+0000","last_undegraded":"2024-03-16T07:30:58.579382+0000","last_fullsized":"2024-03-16T07:30:58.579382+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:23:09.206123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.566963+0000","last_change":"2024-03-16T07:30:58.563542+0000","last_active":"2024-03-16T07:30:58.566963+0000","last_peered":"2024-03-16T07:30:58.566963+0000","last_clean":"2024-03-16T07:30:58.566963+0000","last_became_active":"2024-03-16T07:30:58.562883+0000","last_became_peered":"2024-03-16T07:30:58.562883+0000","last_unstale":"2024-03-16T07:30:58.566963+0000","last_undegraded":"2024-03-16T07:30:58.566963+0000","last_fullsized":"2024-03-16T07:30:58.566963+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:58:08.000301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.576825+0000","last_change":"2024-03-16T07:30:58.574409+0000","last_active":"2024-03-16T07:30:58.576825+0000","last_peered":"2024-03-16T07:30:58.576825+0000","last_clean":"2024-03-16T07:30:58.576825+0000","last_became_active":"2024-03-16T07:30:58.573829+0000","last_became_peered":"2024-03-16T07:30:58.573829+0000","last_unstale":"2024-03-16T07:30:58.576825+0000","last_undegraded":"2024-03-16T07:30:58.576825+0000","last_fullsized":"2024-03-16T07:30:58.576825+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:25:37.976273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.573249+0000","last_change":"2024-03-16T07:30:58.571970+0000","last_active":"2024-03-16T07:30:58.573249+0000","last_peered":"2024-03-16T07:30:58.573249+0000","last_clean":"2024-03-16T07:30:58.573249+0000","last_became_active":"2024-03-16T07:30:58.571516+0000","last_became_peered":"2024-03-16T07:30:58.571516+0000","last_unstale":"2024-03-16T07:30:58.573249+0000","last_undegraded":"2024-03-16T07:30:58.573249+0000","last_fullsized":"2024-03-16T07:30:58.573249+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:22:16.305364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.576350+0000","last_change":"2024-03-16T07:30:58.575126+0000","last_active":"2024-03-16T07:30:58.576350+0000","last_peered":"2024-03-16T07:30:58.576350+0000","last_clean":"2024-03-16T07:30:58.576350+0000","last_became_active":"2024-03-16T07:30:58.574934+0000","last_became_peered":"2024-03-16T07:30:58.574934+0000","last_unstale":"2024-03-16T07:30:58.576350+0000","last_undegraded":"2024-03-16T07:30:58.576350+0000","last_fullsized":"2024-03-16T07:30:58.576350+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:21:45.921916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.574575+0000","last_change":"2024-03-16T07:30:58.572025+0000","last_active":"2024-03-16T07:30:58.574575+0000","last_peered":"2024-03-16T07:30:58.574575+0000","last_clean":"2024-03-16T07:30:58.574575+0000","last_became_active":"2024-03-16T07:30:58.569977+0000","last_became_peered":"2024-03-16T07:30:58.569977+0000","last_unstale":"2024-03-16T07:30:58.574575+0000","last_undegraded":"2024-03-16T07:30:58.574575+0000","last_fullsized":"2024-03-16T07:30:58.574575+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:52:29.384844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.563399+0000","last_change":"2024-03-16T07:30:58.560398+0000","last_active":"2024-03-16T07:30:58.563399+0000","last_peered":"2024-03-16T07:30:58.563399+0000","last_clean":"2024-03-16T07:30:58.563399+0000","last_became_active":"2024-03-16T07:30:58.560136+0000","last_became_peered":"2024-03-16T07:30:58.560136+0000","last_unstale":"2024-03-16T07:30:58.563399+0000","last_undegraded":"2024-03-16T07:30:58.563399+0000","last_fullsized":"2024-03-16T07:30:58.563399+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:37:56.899787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.566071+0000","last_change":"2024-03-16T07:30:58.564792+0000","last_active":"2024-03-16T07:30:58.566071+0000","last_peered":"2024-03-16T07:30:58.566071+0000","last_clean":"2024-03-16T07:30:58.566071+0000","last_became_active":"2024-03-16T07:30:58.564542+0000","last_became_peered":"2024-03-16T07:30:58.564542+0000","last_unstale":"2024-03-16T07:30:58.566071+0000","last_undegraded":"2024-03-16T07:30:58.566071+0000","last_fullsized":"2024-03-16T07:30:58.566071+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:01:00.056073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.566804+0000","last_change":"2024-03-16T07:30:58.562033+0000","last_active":"2024-03-16T07:30:58.566804+0000","last_peered":"2024-03-16T07:30:58.566804+0000","last_clean":"2024-03-16T07:30:58.566804+0000","last_became_active":"2024-03-16T07:30:58.561807+0000","last_became_peered":"2024-03-16T07:30:58.561807+0000","last_unstale":"2024-03-16T07:30:58.566804+0000","last_undegraded":"2024-03-16T07:30:58.566804+0000","last_fullsized":"2024-03-16T07:30:58.566804+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:19:04.077741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.576368+0000","last_change":"2024-03-16T07:30:58.575428+0000","last_active":"2024-03-16T07:30:58.576368+0000","last_peered":"2024-03-16T07:30:58.576368+0000","last_clean":"2024-03-16T07:30:58.576368+0000","last_became_active":"2024-03-16T07:30:58.575207+0000","last_became_peered":"2024-03-16T07:30:58.575207+0000","last_unstale":"2024-03-16T07:30:58.576368+0000","last_undegraded":"2024-03-16T07:30:58.576368+0000","last_fullsized":"2024-03-16T07:30:58.576368+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:50:38.987166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.573228+0000","last_change":"2024-03-16T07:30:58.571761+0000","last_active":"2024-03-16T07:30:58.573228+0000","last_peered":"2024-03-16T07:30:58.573228+0000","last_clean":"2024-03-16T07:30:58.573228+0000","last_became_active":"2024-03-16T07:30:58.570852+0000","last_became_peered":"2024-03-16T07:30:58.570852+0000","last_unstale":"2024-03-16T07:30:58.573228+0000","last_undegraded":"2024-03-16T07:30:58.573228+0000","last_fullsized":"2024-03-16T07:30:58.573228+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:05:40.149740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1f","version":"118'4","reported_seq":16,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.870834+0000","last_change":"2024-03-16T07:30:57.875122+0000","last_active":"2024-03-16T07:30:58.870834+0000","last_peered":"2024-03-16T07:30:58.870834+0000","last_clean":"2024-03-16T07:30:58.870834+0000","last_became_active":"2024-03-16T07:30:57.874848+0000","last_became_peered":"2024-03-16T07:30:57.874848+0000","last_unstale":"2024-03-16T07:30:58.870834+0000","last_undegraded":"2024-03-16T07:30:58.870834+0000","last_fullsized":"2024-03-16T07:30:58.870834+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_clean_scrub_stamp":"2024-03-16T07:30:56.855668+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:27:04.801331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.578114+0000","last_change":"2024-03-16T07:30:58.576923+0000","last_active":"2024-03-16T07:30:58.578114+0000","last_peered":"2024-03-16T07:30:58.578114+0000","last_clean":"2024-03-16T07:30:58.578114+0000","last_became_active":"2024-03-16T07:30:58.576662+0000","last_became_peered":"2024-03-16T07:30:58.576662+0000","last_unstale":"2024-03-16T07:30:58.578114+0000","last_undegraded":"2024-03-16T07:30:58.578114+0000","last_fullsized":"2024-03-16T07:30:58.578114+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:25:23.575079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1e","version":"118'1","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.870345+0000","last_change":"2024-03-16T07:30:57.876067+0000","last_active":"2024-03-16T07:30:58.870345+0000","last_peered":"2024-03-16T07:30:58.870345+0000","last_clean":"2024-03-16T07:30:58.870345+0000","last_became_active":"2024-03-16T07:30:57.875777+0000","last_became_peered":"2024-03-16T07:30:57.875777+0000","last_unstale":"2024-03-16T07:30:58.870345+0000","last_undegraded":"2024-03-16T07:30:58.870345+0000","last_fullsized":"2024-03-16T07:30:58.870345+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_clean_scrub_stamp":"2024-03-16T07:30:56.855668+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:09:20.828638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.563560+0000","last_change":"2024-03-16T07:30:58.562404+0000","last_active":"2024-03-16T07:30:58.563560+0000","last_peered":"2024-03-16T07:30:58.563560+0000","last_clean":"2024-03-16T07:30:58.563560+0000","last_became_active":"2024-03-16T07:30:58.561934+0000","last_became_peered":"2024-03-16T07:30:58.561934+0000","last_unstale":"2024-03-16T07:30:58.563560+0000","last_undegraded":"2024-03-16T07:30:58.563560+0000","last_fullsized":"2024-03-16T07:30:58.563560+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:00:46.800781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1d","version":"118'2","reported_seq":14,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.870203+0000","last_change":"2024-03-16T07:30:57.880613+0000","last_active":"2024-03-16T07:30:58.870203+0000","last_peered":"2024-03-16T07:30:58.870203+0000","last_clean":"2024-03-16T07:30:58.870203+0000","last_became_active":"2024-03-16T07:30:57.880338+0000","last_became_peered":"2024-03-16T07:30:57.880338+0000","last_unstale":"2024-03-16T07:30:58.870203+0000","last_undegraded":"2024-03-16T07:30:58.870203+0000","last_fullsized":"2024-03-16T07:30:58.870203+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_clean_scrub_stamp":"2024-03-16T07:30:56.855668+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:44:41.572764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.576370+0000","last_change":"2024-03-16T07:30:58.575257+0000","last_active":"2024-03-16T07:30:58.576370+0000","last_peered":"2024-03-16T07:30:58.576370+0000","last_clean":"2024-03-16T07:30:58.576370+0000","last_became_active":"2024-03-16T07:30:58.575059+0000","last_became_peered":"2024-03-16T07:30:58.575059+0000","last_unstale":"2024-03-16T07:30:58.576370+0000","last_undegraded":"2024-03-16T07:30:58.576370+0000","last_fullsized":"2024-03-16T07:30:58.576370+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:56:38.419618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1c","version":"118'2","reported_seq":14,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.870246+0000","last_change":"2024-03-16T07:30:57.883046+0000","last_active":"2024-03-16T07:30:58.870246+0000","last_peered":"2024-03-16T07:30:58.870246+0000","last_clean":"2024-03-16T07:30:58.870246+0000","last_became_active":"2024-03-16T07:30:57.882833+0000","last_became_peered":"2024-03-16T07:30:57.882833+0000","last_unstale":"2024-03-16T07:30:58.870246+0000","last_undegraded":"2024-03-16T07:30:58.870246+0000","last_fullsized":"2024-03-16T07:30:58.870246+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_clean_scrub_stamp":"2024-03-16T07:30:56.855668+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:32:36.972246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.574830+0000","last_change":"2024-03-16T07:30:58.574103+0000","last_active":"2024-03-16T07:30:58.574830+0000","last_peered":"2024-03-16T07:30:58.574830+0000","last_clean":"2024-03-16T07:30:58.574830+0000","last_became_active":"2024-03-16T07:30:58.573253+0000","last_became_peered":"2024-03-16T07:30:58.573253+0000","last_unstale":"2024-03-16T07:30:58.574830+0000","last_undegraded":"2024-03-16T07:30:58.574830+0000","last_fullsized":"2024-03-16T07:30:58.574830+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:00:27.704551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.1b","version":"118'1","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.869788+0000","last_change":"2024-03-16T07:30:57.877500+0000","last_active":"2024-03-16T07:30:58.869788+0000","last_peered":"2024-03-16T07:30:58.869788+0000","last_clean":"2024-03-16T07:30:58.869788+0000","last_became_active":"2024-03-16T07:30:57.877227+0000","last_became_peered":"2024-03-16T07:30:57.877227+0000","last_unstale":"2024-03-16T07:30:58.869788+0000","last_undegraded":"2024-03-16T07:30:58.869788+0000","last_fullsized":"2024-03-16T07:30:58.869788+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_clean_scrub_stamp":"2024-03-16T07:30:56.855668+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:58:06.999355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.575604+0000","last_change":"2024-03-16T07:30:58.572972+0000","last_active":"2024-03-16T07:30:58.575604+0000","last_peered":"2024-03-16T07:30:58.575604+0000","last_clean":"2024-03-16T07:30:58.575604+0000","last_became_active":"2024-03-16T07:30:58.572740+0000","last_became_peered":"2024-03-16T07:30:58.572740+0000","last_unstale":"2024-03-16T07:30:58.575604+0000","last_undegraded":"2024-03-16T07:30:58.575604+0000","last_fullsized":"2024-03-16T07:30:58.575604+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:15:58.196193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1a","version":"118'1","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.869626+0000","last_change":"2024-03-16T07:30:57.877180+0000","last_active":"2024-03-16T07:30:58.869626+0000","last_peered":"2024-03-16T07:30:58.869626+0000","last_clean":"2024-03-16T07:30:58.869626+0000","last_became_active":"2024-03-16T07:30:57.874453+0000","last_became_peered":"2024-03-16T07:30:57.874453+0000","last_unstale":"2024-03-16T07:30:58.869626+0000","last_undegraded":"2024-03-16T07:30:58.869626+0000","last_fullsized":"2024-03-16T07:30:58.869626+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_clean_scrub_stamp":"2024-03-16T07:30:56.855668+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:08:51.971603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.564929+0000","last_change":"2024-03-16T07:30:58.563319+0000","last_active":"2024-03-16T07:30:58.564929+0000","last_peered":"2024-03-16T07:30:58.564929+0000","last_clean":"2024-03-16T07:30:58.564929+0000","last_became_active":"2024-03-16T07:30:58.560355+0000","last_became_peered":"2024-03-16T07:30:58.560355+0000","last_unstale":"2024-03-16T07:30:58.564929+0000","last_undegraded":"2024-03-16T07:30:58.564929+0000","last_fullsized":"2024-03-16T07:30:58.564929+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:06:51.999186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":12,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.566897+0000","last_change":"2024-03-16T07:30:57.880819+0000","last_active":"2024-03-16T07:30:58.566897+0000","last_peered":"2024-03-16T07:30:58.566897+0000","last_clean":"2024-03-16T07:30:58.566897+0000","last_became_active":"2024-03-16T07:30:57.879895+0000","last_became_peered":"2024-03-16T07:30:57.879895+0000","last_unstale":"2024-03-16T07:30:58.566897+0000","last_undegraded":"2024-03-16T07:30:58.566897+0000","last_fullsized":"2024-03-16T07:30:58.566897+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_clean_scrub_stamp":"2024-03-16T07:30:56.855668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:05:21.871385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.579419+0000","last_change":"2024-03-16T07:30:58.578447+0000","last_active":"2024-03-16T07:30:58.579419+0000","last_peered":"2024-03-16T07:30:58.579419+0000","last_clean":"2024-03-16T07:30:58.579419+0000","last_became_active":"2024-03-16T07:30:58.576907+0000","last_became_peered":"2024-03-16T07:30:58.576907+0000","last_unstale":"2024-03-16T07:30:58.579419+0000","last_undegraded":"2024-03-16T07:30:58.579419+0000","last_fullsized":"2024-03-16T07:30:58.579419+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:44:15.784720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":12,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.558270+0000","last_change":"2024-03-16T07:30:57.876311+0000","last_active":"2024-03-16T07:30:58.558270+0000","last_peered":"2024-03-16T07:30:58.558270+0000","last_clean":"2024-03-16T07:30:58.558270+0000","last_became_active":"2024-03-16T07:30:57.875731+0000","last_became_peered":"2024-03-16T07:30:57.875731+0000","last_unstale":"2024-03-16T07:30:58.558270+0000","last_undegraded":"2024-03-16T07:30:58.558270+0000","last_fullsized":"2024-03-16T07:30:58.558270+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_clean_scrub_stamp":"2024-03-16T07:30:56.855668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:05:56.490504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.576289+0000","last_change":"2024-03-16T07:30:58.574189+0000","last_active":"2024-03-16T07:30:58.576289+0000","last_peered":"2024-03-16T07:30:58.576289+0000","last_clean":"2024-03-16T07:30:58.576289+0000","last_became_active":"2024-03-16T07:30:58.573886+0000","last_became_peered":"2024-03-16T07:30:58.573886+0000","last_unstale":"2024-03-16T07:30:58.576289+0000","last_undegraded":"2024-03-16T07:30:58.576289+0000","last_fullsized":"2024-03-16T07:30:58.576289+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:10:16.259637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":12,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.553539+0000","last_change":"2024-03-16T07:30:57.880020+0000","last_active":"2024-03-16T07:30:58.553539+0000","last_peered":"2024-03-16T07:30:58.553539+0000","last_clean":"2024-03-16T07:30:58.553539+0000","last_became_active":"2024-03-16T07:30:57.877991+0000","last_became_peered":"2024-03-16T07:30:57.877991+0000","last_unstale":"2024-03-16T07:30:58.553539+0000","last_undegraded":"2024-03-16T07:30:58.553539+0000","last_fullsized":"2024-03-16T07:30:58.553539+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_clean_scrub_stamp":"2024-03-16T07:30:56.855668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:59:19.537450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.565573+0000","last_change":"2024-03-16T07:30:58.560911+0000","last_active":"2024-03-16T07:30:58.565573+0000","last_peered":"2024-03-16T07:30:58.565573+0000","last_clean":"2024-03-16T07:30:58.565573+0000","last_became_active":"2024-03-16T07:30:58.560672+0000","last_became_peered":"2024-03-16T07:30:58.560672+0000","last_unstale":"2024-03-16T07:30:58.565573+0000","last_undegraded":"2024-03-16T07:30:58.565573+0000","last_fullsized":"2024-03-16T07:30:58.565573+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:08:08.558438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":12,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.554632+0000","last_change":"2024-03-16T07:30:57.883569+0000","last_active":"2024-03-16T07:30:58.554632+0000","last_peered":"2024-03-16T07:30:58.554632+0000","last_clean":"2024-03-16T07:30:58.554632+0000","last_became_active":"2024-03-16T07:30:57.881021+0000","last_became_peered":"2024-03-16T07:30:57.881021+0000","last_unstale":"2024-03-16T07:30:58.554632+0000","last_undegraded":"2024-03-16T07:30:58.554632+0000","last_fullsized":"2024-03-16T07:30:58.554632+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_clean_scrub_stamp":"2024-03-16T07:30:56.855668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:10:24.637645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.578094+0000","last_change":"2024-03-16T07:30:58.577305+0000","last_active":"2024-03-16T07:30:58.578094+0000","last_peered":"2024-03-16T07:30:58.578094+0000","last_clean":"2024-03-16T07:30:58.578094+0000","last_became_active":"2024-03-16T07:30:58.577050+0000","last_became_peered":"2024-03-16T07:30:58.577050+0000","last_unstale":"2024-03-16T07:30:58.578094+0000","last_undegraded":"2024-03-16T07:30:58.578094+0000","last_fullsized":"2024-03-16T07:30:58.578094+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:02:09.725846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.14","version":"118'6","reported_seq":18,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.873760+0000","last_change":"2024-03-16T07:30:57.875270+0000","last_active":"2024-03-16T07:30:58.873760+0000","last_peered":"2024-03-16T07:30:58.873760+0000","last_clean":"2024-03-16T07:30:58.873760+0000","last_became_active":"2024-03-16T07:30:57.874794+0000","last_became_peered":"2024-03-16T07:30:57.874794+0000","last_unstale":"2024-03-16T07:30:58.873760+0000","last_undegraded":"2024-03-16T07:30:58.873760+0000","last_fullsized":"2024-03-16T07:30:58.873760+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_clean_scrub_stamp":"2024-03-16T07:30:56.855668+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:26:41.488241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.578536+0000","last_change":"2024-03-16T07:30:58.577837+0000","last_active":"2024-03-16T07:30:58.578536+0000","last_peered":"2024-03-16T07:30:58.578536+0000","last_clean":"2024-03-16T07:30:58.578536+0000","last_became_active":"2024-03-16T07:30:58.577593+0000","last_became_peered":"2024-03-16T07:30:58.577593+0000","last_unstale":"2024-03-16T07:30:58.578536+0000","last_undegraded":"2024-03-16T07:30:58.578536+0000","last_fullsized":"2024-03-16T07:30:58.578536+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:27:03.691637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.13","version":"118'2","reported_seq":14,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.871940+0000","last_change":"2024-03-16T07:30:57.876973+0000","last_active":"2024-03-16T07:30:58.871940+0000","last_peered":"2024-03-16T07:30:58.871940+0000","last_clean":"2024-03-16T07:30:58.871940+0000","last_became_active":"2024-03-16T07:30:57.876549+0000","last_became_peered":"2024-03-16T07:30:57.876549+0000","last_unstale":"2024-03-16T07:30:58.871940+0000","last_undegraded":"2024-03-16T07:30:58.871940+0000","last_fullsized":"2024-03-16T07:30:58.871940+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_clean_scrub_stamp":"2024-03-16T07:30:56.855668+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:22:06.397991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.563107+0000","last_change":"2024-03-16T07:30:58.560202+0000","last_active":"2024-03-16T07:30:58.563107+0000","last_peered":"2024-03-16T07:30:58.563107+0000","last_clean":"2024-03-16T07:30:58.563107+0000","last_became_active":"2024-03-16T07:30:58.559912+0000","last_became_peered":"2024-03-16T07:30:58.559912+0000","last_unstale":"2024-03-16T07:30:58.563107+0000","last_undegraded":"2024-03-16T07:30:58.563107+0000","last_fullsized":"2024-03-16T07:30:58.563107+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:44:42.573710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":12,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.557777+0000","last_change":"2024-03-16T07:30:57.873985+0000","last_active":"2024-03-16T07:30:58.557777+0000","last_peered":"2024-03-16T07:30:58.557777+0000","last_clean":"2024-03-16T07:30:58.557777+0000","last_became_active":"2024-03-16T07:30:57.873398+0000","last_became_peered":"2024-03-16T07:30:57.873398+0000","last_unstale":"2024-03-16T07:30:58.557777+0000","last_undegraded":"2024-03-16T07:30:58.557777+0000","last_fullsized":"2024-03-16T07:30:58.557777+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_clean_scrub_stamp":"2024-03-16T07:30:56.855668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:46:10.971699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.575535+0000","last_change":"2024-03-16T07:30:58.573178+0000","last_active":"2024-03-16T07:30:58.575535+0000","last_peered":"2024-03-16T07:30:58.575535+0000","last_clean":"2024-03-16T07:30:58.575535+0000","last_became_active":"2024-03-16T07:30:58.571970+0000","last_became_peered":"2024-03-16T07:30:58.571970+0000","last_unstale":"2024-03-16T07:30:58.575535+0000","last_undegraded":"2024-03-16T07:30:58.575535+0000","last_fullsized":"2024-03-16T07:30:58.575535+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:34:17.392134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":12,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.553540+0000","last_change":"2024-03-16T07:30:57.876093+0000","last_active":"2024-03-16T07:30:58.553540+0000","last_peered":"2024-03-16T07:30:58.553540+0000","last_clean":"2024-03-16T07:30:58.553540+0000","last_became_active":"2024-03-16T07:30:57.875436+0000","last_became_peered":"2024-03-16T07:30:57.875436+0000","last_unstale":"2024-03-16T07:30:58.553540+0000","last_undegraded":"2024-03-16T07:30:58.553540+0000","last_fullsized":"2024-03-16T07:30:58.553540+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_clean_scrub_stamp":"2024-03-16T07:30:56.855668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:32:20.139876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.579403+0000","last_change":"2024-03-16T07:30:58.576156+0000","last_active":"2024-03-16T07:30:58.579403+0000","last_peered":"2024-03-16T07:30:58.579403+0000","last_clean":"2024-03-16T07:30:58.579403+0000","last_became_active":"2024-03-16T07:30:58.575849+0000","last_became_peered":"2024-03-16T07:30:58.575849+0000","last_unstale":"2024-03-16T07:30:58.579403+0000","last_undegraded":"2024-03-16T07:30:58.579403+0000","last_fullsized":"2024-03-16T07:30:58.579403+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:46:53.824339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.10","version":"118'8","reported_seq":20,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.873263+0000","last_change":"2024-03-16T07:30:57.879389+0000","last_active":"2024-03-16T07:30:58.873263+0000","last_peered":"2024-03-16T07:30:58.873263+0000","last_clean":"2024-03-16T07:30:58.873263+0000","last_became_active":"2024-03-16T07:30:57.879149+0000","last_became_peered":"2024-03-16T07:30:57.879149+0000","last_unstale":"2024-03-16T07:30:58.873263+0000","last_undegraded":"2024-03-16T07:30:58.873263+0000","last_fullsized":"2024-03-16T07:30:58.873263+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_clean_scrub_stamp":"2024-03-16T07:30:56.855668+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:55:45.100141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.568059+0000","last_change":"2024-03-16T07:30:58.566955+0000","last_active":"2024-03-16T07:30:58.568059+0000","last_peered":"2024-03-16T07:30:58.568059+0000","last_clean":"2024-03-16T07:30:58.568059+0000","last_became_active":"2024-03-16T07:30:58.563826+0000","last_became_peered":"2024-03-16T07:30:58.563826+0000","last_unstale":"2024-03-16T07:30:58.568059+0000","last_undegraded":"2024-03-16T07:30:58.568059+0000","last_fullsized":"2024-03-16T07:30:58.568059+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:30:50.425935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.f","version":"118'1","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.871750+0000","last_change":"2024-03-16T07:30:57.879349+0000","last_active":"2024-03-16T07:30:58.871750+0000","last_peered":"2024-03-16T07:30:58.871750+0000","last_clean":"2024-03-16T07:30:58.871750+0000","last_became_active":"2024-03-16T07:30:57.879060+0000","last_became_peered":"2024-03-16T07:30:57.879060+0000","last_unstale":"2024-03-16T07:30:58.871750+0000","last_undegraded":"2024-03-16T07:30:58.871750+0000","last_fullsized":"2024-03-16T07:30:58.871750+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_clean_scrub_stamp":"2024-03-16T07:30:56.855668+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:30:49.424989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.576844+0000","last_change":"2024-03-16T07:30:58.574600+0000","last_active":"2024-03-16T07:30:58.576844+0000","last_peered":"2024-03-16T07:30:58.576844+0000","last_clean":"2024-03-16T07:30:58.576844+0000","last_became_active":"2024-03-16T07:30:58.574152+0000","last_became_peered":"2024-03-16T07:30:58.574152+0000","last_unstale":"2024-03-16T07:30:58.576844+0000","last_undegraded":"2024-03-16T07:30:58.576844+0000","last_fullsized":"2024-03-16T07:30:58.576844+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:05:40.149740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"118'2","reported_seq":14,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.869689+0000","last_change":"2024-03-16T07:30:57.881691+0000","last_active":"2024-03-16T07:30:58.869689+0000","last_peered":"2024-03-16T07:30:58.869689+0000","last_clean":"2024-03-16T07:30:58.869689+0000","last_became_active":"2024-03-16T07:30:57.880871+0000","last_became_peered":"2024-03-16T07:30:57.880871+0000","last_unstale":"2024-03-16T07:30:58.869689+0000","last_undegraded":"2024-03-16T07:30:58.869689+0000","last_fullsized":"2024-03-16T07:30:58.869689+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_clean_scrub_stamp":"2024-03-16T07:30:56.855668+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:56:12.658295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.563461+0000","last_change":"2024-03-16T07:30:58.562180+0000","last_active":"2024-03-16T07:30:58.563461+0000","last_peered":"2024-03-16T07:30:58.563461+0000","last_clean":"2024-03-16T07:30:58.563461+0000","last_became_active":"2024-03-16T07:30:58.560416+0000","last_became_peered":"2024-03-16T07:30:58.560416+0000","last_unstale":"2024-03-16T07:30:58.563461+0000","last_undegraded":"2024-03-16T07:30:58.563461+0000","last_fullsized":"2024-03-16T07:30:58.563461+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:26:14.662551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.d","version":"118'1","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.869385+0000","last_change":"2024-03-16T07:30:57.878006+0000","last_active":"2024-03-16T07:30:58.869385+0000","last_peered":"2024-03-16T07:30:58.869385+0000","last_clean":"2024-03-16T07:30:58.869385+0000","last_became_active":"2024-03-16T07:30:57.877534+0000","last_became_peered":"2024-03-16T07:30:57.877534+0000","last_unstale":"2024-03-16T07:30:58.869385+0000","last_undegraded":"2024-03-16T07:30:58.869385+0000","last_fullsized":"2024-03-16T07:30:58.869385+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_clean_scrub_stamp":"2024-03-16T07:30:56.855668+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:00:45.799835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.563358+0000","last_change":"2024-03-16T07:30:58.562773+0000","last_active":"2024-03-16T07:30:58.563358+0000","last_peered":"2024-03-16T07:30:58.563358+0000","last_clean":"2024-03-16T07:30:58.563358+0000","last_became_active":"2024-03-16T07:30:58.562520+0000","last_became_peered":"2024-03-16T07:30:58.562520+0000","last_unstale":"2024-03-16T07:30:58.563358+0000","last_undegraded":"2024-03-16T07:30:58.563358+0000","last_fullsized":"2024-03-16T07:30:58.563358+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:32:37.973192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":12,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.553123+0000","last_change":"2024-03-16T07:30:57.877782+0000","last_active":"2024-03-16T07:30:58.553123+0000","last_peered":"2024-03-16T07:30:58.553123+0000","last_clean":"2024-03-16T07:30:58.553123+0000","last_became_active":"2024-03-16T07:30:57.876843+0000","last_became_peered":"2024-03-16T07:30:57.876843+0000","last_unstale":"2024-03-16T07:30:58.553123+0000","last_undegraded":"2024-03-16T07:30:58.553123+0000","last_fullsized":"2024-03-16T07:30:58.553123+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_clean_scrub_stamp":"2024-03-16T07:30:56.855668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:26:20.745771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.565603+0000","last_change":"2024-03-16T07:30:58.561355+0000","last_active":"2024-03-16T07:30:58.565603+0000","last_peered":"2024-03-16T07:30:58.565603+0000","last_clean":"2024-03-16T07:30:58.565603+0000","last_became_active":"2024-03-16T07:30:58.561123+0000","last_became_peered":"2024-03-16T07:30:58.561123+0000","last_unstale":"2024-03-16T07:30:58.565603+0000","last_undegraded":"2024-03-16T07:30:58.565603+0000","last_fullsized":"2024-03-16T07:30:58.565603+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:49:43.840977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.b","version":"118'2","reported_seq":14,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.871789+0000","last_change":"2024-03-16T07:30:57.876715+0000","last_active":"2024-03-16T07:30:58.871789+0000","last_peered":"2024-03-16T07:30:58.871789+0000","last_clean":"2024-03-16T07:30:58.871789+0000","last_became_active":"2024-03-16T07:30:57.876348+0000","last_became_peered":"2024-03-16T07:30:57.876348+0000","last_unstale":"2024-03-16T07:30:58.871789+0000","last_undegraded":"2024-03-16T07:30:58.871789+0000","last_fullsized":"2024-03-16T07:30:58.871789+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_clean_scrub_stamp":"2024-03-16T07:30:56.855668+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:59:13.050997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.565510+0000","last_change":"2024-03-16T07:30:58.561031+0000","last_active":"2024-03-16T07:30:58.565510+0000","last_peered":"2024-03-16T07:30:58.565510+0000","last_clean":"2024-03-16T07:30:58.565510+0000","last_became_active":"2024-03-16T07:30:58.560717+0000","last_became_peered":"2024-03-16T07:30:58.560717+0000","last_unstale":"2024-03-16T07:30:58.565510+0000","last_undegraded":"2024-03-16T07:30:58.565510+0000","last_fullsized":"2024-03-16T07:30:58.565510+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:43:10.162391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":12,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.566181+0000","last_change":"2024-03-16T07:30:57.876974+0000","last_active":"2024-03-16T07:30:58.566181+0000","last_peered":"2024-03-16T07:30:58.566181+0000","last_clean":"2024-03-16T07:30:58.566181+0000","last_became_active":"2024-03-16T07:30:57.876350+0000","last_became_peered":"2024-03-16T07:30:57.876350+0000","last_unstale":"2024-03-16T07:30:58.566181+0000","last_undegraded":"2024-03-16T07:30:58.566181+0000","last_fullsized":"2024-03-16T07:30:58.566181+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_clean_scrub_stamp":"2024-03-16T07:30:56.855668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:12:00.017490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.565679+0000","last_change":"2024-03-16T07:30:58.561986+0000","last_active":"2024-03-16T07:30:58.565679+0000","last_peered":"2024-03-16T07:30:58.565679+0000","last_clean":"2024-03-16T07:30:58.565679+0000","last_became_active":"2024-03-16T07:30:58.561661+0000","last_became_peered":"2024-03-16T07:30:58.561661+0000","last_unstale":"2024-03-16T07:30:58.565679+0000","last_undegraded":"2024-03-16T07:30:58.565679+0000","last_fullsized":"2024-03-16T07:30:58.565679+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:51:34.702543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":12,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.566754+0000","last_change":"2024-03-16T07:30:57.880017+0000","last_active":"2024-03-16T07:30:58.566754+0000","last_peered":"2024-03-16T07:30:58.566754+0000","last_clean":"2024-03-16T07:30:58.566754+0000","last_became_active":"2024-03-16T07:30:57.879752+0000","last_became_peered":"2024-03-16T07:30:57.879752+0000","last_unstale":"2024-03-16T07:30:58.566754+0000","last_undegraded":"2024-03-16T07:30:58.566754+0000","last_fullsized":"2024-03-16T07:30:58.566754+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_clean_scrub_stamp":"2024-03-16T07:30:56.855668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:02:33.202240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.569162+0000","last_change":"2024-03-16T07:30:58.566963+0000","last_active":"2024-03-16T07:30:58.569162+0000","last_peered":"2024-03-16T07:30:58.569162+0000","last_clean":"2024-03-16T07:30:58.569162+0000","last_became_active":"2024-03-16T07:30:58.566661+0000","last_became_peered":"2024-03-16T07:30:58.566661+0000","last_unstale":"2024-03-16T07:30:58.569162+0000","last_undegraded":"2024-03-16T07:30:58.569162+0000","last_fullsized":"2024-03-16T07:30:58.569162+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:01:42.242569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":12,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.565267+0000","last_change":"2024-03-16T07:30:57.881392+0000","last_active":"2024-03-16T07:30:58.565267+0000","last_peered":"2024-03-16T07:30:58.565267+0000","last_clean":"2024-03-16T07:30:58.565267+0000","last_became_active":"2024-03-16T07:30:57.881148+0000","last_became_peered":"2024-03-16T07:30:57.881148+0000","last_unstale":"2024-03-16T07:30:58.565267+0000","last_undegraded":"2024-03-16T07:30:58.565267+0000","last_fullsized":"2024-03-16T07:30:58.565267+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_clean_scrub_stamp":"2024-03-16T07:30:56.855668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:37:55.898841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.579499+0000","last_change":"2024-03-16T07:30:58.576511+0000","last_active":"2024-03-16T07:30:58.579499+0000","last_peered":"2024-03-16T07:30:58.579499+0000","last_clean":"2024-03-16T07:30:58.579499+0000","last_became_active":"2024-03-16T07:30:58.576275+0000","last_became_peered":"2024-03-16T07:30:58.576275+0000","last_unstale":"2024-03-16T07:30:58.579499+0000","last_undegraded":"2024-03-16T07:30:58.579499+0000","last_fullsized":"2024-03-16T07:30:58.579499+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:48:25.008750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.7","version":"118'2","reported_seq":14,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.870144+0000","last_change":"2024-03-16T07:30:57.876924+0000","last_active":"2024-03-16T07:30:58.870144+0000","last_peered":"2024-03-16T07:30:58.870144+0000","last_clean":"2024-03-16T07:30:58.870144+0000","last_became_active":"2024-03-16T07:30:57.876507+0000","last_became_peered":"2024-03-16T07:30:57.876507+0000","last_unstale":"2024-03-16T07:30:58.870144+0000","last_undegraded":"2024-03-16T07:30:58.870144+0000","last_fullsized":"2024-03-16T07:30:58.870144+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_clean_scrub_stamp":"2024-03-16T07:30:56.855668+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:09:54.480497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.576862+0000","last_change":"2024-03-16T07:30:58.574706+0000","last_active":"2024-03-16T07:30:58.576862+0000","last_peered":"2024-03-16T07:30:58.576862+0000","last_clean":"2024-03-16T07:30:58.576862+0000","last_became_active":"2024-03-16T07:30:58.574447+0000","last_became_peered":"2024-03-16T07:30:58.574447+0000","last_unstale":"2024-03-16T07:30:58.576862+0000","last_undegraded":"2024-03-16T07:30:58.576862+0000","last_fullsized":"2024-03-16T07:30:58.576862+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:22:16.305364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":12,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.554958+0000","last_change":"2024-03-16T07:30:57.883769+0000","last_active":"2024-03-16T07:30:58.554958+0000","last_peered":"2024-03-16T07:30:58.554958+0000","last_clean":"2024-03-16T07:30:58.554958+0000","last_became_active":"2024-03-16T07:30:57.881218+0000","last_became_peered":"2024-03-16T07:30:57.881218+0000","last_unstale":"2024-03-16T07:30:58.554958+0000","last_undegraded":"2024-03-16T07:30:58.554958+0000","last_fullsized":"2024-03-16T07:30:58.554958+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_clean_scrub_stamp":"2024-03-16T07:30:56.855668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:56:31.528403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.563541+0000","last_change":"2024-03-16T07:30:58.562495+0000","last_active":"2024-03-16T07:30:58.563541+0000","last_peered":"2024-03-16T07:30:58.563541+0000","last_clean":"2024-03-16T07:30:58.563541+0000","last_became_active":"2024-03-16T07:30:58.562227+0000","last_became_peered":"2024-03-16T07:30:58.562227+0000","last_unstale":"2024-03-16T07:30:58.563541+0000","last_undegraded":"2024-03-16T07:30:58.563541+0000","last_fullsized":"2024-03-16T07:30:58.563541+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:55:46.101087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":12,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.553894+0000","last_change":"2024-03-16T07:30:57.875030+0000","last_active":"2024-03-16T07:30:58.553894+0000","last_peered":"2024-03-16T07:30:58.553894+0000","last_clean":"2024-03-16T07:30:58.553894+0000","last_became_active":"2024-03-16T07:30:57.874778+0000","last_became_peered":"2024-03-16T07:30:57.874778+0000","last_unstale":"2024-03-16T07:30:58.553894+0000","last_undegraded":"2024-03-16T07:30:58.553894+0000","last_fullsized":"2024-03-16T07:30:58.553894+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_clean_scrub_stamp":"2024-03-16T07:30:56.855668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:21:12.260369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.569920+0000","last_change":"2024-03-16T07:30:58.568858+0000","last_active":"2024-03-16T07:30:58.569920+0000","last_peered":"2024-03-16T07:30:58.569920+0000","last_clean":"2024-03-16T07:30:58.569920+0000","last_became_active":"2024-03-16T07:30:58.568307+0000","last_became_peered":"2024-03-16T07:30:58.568307+0000","last_unstale":"2024-03-16T07:30:58.569920+0000","last_undegraded":"2024-03-16T07:30:58.569920+0000","last_fullsized":"2024-03-16T07:30:58.569920+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:09:55.481444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":12,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.553497+0000","last_change":"2024-03-16T07:30:57.877529+0000","last_active":"2024-03-16T07:30:58.553497+0000","last_peered":"2024-03-16T07:30:58.553497+0000","last_clean":"2024-03-16T07:30:58.553497+0000","last_became_active":"2024-03-16T07:30:57.876528+0000","last_became_peered":"2024-03-16T07:30:57.876528+0000","last_unstale":"2024-03-16T07:30:58.553497+0000","last_undegraded":"2024-03-16T07:30:58.553497+0000","last_fullsized":"2024-03-16T07:30:58.553497+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_clean_scrub_stamp":"2024-03-16T07:30:56.855668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:21:55.125566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.578555+0000","last_change":"2024-03-16T07:30:58.577875+0000","last_active":"2024-03-16T07:30:58.578555+0000","last_peered":"2024-03-16T07:30:58.578555+0000","last_clean":"2024-03-16T07:30:58.578555+0000","last_became_active":"2024-03-16T07:30:58.577623+0000","last_became_peered":"2024-03-16T07:30:58.577623+0000","last_unstale":"2024-03-16T07:30:58.578555+0000","last_undegraded":"2024-03-16T07:30:58.578555+0000","last_fullsized":"2024-03-16T07:30:58.578555+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:31:58.669992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":12,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.557103+0000","last_change":"2024-03-16T07:30:57.875740+0000","last_active":"2024-03-16T07:30:58.557103+0000","last_peered":"2024-03-16T07:30:58.557103+0000","last_clean":"2024-03-16T07:30:58.557103+0000","last_became_active":"2024-03-16T07:30:57.875469+0000","last_became_peered":"2024-03-16T07:30:57.875469+0000","last_unstale":"2024-03-16T07:30:58.557103+0000","last_undegraded":"2024-03-16T07:30:58.557103+0000","last_fullsized":"2024-03-16T07:30:58.557103+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_clean_scrub_stamp":"2024-03-16T07:30:56.855668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:19:36.033244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.578600+0000","last_change":"2024-03-16T07:30:58.577788+0000","last_active":"2024-03-16T07:30:58.578600+0000","last_peered":"2024-03-16T07:30:58.578600+0000","last_clean":"2024-03-16T07:30:58.578600+0000","last_became_active":"2024-03-16T07:30:58.577528+0000","last_became_peered":"2024-03-16T07:30:58.577528+0000","last_unstale":"2024-03-16T07:30:58.578600+0000","last_undegraded":"2024-03-16T07:30:58.578600+0000","last_fullsized":"2024-03-16T07:30:58.578600+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:37:16.741567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":12,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.557777+0000","last_change":"2024-03-16T07:30:57.874192+0000","last_active":"2024-03-16T07:30:58.557777+0000","last_peered":"2024-03-16T07:30:58.557777+0000","last_clean":"2024-03-16T07:30:58.557777+0000","last_became_active":"2024-03-16T07:30:57.873741+0000","last_became_peered":"2024-03-16T07:30:57.873741+0000","last_unstale":"2024-03-16T07:30:58.557777+0000","last_undegraded":"2024-03-16T07:30:58.557777+0000","last_fullsized":"2024-03-16T07:30:58.557777+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_clean_scrub_stamp":"2024-03-16T07:30:56.855668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:45:10.776890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.576010+0000","last_change":"2024-03-16T07:30:58.573475+0000","last_active":"2024-03-16T07:30:58.576010+0000","last_peered":"2024-03-16T07:30:58.576010+0000","last_clean":"2024-03-16T07:30:58.576010+0000","last_became_active":"2024-03-16T07:30:58.572303+0000","last_became_peered":"2024-03-16T07:30:58.572303+0000","last_unstale":"2024-03-16T07:30:58.576010+0000","last_undegraded":"2024-03-16T07:30:58.576010+0000","last_fullsized":"2024-03-16T07:30:58.576010+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:06:50.154852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":12,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.557054+0000","last_change":"2024-03-16T07:30:57.875574+0000","last_active":"2024-03-16T07:30:58.557054+0000","last_peered":"2024-03-16T07:30:58.557054+0000","last_clean":"2024-03-16T07:30:58.557054+0000","last_became_active":"2024-03-16T07:30:57.875325+0000","last_became_peered":"2024-03-16T07:30:57.875325+0000","last_unstale":"2024-03-16T07:30:58.557054+0000","last_undegraded":"2024-03-16T07:30:58.557054+0000","last_fullsized":"2024-03-16T07:30:58.557054+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_clean_scrub_stamp":"2024-03-16T07:30:56.855668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:18:36.802383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.566822+0000","last_change":"2024-03-16T07:30:58.564067+0000","last_active":"2024-03-16T07:30:58.566822+0000","last_peered":"2024-03-16T07:30:58.566822+0000","last_clean":"2024-03-16T07:30:58.566822+0000","last_became_active":"2024-03-16T07:30:58.563838+0000","last_became_peered":"2024-03-16T07:30:58.563838+0000","last_unstale":"2024-03-16T07:30:58.566822+0000","last_undegraded":"2024-03-16T07:30:58.566822+0000","last_fullsized":"2024-03-16T07:30:58.566822+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:51:01.471752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":12,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.565404+0000","last_change":"2024-03-16T07:30:57.883190+0000","last_active":"2024-03-16T07:30:58.565404+0000","last_peered":"2024-03-16T07:30:58.565404+0000","last_clean":"2024-03-16T07:30:58.565404+0000","last_became_active":"2024-03-16T07:30:57.882925+0000","last_became_peered":"2024-03-16T07:30:57.882925+0000","last_unstale":"2024-03-16T07:30:58.565404+0000","last_undegraded":"2024-03-16T07:30:58.565404+0000","last_fullsized":"2024-03-16T07:30:58.565404+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_clean_scrub_stamp":"2024-03-16T07:30:56.855668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:06:50.998240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":9,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.565675+0000","last_change":"2024-03-16T07:30:58.561416+0000","last_active":"2024-03-16T07:30:58.565675+0000","last_peered":"2024-03-16T07:30:58.565675+0000","last_clean":"2024-03-16T07:30:58.565675+0000","last_became_active":"2024-03-16T07:30:58.561163+0000","last_became_peered":"2024-03-16T07:30:58.561163+0000","last_unstale":"2024-03-16T07:30:58.565675+0000","last_undegraded":"2024-03-16T07:30:58.565675+0000","last_fullsized":"2024-03-16T07:30:58.565675+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:31:32.097584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.15","version":"118'3","reported_seq":15,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.871634+0000","last_change":"2024-03-16T07:30:57.875401+0000","last_active":"2024-03-16T07:30:58.871634+0000","last_peered":"2024-03-16T07:30:58.871634+0000","last_clean":"2024-03-16T07:30:58.871634+0000","last_became_active":"2024-03-16T07:30:57.875032+0000","last_became_peered":"2024-03-16T07:30:57.875032+0000","last_unstale":"2024-03-16T07:30:58.871634+0000","last_undegraded":"2024-03-16T07:30:58.871634+0000","last_fullsized":"2024-03-16T07:30:58.871634+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_clean_scrub_stamp":"2024-03-16T07:30:56.855668+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:39:09.736811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"103'174","reported_seq":612,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-03-16T07:30:58.553582+0000","last_change":"2024-03-16T07:24:31.650537+0000","last_active":"2024-03-16T07:30:58.553582+0000","last_peered":"2024-03-16T07:30:58.553582+0000","last_clean":"2024-03-16T07:30:58.553582+0000","last_became_active":"2024-03-16T07:24:31.649574+0000","last_became_peered":"2024-03-16T07:24:31.649574+0000","last_unstale":"2024-03-16T07:30:58.553582+0000","last_undegraded":"2024-03-16T07:30:58.553582+0000","last_fullsized":"2024-03-16T07:30:58.553582+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:29.719970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:29.719970+0000","last_clean_scrub_stamp":"2024-03-16T07:24:29.719970+0000","objects_scrubbed":0,"log_size":174,"log_dups_size":0,"ondisk_log_size":174,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:31:35.774554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":778,"num_read_kb":1533,"num_write":277,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":20,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":778,"num_read_kb":1533,"num_write":277,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":174,"ondisk_log_size":174,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738444,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":36516,"kb_used_data":1172,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":104821084,"statfs":{"total":107374182400,"available":107336790016,"internally_reserved":0,"allocated":1200128,"data_stored":485773,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738444,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":37096,"kb_used_data":1752,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":104820504,"statfs":{"total":107374182400,"available":107336196096,"internally_reserved":0,"allocated":1794048,"data_stored":1076141,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738444,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":37096,"kb_used_data":1752,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":104820504,"statfs":{"total":107374182400,"available":107336196096,"internally_reserved":0,"allocated":1794048,"data_stored":1076141,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2286,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-16T07:31:02.246 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-03-16T07:31:02.246 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-03-16T07:31:02.661 INFO:teuthology.orchestra.run.smithi049.stdout:[client.0] 2024-03-16T07:31:02.661 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQAaSfVlmBmvGRAAaxdhkajaioVlq23dyv/g4g== 2024-03-16T07:31:02.661 INFO:teuthology.orchestra.run.smithi049.stdout: caps mds = "allow" 2024-03-16T07:31:02.661 INFO:teuthology.orchestra.run.smithi049.stdout: caps mon = "allow r" 2024-03-16T07:31:02.661 INFO:teuthology.orchestra.run.smithi049.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-03-16T07:31:02.662 INFO:teuthology.orchestra.run.smithi049.stderr:updated caps for client.0 2024-03-16T07:31:02.679 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T07:31:03.023 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:31:03.024 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":81,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5957,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6827/2832753094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":2832753094},{"type":"v1","addr":"172.21.15.49:6827","nonce":2832753094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":78},{"gid":5961,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6829/3236120377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":3236120377},{"type":"v1","addr":"172.21.15.49:6829","nonce":3236120377}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":78},{"gid":5964,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6831/1238434429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":1238434429},{"type":"v1","addr":"172.21.15.49:6831","nonce":1238434429}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":78},{"gid":5965,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6833/4146414383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":4146414383},{"type":"v1","addr":"172.21.15.49:6833","nonce":4146414383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":78}],"filesystems":[{"mdsmap":{"epoch":81,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-16T07:30:58.238420+0000","modified":"2024-03-16T07:31:00.495716+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5968},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5968":{"gid":5968,"name":"d","rank":0,"incarnation":79,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6835/790210824","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":790210824},{"type":"v1","addr":"172.21.15.49:6835","nonce":790210824}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5968,"qdb_cluster":[5968]},"id":10}]} 2024-03-16T07:31:03.024 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 81 2024-03-16T07:31:03.538 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 81, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-03-16T07:30:58.238420+0000', 'modified': '2024-03-16T07:31:00.495716+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5968}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5968': {'gid': 5968, 'name': 'd', 'rank': 0, 'incarnation': 79, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.49:6835/790210824', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.49:6834', 'nonce': 790210824}, {'type': 'v1', 'addr': '172.21.15.49:6835', 'nonce': 790210824}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [21], 'metadata_pool': 20, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5968, 'qdb_cluster': [5968]} 2024-03-16T07:31:03.539 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-03-16T07:31:03.539 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-03-16T07:31:03.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-16T07:31:03.662+0000 7fea937fe640 0 client.6027 ms_handle_reset on v2:172.21.15.49:6834/790210824 2024-03-16T07:31:03.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-16T07:31:03.686+0000 7fea937fe640 0 client.6029 ms_handle_reset on v2:172.21.15.49:6834/790210824 2024-03-16T07:31:03.685 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-03-16T07:31:03.685 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_fsid": "f91af061-9eac-4793-87fa-8d27ae3d242f", 2024-03-16T07:31:03.685 INFO:teuthology.orchestra.run.smithi049.stdout: "whoami": 0, 2024-03-16T07:31:03.685 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 5968, 2024-03-16T07:31:03.685 INFO:teuthology.orchestra.run.smithi049.stdout: "want_state": "up:active", 2024-03-16T07:31:03.686 INFO:teuthology.orchestra.run.smithi049.stdout: "state": "up:active", 2024-03-16T07:31:03.686 INFO:teuthology.orchestra.run.smithi049.stdout: "fs_name": "cephfs", 2024-03-16T07:31:03.686 INFO:teuthology.orchestra.run.smithi049.stdout: "rank_uptime": 4.8268066110000003, 2024-03-16T07:31:03.686 INFO:teuthology.orchestra.run.smithi049.stdout: "mdsmap_epoch": 81, 2024-03-16T07:31:03.686 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch": 119, 2024-03-16T07:31:03.686 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch_barrier": 119, 2024-03-16T07:31:03.686 INFO:teuthology.orchestra.run.smithi049.stdout: "uptime": 10.120618179999999 2024-03-16T07:31:03.686 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-03-16T07:31:03.696 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-03-16T07:31:04.038 INFO:teuthology.orchestra.run.smithi049.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-03-16T07:31:04.051 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-03-16T07:31:04.051 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-03-16T07:31:04.051 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi049.front.sepia.ceph.com 2024-03-16T07:31:04.052 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-03-16T07:31:04.052 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-03-16T07:31:04.052 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-03-16T07:31:04.052 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-03-16T07:31:04.052 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-03-16T07:31:04.052 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-03-16T07:31:04.052 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:31:04.052 DEBUG:teuthology.orchestra.run.smithi049:> ip addr 2024-03-16T07:31:04.067 INFO:teuthology.orchestra.run.smithi049.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-16T07:31:04.068 INFO:teuthology.orchestra.run.smithi049.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-16T07:31:04.068 INFO:teuthology.orchestra.run.smithi049.stdout: inet 127.0.0.1/8 scope host lo 2024-03-16T07:31:04.068 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-03-16T07:31:04.068 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 ::1/128 scope host 2024-03-16T07:31:04.068 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-03-16T07:31:04.068 INFO:teuthology.orchestra.run.smithi049.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-16T07:31:04.068 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:6b:ff:84 brd ff:ff:ff:ff:ff:ff 2024-03-16T07:31:04.068 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp7s0f0 2024-03-16T07:31:04.068 INFO:teuthology.orchestra.run.smithi049.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-16T07:31:04.068 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:6b:ff:85 brd ff:ff:ff:ff:ff:ff 2024-03-16T07:31:04.068 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp7s0f1 2024-03-16T07:31:04.068 INFO:teuthology.orchestra.run.smithi049.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-03-16T07:31:04.068 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:bd:15:66 brd ff:ff:ff:ff:ff:ff 2024-03-16T07:31:04.068 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp1s0f0 2024-03-16T07:31:04.069 INFO:teuthology.orchestra.run.smithi049.stdout: inet 172.21.15.49/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-03-16T07:31:04.069 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft 42043sec preferred_lft 42043sec 2024-03-16T07:31:04.069 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::ec4:7aff:febd:1566/64 scope link noprefixroute 2024-03-16T07:31:04.069 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-03-16T07:31:04.069 INFO:teuthology.orchestra.run.smithi049.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-16T07:31:04.069 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:bd:15:67 brd ff:ff:ff:ff:ff:ff 2024-03-16T07:31:04.069 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp1s0f1 2024-03-16T07:31:04.069 INFO:teuthology.orchestra.run.smithi049.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-03-16T07:31:04.069 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether a2:f1:88:c1:22:e7 brd ff:ff:ff:ff:ff:ff 2024-03-16T07:31:04.069 INFO:teuthology.orchestra.run.smithi049.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-03-16T07:31:04.069 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-03-16T07:31:04.069 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::e0e6:55ff:fe4d:1d68/64 scope link 2024-03-16T07:31:04.069 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-03-16T07:31:04.069 INFO:teuthology.orchestra.run.smithi049.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-03-16T07:31:04.069 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether ee:10:71:d7:68:c4 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-16T07:31:04.070 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::ec10:71ff:fed7:68c4/64 scope link 2024-03-16T07:31:04.070 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-03-16T07:31:04.070 INFO:teuthology.orchestra.run.smithi049.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-03-16T07:31:04.070 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether a2:f1:88:c1:22:e7 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-16T07:31:04.070 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::a0f1:88ff:fec1:22e7/64 scope link 2024-03-16T07:31:04.070 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-03-16T07:31:04.070 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:31:04.070 DEBUG:teuthology.orchestra.run.smithi049:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-03-16T07:31:04.137 INFO:teuthology.orchestra.run.smithi049.stdout:1 2024-03-16T07:31:04.139 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:31:04.139 DEBUG:teuthology.orchestra.run.smithi049:> route 2024-03-16T07:31:04.194 INFO:teuthology.orchestra.run.smithi049.stdout:Kernel IP routing table 2024-03-16T07:31:04.194 INFO:teuthology.orchestra.run.smithi049.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-03-16T07:31:04.194 INFO:teuthology.orchestra.run.smithi049.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-03-16T07:31:04.195 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-03-16T07:31:04.195 INFO:teuthology.orchestra.run.smithi049.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-03-16T07:31:04.195 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-16T07:31:04.195 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-03-16T07:31:04.195 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-03-16T07:31:04.195 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-03-16T07:31:04.195 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-03-16T07:31:04.195 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-03-16T07:31:04.283 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-16T07:31:04 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-16T07:31:04.335 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-16T07:31:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-16T07:31:04.341 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:31:04.341 DEBUG:teuthology.orchestra.run.smithi049:> ip netns list 2024-03-16T07:31:04.356 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 1) 2024-03-16T07:31:04.356 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-03-16T07:31:04.356 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-03-16T07:31:04.356 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:31:04.356 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link set brx.0 up 2024-03-16T07:31:04.432 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-03-16T07:31:04.432 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-16T07:31:04.432 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-03-16T07:31:04.487 INFO:teuthology.orchestra.run.smithi049.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-03-16T07:31:04.487 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-16T07:31:04.487 DEBUG:teuthology.orchestra.run.smithi049:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-03-16T07:31:04.527 INFO:tasks.ceph.mds.d.smithi049.stderr:2024-03-16T07:31:04.528+0000 7f9e719fd640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-03-16T07:31:04.541 DEBUG:teuthology.orchestra.run.smithi049:> sudo modprobe fuse 2024-03-16T07:31:04.612 DEBUG:teuthology.orchestra.run.smithi049:> cat /proc/self/mounts | awk '{print $2}' 2024-03-16T07:31:04.668 INFO:teuthology.orchestra.run.smithi049.stdout:/proc 2024-03-16T07:31:04.668 INFO:teuthology.orchestra.run.smithi049.stdout:/sys 2024-03-16T07:31:04.668 INFO:teuthology.orchestra.run.smithi049.stdout:/dev 2024-03-16T07:31:04.668 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/security 2024-03-16T07:31:04.668 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/shm 2024-03-16T07:31:04.668 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/pts 2024-03-16T07:31:04.668 INFO:teuthology.orchestra.run.smithi049.stdout:/run 2024-03-16T07:31:04.668 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/cgroup 2024-03-16T07:31:04.668 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/pstore 2024-03-16T07:31:04.668 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/bpf 2024-03-16T07:31:04.669 INFO:teuthology.orchestra.run.smithi049.stdout:/ 2024-03-16T07:31:04.669 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/selinux 2024-03-16T07:31:04.669 INFO:teuthology.orchestra.run.smithi049.stdout:/proc/sys/fs/binfmt_misc 2024-03-16T07:31:04.669 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/mqueue 2024-03-16T07:31:04.669 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/hugepages 2024-03-16T07:31:04.669 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/debug 2024-03-16T07:31:04.669 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/tracing 2024-03-16T07:31:04.669 INFO:teuthology.orchestra.run.smithi049.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-03-16T07:31:04.669 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/fuse/connections 2024-03-16T07:31:04.669 INFO:teuthology.orchestra.run.smithi049.stdout:/run/credentials/systemd-sysctl.service 2024-03-16T07:31:04.669 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/config 2024-03-16T07:31:04.669 INFO:teuthology.orchestra.run.smithi049.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-03-16T07:31:04.669 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/nfs/rpc_pipefs 2024-03-16T07:31:04.669 INFO:teuthology.orchestra.run.smithi049.stdout:/run/user/1000 2024-03-16T07:31:04.669 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph 2024-03-16T07:31:04.670 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-0 2024-03-16T07:31:04.670 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-1 2024-03-16T07:31:04.670 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-2 2024-03-16T07:31:04.670 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns 2024-03-16T07:31:04.670 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-16T07:31:04.670 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-16T07:31:04.670 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-16T07:31:04.670 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-16T07:31:04.670 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:31:04.670 DEBUG:teuthology.orchestra.run.smithi049:> ls /sys/fs/fuse/connections 2024-03-16T07:31:04.723 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-03-16T07:31:04.723 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-03-16T07:31:04.765 DEBUG:teuthology.orchestra.run.smithi049:> sudo modprobe fuse 2024-03-16T07:31:04.796 DEBUG:teuthology.orchestra.run.smithi049:> cat /proc/self/mounts | awk '{print $2}' 2024-03-16T07:31:04.854 INFO:teuthology.orchestra.run.smithi049.stdout:/proc 2024-03-16T07:31:04.854 INFO:teuthology.orchestra.run.smithi049.stdout:/sys 2024-03-16T07:31:04.854 INFO:teuthology.orchestra.run.smithi049.stdout:/dev 2024-03-16T07:31:04.855 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/security 2024-03-16T07:31:04.855 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/shm 2024-03-16T07:31:04.855 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/pts 2024-03-16T07:31:04.855 INFO:teuthology.orchestra.run.smithi049.stdout:/run 2024-03-16T07:31:04.855 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/cgroup 2024-03-16T07:31:04.855 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/pstore 2024-03-16T07:31:04.855 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/bpf 2024-03-16T07:31:04.855 INFO:teuthology.orchestra.run.smithi049.stdout:/ 2024-03-16T07:31:04.855 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/selinux 2024-03-16T07:31:04.855 INFO:teuthology.orchestra.run.smithi049.stdout:/proc/sys/fs/binfmt_misc 2024-03-16T07:31:04.855 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/mqueue 2024-03-16T07:31:04.855 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/hugepages 2024-03-16T07:31:04.855 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/debug 2024-03-16T07:31:04.855 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/tracing 2024-03-16T07:31:04.855 INFO:teuthology.orchestra.run.smithi049.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-03-16T07:31:04.856 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/fuse/connections 2024-03-16T07:31:04.856 INFO:teuthology.orchestra.run.smithi049.stdout:/run/credentials/systemd-sysctl.service 2024-03-16T07:31:04.856 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/config 2024-03-16T07:31:04.856 INFO:teuthology.orchestra.run.smithi049.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-03-16T07:31:04.856 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/nfs/rpc_pipefs 2024-03-16T07:31:04.856 INFO:teuthology.orchestra.run.smithi049.stdout:/run/user/1000 2024-03-16T07:31:04.856 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph 2024-03-16T07:31:04.856 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-0 2024-03-16T07:31:04.856 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-1 2024-03-16T07:31:04.856 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-2 2024-03-16T07:31:04.856 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns 2024-03-16T07:31:04.856 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-16T07:31:04.856 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-16T07:31:04.857 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-16T07:31:04.857 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-16T07:31:04.857 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:31:04.857 DEBUG:teuthology.orchestra.run.smithi049:> ls /sys/fs/fuse/connections 2024-03-16T07:31:04.860 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi049.stderr:2024-03-16T07:31:04.861+0000 7f9ebf84b480 -1 init, newargv = 0x564beea1e400 newargc=15 2024-03-16T07:31:04.860 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi049.stderr:ceph-fuse[70210]: starting ceph client 2024-03-16T07:31:04.864 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi049.stderr:ceph-fuse[70210]: starting fuse 2024-03-16T07:31:04.876 INFO:teuthology.orchestra.run.smithi049.stdout:41 2024-03-16T07:31:04.876 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2024-03-16T07:31:04.877 DEBUG:teuthology.orchestra.run.smithi049:> sudo stdin-killer -- python3 -c ' 2024-03-16T07:31:04.877 DEBUG:teuthology.orchestra.run.smithi049:> import glob 2024-03-16T07:31:04.877 DEBUG:teuthology.orchestra.run.smithi049:> import re 2024-03-16T07:31:04.877 DEBUG:teuthology.orchestra.run.smithi049:> import os 2024-03-16T07:31:04.877 DEBUG:teuthology.orchestra.run.smithi049:> import subprocess 2024-03-16T07:31:04.877 DEBUG:teuthology.orchestra.run.smithi049:> 2024-03-16T07:31:04.877 DEBUG:teuthology.orchestra.run.smithi049:> def _find_admin_socket(client_name): 2024-03-16T07:31:04.877 DEBUG:teuthology.orchestra.run.smithi049:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-03-16T07:31:04.877 DEBUG:teuthology.orchestra.run.smithi049:> files = glob.glob(asok_path) 2024-03-16T07:31:04.877 DEBUG:teuthology.orchestra.run.smithi049:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-03-16T07:31:04.877 DEBUG:teuthology.orchestra.run.smithi049:> 2024-03-16T07:31:04.877 DEBUG:teuthology.orchestra.run.smithi049:> # Given a non-glob path, it better be there 2024-03-16T07:31:04.877 DEBUG:teuthology.orchestra.run.smithi049:> if "*" not in asok_path: 2024-03-16T07:31:04.877 DEBUG:teuthology.orchestra.run.smithi049:> assert(len(files) == 1) 2024-03-16T07:31:04.877 DEBUG:teuthology.orchestra.run.smithi049:> return files[0] 2024-03-16T07:31:04.878 DEBUG:teuthology.orchestra.run.smithi049:> 2024-03-16T07:31:04.878 DEBUG:teuthology.orchestra.run.smithi049:> for f in files: 2024-03-16T07:31:04.878 DEBUG:teuthology.orchestra.run.smithi049:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-03-16T07:31:04.878 DEBUG:teuthology.orchestra.run.smithi049:> if os.path.exists("/proc/{0}".format(pid)): 2024-03-16T07:31:04.878 DEBUG:teuthology.orchestra.run.smithi049:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-03-16T07:31:04.878 DEBUG:teuthology.orchestra.run.smithi049:> contents = proc_f.read() 2024-03-16T07:31:04.878 DEBUG:teuthology.orchestra.run.smithi049:> if mountpoint in contents: 2024-03-16T07:31:04.878 DEBUG:teuthology.orchestra.run.smithi049:> return f 2024-03-16T07:31:04.878 DEBUG:teuthology.orchestra.run.smithi049:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-03-16T07:31:04.878 DEBUG:teuthology.orchestra.run.smithi049:> 2024-03-16T07:31:04.878 DEBUG:teuthology.orchestra.run.smithi049:> print(_find_admin_socket("client.0")) 2024-03-16T07:31:04.878 DEBUG:teuthology.orchestra.run.smithi049:> ' 2024-03-16T07:31:05.002 INFO:teuthology.orchestra.run.smithi049.stdout:/var/run/ceph/ceph-client.0.70210.asok 2024-03-16T07:31:05.005 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-16T07:31:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-16T07:31:05.013 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.70210.asok 2024-03-16T07:31:05.013 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:31:05.013 DEBUG:teuthology.orchestra.run.smithi049:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.70210.asok status 2024-03-16T07:31:05.155 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-03-16T07:31:05.155 INFO:teuthology.orchestra.run.smithi049.stdout: "metadata": { 2024-03-16T07:31:05.156 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph_sha1": "3d78f5ba07bf18880172c07d4d7b4ac00c9d30af", 2024-03-16T07:31:05.156 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph_version": "ceph version 19.0.0-2162-g3d78f5ba (3d78f5ba07bf18880172c07d4d7b4ac00c9d30af) squid (dev)", 2024-03-16T07:31:05.156 INFO:teuthology.orchestra.run.smithi049.stdout: "entity_id": "0", 2024-03-16T07:31:05.156 INFO:teuthology.orchestra.run.smithi049.stdout: "hostname": "smithi049", 2024-03-16T07:31:05.156 INFO:teuthology.orchestra.run.smithi049.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-03-16T07:31:05.156 INFO:teuthology.orchestra.run.smithi049.stdout: "pid": "70210", 2024-03-16T07:31:05.156 INFO:teuthology.orchestra.run.smithi049.stdout: "root": "/" 2024-03-16T07:31:05.156 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:31:05.156 INFO:teuthology.orchestra.run.smithi049.stdout: "dentry_count": 0, 2024-03-16T07:31:05.156 INFO:teuthology.orchestra.run.smithi049.stdout: "dentry_pinned_count": 0, 2024-03-16T07:31:05.156 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 6035, 2024-03-16T07:31:05.156 INFO:teuthology.orchestra.run.smithi049.stdout: "inst": { 2024-03-16T07:31:05.156 INFO:teuthology.orchestra.run.smithi049.stdout: "name": { 2024-03-16T07:31:05.156 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "client", 2024-03-16T07:31:05.156 INFO:teuthology.orchestra.run.smithi049.stdout: "num": 6035 2024-03-16T07:31:05.156 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:31:05.156 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": { 2024-03-16T07:31:05.157 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2024-03-16T07:31:05.157 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "192.168.0.1:0", 2024-03-16T07:31:05.157 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 2015109472 2024-03-16T07:31:05.157 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:31:05.157 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:31:05.157 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": { 2024-03-16T07:31:05.157 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2024-03-16T07:31:05.157 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "192.168.0.1:0", 2024-03-16T07:31:05.157 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 2015109472 2024-03-16T07:31:05.157 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:31:05.157 INFO:teuthology.orchestra.run.smithi049.stdout: "inst_str": "client.6035 192.168.0.1:0/2015109472", 2024-03-16T07:31:05.157 INFO:teuthology.orchestra.run.smithi049.stdout: "addr_str": "192.168.0.1:0/2015109472", 2024-03-16T07:31:05.157 INFO:teuthology.orchestra.run.smithi049.stdout: "inode_count": 1, 2024-03-16T07:31:05.157 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_epoch": 81, 2024-03-16T07:31:05.157 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_epoch": 119, 2024-03-16T07:31:05.157 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_epoch_barrier": 0, 2024-03-16T07:31:05.157 INFO:teuthology.orchestra.run.smithi049.stdout: "blocklisted": false, 2024-03-16T07:31:05.158 INFO:teuthology.orchestra.run.smithi049.stdout: "fs_name": "cephfs" 2024-03-16T07:31:05.158 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-03-16T07:31:05.164 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:31:05.164 DEBUG:teuthology.orchestra.run.smithi049:> stat --file-system '--printf=%T 2024-03-16T07:31:05.164 DEBUG:teuthology.orchestra.run.smithi049:> ' -- /home/ubuntu/cephtest/mnt.0 2024-03-16T07:31:05.179 INFO:teuthology.orchestra.run.smithi049.stdout:fuseblk 2024-03-16T07:31:05.179 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-03-16T07:31:05.179 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:31:05.180 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-03-16T07:31:05.249 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-03-16T07:31:05.648 INFO:teuthology.orchestra.run.smithi049.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-03-16T07:31:05.661 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-03-16T07:31:05.661 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-03-16T07:31:05.661 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi049.front.sepia.ceph.com 2024-03-16T07:31:05.661 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-03-16T07:31:05.661 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-03-16T07:31:05.661 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-03-16T07:31:05.661 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-03-16T07:31:05.661 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-03-16T07:31:05.661 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-03-16T07:31:05.661 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:31:05.662 DEBUG:teuthology.orchestra.run.smithi049:> ip addr 2024-03-16T07:31:05.677 INFO:teuthology.orchestra.run.smithi049.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-16T07:31:05.677 INFO:teuthology.orchestra.run.smithi049.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-16T07:31:05.677 INFO:teuthology.orchestra.run.smithi049.stdout: inet 127.0.0.1/8 scope host lo 2024-03-16T07:31:05.677 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-03-16T07:31:05.677 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 ::1/128 scope host 2024-03-16T07:31:05.677 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-03-16T07:31:05.678 INFO:teuthology.orchestra.run.smithi049.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-16T07:31:05.678 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:6b:ff:84 brd ff:ff:ff:ff:ff:ff 2024-03-16T07:31:05.678 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp7s0f0 2024-03-16T07:31:05.678 INFO:teuthology.orchestra.run.smithi049.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-16T07:31:05.678 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:6b:ff:85 brd ff:ff:ff:ff:ff:ff 2024-03-16T07:31:05.678 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp7s0f1 2024-03-16T07:31:05.678 INFO:teuthology.orchestra.run.smithi049.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-03-16T07:31:05.678 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:bd:15:66 brd ff:ff:ff:ff:ff:ff 2024-03-16T07:31:05.678 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp1s0f0 2024-03-16T07:31:05.678 INFO:teuthology.orchestra.run.smithi049.stdout: inet 172.21.15.49/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-03-16T07:31:05.678 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft 42042sec preferred_lft 42042sec 2024-03-16T07:31:05.678 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::ec4:7aff:febd:1566/64 scope link noprefixroute 2024-03-16T07:31:05.678 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-03-16T07:31:05.678 INFO:teuthology.orchestra.run.smithi049.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-16T07:31:05.678 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:bd:15:67 brd ff:ff:ff:ff:ff:ff 2024-03-16T07:31:05.679 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp1s0f1 2024-03-16T07:31:05.679 INFO:teuthology.orchestra.run.smithi049.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-03-16T07:31:05.679 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether a2:f1:88:c1:22:e7 brd ff:ff:ff:ff:ff:ff 2024-03-16T07:31:05.679 INFO:teuthology.orchestra.run.smithi049.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-03-16T07:31:05.679 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-03-16T07:31:05.679 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::e0e6:55ff:fe4d:1d68/64 scope link 2024-03-16T07:31:05.679 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-03-16T07:31:05.679 INFO:teuthology.orchestra.run.smithi049.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-03-16T07:31:05.679 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether ee:10:71:d7:68:c4 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-16T07:31:05.679 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::ec10:71ff:fed7:68c4/64 scope link 2024-03-16T07:31:05.679 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-03-16T07:31:05.679 INFO:teuthology.orchestra.run.smithi049.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-03-16T07:31:05.679 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether a2:f1:88:c1:22:e7 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-16T07:31:05.679 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::a0f1:88ff:fec1:22e7/64 scope link 2024-03-16T07:31:05.679 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-03-16T07:31:05.680 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:31:05.680 DEBUG:teuthology.orchestra.run.smithi049:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-03-16T07:31:05.746 INFO:teuthology.orchestra.run.smithi049.stdout:1 2024-03-16T07:31:05.747 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:31:05.747 DEBUG:teuthology.orchestra.run.smithi049:> route 2024-03-16T07:31:05.803 INFO:teuthology.orchestra.run.smithi049.stdout:Kernel IP routing table 2024-03-16T07:31:05.803 INFO:teuthology.orchestra.run.smithi049.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-03-16T07:31:05.803 INFO:teuthology.orchestra.run.smithi049.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-03-16T07:31:05.803 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-03-16T07:31:05.803 INFO:teuthology.orchestra.run.smithi049.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-03-16T07:31:05.804 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-16T07:31:05.804 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-03-16T07:31:05.804 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-03-16T07:31:05.804 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-03-16T07:31:05.804 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-03-16T07:31:05.804 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-03-16T07:31:05.894 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-16T07:31:05 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-16T07:31:05.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-16T07:31:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-16T07:31:05.952 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:31:05.952 DEBUG:teuthology.orchestra.run.smithi049:> ip netns list 2024-03-16T07:31:05.967 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 1) 2024-03-16T07:31:05.967 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-03-16T07:31:05.967 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-03-16T07:31:05.967 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:31:05.967 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link set brx.1 up 2024-03-16T07:31:06.037 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-03-16T07:31:06.037 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-16T07:31:06.037 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-03-16T07:31:06.092 INFO:teuthology.orchestra.run.smithi049.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-03-16T07:31:06.092 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-16T07:31:06.092 DEBUG:teuthology.orchestra.run.smithi049:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-03-16T07:31:06.147 DEBUG:teuthology.orchestra.run.smithi049:> sudo modprobe fuse 2024-03-16T07:31:06.217 DEBUG:teuthology.orchestra.run.smithi049:> cat /proc/self/mounts | awk '{print $2}' 2024-03-16T07:31:06.274 INFO:teuthology.orchestra.run.smithi049.stdout:/proc 2024-03-16T07:31:06.274 INFO:teuthology.orchestra.run.smithi049.stdout:/sys 2024-03-16T07:31:06.274 INFO:teuthology.orchestra.run.smithi049.stdout:/dev 2024-03-16T07:31:06.274 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/security 2024-03-16T07:31:06.274 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/shm 2024-03-16T07:31:06.274 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/pts 2024-03-16T07:31:06.274 INFO:teuthology.orchestra.run.smithi049.stdout:/run 2024-03-16T07:31:06.274 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/cgroup 2024-03-16T07:31:06.274 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/pstore 2024-03-16T07:31:06.275 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/bpf 2024-03-16T07:31:06.275 INFO:teuthology.orchestra.run.smithi049.stdout:/ 2024-03-16T07:31:06.275 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/selinux 2024-03-16T07:31:06.275 INFO:teuthology.orchestra.run.smithi049.stdout:/proc/sys/fs/binfmt_misc 2024-03-16T07:31:06.275 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/mqueue 2024-03-16T07:31:06.275 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/hugepages 2024-03-16T07:31:06.275 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/debug 2024-03-16T07:31:06.275 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/tracing 2024-03-16T07:31:06.275 INFO:teuthology.orchestra.run.smithi049.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-03-16T07:31:06.275 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/fuse/connections 2024-03-16T07:31:06.275 INFO:teuthology.orchestra.run.smithi049.stdout:/run/credentials/systemd-sysctl.service 2024-03-16T07:31:06.275 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/config 2024-03-16T07:31:06.275 INFO:teuthology.orchestra.run.smithi049.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-03-16T07:31:06.275 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/nfs/rpc_pipefs 2024-03-16T07:31:06.275 INFO:teuthology.orchestra.run.smithi049.stdout:/run/user/1000 2024-03-16T07:31:06.276 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph 2024-03-16T07:31:06.276 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-0 2024-03-16T07:31:06.276 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-1 2024-03-16T07:31:06.276 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-2 2024-03-16T07:31:06.276 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns 2024-03-16T07:31:06.276 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-16T07:31:06.276 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-16T07:31:06.276 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-16T07:31:06.276 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-16T07:31:06.276 INFO:teuthology.orchestra.run.smithi049.stdout:/home/ubuntu/cephtest/mnt.0 2024-03-16T07:31:06.276 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:31:06.276 DEBUG:teuthology.orchestra.run.smithi049:> ls /sys/fs/fuse/connections 2024-03-16T07:31:06.330 INFO:teuthology.orchestra.run.smithi049.stdout:41 2024-03-16T07:31:06.330 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [41] 2024-03-16T07:31:06.330 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-03-16T07:31:06.372 DEBUG:teuthology.orchestra.run.smithi049:> sudo modprobe fuse 2024-03-16T07:31:06.403 DEBUG:teuthology.orchestra.run.smithi049:> cat /proc/self/mounts | awk '{print $2}' 2024-03-16T07:31:06.459 INFO:teuthology.orchestra.run.smithi049.stdout:/proc 2024-03-16T07:31:06.460 INFO:teuthology.orchestra.run.smithi049.stdout:/sys 2024-03-16T07:31:06.460 INFO:teuthology.orchestra.run.smithi049.stdout:/dev 2024-03-16T07:31:06.460 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/security 2024-03-16T07:31:06.460 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/shm 2024-03-16T07:31:06.460 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/pts 2024-03-16T07:31:06.460 INFO:teuthology.orchestra.run.smithi049.stdout:/run 2024-03-16T07:31:06.460 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/cgroup 2024-03-16T07:31:06.460 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/pstore 2024-03-16T07:31:06.460 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/bpf 2024-03-16T07:31:06.460 INFO:teuthology.orchestra.run.smithi049.stdout:/ 2024-03-16T07:31:06.460 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/selinux 2024-03-16T07:31:06.461 INFO:teuthology.orchestra.run.smithi049.stdout:/proc/sys/fs/binfmt_misc 2024-03-16T07:31:06.461 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/mqueue 2024-03-16T07:31:06.461 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/hugepages 2024-03-16T07:31:06.461 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/debug 2024-03-16T07:31:06.461 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/tracing 2024-03-16T07:31:06.461 INFO:teuthology.orchestra.run.smithi049.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-03-16T07:31:06.461 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/fuse/connections 2024-03-16T07:31:06.461 INFO:teuthology.orchestra.run.smithi049.stdout:/run/credentials/systemd-sysctl.service 2024-03-16T07:31:06.461 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/config 2024-03-16T07:31:06.461 INFO:teuthology.orchestra.run.smithi049.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-03-16T07:31:06.461 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/nfs/rpc_pipefs 2024-03-16T07:31:06.461 INFO:teuthology.orchestra.run.smithi049.stdout:/run/user/1000 2024-03-16T07:31:06.461 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph 2024-03-16T07:31:06.461 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-0 2024-03-16T07:31:06.462 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-1 2024-03-16T07:31:06.462 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-2 2024-03-16T07:31:06.462 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns 2024-03-16T07:31:06.462 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-16T07:31:06.462 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-16T07:31:06.462 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-16T07:31:06.462 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-16T07:31:06.462 INFO:teuthology.orchestra.run.smithi049.stdout:/home/ubuntu/cephtest/mnt.0 2024-03-16T07:31:06.463 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:31:06.463 DEBUG:teuthology.orchestra.run.smithi049:> ls /sys/fs/fuse/connections 2024-03-16T07:31:06.467 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi049.stderr:2024-03-16T07:31:06.469+0000 7f8f6835e480 -1 init, newargv = 0x564e60dc1f80 newargc=15 2024-03-16T07:31:06.468 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi049.stderr:ceph-fuse[70628]: starting ceph client 2024-03-16T07:31:06.471 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi049.stderr:ceph-fuse[70628]: starting fuse 2024-03-16T07:31:06.484 INFO:teuthology.orchestra.run.smithi049.stdout:41 2024-03-16T07:31:06.484 INFO:teuthology.orchestra.run.smithi049.stdout:44 2024-03-16T07:31:06.484 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41, 44] 2024-03-16T07:31:06.484 DEBUG:teuthology.orchestra.run.smithi049:> sudo stdin-killer -- python3 -c ' 2024-03-16T07:31:06.484 DEBUG:teuthology.orchestra.run.smithi049:> import glob 2024-03-16T07:31:06.484 DEBUG:teuthology.orchestra.run.smithi049:> import re 2024-03-16T07:31:06.484 DEBUG:teuthology.orchestra.run.smithi049:> import os 2024-03-16T07:31:06.484 DEBUG:teuthology.orchestra.run.smithi049:> import subprocess 2024-03-16T07:31:06.484 DEBUG:teuthology.orchestra.run.smithi049:> 2024-03-16T07:31:06.485 DEBUG:teuthology.orchestra.run.smithi049:> def _find_admin_socket(client_name): 2024-03-16T07:31:06.485 DEBUG:teuthology.orchestra.run.smithi049:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-03-16T07:31:06.485 DEBUG:teuthology.orchestra.run.smithi049:> files = glob.glob(asok_path) 2024-03-16T07:31:06.485 DEBUG:teuthology.orchestra.run.smithi049:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-03-16T07:31:06.485 DEBUG:teuthology.orchestra.run.smithi049:> 2024-03-16T07:31:06.485 DEBUG:teuthology.orchestra.run.smithi049:> # Given a non-glob path, it better be there 2024-03-16T07:31:06.485 DEBUG:teuthology.orchestra.run.smithi049:> if "*" not in asok_path: 2024-03-16T07:31:06.485 DEBUG:teuthology.orchestra.run.smithi049:> assert(len(files) == 1) 2024-03-16T07:31:06.485 DEBUG:teuthology.orchestra.run.smithi049:> return files[0] 2024-03-16T07:31:06.485 DEBUG:teuthology.orchestra.run.smithi049:> 2024-03-16T07:31:06.485 DEBUG:teuthology.orchestra.run.smithi049:> for f in files: 2024-03-16T07:31:06.485 DEBUG:teuthology.orchestra.run.smithi049:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-03-16T07:31:06.485 DEBUG:teuthology.orchestra.run.smithi049:> if os.path.exists("/proc/{0}".format(pid)): 2024-03-16T07:31:06.485 DEBUG:teuthology.orchestra.run.smithi049:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-03-16T07:31:06.486 DEBUG:teuthology.orchestra.run.smithi049:> contents = proc_f.read() 2024-03-16T07:31:06.486 DEBUG:teuthology.orchestra.run.smithi049:> if mountpoint in contents: 2024-03-16T07:31:06.486 DEBUG:teuthology.orchestra.run.smithi049:> return f 2024-03-16T07:31:06.486 DEBUG:teuthology.orchestra.run.smithi049:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-03-16T07:31:06.486 DEBUG:teuthology.orchestra.run.smithi049:> 2024-03-16T07:31:06.486 DEBUG:teuthology.orchestra.run.smithi049:> print(_find_admin_socket("client.1")) 2024-03-16T07:31:06.486 DEBUG:teuthology.orchestra.run.smithi049:> ' 2024-03-16T07:31:06.621 INFO:teuthology.orchestra.run.smithi049.stdout:/var/run/ceph/ceph-client.1.70628.asok 2024-03-16T07:31:06.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-16T07:31:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-16T07:31:06.634 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.70628.asok 2024-03-16T07:31:06.634 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:31:06.634 DEBUG:teuthology.orchestra.run.smithi049:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.70628.asok status 2024-03-16T07:31:06.777 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-03-16T07:31:06.777 INFO:teuthology.orchestra.run.smithi049.stdout: "metadata": { 2024-03-16T07:31:06.777 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph_sha1": "3d78f5ba07bf18880172c07d4d7b4ac00c9d30af", 2024-03-16T07:31:06.777 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph_version": "ceph version 19.0.0-2162-g3d78f5ba (3d78f5ba07bf18880172c07d4d7b4ac00c9d30af) squid (dev)", 2024-03-16T07:31:06.777 INFO:teuthology.orchestra.run.smithi049.stdout: "entity_id": "1", 2024-03-16T07:31:06.777 INFO:teuthology.orchestra.run.smithi049.stdout: "hostname": "smithi049", 2024-03-16T07:31:06.777 INFO:teuthology.orchestra.run.smithi049.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-03-16T07:31:06.777 INFO:teuthology.orchestra.run.smithi049.stdout: "pid": "70628", 2024-03-16T07:31:06.777 INFO:teuthology.orchestra.run.smithi049.stdout: "root": "/" 2024-03-16T07:31:06.777 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:31:06.777 INFO:teuthology.orchestra.run.smithi049.stdout: "dentry_count": 0, 2024-03-16T07:31:06.778 INFO:teuthology.orchestra.run.smithi049.stdout: "dentry_pinned_count": 0, 2024-03-16T07:31:06.778 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 6041, 2024-03-16T07:31:06.778 INFO:teuthology.orchestra.run.smithi049.stdout: "inst": { 2024-03-16T07:31:06.778 INFO:teuthology.orchestra.run.smithi049.stdout: "name": { 2024-03-16T07:31:06.778 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "client", 2024-03-16T07:31:06.778 INFO:teuthology.orchestra.run.smithi049.stdout: "num": 6041 2024-03-16T07:31:06.778 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:31:06.778 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": { 2024-03-16T07:31:06.778 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2024-03-16T07:31:06.778 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "192.168.0.2:0", 2024-03-16T07:31:06.778 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 401321220 2024-03-16T07:31:06.778 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:31:06.778 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:31:06.778 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": { 2024-03-16T07:31:06.778 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2024-03-16T07:31:06.778 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "192.168.0.2:0", 2024-03-16T07:31:06.778 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 401321220 2024-03-16T07:31:06.779 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:31:06.779 INFO:teuthology.orchestra.run.smithi049.stdout: "inst_str": "client.6041 192.168.0.2:0/401321220", 2024-03-16T07:31:06.779 INFO:teuthology.orchestra.run.smithi049.stdout: "addr_str": "192.168.0.2:0/401321220", 2024-03-16T07:31:06.779 INFO:teuthology.orchestra.run.smithi049.stdout: "inode_count": 1, 2024-03-16T07:31:06.779 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_epoch": 81, 2024-03-16T07:31:06.779 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_epoch": 119, 2024-03-16T07:31:06.779 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_epoch_barrier": 0, 2024-03-16T07:31:06.779 INFO:teuthology.orchestra.run.smithi049.stdout: "blocklisted": false, 2024-03-16T07:31:06.779 INFO:teuthology.orchestra.run.smithi049.stdout: "fs_name": "cephfs" 2024-03-16T07:31:06.779 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-03-16T07:31:06.785 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:31:06.785 DEBUG:teuthology.orchestra.run.smithi049:> stat --file-system '--printf=%T 2024-03-16T07:31:06.785 DEBUG:teuthology.orchestra.run.smithi049:> ' -- /home/ubuntu/cephtest/mnt.1 2024-03-16T07:31:06.801 INFO:teuthology.orchestra.run.smithi049.stdout:fuseblk 2024-03-16T07:31:06.801 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-03-16T07:31:06.801 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:31:06.801 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-03-16T07:31:06.873 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2024-03-16T07:31:07.954 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T07:31:08.320 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:31:08.320 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":119,"fsid":"f91af061-9eac-4793-87fa-8d27ae3d242f","created":"2024-03-16T07:24:20.357868+0000","modified":"2024-03-16T07:30:59.550794+0000","last_up_change":"2024-03-16T07:24:27.474980+0000","last_in_change":"2024-03-16T07:24:21.254179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T07:24:28.947521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2024-03-16T07:30:56.548783+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2024-03-16T07:30:57.216365+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"119","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2df14aac-98dc-4e3c-ae7e-9eb677aa30be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6801","nonce":2744935777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6803","nonce":2744935777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6807","nonce":2744935777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6805","nonce":2744935777}]},"public_addr":"172.21.15.49:6801/2744935777","cluster_addr":"172.21.15.49:6803/2744935777","heartbeat_back_addr":"172.21.15.49:6807/2744935777","heartbeat_front_addr":"172.21.15.49:6805/2744935777","state":["exists","up"]},{"osd":1,"uuid":"80461bd9-59ef-46df-9eea-bad92d960c57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6811","nonce":1655120118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6815","nonce":1655120118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6821","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6823","nonce":1655120118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6817","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6819","nonce":1655120118}]},"public_addr":"172.21.15.49:6811/1655120118","cluster_addr":"172.21.15.49:6815/1655120118","heartbeat_back_addr":"172.21.15.49:6823/1655120118","heartbeat_front_addr":"172.21.15.49:6819/1655120118","state":["exists","up"]},{"osd":2,"uuid":"d6bf40eb-6e42-4ec9-8b3d-0b6c5a6def79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6810","nonce":3815472376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6814","nonce":3815472376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6822","nonce":3815472376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6818","nonce":3815472376}]},"public_addr":"172.21.15.49:6810/3815472376","cluster_addr":"172.21.15.49:6814/3815472376","heartbeat_back_addr":"172.21.15.49:6822/3815472376","heartbeat_front_addr":"172.21.15.49:6818/3815472376","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.641492+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.668598+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.614940+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T07:31:08.333 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-16T07:24:28.947521+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 20, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-16T07:30:56.548783+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '118', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 21, 'pool_name': 'cephfs_data', 'create_time': '2024-03-16T07:30:57.216365+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '119', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-16T07:31:08.333 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-16T07:31:08.636 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2024-03-16T07:31:08.648 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-16T07:31:08.748 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T07:31:08.972 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2024-03-16T07:31:08.985 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-16T07:31:09.288 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2024-03-16T07:31:09.301 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-03-16T07:31:09.679 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:31:09.679 INFO:teuthology.orchestra.run.smithi049.stdout:[ 2024-03-16T07:31:09.679 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:31:09.679 INFO:teuthology.orchestra.run.smithi049.stdout: "poolnum": 1, 2024-03-16T07:31:09.679 INFO:teuthology.orchestra.run.smithi049.stdout: "poolname": ".mgr" 2024-03-16T07:31:09.679 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:31:09.679 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:31:09.679 INFO:teuthology.orchestra.run.smithi049.stdout: "poolnum": 20, 2024-03-16T07:31:09.679 INFO:teuthology.orchestra.run.smithi049.stdout: "poolname": "cephfs_metadata" 2024-03-16T07:31:09.679 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:31:09.679 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:31:09.679 INFO:teuthology.orchestra.run.smithi049.stdout: "poolnum": 21, 2024-03-16T07:31:09.680 INFO:teuthology.orchestra.run.smithi049.stdout: "poolname": "cephfs_data" 2024-03-16T07:31:09.680 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:31:09.680 INFO:teuthology.orchestra.run.smithi049.stdout:] 2024-03-16T07:31:09.692 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'backup_fs' 2024-03-16T07:31:09.692 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create backup_fs_metadata --pg_num_min 64 2024-03-16T07:31:10.946 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'backup_fs_metadata' created 2024-03-16T07:31:10.967 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create backup_fs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-03-16T07:31:11.947 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'backup_fs_data' created 2024-03-16T07:31:11.980 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new backup_fs backup_fs_metadata backup_fs_data 2024-03-16T07:31:12.960 INFO:teuthology.orchestra.run.smithi049.stderr:new fs with metadata pool 22 and data pool 23 2024-03-16T07:31:12.991 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T07:31:13.409 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:31:13.410 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":122,"fsid":"f91af061-9eac-4793-87fa-8d27ae3d242f","created":"2024-03-16T07:24:20.357868+0000","modified":"2024-03-16T07:31:12.498253+0000","last_up_change":"2024-03-16T07:24:27.474980+0000","last_in_change":"2024-03-16T07:24:21.254179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T07:24:28.947521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2024-03-16T07:30:56.548783+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2024-03-16T07:30:57.216365+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"119","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"backup_fs_metadata","create_time":"2024-03-16T07:31:10.087893+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"backup_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.309999942779541,"score_stable":1.309999942779541,"optimal_score":1,"raw_score_acting":1.309999942779541,"raw_score_stable":1.309999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"backup_fs_data","create_time":"2024-03-16T07:31:11.310351+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"backup_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1699999570846558,"score_stable":1.1699999570846558,"optimal_score":1,"raw_score_acting":1.1699999570846558,"raw_score_stable":1.1699999570846558,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2df14aac-98dc-4e3c-ae7e-9eb677aa30be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6801","nonce":2744935777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6803","nonce":2744935777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6807","nonce":2744935777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6805","nonce":2744935777}]},"public_addr":"172.21.15.49:6801/2744935777","cluster_addr":"172.21.15.49:6803/2744935777","heartbeat_back_addr":"172.21.15.49:6807/2744935777","heartbeat_front_addr":"172.21.15.49:6805/2744935777","state":["exists","up"]},{"osd":1,"uuid":"80461bd9-59ef-46df-9eea-bad92d960c57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6811","nonce":1655120118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6815","nonce":1655120118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6821","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6823","nonce":1655120118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6817","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6819","nonce":1655120118}]},"public_addr":"172.21.15.49:6811/1655120118","cluster_addr":"172.21.15.49:6815/1655120118","heartbeat_back_addr":"172.21.15.49:6823/1655120118","heartbeat_front_addr":"172.21.15.49:6819/1655120118","state":["exists","up"]},{"osd":2,"uuid":"d6bf40eb-6e42-4ec9-8b3d-0b6c5a6def79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6810","nonce":3815472376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6814","nonce":3815472376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6822","nonce":3815472376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6818","nonce":3815472376}]},"public_addr":"172.21.15.49:6810/3815472376","cluster_addr":"172.21.15.49:6814/3815472376","heartbeat_back_addr":"172.21.15.49:6822/3815472376","heartbeat_front_addr":"172.21.15.49:6818/3815472376","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.641492+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.668598+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.614940+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T07:31:13.428 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T07:31:13.737 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:31:13.737 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":122,"fsid":"f91af061-9eac-4793-87fa-8d27ae3d242f","created":"2024-03-16T07:24:20.357868+0000","modified":"2024-03-16T07:31:12.498253+0000","last_up_change":"2024-03-16T07:24:27.474980+0000","last_in_change":"2024-03-16T07:24:21.254179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T07:24:28.947521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2024-03-16T07:30:56.548783+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2024-03-16T07:30:57.216365+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"119","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"backup_fs_metadata","create_time":"2024-03-16T07:31:10.087893+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"backup_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.309999942779541,"score_stable":1.309999942779541,"optimal_score":1,"raw_score_acting":1.309999942779541,"raw_score_stable":1.309999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"backup_fs_data","create_time":"2024-03-16T07:31:11.310351+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"backup_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1699999570846558,"score_stable":1.1699999570846558,"optimal_score":1,"raw_score_acting":1.1699999570846558,"raw_score_stable":1.1699999570846558,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2df14aac-98dc-4e3c-ae7e-9eb677aa30be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6801","nonce":2744935777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6803","nonce":2744935777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6807","nonce":2744935777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6805","nonce":2744935777}]},"public_addr":"172.21.15.49:6801/2744935777","cluster_addr":"172.21.15.49:6803/2744935777","heartbeat_back_addr":"172.21.15.49:6807/2744935777","heartbeat_front_addr":"172.21.15.49:6805/2744935777","state":["exists","up"]},{"osd":1,"uuid":"80461bd9-59ef-46df-9eea-bad92d960c57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6811","nonce":1655120118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6815","nonce":1655120118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6821","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6823","nonce":1655120118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6817","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6819","nonce":1655120118}]},"public_addr":"172.21.15.49:6811/1655120118","cluster_addr":"172.21.15.49:6815/1655120118","heartbeat_back_addr":"172.21.15.49:6823/1655120118","heartbeat_front_addr":"172.21.15.49:6819/1655120118","state":["exists","up"]},{"osd":2,"uuid":"d6bf40eb-6e42-4ec9-8b3d-0b6c5a6def79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6810","nonce":3815472376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6814","nonce":3815472376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6822","nonce":3815472376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6818","nonce":3815472376}]},"public_addr":"172.21.15.49:6810/3815472376","cluster_addr":"172.21.15.49:6814/3815472376","heartbeat_back_addr":"172.21.15.49:6822/3815472376","heartbeat_front_addr":"172.21.15.49:6818/3815472376","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.641492+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.668598+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.614940+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T07:31:13.750 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set backup_fs standby_count_wanted 0 2024-03-16T07:31:14.527 INFO:tasks.ceph.mds.c.smithi049.stderr:2024-03-16T07:31:14.527+0000 7fdfd00aa640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-03-16T07:31:14.981 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-03-16T07:31:14.981 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set backup_fs allow_standby_replay false 2024-03-16T07:31:15.988 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'backup_fs' 2024-03-16T07:31:15.989 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T07:31:16.334 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:31:16.334 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":87,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5957,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6827/2832753094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":2832753094},{"type":"v1","addr":"172.21.15.49:6827","nonce":2832753094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":78},{"gid":5961,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6829/3236120377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":3236120377},{"type":"v1","addr":"172.21.15.49:6829","nonce":3236120377}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":78},{"gid":5964,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6831/1238434429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":1238434429},{"type":"v1","addr":"172.21.15.49:6831","nonce":1238434429}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":78}],"filesystems":[{"mdsmap":{"epoch":81,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-16T07:30:58.238420+0000","modified":"2024-03-16T07:31:00.495716+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5968},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5968":{"gid":5968,"name":"d","rank":0,"incarnation":79,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6835/790210824","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":790210824},{"type":"v1","addr":"172.21.15.49:6835","nonce":790210824}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5968,"qdb_cluster":[5968]},"id":10},{"mdsmap":{"epoch":87,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-16T07:31:12.498747+0000","modified":"2024-03-16T07:31:15.331790+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5965},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5965":{"gid":5965,"name":"c","rank":0,"incarnation":83,"state":"up:active","state_seq":6,"addr":"172.21.15.49:6833/4146414383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":4146414383},{"type":"v1","addr":"172.21.15.49:6833","nonce":4146414383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"backup_fs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5965,"qdb_cluster":[5965]},"id":11}]} 2024-03-16T07:31:16.335 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 87 2024-03-16T07:31:16.347 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T07:31:16.656 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:31:16.656 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":123,"fsid":"f91af061-9eac-4793-87fa-8d27ae3d242f","created":"2024-03-16T07:24:20.357868+0000","modified":"2024-03-16T07:31:13.959615+0000","last_up_change":"2024-03-16T07:24:27.474980+0000","last_in_change":"2024-03-16T07:24:21.254179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T07:24:28.947521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2024-03-16T07:30:56.548783+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2024-03-16T07:30:57.216365+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"119","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"backup_fs_metadata","create_time":"2024-03-16T07:31:10.087893+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"backup_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.309999942779541,"score_stable":1.309999942779541,"optimal_score":1,"raw_score_acting":1.309999942779541,"raw_score_stable":1.309999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"backup_fs_data","create_time":"2024-03-16T07:31:11.310351+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"123","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"backup_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1699999570846558,"score_stable":1.1699999570846558,"optimal_score":1,"raw_score_acting":1.1699999570846558,"raw_score_stable":1.1699999570846558,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2df14aac-98dc-4e3c-ae7e-9eb677aa30be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6801","nonce":2744935777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6803","nonce":2744935777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6807","nonce":2744935777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6805","nonce":2744935777}]},"public_addr":"172.21.15.49:6801/2744935777","cluster_addr":"172.21.15.49:6803/2744935777","heartbeat_back_addr":"172.21.15.49:6807/2744935777","heartbeat_front_addr":"172.21.15.49:6805/2744935777","state":["exists","up"]},{"osd":1,"uuid":"80461bd9-59ef-46df-9eea-bad92d960c57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6811","nonce":1655120118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6815","nonce":1655120118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6821","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6823","nonce":1655120118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6817","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6819","nonce":1655120118}]},"public_addr":"172.21.15.49:6811/1655120118","cluster_addr":"172.21.15.49:6815/1655120118","heartbeat_back_addr":"172.21.15.49:6823/1655120118","heartbeat_front_addr":"172.21.15.49:6819/1655120118","state":["exists","up"]},{"osd":2,"uuid":"d6bf40eb-6e42-4ec9-8b3d-0b6c5a6def79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6810","nonce":3815472376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6814","nonce":3815472376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6822","nonce":3815472376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6818","nonce":3815472376}]},"public_addr":"172.21.15.49:6810/3815472376","cluster_addr":"172.21.15.49:6814/3815472376","heartbeat_back_addr":"172.21.15.49:6822/3815472376","heartbeat_front_addr":"172.21.15.49:6818/3815472376","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.641492+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.668598+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.614940+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T07:31:16.670 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-03-16T07:31:16.671 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-16T07:31:17.011 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:31:17.014 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2024-03-16T07:31:17.020 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":45,"stamp":"2024-03-16T07:31:16.891189+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596885,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":778,"num_read_kb":1533,"num_write":368,"num_write_kb":1925,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":253,"ondisk_log_size":253,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":263,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":314572800,"kb_used":110944,"kb_used_data":4924,"kb_used_omap":4,"kb_used_meta":105979,"kb_avail":314461856,"statfs":{"total":322122547200,"available":322008940544,"internally_reserved":0,"allocated":5042176,"data_stored":2706877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":108522831},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.942080"},"pg_stats":[{"pgid":"23.3d","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.974883+0000","last_change":"2024-03-16T07:31:12.974114+0000","last_active":"2024-03-16T07:31:12.974883+0000","last_peered":"2024-03-16T07:31:12.974883+0000","last_clean":"2024-03-16T07:31:12.974883+0000","last_became_active":"2024-03-16T07:31:12.973858+0000","last_became_peered":"2024-03-16T07:31:12.973858+0000","last_unstale":"2024-03-16T07:31:12.974883+0000","last_undegraded":"2024-03-16T07:31:12.974883+0000","last_fullsized":"2024-03-16T07:31:12.974883+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_clean_scrub_stamp":"2024-03-16T07:31:11.948725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:43:24.254501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.3f","version":"0'0","reported_seq":18,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.966398+0000","last_change":"2024-03-16T07:30:58.571155+0000","last_active":"2024-03-16T07:31:12.966398+0000","last_peered":"2024-03-16T07:31:12.966398+0000","last_clean":"2024-03-16T07:31:12.966398+0000","last_became_active":"2024-03-16T07:30:58.570907+0000","last_became_peered":"2024-03-16T07:30:58.570907+0000","last_unstale":"2024-03-16T07:31:12.966398+0000","last_undegraded":"2024-03-16T07:31:12.966398+0000","last_fullsized":"2024-03-16T07:31:12.966398+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:11:25.928386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.3c","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.985644+0000","last_change":"2024-03-16T07:31:12.983820+0000","last_active":"2024-03-16T07:31:12.985644+0000","last_peered":"2024-03-16T07:31:12.985644+0000","last_clean":"2024-03-16T07:31:12.985644+0000","last_became_active":"2024-03-16T07:31:12.983412+0000","last_became_peered":"2024-03-16T07:31:12.983412+0000","last_unstale":"2024-03-16T07:31:12.985644+0000","last_undegraded":"2024-03-16T07:31:12.985644+0000","last_fullsized":"2024-03-16T07:31:12.985644+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_clean_scrub_stamp":"2024-03-16T07:31:11.948725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:19:51.126301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":18,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.976460+0000","last_change":"2024-03-16T07:30:58.567565+0000","last_active":"2024-03-16T07:31:12.976460+0000","last_peered":"2024-03-16T07:31:12.976460+0000","last_clean":"2024-03-16T07:31:12.976460+0000","last_became_active":"2024-03-16T07:30:58.567322+0000","last_became_peered":"2024-03-16T07:30:58.567322+0000","last_unstale":"2024-03-16T07:31:12.976460+0000","last_undegraded":"2024-03-16T07:31:12.976460+0000","last_fullsized":"2024-03-16T07:31:12.976460+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:16:13.408270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.3f","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.995196+0000","last_change":"2024-03-16T07:31:12.994069+0000","last_active":"2024-03-16T07:31:12.995196+0000","last_peered":"2024-03-16T07:31:12.995196+0000","last_clean":"2024-03-16T07:31:12.995196+0000","last_became_active":"2024-03-16T07:31:12.991563+0000","last_became_peered":"2024-03-16T07:31:12.991563+0000","last_unstale":"2024-03-16T07:31:12.995196+0000","last_undegraded":"2024-03-16T07:31:12.995196+0000","last_fullsized":"2024-03-16T07:31:12.995196+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_clean_scrub_stamp":"2024-03-16T07:31:11.948725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:39:03.325870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":18,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.970363+0000","last_change":"2024-03-16T07:30:58.563537+0000","last_active":"2024-03-16T07:31:12.970363+0000","last_peered":"2024-03-16T07:31:12.970363+0000","last_clean":"2024-03-16T07:31:12.970363+0000","last_became_active":"2024-03-16T07:30:58.562673+0000","last_became_peered":"2024-03-16T07:30:58.562673+0000","last_unstale":"2024-03-16T07:31:12.970363+0000","last_undegraded":"2024-03-16T07:31:12.970363+0000","last_fullsized":"2024-03-16T07:31:12.970363+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:31:58.669992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.3e","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.993579+0000","last_change":"2024-03-16T07:31:12.989128+0000","last_active":"2024-03-16T07:31:12.993579+0000","last_peered":"2024-03-16T07:31:12.993579+0000","last_clean":"2024-03-16T07:31:12.993579+0000","last_became_active":"2024-03-16T07:31:12.988884+0000","last_became_peered":"2024-03-16T07:31:12.988884+0000","last_unstale":"2024-03-16T07:31:12.993579+0000","last_undegraded":"2024-03-16T07:31:12.993579+0000","last_fullsized":"2024-03-16T07:31:12.993579+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_clean_scrub_stamp":"2024-03-16T07:31:11.948725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:42:44.915624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.3c","version":"0'0","reported_seq":18,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.958753+0000","last_change":"2024-03-16T07:30:58.572946+0000","last_active":"2024-03-16T07:31:12.958753+0000","last_peered":"2024-03-16T07:31:12.958753+0000","last_clean":"2024-03-16T07:31:12.958753+0000","last_became_active":"2024-03-16T07:30:58.572626+0000","last_became_peered":"2024-03-16T07:30:58.572626+0000","last_unstale":"2024-03-16T07:31:12.958753+0000","last_undegraded":"2024-03-16T07:31:12.958753+0000","last_fullsized":"2024-03-16T07:31:12.958753+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:56:18.837266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.39","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.999534+0000","last_change":"2024-03-16T07:31:12.998696+0000","last_active":"2024-03-16T07:31:12.999534+0000","last_peered":"2024-03-16T07:31:12.999534+0000","last_clean":"2024-03-16T07:31:12.999534+0000","last_became_active":"2024-03-16T07:31:12.998160+0000","last_became_peered":"2024-03-16T07:31:12.998160+0000","last_unstale":"2024-03-16T07:31:12.999534+0000","last_undegraded":"2024-03-16T07:31:12.999534+0000","last_fullsized":"2024-03-16T07:31:12.999534+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_clean_scrub_stamp":"2024-03-16T07:31:11.948725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:16:39.873658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.3b","version":"0'0","reported_seq":18,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.967911+0000","last_change":"2024-03-16T07:30:58.571437+0000","last_active":"2024-03-16T07:31:12.967911+0000","last_peered":"2024-03-16T07:31:12.967911+0000","last_clean":"2024-03-16T07:31:12.967911+0000","last_became_active":"2024-03-16T07:30:58.571200+0000","last_became_peered":"2024-03-16T07:30:58.571200+0000","last_unstale":"2024-03-16T07:31:12.967911+0000","last_undegraded":"2024-03-16T07:31:12.967911+0000","last_fullsized":"2024-03-16T07:31:12.967911+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:48:25.008750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.38","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:13.001477+0000","last_change":"2024-03-16T07:31:13.000832+0000","last_active":"2024-03-16T07:31:13.001477+0000","last_peered":"2024-03-16T07:31:13.001477+0000","last_clean":"2024-03-16T07:31:13.001477+0000","last_became_active":"2024-03-16T07:31:13.000513+0000","last_became_peered":"2024-03-16T07:31:13.000513+0000","last_unstale":"2024-03-16T07:31:13.001477+0000","last_undegraded":"2024-03-16T07:31:13.001477+0000","last_fullsized":"2024-03-16T07:31:13.001477+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_clean_scrub_stamp":"2024-03-16T07:31:11.948725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:16:11.889902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.3a","version":"0'0","reported_seq":18,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.964990+0000","last_change":"2024-03-16T07:30:58.570783+0000","last_active":"2024-03-16T07:31:12.964990+0000","last_peered":"2024-03-16T07:31:12.964990+0000","last_clean":"2024-03-16T07:31:12.964990+0000","last_became_active":"2024-03-16T07:30:58.570527+0000","last_became_peered":"2024-03-16T07:30:58.570527+0000","last_unstale":"2024-03-16T07:31:12.964990+0000","last_undegraded":"2024-03-16T07:31:12.964990+0000","last_fullsized":"2024-03-16T07:31:12.964990+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:30:06.769142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.3b","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.995319+0000","last_change":"2024-03-16T07:31:12.992911+0000","last_active":"2024-03-16T07:31:12.995319+0000","last_peered":"2024-03-16T07:31:12.995319+0000","last_clean":"2024-03-16T07:31:12.995319+0000","last_became_active":"2024-03-16T07:31:12.992643+0000","last_became_peered":"2024-03-16T07:31:12.992643+0000","last_unstale":"2024-03-16T07:31:12.995319+0000","last_undegraded":"2024-03-16T07:31:12.995319+0000","last_fullsized":"2024-03-16T07:31:12.995319+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_clean_scrub_stamp":"2024-03-16T07:31:11.948725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:45:25.869947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":18,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.975863+0000","last_change":"2024-03-16T07:30:58.572802+0000","last_active":"2024-03-16T07:31:12.975863+0000","last_peered":"2024-03-16T07:31:12.975863+0000","last_clean":"2024-03-16T07:31:12.975863+0000","last_became_active":"2024-03-16T07:30:58.572430+0000","last_became_peered":"2024-03-16T07:30:58.572430+0000","last_unstale":"2024-03-16T07:31:12.975863+0000","last_undegraded":"2024-03-16T07:31:12.975863+0000","last_fullsized":"2024-03-16T07:31:12.975863+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:38:49.233760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.3a","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.993554+0000","last_change":"2024-03-16T07:31:12.989727+0000","last_active":"2024-03-16T07:31:12.993554+0000","last_peered":"2024-03-16T07:31:12.993554+0000","last_clean":"2024-03-16T07:31:12.993554+0000","last_became_active":"2024-03-16T07:31:12.989457+0000","last_became_peered":"2024-03-16T07:31:12.989457+0000","last_unstale":"2024-03-16T07:31:12.993554+0000","last_undegraded":"2024-03-16T07:31:12.993554+0000","last_fullsized":"2024-03-16T07:31:12.993554+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_clean_scrub_stamp":"2024-03-16T07:31:11.948725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:52:43.476954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":18,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.967898+0000","last_change":"2024-03-16T07:30:58.563881+0000","last_active":"2024-03-16T07:31:12.967898+0000","last_peered":"2024-03-16T07:31:12.967898+0000","last_clean":"2024-03-16T07:31:12.967898+0000","last_became_active":"2024-03-16T07:30:58.563112+0000","last_became_peered":"2024-03-16T07:30:58.563112+0000","last_unstale":"2024-03-16T07:31:12.967898+0000","last_undegraded":"2024-03-16T07:31:12.967898+0000","last_fullsized":"2024-03-16T07:31:12.967898+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:56:38.419618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.35","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.996614+0000","last_change":"2024-03-16T07:31:12.994622+0000","last_active":"2024-03-16T07:31:12.996614+0000","last_peered":"2024-03-16T07:31:12.996614+0000","last_clean":"2024-03-16T07:31:12.996614+0000","last_became_active":"2024-03-16T07:31:12.994175+0000","last_became_peered":"2024-03-16T07:31:12.994175+0000","last_unstale":"2024-03-16T07:31:12.996614+0000","last_undegraded":"2024-03-16T07:31:12.996614+0000","last_fullsized":"2024-03-16T07:31:12.996614+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_clean_scrub_stamp":"2024-03-16T07:31:11.948725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:49:57.933087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":18,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.966743+0000","last_change":"2024-03-16T07:30:58.571043+0000","last_active":"2024-03-16T07:31:12.966743+0000","last_peered":"2024-03-16T07:31:12.966743+0000","last_clean":"2024-03-16T07:31:12.966743+0000","last_became_active":"2024-03-16T07:30:58.570796+0000","last_became_peered":"2024-03-16T07:30:58.570796+0000","last_unstale":"2024-03-16T07:31:12.966743+0000","last_undegraded":"2024-03-16T07:31:12.966743+0000","last_fullsized":"2024-03-16T07:31:12.966743+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:47:26.847551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.34","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.995387+0000","last_change":"2024-03-16T07:31:12.993654+0000","last_active":"2024-03-16T07:31:12.995387+0000","last_peered":"2024-03-16T07:31:12.995387+0000","last_clean":"2024-03-16T07:31:12.995387+0000","last_became_active":"2024-03-16T07:31:12.993422+0000","last_became_peered":"2024-03-16T07:31:12.993422+0000","last_unstale":"2024-03-16T07:31:12.995387+0000","last_undegraded":"2024-03-16T07:31:12.995387+0000","last_fullsized":"2024-03-16T07:31:12.995387+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_clean_scrub_stamp":"2024-03-16T07:31:11.948725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:26:56.581297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":18,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.967717+0000","last_change":"2024-03-16T07:30:58.563510+0000","last_active":"2024-03-16T07:31:12.967717+0000","last_peered":"2024-03-16T07:31:12.967717+0000","last_clean":"2024-03-16T07:31:12.967717+0000","last_became_active":"2024-03-16T07:30:58.563192+0000","last_became_peered":"2024-03-16T07:30:58.563192+0000","last_unstale":"2024-03-16T07:31:12.967717+0000","last_undegraded":"2024-03-16T07:31:12.967717+0000","last_fullsized":"2024-03-16T07:31:12.967717+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:13:45.980861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.37","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.992980+0000","last_change":"2024-03-16T07:31:12.990733+0000","last_active":"2024-03-16T07:31:12.992980+0000","last_peered":"2024-03-16T07:31:12.992980+0000","last_clean":"2024-03-16T07:31:12.992980+0000","last_became_active":"2024-03-16T07:31:12.990523+0000","last_became_peered":"2024-03-16T07:31:12.990523+0000","last_unstale":"2024-03-16T07:31:12.992980+0000","last_undegraded":"2024-03-16T07:31:12.992980+0000","last_fullsized":"2024-03-16T07:31:12.992980+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_clean_scrub_stamp":"2024-03-16T07:31:11.948725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:10:42.822545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":18,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.970512+0000","last_change":"2024-03-16T07:30:58.569050+0000","last_active":"2024-03-16T07:31:12.970512+0000","last_peered":"2024-03-16T07:31:12.970512+0000","last_clean":"2024-03-16T07:31:12.970512+0000","last_became_active":"2024-03-16T07:30:58.568635+0000","last_became_peered":"2024-03-16T07:30:58.568635+0000","last_unstale":"2024-03-16T07:31:12.970512+0000","last_undegraded":"2024-03-16T07:31:12.970512+0000","last_fullsized":"2024-03-16T07:31:12.970512+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:44:15.784720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.36","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:13.000029+0000","last_change":"2024-03-16T07:31:12.999439+0000","last_active":"2024-03-16T07:31:13.000029+0000","last_peered":"2024-03-16T07:31:13.000029+0000","last_clean":"2024-03-16T07:31:13.000029+0000","last_became_active":"2024-03-16T07:31:12.999183+0000","last_became_peered":"2024-03-16T07:31:12.999183+0000","last_unstale":"2024-03-16T07:31:13.000029+0000","last_undegraded":"2024-03-16T07:31:13.000029+0000","last_fullsized":"2024-03-16T07:31:13.000029+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_clean_scrub_stamp":"2024-03-16T07:31:11.948725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:49:30.570492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.34","version":"0'0","reported_seq":18,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.971132+0000","last_change":"2024-03-16T07:30:58.572517+0000","last_active":"2024-03-16T07:31:12.971132+0000","last_peered":"2024-03-16T07:31:12.971132+0000","last_clean":"2024-03-16T07:31:12.971132+0000","last_became_active":"2024-03-16T07:30:58.570337+0000","last_became_peered":"2024-03-16T07:30:58.570337+0000","last_unstale":"2024-03-16T07:31:12.971132+0000","last_undegraded":"2024-03-16T07:31:12.971132+0000","last_fullsized":"2024-03-16T07:31:12.971132+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:07:21.183199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.31","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.998378+0000","last_change":"2024-03-16T07:31:12.997312+0000","last_active":"2024-03-16T07:31:12.998378+0000","last_peered":"2024-03-16T07:31:12.998378+0000","last_clean":"2024-03-16T07:31:12.998378+0000","last_became_active":"2024-03-16T07:31:12.997072+0000","last_became_peered":"2024-03-16T07:31:12.997072+0000","last_unstale":"2024-03-16T07:31:12.998378+0000","last_undegraded":"2024-03-16T07:31:12.998378+0000","last_fullsized":"2024-03-16T07:31:12.998378+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_clean_scrub_stamp":"2024-03-16T07:31:11.948725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:33:03.973047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.33","version":"0'0","reported_seq":18,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.968002+0000","last_change":"2024-03-16T07:30:58.571283+0000","last_active":"2024-03-16T07:31:12.968002+0000","last_peered":"2024-03-16T07:31:12.968002+0000","last_clean":"2024-03-16T07:31:12.968002+0000","last_became_active":"2024-03-16T07:30:58.570972+0000","last_became_peered":"2024-03-16T07:30:58.570972+0000","last_unstale":"2024-03-16T07:31:12.968002+0000","last_undegraded":"2024-03-16T07:31:12.968002+0000","last_fullsized":"2024-03-16T07:31:12.968002+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:12:28.497074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.30","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.993248+0000","last_change":"2024-03-16T07:31:12.989216+0000","last_active":"2024-03-16T07:31:12.993248+0000","last_peered":"2024-03-16T07:31:12.993248+0000","last_clean":"2024-03-16T07:31:12.993248+0000","last_became_active":"2024-03-16T07:31:12.986563+0000","last_became_peered":"2024-03-16T07:31:12.986563+0000","last_unstale":"2024-03-16T07:31:12.993248+0000","last_undegraded":"2024-03-16T07:31:12.993248+0000","last_fullsized":"2024-03-16T07:31:12.993248+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_clean_scrub_stamp":"2024-03-16T07:31:11.948725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:00:33.472987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":18,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.977093+0000","last_change":"2024-03-16T07:30:58.574666+0000","last_active":"2024-03-16T07:31:12.977093+0000","last_peered":"2024-03-16T07:31:12.977093+0000","last_clean":"2024-03-16T07:31:12.977093+0000","last_became_active":"2024-03-16T07:30:58.573873+0000","last_became_peered":"2024-03-16T07:30:58.573873+0000","last_unstale":"2024-03-16T07:31:12.977093+0000","last_undegraded":"2024-03-16T07:31:12.977093+0000","last_fullsized":"2024-03-16T07:31:12.977093+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:27:34.230714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.33","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.992424+0000","last_change":"2024-03-16T07:31:12.987058+0000","last_active":"2024-03-16T07:31:12.992424+0000","last_peered":"2024-03-16T07:31:12.992424+0000","last_clean":"2024-03-16T07:31:12.992424+0000","last_became_active":"2024-03-16T07:31:12.986192+0000","last_became_peered":"2024-03-16T07:31:12.986192+0000","last_unstale":"2024-03-16T07:31:12.992424+0000","last_undegraded":"2024-03-16T07:31:12.992424+0000","last_fullsized":"2024-03-16T07:31:12.992424+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_clean_scrub_stamp":"2024-03-16T07:31:11.948725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:04:19.705306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":18,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.965834+0000","last_change":"2024-03-16T07:30:58.570258+0000","last_active":"2024-03-16T07:31:12.965834+0000","last_peered":"2024-03-16T07:31:12.965834+0000","last_clean":"2024-03-16T07:31:12.965834+0000","last_became_active":"2024-03-16T07:30:58.570020+0000","last_became_peered":"2024-03-16T07:30:58.570020+0000","last_unstale":"2024-03-16T07:31:12.965834+0000","last_undegraded":"2024-03-16T07:31:12.965834+0000","last_fullsized":"2024-03-16T07:31:12.965834+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:23:09.206123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.32","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:13.000883+0000","last_change":"2024-03-16T07:31:13.000134+0000","last_active":"2024-03-16T07:31:13.000883+0000","last_peered":"2024-03-16T07:31:13.000883+0000","last_clean":"2024-03-16T07:31:13.000883+0000","last_became_active":"2024-03-16T07:31:12.999867+0000","last_became_peered":"2024-03-16T07:31:12.999867+0000","last_unstale":"2024-03-16T07:31:13.000883+0000","last_undegraded":"2024-03-16T07:31:13.000883+0000","last_fullsized":"2024-03-16T07:31:13.000883+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_clean_scrub_stamp":"2024-03-16T07:31:11.948725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:09:26.471224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.30","version":"0'0","reported_seq":18,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.956433+0000","last_change":"2024-03-16T07:30:58.574365+0000","last_active":"2024-03-16T07:31:12.956433+0000","last_peered":"2024-03-16T07:31:12.956433+0000","last_clean":"2024-03-16T07:31:12.956433+0000","last_became_active":"2024-03-16T07:30:58.574133+0000","last_became_peered":"2024-03-16T07:30:58.574133+0000","last_unstale":"2024-03-16T07:31:12.956433+0000","last_undegraded":"2024-03-16T07:31:12.956433+0000","last_fullsized":"2024-03-16T07:31:12.956433+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:02:57.834208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2d","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.993580+0000","last_change":"2024-03-16T07:31:12.990058+0000","last_active":"2024-03-16T07:31:12.993580+0000","last_peered":"2024-03-16T07:31:12.993580+0000","last_clean":"2024-03-16T07:31:12.993580+0000","last_became_active":"2024-03-16T07:31:12.989836+0000","last_became_peered":"2024-03-16T07:31:12.989836+0000","last_unstale":"2024-03-16T07:31:12.993580+0000","last_undegraded":"2024-03-16T07:31:12.993580+0000","last_fullsized":"2024-03-16T07:31:12.993580+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_clean_scrub_stamp":"2024-03-16T07:31:11.948725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:25:02.571301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":18,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.960951+0000","last_change":"2024-03-16T07:30:58.576696+0000","last_active":"2024-03-16T07:31:12.960951+0000","last_peered":"2024-03-16T07:31:12.960951+0000","last_clean":"2024-03-16T07:31:12.960951+0000","last_became_active":"2024-03-16T07:30:58.576438+0000","last_became_peered":"2024-03-16T07:30:58.576438+0000","last_unstale":"2024-03-16T07:31:12.960951+0000","last_undegraded":"2024-03-16T07:31:12.960951+0000","last_fullsized":"2024-03-16T07:31:12.960951+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:56:32.600260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2c","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.982017+0000","last_change":"2024-03-16T07:31:12.975228+0000","last_active":"2024-03-16T07:31:12.982017+0000","last_peered":"2024-03-16T07:31:12.982017+0000","last_clean":"2024-03-16T07:31:12.982017+0000","last_became_active":"2024-03-16T07:31:12.974979+0000","last_became_peered":"2024-03-16T07:31:12.974979+0000","last_unstale":"2024-03-16T07:31:12.982017+0000","last_undegraded":"2024-03-16T07:31:12.982017+0000","last_fullsized":"2024-03-16T07:31:12.982017+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_clean_scrub_stamp":"2024-03-16T07:31:11.948725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:51:48.794653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":18,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.967845+0000","last_change":"2024-03-16T07:30:58.572031+0000","last_active":"2024-03-16T07:31:12.967845+0000","last_peered":"2024-03-16T07:31:12.967845+0000","last_clean":"2024-03-16T07:31:12.967845+0000","last_became_active":"2024-03-16T07:30:58.571663+0000","last_became_peered":"2024-03-16T07:30:58.571663+0000","last_unstale":"2024-03-16T07:31:12.967845+0000","last_undegraded":"2024-03-16T07:31:12.967845+0000","last_fullsized":"2024-03-16T07:31:12.967845+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:13:31.805609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.2f","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.995213+0000","last_change":"2024-03-16T07:31:12.994254+0000","last_active":"2024-03-16T07:31:12.995213+0000","last_peered":"2024-03-16T07:31:12.995213+0000","last_clean":"2024-03-16T07:31:12.995213+0000","last_became_active":"2024-03-16T07:31:12.991910+0000","last_became_peered":"2024-03-16T07:31:12.991910+0000","last_unstale":"2024-03-16T07:31:12.995213+0000","last_undegraded":"2024-03-16T07:31:12.995213+0000","last_fullsized":"2024-03-16T07:31:12.995213+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_clean_scrub_stamp":"2024-03-16T07:31:11.948725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:00:55.107031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2d","version":"0'0","reported_seq":18,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.970735+0000","last_change":"2024-03-16T07:30:58.569822+0000","last_active":"2024-03-16T07:31:12.970735+0000","last_peered":"2024-03-16T07:31:12.970735+0000","last_clean":"2024-03-16T07:31:12.970735+0000","last_became_active":"2024-03-16T07:30:58.569585+0000","last_became_peered":"2024-03-16T07:30:58.569585+0000","last_unstale":"2024-03-16T07:31:12.970735+0000","last_undegraded":"2024-03-16T07:31:12.970735+0000","last_fullsized":"2024-03-16T07:31:12.970735+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:34:34.180780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.2e","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.985617+0000","last_change":"2024-03-16T07:31:12.983659+0000","last_active":"2024-03-16T07:31:12.985617+0000","last_peered":"2024-03-16T07:31:12.985617+0000","last_clean":"2024-03-16T07:31:12.985617+0000","last_became_active":"2024-03-16T07:31:12.983214+0000","last_became_peered":"2024-03-16T07:31:12.983214+0000","last_unstale":"2024-03-16T07:31:12.985617+0000","last_undegraded":"2024-03-16T07:31:12.985617+0000","last_fullsized":"2024-03-16T07:31:12.985617+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_clean_scrub_stamp":"2024-03-16T07:31:11.948725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:18:51.895439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":18,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.958812+0000","last_change":"2024-03-16T07:30:58.573838+0000","last_active":"2024-03-16T07:31:12.958812+0000","last_peered":"2024-03-16T07:31:12.958812+0000","last_clean":"2024-03-16T07:31:12.958812+0000","last_became_active":"2024-03-16T07:30:58.573583+0000","last_became_peered":"2024-03-16T07:30:58.573583+0000","last_unstale":"2024-03-16T07:31:12.958812+0000","last_undegraded":"2024-03-16T07:31:12.958812+0000","last_fullsized":"2024-03-16T07:31:12.958812+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:49:38.279098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.29","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.974736+0000","last_change":"2024-03-16T07:31:12.971999+0000","last_active":"2024-03-16T07:31:12.974736+0000","last_peered":"2024-03-16T07:31:12.974736+0000","last_clean":"2024-03-16T07:31:12.974736+0000","last_became_active":"2024-03-16T07:31:12.971776+0000","last_became_peered":"2024-03-16T07:31:12.971776+0000","last_unstale":"2024-03-16T07:31:12.974736+0000","last_undegraded":"2024-03-16T07:31:12.974736+0000","last_fullsized":"2024-03-16T07:31:12.974736+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_clean_scrub_stamp":"2024-03-16T07:31:11.948725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:06:11.583560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2b","version":"0'0","reported_seq":18,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.958264+0000","last_change":"2024-03-16T07:30:58.576167+0000","last_active":"2024-03-16T07:31:12.958264+0000","last_peered":"2024-03-16T07:31:12.958264+0000","last_clean":"2024-03-16T07:31:12.958264+0000","last_became_active":"2024-03-16T07:30:58.575924+0000","last_became_peered":"2024-03-16T07:30:58.575924+0000","last_unstale":"2024-03-16T07:31:12.958264+0000","last_undegraded":"2024-03-16T07:31:12.958264+0000","last_fullsized":"2024-03-16T07:31:12.958264+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:13:31.805609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.28","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.994475+0000","last_change":"2024-03-16T07:31:12.991339+0000","last_active":"2024-03-16T07:31:12.994475+0000","last_peered":"2024-03-16T07:31:12.994475+0000","last_clean":"2024-03-16T07:31:12.994475+0000","last_became_active":"2024-03-16T07:31:12.990704+0000","last_became_peered":"2024-03-16T07:31:12.990704+0000","last_unstale":"2024-03-16T07:31:12.994475+0000","last_undegraded":"2024-03-16T07:31:12.994475+0000","last_fullsized":"2024-03-16T07:31:12.994475+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_clean_scrub_stamp":"2024-03-16T07:31:11.948725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:46:26.064755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":18,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.977098+0000","last_change":"2024-03-16T07:30:58.574457+0000","last_active":"2024-03-16T07:31:12.977098+0000","last_peered":"2024-03-16T07:31:12.977098+0000","last_clean":"2024-03-16T07:31:12.977098+0000","last_became_active":"2024-03-16T07:30:58.573573+0000","last_became_peered":"2024-03-16T07:30:58.573573+0000","last_unstale":"2024-03-16T07:31:12.977098+0000","last_undegraded":"2024-03-16T07:31:12.977098+0000","last_fullsized":"2024-03-16T07:31:12.977098+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:55:37.004684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.2b","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.975060+0000","last_change":"2024-03-16T07:31:12.974386+0000","last_active":"2024-03-16T07:31:12.975060+0000","last_peered":"2024-03-16T07:31:12.975060+0000","last_clean":"2024-03-16T07:31:12.975060+0000","last_became_active":"2024-03-16T07:31:12.974032+0000","last_became_peered":"2024-03-16T07:31:12.974032+0000","last_unstale":"2024-03-16T07:31:12.975060+0000","last_undegraded":"2024-03-16T07:31:12.975060+0000","last_fullsized":"2024-03-16T07:31:12.975060+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_clean_scrub_stamp":"2024-03-16T07:31:11.948725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:49:57.933087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":18,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.957828+0000","last_change":"2024-03-16T07:30:58.575945+0000","last_active":"2024-03-16T07:31:12.957828+0000","last_peered":"2024-03-16T07:31:12.957828+0000","last_clean":"2024-03-16T07:31:12.957828+0000","last_became_active":"2024-03-16T07:30:58.575414+0000","last_became_peered":"2024-03-16T07:30:58.575414+0000","last_unstale":"2024-03-16T07:31:12.957828+0000","last_undegraded":"2024-03-16T07:31:12.957828+0000","last_fullsized":"2024-03-16T07:31:12.957828+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:11:25.928386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2a","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.995416+0000","last_change":"2024-03-16T07:31:12.993289+0000","last_active":"2024-03-16T07:31:12.995416+0000","last_peered":"2024-03-16T07:31:12.995416+0000","last_clean":"2024-03-16T07:31:12.995416+0000","last_became_active":"2024-03-16T07:31:12.993035+0000","last_became_peered":"2024-03-16T07:31:12.993035+0000","last_unstale":"2024-03-16T07:31:12.995416+0000","last_undegraded":"2024-03-16T07:31:12.995416+0000","last_fullsized":"2024-03-16T07:31:12.995416+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_clean_scrub_stamp":"2024-03-16T07:31:11.948725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:08:22.650549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":18,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.968085+0000","last_change":"2024-03-16T07:30:58.563542+0000","last_active":"2024-03-16T07:31:12.968085+0000","last_peered":"2024-03-16T07:31:12.968085+0000","last_clean":"2024-03-16T07:31:12.968085+0000","last_became_active":"2024-03-16T07:30:58.562883+0000","last_became_peered":"2024-03-16T07:30:58.562883+0000","last_unstale":"2024-03-16T07:31:12.968085+0000","last_undegraded":"2024-03-16T07:31:12.968085+0000","last_fullsized":"2024-03-16T07:31:12.968085+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:50:38.987166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.25","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.996637+0000","last_change":"2024-03-16T07:31:12.994738+0000","last_active":"2024-03-16T07:31:12.996637+0000","last_peered":"2024-03-16T07:31:12.996637+0000","last_clean":"2024-03-16T07:31:12.996637+0000","last_became_active":"2024-03-16T07:31:12.994499+0000","last_became_peered":"2024-03-16T07:31:12.994499+0000","last_unstale":"2024-03-16T07:31:12.996637+0000","last_undegraded":"2024-03-16T07:31:12.996637+0000","last_fullsized":"2024-03-16T07:31:12.996637+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_clean_scrub_stamp":"2024-03-16T07:31:11.948725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:31:46.189694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":18,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.961044+0000","last_change":"2024-03-16T07:30:58.574409+0000","last_active":"2024-03-16T07:31:12.961044+0000","last_peered":"2024-03-16T07:31:12.961044+0000","last_clean":"2024-03-16T07:31:12.961044+0000","last_became_active":"2024-03-16T07:30:58.573829+0000","last_became_peered":"2024-03-16T07:30:58.573829+0000","last_unstale":"2024-03-16T07:31:12.961044+0000","last_undegraded":"2024-03-16T07:31:12.961044+0000","last_fullsized":"2024-03-16T07:31:12.961044+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:50:43.375419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.24","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.983569+0000","last_change":"2024-03-16T07:31:12.982775+0000","last_active":"2024-03-16T07:31:12.983569+0000","last_peered":"2024-03-16T07:31:12.983569+0000","last_clean":"2024-03-16T07:31:12.983569+0000","last_became_active":"2024-03-16T07:31:12.981760+0000","last_became_peered":"2024-03-16T07:31:12.981760+0000","last_unstale":"2024-03-16T07:31:12.983569+0000","last_undegraded":"2024-03-16T07:31:12.983569+0000","last_fullsized":"2024-03-16T07:31:12.983569+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_clean_scrub_stamp":"2024-03-16T07:31:11.948725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:19:56.945658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":18,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.967869+0000","last_change":"2024-03-16T07:30:58.571970+0000","last_active":"2024-03-16T07:31:12.967869+0000","last_peered":"2024-03-16T07:31:12.967869+0000","last_clean":"2024-03-16T07:31:12.967869+0000","last_became_active":"2024-03-16T07:30:58.571516+0000","last_became_peered":"2024-03-16T07:30:58.571516+0000","last_unstale":"2024-03-16T07:31:12.967869+0000","last_undegraded":"2024-03-16T07:31:12.967869+0000","last_fullsized":"2024-03-16T07:31:12.967869+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:56:18.837266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.27","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.981802+0000","last_change":"2024-03-16T07:31:12.981214+0000","last_active":"2024-03-16T07:31:12.981802+0000","last_peered":"2024-03-16T07:31:12.981802+0000","last_clean":"2024-03-16T07:31:12.981802+0000","last_became_active":"2024-03-16T07:31:12.980972+0000","last_became_peered":"2024-03-16T07:31:12.980972+0000","last_unstale":"2024-03-16T07:31:12.981802+0000","last_undegraded":"2024-03-16T07:31:12.981802+0000","last_fullsized":"2024-03-16T07:31:12.981802+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_clean_scrub_stamp":"2024-03-16T07:31:11.948725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:40:38.815142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":18,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.959752+0000","last_change":"2024-03-16T07:30:58.575126+0000","last_active":"2024-03-16T07:31:12.959752+0000","last_peered":"2024-03-16T07:31:12.959752+0000","last_clean":"2024-03-16T07:31:12.959752+0000","last_became_active":"2024-03-16T07:30:58.574934+0000","last_became_peered":"2024-03-16T07:30:58.574934+0000","last_unstale":"2024-03-16T07:31:12.959752+0000","last_undegraded":"2024-03-16T07:31:12.959752+0000","last_fullsized":"2024-03-16T07:31:12.959752+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:49:47.185506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.26","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:13.000014+0000","last_change":"2024-03-16T07:31:12.999377+0000","last_active":"2024-03-16T07:31:13.000014+0000","last_peered":"2024-03-16T07:31:13.000014+0000","last_clean":"2024-03-16T07:31:13.000014+0000","last_became_active":"2024-03-16T07:31:12.999015+0000","last_became_peered":"2024-03-16T07:31:12.999015+0000","last_unstale":"2024-03-16T07:31:13.000014+0000","last_undegraded":"2024-03-16T07:31:13.000014+0000","last_fullsized":"2024-03-16T07:31:13.000014+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_clean_scrub_stamp":"2024-03-16T07:31:11.948725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:50:12.144732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":18,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.971222+0000","last_change":"2024-03-16T07:30:58.572025+0000","last_active":"2024-03-16T07:31:12.971222+0000","last_peered":"2024-03-16T07:31:12.971222+0000","last_clean":"2024-03-16T07:31:12.971222+0000","last_became_active":"2024-03-16T07:30:58.569977+0000","last_became_peered":"2024-03-16T07:30:58.569977+0000","last_unstale":"2024-03-16T07:31:12.971222+0000","last_undegraded":"2024-03-16T07:31:12.971222+0000","last_fullsized":"2024-03-16T07:31:12.971222+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:15:34.064322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.21","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.995165+0000","last_change":"2024-03-16T07:31:12.991786+0000","last_active":"2024-03-16T07:31:12.995165+0000","last_peered":"2024-03-16T07:31:12.995165+0000","last_clean":"2024-03-16T07:31:12.995165+0000","last_became_active":"2024-03-16T07:31:12.991376+0000","last_became_peered":"2024-03-16T07:31:12.991376+0000","last_unstale":"2024-03-16T07:31:12.995165+0000","last_undegraded":"2024-03-16T07:31:12.995165+0000","last_fullsized":"2024-03-16T07:31:12.995165+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_clean_scrub_stamp":"2024-03-16T07:31:11.948725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:57:17.307359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":18,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.968087+0000","last_change":"2024-03-16T07:30:58.560398+0000","last_active":"2024-03-16T07:31:12.968087+0000","last_peered":"2024-03-16T07:31:12.968087+0000","last_clean":"2024-03-16T07:31:12.968087+0000","last_became_active":"2024-03-16T07:30:58.560136+0000","last_became_peered":"2024-03-16T07:30:58.560136+0000","last_unstale":"2024-03-16T07:31:12.968087+0000","last_undegraded":"2024-03-16T07:31:12.968087+0000","last_fullsized":"2024-03-16T07:31:12.968087+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:02:09.725846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.20","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.992397+0000","last_change":"2024-03-16T07:31:12.986924+0000","last_active":"2024-03-16T07:31:12.992397+0000","last_peered":"2024-03-16T07:31:12.992397+0000","last_clean":"2024-03-16T07:31:12.992397+0000","last_became_active":"2024-03-16T07:31:12.985982+0000","last_became_peered":"2024-03-16T07:31:12.985982+0000","last_unstale":"2024-03-16T07:31:12.992397+0000","last_undegraded":"2024-03-16T07:31:12.992397+0000","last_fullsized":"2024-03-16T07:31:12.992397+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_clean_scrub_stamp":"2024-03-16T07:31:11.948725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:05:49.894740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":18,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.977192+0000","last_change":"2024-03-16T07:30:58.564792+0000","last_active":"2024-03-16T07:31:12.977192+0000","last_peered":"2024-03-16T07:31:12.977192+0000","last_clean":"2024-03-16T07:31:12.977192+0000","last_became_active":"2024-03-16T07:30:58.564542+0000","last_became_peered":"2024-03-16T07:30:58.564542+0000","last_unstale":"2024-03-16T07:31:12.977192+0000","last_undegraded":"2024-03-16T07:31:12.977192+0000","last_fullsized":"2024-03-16T07:31:12.977192+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:10:51.120695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.23","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.975079+0000","last_change":"2024-03-16T07:31:12.974481+0000","last_active":"2024-03-16T07:31:12.975079+0000","last_peered":"2024-03-16T07:31:12.975079+0000","last_clean":"2024-03-16T07:31:12.975079+0000","last_became_active":"2024-03-16T07:31:12.973715+0000","last_became_peered":"2024-03-16T07:31:12.973715+0000","last_unstale":"2024-03-16T07:31:12.975079+0000","last_undegraded":"2024-03-16T07:31:12.975079+0000","last_fullsized":"2024-03-16T07:31:12.975079+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_clean_scrub_stamp":"2024-03-16T07:31:11.948725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:31:46.189694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":18,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.975955+0000","last_change":"2024-03-16T07:30:58.562033+0000","last_active":"2024-03-16T07:31:12.975955+0000","last_peered":"2024-03-16T07:31:12.975955+0000","last_clean":"2024-03-16T07:31:12.975955+0000","last_became_active":"2024-03-16T07:30:58.561807+0000","last_became_peered":"2024-03-16T07:30:58.561807+0000","last_unstale":"2024-03-16T07:31:12.975955+0000","last_undegraded":"2024-03-16T07:31:12.975955+0000","last_fullsized":"2024-03-16T07:31:12.975955+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:00:41.014921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.22","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.998737+0000","last_change":"2024-03-16T07:31:12.997221+0000","last_active":"2024-03-16T07:31:12.998737+0000","last_peered":"2024-03-16T07:31:12.998737+0000","last_clean":"2024-03-16T07:31:12.998737+0000","last_became_active":"2024-03-16T07:31:12.996879+0000","last_became_peered":"2024-03-16T07:31:12.996879+0000","last_unstale":"2024-03-16T07:31:12.998737+0000","last_undegraded":"2024-03-16T07:31:12.998737+0000","last_fullsized":"2024-03-16T07:31:12.998737+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_clean_scrub_stamp":"2024-03-16T07:31:11.948725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:14:33.562759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":18,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.956642+0000","last_change":"2024-03-16T07:30:58.575428+0000","last_active":"2024-03-16T07:31:12.956642+0000","last_peered":"2024-03-16T07:31:12.956642+0000","last_clean":"2024-03-16T07:31:12.956642+0000","last_became_active":"2024-03-16T07:30:58.575207+0000","last_became_peered":"2024-03-16T07:30:58.575207+0000","last_unstale":"2024-03-16T07:31:12.956642+0000","last_undegraded":"2024-03-16T07:31:12.956642+0000","last_fullsized":"2024-03-16T07:31:12.956642+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:13:01.831834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.983353+0000","last_change":"2024-03-16T07:31:12.982312+0000","last_active":"2024-03-16T07:31:12.983353+0000","last_peered":"2024-03-16T07:31:12.983353+0000","last_clean":"2024-03-16T07:31:12.983353+0000","last_became_active":"2024-03-16T07:31:12.982024+0000","last_became_peered":"2024-03-16T07:31:12.982024+0000","last_unstale":"2024-03-16T07:31:12.983353+0000","last_undegraded":"2024-03-16T07:31:12.983353+0000","last_fullsized":"2024-03-16T07:31:12.983353+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_clean_scrub_stamp":"2024-03-16T07:31:11.948725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:01:56.334680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.1d","version":"122'2","reported_seq":14,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.985202+0000","last_change":"2024-03-16T07:31:11.970374+0000","last_active":"2024-03-16T07:31:12.985202+0000","last_peered":"2024-03-16T07:31:12.985202+0000","last_clean":"2024-03-16T07:31:12.985202+0000","last_became_active":"2024-03-16T07:31:11.968081+0000","last_became_peered":"2024-03-16T07:31:11.968081+0000","last_unstale":"2024-03-16T07:31:12.985202+0000","last_undegraded":"2024-03-16T07:31:12.985202+0000","last_fullsized":"2024-03-16T07:31:12.985202+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:10.945812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:10.945812+0000","last_clean_scrub_stamp":"2024-03-16T07:31:10.945812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:08:50.570734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":18,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.967939+0000","last_change":"2024-03-16T07:30:58.571761+0000","last_active":"2024-03-16T07:31:12.967939+0000","last_peered":"2024-03-16T07:31:12.967939+0000","last_clean":"2024-03-16T07:31:12.967939+0000","last_became_active":"2024-03-16T07:30:58.570852+0000","last_became_peered":"2024-03-16T07:30:58.570852+0000","last_unstale":"2024-03-16T07:31:12.967939+0000","last_undegraded":"2024-03-16T07:31:12.967939+0000","last_fullsized":"2024-03-16T07:31:12.967939+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:16:51.341129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1f","version":"118'4","reported_seq":24,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.967705+0000","last_change":"2024-03-16T07:30:57.875122+0000","last_active":"2024-03-16T07:31:12.967705+0000","last_peered":"2024-03-16T07:31:12.967705+0000","last_clean":"2024-03-16T07:31:12.967705+0000","last_became_active":"2024-03-16T07:30:57.874848+0000","last_became_peered":"2024-03-16T07:30:57.874848+0000","last_unstale":"2024-03-16T07:31:12.967705+0000","last_undegraded":"2024-03-16T07:31:12.967705+0000","last_fullsized":"2024-03-16T07:31:12.967705+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_clean_scrub_stamp":"2024-03-16T07:30:56.855668+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:27:04.801331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1d","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.993111+0000","last_change":"2024-03-16T07:31:12.988617+0000","last_active":"2024-03-16T07:31:12.993111+0000","last_peered":"2024-03-16T07:31:12.993111+0000","last_clean":"2024-03-16T07:31:12.993111+0000","last_became_active":"2024-03-16T07:31:12.988116+0000","last_became_peered":"2024-03-16T07:31:12.988116+0000","last_unstale":"2024-03-16T07:31:12.993111+0000","last_undegraded":"2024-03-16T07:31:12.993111+0000","last_fullsized":"2024-03-16T07:31:12.993111+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_clean_scrub_stamp":"2024-03-16T07:31:11.948725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:17:40.639439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1c","version":"122'2","reported_seq":14,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.996312+0000","last_change":"2024-03-16T07:31:11.978939+0000","last_active":"2024-03-16T07:31:12.996312+0000","last_peered":"2024-03-16T07:31:12.996312+0000","last_clean":"2024-03-16T07:31:12.996312+0000","last_became_active":"2024-03-16T07:31:11.978698+0000","last_became_peered":"2024-03-16T07:31:11.978698+0000","last_unstale":"2024-03-16T07:31:12.996312+0000","last_undegraded":"2024-03-16T07:31:12.996312+0000","last_fullsized":"2024-03-16T07:31:12.996312+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:10.945812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:10.945812+0000","last_clean_scrub_stamp":"2024-03-16T07:31:10.945812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:59:58.804177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":18,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.961141+0000","last_change":"2024-03-16T07:30:58.576923+0000","last_active":"2024-03-16T07:31:12.961141+0000","last_peered":"2024-03-16T07:31:12.961141+0000","last_clean":"2024-03-16T07:31:12.961141+0000","last_became_active":"2024-03-16T07:30:58.576662+0000","last_became_peered":"2024-03-16T07:30:58.576662+0000","last_unstale":"2024-03-16T07:31:12.961141+0000","last_undegraded":"2024-03-16T07:31:12.961141+0000","last_fullsized":"2024-03-16T07:31:12.961141+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:12:28.567985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1e","version":"118'1","reported_seq":21,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.976546+0000","last_change":"2024-03-16T07:30:57.876067+0000","last_active":"2024-03-16T07:31:12.976546+0000","last_peered":"2024-03-16T07:31:12.976546+0000","last_clean":"2024-03-16T07:31:12.976546+0000","last_became_active":"2024-03-16T07:30:57.875777+0000","last_became_peered":"2024-03-16T07:30:57.875777+0000","last_unstale":"2024-03-16T07:31:12.976546+0000","last_undegraded":"2024-03-16T07:31:12.976546+0000","last_fullsized":"2024-03-16T07:31:12.976546+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_clean_scrub_stamp":"2024-03-16T07:30:56.855668+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:09:20.828638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.1e","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.999509+0000","last_change":"2024-03-16T07:31:12.998718+0000","last_active":"2024-03-16T07:31:12.999509+0000","last_peered":"2024-03-16T07:31:12.999509+0000","last_clean":"2024-03-16T07:31:12.999509+0000","last_became_active":"2024-03-16T07:31:12.998180+0000","last_became_peered":"2024-03-16T07:31:12.998180+0000","last_unstale":"2024-03-16T07:31:12.999509+0000","last_undegraded":"2024-03-16T07:31:12.999509+0000","last_fullsized":"2024-03-16T07:31:12.999509+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_clean_scrub_stamp":"2024-03-16T07:31:11.948725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:15:28.738686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1f","version":"122'4","reported_seq":16,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.995964+0000","last_change":"2024-03-16T07:31:11.971406+0000","last_active":"2024-03-16T07:31:12.995964+0000","last_peered":"2024-03-16T07:31:12.995964+0000","last_clean":"2024-03-16T07:31:12.995964+0000","last_became_active":"2024-03-16T07:31:11.971177+0000","last_became_peered":"2024-03-16T07:31:11.971177+0000","last_unstale":"2024-03-16T07:31:12.995964+0000","last_undegraded":"2024-03-16T07:31:12.995964+0000","last_fullsized":"2024-03-16T07:31:12.995964+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:10.945812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:10.945812+0000","last_clean_scrub_stamp":"2024-03-16T07:31:10.945812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:09:34.918782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":18,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.973909+0000","last_change":"2024-03-16T07:30:58.562404+0000","last_active":"2024-03-16T07:31:12.973909+0000","last_peered":"2024-03-16T07:31:12.973909+0000","last_clean":"2024-03-16T07:31:12.973909+0000","last_became_active":"2024-03-16T07:30:58.561934+0000","last_became_peered":"2024-03-16T07:30:58.561934+0000","last_unstale":"2024-03-16T07:31:12.973909+0000","last_undegraded":"2024-03-16T07:31:12.973909+0000","last_fullsized":"2024-03-16T07:31:12.973909+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:37:16.741567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1d","version":"118'2","reported_seq":22,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.960285+0000","last_change":"2024-03-16T07:30:57.880613+0000","last_active":"2024-03-16T07:31:12.960285+0000","last_peered":"2024-03-16T07:31:12.960285+0000","last_clean":"2024-03-16T07:31:12.960285+0000","last_became_active":"2024-03-16T07:30:57.880338+0000","last_became_peered":"2024-03-16T07:30:57.880338+0000","last_unstale":"2024-03-16T07:31:12.960285+0000","last_undegraded":"2024-03-16T07:31:12.960285+0000","last_fullsized":"2024-03-16T07:31:12.960285+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_clean_scrub_stamp":"2024-03-16T07:30:56.855668+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:44:41.572764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1f","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.995164+0000","last_change":"2024-03-16T07:31:12.991632+0000","last_active":"2024-03-16T07:31:12.995164+0000","last_peered":"2024-03-16T07:31:12.995164+0000","last_clean":"2024-03-16T07:31:12.995164+0000","last_became_active":"2024-03-16T07:31:12.989908+0000","last_became_peered":"2024-03-16T07:31:12.989908+0000","last_unstale":"2024-03-16T07:31:12.995164+0000","last_undegraded":"2024-03-16T07:31:12.995164+0000","last_fullsized":"2024-03-16T07:31:12.995164+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_clean_scrub_stamp":"2024-03-16T07:31:11.948725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:51:28.240614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.1e","version":"122'1","reported_seq":13,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.998618+0000","last_change":"2024-03-16T07:31:11.976370+0000","last_active":"2024-03-16T07:31:12.998618+0000","last_peered":"2024-03-16T07:31:12.998618+0000","last_clean":"2024-03-16T07:31:12.998618+0000","last_became_active":"2024-03-16T07:31:11.976137+0000","last_became_peered":"2024-03-16T07:31:11.976137+0000","last_unstale":"2024-03-16T07:31:12.998618+0000","last_undegraded":"2024-03-16T07:31:12.998618+0000","last_fullsized":"2024-03-16T07:31:12.998618+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:10.945812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:10.945812+0000","last_clean_scrub_stamp":"2024-03-16T07:31:10.945812+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:16:05.588947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":18,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.959836+0000","last_change":"2024-03-16T07:30:58.575257+0000","last_active":"2024-03-16T07:31:12.959836+0000","last_peered":"2024-03-16T07:31:12.959836+0000","last_clean":"2024-03-16T07:31:12.959836+0000","last_became_active":"2024-03-16T07:30:58.575059+0000","last_became_peered":"2024-03-16T07:30:58.575059+0000","last_unstale":"2024-03-16T07:31:12.959836+0000","last_undegraded":"2024-03-16T07:31:12.959836+0000","last_fullsized":"2024-03-16T07:31:12.959836+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:30:52.037257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1c","version":"118'2","reported_seq":22,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.958962+0000","last_change":"2024-03-16T07:30:57.883046+0000","last_active":"2024-03-16T07:31:12.958962+0000","last_peered":"2024-03-16T07:31:12.958962+0000","last_clean":"2024-03-16T07:31:12.958962+0000","last_became_active":"2024-03-16T07:30:57.882833+0000","last_became_peered":"2024-03-16T07:30:57.882833+0000","last_unstale":"2024-03-16T07:31:12.958962+0000","last_undegraded":"2024-03-16T07:31:12.958962+0000","last_fullsized":"2024-03-16T07:31:12.958962+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_clean_scrub_stamp":"2024-03-16T07:30:56.855668+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:32:36.972246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.981897+0000","last_change":"2024-03-16T07:31:12.981294+0000","last_active":"2024-03-16T07:31:12.981897+0000","last_peered":"2024-03-16T07:31:12.981897+0000","last_clean":"2024-03-16T07:31:12.981897+0000","last_became_active":"2024-03-16T07:31:12.980948+0000","last_became_peered":"2024-03-16T07:31:12.980948+0000","last_unstale":"2024-03-16T07:31:12.981897+0000","last_undegraded":"2024-03-16T07:31:12.981897+0000","last_fullsized":"2024-03-16T07:31:12.981897+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_clean_scrub_stamp":"2024-03-16T07:31:11.948725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:42:05.791445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.958020+0000","last_change":"2024-03-16T07:31:11.972102+0000","last_active":"2024-03-16T07:31:12.958020+0000","last_peered":"2024-03-16T07:31:12.958020+0000","last_clean":"2024-03-16T07:31:12.958020+0000","last_became_active":"2024-03-16T07:31:11.971861+0000","last_became_peered":"2024-03-16T07:31:11.971861+0000","last_unstale":"2024-03-16T07:31:12.958020+0000","last_undegraded":"2024-03-16T07:31:12.958020+0000","last_fullsized":"2024-03-16T07:31:12.958020+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:10.945812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:10.945812+0000","last_clean_scrub_stamp":"2024-03-16T07:31:10.945812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:40:37.812229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":18,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.977196+0000","last_change":"2024-03-16T07:30:58.574103+0000","last_active":"2024-03-16T07:31:12.977196+0000","last_peered":"2024-03-16T07:31:12.977196+0000","last_clean":"2024-03-16T07:31:12.977196+0000","last_became_active":"2024-03-16T07:30:58.573253+0000","last_became_peered":"2024-03-16T07:30:58.573253+0000","last_unstale":"2024-03-16T07:31:12.977196+0000","last_undegraded":"2024-03-16T07:31:12.977196+0000","last_fullsized":"2024-03-16T07:31:12.977196+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:52:44.766166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.1b","version":"118'1","reported_seq":21,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.959142+0000","last_change":"2024-03-16T07:30:57.877500+0000","last_active":"2024-03-16T07:31:12.959142+0000","last_peered":"2024-03-16T07:31:12.959142+0000","last_clean":"2024-03-16T07:31:12.959142+0000","last_became_active":"2024-03-16T07:30:57.877227+0000","last_became_peered":"2024-03-16T07:30:57.877227+0000","last_unstale":"2024-03-16T07:31:12.959142+0000","last_undegraded":"2024-03-16T07:31:12.959142+0000","last_fullsized":"2024-03-16T07:31:12.959142+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_clean_scrub_stamp":"2024-03-16T07:30:56.855668+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:58:06.999355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.993759+0000","last_change":"2024-03-16T07:31:12.991114+0000","last_active":"2024-03-16T07:31:12.993759+0000","last_peered":"2024-03-16T07:31:12.993759+0000","last_clean":"2024-03-16T07:31:12.993759+0000","last_became_active":"2024-03-16T07:31:12.990721+0000","last_became_peered":"2024-03-16T07:31:12.990721+0000","last_unstale":"2024-03-16T07:31:12.993759+0000","last_undegraded":"2024-03-16T07:31:12.993759+0000","last_fullsized":"2024-03-16T07:31:12.993759+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_clean_scrub_stamp":"2024-03-16T07:31:11.948725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:15:30.216474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.968779+0000","last_change":"2024-03-16T07:31:11.978743+0000","last_active":"2024-03-16T07:31:12.968779+0000","last_peered":"2024-03-16T07:31:12.968779+0000","last_clean":"2024-03-16T07:31:12.968779+0000","last_became_active":"2024-03-16T07:31:11.978435+0000","last_became_peered":"2024-03-16T07:31:11.978435+0000","last_unstale":"2024-03-16T07:31:12.968779+0000","last_undegraded":"2024-03-16T07:31:12.968779+0000","last_fullsized":"2024-03-16T07:31:12.968779+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:10.945812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:10.945812+0000","last_clean_scrub_stamp":"2024-03-16T07:31:10.945812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:39:56.572018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":18,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.958380+0000","last_change":"2024-03-16T07:30:58.572972+0000","last_active":"2024-03-16T07:31:12.958380+0000","last_peered":"2024-03-16T07:31:12.958380+0000","last_clean":"2024-03-16T07:31:12.958380+0000","last_became_active":"2024-03-16T07:30:58.572740+0000","last_became_peered":"2024-03-16T07:30:58.572740+0000","last_unstale":"2024-03-16T07:31:12.958380+0000","last_undegraded":"2024-03-16T07:31:12.958380+0000","last_fullsized":"2024-03-16T07:31:12.958380+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:13:45.980861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1a","version":"118'1","reported_seq":21,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.965199+0000","last_change":"2024-03-16T07:30:57.877180+0000","last_active":"2024-03-16T07:31:12.965199+0000","last_peered":"2024-03-16T07:31:12.965199+0000","last_clean":"2024-03-16T07:31:12.965199+0000","last_became_active":"2024-03-16T07:30:57.874453+0000","last_became_peered":"2024-03-16T07:30:57.874453+0000","last_unstale":"2024-03-16T07:31:12.965199+0000","last_undegraded":"2024-03-16T07:31:12.965199+0000","last_fullsized":"2024-03-16T07:31:12.965199+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_clean_scrub_stamp":"2024-03-16T07:30:56.855668+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:08:51.971603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.988729+0000","last_change":"2024-03-16T07:31:12.984402+0000","last_active":"2024-03-16T07:31:12.988729+0000","last_peered":"2024-03-16T07:31:12.988729+0000","last_clean":"2024-03-16T07:31:12.988729+0000","last_became_active":"2024-03-16T07:31:12.984163+0000","last_became_peered":"2024-03-16T07:31:12.984163+0000","last_unstale":"2024-03-16T07:31:12.988729+0000","last_undegraded":"2024-03-16T07:31:12.988729+0000","last_fullsized":"2024-03-16T07:31:12.988729+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_clean_scrub_stamp":"2024-03-16T07:31:11.948725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:27:56.378721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1b","version":"122'1","reported_seq":13,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.991986+0000","last_change":"2024-03-16T07:31:11.975998+0000","last_active":"2024-03-16T07:31:12.991986+0000","last_peered":"2024-03-16T07:31:12.991986+0000","last_clean":"2024-03-16T07:31:12.991986+0000","last_became_active":"2024-03-16T07:31:11.974618+0000","last_became_peered":"2024-03-16T07:31:11.974618+0000","last_unstale":"2024-03-16T07:31:12.991986+0000","last_undegraded":"2024-03-16T07:31:12.991986+0000","last_fullsized":"2024-03-16T07:31:12.991986+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:10.945812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:10.945812+0000","last_clean_scrub_stamp":"2024-03-16T07:31:10.945812+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:59:58.804177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":18,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.971358+0000","last_change":"2024-03-16T07:30:58.563319+0000","last_active":"2024-03-16T07:31:12.971358+0000","last_peered":"2024-03-16T07:31:12.971358+0000","last_clean":"2024-03-16T07:31:12.971358+0000","last_became_active":"2024-03-16T07:30:58.560355+0000","last_became_peered":"2024-03-16T07:30:58.560355+0000","last_unstale":"2024-03-16T07:31:12.971358+0000","last_undegraded":"2024-03-16T07:31:12.971358+0000","last_fullsized":"2024-03-16T07:31:12.971358+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:46:53.824339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":20,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.958364+0000","last_change":"2024-03-16T07:30:57.880819+0000","last_active":"2024-03-16T07:31:12.958364+0000","last_peered":"2024-03-16T07:31:12.958364+0000","last_clean":"2024-03-16T07:31:12.958364+0000","last_became_active":"2024-03-16T07:30:57.879895+0000","last_became_peered":"2024-03-16T07:30:57.879895+0000","last_unstale":"2024-03-16T07:31:12.958364+0000","last_undegraded":"2024-03-16T07:31:12.958364+0000","last_fullsized":"2024-03-16T07:31:12.958364+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_clean_scrub_stamp":"2024-03-16T07:30:56.855668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:05:21.871385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.995339+0000","last_change":"2024-03-16T07:31:12.993127+0000","last_active":"2024-03-16T07:31:12.995339+0000","last_peered":"2024-03-16T07:31:12.995339+0000","last_clean":"2024-03-16T07:31:12.995339+0000","last_became_active":"2024-03-16T07:31:12.992674+0000","last_became_peered":"2024-03-16T07:31:12.992674+0000","last_unstale":"2024-03-16T07:31:12.995339+0000","last_undegraded":"2024-03-16T07:31:12.995339+0000","last_fullsized":"2024-03-16T07:31:12.995339+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_clean_scrub_stamp":"2024-03-16T07:31:11.948725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:39:24.829868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.1a","version":"122'1","reported_seq":13,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.993878+0000","last_change":"2024-03-16T07:31:11.976125+0000","last_active":"2024-03-16T07:31:12.993878+0000","last_peered":"2024-03-16T07:31:12.993878+0000","last_clean":"2024-03-16T07:31:12.993878+0000","last_became_active":"2024-03-16T07:31:11.975895+0000","last_became_peered":"2024-03-16T07:31:11.975895+0000","last_unstale":"2024-03-16T07:31:12.993878+0000","last_undegraded":"2024-03-16T07:31:12.993878+0000","last_fullsized":"2024-03-16T07:31:12.993878+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:10.945812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:10.945812+0000","last_clean_scrub_stamp":"2024-03-16T07:31:10.945812+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:00:31.182555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":18,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.957884+0000","last_change":"2024-03-16T07:30:58.578447+0000","last_active":"2024-03-16T07:31:12.957884+0000","last_peered":"2024-03-16T07:31:12.957884+0000","last_clean":"2024-03-16T07:31:12.957884+0000","last_became_active":"2024-03-16T07:30:58.576907+0000","last_became_peered":"2024-03-16T07:30:58.576907+0000","last_unstale":"2024-03-16T07:31:12.957884+0000","last_undegraded":"2024-03-16T07:31:12.957884+0000","last_fullsized":"2024-03-16T07:31:12.957884+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:34:34.180780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":20,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.979560+0000","last_change":"2024-03-16T07:30:57.876311+0000","last_active":"2024-03-16T07:31:12.979560+0000","last_peered":"2024-03-16T07:31:12.979560+0000","last_clean":"2024-03-16T07:31:12.979560+0000","last_became_active":"2024-03-16T07:30:57.875731+0000","last_became_peered":"2024-03-16T07:30:57.875731+0000","last_unstale":"2024-03-16T07:31:12.979560+0000","last_undegraded":"2024-03-16T07:31:12.979560+0000","last_fullsized":"2024-03-16T07:31:12.979560+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_clean_scrub_stamp":"2024-03-16T07:30:56.855668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:05:56.490504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.14","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.993310+0000","last_change":"2024-03-16T07:31:12.991456+0000","last_active":"2024-03-16T07:31:12.993310+0000","last_peered":"2024-03-16T07:31:12.993310+0000","last_clean":"2024-03-16T07:31:12.993310+0000","last_became_active":"2024-03-16T07:31:12.991237+0000","last_became_peered":"2024-03-16T07:31:12.991237+0000","last_unstale":"2024-03-16T07:31:12.993310+0000","last_undegraded":"2024-03-16T07:31:12.993310+0000","last_fullsized":"2024-03-16T07:31:12.993310+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_clean_scrub_stamp":"2024-03-16T07:31:11.948725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:44:45.844091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.15","version":"122'3","reported_seq":15,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.983962+0000","last_change":"2024-03-16T07:31:11.968910+0000","last_active":"2024-03-16T07:31:12.983962+0000","last_peered":"2024-03-16T07:31:12.983962+0000","last_clean":"2024-03-16T07:31:12.983962+0000","last_became_active":"2024-03-16T07:31:11.968664+0000","last_became_peered":"2024-03-16T07:31:11.968664+0000","last_unstale":"2024-03-16T07:31:12.983962+0000","last_undegraded":"2024-03-16T07:31:12.983962+0000","last_fullsized":"2024-03-16T07:31:12.983962+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:10.945812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:10.945812+0000","last_clean_scrub_stamp":"2024-03-16T07:31:10.945812+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:19:55.942745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":18,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.960333+0000","last_change":"2024-03-16T07:30:58.574189+0000","last_active":"2024-03-16T07:31:12.960333+0000","last_peered":"2024-03-16T07:31:12.960333+0000","last_clean":"2024-03-16T07:31:12.960333+0000","last_became_active":"2024-03-16T07:30:58.573886+0000","last_became_peered":"2024-03-16T07:30:58.573886+0000","last_unstale":"2024-03-16T07:31:12.960333+0000","last_undegraded":"2024-03-16T07:31:12.960333+0000","last_fullsized":"2024-03-16T07:31:12.960333+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:58:32.025910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":20,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.967833+0000","last_change":"2024-03-16T07:30:57.880020+0000","last_active":"2024-03-16T07:31:12.967833+0000","last_peered":"2024-03-16T07:31:12.967833+0000","last_clean":"2024-03-16T07:31:12.967833+0000","last_became_active":"2024-03-16T07:30:57.877991+0000","last_became_peered":"2024-03-16T07:30:57.877991+0000","last_unstale":"2024-03-16T07:31:12.967833+0000","last_undegraded":"2024-03-16T07:31:12.967833+0000","last_fullsized":"2024-03-16T07:31:12.967833+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_clean_scrub_stamp":"2024-03-16T07:30:56.855668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:59:19.537450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.15","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.974862+0000","last_change":"2024-03-16T07:31:12.974034+0000","last_active":"2024-03-16T07:31:12.974862+0000","last_peered":"2024-03-16T07:31:12.974862+0000","last_clean":"2024-03-16T07:31:12.974862+0000","last_became_active":"2024-03-16T07:31:12.973792+0000","last_became_peered":"2024-03-16T07:31:12.973792+0000","last_unstale":"2024-03-16T07:31:12.974862+0000","last_undegraded":"2024-03-16T07:31:12.974862+0000","last_fullsized":"2024-03-16T07:31:12.974862+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_clean_scrub_stamp":"2024-03-16T07:31:11.948725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:08:22.650549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.14","version":"122'6","reported_seq":18,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.997452+0000","last_change":"2024-03-16T07:31:11.969036+0000","last_active":"2024-03-16T07:31:12.997452+0000","last_peered":"2024-03-16T07:31:12.997452+0000","last_clean":"2024-03-16T07:31:12.997452+0000","last_became_active":"2024-03-16T07:31:11.968024+0000","last_became_peered":"2024-03-16T07:31:11.968024+0000","last_unstale":"2024-03-16T07:31:12.997452+0000","last_undegraded":"2024-03-16T07:31:12.997452+0000","last_fullsized":"2024-03-16T07:31:12.997452+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:10.945812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:10.945812+0000","last_clean_scrub_stamp":"2024-03-16T07:31:10.945812+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:54:44.055228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":18,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.972407+0000","last_change":"2024-03-16T07:30:58.560911+0000","last_active":"2024-03-16T07:31:12.972407+0000","last_peered":"2024-03-16T07:31:12.972407+0000","last_clean":"2024-03-16T07:31:12.972407+0000","last_became_active":"2024-03-16T07:30:58.560672+0000","last_became_peered":"2024-03-16T07:30:58.560672+0000","last_unstale":"2024-03-16T07:31:12.972407+0000","last_undegraded":"2024-03-16T07:31:12.972407+0000","last_fullsized":"2024-03-16T07:31:12.972407+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:58:03.061266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":20,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.968024+0000","last_change":"2024-03-16T07:30:57.883569+0000","last_active":"2024-03-16T07:31:12.968024+0000","last_peered":"2024-03-16T07:31:12.968024+0000","last_clean":"2024-03-16T07:31:12.968024+0000","last_became_active":"2024-03-16T07:30:57.881021+0000","last_became_peered":"2024-03-16T07:30:57.881021+0000","last_unstale":"2024-03-16T07:31:12.968024+0000","last_undegraded":"2024-03-16T07:31:12.968024+0000","last_fullsized":"2024-03-16T07:31:12.968024+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_clean_scrub_stamp":"2024-03-16T07:30:56.855668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:10:24.637645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.981722+0000","last_change":"2024-03-16T07:31:12.976002+0000","last_active":"2024-03-16T07:31:12.981722+0000","last_peered":"2024-03-16T07:31:12.981722+0000","last_clean":"2024-03-16T07:31:12.981722+0000","last_became_active":"2024-03-16T07:31:12.975745+0000","last_became_peered":"2024-03-16T07:31:12.975745+0000","last_unstale":"2024-03-16T07:31:12.981722+0000","last_undegraded":"2024-03-16T07:31:12.981722+0000","last_fullsized":"2024-03-16T07:31:12.981722+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_clean_scrub_stamp":"2024-03-16T07:31:11.948725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:51:15.563862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.959490+0000","last_change":"2024-03-16T07:31:11.963491+0000","last_active":"2024-03-16T07:31:12.959490+0000","last_peered":"2024-03-16T07:31:12.959490+0000","last_clean":"2024-03-16T07:31:12.959490+0000","last_became_active":"2024-03-16T07:31:11.963266+0000","last_became_peered":"2024-03-16T07:31:11.963266+0000","last_unstale":"2024-03-16T07:31:12.959490+0000","last_undegraded":"2024-03-16T07:31:12.959490+0000","last_fullsized":"2024-03-16T07:31:12.959490+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:10.945812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:10.945812+0000","last_clean_scrub_stamp":"2024-03-16T07:31:10.945812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:59:27.141140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":18,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.960194+0000","last_change":"2024-03-16T07:30:58.577305+0000","last_active":"2024-03-16T07:31:12.960194+0000","last_peered":"2024-03-16T07:31:12.960194+0000","last_clean":"2024-03-16T07:31:12.960194+0000","last_became_active":"2024-03-16T07:30:58.577050+0000","last_became_peered":"2024-03-16T07:30:58.577050+0000","last_unstale":"2024-03-16T07:31:12.960194+0000","last_undegraded":"2024-03-16T07:31:12.960194+0000","last_fullsized":"2024-03-16T07:31:12.960194+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:41:05.634256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.14","version":"119'8","reported_seq":28,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.971406+0000","last_change":"2024-03-16T07:30:57.875270+0000","last_active":"2024-03-16T07:31:12.971406+0000","last_peered":"2024-03-16T07:31:12.971406+0000","last_clean":"2024-03-16T07:31:12.971406+0000","last_became_active":"2024-03-16T07:30:57.874794+0000","last_became_peered":"2024-03-16T07:30:57.874794+0000","last_unstale":"2024-03-16T07:31:12.971406+0000","last_undegraded":"2024-03-16T07:31:12.971406+0000","last_fullsized":"2024-03-16T07:31:12.971406+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_clean_scrub_stamp":"2024-03-16T07:30:56.855668+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:26:41.488241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3309,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.10","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.996322+0000","last_change":"2024-03-16T07:31:12.994279+0000","last_active":"2024-03-16T07:31:12.996322+0000","last_peered":"2024-03-16T07:31:12.996322+0000","last_clean":"2024-03-16T07:31:12.996322+0000","last_became_active":"2024-03-16T07:31:12.994031+0000","last_became_peered":"2024-03-16T07:31:12.994031+0000","last_unstale":"2024-03-16T07:31:12.996322+0000","last_undegraded":"2024-03-16T07:31:12.996322+0000","last_fullsized":"2024-03-16T07:31:12.996322+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_clean_scrub_stamp":"2024-03-16T07:31:11.948725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:43:24.254501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.965763+0000","last_change":"2024-03-16T07:31:11.964087+0000","last_active":"2024-03-16T07:31:12.965763+0000","last_peered":"2024-03-16T07:31:12.965763+0000","last_clean":"2024-03-16T07:31:12.965763+0000","last_became_active":"2024-03-16T07:31:11.963805+0000","last_became_peered":"2024-03-16T07:31:11.963805+0000","last_unstale":"2024-03-16T07:31:12.965763+0000","last_undegraded":"2024-03-16T07:31:12.965763+0000","last_fullsized":"2024-03-16T07:31:12.965763+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:10.945812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:10.945812+0000","last_clean_scrub_stamp":"2024-03-16T07:31:10.945812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:22:40.297574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":18,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.958387+0000","last_change":"2024-03-16T07:30:58.577837+0000","last_active":"2024-03-16T07:31:12.958387+0000","last_peered":"2024-03-16T07:31:12.958387+0000","last_clean":"2024-03-16T07:31:12.958387+0000","last_became_active":"2024-03-16T07:30:58.577593+0000","last_became_peered":"2024-03-16T07:30:58.577593+0000","last_unstale":"2024-03-16T07:31:12.958387+0000","last_undegraded":"2024-03-16T07:31:12.958387+0000","last_fullsized":"2024-03-16T07:31:12.958387+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:56:09.744131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.13","version":"118'2","reported_seq":22,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.968202+0000","last_change":"2024-03-16T07:30:57.876973+0000","last_active":"2024-03-16T07:31:12.968202+0000","last_peered":"2024-03-16T07:31:12.968202+0000","last_clean":"2024-03-16T07:31:12.968202+0000","last_became_active":"2024-03-16T07:30:57.876549+0000","last_became_peered":"2024-03-16T07:30:57.876549+0000","last_unstale":"2024-03-16T07:31:12.968202+0000","last_undegraded":"2024-03-16T07:31:12.968202+0000","last_fullsized":"2024-03-16T07:31:12.968202+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_clean_scrub_stamp":"2024-03-16T07:30:56.855668+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:22:06.397991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.992834+0000","last_change":"2024-03-16T07:31:12.986842+0000","last_active":"2024-03-16T07:31:12.992834+0000","last_peered":"2024-03-16T07:31:12.992834+0000","last_clean":"2024-03-16T07:31:12.992834+0000","last_became_active":"2024-03-16T07:31:12.986590+0000","last_became_peered":"2024-03-16T07:31:12.986590+0000","last_unstale":"2024-03-16T07:31:12.992834+0000","last_undegraded":"2024-03-16T07:31:12.992834+0000","last_fullsized":"2024-03-16T07:31:12.992834+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_clean_scrub_stamp":"2024-03-16T07:31:11.948725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:22:54.476463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.10","version":"122'8","reported_seq":20,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.998024+0000","last_change":"2024-03-16T07:31:11.979272+0000","last_active":"2024-03-16T07:31:12.998024+0000","last_peered":"2024-03-16T07:31:12.998024+0000","last_clean":"2024-03-16T07:31:12.998024+0000","last_became_active":"2024-03-16T07:31:11.976520+0000","last_became_peered":"2024-03-16T07:31:11.976520+0000","last_unstale":"2024-03-16T07:31:12.998024+0000","last_undegraded":"2024-03-16T07:31:12.998024+0000","last_fullsized":"2024-03-16T07:31:12.998024+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:10.945812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:10.945812+0000","last_clean_scrub_stamp":"2024-03-16T07:31:10.945812+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:54:17.182433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":18,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.968092+0000","last_change":"2024-03-16T07:30:58.560202+0000","last_active":"2024-03-16T07:31:12.968092+0000","last_peered":"2024-03-16T07:31:12.968092+0000","last_clean":"2024-03-16T07:31:12.968092+0000","last_became_active":"2024-03-16T07:30:58.559912+0000","last_became_peered":"2024-03-16T07:30:58.559912+0000","last_unstale":"2024-03-16T07:31:12.968092+0000","last_undegraded":"2024-03-16T07:31:12.968092+0000","last_fullsized":"2024-03-16T07:31:12.968092+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:25:23.575079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":20,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.977305+0000","last_change":"2024-03-16T07:30:57.873985+0000","last_active":"2024-03-16T07:31:12.977305+0000","last_peered":"2024-03-16T07:31:12.977305+0000","last_clean":"2024-03-16T07:31:12.977305+0000","last_became_active":"2024-03-16T07:30:57.873398+0000","last_became_peered":"2024-03-16T07:30:57.873398+0000","last_unstale":"2024-03-16T07:31:12.977305+0000","last_undegraded":"2024-03-16T07:31:12.977305+0000","last_fullsized":"2024-03-16T07:31:12.977305+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_clean_scrub_stamp":"2024-03-16T07:30:56.855668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:46:10.971699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.974598+0000","last_change":"2024-03-16T07:31:12.972760+0000","last_active":"2024-03-16T07:31:12.974598+0000","last_peered":"2024-03-16T07:31:12.974598+0000","last_clean":"2024-03-16T07:31:12.974598+0000","last_became_active":"2024-03-16T07:31:12.971306+0000","last_became_peered":"2024-03-16T07:31:12.971306+0000","last_unstale":"2024-03-16T07:31:12.974598+0000","last_undegraded":"2024-03-16T07:31:12.974598+0000","last_fullsized":"2024-03-16T07:31:12.974598+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_clean_scrub_stamp":"2024-03-16T07:31:11.948725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:26:56.581297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.13","version":"122'2","reported_seq":14,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.985578+0000","last_change":"2024-03-16T07:31:11.967711+0000","last_active":"2024-03-16T07:31:12.985578+0000","last_peered":"2024-03-16T07:31:12.985578+0000","last_clean":"2024-03-16T07:31:12.985578+0000","last_became_active":"2024-03-16T07:31:11.967461+0000","last_became_peered":"2024-03-16T07:31:11.967461+0000","last_unstale":"2024-03-16T07:31:12.985578+0000","last_undegraded":"2024-03-16T07:31:12.985578+0000","last_fullsized":"2024-03-16T07:31:12.985578+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:10.945812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:10.945812+0000","last_clean_scrub_stamp":"2024-03-16T07:31:10.945812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:26:16.621759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":18,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.956734+0000","last_change":"2024-03-16T07:30:58.573178+0000","last_active":"2024-03-16T07:31:12.956734+0000","last_peered":"2024-03-16T07:31:12.956734+0000","last_clean":"2024-03-16T07:31:12.956734+0000","last_became_active":"2024-03-16T07:30:58.571970+0000","last_became_peered":"2024-03-16T07:30:58.571970+0000","last_unstale":"2024-03-16T07:31:12.956734+0000","last_undegraded":"2024-03-16T07:31:12.956734+0000","last_fullsized":"2024-03-16T07:31:12.956734+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:47:26.847551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":20,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.965899+0000","last_change":"2024-03-16T07:30:57.876093+0000","last_active":"2024-03-16T07:31:12.965899+0000","last_peered":"2024-03-16T07:31:12.965899+0000","last_clean":"2024-03-16T07:31:12.965899+0000","last_became_active":"2024-03-16T07:30:57.875436+0000","last_became_peered":"2024-03-16T07:30:57.875436+0000","last_unstale":"2024-03-16T07:31:12.965899+0000","last_undegraded":"2024-03-16T07:31:12.965899+0000","last_fullsized":"2024-03-16T07:31:12.965899+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_clean_scrub_stamp":"2024-03-16T07:30:56.855668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:32:20.139876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.13","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.992445+0000","last_change":"2024-03-16T07:31:12.987329+0000","last_active":"2024-03-16T07:31:12.992445+0000","last_peered":"2024-03-16T07:31:12.992445+0000","last_clean":"2024-03-16T07:31:12.992445+0000","last_became_active":"2024-03-16T07:31:12.986553+0000","last_became_peered":"2024-03-16T07:31:12.986553+0000","last_unstale":"2024-03-16T07:31:12.992445+0000","last_undegraded":"2024-03-16T07:31:12.992445+0000","last_fullsized":"2024-03-16T07:31:12.992445+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_clean_scrub_stamp":"2024-03-16T07:31:11.948725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:02:47.740523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.976969+0000","last_change":"2024-03-16T07:31:11.977422+0000","last_active":"2024-03-16T07:31:12.976969+0000","last_peered":"2024-03-16T07:31:12.976969+0000","last_clean":"2024-03-16T07:31:12.976969+0000","last_became_active":"2024-03-16T07:31:11.976873+0000","last_became_peered":"2024-03-16T07:31:11.976873+0000","last_unstale":"2024-03-16T07:31:12.976969+0000","last_undegraded":"2024-03-16T07:31:12.976969+0000","last_fullsized":"2024-03-16T07:31:12.976969+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:10.945812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:10.945812+0000","last_clean_scrub_stamp":"2024-03-16T07:31:10.945812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:21:15.124125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":18,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.958109+0000","last_change":"2024-03-16T07:30:58.576156+0000","last_active":"2024-03-16T07:31:12.958109+0000","last_peered":"2024-03-16T07:31:12.958109+0000","last_clean":"2024-03-16T07:31:12.958109+0000","last_became_active":"2024-03-16T07:30:58.575849+0000","last_became_peered":"2024-03-16T07:30:58.575849+0000","last_unstale":"2024-03-16T07:31:12.958109+0000","last_undegraded":"2024-03-16T07:31:12.958109+0000","last_fullsized":"2024-03-16T07:31:12.958109+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:13:03.840990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.10","version":"118'8","reported_seq":28,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.956972+0000","last_change":"2024-03-16T07:30:57.879389+0000","last_active":"2024-03-16T07:31:12.956972+0000","last_peered":"2024-03-16T07:31:12.956972+0000","last_clean":"2024-03-16T07:31:12.956972+0000","last_became_active":"2024-03-16T07:30:57.879149+0000","last_became_peered":"2024-03-16T07:30:57.879149+0000","last_unstale":"2024-03-16T07:31:12.956972+0000","last_undegraded":"2024-03-16T07:31:12.956972+0000","last_fullsized":"2024-03-16T07:31:12.956972+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_clean_scrub_stamp":"2024-03-16T07:30:56.855668+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:55:45.100141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.995370+0000","last_change":"2024-03-16T07:31:12.993188+0000","last_active":"2024-03-16T07:31:12.995370+0000","last_peered":"2024-03-16T07:31:12.995370+0000","last_clean":"2024-03-16T07:31:12.995370+0000","last_became_active":"2024-03-16T07:31:12.992856+0000","last_became_peered":"2024-03-16T07:31:12.992856+0000","last_unstale":"2024-03-16T07:31:12.995370+0000","last_undegraded":"2024-03-16T07:31:12.995370+0000","last_fullsized":"2024-03-16T07:31:12.995370+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_clean_scrub_stamp":"2024-03-16T07:31:11.948725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:06:11.583560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.d","version":"122'1","reported_seq":13,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.995984+0000","last_change":"2024-03-16T07:31:11.979087+0000","last_active":"2024-03-16T07:31:12.995984+0000","last_peered":"2024-03-16T07:31:12.995984+0000","last_clean":"2024-03-16T07:31:12.995984+0000","last_became_active":"2024-03-16T07:31:11.978817+0000","last_became_peered":"2024-03-16T07:31:11.978817+0000","last_unstale":"2024-03-16T07:31:12.995984+0000","last_undegraded":"2024-03-16T07:31:12.995984+0000","last_fullsized":"2024-03-16T07:31:12.995984+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:10.945812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:10.945812+0000","last_clean_scrub_stamp":"2024-03-16T07:31:10.945812+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:21:57.389765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":18,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.967963+0000","last_change":"2024-03-16T07:30:58.566955+0000","last_active":"2024-03-16T07:31:12.967963+0000","last_peered":"2024-03-16T07:31:12.967963+0000","last_clean":"2024-03-16T07:31:12.967963+0000","last_became_active":"2024-03-16T07:30:58.563826+0000","last_became_peered":"2024-03-16T07:30:58.563826+0000","last_unstale":"2024-03-16T07:31:12.967963+0000","last_undegraded":"2024-03-16T07:31:12.967963+0000","last_fullsized":"2024-03-16T07:31:12.967963+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:49:38.279098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.f","version":"118'1","reported_seq":21,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.961671+0000","last_change":"2024-03-16T07:30:57.879349+0000","last_active":"2024-03-16T07:31:12.961671+0000","last_peered":"2024-03-16T07:31:12.961671+0000","last_clean":"2024-03-16T07:31:12.961671+0000","last_became_active":"2024-03-16T07:30:57.879060+0000","last_became_peered":"2024-03-16T07:30:57.879060+0000","last_unstale":"2024-03-16T07:31:12.961671+0000","last_undegraded":"2024-03-16T07:31:12.961671+0000","last_fullsized":"2024-03-16T07:31:12.961671+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_clean_scrub_stamp":"2024-03-16T07:30:56.855668+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:30:49.424989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.993091+0000","last_change":"2024-03-16T07:31:12.988388+0000","last_active":"2024-03-16T07:31:12.993091+0000","last_peered":"2024-03-16T07:31:12.993091+0000","last_clean":"2024-03-16T07:31:12.993091+0000","last_became_active":"2024-03-16T07:31:12.987803+0000","last_became_peered":"2024-03-16T07:31:12.987803+0000","last_unstale":"2024-03-16T07:31:12.993091+0000","last_undegraded":"2024-03-16T07:31:12.993091+0000","last_fullsized":"2024-03-16T07:31:12.993091+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_clean_scrub_stamp":"2024-03-16T07:31:11.948725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:48:55.913014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.970882+0000","last_change":"2024-03-16T07:31:11.970854+0000","last_active":"2024-03-16T07:31:12.970882+0000","last_peered":"2024-03-16T07:31:12.970882+0000","last_clean":"2024-03-16T07:31:12.970882+0000","last_became_active":"2024-03-16T07:31:11.970623+0000","last_became_peered":"2024-03-16T07:31:11.970623+0000","last_unstale":"2024-03-16T07:31:12.970882+0000","last_undegraded":"2024-03-16T07:31:12.970882+0000","last_fullsized":"2024-03-16T07:31:12.970882+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:10.945812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:10.945812+0000","last_clean_scrub_stamp":"2024-03-16T07:31:10.945812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:55:09.765511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":18,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.961226+0000","last_change":"2024-03-16T07:30:58.574600+0000","last_active":"2024-03-16T07:31:12.961226+0000","last_peered":"2024-03-16T07:31:12.961226+0000","last_clean":"2024-03-16T07:31:12.961226+0000","last_became_active":"2024-03-16T07:30:58.574152+0000","last_became_peered":"2024-03-16T07:30:58.574152+0000","last_unstale":"2024-03-16T07:31:12.961226+0000","last_undegraded":"2024-03-16T07:31:12.961226+0000","last_fullsized":"2024-03-16T07:31:12.961226+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:59:55.677315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"118'2","reported_seq":22,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.968113+0000","last_change":"2024-03-16T07:30:57.881691+0000","last_active":"2024-03-16T07:31:12.968113+0000","last_peered":"2024-03-16T07:31:12.968113+0000","last_clean":"2024-03-16T07:31:12.968113+0000","last_became_active":"2024-03-16T07:30:57.880871+0000","last_became_peered":"2024-03-16T07:30:57.880871+0000","last_unstale":"2024-03-16T07:31:12.968113+0000","last_undegraded":"2024-03-16T07:31:12.968113+0000","last_fullsized":"2024-03-16T07:31:12.968113+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_clean_scrub_stamp":"2024-03-16T07:30:56.855668+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:56:12.658295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.e","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.983782+0000","last_change":"2024-03-16T07:31:12.982828+0000","last_active":"2024-03-16T07:31:12.983782+0000","last_peered":"2024-03-16T07:31:12.983782+0000","last_clean":"2024-03-16T07:31:12.983782+0000","last_became_active":"2024-03-16T07:31:12.981644+0000","last_became_peered":"2024-03-16T07:31:12.981644+0000","last_unstale":"2024-03-16T07:31:12.983782+0000","last_undegraded":"2024-03-16T07:31:12.983782+0000","last_fullsized":"2024-03-16T07:31:12.983782+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_clean_scrub_stamp":"2024-03-16T07:31:11.948725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:59:28.144053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"122'1","reported_seq":13,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.992402+0000","last_change":"2024-03-16T07:31:11.975750+0000","last_active":"2024-03-16T07:31:12.992402+0000","last_peered":"2024-03-16T07:31:12.992402+0000","last_clean":"2024-03-16T07:31:12.992402+0000","last_became_active":"2024-03-16T07:31:11.972712+0000","last_became_peered":"2024-03-16T07:31:11.972712+0000","last_unstale":"2024-03-16T07:31:12.992402+0000","last_undegraded":"2024-03-16T07:31:12.992402+0000","last_fullsized":"2024-03-16T07:31:12.992402+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:10.945812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:10.945812+0000","last_clean_scrub_stamp":"2024-03-16T07:31:10.945812+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:22:40.274582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":18,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.974001+0000","last_change":"2024-03-16T07:30:58.562180+0000","last_active":"2024-03-16T07:31:12.974001+0000","last_peered":"2024-03-16T07:31:12.974001+0000","last_clean":"2024-03-16T07:31:12.974001+0000","last_became_active":"2024-03-16T07:30:58.560416+0000","last_became_peered":"2024-03-16T07:30:58.560416+0000","last_unstale":"2024-03-16T07:31:12.974001+0000","last_undegraded":"2024-03-16T07:31:12.974001+0000","last_fullsized":"2024-03-16T07:31:12.974001+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:27:03.691637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.d","version":"118'1","reported_seq":21,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.960380+0000","last_change":"2024-03-16T07:30:57.878006+0000","last_active":"2024-03-16T07:31:12.960380+0000","last_peered":"2024-03-16T07:31:12.960380+0000","last_clean":"2024-03-16T07:31:12.960380+0000","last_became_active":"2024-03-16T07:30:57.877534+0000","last_became_peered":"2024-03-16T07:30:57.877534+0000","last_unstale":"2024-03-16T07:31:12.960380+0000","last_undegraded":"2024-03-16T07:31:12.960380+0000","last_fullsized":"2024-03-16T07:31:12.960380+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_clean_scrub_stamp":"2024-03-16T07:30:56.855668+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:00:45.799835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.f","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.993952+0000","last_change":"2024-03-16T07:31:12.990128+0000","last_active":"2024-03-16T07:31:12.993952+0000","last_peered":"2024-03-16T07:31:12.993952+0000","last_clean":"2024-03-16T07:31:12.993952+0000","last_became_active":"2024-03-16T07:31:12.989446+0000","last_became_peered":"2024-03-16T07:31:12.989446+0000","last_unstale":"2024-03-16T07:31:12.993952+0000","last_undegraded":"2024-03-16T07:31:12.993952+0000","last_fullsized":"2024-03-16T07:31:12.993952+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_clean_scrub_stamp":"2024-03-16T07:31:11.948725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:37:50.591552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.e","version":"122'2","reported_seq":14,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:13.001494+0000","last_change":"2024-03-16T07:31:11.970846+0000","last_active":"2024-03-16T07:31:13.001494+0000","last_peered":"2024-03-16T07:31:13.001494+0000","last_clean":"2024-03-16T07:31:13.001494+0000","last_became_active":"2024-03-16T07:31:11.970590+0000","last_became_peered":"2024-03-16T07:31:11.970590+0000","last_unstale":"2024-03-16T07:31:13.001494+0000","last_undegraded":"2024-03-16T07:31:13.001494+0000","last_fullsized":"2024-03-16T07:31:13.001494+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:10.945812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:10.945812+0000","last_clean_scrub_stamp":"2024-03-16T07:31:10.945812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:00:12.863907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":18,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.970820+0000","last_change":"2024-03-16T07:30:58.562773+0000","last_active":"2024-03-16T07:31:12.970820+0000","last_peered":"2024-03-16T07:31:12.970820+0000","last_clean":"2024-03-16T07:31:12.970820+0000","last_became_active":"2024-03-16T07:30:58.562520+0000","last_became_peered":"2024-03-16T07:30:58.562520+0000","last_unstale":"2024-03-16T07:31:12.970820+0000","last_undegraded":"2024-03-16T07:31:12.970820+0000","last_fullsized":"2024-03-16T07:31:12.970820+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:13:01.831834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":20,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.974172+0000","last_change":"2024-03-16T07:30:57.877782+0000","last_active":"2024-03-16T07:31:12.974172+0000","last_peered":"2024-03-16T07:31:12.974172+0000","last_clean":"2024-03-16T07:31:12.974172+0000","last_became_active":"2024-03-16T07:30:57.876843+0000","last_became_peered":"2024-03-16T07:30:57.876843+0000","last_unstale":"2024-03-16T07:31:12.974172+0000","last_undegraded":"2024-03-16T07:31:12.974172+0000","last_fullsized":"2024-03-16T07:31:12.974172+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_clean_scrub_stamp":"2024-03-16T07:30:56.855668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:26:20.745771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.993622+0000","last_change":"2024-03-16T07:31:12.990712+0000","last_active":"2024-03-16T07:31:12.993622+0000","last_peered":"2024-03-16T07:31:12.993622+0000","last_clean":"2024-03-16T07:31:12.993622+0000","last_became_active":"2024-03-16T07:31:12.990475+0000","last_became_peered":"2024-03-16T07:31:12.990475+0000","last_unstale":"2024-03-16T07:31:12.993622+0000","last_undegraded":"2024-03-16T07:31:12.993622+0000","last_fullsized":"2024-03-16T07:31:12.993622+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_clean_scrub_stamp":"2024-03-16T07:31:11.948725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:00:41.796661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.965343+0000","last_change":"2024-03-16T07:31:11.968601+0000","last_active":"2024-03-16T07:31:12.965343+0000","last_peered":"2024-03-16T07:31:12.965343+0000","last_clean":"2024-03-16T07:31:12.965343+0000","last_became_active":"2024-03-16T07:31:11.968362+0000","last_became_peered":"2024-03-16T07:31:11.968362+0000","last_unstale":"2024-03-16T07:31:12.965343+0000","last_undegraded":"2024-03-16T07:31:12.965343+0000","last_fullsized":"2024-03-16T07:31:12.965343+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:10.945812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:10.945812+0000","last_clean_scrub_stamp":"2024-03-16T07:31:10.945812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:40:36.299362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":18,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.977304+0000","last_change":"2024-03-16T07:30:58.561355+0000","last_active":"2024-03-16T07:31:12.977304+0000","last_peered":"2024-03-16T07:31:12.977304+0000","last_clean":"2024-03-16T07:31:12.977304+0000","last_became_active":"2024-03-16T07:30:58.561123+0000","last_became_peered":"2024-03-16T07:30:58.561123+0000","last_unstale":"2024-03-16T07:31:12.977304+0000","last_undegraded":"2024-03-16T07:31:12.977304+0000","last_fullsized":"2024-03-16T07:31:12.977304+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:26:11.962024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.b","version":"118'2","reported_seq":22,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.977085+0000","last_change":"2024-03-16T07:30:57.876715+0000","last_active":"2024-03-16T07:31:12.977085+0000","last_peered":"2024-03-16T07:31:12.977085+0000","last_clean":"2024-03-16T07:31:12.977085+0000","last_became_active":"2024-03-16T07:30:57.876348+0000","last_became_peered":"2024-03-16T07:30:57.876348+0000","last_unstale":"2024-03-16T07:31:12.977085+0000","last_undegraded":"2024-03-16T07:31:12.977085+0000","last_fullsized":"2024-03-16T07:31:12.977085+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_clean_scrub_stamp":"2024-03-16T07:30:56.855668+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:59:13.050997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.974718+0000","last_change":"2024-03-16T07:31:12.970889+0000","last_active":"2024-03-16T07:31:12.974718+0000","last_peered":"2024-03-16T07:31:12.974718+0000","last_clean":"2024-03-16T07:31:12.974718+0000","last_became_active":"2024-03-16T07:31:12.969677+0000","last_became_peered":"2024-03-16T07:31:12.969677+0000","last_unstale":"2024-03-16T07:31:12.974718+0000","last_undegraded":"2024-03-16T07:31:12.974718+0000","last_fullsized":"2024-03-16T07:31:12.974718+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_clean_scrub_stamp":"2024-03-16T07:31:11.948725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:39:24.829868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.979762+0000","last_change":"2024-03-16T07:31:11.971513+0000","last_active":"2024-03-16T07:31:12.979762+0000","last_peered":"2024-03-16T07:31:12.979762+0000","last_clean":"2024-03-16T07:31:12.979762+0000","last_became_active":"2024-03-16T07:31:11.971265+0000","last_became_peered":"2024-03-16T07:31:11.971265+0000","last_unstale":"2024-03-16T07:31:12.979762+0000","last_undegraded":"2024-03-16T07:31:12.979762+0000","last_fullsized":"2024-03-16T07:31:12.979762+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:10.945812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:10.945812+0000","last_clean_scrub_stamp":"2024-03-16T07:31:10.945812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:29:56.022194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":18,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.976997+0000","last_change":"2024-03-16T07:30:58.561031+0000","last_active":"2024-03-16T07:31:12.976997+0000","last_peered":"2024-03-16T07:31:12.976997+0000","last_clean":"2024-03-16T07:31:12.976997+0000","last_became_active":"2024-03-16T07:30:58.560717+0000","last_became_peered":"2024-03-16T07:30:58.560717+0000","last_unstale":"2024-03-16T07:31:12.976997+0000","last_undegraded":"2024-03-16T07:31:12.976997+0000","last_fullsized":"2024-03-16T07:31:12.976997+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:30:27.329471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":20,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.958501+0000","last_change":"2024-03-16T07:30:57.876974+0000","last_active":"2024-03-16T07:31:12.958501+0000","last_peered":"2024-03-16T07:31:12.958501+0000","last_clean":"2024-03-16T07:31:12.958501+0000","last_became_active":"2024-03-16T07:30:57.876350+0000","last_became_peered":"2024-03-16T07:30:57.876350+0000","last_unstale":"2024-03-16T07:31:12.958501+0000","last_undegraded":"2024-03-16T07:31:12.958501+0000","last_fullsized":"2024-03-16T07:31:12.958501+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_clean_scrub_stamp":"2024-03-16T07:30:56.855668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:12:00.017490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.974486+0000","last_change":"2024-03-16T07:31:12.970218+0000","last_active":"2024-03-16T07:31:12.974486+0000","last_peered":"2024-03-16T07:31:12.974486+0000","last_clean":"2024-03-16T07:31:12.974486+0000","last_became_active":"2024-03-16T07:31:12.969970+0000","last_became_peered":"2024-03-16T07:31:12.969970+0000","last_unstale":"2024-03-16T07:31:12.974486+0000","last_undegraded":"2024-03-16T07:31:12.974486+0000","last_fullsized":"2024-03-16T07:31:12.974486+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_clean_scrub_stamp":"2024-03-16T07:31:11.948725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:45:25.869947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.b","version":"122'2","reported_seq":14,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.995966+0000","last_change":"2024-03-16T07:31:11.975500+0000","last_active":"2024-03-16T07:31:12.995966+0000","last_peered":"2024-03-16T07:31:12.995966+0000","last_clean":"2024-03-16T07:31:12.995966+0000","last_became_active":"2024-03-16T07:31:11.975276+0000","last_became_peered":"2024-03-16T07:31:11.975276+0000","last_unstale":"2024-03-16T07:31:12.995966+0000","last_undegraded":"2024-03-16T07:31:12.995966+0000","last_fullsized":"2024-03-16T07:31:12.995966+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:10.945812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:10.945812+0000","last_clean_scrub_stamp":"2024-03-16T07:31:10.945812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:39:09.265518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":18,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.984464+0000","last_change":"2024-03-16T07:30:58.561986+0000","last_active":"2024-03-16T07:31:12.984464+0000","last_peered":"2024-03-16T07:31:12.984464+0000","last_clean":"2024-03-16T07:31:12.984464+0000","last_became_active":"2024-03-16T07:30:58.561661+0000","last_became_peered":"2024-03-16T07:30:58.561661+0000","last_unstale":"2024-03-16T07:31:12.984464+0000","last_undegraded":"2024-03-16T07:31:12.984464+0000","last_fullsized":"2024-03-16T07:31:12.984464+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:57:03.215249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":20,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.958269+0000","last_change":"2024-03-16T07:30:57.880017+0000","last_active":"2024-03-16T07:31:12.958269+0000","last_peered":"2024-03-16T07:31:12.958269+0000","last_clean":"2024-03-16T07:31:12.958269+0000","last_became_active":"2024-03-16T07:30:57.879752+0000","last_became_peered":"2024-03-16T07:30:57.879752+0000","last_unstale":"2024-03-16T07:31:12.958269+0000","last_undegraded":"2024-03-16T07:31:12.958269+0000","last_fullsized":"2024-03-16T07:31:12.958269+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_clean_scrub_stamp":"2024-03-16T07:30:56.855668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:02:33.202240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.b","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.993017+0000","last_change":"2024-03-16T07:31:12.987755+0000","last_active":"2024-03-16T07:31:12.993017+0000","last_peered":"2024-03-16T07:31:12.993017+0000","last_clean":"2024-03-16T07:31:12.993017+0000","last_became_active":"2024-03-16T07:31:12.987524+0000","last_became_peered":"2024-03-16T07:31:12.987524+0000","last_unstale":"2024-03-16T07:31:12.993017+0000","last_undegraded":"2024-03-16T07:31:12.993017+0000","last_fullsized":"2024-03-16T07:31:12.993017+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_clean_scrub_stamp":"2024-03-16T07:31:11.948725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:05:19.367597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.976972+0000","last_change":"2024-03-16T07:31:11.977237+0000","last_active":"2024-03-16T07:31:12.976972+0000","last_peered":"2024-03-16T07:31:12.976972+0000","last_clean":"2024-03-16T07:31:12.976972+0000","last_became_active":"2024-03-16T07:31:11.975987+0000","last_became_peered":"2024-03-16T07:31:11.975987+0000","last_unstale":"2024-03-16T07:31:12.976972+0000","last_undegraded":"2024-03-16T07:31:12.976972+0000","last_fullsized":"2024-03-16T07:31:12.976972+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:10.945812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:10.945812+0000","last_clean_scrub_stamp":"2024-03-16T07:31:10.945812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:23:56.966113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":18,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.976045+0000","last_change":"2024-03-16T07:30:58.566963+0000","last_active":"2024-03-16T07:31:12.976045+0000","last_peered":"2024-03-16T07:31:12.976045+0000","last_clean":"2024-03-16T07:31:12.976045+0000","last_became_active":"2024-03-16T07:30:58.566661+0000","last_became_peered":"2024-03-16T07:30:58.566661+0000","last_unstale":"2024-03-16T07:31:12.976045+0000","last_undegraded":"2024-03-16T07:31:12.976045+0000","last_fullsized":"2024-03-16T07:31:12.976045+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:07:57.057969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":20,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.957034+0000","last_change":"2024-03-16T07:30:57.881392+0000","last_active":"2024-03-16T07:31:12.957034+0000","last_peered":"2024-03-16T07:31:12.957034+0000","last_clean":"2024-03-16T07:31:12.957034+0000","last_became_active":"2024-03-16T07:30:57.881148+0000","last_became_peered":"2024-03-16T07:30:57.881148+0000","last_unstale":"2024-03-16T07:31:12.957034+0000","last_undegraded":"2024-03-16T07:31:12.957034+0000","last_fullsized":"2024-03-16T07:31:12.957034+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_clean_scrub_stamp":"2024-03-16T07:30:56.855668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:37:55.898841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.982910+0000","last_change":"2024-03-16T07:31:12.981881+0000","last_active":"2024-03-16T07:31:12.982910+0000","last_peered":"2024-03-16T07:31:12.982910+0000","last_clean":"2024-03-16T07:31:12.982910+0000","last_became_active":"2024-03-16T07:31:12.981577+0000","last_became_peered":"2024-03-16T07:31:12.981577+0000","last_unstale":"2024-03-16T07:31:12.982910+0000","last_undegraded":"2024-03-16T07:31:12.982910+0000","last_fullsized":"2024-03-16T07:31:12.982910+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_clean_scrub_stamp":"2024-03-16T07:31:11.948725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:01:14.148184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.959706+0000","last_change":"2024-03-16T07:31:11.969508+0000","last_active":"2024-03-16T07:31:12.959706+0000","last_peered":"2024-03-16T07:31:12.959706+0000","last_clean":"2024-03-16T07:31:12.959706+0000","last_became_active":"2024-03-16T07:31:11.969276+0000","last_became_peered":"2024-03-16T07:31:11.969276+0000","last_unstale":"2024-03-16T07:31:12.959706+0000","last_undegraded":"2024-03-16T07:31:12.959706+0000","last_fullsized":"2024-03-16T07:31:12.959706+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:10.945812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:10.945812+0000","last_clean_scrub_stamp":"2024-03-16T07:31:10.945812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:19:50.123388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":18,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.960444+0000","last_change":"2024-03-16T07:30:58.576511+0000","last_active":"2024-03-16T07:31:12.960444+0000","last_peered":"2024-03-16T07:31:12.960444+0000","last_clean":"2024-03-16T07:31:12.960444+0000","last_became_active":"2024-03-16T07:30:58.576275+0000","last_became_peered":"2024-03-16T07:30:58.576275+0000","last_unstale":"2024-03-16T07:31:12.960444+0000","last_undegraded":"2024-03-16T07:31:12.960444+0000","last_fullsized":"2024-03-16T07:31:12.960444+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:00:46.764807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.7","version":"118'2","reported_seq":22,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.961768+0000","last_change":"2024-03-16T07:30:57.876924+0000","last_active":"2024-03-16T07:31:12.961768+0000","last_peered":"2024-03-16T07:31:12.961768+0000","last_clean":"2024-03-16T07:31:12.961768+0000","last_became_active":"2024-03-16T07:30:57.876507+0000","last_became_peered":"2024-03-16T07:30:57.876507+0000","last_unstale":"2024-03-16T07:31:12.961768+0000","last_undegraded":"2024-03-16T07:31:12.961768+0000","last_fullsized":"2024-03-16T07:31:12.961768+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_clean_scrub_stamp":"2024-03-16T07:30:56.855668+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:09:54.480497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.994732+0000","last_change":"2024-03-16T07:31:12.988472+0000","last_active":"2024-03-16T07:31:12.994732+0000","last_peered":"2024-03-16T07:31:12.994732+0000","last_clean":"2024-03-16T07:31:12.994732+0000","last_became_active":"2024-03-16T07:31:12.988196+0000","last_became_peered":"2024-03-16T07:31:12.988196+0000","last_unstale":"2024-03-16T07:31:12.994732+0000","last_undegraded":"2024-03-16T07:31:12.994732+0000","last_fullsized":"2024-03-16T07:31:12.994732+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_clean_scrub_stamp":"2024-03-16T07:31:11.948725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:09:35.921695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.958758+0000","last_change":"2024-03-16T07:31:11.974760+0000","last_active":"2024-03-16T07:31:12.958758+0000","last_peered":"2024-03-16T07:31:12.958758+0000","last_clean":"2024-03-16T07:31:12.958758+0000","last_became_active":"2024-03-16T07:31:11.974514+0000","last_became_peered":"2024-03-16T07:31:11.974514+0000","last_unstale":"2024-03-16T07:31:12.958758+0000","last_undegraded":"2024-03-16T07:31:12.958758+0000","last_fullsized":"2024-03-16T07:31:12.958758+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:10.945812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:10.945812+0000","last_clean_scrub_stamp":"2024-03-16T07:31:10.945812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:42:04.788532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":18,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.961307+0000","last_change":"2024-03-16T07:30:58.574706+0000","last_active":"2024-03-16T07:31:12.961307+0000","last_peered":"2024-03-16T07:31:12.961307+0000","last_clean":"2024-03-16T07:31:12.961307+0000","last_became_active":"2024-03-16T07:30:58.574447+0000","last_became_peered":"2024-03-16T07:30:58.574447+0000","last_unstale":"2024-03-16T07:31:12.961307+0000","last_undegraded":"2024-03-16T07:31:12.961307+0000","last_fullsized":"2024-03-16T07:31:12.961307+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:08:10.527555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.6","version":"119'1","reported_seq":21,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.968287+0000","last_change":"2024-03-16T07:30:57.883769+0000","last_active":"2024-03-16T07:31:12.968287+0000","last_peered":"2024-03-16T07:31:12.968287+0000","last_clean":"2024-03-16T07:31:12.968287+0000","last_became_active":"2024-03-16T07:30:57.881218+0000","last_became_peered":"2024-03-16T07:30:57.881218+0000","last_unstale":"2024-03-16T07:31:12.968287+0000","last_undegraded":"2024-03-16T07:31:12.968287+0000","last_fullsized":"2024-03-16T07:31:12.968287+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_clean_scrub_stamp":"2024-03-16T07:30:56.855668+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:56:31.528403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:13.001033+0000","last_change":"2024-03-16T07:31:13.000439+0000","last_active":"2024-03-16T07:31:13.001033+0000","last_peered":"2024-03-16T07:31:13.001033+0000","last_clean":"2024-03-16T07:31:13.001033+0000","last_became_active":"2024-03-16T07:31:13.000172+0000","last_became_peered":"2024-03-16T07:31:13.000172+0000","last_unstale":"2024-03-16T07:31:13.001033+0000","last_undegraded":"2024-03-16T07:31:13.001033+0000","last_fullsized":"2024-03-16T07:31:13.001033+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_clean_scrub_stamp":"2024-03-16T07:31:11.948725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:29:27.923001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.7","version":"122'2","reported_seq":14,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.995110+0000","last_change":"2024-03-16T07:31:11.970787+0000","last_active":"2024-03-16T07:31:12.995110+0000","last_peered":"2024-03-16T07:31:12.995110+0000","last_clean":"2024-03-16T07:31:12.995110+0000","last_became_active":"2024-03-16T07:31:11.970470+0000","last_became_peered":"2024-03-16T07:31:11.970470+0000","last_unstale":"2024-03-16T07:31:12.995110+0000","last_undegraded":"2024-03-16T07:31:12.995110+0000","last_fullsized":"2024-03-16T07:31:12.995110+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:10.945812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:10.945812+0000","last_clean_scrub_stamp":"2024-03-16T07:31:10.945812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:46:25.061842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":18,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.974089+0000","last_change":"2024-03-16T07:30:58.562495+0000","last_active":"2024-03-16T07:31:12.974089+0000","last_peered":"2024-03-16T07:31:12.974089+0000","last_clean":"2024-03-16T07:31:12.974089+0000","last_became_active":"2024-03-16T07:30:58.562227+0000","last_became_peered":"2024-03-16T07:30:58.562227+0000","last_unstale":"2024-03-16T07:31:12.974089+0000","last_undegraded":"2024-03-16T07:31:12.974089+0000","last_fullsized":"2024-03-16T07:31:12.974089+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:02:57.834208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":20,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.970984+0000","last_change":"2024-03-16T07:30:57.875030+0000","last_active":"2024-03-16T07:31:12.970984+0000","last_peered":"2024-03-16T07:31:12.970984+0000","last_clean":"2024-03-16T07:31:12.970984+0000","last_became_active":"2024-03-16T07:30:57.874778+0000","last_became_peered":"2024-03-16T07:30:57.874778+0000","last_unstale":"2024-03-16T07:31:12.970984+0000","last_undegraded":"2024-03-16T07:31:12.970984+0000","last_fullsized":"2024-03-16T07:31:12.970984+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_clean_scrub_stamp":"2024-03-16T07:30:56.855668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:21:12.260369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.7","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.999392+0000","last_change":"2024-03-16T07:31:12.998435+0000","last_active":"2024-03-16T07:31:12.999392+0000","last_peered":"2024-03-16T07:31:12.999392+0000","last_clean":"2024-03-16T07:31:12.999392+0000","last_became_active":"2024-03-16T07:31:12.998195+0000","last_became_peered":"2024-03-16T07:31:12.998195+0000","last_unstale":"2024-03-16T07:31:12.999392+0000","last_undegraded":"2024-03-16T07:31:12.999392+0000","last_fullsized":"2024-03-16T07:31:12.999392+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_clean_scrub_stamp":"2024-03-16T07:31:11.948725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:32:27.894672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.959642+0000","last_change":"2024-03-16T07:31:11.973959+0000","last_active":"2024-03-16T07:31:12.959642+0000","last_peered":"2024-03-16T07:31:12.959642+0000","last_clean":"2024-03-16T07:31:12.959642+0000","last_became_active":"2024-03-16T07:31:11.973651+0000","last_became_peered":"2024-03-16T07:31:11.973651+0000","last_unstale":"2024-03-16T07:31:12.959642+0000","last_undegraded":"2024-03-16T07:31:12.959642+0000","last_fullsized":"2024-03-16T07:31:12.959642+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:10.945812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:10.945812+0000","last_clean_scrub_stamp":"2024-03-16T07:31:10.945812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:18:50.892526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":18,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.970901+0000","last_change":"2024-03-16T07:30:58.568858+0000","last_active":"2024-03-16T07:31:12.970901+0000","last_peered":"2024-03-16T07:31:12.970901+0000","last_clean":"2024-03-16T07:31:12.970901+0000","last_became_active":"2024-03-16T07:30:58.568307+0000","last_became_peered":"2024-03-16T07:30:58.568307+0000","last_unstale":"2024-03-16T07:31:12.970901+0000","last_undegraded":"2024-03-16T07:31:12.970901+0000","last_fullsized":"2024-03-16T07:31:12.970901+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:11:18.497707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":20,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.974261+0000","last_change":"2024-03-16T07:30:57.877529+0000","last_active":"2024-03-16T07:31:12.974261+0000","last_peered":"2024-03-16T07:31:12.974261+0000","last_clean":"2024-03-16T07:31:12.974261+0000","last_became_active":"2024-03-16T07:30:57.876528+0000","last_became_peered":"2024-03-16T07:30:57.876528+0000","last_unstale":"2024-03-16T07:31:12.974261+0000","last_undegraded":"2024-03-16T07:31:12.974261+0000","last_fullsized":"2024-03-16T07:31:12.974261+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_clean_scrub_stamp":"2024-03-16T07:30:56.855668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:21:55.125566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.984996+0000","last_change":"2024-03-16T07:31:12.982909+0000","last_active":"2024-03-16T07:31:12.984996+0000","last_peered":"2024-03-16T07:31:12.984996+0000","last_clean":"2024-03-16T07:31:12.984996+0000","last_became_active":"2024-03-16T07:31:12.982149+0000","last_became_peered":"2024-03-16T07:31:12.982149+0000","last_unstale":"2024-03-16T07:31:12.984996+0000","last_undegraded":"2024-03-16T07:31:12.984996+0000","last_fullsized":"2024-03-16T07:31:12.984996+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_clean_scrub_stamp":"2024-03-16T07:31:11.948725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:20:34.343105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.957636+0000","last_change":"2024-03-16T07:31:11.970154+0000","last_active":"2024-03-16T07:31:12.957636+0000","last_peered":"2024-03-16T07:31:12.957636+0000","last_clean":"2024-03-16T07:31:12.957636+0000","last_became_active":"2024-03-16T07:31:11.969914+0000","last_became_peered":"2024-03-16T07:31:11.969914+0000","last_unstale":"2024-03-16T07:31:12.957636+0000","last_undegraded":"2024-03-16T07:31:12.957636+0000","last_fullsized":"2024-03-16T07:31:12.957636+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:10.945812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:10.945812+0000","last_clean_scrub_stamp":"2024-03-16T07:31:10.945812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:54:44.055228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":18,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.958414+0000","last_change":"2024-03-16T07:30:58.577875+0000","last_active":"2024-03-16T07:31:12.958414+0000","last_peered":"2024-03-16T07:31:12.958414+0000","last_clean":"2024-03-16T07:31:12.958414+0000","last_became_active":"2024-03-16T07:30:58.577623+0000","last_became_peered":"2024-03-16T07:30:58.577623+0000","last_unstale":"2024-03-16T07:31:12.958414+0000","last_undegraded":"2024-03-16T07:31:12.958414+0000","last_fullsized":"2024-03-16T07:31:12.958414+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:07:43.960629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":20,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.977175+0000","last_change":"2024-03-16T07:30:57.875740+0000","last_active":"2024-03-16T07:31:12.977175+0000","last_peered":"2024-03-16T07:31:12.977175+0000","last_clean":"2024-03-16T07:31:12.977175+0000","last_became_active":"2024-03-16T07:30:57.875469+0000","last_became_peered":"2024-03-16T07:30:57.875469+0000","last_unstale":"2024-03-16T07:31:12.977175+0000","last_undegraded":"2024-03-16T07:31:12.977175+0000","last_fullsized":"2024-03-16T07:31:12.977175+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_clean_scrub_stamp":"2024-03-16T07:30:56.855668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:19:36.033244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.993739+0000","last_change":"2024-03-16T07:31:12.990937+0000","last_active":"2024-03-16T07:31:12.993739+0000","last_peered":"2024-03-16T07:31:12.993739+0000","last_clean":"2024-03-16T07:31:12.993739+0000","last_became_active":"2024-03-16T07:31:12.990421+0000","last_became_peered":"2024-03-16T07:31:12.990421+0000","last_unstale":"2024-03-16T07:31:12.993739+0000","last_undegraded":"2024-03-16T07:31:12.993739+0000","last_fullsized":"2024-03-16T07:31:12.993739+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_clean_scrub_stamp":"2024-03-16T07:31:11.948725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:28:29.449014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.956362+0000","last_change":"2024-03-16T07:31:11.975752+0000","last_active":"2024-03-16T07:31:12.956362+0000","last_peered":"2024-03-16T07:31:12.956362+0000","last_clean":"2024-03-16T07:31:12.956362+0000","last_became_active":"2024-03-16T07:31:11.975520+0000","last_became_peered":"2024-03-16T07:31:11.975520+0000","last_unstale":"2024-03-16T07:31:12.956362+0000","last_undegraded":"2024-03-16T07:31:12.956362+0000","last_fullsized":"2024-03-16T07:31:12.956362+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:10.945812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:10.945812+0000","last_clean_scrub_stamp":"2024-03-16T07:31:10.945812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:21:57.389765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":18,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.958484+0000","last_change":"2024-03-16T07:30:58.577788+0000","last_active":"2024-03-16T07:31:12.958484+0000","last_peered":"2024-03-16T07:31:12.958484+0000","last_clean":"2024-03-16T07:31:12.958484+0000","last_became_active":"2024-03-16T07:30:58.577528+0000","last_became_peered":"2024-03-16T07:30:58.577528+0000","last_unstale":"2024-03-16T07:31:12.958484+0000","last_undegraded":"2024-03-16T07:31:12.958484+0000","last_fullsized":"2024-03-16T07:31:12.958484+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:16:51.341129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":20,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.977418+0000","last_change":"2024-03-16T07:30:57.874192+0000","last_active":"2024-03-16T07:31:12.977418+0000","last_peered":"2024-03-16T07:31:12.977418+0000","last_clean":"2024-03-16T07:31:12.977418+0000","last_became_active":"2024-03-16T07:30:57.873741+0000","last_became_peered":"2024-03-16T07:30:57.873741+0000","last_unstale":"2024-03-16T07:31:12.977418+0000","last_undegraded":"2024-03-16T07:31:12.977418+0000","last_fullsized":"2024-03-16T07:31:12.977418+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_clean_scrub_stamp":"2024-03-16T07:30:56.855668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:45:10.776890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.987557+0000","last_change":"2024-03-16T07:31:12.981563+0000","last_active":"2024-03-16T07:31:12.987557+0000","last_peered":"2024-03-16T07:31:12.987557+0000","last_clean":"2024-03-16T07:31:12.987557+0000","last_became_active":"2024-03-16T07:31:12.980910+0000","last_became_peered":"2024-03-16T07:31:12.980910+0000","last_unstale":"2024-03-16T07:31:12.987557+0000","last_undegraded":"2024-03-16T07:31:12.987557+0000","last_fullsized":"2024-03-16T07:31:12.987557+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_clean_scrub_stamp":"2024-03-16T07:31:11.948725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:58:15.328373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.967810+0000","last_change":"2024-03-16T07:31:11.975341+0000","last_active":"2024-03-16T07:31:12.967810+0000","last_peered":"2024-03-16T07:31:12.967810+0000","last_clean":"2024-03-16T07:31:12.967810+0000","last_became_active":"2024-03-16T07:31:11.975110+0000","last_became_peered":"2024-03-16T07:31:11.975110+0000","last_unstale":"2024-03-16T07:31:12.967810+0000","last_undegraded":"2024-03-16T07:31:12.967810+0000","last_fullsized":"2024-03-16T07:31:12.967810+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:10.945812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:10.945812+0000","last_clean_scrub_stamp":"2024-03-16T07:31:10.945812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:34:37.823525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":18,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.956824+0000","last_change":"2024-03-16T07:30:58.573475+0000","last_active":"2024-03-16T07:31:12.956824+0000","last_peered":"2024-03-16T07:31:12.956824+0000","last_clean":"2024-03-16T07:31:12.956824+0000","last_became_active":"2024-03-16T07:30:58.572303+0000","last_became_peered":"2024-03-16T07:30:58.572303+0000","last_unstale":"2024-03-16T07:31:12.956824+0000","last_undegraded":"2024-03-16T07:31:12.956824+0000","last_fullsized":"2024-03-16T07:31:12.956824+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:11:18.497707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":20,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.976216+0000","last_change":"2024-03-16T07:30:57.875574+0000","last_active":"2024-03-16T07:31:12.976216+0000","last_peered":"2024-03-16T07:31:12.976216+0000","last_clean":"2024-03-16T07:31:12.976216+0000","last_became_active":"2024-03-16T07:30:57.875325+0000","last_became_peered":"2024-03-16T07:30:57.875325+0000","last_unstale":"2024-03-16T07:31:12.976216+0000","last_undegraded":"2024-03-16T07:31:12.976216+0000","last_fullsized":"2024-03-16T07:31:12.976216+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_clean_scrub_stamp":"2024-03-16T07:30:56.855668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:18:36.802383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.996944+0000","last_change":"2024-03-16T07:31:12.995271+0000","last_active":"2024-03-16T07:31:12.996944+0000","last_peered":"2024-03-16T07:31:12.996944+0000","last_clean":"2024-03-16T07:31:12.996944+0000","last_became_active":"2024-03-16T07:31:12.995012+0000","last_became_peered":"2024-03-16T07:31:12.995012+0000","last_unstale":"2024-03-16T07:31:12.996944+0000","last_undegraded":"2024-03-16T07:31:12.996944+0000","last_fullsized":"2024-03-16T07:31:12.996944+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_clean_scrub_stamp":"2024-03-16T07:31:11.948725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:08:11.150080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.964760+0000","last_change":"2024-03-16T07:31:11.968628+0000","last_active":"2024-03-16T07:31:12.964760+0000","last_peered":"2024-03-16T07:31:12.964760+0000","last_clean":"2024-03-16T07:31:12.964760+0000","last_became_active":"2024-03-16T07:31:11.968407+0000","last_became_peered":"2024-03-16T07:31:11.968407+0000","last_unstale":"2024-03-16T07:31:12.964760+0000","last_undegraded":"2024-03-16T07:31:12.964760+0000","last_fullsized":"2024-03-16T07:31:12.964760+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:10.945812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:10.945812+0000","last_clean_scrub_stamp":"2024-03-16T07:31:10.945812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:50:40.320000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":18,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.976132+0000","last_change":"2024-03-16T07:30:58.564067+0000","last_active":"2024-03-16T07:31:12.976132+0000","last_peered":"2024-03-16T07:31:12.976132+0000","last_clean":"2024-03-16T07:31:12.976132+0000","last_became_active":"2024-03-16T07:30:58.563838+0000","last_became_peered":"2024-03-16T07:30:58.563838+0000","last_unstale":"2024-03-16T07:31:12.976132+0000","last_undegraded":"2024-03-16T07:31:12.976132+0000","last_fullsized":"2024-03-16T07:31:12.976132+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:28:57.210229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":20,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.957377+0000","last_change":"2024-03-16T07:30:57.883190+0000","last_active":"2024-03-16T07:31:12.957377+0000","last_peered":"2024-03-16T07:31:12.957377+0000","last_clean":"2024-03-16T07:31:12.957377+0000","last_became_active":"2024-03-16T07:30:57.882925+0000","last_became_peered":"2024-03-16T07:30:57.882925+0000","last_unstale":"2024-03-16T07:31:12.957377+0000","last_undegraded":"2024-03-16T07:31:12.957377+0000","last_fullsized":"2024-03-16T07:31:12.957377+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_clean_scrub_stamp":"2024-03-16T07:30:56.855668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:06:50.998240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.982008+0000","last_change":"2024-03-16T07:31:12.975328+0000","last_active":"2024-03-16T07:31:12.982008+0000","last_peered":"2024-03-16T07:31:12.982008+0000","last_clean":"2024-03-16T07:31:12.982008+0000","last_became_active":"2024-03-16T07:31:12.974942+0000","last_became_peered":"2024-03-16T07:31:12.974942+0000","last_unstale":"2024-03-16T07:31:12.982008+0000","last_undegraded":"2024-03-16T07:31:12.982008+0000","last_fullsized":"2024-03-16T07:31:12.982008+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_clean_scrub_stamp":"2024-03-16T07:31:11.948725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:19:18.169851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.965362+0000","last_change":"2024-03-16T07:31:11.975936+0000","last_active":"2024-03-16T07:31:12.965362+0000","last_peered":"2024-03-16T07:31:12.965362+0000","last_clean":"2024-03-16T07:31:12.965362+0000","last_became_active":"2024-03-16T07:31:11.975509+0000","last_became_peered":"2024-03-16T07:31:11.975509+0000","last_unstale":"2024-03-16T07:31:12.965362+0000","last_undegraded":"2024-03-16T07:31:12.965362+0000","last_fullsized":"2024-03-16T07:31:12.965362+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:10.945812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:10.945812+0000","last_clean_scrub_stamp":"2024-03-16T07:31:10.945812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:13:49.110660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":18,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.971312+0000","last_change":"2024-03-16T07:30:58.561416+0000","last_active":"2024-03-16T07:31:12.971312+0000","last_peered":"2024-03-16T07:31:12.971312+0000","last_clean":"2024-03-16T07:31:12.971312+0000","last_became_active":"2024-03-16T07:30:58.561163+0000","last_became_peered":"2024-03-16T07:30:58.561163+0000","last_unstale":"2024-03-16T07:31:12.971312+0000","last_undegraded":"2024-03-16T07:31:12.971312+0000","last_fullsized":"2024-03-16T07:31:12.971312+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:45:50.755510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.15","version":"118'3","reported_seq":23,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.979351+0000","last_change":"2024-03-16T07:30:57.875401+0000","last_active":"2024-03-16T07:31:12.979351+0000","last_peered":"2024-03-16T07:31:12.979351+0000","last_clean":"2024-03-16T07:31:12.979351+0000","last_became_active":"2024-03-16T07:30:57.875032+0000","last_became_peered":"2024-03-16T07:30:57.875032+0000","last_unstale":"2024-03-16T07:31:12.979351+0000","last_undegraded":"2024-03-16T07:31:12.979351+0000","last_fullsized":"2024-03-16T07:31:12.979351+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_clean_scrub_stamp":"2024-03-16T07:30:56.855668+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:39:09.736811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"103'174","reported_seq":620,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.971518+0000","last_change":"2024-03-16T07:24:31.650537+0000","last_active":"2024-03-16T07:31:12.971518+0000","last_peered":"2024-03-16T07:31:12.971518+0000","last_clean":"2024-03-16T07:31:12.971518+0000","last_became_active":"2024-03-16T07:24:31.649574+0000","last_became_peered":"2024-03-16T07:24:31.649574+0000","last_unstale":"2024-03-16T07:31:12.971518+0000","last_undegraded":"2024-03-16T07:31:12.971518+0000","last_fullsized":"2024-03-16T07:31:12.971518+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:29.719970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:29.719970+0000","last_clean_scrub_stamp":"2024-03-16T07:24:29.719970+0000","objects_scrubbed":0,"log_size":174,"log_dups_size":0,"ondisk_log_size":174,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:31:35.774554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":778,"num_read_kb":1533,"num_write":277,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":23,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":22,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":3},{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":20,"num_pg":32,"stat_sum":{"num_bytes":4107,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":8214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":778,"num_read_kb":1533,"num_write":277,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":174,"ondisk_log_size":174,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738447,"num_pgs":132,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":36600,"kb_used_data":1260,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":104821000,"statfs":{"total":107374182400,"available":107336704000,"internally_reserved":0,"allocated":1290240,"data_stored":510670,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738447,"num_pgs":63,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":37176,"kb_used_data":1836,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":104820424,"statfs":{"total":107374182400,"available":107336114176,"internally_reserved":0,"allocated":1880064,"data_stored":1097341,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738447,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":37168,"kb_used_data":1828,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":104820432,"statfs":{"total":107374182400,"available":107336122368,"internally_reserved":0,"allocated":1871872,"data_stored":1098866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":3455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":3983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-16T07:31:17.027 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-16T07:31:17.432 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:31:17.435 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2024-03-16T07:31:17.441 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":45,"stamp":"2024-03-16T07:31:16.891189+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596885,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":778,"num_read_kb":1533,"num_write":368,"num_write_kb":1925,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":253,"ondisk_log_size":253,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":263,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":314572800,"kb_used":110944,"kb_used_data":4924,"kb_used_omap":4,"kb_used_meta":105979,"kb_avail":314461856,"statfs":{"total":322122547200,"available":322008940544,"internally_reserved":0,"allocated":5042176,"data_stored":2706877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":108522831},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.942080"},"pg_stats":[{"pgid":"23.3d","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.974883+0000","last_change":"2024-03-16T07:31:12.974114+0000","last_active":"2024-03-16T07:31:12.974883+0000","last_peered":"2024-03-16T07:31:12.974883+0000","last_clean":"2024-03-16T07:31:12.974883+0000","last_became_active":"2024-03-16T07:31:12.973858+0000","last_became_peered":"2024-03-16T07:31:12.973858+0000","last_unstale":"2024-03-16T07:31:12.974883+0000","last_undegraded":"2024-03-16T07:31:12.974883+0000","last_fullsized":"2024-03-16T07:31:12.974883+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_clean_scrub_stamp":"2024-03-16T07:31:11.948725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:43:24.254501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.3f","version":"0'0","reported_seq":18,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.966398+0000","last_change":"2024-03-16T07:30:58.571155+0000","last_active":"2024-03-16T07:31:12.966398+0000","last_peered":"2024-03-16T07:31:12.966398+0000","last_clean":"2024-03-16T07:31:12.966398+0000","last_became_active":"2024-03-16T07:30:58.570907+0000","last_became_peered":"2024-03-16T07:30:58.570907+0000","last_unstale":"2024-03-16T07:31:12.966398+0000","last_undegraded":"2024-03-16T07:31:12.966398+0000","last_fullsized":"2024-03-16T07:31:12.966398+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:11:25.928386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.3c","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.985644+0000","last_change":"2024-03-16T07:31:12.983820+0000","last_active":"2024-03-16T07:31:12.985644+0000","last_peered":"2024-03-16T07:31:12.985644+0000","last_clean":"2024-03-16T07:31:12.985644+0000","last_became_active":"2024-03-16T07:31:12.983412+0000","last_became_peered":"2024-03-16T07:31:12.983412+0000","last_unstale":"2024-03-16T07:31:12.985644+0000","last_undegraded":"2024-03-16T07:31:12.985644+0000","last_fullsized":"2024-03-16T07:31:12.985644+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_clean_scrub_stamp":"2024-03-16T07:31:11.948725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:19:51.126301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":18,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.976460+0000","last_change":"2024-03-16T07:30:58.567565+0000","last_active":"2024-03-16T07:31:12.976460+0000","last_peered":"2024-03-16T07:31:12.976460+0000","last_clean":"2024-03-16T07:31:12.976460+0000","last_became_active":"2024-03-16T07:30:58.567322+0000","last_became_peered":"2024-03-16T07:30:58.567322+0000","last_unstale":"2024-03-16T07:31:12.976460+0000","last_undegraded":"2024-03-16T07:31:12.976460+0000","last_fullsized":"2024-03-16T07:31:12.976460+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:16:13.408270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.3f","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.995196+0000","last_change":"2024-03-16T07:31:12.994069+0000","last_active":"2024-03-16T07:31:12.995196+0000","last_peered":"2024-03-16T07:31:12.995196+0000","last_clean":"2024-03-16T07:31:12.995196+0000","last_became_active":"2024-03-16T07:31:12.991563+0000","last_became_peered":"2024-03-16T07:31:12.991563+0000","last_unstale":"2024-03-16T07:31:12.995196+0000","last_undegraded":"2024-03-16T07:31:12.995196+0000","last_fullsized":"2024-03-16T07:31:12.995196+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_clean_scrub_stamp":"2024-03-16T07:31:11.948725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:39:03.325870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":18,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.970363+0000","last_change":"2024-03-16T07:30:58.563537+0000","last_active":"2024-03-16T07:31:12.970363+0000","last_peered":"2024-03-16T07:31:12.970363+0000","last_clean":"2024-03-16T07:31:12.970363+0000","last_became_active":"2024-03-16T07:30:58.562673+0000","last_became_peered":"2024-03-16T07:30:58.562673+0000","last_unstale":"2024-03-16T07:31:12.970363+0000","last_undegraded":"2024-03-16T07:31:12.970363+0000","last_fullsized":"2024-03-16T07:31:12.970363+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:31:58.669992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.3e","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.993579+0000","last_change":"2024-03-16T07:31:12.989128+0000","last_active":"2024-03-16T07:31:12.993579+0000","last_peered":"2024-03-16T07:31:12.993579+0000","last_clean":"2024-03-16T07:31:12.993579+0000","last_became_active":"2024-03-16T07:31:12.988884+0000","last_became_peered":"2024-03-16T07:31:12.988884+0000","last_unstale":"2024-03-16T07:31:12.993579+0000","last_undegraded":"2024-03-16T07:31:12.993579+0000","last_fullsized":"2024-03-16T07:31:12.993579+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_clean_scrub_stamp":"2024-03-16T07:31:11.948725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:42:44.915624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.3c","version":"0'0","reported_seq":18,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.958753+0000","last_change":"2024-03-16T07:30:58.572946+0000","last_active":"2024-03-16T07:31:12.958753+0000","last_peered":"2024-03-16T07:31:12.958753+0000","last_clean":"2024-03-16T07:31:12.958753+0000","last_became_active":"2024-03-16T07:30:58.572626+0000","last_became_peered":"2024-03-16T07:30:58.572626+0000","last_unstale":"2024-03-16T07:31:12.958753+0000","last_undegraded":"2024-03-16T07:31:12.958753+0000","last_fullsized":"2024-03-16T07:31:12.958753+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:56:18.837266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.39","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.999534+0000","last_change":"2024-03-16T07:31:12.998696+0000","last_active":"2024-03-16T07:31:12.999534+0000","last_peered":"2024-03-16T07:31:12.999534+0000","last_clean":"2024-03-16T07:31:12.999534+0000","last_became_active":"2024-03-16T07:31:12.998160+0000","last_became_peered":"2024-03-16T07:31:12.998160+0000","last_unstale":"2024-03-16T07:31:12.999534+0000","last_undegraded":"2024-03-16T07:31:12.999534+0000","last_fullsized":"2024-03-16T07:31:12.999534+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_clean_scrub_stamp":"2024-03-16T07:31:11.948725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:16:39.873658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.3b","version":"0'0","reported_seq":18,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.967911+0000","last_change":"2024-03-16T07:30:58.571437+0000","last_active":"2024-03-16T07:31:12.967911+0000","last_peered":"2024-03-16T07:31:12.967911+0000","last_clean":"2024-03-16T07:31:12.967911+0000","last_became_active":"2024-03-16T07:30:58.571200+0000","last_became_peered":"2024-03-16T07:30:58.571200+0000","last_unstale":"2024-03-16T07:31:12.967911+0000","last_undegraded":"2024-03-16T07:31:12.967911+0000","last_fullsized":"2024-03-16T07:31:12.967911+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:48:25.008750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.38","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:13.001477+0000","last_change":"2024-03-16T07:31:13.000832+0000","last_active":"2024-03-16T07:31:13.001477+0000","last_peered":"2024-03-16T07:31:13.001477+0000","last_clean":"2024-03-16T07:31:13.001477+0000","last_became_active":"2024-03-16T07:31:13.000513+0000","last_became_peered":"2024-03-16T07:31:13.000513+0000","last_unstale":"2024-03-16T07:31:13.001477+0000","last_undegraded":"2024-03-16T07:31:13.001477+0000","last_fullsized":"2024-03-16T07:31:13.001477+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_clean_scrub_stamp":"2024-03-16T07:31:11.948725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:16:11.889902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.3a","version":"0'0","reported_seq":18,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.964990+0000","last_change":"2024-03-16T07:30:58.570783+0000","last_active":"2024-03-16T07:31:12.964990+0000","last_peered":"2024-03-16T07:31:12.964990+0000","last_clean":"2024-03-16T07:31:12.964990+0000","last_became_active":"2024-03-16T07:30:58.570527+0000","last_became_peered":"2024-03-16T07:30:58.570527+0000","last_unstale":"2024-03-16T07:31:12.964990+0000","last_undegraded":"2024-03-16T07:31:12.964990+0000","last_fullsized":"2024-03-16T07:31:12.964990+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:30:06.769142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.3b","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.995319+0000","last_change":"2024-03-16T07:31:12.992911+0000","last_active":"2024-03-16T07:31:12.995319+0000","last_peered":"2024-03-16T07:31:12.995319+0000","last_clean":"2024-03-16T07:31:12.995319+0000","last_became_active":"2024-03-16T07:31:12.992643+0000","last_became_peered":"2024-03-16T07:31:12.992643+0000","last_unstale":"2024-03-16T07:31:12.995319+0000","last_undegraded":"2024-03-16T07:31:12.995319+0000","last_fullsized":"2024-03-16T07:31:12.995319+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_clean_scrub_stamp":"2024-03-16T07:31:11.948725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:45:25.869947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":18,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.975863+0000","last_change":"2024-03-16T07:30:58.572802+0000","last_active":"2024-03-16T07:31:12.975863+0000","last_peered":"2024-03-16T07:31:12.975863+0000","last_clean":"2024-03-16T07:31:12.975863+0000","last_became_active":"2024-03-16T07:30:58.572430+0000","last_became_peered":"2024-03-16T07:30:58.572430+0000","last_unstale":"2024-03-16T07:31:12.975863+0000","last_undegraded":"2024-03-16T07:31:12.975863+0000","last_fullsized":"2024-03-16T07:31:12.975863+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:38:49.233760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.3a","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.993554+0000","last_change":"2024-03-16T07:31:12.989727+0000","last_active":"2024-03-16T07:31:12.993554+0000","last_peered":"2024-03-16T07:31:12.993554+0000","last_clean":"2024-03-16T07:31:12.993554+0000","last_became_active":"2024-03-16T07:31:12.989457+0000","last_became_peered":"2024-03-16T07:31:12.989457+0000","last_unstale":"2024-03-16T07:31:12.993554+0000","last_undegraded":"2024-03-16T07:31:12.993554+0000","last_fullsized":"2024-03-16T07:31:12.993554+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_clean_scrub_stamp":"2024-03-16T07:31:11.948725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:52:43.476954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":18,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.967898+0000","last_change":"2024-03-16T07:30:58.563881+0000","last_active":"2024-03-16T07:31:12.967898+0000","last_peered":"2024-03-16T07:31:12.967898+0000","last_clean":"2024-03-16T07:31:12.967898+0000","last_became_active":"2024-03-16T07:30:58.563112+0000","last_became_peered":"2024-03-16T07:30:58.563112+0000","last_unstale":"2024-03-16T07:31:12.967898+0000","last_undegraded":"2024-03-16T07:31:12.967898+0000","last_fullsized":"2024-03-16T07:31:12.967898+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:56:38.419618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.35","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.996614+0000","last_change":"2024-03-16T07:31:12.994622+0000","last_active":"2024-03-16T07:31:12.996614+0000","last_peered":"2024-03-16T07:31:12.996614+0000","last_clean":"2024-03-16T07:31:12.996614+0000","last_became_active":"2024-03-16T07:31:12.994175+0000","last_became_peered":"2024-03-16T07:31:12.994175+0000","last_unstale":"2024-03-16T07:31:12.996614+0000","last_undegraded":"2024-03-16T07:31:12.996614+0000","last_fullsized":"2024-03-16T07:31:12.996614+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_clean_scrub_stamp":"2024-03-16T07:31:11.948725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:49:57.933087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":18,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.966743+0000","last_change":"2024-03-16T07:30:58.571043+0000","last_active":"2024-03-16T07:31:12.966743+0000","last_peered":"2024-03-16T07:31:12.966743+0000","last_clean":"2024-03-16T07:31:12.966743+0000","last_became_active":"2024-03-16T07:30:58.570796+0000","last_became_peered":"2024-03-16T07:30:58.570796+0000","last_unstale":"2024-03-16T07:31:12.966743+0000","last_undegraded":"2024-03-16T07:31:12.966743+0000","last_fullsized":"2024-03-16T07:31:12.966743+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:47:26.847551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.34","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.995387+0000","last_change":"2024-03-16T07:31:12.993654+0000","last_active":"2024-03-16T07:31:12.995387+0000","last_peered":"2024-03-16T07:31:12.995387+0000","last_clean":"2024-03-16T07:31:12.995387+0000","last_became_active":"2024-03-16T07:31:12.993422+0000","last_became_peered":"2024-03-16T07:31:12.993422+0000","last_unstale":"2024-03-16T07:31:12.995387+0000","last_undegraded":"2024-03-16T07:31:12.995387+0000","last_fullsized":"2024-03-16T07:31:12.995387+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_clean_scrub_stamp":"2024-03-16T07:31:11.948725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:26:56.581297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":18,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.967717+0000","last_change":"2024-03-16T07:30:58.563510+0000","last_active":"2024-03-16T07:31:12.967717+0000","last_peered":"2024-03-16T07:31:12.967717+0000","last_clean":"2024-03-16T07:31:12.967717+0000","last_became_active":"2024-03-16T07:30:58.563192+0000","last_became_peered":"2024-03-16T07:30:58.563192+0000","last_unstale":"2024-03-16T07:31:12.967717+0000","last_undegraded":"2024-03-16T07:31:12.967717+0000","last_fullsized":"2024-03-16T07:31:12.967717+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:13:45.980861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.37","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.992980+0000","last_change":"2024-03-16T07:31:12.990733+0000","last_active":"2024-03-16T07:31:12.992980+0000","last_peered":"2024-03-16T07:31:12.992980+0000","last_clean":"2024-03-16T07:31:12.992980+0000","last_became_active":"2024-03-16T07:31:12.990523+0000","last_became_peered":"2024-03-16T07:31:12.990523+0000","last_unstale":"2024-03-16T07:31:12.992980+0000","last_undegraded":"2024-03-16T07:31:12.992980+0000","last_fullsized":"2024-03-16T07:31:12.992980+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_clean_scrub_stamp":"2024-03-16T07:31:11.948725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:10:42.822545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":18,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.970512+0000","last_change":"2024-03-16T07:30:58.569050+0000","last_active":"2024-03-16T07:31:12.970512+0000","last_peered":"2024-03-16T07:31:12.970512+0000","last_clean":"2024-03-16T07:31:12.970512+0000","last_became_active":"2024-03-16T07:30:58.568635+0000","last_became_peered":"2024-03-16T07:30:58.568635+0000","last_unstale":"2024-03-16T07:31:12.970512+0000","last_undegraded":"2024-03-16T07:31:12.970512+0000","last_fullsized":"2024-03-16T07:31:12.970512+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:44:15.784720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.36","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:13.000029+0000","last_change":"2024-03-16T07:31:12.999439+0000","last_active":"2024-03-16T07:31:13.000029+0000","last_peered":"2024-03-16T07:31:13.000029+0000","last_clean":"2024-03-16T07:31:13.000029+0000","last_became_active":"2024-03-16T07:31:12.999183+0000","last_became_peered":"2024-03-16T07:31:12.999183+0000","last_unstale":"2024-03-16T07:31:13.000029+0000","last_undegraded":"2024-03-16T07:31:13.000029+0000","last_fullsized":"2024-03-16T07:31:13.000029+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_clean_scrub_stamp":"2024-03-16T07:31:11.948725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:49:30.570492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.34","version":"0'0","reported_seq":18,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.971132+0000","last_change":"2024-03-16T07:30:58.572517+0000","last_active":"2024-03-16T07:31:12.971132+0000","last_peered":"2024-03-16T07:31:12.971132+0000","last_clean":"2024-03-16T07:31:12.971132+0000","last_became_active":"2024-03-16T07:30:58.570337+0000","last_became_peered":"2024-03-16T07:30:58.570337+0000","last_unstale":"2024-03-16T07:31:12.971132+0000","last_undegraded":"2024-03-16T07:31:12.971132+0000","last_fullsized":"2024-03-16T07:31:12.971132+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:07:21.183199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.31","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.998378+0000","last_change":"2024-03-16T07:31:12.997312+0000","last_active":"2024-03-16T07:31:12.998378+0000","last_peered":"2024-03-16T07:31:12.998378+0000","last_clean":"2024-03-16T07:31:12.998378+0000","last_became_active":"2024-03-16T07:31:12.997072+0000","last_became_peered":"2024-03-16T07:31:12.997072+0000","last_unstale":"2024-03-16T07:31:12.998378+0000","last_undegraded":"2024-03-16T07:31:12.998378+0000","last_fullsized":"2024-03-16T07:31:12.998378+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_clean_scrub_stamp":"2024-03-16T07:31:11.948725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:33:03.973047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.33","version":"0'0","reported_seq":18,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.968002+0000","last_change":"2024-03-16T07:30:58.571283+0000","last_active":"2024-03-16T07:31:12.968002+0000","last_peered":"2024-03-16T07:31:12.968002+0000","last_clean":"2024-03-16T07:31:12.968002+0000","last_became_active":"2024-03-16T07:30:58.570972+0000","last_became_peered":"2024-03-16T07:30:58.570972+0000","last_unstale":"2024-03-16T07:31:12.968002+0000","last_undegraded":"2024-03-16T07:31:12.968002+0000","last_fullsized":"2024-03-16T07:31:12.968002+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:12:28.497074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.30","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.993248+0000","last_change":"2024-03-16T07:31:12.989216+0000","last_active":"2024-03-16T07:31:12.993248+0000","last_peered":"2024-03-16T07:31:12.993248+0000","last_clean":"2024-03-16T07:31:12.993248+0000","last_became_active":"2024-03-16T07:31:12.986563+0000","last_became_peered":"2024-03-16T07:31:12.986563+0000","last_unstale":"2024-03-16T07:31:12.993248+0000","last_undegraded":"2024-03-16T07:31:12.993248+0000","last_fullsized":"2024-03-16T07:31:12.993248+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_clean_scrub_stamp":"2024-03-16T07:31:11.948725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:00:33.472987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":18,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.977093+0000","last_change":"2024-03-16T07:30:58.574666+0000","last_active":"2024-03-16T07:31:12.977093+0000","last_peered":"2024-03-16T07:31:12.977093+0000","last_clean":"2024-03-16T07:31:12.977093+0000","last_became_active":"2024-03-16T07:30:58.573873+0000","last_became_peered":"2024-03-16T07:30:58.573873+0000","last_unstale":"2024-03-16T07:31:12.977093+0000","last_undegraded":"2024-03-16T07:31:12.977093+0000","last_fullsized":"2024-03-16T07:31:12.977093+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:27:34.230714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.33","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.992424+0000","last_change":"2024-03-16T07:31:12.987058+0000","last_active":"2024-03-16T07:31:12.992424+0000","last_peered":"2024-03-16T07:31:12.992424+0000","last_clean":"2024-03-16T07:31:12.992424+0000","last_became_active":"2024-03-16T07:31:12.986192+0000","last_became_peered":"2024-03-16T07:31:12.986192+0000","last_unstale":"2024-03-16T07:31:12.992424+0000","last_undegraded":"2024-03-16T07:31:12.992424+0000","last_fullsized":"2024-03-16T07:31:12.992424+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_clean_scrub_stamp":"2024-03-16T07:31:11.948725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:04:19.705306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":18,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.965834+0000","last_change":"2024-03-16T07:30:58.570258+0000","last_active":"2024-03-16T07:31:12.965834+0000","last_peered":"2024-03-16T07:31:12.965834+0000","last_clean":"2024-03-16T07:31:12.965834+0000","last_became_active":"2024-03-16T07:30:58.570020+0000","last_became_peered":"2024-03-16T07:30:58.570020+0000","last_unstale":"2024-03-16T07:31:12.965834+0000","last_undegraded":"2024-03-16T07:31:12.965834+0000","last_fullsized":"2024-03-16T07:31:12.965834+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:23:09.206123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.32","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:13.000883+0000","last_change":"2024-03-16T07:31:13.000134+0000","last_active":"2024-03-16T07:31:13.000883+0000","last_peered":"2024-03-16T07:31:13.000883+0000","last_clean":"2024-03-16T07:31:13.000883+0000","last_became_active":"2024-03-16T07:31:12.999867+0000","last_became_peered":"2024-03-16T07:31:12.999867+0000","last_unstale":"2024-03-16T07:31:13.000883+0000","last_undegraded":"2024-03-16T07:31:13.000883+0000","last_fullsized":"2024-03-16T07:31:13.000883+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_clean_scrub_stamp":"2024-03-16T07:31:11.948725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:09:26.471224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.30","version":"0'0","reported_seq":18,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.956433+0000","last_change":"2024-03-16T07:30:58.574365+0000","last_active":"2024-03-16T07:31:12.956433+0000","last_peered":"2024-03-16T07:31:12.956433+0000","last_clean":"2024-03-16T07:31:12.956433+0000","last_became_active":"2024-03-16T07:30:58.574133+0000","last_became_peered":"2024-03-16T07:30:58.574133+0000","last_unstale":"2024-03-16T07:31:12.956433+0000","last_undegraded":"2024-03-16T07:31:12.956433+0000","last_fullsized":"2024-03-16T07:31:12.956433+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:02:57.834208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2d","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.993580+0000","last_change":"2024-03-16T07:31:12.990058+0000","last_active":"2024-03-16T07:31:12.993580+0000","last_peered":"2024-03-16T07:31:12.993580+0000","last_clean":"2024-03-16T07:31:12.993580+0000","last_became_active":"2024-03-16T07:31:12.989836+0000","last_became_peered":"2024-03-16T07:31:12.989836+0000","last_unstale":"2024-03-16T07:31:12.993580+0000","last_undegraded":"2024-03-16T07:31:12.993580+0000","last_fullsized":"2024-03-16T07:31:12.993580+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_clean_scrub_stamp":"2024-03-16T07:31:11.948725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:25:02.571301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":18,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.960951+0000","last_change":"2024-03-16T07:30:58.576696+0000","last_active":"2024-03-16T07:31:12.960951+0000","last_peered":"2024-03-16T07:31:12.960951+0000","last_clean":"2024-03-16T07:31:12.960951+0000","last_became_active":"2024-03-16T07:30:58.576438+0000","last_became_peered":"2024-03-16T07:30:58.576438+0000","last_unstale":"2024-03-16T07:31:12.960951+0000","last_undegraded":"2024-03-16T07:31:12.960951+0000","last_fullsized":"2024-03-16T07:31:12.960951+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:56:32.600260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2c","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.982017+0000","last_change":"2024-03-16T07:31:12.975228+0000","last_active":"2024-03-16T07:31:12.982017+0000","last_peered":"2024-03-16T07:31:12.982017+0000","last_clean":"2024-03-16T07:31:12.982017+0000","last_became_active":"2024-03-16T07:31:12.974979+0000","last_became_peered":"2024-03-16T07:31:12.974979+0000","last_unstale":"2024-03-16T07:31:12.982017+0000","last_undegraded":"2024-03-16T07:31:12.982017+0000","last_fullsized":"2024-03-16T07:31:12.982017+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_clean_scrub_stamp":"2024-03-16T07:31:11.948725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:51:48.794653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":18,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.967845+0000","last_change":"2024-03-16T07:30:58.572031+0000","last_active":"2024-03-16T07:31:12.967845+0000","last_peered":"2024-03-16T07:31:12.967845+0000","last_clean":"2024-03-16T07:31:12.967845+0000","last_became_active":"2024-03-16T07:30:58.571663+0000","last_became_peered":"2024-03-16T07:30:58.571663+0000","last_unstale":"2024-03-16T07:31:12.967845+0000","last_undegraded":"2024-03-16T07:31:12.967845+0000","last_fullsized":"2024-03-16T07:31:12.967845+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:13:31.805609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.2f","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.995213+0000","last_change":"2024-03-16T07:31:12.994254+0000","last_active":"2024-03-16T07:31:12.995213+0000","last_peered":"2024-03-16T07:31:12.995213+0000","last_clean":"2024-03-16T07:31:12.995213+0000","last_became_active":"2024-03-16T07:31:12.991910+0000","last_became_peered":"2024-03-16T07:31:12.991910+0000","last_unstale":"2024-03-16T07:31:12.995213+0000","last_undegraded":"2024-03-16T07:31:12.995213+0000","last_fullsized":"2024-03-16T07:31:12.995213+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_clean_scrub_stamp":"2024-03-16T07:31:11.948725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:00:55.107031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2d","version":"0'0","reported_seq":18,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.970735+0000","last_change":"2024-03-16T07:30:58.569822+0000","last_active":"2024-03-16T07:31:12.970735+0000","last_peered":"2024-03-16T07:31:12.970735+0000","last_clean":"2024-03-16T07:31:12.970735+0000","last_became_active":"2024-03-16T07:30:58.569585+0000","last_became_peered":"2024-03-16T07:30:58.569585+0000","last_unstale":"2024-03-16T07:31:12.970735+0000","last_undegraded":"2024-03-16T07:31:12.970735+0000","last_fullsized":"2024-03-16T07:31:12.970735+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:34:34.180780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.2e","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.985617+0000","last_change":"2024-03-16T07:31:12.983659+0000","last_active":"2024-03-16T07:31:12.985617+0000","last_peered":"2024-03-16T07:31:12.985617+0000","last_clean":"2024-03-16T07:31:12.985617+0000","last_became_active":"2024-03-16T07:31:12.983214+0000","last_became_peered":"2024-03-16T07:31:12.983214+0000","last_unstale":"2024-03-16T07:31:12.985617+0000","last_undegraded":"2024-03-16T07:31:12.985617+0000","last_fullsized":"2024-03-16T07:31:12.985617+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_clean_scrub_stamp":"2024-03-16T07:31:11.948725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:18:51.895439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":18,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.958812+0000","last_change":"2024-03-16T07:30:58.573838+0000","last_active":"2024-03-16T07:31:12.958812+0000","last_peered":"2024-03-16T07:31:12.958812+0000","last_clean":"2024-03-16T07:31:12.958812+0000","last_became_active":"2024-03-16T07:30:58.573583+0000","last_became_peered":"2024-03-16T07:30:58.573583+0000","last_unstale":"2024-03-16T07:31:12.958812+0000","last_undegraded":"2024-03-16T07:31:12.958812+0000","last_fullsized":"2024-03-16T07:31:12.958812+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:49:38.279098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.29","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.974736+0000","last_change":"2024-03-16T07:31:12.971999+0000","last_active":"2024-03-16T07:31:12.974736+0000","last_peered":"2024-03-16T07:31:12.974736+0000","last_clean":"2024-03-16T07:31:12.974736+0000","last_became_active":"2024-03-16T07:31:12.971776+0000","last_became_peered":"2024-03-16T07:31:12.971776+0000","last_unstale":"2024-03-16T07:31:12.974736+0000","last_undegraded":"2024-03-16T07:31:12.974736+0000","last_fullsized":"2024-03-16T07:31:12.974736+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_clean_scrub_stamp":"2024-03-16T07:31:11.948725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:06:11.583560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2b","version":"0'0","reported_seq":18,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.958264+0000","last_change":"2024-03-16T07:30:58.576167+0000","last_active":"2024-03-16T07:31:12.958264+0000","last_peered":"2024-03-16T07:31:12.958264+0000","last_clean":"2024-03-16T07:31:12.958264+0000","last_became_active":"2024-03-16T07:30:58.575924+0000","last_became_peered":"2024-03-16T07:30:58.575924+0000","last_unstale":"2024-03-16T07:31:12.958264+0000","last_undegraded":"2024-03-16T07:31:12.958264+0000","last_fullsized":"2024-03-16T07:31:12.958264+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:13:31.805609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.28","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.994475+0000","last_change":"2024-03-16T07:31:12.991339+0000","last_active":"2024-03-16T07:31:12.994475+0000","last_peered":"2024-03-16T07:31:12.994475+0000","last_clean":"2024-03-16T07:31:12.994475+0000","last_became_active":"2024-03-16T07:31:12.990704+0000","last_became_peered":"2024-03-16T07:31:12.990704+0000","last_unstale":"2024-03-16T07:31:12.994475+0000","last_undegraded":"2024-03-16T07:31:12.994475+0000","last_fullsized":"2024-03-16T07:31:12.994475+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_clean_scrub_stamp":"2024-03-16T07:31:11.948725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:46:26.064755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":18,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.977098+0000","last_change":"2024-03-16T07:30:58.574457+0000","last_active":"2024-03-16T07:31:12.977098+0000","last_peered":"2024-03-16T07:31:12.977098+0000","last_clean":"2024-03-16T07:31:12.977098+0000","last_became_active":"2024-03-16T07:30:58.573573+0000","last_became_peered":"2024-03-16T07:30:58.573573+0000","last_unstale":"2024-03-16T07:31:12.977098+0000","last_undegraded":"2024-03-16T07:31:12.977098+0000","last_fullsized":"2024-03-16T07:31:12.977098+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:55:37.004684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.2b","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.975060+0000","last_change":"2024-03-16T07:31:12.974386+0000","last_active":"2024-03-16T07:31:12.975060+0000","last_peered":"2024-03-16T07:31:12.975060+0000","last_clean":"2024-03-16T07:31:12.975060+0000","last_became_active":"2024-03-16T07:31:12.974032+0000","last_became_peered":"2024-03-16T07:31:12.974032+0000","last_unstale":"2024-03-16T07:31:12.975060+0000","last_undegraded":"2024-03-16T07:31:12.975060+0000","last_fullsized":"2024-03-16T07:31:12.975060+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_clean_scrub_stamp":"2024-03-16T07:31:11.948725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:49:57.933087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":18,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.957828+0000","last_change":"2024-03-16T07:30:58.575945+0000","last_active":"2024-03-16T07:31:12.957828+0000","last_peered":"2024-03-16T07:31:12.957828+0000","last_clean":"2024-03-16T07:31:12.957828+0000","last_became_active":"2024-03-16T07:30:58.575414+0000","last_became_peered":"2024-03-16T07:30:58.575414+0000","last_unstale":"2024-03-16T07:31:12.957828+0000","last_undegraded":"2024-03-16T07:31:12.957828+0000","last_fullsized":"2024-03-16T07:31:12.957828+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:11:25.928386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2a","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.995416+0000","last_change":"2024-03-16T07:31:12.993289+0000","last_active":"2024-03-16T07:31:12.995416+0000","last_peered":"2024-03-16T07:31:12.995416+0000","last_clean":"2024-03-16T07:31:12.995416+0000","last_became_active":"2024-03-16T07:31:12.993035+0000","last_became_peered":"2024-03-16T07:31:12.993035+0000","last_unstale":"2024-03-16T07:31:12.995416+0000","last_undegraded":"2024-03-16T07:31:12.995416+0000","last_fullsized":"2024-03-16T07:31:12.995416+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_clean_scrub_stamp":"2024-03-16T07:31:11.948725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:08:22.650549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":18,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.968085+0000","last_change":"2024-03-16T07:30:58.563542+0000","last_active":"2024-03-16T07:31:12.968085+0000","last_peered":"2024-03-16T07:31:12.968085+0000","last_clean":"2024-03-16T07:31:12.968085+0000","last_became_active":"2024-03-16T07:30:58.562883+0000","last_became_peered":"2024-03-16T07:30:58.562883+0000","last_unstale":"2024-03-16T07:31:12.968085+0000","last_undegraded":"2024-03-16T07:31:12.968085+0000","last_fullsized":"2024-03-16T07:31:12.968085+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:50:38.987166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.25","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.996637+0000","last_change":"2024-03-16T07:31:12.994738+0000","last_active":"2024-03-16T07:31:12.996637+0000","last_peered":"2024-03-16T07:31:12.996637+0000","last_clean":"2024-03-16T07:31:12.996637+0000","last_became_active":"2024-03-16T07:31:12.994499+0000","last_became_peered":"2024-03-16T07:31:12.994499+0000","last_unstale":"2024-03-16T07:31:12.996637+0000","last_undegraded":"2024-03-16T07:31:12.996637+0000","last_fullsized":"2024-03-16T07:31:12.996637+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_clean_scrub_stamp":"2024-03-16T07:31:11.948725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:31:46.189694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":18,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.961044+0000","last_change":"2024-03-16T07:30:58.574409+0000","last_active":"2024-03-16T07:31:12.961044+0000","last_peered":"2024-03-16T07:31:12.961044+0000","last_clean":"2024-03-16T07:31:12.961044+0000","last_became_active":"2024-03-16T07:30:58.573829+0000","last_became_peered":"2024-03-16T07:30:58.573829+0000","last_unstale":"2024-03-16T07:31:12.961044+0000","last_undegraded":"2024-03-16T07:31:12.961044+0000","last_fullsized":"2024-03-16T07:31:12.961044+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:50:43.375419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.24","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.983569+0000","last_change":"2024-03-16T07:31:12.982775+0000","last_active":"2024-03-16T07:31:12.983569+0000","last_peered":"2024-03-16T07:31:12.983569+0000","last_clean":"2024-03-16T07:31:12.983569+0000","last_became_active":"2024-03-16T07:31:12.981760+0000","last_became_peered":"2024-03-16T07:31:12.981760+0000","last_unstale":"2024-03-16T07:31:12.983569+0000","last_undegraded":"2024-03-16T07:31:12.983569+0000","last_fullsized":"2024-03-16T07:31:12.983569+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_clean_scrub_stamp":"2024-03-16T07:31:11.948725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:19:56.945658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":18,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.967869+0000","last_change":"2024-03-16T07:30:58.571970+0000","last_active":"2024-03-16T07:31:12.967869+0000","last_peered":"2024-03-16T07:31:12.967869+0000","last_clean":"2024-03-16T07:31:12.967869+0000","last_became_active":"2024-03-16T07:30:58.571516+0000","last_became_peered":"2024-03-16T07:30:58.571516+0000","last_unstale":"2024-03-16T07:31:12.967869+0000","last_undegraded":"2024-03-16T07:31:12.967869+0000","last_fullsized":"2024-03-16T07:31:12.967869+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:56:18.837266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.27","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.981802+0000","last_change":"2024-03-16T07:31:12.981214+0000","last_active":"2024-03-16T07:31:12.981802+0000","last_peered":"2024-03-16T07:31:12.981802+0000","last_clean":"2024-03-16T07:31:12.981802+0000","last_became_active":"2024-03-16T07:31:12.980972+0000","last_became_peered":"2024-03-16T07:31:12.980972+0000","last_unstale":"2024-03-16T07:31:12.981802+0000","last_undegraded":"2024-03-16T07:31:12.981802+0000","last_fullsized":"2024-03-16T07:31:12.981802+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_clean_scrub_stamp":"2024-03-16T07:31:11.948725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:40:38.815142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":18,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.959752+0000","last_change":"2024-03-16T07:30:58.575126+0000","last_active":"2024-03-16T07:31:12.959752+0000","last_peered":"2024-03-16T07:31:12.959752+0000","last_clean":"2024-03-16T07:31:12.959752+0000","last_became_active":"2024-03-16T07:30:58.574934+0000","last_became_peered":"2024-03-16T07:30:58.574934+0000","last_unstale":"2024-03-16T07:31:12.959752+0000","last_undegraded":"2024-03-16T07:31:12.959752+0000","last_fullsized":"2024-03-16T07:31:12.959752+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:49:47.185506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.26","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:13.000014+0000","last_change":"2024-03-16T07:31:12.999377+0000","last_active":"2024-03-16T07:31:13.000014+0000","last_peered":"2024-03-16T07:31:13.000014+0000","last_clean":"2024-03-16T07:31:13.000014+0000","last_became_active":"2024-03-16T07:31:12.999015+0000","last_became_peered":"2024-03-16T07:31:12.999015+0000","last_unstale":"2024-03-16T07:31:13.000014+0000","last_undegraded":"2024-03-16T07:31:13.000014+0000","last_fullsized":"2024-03-16T07:31:13.000014+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_clean_scrub_stamp":"2024-03-16T07:31:11.948725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:50:12.144732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":18,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.971222+0000","last_change":"2024-03-16T07:30:58.572025+0000","last_active":"2024-03-16T07:31:12.971222+0000","last_peered":"2024-03-16T07:31:12.971222+0000","last_clean":"2024-03-16T07:31:12.971222+0000","last_became_active":"2024-03-16T07:30:58.569977+0000","last_became_peered":"2024-03-16T07:30:58.569977+0000","last_unstale":"2024-03-16T07:31:12.971222+0000","last_undegraded":"2024-03-16T07:31:12.971222+0000","last_fullsized":"2024-03-16T07:31:12.971222+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:15:34.064322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.21","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.995165+0000","last_change":"2024-03-16T07:31:12.991786+0000","last_active":"2024-03-16T07:31:12.995165+0000","last_peered":"2024-03-16T07:31:12.995165+0000","last_clean":"2024-03-16T07:31:12.995165+0000","last_became_active":"2024-03-16T07:31:12.991376+0000","last_became_peered":"2024-03-16T07:31:12.991376+0000","last_unstale":"2024-03-16T07:31:12.995165+0000","last_undegraded":"2024-03-16T07:31:12.995165+0000","last_fullsized":"2024-03-16T07:31:12.995165+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_clean_scrub_stamp":"2024-03-16T07:31:11.948725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:57:17.307359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":18,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.968087+0000","last_change":"2024-03-16T07:30:58.560398+0000","last_active":"2024-03-16T07:31:12.968087+0000","last_peered":"2024-03-16T07:31:12.968087+0000","last_clean":"2024-03-16T07:31:12.968087+0000","last_became_active":"2024-03-16T07:30:58.560136+0000","last_became_peered":"2024-03-16T07:30:58.560136+0000","last_unstale":"2024-03-16T07:31:12.968087+0000","last_undegraded":"2024-03-16T07:31:12.968087+0000","last_fullsized":"2024-03-16T07:31:12.968087+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:02:09.725846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.20","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.992397+0000","last_change":"2024-03-16T07:31:12.986924+0000","last_active":"2024-03-16T07:31:12.992397+0000","last_peered":"2024-03-16T07:31:12.992397+0000","last_clean":"2024-03-16T07:31:12.992397+0000","last_became_active":"2024-03-16T07:31:12.985982+0000","last_became_peered":"2024-03-16T07:31:12.985982+0000","last_unstale":"2024-03-16T07:31:12.992397+0000","last_undegraded":"2024-03-16T07:31:12.992397+0000","last_fullsized":"2024-03-16T07:31:12.992397+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_clean_scrub_stamp":"2024-03-16T07:31:11.948725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:05:49.894740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":18,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.977192+0000","last_change":"2024-03-16T07:30:58.564792+0000","last_active":"2024-03-16T07:31:12.977192+0000","last_peered":"2024-03-16T07:31:12.977192+0000","last_clean":"2024-03-16T07:31:12.977192+0000","last_became_active":"2024-03-16T07:30:58.564542+0000","last_became_peered":"2024-03-16T07:30:58.564542+0000","last_unstale":"2024-03-16T07:31:12.977192+0000","last_undegraded":"2024-03-16T07:31:12.977192+0000","last_fullsized":"2024-03-16T07:31:12.977192+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:10:51.120695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.23","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.975079+0000","last_change":"2024-03-16T07:31:12.974481+0000","last_active":"2024-03-16T07:31:12.975079+0000","last_peered":"2024-03-16T07:31:12.975079+0000","last_clean":"2024-03-16T07:31:12.975079+0000","last_became_active":"2024-03-16T07:31:12.973715+0000","last_became_peered":"2024-03-16T07:31:12.973715+0000","last_unstale":"2024-03-16T07:31:12.975079+0000","last_undegraded":"2024-03-16T07:31:12.975079+0000","last_fullsized":"2024-03-16T07:31:12.975079+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_clean_scrub_stamp":"2024-03-16T07:31:11.948725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:31:46.189694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":18,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.975955+0000","last_change":"2024-03-16T07:30:58.562033+0000","last_active":"2024-03-16T07:31:12.975955+0000","last_peered":"2024-03-16T07:31:12.975955+0000","last_clean":"2024-03-16T07:31:12.975955+0000","last_became_active":"2024-03-16T07:30:58.561807+0000","last_became_peered":"2024-03-16T07:30:58.561807+0000","last_unstale":"2024-03-16T07:31:12.975955+0000","last_undegraded":"2024-03-16T07:31:12.975955+0000","last_fullsized":"2024-03-16T07:31:12.975955+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:00:41.014921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.22","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.998737+0000","last_change":"2024-03-16T07:31:12.997221+0000","last_active":"2024-03-16T07:31:12.998737+0000","last_peered":"2024-03-16T07:31:12.998737+0000","last_clean":"2024-03-16T07:31:12.998737+0000","last_became_active":"2024-03-16T07:31:12.996879+0000","last_became_peered":"2024-03-16T07:31:12.996879+0000","last_unstale":"2024-03-16T07:31:12.998737+0000","last_undegraded":"2024-03-16T07:31:12.998737+0000","last_fullsized":"2024-03-16T07:31:12.998737+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_clean_scrub_stamp":"2024-03-16T07:31:11.948725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:14:33.562759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":18,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.956642+0000","last_change":"2024-03-16T07:30:58.575428+0000","last_active":"2024-03-16T07:31:12.956642+0000","last_peered":"2024-03-16T07:31:12.956642+0000","last_clean":"2024-03-16T07:31:12.956642+0000","last_became_active":"2024-03-16T07:30:58.575207+0000","last_became_peered":"2024-03-16T07:30:58.575207+0000","last_unstale":"2024-03-16T07:31:12.956642+0000","last_undegraded":"2024-03-16T07:31:12.956642+0000","last_fullsized":"2024-03-16T07:31:12.956642+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:13:01.831834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.983353+0000","last_change":"2024-03-16T07:31:12.982312+0000","last_active":"2024-03-16T07:31:12.983353+0000","last_peered":"2024-03-16T07:31:12.983353+0000","last_clean":"2024-03-16T07:31:12.983353+0000","last_became_active":"2024-03-16T07:31:12.982024+0000","last_became_peered":"2024-03-16T07:31:12.982024+0000","last_unstale":"2024-03-16T07:31:12.983353+0000","last_undegraded":"2024-03-16T07:31:12.983353+0000","last_fullsized":"2024-03-16T07:31:12.983353+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_clean_scrub_stamp":"2024-03-16T07:31:11.948725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:01:56.334680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.1d","version":"122'2","reported_seq":14,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.985202+0000","last_change":"2024-03-16T07:31:11.970374+0000","last_active":"2024-03-16T07:31:12.985202+0000","last_peered":"2024-03-16T07:31:12.985202+0000","last_clean":"2024-03-16T07:31:12.985202+0000","last_became_active":"2024-03-16T07:31:11.968081+0000","last_became_peered":"2024-03-16T07:31:11.968081+0000","last_unstale":"2024-03-16T07:31:12.985202+0000","last_undegraded":"2024-03-16T07:31:12.985202+0000","last_fullsized":"2024-03-16T07:31:12.985202+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:10.945812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:10.945812+0000","last_clean_scrub_stamp":"2024-03-16T07:31:10.945812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:08:50.570734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":18,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.967939+0000","last_change":"2024-03-16T07:30:58.571761+0000","last_active":"2024-03-16T07:31:12.967939+0000","last_peered":"2024-03-16T07:31:12.967939+0000","last_clean":"2024-03-16T07:31:12.967939+0000","last_became_active":"2024-03-16T07:30:58.570852+0000","last_became_peered":"2024-03-16T07:30:58.570852+0000","last_unstale":"2024-03-16T07:31:12.967939+0000","last_undegraded":"2024-03-16T07:31:12.967939+0000","last_fullsized":"2024-03-16T07:31:12.967939+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:16:51.341129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1f","version":"118'4","reported_seq":24,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.967705+0000","last_change":"2024-03-16T07:30:57.875122+0000","last_active":"2024-03-16T07:31:12.967705+0000","last_peered":"2024-03-16T07:31:12.967705+0000","last_clean":"2024-03-16T07:31:12.967705+0000","last_became_active":"2024-03-16T07:30:57.874848+0000","last_became_peered":"2024-03-16T07:30:57.874848+0000","last_unstale":"2024-03-16T07:31:12.967705+0000","last_undegraded":"2024-03-16T07:31:12.967705+0000","last_fullsized":"2024-03-16T07:31:12.967705+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_clean_scrub_stamp":"2024-03-16T07:30:56.855668+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:27:04.801331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1d","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.993111+0000","last_change":"2024-03-16T07:31:12.988617+0000","last_active":"2024-03-16T07:31:12.993111+0000","last_peered":"2024-03-16T07:31:12.993111+0000","last_clean":"2024-03-16T07:31:12.993111+0000","last_became_active":"2024-03-16T07:31:12.988116+0000","last_became_peered":"2024-03-16T07:31:12.988116+0000","last_unstale":"2024-03-16T07:31:12.993111+0000","last_undegraded":"2024-03-16T07:31:12.993111+0000","last_fullsized":"2024-03-16T07:31:12.993111+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_clean_scrub_stamp":"2024-03-16T07:31:11.948725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:17:40.639439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1c","version":"122'2","reported_seq":14,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.996312+0000","last_change":"2024-03-16T07:31:11.978939+0000","last_active":"2024-03-16T07:31:12.996312+0000","last_peered":"2024-03-16T07:31:12.996312+0000","last_clean":"2024-03-16T07:31:12.996312+0000","last_became_active":"2024-03-16T07:31:11.978698+0000","last_became_peered":"2024-03-16T07:31:11.978698+0000","last_unstale":"2024-03-16T07:31:12.996312+0000","last_undegraded":"2024-03-16T07:31:12.996312+0000","last_fullsized":"2024-03-16T07:31:12.996312+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:10.945812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:10.945812+0000","last_clean_scrub_stamp":"2024-03-16T07:31:10.945812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:59:58.804177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":18,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.961141+0000","last_change":"2024-03-16T07:30:58.576923+0000","last_active":"2024-03-16T07:31:12.961141+0000","last_peered":"2024-03-16T07:31:12.961141+0000","last_clean":"2024-03-16T07:31:12.961141+0000","last_became_active":"2024-03-16T07:30:58.576662+0000","last_became_peered":"2024-03-16T07:30:58.576662+0000","last_unstale":"2024-03-16T07:31:12.961141+0000","last_undegraded":"2024-03-16T07:31:12.961141+0000","last_fullsized":"2024-03-16T07:31:12.961141+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:12:28.567985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1e","version":"118'1","reported_seq":21,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.976546+0000","last_change":"2024-03-16T07:30:57.876067+0000","last_active":"2024-03-16T07:31:12.976546+0000","last_peered":"2024-03-16T07:31:12.976546+0000","last_clean":"2024-03-16T07:31:12.976546+0000","last_became_active":"2024-03-16T07:30:57.875777+0000","last_became_peered":"2024-03-16T07:30:57.875777+0000","last_unstale":"2024-03-16T07:31:12.976546+0000","last_undegraded":"2024-03-16T07:31:12.976546+0000","last_fullsized":"2024-03-16T07:31:12.976546+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_clean_scrub_stamp":"2024-03-16T07:30:56.855668+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:09:20.828638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.1e","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.999509+0000","last_change":"2024-03-16T07:31:12.998718+0000","last_active":"2024-03-16T07:31:12.999509+0000","last_peered":"2024-03-16T07:31:12.999509+0000","last_clean":"2024-03-16T07:31:12.999509+0000","last_became_active":"2024-03-16T07:31:12.998180+0000","last_became_peered":"2024-03-16T07:31:12.998180+0000","last_unstale":"2024-03-16T07:31:12.999509+0000","last_undegraded":"2024-03-16T07:31:12.999509+0000","last_fullsized":"2024-03-16T07:31:12.999509+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_clean_scrub_stamp":"2024-03-16T07:31:11.948725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:15:28.738686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1f","version":"122'4","reported_seq":16,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.995964+0000","last_change":"2024-03-16T07:31:11.971406+0000","last_active":"2024-03-16T07:31:12.995964+0000","last_peered":"2024-03-16T07:31:12.995964+0000","last_clean":"2024-03-16T07:31:12.995964+0000","last_became_active":"2024-03-16T07:31:11.971177+0000","last_became_peered":"2024-03-16T07:31:11.971177+0000","last_unstale":"2024-03-16T07:31:12.995964+0000","last_undegraded":"2024-03-16T07:31:12.995964+0000","last_fullsized":"2024-03-16T07:31:12.995964+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:10.945812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:10.945812+0000","last_clean_scrub_stamp":"2024-03-16T07:31:10.945812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:09:34.918782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":18,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.973909+0000","last_change":"2024-03-16T07:30:58.562404+0000","last_active":"2024-03-16T07:31:12.973909+0000","last_peered":"2024-03-16T07:31:12.973909+0000","last_clean":"2024-03-16T07:31:12.973909+0000","last_became_active":"2024-03-16T07:30:58.561934+0000","last_became_peered":"2024-03-16T07:30:58.561934+0000","last_unstale":"2024-03-16T07:31:12.973909+0000","last_undegraded":"2024-03-16T07:31:12.973909+0000","last_fullsized":"2024-03-16T07:31:12.973909+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:37:16.741567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1d","version":"118'2","reported_seq":22,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.960285+0000","last_change":"2024-03-16T07:30:57.880613+0000","last_active":"2024-03-16T07:31:12.960285+0000","last_peered":"2024-03-16T07:31:12.960285+0000","last_clean":"2024-03-16T07:31:12.960285+0000","last_became_active":"2024-03-16T07:30:57.880338+0000","last_became_peered":"2024-03-16T07:30:57.880338+0000","last_unstale":"2024-03-16T07:31:12.960285+0000","last_undegraded":"2024-03-16T07:31:12.960285+0000","last_fullsized":"2024-03-16T07:31:12.960285+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_clean_scrub_stamp":"2024-03-16T07:30:56.855668+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:44:41.572764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1f","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.995164+0000","last_change":"2024-03-16T07:31:12.991632+0000","last_active":"2024-03-16T07:31:12.995164+0000","last_peered":"2024-03-16T07:31:12.995164+0000","last_clean":"2024-03-16T07:31:12.995164+0000","last_became_active":"2024-03-16T07:31:12.989908+0000","last_became_peered":"2024-03-16T07:31:12.989908+0000","last_unstale":"2024-03-16T07:31:12.995164+0000","last_undegraded":"2024-03-16T07:31:12.995164+0000","last_fullsized":"2024-03-16T07:31:12.995164+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_clean_scrub_stamp":"2024-03-16T07:31:11.948725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:51:28.240614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.1e","version":"122'1","reported_seq":13,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.998618+0000","last_change":"2024-03-16T07:31:11.976370+0000","last_active":"2024-03-16T07:31:12.998618+0000","last_peered":"2024-03-16T07:31:12.998618+0000","last_clean":"2024-03-16T07:31:12.998618+0000","last_became_active":"2024-03-16T07:31:11.976137+0000","last_became_peered":"2024-03-16T07:31:11.976137+0000","last_unstale":"2024-03-16T07:31:12.998618+0000","last_undegraded":"2024-03-16T07:31:12.998618+0000","last_fullsized":"2024-03-16T07:31:12.998618+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:10.945812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:10.945812+0000","last_clean_scrub_stamp":"2024-03-16T07:31:10.945812+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:16:05.588947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":18,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.959836+0000","last_change":"2024-03-16T07:30:58.575257+0000","last_active":"2024-03-16T07:31:12.959836+0000","last_peered":"2024-03-16T07:31:12.959836+0000","last_clean":"2024-03-16T07:31:12.959836+0000","last_became_active":"2024-03-16T07:30:58.575059+0000","last_became_peered":"2024-03-16T07:30:58.575059+0000","last_unstale":"2024-03-16T07:31:12.959836+0000","last_undegraded":"2024-03-16T07:31:12.959836+0000","last_fullsized":"2024-03-16T07:31:12.959836+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:30:52.037257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1c","version":"118'2","reported_seq":22,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.958962+0000","last_change":"2024-03-16T07:30:57.883046+0000","last_active":"2024-03-16T07:31:12.958962+0000","last_peered":"2024-03-16T07:31:12.958962+0000","last_clean":"2024-03-16T07:31:12.958962+0000","last_became_active":"2024-03-16T07:30:57.882833+0000","last_became_peered":"2024-03-16T07:30:57.882833+0000","last_unstale":"2024-03-16T07:31:12.958962+0000","last_undegraded":"2024-03-16T07:31:12.958962+0000","last_fullsized":"2024-03-16T07:31:12.958962+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_clean_scrub_stamp":"2024-03-16T07:30:56.855668+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:32:36.972246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.981897+0000","last_change":"2024-03-16T07:31:12.981294+0000","last_active":"2024-03-16T07:31:12.981897+0000","last_peered":"2024-03-16T07:31:12.981897+0000","last_clean":"2024-03-16T07:31:12.981897+0000","last_became_active":"2024-03-16T07:31:12.980948+0000","last_became_peered":"2024-03-16T07:31:12.980948+0000","last_unstale":"2024-03-16T07:31:12.981897+0000","last_undegraded":"2024-03-16T07:31:12.981897+0000","last_fullsized":"2024-03-16T07:31:12.981897+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_clean_scrub_stamp":"2024-03-16T07:31:11.948725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:42:05.791445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.958020+0000","last_change":"2024-03-16T07:31:11.972102+0000","last_active":"2024-03-16T07:31:12.958020+0000","last_peered":"2024-03-16T07:31:12.958020+0000","last_clean":"2024-03-16T07:31:12.958020+0000","last_became_active":"2024-03-16T07:31:11.971861+0000","last_became_peered":"2024-03-16T07:31:11.971861+0000","last_unstale":"2024-03-16T07:31:12.958020+0000","last_undegraded":"2024-03-16T07:31:12.958020+0000","last_fullsized":"2024-03-16T07:31:12.958020+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:10.945812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:10.945812+0000","last_clean_scrub_stamp":"2024-03-16T07:31:10.945812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:40:37.812229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":18,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.977196+0000","last_change":"2024-03-16T07:30:58.574103+0000","last_active":"2024-03-16T07:31:12.977196+0000","last_peered":"2024-03-16T07:31:12.977196+0000","last_clean":"2024-03-16T07:31:12.977196+0000","last_became_active":"2024-03-16T07:30:58.573253+0000","last_became_peered":"2024-03-16T07:30:58.573253+0000","last_unstale":"2024-03-16T07:31:12.977196+0000","last_undegraded":"2024-03-16T07:31:12.977196+0000","last_fullsized":"2024-03-16T07:31:12.977196+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:52:44.766166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.1b","version":"118'1","reported_seq":21,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.959142+0000","last_change":"2024-03-16T07:30:57.877500+0000","last_active":"2024-03-16T07:31:12.959142+0000","last_peered":"2024-03-16T07:31:12.959142+0000","last_clean":"2024-03-16T07:31:12.959142+0000","last_became_active":"2024-03-16T07:30:57.877227+0000","last_became_peered":"2024-03-16T07:30:57.877227+0000","last_unstale":"2024-03-16T07:31:12.959142+0000","last_undegraded":"2024-03-16T07:31:12.959142+0000","last_fullsized":"2024-03-16T07:31:12.959142+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_clean_scrub_stamp":"2024-03-16T07:30:56.855668+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:58:06.999355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.993759+0000","last_change":"2024-03-16T07:31:12.991114+0000","last_active":"2024-03-16T07:31:12.993759+0000","last_peered":"2024-03-16T07:31:12.993759+0000","last_clean":"2024-03-16T07:31:12.993759+0000","last_became_active":"2024-03-16T07:31:12.990721+0000","last_became_peered":"2024-03-16T07:31:12.990721+0000","last_unstale":"2024-03-16T07:31:12.993759+0000","last_undegraded":"2024-03-16T07:31:12.993759+0000","last_fullsized":"2024-03-16T07:31:12.993759+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_clean_scrub_stamp":"2024-03-16T07:31:11.948725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:15:30.216474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.968779+0000","last_change":"2024-03-16T07:31:11.978743+0000","last_active":"2024-03-16T07:31:12.968779+0000","last_peered":"2024-03-16T07:31:12.968779+0000","last_clean":"2024-03-16T07:31:12.968779+0000","last_became_active":"2024-03-16T07:31:11.978435+0000","last_became_peered":"2024-03-16T07:31:11.978435+0000","last_unstale":"2024-03-16T07:31:12.968779+0000","last_undegraded":"2024-03-16T07:31:12.968779+0000","last_fullsized":"2024-03-16T07:31:12.968779+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:10.945812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:10.945812+0000","last_clean_scrub_stamp":"2024-03-16T07:31:10.945812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:39:56.572018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":18,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.958380+0000","last_change":"2024-03-16T07:30:58.572972+0000","last_active":"2024-03-16T07:31:12.958380+0000","last_peered":"2024-03-16T07:31:12.958380+0000","last_clean":"2024-03-16T07:31:12.958380+0000","last_became_active":"2024-03-16T07:30:58.572740+0000","last_became_peered":"2024-03-16T07:30:58.572740+0000","last_unstale":"2024-03-16T07:31:12.958380+0000","last_undegraded":"2024-03-16T07:31:12.958380+0000","last_fullsized":"2024-03-16T07:31:12.958380+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:13:45.980861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1a","version":"118'1","reported_seq":21,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.965199+0000","last_change":"2024-03-16T07:30:57.877180+0000","last_active":"2024-03-16T07:31:12.965199+0000","last_peered":"2024-03-16T07:31:12.965199+0000","last_clean":"2024-03-16T07:31:12.965199+0000","last_became_active":"2024-03-16T07:30:57.874453+0000","last_became_peered":"2024-03-16T07:30:57.874453+0000","last_unstale":"2024-03-16T07:31:12.965199+0000","last_undegraded":"2024-03-16T07:31:12.965199+0000","last_fullsized":"2024-03-16T07:31:12.965199+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_clean_scrub_stamp":"2024-03-16T07:30:56.855668+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:08:51.971603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.988729+0000","last_change":"2024-03-16T07:31:12.984402+0000","last_active":"2024-03-16T07:31:12.988729+0000","last_peered":"2024-03-16T07:31:12.988729+0000","last_clean":"2024-03-16T07:31:12.988729+0000","last_became_active":"2024-03-16T07:31:12.984163+0000","last_became_peered":"2024-03-16T07:31:12.984163+0000","last_unstale":"2024-03-16T07:31:12.988729+0000","last_undegraded":"2024-03-16T07:31:12.988729+0000","last_fullsized":"2024-03-16T07:31:12.988729+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_clean_scrub_stamp":"2024-03-16T07:31:11.948725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:27:56.378721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1b","version":"122'1","reported_seq":13,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.991986+0000","last_change":"2024-03-16T07:31:11.975998+0000","last_active":"2024-03-16T07:31:12.991986+0000","last_peered":"2024-03-16T07:31:12.991986+0000","last_clean":"2024-03-16T07:31:12.991986+0000","last_became_active":"2024-03-16T07:31:11.974618+0000","last_became_peered":"2024-03-16T07:31:11.974618+0000","last_unstale":"2024-03-16T07:31:12.991986+0000","last_undegraded":"2024-03-16T07:31:12.991986+0000","last_fullsized":"2024-03-16T07:31:12.991986+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:10.945812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:10.945812+0000","last_clean_scrub_stamp":"2024-03-16T07:31:10.945812+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:59:58.804177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":18,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.971358+0000","last_change":"2024-03-16T07:30:58.563319+0000","last_active":"2024-03-16T07:31:12.971358+0000","last_peered":"2024-03-16T07:31:12.971358+0000","last_clean":"2024-03-16T07:31:12.971358+0000","last_became_active":"2024-03-16T07:30:58.560355+0000","last_became_peered":"2024-03-16T07:30:58.560355+0000","last_unstale":"2024-03-16T07:31:12.971358+0000","last_undegraded":"2024-03-16T07:31:12.971358+0000","last_fullsized":"2024-03-16T07:31:12.971358+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:46:53.824339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":20,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.958364+0000","last_change":"2024-03-16T07:30:57.880819+0000","last_active":"2024-03-16T07:31:12.958364+0000","last_peered":"2024-03-16T07:31:12.958364+0000","last_clean":"2024-03-16T07:31:12.958364+0000","last_became_active":"2024-03-16T07:30:57.879895+0000","last_became_peered":"2024-03-16T07:30:57.879895+0000","last_unstale":"2024-03-16T07:31:12.958364+0000","last_undegraded":"2024-03-16T07:31:12.958364+0000","last_fullsized":"2024-03-16T07:31:12.958364+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_clean_scrub_stamp":"2024-03-16T07:30:56.855668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:05:21.871385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.995339+0000","last_change":"2024-03-16T07:31:12.993127+0000","last_active":"2024-03-16T07:31:12.995339+0000","last_peered":"2024-03-16T07:31:12.995339+0000","last_clean":"2024-03-16T07:31:12.995339+0000","last_became_active":"2024-03-16T07:31:12.992674+0000","last_became_peered":"2024-03-16T07:31:12.992674+0000","last_unstale":"2024-03-16T07:31:12.995339+0000","last_undegraded":"2024-03-16T07:31:12.995339+0000","last_fullsized":"2024-03-16T07:31:12.995339+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_clean_scrub_stamp":"2024-03-16T07:31:11.948725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:39:24.829868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.1a","version":"122'1","reported_seq":13,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.993878+0000","last_change":"2024-03-16T07:31:11.976125+0000","last_active":"2024-03-16T07:31:12.993878+0000","last_peered":"2024-03-16T07:31:12.993878+0000","last_clean":"2024-03-16T07:31:12.993878+0000","last_became_active":"2024-03-16T07:31:11.975895+0000","last_became_peered":"2024-03-16T07:31:11.975895+0000","last_unstale":"2024-03-16T07:31:12.993878+0000","last_undegraded":"2024-03-16T07:31:12.993878+0000","last_fullsized":"2024-03-16T07:31:12.993878+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:10.945812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:10.945812+0000","last_clean_scrub_stamp":"2024-03-16T07:31:10.945812+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:00:31.182555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":18,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.957884+0000","last_change":"2024-03-16T07:30:58.578447+0000","last_active":"2024-03-16T07:31:12.957884+0000","last_peered":"2024-03-16T07:31:12.957884+0000","last_clean":"2024-03-16T07:31:12.957884+0000","last_became_active":"2024-03-16T07:30:58.576907+0000","last_became_peered":"2024-03-16T07:30:58.576907+0000","last_unstale":"2024-03-16T07:31:12.957884+0000","last_undegraded":"2024-03-16T07:31:12.957884+0000","last_fullsized":"2024-03-16T07:31:12.957884+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:34:34.180780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":20,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.979560+0000","last_change":"2024-03-16T07:30:57.876311+0000","last_active":"2024-03-16T07:31:12.979560+0000","last_peered":"2024-03-16T07:31:12.979560+0000","last_clean":"2024-03-16T07:31:12.979560+0000","last_became_active":"2024-03-16T07:30:57.875731+0000","last_became_peered":"2024-03-16T07:30:57.875731+0000","last_unstale":"2024-03-16T07:31:12.979560+0000","last_undegraded":"2024-03-16T07:31:12.979560+0000","last_fullsized":"2024-03-16T07:31:12.979560+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_clean_scrub_stamp":"2024-03-16T07:30:56.855668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:05:56.490504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.14","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.993310+0000","last_change":"2024-03-16T07:31:12.991456+0000","last_active":"2024-03-16T07:31:12.993310+0000","last_peered":"2024-03-16T07:31:12.993310+0000","last_clean":"2024-03-16T07:31:12.993310+0000","last_became_active":"2024-03-16T07:31:12.991237+0000","last_became_peered":"2024-03-16T07:31:12.991237+0000","last_unstale":"2024-03-16T07:31:12.993310+0000","last_undegraded":"2024-03-16T07:31:12.993310+0000","last_fullsized":"2024-03-16T07:31:12.993310+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_clean_scrub_stamp":"2024-03-16T07:31:11.948725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:44:45.844091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.15","version":"122'3","reported_seq":15,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.983962+0000","last_change":"2024-03-16T07:31:11.968910+0000","last_active":"2024-03-16T07:31:12.983962+0000","last_peered":"2024-03-16T07:31:12.983962+0000","last_clean":"2024-03-16T07:31:12.983962+0000","last_became_active":"2024-03-16T07:31:11.968664+0000","last_became_peered":"2024-03-16T07:31:11.968664+0000","last_unstale":"2024-03-16T07:31:12.983962+0000","last_undegraded":"2024-03-16T07:31:12.983962+0000","last_fullsized":"2024-03-16T07:31:12.983962+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:10.945812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:10.945812+0000","last_clean_scrub_stamp":"2024-03-16T07:31:10.945812+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:19:55.942745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":18,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.960333+0000","last_change":"2024-03-16T07:30:58.574189+0000","last_active":"2024-03-16T07:31:12.960333+0000","last_peered":"2024-03-16T07:31:12.960333+0000","last_clean":"2024-03-16T07:31:12.960333+0000","last_became_active":"2024-03-16T07:30:58.573886+0000","last_became_peered":"2024-03-16T07:30:58.573886+0000","last_unstale":"2024-03-16T07:31:12.960333+0000","last_undegraded":"2024-03-16T07:31:12.960333+0000","last_fullsized":"2024-03-16T07:31:12.960333+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:58:32.025910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":20,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.967833+0000","last_change":"2024-03-16T07:30:57.880020+0000","last_active":"2024-03-16T07:31:12.967833+0000","last_peered":"2024-03-16T07:31:12.967833+0000","last_clean":"2024-03-16T07:31:12.967833+0000","last_became_active":"2024-03-16T07:30:57.877991+0000","last_became_peered":"2024-03-16T07:30:57.877991+0000","last_unstale":"2024-03-16T07:31:12.967833+0000","last_undegraded":"2024-03-16T07:31:12.967833+0000","last_fullsized":"2024-03-16T07:31:12.967833+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_clean_scrub_stamp":"2024-03-16T07:30:56.855668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:59:19.537450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.15","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.974862+0000","last_change":"2024-03-16T07:31:12.974034+0000","last_active":"2024-03-16T07:31:12.974862+0000","last_peered":"2024-03-16T07:31:12.974862+0000","last_clean":"2024-03-16T07:31:12.974862+0000","last_became_active":"2024-03-16T07:31:12.973792+0000","last_became_peered":"2024-03-16T07:31:12.973792+0000","last_unstale":"2024-03-16T07:31:12.974862+0000","last_undegraded":"2024-03-16T07:31:12.974862+0000","last_fullsized":"2024-03-16T07:31:12.974862+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_clean_scrub_stamp":"2024-03-16T07:31:11.948725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:08:22.650549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.14","version":"122'6","reported_seq":18,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.997452+0000","last_change":"2024-03-16T07:31:11.969036+0000","last_active":"2024-03-16T07:31:12.997452+0000","last_peered":"2024-03-16T07:31:12.997452+0000","last_clean":"2024-03-16T07:31:12.997452+0000","last_became_active":"2024-03-16T07:31:11.968024+0000","last_became_peered":"2024-03-16T07:31:11.968024+0000","last_unstale":"2024-03-16T07:31:12.997452+0000","last_undegraded":"2024-03-16T07:31:12.997452+0000","last_fullsized":"2024-03-16T07:31:12.997452+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:10.945812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:10.945812+0000","last_clean_scrub_stamp":"2024-03-16T07:31:10.945812+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:54:44.055228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":18,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.972407+0000","last_change":"2024-03-16T07:30:58.560911+0000","last_active":"2024-03-16T07:31:12.972407+0000","last_peered":"2024-03-16T07:31:12.972407+0000","last_clean":"2024-03-16T07:31:12.972407+0000","last_became_active":"2024-03-16T07:30:58.560672+0000","last_became_peered":"2024-03-16T07:30:58.560672+0000","last_unstale":"2024-03-16T07:31:12.972407+0000","last_undegraded":"2024-03-16T07:31:12.972407+0000","last_fullsized":"2024-03-16T07:31:12.972407+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:58:03.061266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":20,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.968024+0000","last_change":"2024-03-16T07:30:57.883569+0000","last_active":"2024-03-16T07:31:12.968024+0000","last_peered":"2024-03-16T07:31:12.968024+0000","last_clean":"2024-03-16T07:31:12.968024+0000","last_became_active":"2024-03-16T07:30:57.881021+0000","last_became_peered":"2024-03-16T07:30:57.881021+0000","last_unstale":"2024-03-16T07:31:12.968024+0000","last_undegraded":"2024-03-16T07:31:12.968024+0000","last_fullsized":"2024-03-16T07:31:12.968024+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_clean_scrub_stamp":"2024-03-16T07:30:56.855668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:10:24.637645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.981722+0000","last_change":"2024-03-16T07:31:12.976002+0000","last_active":"2024-03-16T07:31:12.981722+0000","last_peered":"2024-03-16T07:31:12.981722+0000","last_clean":"2024-03-16T07:31:12.981722+0000","last_became_active":"2024-03-16T07:31:12.975745+0000","last_became_peered":"2024-03-16T07:31:12.975745+0000","last_unstale":"2024-03-16T07:31:12.981722+0000","last_undegraded":"2024-03-16T07:31:12.981722+0000","last_fullsized":"2024-03-16T07:31:12.981722+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_clean_scrub_stamp":"2024-03-16T07:31:11.948725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:51:15.563862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.959490+0000","last_change":"2024-03-16T07:31:11.963491+0000","last_active":"2024-03-16T07:31:12.959490+0000","last_peered":"2024-03-16T07:31:12.959490+0000","last_clean":"2024-03-16T07:31:12.959490+0000","last_became_active":"2024-03-16T07:31:11.963266+0000","last_became_peered":"2024-03-16T07:31:11.963266+0000","last_unstale":"2024-03-16T07:31:12.959490+0000","last_undegraded":"2024-03-16T07:31:12.959490+0000","last_fullsized":"2024-03-16T07:31:12.959490+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:10.945812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:10.945812+0000","last_clean_scrub_stamp":"2024-03-16T07:31:10.945812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:59:27.141140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":18,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.960194+0000","last_change":"2024-03-16T07:30:58.577305+0000","last_active":"2024-03-16T07:31:12.960194+0000","last_peered":"2024-03-16T07:31:12.960194+0000","last_clean":"2024-03-16T07:31:12.960194+0000","last_became_active":"2024-03-16T07:30:58.577050+0000","last_became_peered":"2024-03-16T07:30:58.577050+0000","last_unstale":"2024-03-16T07:31:12.960194+0000","last_undegraded":"2024-03-16T07:31:12.960194+0000","last_fullsized":"2024-03-16T07:31:12.960194+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:41:05.634256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.14","version":"119'8","reported_seq":28,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.971406+0000","last_change":"2024-03-16T07:30:57.875270+0000","last_active":"2024-03-16T07:31:12.971406+0000","last_peered":"2024-03-16T07:31:12.971406+0000","last_clean":"2024-03-16T07:31:12.971406+0000","last_became_active":"2024-03-16T07:30:57.874794+0000","last_became_peered":"2024-03-16T07:30:57.874794+0000","last_unstale":"2024-03-16T07:31:12.971406+0000","last_undegraded":"2024-03-16T07:31:12.971406+0000","last_fullsized":"2024-03-16T07:31:12.971406+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_clean_scrub_stamp":"2024-03-16T07:30:56.855668+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:26:41.488241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3309,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.10","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.996322+0000","last_change":"2024-03-16T07:31:12.994279+0000","last_active":"2024-03-16T07:31:12.996322+0000","last_peered":"2024-03-16T07:31:12.996322+0000","last_clean":"2024-03-16T07:31:12.996322+0000","last_became_active":"2024-03-16T07:31:12.994031+0000","last_became_peered":"2024-03-16T07:31:12.994031+0000","last_unstale":"2024-03-16T07:31:12.996322+0000","last_undegraded":"2024-03-16T07:31:12.996322+0000","last_fullsized":"2024-03-16T07:31:12.996322+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_clean_scrub_stamp":"2024-03-16T07:31:11.948725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:43:24.254501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.965763+0000","last_change":"2024-03-16T07:31:11.964087+0000","last_active":"2024-03-16T07:31:12.965763+0000","last_peered":"2024-03-16T07:31:12.965763+0000","last_clean":"2024-03-16T07:31:12.965763+0000","last_became_active":"2024-03-16T07:31:11.963805+0000","last_became_peered":"2024-03-16T07:31:11.963805+0000","last_unstale":"2024-03-16T07:31:12.965763+0000","last_undegraded":"2024-03-16T07:31:12.965763+0000","last_fullsized":"2024-03-16T07:31:12.965763+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:10.945812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:10.945812+0000","last_clean_scrub_stamp":"2024-03-16T07:31:10.945812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:22:40.297574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":18,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.958387+0000","last_change":"2024-03-16T07:30:58.577837+0000","last_active":"2024-03-16T07:31:12.958387+0000","last_peered":"2024-03-16T07:31:12.958387+0000","last_clean":"2024-03-16T07:31:12.958387+0000","last_became_active":"2024-03-16T07:30:58.577593+0000","last_became_peered":"2024-03-16T07:30:58.577593+0000","last_unstale":"2024-03-16T07:31:12.958387+0000","last_undegraded":"2024-03-16T07:31:12.958387+0000","last_fullsized":"2024-03-16T07:31:12.958387+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:56:09.744131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.13","version":"118'2","reported_seq":22,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.968202+0000","last_change":"2024-03-16T07:30:57.876973+0000","last_active":"2024-03-16T07:31:12.968202+0000","last_peered":"2024-03-16T07:31:12.968202+0000","last_clean":"2024-03-16T07:31:12.968202+0000","last_became_active":"2024-03-16T07:30:57.876549+0000","last_became_peered":"2024-03-16T07:30:57.876549+0000","last_unstale":"2024-03-16T07:31:12.968202+0000","last_undegraded":"2024-03-16T07:31:12.968202+0000","last_fullsized":"2024-03-16T07:31:12.968202+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_clean_scrub_stamp":"2024-03-16T07:30:56.855668+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:22:06.397991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.992834+0000","last_change":"2024-03-16T07:31:12.986842+0000","last_active":"2024-03-16T07:31:12.992834+0000","last_peered":"2024-03-16T07:31:12.992834+0000","last_clean":"2024-03-16T07:31:12.992834+0000","last_became_active":"2024-03-16T07:31:12.986590+0000","last_became_peered":"2024-03-16T07:31:12.986590+0000","last_unstale":"2024-03-16T07:31:12.992834+0000","last_undegraded":"2024-03-16T07:31:12.992834+0000","last_fullsized":"2024-03-16T07:31:12.992834+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_clean_scrub_stamp":"2024-03-16T07:31:11.948725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:22:54.476463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.10","version":"122'8","reported_seq":20,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.998024+0000","last_change":"2024-03-16T07:31:11.979272+0000","last_active":"2024-03-16T07:31:12.998024+0000","last_peered":"2024-03-16T07:31:12.998024+0000","last_clean":"2024-03-16T07:31:12.998024+0000","last_became_active":"2024-03-16T07:31:11.976520+0000","last_became_peered":"2024-03-16T07:31:11.976520+0000","last_unstale":"2024-03-16T07:31:12.998024+0000","last_undegraded":"2024-03-16T07:31:12.998024+0000","last_fullsized":"2024-03-16T07:31:12.998024+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:10.945812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:10.945812+0000","last_clean_scrub_stamp":"2024-03-16T07:31:10.945812+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:54:17.182433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":18,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.968092+0000","last_change":"2024-03-16T07:30:58.560202+0000","last_active":"2024-03-16T07:31:12.968092+0000","last_peered":"2024-03-16T07:31:12.968092+0000","last_clean":"2024-03-16T07:31:12.968092+0000","last_became_active":"2024-03-16T07:30:58.559912+0000","last_became_peered":"2024-03-16T07:30:58.559912+0000","last_unstale":"2024-03-16T07:31:12.968092+0000","last_undegraded":"2024-03-16T07:31:12.968092+0000","last_fullsized":"2024-03-16T07:31:12.968092+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:25:23.575079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":20,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.977305+0000","last_change":"2024-03-16T07:30:57.873985+0000","last_active":"2024-03-16T07:31:12.977305+0000","last_peered":"2024-03-16T07:31:12.977305+0000","last_clean":"2024-03-16T07:31:12.977305+0000","last_became_active":"2024-03-16T07:30:57.873398+0000","last_became_peered":"2024-03-16T07:30:57.873398+0000","last_unstale":"2024-03-16T07:31:12.977305+0000","last_undegraded":"2024-03-16T07:31:12.977305+0000","last_fullsized":"2024-03-16T07:31:12.977305+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_clean_scrub_stamp":"2024-03-16T07:30:56.855668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:46:10.971699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.974598+0000","last_change":"2024-03-16T07:31:12.972760+0000","last_active":"2024-03-16T07:31:12.974598+0000","last_peered":"2024-03-16T07:31:12.974598+0000","last_clean":"2024-03-16T07:31:12.974598+0000","last_became_active":"2024-03-16T07:31:12.971306+0000","last_became_peered":"2024-03-16T07:31:12.971306+0000","last_unstale":"2024-03-16T07:31:12.974598+0000","last_undegraded":"2024-03-16T07:31:12.974598+0000","last_fullsized":"2024-03-16T07:31:12.974598+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_clean_scrub_stamp":"2024-03-16T07:31:11.948725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:26:56.581297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.13","version":"122'2","reported_seq":14,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.985578+0000","last_change":"2024-03-16T07:31:11.967711+0000","last_active":"2024-03-16T07:31:12.985578+0000","last_peered":"2024-03-16T07:31:12.985578+0000","last_clean":"2024-03-16T07:31:12.985578+0000","last_became_active":"2024-03-16T07:31:11.967461+0000","last_became_peered":"2024-03-16T07:31:11.967461+0000","last_unstale":"2024-03-16T07:31:12.985578+0000","last_undegraded":"2024-03-16T07:31:12.985578+0000","last_fullsized":"2024-03-16T07:31:12.985578+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:10.945812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:10.945812+0000","last_clean_scrub_stamp":"2024-03-16T07:31:10.945812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:26:16.621759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":18,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.956734+0000","last_change":"2024-03-16T07:30:58.573178+0000","last_active":"2024-03-16T07:31:12.956734+0000","last_peered":"2024-03-16T07:31:12.956734+0000","last_clean":"2024-03-16T07:31:12.956734+0000","last_became_active":"2024-03-16T07:30:58.571970+0000","last_became_peered":"2024-03-16T07:30:58.571970+0000","last_unstale":"2024-03-16T07:31:12.956734+0000","last_undegraded":"2024-03-16T07:31:12.956734+0000","last_fullsized":"2024-03-16T07:31:12.956734+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:47:26.847551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":20,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.965899+0000","last_change":"2024-03-16T07:30:57.876093+0000","last_active":"2024-03-16T07:31:12.965899+0000","last_peered":"2024-03-16T07:31:12.965899+0000","last_clean":"2024-03-16T07:31:12.965899+0000","last_became_active":"2024-03-16T07:30:57.875436+0000","last_became_peered":"2024-03-16T07:30:57.875436+0000","last_unstale":"2024-03-16T07:31:12.965899+0000","last_undegraded":"2024-03-16T07:31:12.965899+0000","last_fullsized":"2024-03-16T07:31:12.965899+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_clean_scrub_stamp":"2024-03-16T07:30:56.855668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:32:20.139876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.13","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.992445+0000","last_change":"2024-03-16T07:31:12.987329+0000","last_active":"2024-03-16T07:31:12.992445+0000","last_peered":"2024-03-16T07:31:12.992445+0000","last_clean":"2024-03-16T07:31:12.992445+0000","last_became_active":"2024-03-16T07:31:12.986553+0000","last_became_peered":"2024-03-16T07:31:12.986553+0000","last_unstale":"2024-03-16T07:31:12.992445+0000","last_undegraded":"2024-03-16T07:31:12.992445+0000","last_fullsized":"2024-03-16T07:31:12.992445+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_clean_scrub_stamp":"2024-03-16T07:31:11.948725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:02:47.740523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.976969+0000","last_change":"2024-03-16T07:31:11.977422+0000","last_active":"2024-03-16T07:31:12.976969+0000","last_peered":"2024-03-16T07:31:12.976969+0000","last_clean":"2024-03-16T07:31:12.976969+0000","last_became_active":"2024-03-16T07:31:11.976873+0000","last_became_peered":"2024-03-16T07:31:11.976873+0000","last_unstale":"2024-03-16T07:31:12.976969+0000","last_undegraded":"2024-03-16T07:31:12.976969+0000","last_fullsized":"2024-03-16T07:31:12.976969+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:10.945812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:10.945812+0000","last_clean_scrub_stamp":"2024-03-16T07:31:10.945812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:21:15.124125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":18,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.958109+0000","last_change":"2024-03-16T07:30:58.576156+0000","last_active":"2024-03-16T07:31:12.958109+0000","last_peered":"2024-03-16T07:31:12.958109+0000","last_clean":"2024-03-16T07:31:12.958109+0000","last_became_active":"2024-03-16T07:30:58.575849+0000","last_became_peered":"2024-03-16T07:30:58.575849+0000","last_unstale":"2024-03-16T07:31:12.958109+0000","last_undegraded":"2024-03-16T07:31:12.958109+0000","last_fullsized":"2024-03-16T07:31:12.958109+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:13:03.840990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.10","version":"118'8","reported_seq":28,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.956972+0000","last_change":"2024-03-16T07:30:57.879389+0000","last_active":"2024-03-16T07:31:12.956972+0000","last_peered":"2024-03-16T07:31:12.956972+0000","last_clean":"2024-03-16T07:31:12.956972+0000","last_became_active":"2024-03-16T07:30:57.879149+0000","last_became_peered":"2024-03-16T07:30:57.879149+0000","last_unstale":"2024-03-16T07:31:12.956972+0000","last_undegraded":"2024-03-16T07:31:12.956972+0000","last_fullsized":"2024-03-16T07:31:12.956972+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_clean_scrub_stamp":"2024-03-16T07:30:56.855668+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:55:45.100141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.995370+0000","last_change":"2024-03-16T07:31:12.993188+0000","last_active":"2024-03-16T07:31:12.995370+0000","last_peered":"2024-03-16T07:31:12.995370+0000","last_clean":"2024-03-16T07:31:12.995370+0000","last_became_active":"2024-03-16T07:31:12.992856+0000","last_became_peered":"2024-03-16T07:31:12.992856+0000","last_unstale":"2024-03-16T07:31:12.995370+0000","last_undegraded":"2024-03-16T07:31:12.995370+0000","last_fullsized":"2024-03-16T07:31:12.995370+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_clean_scrub_stamp":"2024-03-16T07:31:11.948725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:06:11.583560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.d","version":"122'1","reported_seq":13,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.995984+0000","last_change":"2024-03-16T07:31:11.979087+0000","last_active":"2024-03-16T07:31:12.995984+0000","last_peered":"2024-03-16T07:31:12.995984+0000","last_clean":"2024-03-16T07:31:12.995984+0000","last_became_active":"2024-03-16T07:31:11.978817+0000","last_became_peered":"2024-03-16T07:31:11.978817+0000","last_unstale":"2024-03-16T07:31:12.995984+0000","last_undegraded":"2024-03-16T07:31:12.995984+0000","last_fullsized":"2024-03-16T07:31:12.995984+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:10.945812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:10.945812+0000","last_clean_scrub_stamp":"2024-03-16T07:31:10.945812+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:21:57.389765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":18,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.967963+0000","last_change":"2024-03-16T07:30:58.566955+0000","last_active":"2024-03-16T07:31:12.967963+0000","last_peered":"2024-03-16T07:31:12.967963+0000","last_clean":"2024-03-16T07:31:12.967963+0000","last_became_active":"2024-03-16T07:30:58.563826+0000","last_became_peered":"2024-03-16T07:30:58.563826+0000","last_unstale":"2024-03-16T07:31:12.967963+0000","last_undegraded":"2024-03-16T07:31:12.967963+0000","last_fullsized":"2024-03-16T07:31:12.967963+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:49:38.279098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.f","version":"118'1","reported_seq":21,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.961671+0000","last_change":"2024-03-16T07:30:57.879349+0000","last_active":"2024-03-16T07:31:12.961671+0000","last_peered":"2024-03-16T07:31:12.961671+0000","last_clean":"2024-03-16T07:31:12.961671+0000","last_became_active":"2024-03-16T07:30:57.879060+0000","last_became_peered":"2024-03-16T07:30:57.879060+0000","last_unstale":"2024-03-16T07:31:12.961671+0000","last_undegraded":"2024-03-16T07:31:12.961671+0000","last_fullsized":"2024-03-16T07:31:12.961671+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_clean_scrub_stamp":"2024-03-16T07:30:56.855668+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:30:49.424989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.993091+0000","last_change":"2024-03-16T07:31:12.988388+0000","last_active":"2024-03-16T07:31:12.993091+0000","last_peered":"2024-03-16T07:31:12.993091+0000","last_clean":"2024-03-16T07:31:12.993091+0000","last_became_active":"2024-03-16T07:31:12.987803+0000","last_became_peered":"2024-03-16T07:31:12.987803+0000","last_unstale":"2024-03-16T07:31:12.993091+0000","last_undegraded":"2024-03-16T07:31:12.993091+0000","last_fullsized":"2024-03-16T07:31:12.993091+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_clean_scrub_stamp":"2024-03-16T07:31:11.948725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:48:55.913014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.970882+0000","last_change":"2024-03-16T07:31:11.970854+0000","last_active":"2024-03-16T07:31:12.970882+0000","last_peered":"2024-03-16T07:31:12.970882+0000","last_clean":"2024-03-16T07:31:12.970882+0000","last_became_active":"2024-03-16T07:31:11.970623+0000","last_became_peered":"2024-03-16T07:31:11.970623+0000","last_unstale":"2024-03-16T07:31:12.970882+0000","last_undegraded":"2024-03-16T07:31:12.970882+0000","last_fullsized":"2024-03-16T07:31:12.970882+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:10.945812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:10.945812+0000","last_clean_scrub_stamp":"2024-03-16T07:31:10.945812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:55:09.765511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":18,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.961226+0000","last_change":"2024-03-16T07:30:58.574600+0000","last_active":"2024-03-16T07:31:12.961226+0000","last_peered":"2024-03-16T07:31:12.961226+0000","last_clean":"2024-03-16T07:31:12.961226+0000","last_became_active":"2024-03-16T07:30:58.574152+0000","last_became_peered":"2024-03-16T07:30:58.574152+0000","last_unstale":"2024-03-16T07:31:12.961226+0000","last_undegraded":"2024-03-16T07:31:12.961226+0000","last_fullsized":"2024-03-16T07:31:12.961226+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:59:55.677315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"118'2","reported_seq":22,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.968113+0000","last_change":"2024-03-16T07:30:57.881691+0000","last_active":"2024-03-16T07:31:12.968113+0000","last_peered":"2024-03-16T07:31:12.968113+0000","last_clean":"2024-03-16T07:31:12.968113+0000","last_became_active":"2024-03-16T07:30:57.880871+0000","last_became_peered":"2024-03-16T07:30:57.880871+0000","last_unstale":"2024-03-16T07:31:12.968113+0000","last_undegraded":"2024-03-16T07:31:12.968113+0000","last_fullsized":"2024-03-16T07:31:12.968113+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_clean_scrub_stamp":"2024-03-16T07:30:56.855668+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:56:12.658295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.e","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.983782+0000","last_change":"2024-03-16T07:31:12.982828+0000","last_active":"2024-03-16T07:31:12.983782+0000","last_peered":"2024-03-16T07:31:12.983782+0000","last_clean":"2024-03-16T07:31:12.983782+0000","last_became_active":"2024-03-16T07:31:12.981644+0000","last_became_peered":"2024-03-16T07:31:12.981644+0000","last_unstale":"2024-03-16T07:31:12.983782+0000","last_undegraded":"2024-03-16T07:31:12.983782+0000","last_fullsized":"2024-03-16T07:31:12.983782+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_clean_scrub_stamp":"2024-03-16T07:31:11.948725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:59:28.144053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"122'1","reported_seq":13,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.992402+0000","last_change":"2024-03-16T07:31:11.975750+0000","last_active":"2024-03-16T07:31:12.992402+0000","last_peered":"2024-03-16T07:31:12.992402+0000","last_clean":"2024-03-16T07:31:12.992402+0000","last_became_active":"2024-03-16T07:31:11.972712+0000","last_became_peered":"2024-03-16T07:31:11.972712+0000","last_unstale":"2024-03-16T07:31:12.992402+0000","last_undegraded":"2024-03-16T07:31:12.992402+0000","last_fullsized":"2024-03-16T07:31:12.992402+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:10.945812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:10.945812+0000","last_clean_scrub_stamp":"2024-03-16T07:31:10.945812+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:22:40.274582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":18,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.974001+0000","last_change":"2024-03-16T07:30:58.562180+0000","last_active":"2024-03-16T07:31:12.974001+0000","last_peered":"2024-03-16T07:31:12.974001+0000","last_clean":"2024-03-16T07:31:12.974001+0000","last_became_active":"2024-03-16T07:30:58.560416+0000","last_became_peered":"2024-03-16T07:30:58.560416+0000","last_unstale":"2024-03-16T07:31:12.974001+0000","last_undegraded":"2024-03-16T07:31:12.974001+0000","last_fullsized":"2024-03-16T07:31:12.974001+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:27:03.691637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.d","version":"118'1","reported_seq":21,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.960380+0000","last_change":"2024-03-16T07:30:57.878006+0000","last_active":"2024-03-16T07:31:12.960380+0000","last_peered":"2024-03-16T07:31:12.960380+0000","last_clean":"2024-03-16T07:31:12.960380+0000","last_became_active":"2024-03-16T07:30:57.877534+0000","last_became_peered":"2024-03-16T07:30:57.877534+0000","last_unstale":"2024-03-16T07:31:12.960380+0000","last_undegraded":"2024-03-16T07:31:12.960380+0000","last_fullsized":"2024-03-16T07:31:12.960380+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_clean_scrub_stamp":"2024-03-16T07:30:56.855668+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:00:45.799835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.f","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.993952+0000","last_change":"2024-03-16T07:31:12.990128+0000","last_active":"2024-03-16T07:31:12.993952+0000","last_peered":"2024-03-16T07:31:12.993952+0000","last_clean":"2024-03-16T07:31:12.993952+0000","last_became_active":"2024-03-16T07:31:12.989446+0000","last_became_peered":"2024-03-16T07:31:12.989446+0000","last_unstale":"2024-03-16T07:31:12.993952+0000","last_undegraded":"2024-03-16T07:31:12.993952+0000","last_fullsized":"2024-03-16T07:31:12.993952+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_clean_scrub_stamp":"2024-03-16T07:31:11.948725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:37:50.591552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.e","version":"122'2","reported_seq":14,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:13.001494+0000","last_change":"2024-03-16T07:31:11.970846+0000","last_active":"2024-03-16T07:31:13.001494+0000","last_peered":"2024-03-16T07:31:13.001494+0000","last_clean":"2024-03-16T07:31:13.001494+0000","last_became_active":"2024-03-16T07:31:11.970590+0000","last_became_peered":"2024-03-16T07:31:11.970590+0000","last_unstale":"2024-03-16T07:31:13.001494+0000","last_undegraded":"2024-03-16T07:31:13.001494+0000","last_fullsized":"2024-03-16T07:31:13.001494+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:10.945812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:10.945812+0000","last_clean_scrub_stamp":"2024-03-16T07:31:10.945812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:00:12.863907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":18,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.970820+0000","last_change":"2024-03-16T07:30:58.562773+0000","last_active":"2024-03-16T07:31:12.970820+0000","last_peered":"2024-03-16T07:31:12.970820+0000","last_clean":"2024-03-16T07:31:12.970820+0000","last_became_active":"2024-03-16T07:30:58.562520+0000","last_became_peered":"2024-03-16T07:30:58.562520+0000","last_unstale":"2024-03-16T07:31:12.970820+0000","last_undegraded":"2024-03-16T07:31:12.970820+0000","last_fullsized":"2024-03-16T07:31:12.970820+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:13:01.831834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":20,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.974172+0000","last_change":"2024-03-16T07:30:57.877782+0000","last_active":"2024-03-16T07:31:12.974172+0000","last_peered":"2024-03-16T07:31:12.974172+0000","last_clean":"2024-03-16T07:31:12.974172+0000","last_became_active":"2024-03-16T07:30:57.876843+0000","last_became_peered":"2024-03-16T07:30:57.876843+0000","last_unstale":"2024-03-16T07:31:12.974172+0000","last_undegraded":"2024-03-16T07:31:12.974172+0000","last_fullsized":"2024-03-16T07:31:12.974172+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_clean_scrub_stamp":"2024-03-16T07:30:56.855668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:26:20.745771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.993622+0000","last_change":"2024-03-16T07:31:12.990712+0000","last_active":"2024-03-16T07:31:12.993622+0000","last_peered":"2024-03-16T07:31:12.993622+0000","last_clean":"2024-03-16T07:31:12.993622+0000","last_became_active":"2024-03-16T07:31:12.990475+0000","last_became_peered":"2024-03-16T07:31:12.990475+0000","last_unstale":"2024-03-16T07:31:12.993622+0000","last_undegraded":"2024-03-16T07:31:12.993622+0000","last_fullsized":"2024-03-16T07:31:12.993622+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_clean_scrub_stamp":"2024-03-16T07:31:11.948725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:00:41.796661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.965343+0000","last_change":"2024-03-16T07:31:11.968601+0000","last_active":"2024-03-16T07:31:12.965343+0000","last_peered":"2024-03-16T07:31:12.965343+0000","last_clean":"2024-03-16T07:31:12.965343+0000","last_became_active":"2024-03-16T07:31:11.968362+0000","last_became_peered":"2024-03-16T07:31:11.968362+0000","last_unstale":"2024-03-16T07:31:12.965343+0000","last_undegraded":"2024-03-16T07:31:12.965343+0000","last_fullsized":"2024-03-16T07:31:12.965343+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:10.945812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:10.945812+0000","last_clean_scrub_stamp":"2024-03-16T07:31:10.945812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:40:36.299362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":18,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.977304+0000","last_change":"2024-03-16T07:30:58.561355+0000","last_active":"2024-03-16T07:31:12.977304+0000","last_peered":"2024-03-16T07:31:12.977304+0000","last_clean":"2024-03-16T07:31:12.977304+0000","last_became_active":"2024-03-16T07:30:58.561123+0000","last_became_peered":"2024-03-16T07:30:58.561123+0000","last_unstale":"2024-03-16T07:31:12.977304+0000","last_undegraded":"2024-03-16T07:31:12.977304+0000","last_fullsized":"2024-03-16T07:31:12.977304+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:26:11.962024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.b","version":"118'2","reported_seq":22,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.977085+0000","last_change":"2024-03-16T07:30:57.876715+0000","last_active":"2024-03-16T07:31:12.977085+0000","last_peered":"2024-03-16T07:31:12.977085+0000","last_clean":"2024-03-16T07:31:12.977085+0000","last_became_active":"2024-03-16T07:30:57.876348+0000","last_became_peered":"2024-03-16T07:30:57.876348+0000","last_unstale":"2024-03-16T07:31:12.977085+0000","last_undegraded":"2024-03-16T07:31:12.977085+0000","last_fullsized":"2024-03-16T07:31:12.977085+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_clean_scrub_stamp":"2024-03-16T07:30:56.855668+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:59:13.050997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.974718+0000","last_change":"2024-03-16T07:31:12.970889+0000","last_active":"2024-03-16T07:31:12.974718+0000","last_peered":"2024-03-16T07:31:12.974718+0000","last_clean":"2024-03-16T07:31:12.974718+0000","last_became_active":"2024-03-16T07:31:12.969677+0000","last_became_peered":"2024-03-16T07:31:12.969677+0000","last_unstale":"2024-03-16T07:31:12.974718+0000","last_undegraded":"2024-03-16T07:31:12.974718+0000","last_fullsized":"2024-03-16T07:31:12.974718+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_clean_scrub_stamp":"2024-03-16T07:31:11.948725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:39:24.829868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.979762+0000","last_change":"2024-03-16T07:31:11.971513+0000","last_active":"2024-03-16T07:31:12.979762+0000","last_peered":"2024-03-16T07:31:12.979762+0000","last_clean":"2024-03-16T07:31:12.979762+0000","last_became_active":"2024-03-16T07:31:11.971265+0000","last_became_peered":"2024-03-16T07:31:11.971265+0000","last_unstale":"2024-03-16T07:31:12.979762+0000","last_undegraded":"2024-03-16T07:31:12.979762+0000","last_fullsized":"2024-03-16T07:31:12.979762+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:10.945812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:10.945812+0000","last_clean_scrub_stamp":"2024-03-16T07:31:10.945812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:29:56.022194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":18,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.976997+0000","last_change":"2024-03-16T07:30:58.561031+0000","last_active":"2024-03-16T07:31:12.976997+0000","last_peered":"2024-03-16T07:31:12.976997+0000","last_clean":"2024-03-16T07:31:12.976997+0000","last_became_active":"2024-03-16T07:30:58.560717+0000","last_became_peered":"2024-03-16T07:30:58.560717+0000","last_unstale":"2024-03-16T07:31:12.976997+0000","last_undegraded":"2024-03-16T07:31:12.976997+0000","last_fullsized":"2024-03-16T07:31:12.976997+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:30:27.329471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":20,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.958501+0000","last_change":"2024-03-16T07:30:57.876974+0000","last_active":"2024-03-16T07:31:12.958501+0000","last_peered":"2024-03-16T07:31:12.958501+0000","last_clean":"2024-03-16T07:31:12.958501+0000","last_became_active":"2024-03-16T07:30:57.876350+0000","last_became_peered":"2024-03-16T07:30:57.876350+0000","last_unstale":"2024-03-16T07:31:12.958501+0000","last_undegraded":"2024-03-16T07:31:12.958501+0000","last_fullsized":"2024-03-16T07:31:12.958501+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_clean_scrub_stamp":"2024-03-16T07:30:56.855668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:12:00.017490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.974486+0000","last_change":"2024-03-16T07:31:12.970218+0000","last_active":"2024-03-16T07:31:12.974486+0000","last_peered":"2024-03-16T07:31:12.974486+0000","last_clean":"2024-03-16T07:31:12.974486+0000","last_became_active":"2024-03-16T07:31:12.969970+0000","last_became_peered":"2024-03-16T07:31:12.969970+0000","last_unstale":"2024-03-16T07:31:12.974486+0000","last_undegraded":"2024-03-16T07:31:12.974486+0000","last_fullsized":"2024-03-16T07:31:12.974486+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_clean_scrub_stamp":"2024-03-16T07:31:11.948725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:45:25.869947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.b","version":"122'2","reported_seq":14,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.995966+0000","last_change":"2024-03-16T07:31:11.975500+0000","last_active":"2024-03-16T07:31:12.995966+0000","last_peered":"2024-03-16T07:31:12.995966+0000","last_clean":"2024-03-16T07:31:12.995966+0000","last_became_active":"2024-03-16T07:31:11.975276+0000","last_became_peered":"2024-03-16T07:31:11.975276+0000","last_unstale":"2024-03-16T07:31:12.995966+0000","last_undegraded":"2024-03-16T07:31:12.995966+0000","last_fullsized":"2024-03-16T07:31:12.995966+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:10.945812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:10.945812+0000","last_clean_scrub_stamp":"2024-03-16T07:31:10.945812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:39:09.265518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":18,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.984464+0000","last_change":"2024-03-16T07:30:58.561986+0000","last_active":"2024-03-16T07:31:12.984464+0000","last_peered":"2024-03-16T07:31:12.984464+0000","last_clean":"2024-03-16T07:31:12.984464+0000","last_became_active":"2024-03-16T07:30:58.561661+0000","last_became_peered":"2024-03-16T07:30:58.561661+0000","last_unstale":"2024-03-16T07:31:12.984464+0000","last_undegraded":"2024-03-16T07:31:12.984464+0000","last_fullsized":"2024-03-16T07:31:12.984464+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:57:03.215249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":20,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.958269+0000","last_change":"2024-03-16T07:30:57.880017+0000","last_active":"2024-03-16T07:31:12.958269+0000","last_peered":"2024-03-16T07:31:12.958269+0000","last_clean":"2024-03-16T07:31:12.958269+0000","last_became_active":"2024-03-16T07:30:57.879752+0000","last_became_peered":"2024-03-16T07:30:57.879752+0000","last_unstale":"2024-03-16T07:31:12.958269+0000","last_undegraded":"2024-03-16T07:31:12.958269+0000","last_fullsized":"2024-03-16T07:31:12.958269+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_clean_scrub_stamp":"2024-03-16T07:30:56.855668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:02:33.202240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.b","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.993017+0000","last_change":"2024-03-16T07:31:12.987755+0000","last_active":"2024-03-16T07:31:12.993017+0000","last_peered":"2024-03-16T07:31:12.993017+0000","last_clean":"2024-03-16T07:31:12.993017+0000","last_became_active":"2024-03-16T07:31:12.987524+0000","last_became_peered":"2024-03-16T07:31:12.987524+0000","last_unstale":"2024-03-16T07:31:12.993017+0000","last_undegraded":"2024-03-16T07:31:12.993017+0000","last_fullsized":"2024-03-16T07:31:12.993017+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_clean_scrub_stamp":"2024-03-16T07:31:11.948725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:05:19.367597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.976972+0000","last_change":"2024-03-16T07:31:11.977237+0000","last_active":"2024-03-16T07:31:12.976972+0000","last_peered":"2024-03-16T07:31:12.976972+0000","last_clean":"2024-03-16T07:31:12.976972+0000","last_became_active":"2024-03-16T07:31:11.975987+0000","last_became_peered":"2024-03-16T07:31:11.975987+0000","last_unstale":"2024-03-16T07:31:12.976972+0000","last_undegraded":"2024-03-16T07:31:12.976972+0000","last_fullsized":"2024-03-16T07:31:12.976972+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:10.945812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:10.945812+0000","last_clean_scrub_stamp":"2024-03-16T07:31:10.945812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:23:56.966113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":18,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.976045+0000","last_change":"2024-03-16T07:30:58.566963+0000","last_active":"2024-03-16T07:31:12.976045+0000","last_peered":"2024-03-16T07:31:12.976045+0000","last_clean":"2024-03-16T07:31:12.976045+0000","last_became_active":"2024-03-16T07:30:58.566661+0000","last_became_peered":"2024-03-16T07:30:58.566661+0000","last_unstale":"2024-03-16T07:31:12.976045+0000","last_undegraded":"2024-03-16T07:31:12.976045+0000","last_fullsized":"2024-03-16T07:31:12.976045+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:07:57.057969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":20,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.957034+0000","last_change":"2024-03-16T07:30:57.881392+0000","last_active":"2024-03-16T07:31:12.957034+0000","last_peered":"2024-03-16T07:31:12.957034+0000","last_clean":"2024-03-16T07:31:12.957034+0000","last_became_active":"2024-03-16T07:30:57.881148+0000","last_became_peered":"2024-03-16T07:30:57.881148+0000","last_unstale":"2024-03-16T07:31:12.957034+0000","last_undegraded":"2024-03-16T07:31:12.957034+0000","last_fullsized":"2024-03-16T07:31:12.957034+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_clean_scrub_stamp":"2024-03-16T07:30:56.855668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:37:55.898841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.982910+0000","last_change":"2024-03-16T07:31:12.981881+0000","last_active":"2024-03-16T07:31:12.982910+0000","last_peered":"2024-03-16T07:31:12.982910+0000","last_clean":"2024-03-16T07:31:12.982910+0000","last_became_active":"2024-03-16T07:31:12.981577+0000","last_became_peered":"2024-03-16T07:31:12.981577+0000","last_unstale":"2024-03-16T07:31:12.982910+0000","last_undegraded":"2024-03-16T07:31:12.982910+0000","last_fullsized":"2024-03-16T07:31:12.982910+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_clean_scrub_stamp":"2024-03-16T07:31:11.948725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:01:14.148184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.959706+0000","last_change":"2024-03-16T07:31:11.969508+0000","last_active":"2024-03-16T07:31:12.959706+0000","last_peered":"2024-03-16T07:31:12.959706+0000","last_clean":"2024-03-16T07:31:12.959706+0000","last_became_active":"2024-03-16T07:31:11.969276+0000","last_became_peered":"2024-03-16T07:31:11.969276+0000","last_unstale":"2024-03-16T07:31:12.959706+0000","last_undegraded":"2024-03-16T07:31:12.959706+0000","last_fullsized":"2024-03-16T07:31:12.959706+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:10.945812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:10.945812+0000","last_clean_scrub_stamp":"2024-03-16T07:31:10.945812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:19:50.123388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":18,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.960444+0000","last_change":"2024-03-16T07:30:58.576511+0000","last_active":"2024-03-16T07:31:12.960444+0000","last_peered":"2024-03-16T07:31:12.960444+0000","last_clean":"2024-03-16T07:31:12.960444+0000","last_became_active":"2024-03-16T07:30:58.576275+0000","last_became_peered":"2024-03-16T07:30:58.576275+0000","last_unstale":"2024-03-16T07:31:12.960444+0000","last_undegraded":"2024-03-16T07:31:12.960444+0000","last_fullsized":"2024-03-16T07:31:12.960444+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:00:46.764807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.7","version":"118'2","reported_seq":22,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.961768+0000","last_change":"2024-03-16T07:30:57.876924+0000","last_active":"2024-03-16T07:31:12.961768+0000","last_peered":"2024-03-16T07:31:12.961768+0000","last_clean":"2024-03-16T07:31:12.961768+0000","last_became_active":"2024-03-16T07:30:57.876507+0000","last_became_peered":"2024-03-16T07:30:57.876507+0000","last_unstale":"2024-03-16T07:31:12.961768+0000","last_undegraded":"2024-03-16T07:31:12.961768+0000","last_fullsized":"2024-03-16T07:31:12.961768+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_clean_scrub_stamp":"2024-03-16T07:30:56.855668+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:09:54.480497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.994732+0000","last_change":"2024-03-16T07:31:12.988472+0000","last_active":"2024-03-16T07:31:12.994732+0000","last_peered":"2024-03-16T07:31:12.994732+0000","last_clean":"2024-03-16T07:31:12.994732+0000","last_became_active":"2024-03-16T07:31:12.988196+0000","last_became_peered":"2024-03-16T07:31:12.988196+0000","last_unstale":"2024-03-16T07:31:12.994732+0000","last_undegraded":"2024-03-16T07:31:12.994732+0000","last_fullsized":"2024-03-16T07:31:12.994732+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_clean_scrub_stamp":"2024-03-16T07:31:11.948725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:09:35.921695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.958758+0000","last_change":"2024-03-16T07:31:11.974760+0000","last_active":"2024-03-16T07:31:12.958758+0000","last_peered":"2024-03-16T07:31:12.958758+0000","last_clean":"2024-03-16T07:31:12.958758+0000","last_became_active":"2024-03-16T07:31:11.974514+0000","last_became_peered":"2024-03-16T07:31:11.974514+0000","last_unstale":"2024-03-16T07:31:12.958758+0000","last_undegraded":"2024-03-16T07:31:12.958758+0000","last_fullsized":"2024-03-16T07:31:12.958758+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:10.945812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:10.945812+0000","last_clean_scrub_stamp":"2024-03-16T07:31:10.945812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:42:04.788532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":18,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.961307+0000","last_change":"2024-03-16T07:30:58.574706+0000","last_active":"2024-03-16T07:31:12.961307+0000","last_peered":"2024-03-16T07:31:12.961307+0000","last_clean":"2024-03-16T07:31:12.961307+0000","last_became_active":"2024-03-16T07:30:58.574447+0000","last_became_peered":"2024-03-16T07:30:58.574447+0000","last_unstale":"2024-03-16T07:31:12.961307+0000","last_undegraded":"2024-03-16T07:31:12.961307+0000","last_fullsized":"2024-03-16T07:31:12.961307+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:08:10.527555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.6","version":"119'1","reported_seq":21,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.968287+0000","last_change":"2024-03-16T07:30:57.883769+0000","last_active":"2024-03-16T07:31:12.968287+0000","last_peered":"2024-03-16T07:31:12.968287+0000","last_clean":"2024-03-16T07:31:12.968287+0000","last_became_active":"2024-03-16T07:30:57.881218+0000","last_became_peered":"2024-03-16T07:30:57.881218+0000","last_unstale":"2024-03-16T07:31:12.968287+0000","last_undegraded":"2024-03-16T07:31:12.968287+0000","last_fullsized":"2024-03-16T07:31:12.968287+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_clean_scrub_stamp":"2024-03-16T07:30:56.855668+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:56:31.528403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:13.001033+0000","last_change":"2024-03-16T07:31:13.000439+0000","last_active":"2024-03-16T07:31:13.001033+0000","last_peered":"2024-03-16T07:31:13.001033+0000","last_clean":"2024-03-16T07:31:13.001033+0000","last_became_active":"2024-03-16T07:31:13.000172+0000","last_became_peered":"2024-03-16T07:31:13.000172+0000","last_unstale":"2024-03-16T07:31:13.001033+0000","last_undegraded":"2024-03-16T07:31:13.001033+0000","last_fullsized":"2024-03-16T07:31:13.001033+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_clean_scrub_stamp":"2024-03-16T07:31:11.948725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:29:27.923001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.7","version":"122'2","reported_seq":14,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.995110+0000","last_change":"2024-03-16T07:31:11.970787+0000","last_active":"2024-03-16T07:31:12.995110+0000","last_peered":"2024-03-16T07:31:12.995110+0000","last_clean":"2024-03-16T07:31:12.995110+0000","last_became_active":"2024-03-16T07:31:11.970470+0000","last_became_peered":"2024-03-16T07:31:11.970470+0000","last_unstale":"2024-03-16T07:31:12.995110+0000","last_undegraded":"2024-03-16T07:31:12.995110+0000","last_fullsized":"2024-03-16T07:31:12.995110+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:10.945812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:10.945812+0000","last_clean_scrub_stamp":"2024-03-16T07:31:10.945812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:46:25.061842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":18,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.974089+0000","last_change":"2024-03-16T07:30:58.562495+0000","last_active":"2024-03-16T07:31:12.974089+0000","last_peered":"2024-03-16T07:31:12.974089+0000","last_clean":"2024-03-16T07:31:12.974089+0000","last_became_active":"2024-03-16T07:30:58.562227+0000","last_became_peered":"2024-03-16T07:30:58.562227+0000","last_unstale":"2024-03-16T07:31:12.974089+0000","last_undegraded":"2024-03-16T07:31:12.974089+0000","last_fullsized":"2024-03-16T07:31:12.974089+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:02:57.834208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":20,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.970984+0000","last_change":"2024-03-16T07:30:57.875030+0000","last_active":"2024-03-16T07:31:12.970984+0000","last_peered":"2024-03-16T07:31:12.970984+0000","last_clean":"2024-03-16T07:31:12.970984+0000","last_became_active":"2024-03-16T07:30:57.874778+0000","last_became_peered":"2024-03-16T07:30:57.874778+0000","last_unstale":"2024-03-16T07:31:12.970984+0000","last_undegraded":"2024-03-16T07:31:12.970984+0000","last_fullsized":"2024-03-16T07:31:12.970984+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_clean_scrub_stamp":"2024-03-16T07:30:56.855668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:21:12.260369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.7","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.999392+0000","last_change":"2024-03-16T07:31:12.998435+0000","last_active":"2024-03-16T07:31:12.999392+0000","last_peered":"2024-03-16T07:31:12.999392+0000","last_clean":"2024-03-16T07:31:12.999392+0000","last_became_active":"2024-03-16T07:31:12.998195+0000","last_became_peered":"2024-03-16T07:31:12.998195+0000","last_unstale":"2024-03-16T07:31:12.999392+0000","last_undegraded":"2024-03-16T07:31:12.999392+0000","last_fullsized":"2024-03-16T07:31:12.999392+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_clean_scrub_stamp":"2024-03-16T07:31:11.948725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:32:27.894672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.959642+0000","last_change":"2024-03-16T07:31:11.973959+0000","last_active":"2024-03-16T07:31:12.959642+0000","last_peered":"2024-03-16T07:31:12.959642+0000","last_clean":"2024-03-16T07:31:12.959642+0000","last_became_active":"2024-03-16T07:31:11.973651+0000","last_became_peered":"2024-03-16T07:31:11.973651+0000","last_unstale":"2024-03-16T07:31:12.959642+0000","last_undegraded":"2024-03-16T07:31:12.959642+0000","last_fullsized":"2024-03-16T07:31:12.959642+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:10.945812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:10.945812+0000","last_clean_scrub_stamp":"2024-03-16T07:31:10.945812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:18:50.892526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":18,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.970901+0000","last_change":"2024-03-16T07:30:58.568858+0000","last_active":"2024-03-16T07:31:12.970901+0000","last_peered":"2024-03-16T07:31:12.970901+0000","last_clean":"2024-03-16T07:31:12.970901+0000","last_became_active":"2024-03-16T07:30:58.568307+0000","last_became_peered":"2024-03-16T07:30:58.568307+0000","last_unstale":"2024-03-16T07:31:12.970901+0000","last_undegraded":"2024-03-16T07:31:12.970901+0000","last_fullsized":"2024-03-16T07:31:12.970901+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:11:18.497707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":20,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.974261+0000","last_change":"2024-03-16T07:30:57.877529+0000","last_active":"2024-03-16T07:31:12.974261+0000","last_peered":"2024-03-16T07:31:12.974261+0000","last_clean":"2024-03-16T07:31:12.974261+0000","last_became_active":"2024-03-16T07:30:57.876528+0000","last_became_peered":"2024-03-16T07:30:57.876528+0000","last_unstale":"2024-03-16T07:31:12.974261+0000","last_undegraded":"2024-03-16T07:31:12.974261+0000","last_fullsized":"2024-03-16T07:31:12.974261+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_clean_scrub_stamp":"2024-03-16T07:30:56.855668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:21:55.125566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.984996+0000","last_change":"2024-03-16T07:31:12.982909+0000","last_active":"2024-03-16T07:31:12.984996+0000","last_peered":"2024-03-16T07:31:12.984996+0000","last_clean":"2024-03-16T07:31:12.984996+0000","last_became_active":"2024-03-16T07:31:12.982149+0000","last_became_peered":"2024-03-16T07:31:12.982149+0000","last_unstale":"2024-03-16T07:31:12.984996+0000","last_undegraded":"2024-03-16T07:31:12.984996+0000","last_fullsized":"2024-03-16T07:31:12.984996+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_clean_scrub_stamp":"2024-03-16T07:31:11.948725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:20:34.343105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.957636+0000","last_change":"2024-03-16T07:31:11.970154+0000","last_active":"2024-03-16T07:31:12.957636+0000","last_peered":"2024-03-16T07:31:12.957636+0000","last_clean":"2024-03-16T07:31:12.957636+0000","last_became_active":"2024-03-16T07:31:11.969914+0000","last_became_peered":"2024-03-16T07:31:11.969914+0000","last_unstale":"2024-03-16T07:31:12.957636+0000","last_undegraded":"2024-03-16T07:31:12.957636+0000","last_fullsized":"2024-03-16T07:31:12.957636+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:10.945812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:10.945812+0000","last_clean_scrub_stamp":"2024-03-16T07:31:10.945812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:54:44.055228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":18,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.958414+0000","last_change":"2024-03-16T07:30:58.577875+0000","last_active":"2024-03-16T07:31:12.958414+0000","last_peered":"2024-03-16T07:31:12.958414+0000","last_clean":"2024-03-16T07:31:12.958414+0000","last_became_active":"2024-03-16T07:30:58.577623+0000","last_became_peered":"2024-03-16T07:30:58.577623+0000","last_unstale":"2024-03-16T07:31:12.958414+0000","last_undegraded":"2024-03-16T07:31:12.958414+0000","last_fullsized":"2024-03-16T07:31:12.958414+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:07:43.960629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":20,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.977175+0000","last_change":"2024-03-16T07:30:57.875740+0000","last_active":"2024-03-16T07:31:12.977175+0000","last_peered":"2024-03-16T07:31:12.977175+0000","last_clean":"2024-03-16T07:31:12.977175+0000","last_became_active":"2024-03-16T07:30:57.875469+0000","last_became_peered":"2024-03-16T07:30:57.875469+0000","last_unstale":"2024-03-16T07:31:12.977175+0000","last_undegraded":"2024-03-16T07:31:12.977175+0000","last_fullsized":"2024-03-16T07:31:12.977175+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_clean_scrub_stamp":"2024-03-16T07:30:56.855668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:19:36.033244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.993739+0000","last_change":"2024-03-16T07:31:12.990937+0000","last_active":"2024-03-16T07:31:12.993739+0000","last_peered":"2024-03-16T07:31:12.993739+0000","last_clean":"2024-03-16T07:31:12.993739+0000","last_became_active":"2024-03-16T07:31:12.990421+0000","last_became_peered":"2024-03-16T07:31:12.990421+0000","last_unstale":"2024-03-16T07:31:12.993739+0000","last_undegraded":"2024-03-16T07:31:12.993739+0000","last_fullsized":"2024-03-16T07:31:12.993739+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_clean_scrub_stamp":"2024-03-16T07:31:11.948725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:28:29.449014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.956362+0000","last_change":"2024-03-16T07:31:11.975752+0000","last_active":"2024-03-16T07:31:12.956362+0000","last_peered":"2024-03-16T07:31:12.956362+0000","last_clean":"2024-03-16T07:31:12.956362+0000","last_became_active":"2024-03-16T07:31:11.975520+0000","last_became_peered":"2024-03-16T07:31:11.975520+0000","last_unstale":"2024-03-16T07:31:12.956362+0000","last_undegraded":"2024-03-16T07:31:12.956362+0000","last_fullsized":"2024-03-16T07:31:12.956362+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:10.945812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:10.945812+0000","last_clean_scrub_stamp":"2024-03-16T07:31:10.945812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:21:57.389765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":18,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.958484+0000","last_change":"2024-03-16T07:30:58.577788+0000","last_active":"2024-03-16T07:31:12.958484+0000","last_peered":"2024-03-16T07:31:12.958484+0000","last_clean":"2024-03-16T07:31:12.958484+0000","last_became_active":"2024-03-16T07:30:58.577528+0000","last_became_peered":"2024-03-16T07:30:58.577528+0000","last_unstale":"2024-03-16T07:31:12.958484+0000","last_undegraded":"2024-03-16T07:31:12.958484+0000","last_fullsized":"2024-03-16T07:31:12.958484+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:16:51.341129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":20,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.977418+0000","last_change":"2024-03-16T07:30:57.874192+0000","last_active":"2024-03-16T07:31:12.977418+0000","last_peered":"2024-03-16T07:31:12.977418+0000","last_clean":"2024-03-16T07:31:12.977418+0000","last_became_active":"2024-03-16T07:30:57.873741+0000","last_became_peered":"2024-03-16T07:30:57.873741+0000","last_unstale":"2024-03-16T07:31:12.977418+0000","last_undegraded":"2024-03-16T07:31:12.977418+0000","last_fullsized":"2024-03-16T07:31:12.977418+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_clean_scrub_stamp":"2024-03-16T07:30:56.855668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:45:10.776890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.987557+0000","last_change":"2024-03-16T07:31:12.981563+0000","last_active":"2024-03-16T07:31:12.987557+0000","last_peered":"2024-03-16T07:31:12.987557+0000","last_clean":"2024-03-16T07:31:12.987557+0000","last_became_active":"2024-03-16T07:31:12.980910+0000","last_became_peered":"2024-03-16T07:31:12.980910+0000","last_unstale":"2024-03-16T07:31:12.987557+0000","last_undegraded":"2024-03-16T07:31:12.987557+0000","last_fullsized":"2024-03-16T07:31:12.987557+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_clean_scrub_stamp":"2024-03-16T07:31:11.948725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:58:15.328373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.967810+0000","last_change":"2024-03-16T07:31:11.975341+0000","last_active":"2024-03-16T07:31:12.967810+0000","last_peered":"2024-03-16T07:31:12.967810+0000","last_clean":"2024-03-16T07:31:12.967810+0000","last_became_active":"2024-03-16T07:31:11.975110+0000","last_became_peered":"2024-03-16T07:31:11.975110+0000","last_unstale":"2024-03-16T07:31:12.967810+0000","last_undegraded":"2024-03-16T07:31:12.967810+0000","last_fullsized":"2024-03-16T07:31:12.967810+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:10.945812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:10.945812+0000","last_clean_scrub_stamp":"2024-03-16T07:31:10.945812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:34:37.823525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":18,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.956824+0000","last_change":"2024-03-16T07:30:58.573475+0000","last_active":"2024-03-16T07:31:12.956824+0000","last_peered":"2024-03-16T07:31:12.956824+0000","last_clean":"2024-03-16T07:31:12.956824+0000","last_became_active":"2024-03-16T07:30:58.572303+0000","last_became_peered":"2024-03-16T07:30:58.572303+0000","last_unstale":"2024-03-16T07:31:12.956824+0000","last_undegraded":"2024-03-16T07:31:12.956824+0000","last_fullsized":"2024-03-16T07:31:12.956824+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:11:18.497707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":20,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.976216+0000","last_change":"2024-03-16T07:30:57.875574+0000","last_active":"2024-03-16T07:31:12.976216+0000","last_peered":"2024-03-16T07:31:12.976216+0000","last_clean":"2024-03-16T07:31:12.976216+0000","last_became_active":"2024-03-16T07:30:57.875325+0000","last_became_peered":"2024-03-16T07:30:57.875325+0000","last_unstale":"2024-03-16T07:31:12.976216+0000","last_undegraded":"2024-03-16T07:31:12.976216+0000","last_fullsized":"2024-03-16T07:31:12.976216+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_clean_scrub_stamp":"2024-03-16T07:30:56.855668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:18:36.802383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.996944+0000","last_change":"2024-03-16T07:31:12.995271+0000","last_active":"2024-03-16T07:31:12.996944+0000","last_peered":"2024-03-16T07:31:12.996944+0000","last_clean":"2024-03-16T07:31:12.996944+0000","last_became_active":"2024-03-16T07:31:12.995012+0000","last_became_peered":"2024-03-16T07:31:12.995012+0000","last_unstale":"2024-03-16T07:31:12.996944+0000","last_undegraded":"2024-03-16T07:31:12.996944+0000","last_fullsized":"2024-03-16T07:31:12.996944+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_clean_scrub_stamp":"2024-03-16T07:31:11.948725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:08:11.150080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.964760+0000","last_change":"2024-03-16T07:31:11.968628+0000","last_active":"2024-03-16T07:31:12.964760+0000","last_peered":"2024-03-16T07:31:12.964760+0000","last_clean":"2024-03-16T07:31:12.964760+0000","last_became_active":"2024-03-16T07:31:11.968407+0000","last_became_peered":"2024-03-16T07:31:11.968407+0000","last_unstale":"2024-03-16T07:31:12.964760+0000","last_undegraded":"2024-03-16T07:31:12.964760+0000","last_fullsized":"2024-03-16T07:31:12.964760+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:10.945812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:10.945812+0000","last_clean_scrub_stamp":"2024-03-16T07:31:10.945812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:50:40.320000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":18,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.976132+0000","last_change":"2024-03-16T07:30:58.564067+0000","last_active":"2024-03-16T07:31:12.976132+0000","last_peered":"2024-03-16T07:31:12.976132+0000","last_clean":"2024-03-16T07:31:12.976132+0000","last_became_active":"2024-03-16T07:30:58.563838+0000","last_became_peered":"2024-03-16T07:30:58.563838+0000","last_unstale":"2024-03-16T07:31:12.976132+0000","last_undegraded":"2024-03-16T07:31:12.976132+0000","last_fullsized":"2024-03-16T07:31:12.976132+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:28:57.210229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":20,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.957377+0000","last_change":"2024-03-16T07:30:57.883190+0000","last_active":"2024-03-16T07:31:12.957377+0000","last_peered":"2024-03-16T07:31:12.957377+0000","last_clean":"2024-03-16T07:31:12.957377+0000","last_became_active":"2024-03-16T07:30:57.882925+0000","last_became_peered":"2024-03-16T07:30:57.882925+0000","last_unstale":"2024-03-16T07:31:12.957377+0000","last_undegraded":"2024-03-16T07:31:12.957377+0000","last_fullsized":"2024-03-16T07:31:12.957377+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_clean_scrub_stamp":"2024-03-16T07:30:56.855668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:06:50.998240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.982008+0000","last_change":"2024-03-16T07:31:12.975328+0000","last_active":"2024-03-16T07:31:12.982008+0000","last_peered":"2024-03-16T07:31:12.982008+0000","last_clean":"2024-03-16T07:31:12.982008+0000","last_became_active":"2024-03-16T07:31:12.974942+0000","last_became_peered":"2024-03-16T07:31:12.974942+0000","last_unstale":"2024-03-16T07:31:12.982008+0000","last_undegraded":"2024-03-16T07:31:12.982008+0000","last_fullsized":"2024-03-16T07:31:12.982008+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:11.948725+0000","last_clean_scrub_stamp":"2024-03-16T07:31:11.948725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:19:18.169851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.965362+0000","last_change":"2024-03-16T07:31:11.975936+0000","last_active":"2024-03-16T07:31:12.965362+0000","last_peered":"2024-03-16T07:31:12.965362+0000","last_clean":"2024-03-16T07:31:12.965362+0000","last_became_active":"2024-03-16T07:31:11.975509+0000","last_became_peered":"2024-03-16T07:31:11.975509+0000","last_unstale":"2024-03-16T07:31:12.965362+0000","last_undegraded":"2024-03-16T07:31:12.965362+0000","last_fullsized":"2024-03-16T07:31:12.965362+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:31:10.945812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:31:10.945812+0000","last_clean_scrub_stamp":"2024-03-16T07:31:10.945812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:13:49.110660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":18,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.971312+0000","last_change":"2024-03-16T07:30:58.561416+0000","last_active":"2024-03-16T07:31:12.971312+0000","last_peered":"2024-03-16T07:31:12.971312+0000","last_clean":"2024-03-16T07:31:12.971312+0000","last_became_active":"2024-03-16T07:30:58.561163+0000","last_became_peered":"2024-03-16T07:30:58.561163+0000","last_unstale":"2024-03-16T07:31:12.971312+0000","last_undegraded":"2024-03-16T07:31:12.971312+0000","last_fullsized":"2024-03-16T07:31:12.971312+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:57.856614+0000","last_clean_scrub_stamp":"2024-03-16T07:30:57.856614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:45:50.755510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.15","version":"118'3","reported_seq":23,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.979351+0000","last_change":"2024-03-16T07:30:57.875401+0000","last_active":"2024-03-16T07:31:12.979351+0000","last_peered":"2024-03-16T07:31:12.979351+0000","last_clean":"2024-03-16T07:31:12.979351+0000","last_became_active":"2024-03-16T07:30:57.875032+0000","last_became_peered":"2024-03-16T07:30:57.875032+0000","last_unstale":"2024-03-16T07:31:12.979351+0000","last_undegraded":"2024-03-16T07:31:12.979351+0000","last_fullsized":"2024-03-16T07:31:12.979351+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:30:56.855668+0000","last_clean_scrub_stamp":"2024-03-16T07:30:56.855668+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:39:09.736811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"103'174","reported_seq":620,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-03-16T07:31:12.971518+0000","last_change":"2024-03-16T07:24:31.650537+0000","last_active":"2024-03-16T07:31:12.971518+0000","last_peered":"2024-03-16T07:31:12.971518+0000","last_clean":"2024-03-16T07:31:12.971518+0000","last_became_active":"2024-03-16T07:24:31.649574+0000","last_became_peered":"2024-03-16T07:24:31.649574+0000","last_unstale":"2024-03-16T07:31:12.971518+0000","last_undegraded":"2024-03-16T07:31:12.971518+0000","last_fullsized":"2024-03-16T07:31:12.971518+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:29.719970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:29.719970+0000","last_clean_scrub_stamp":"2024-03-16T07:24:29.719970+0000","objects_scrubbed":0,"log_size":174,"log_dups_size":0,"ondisk_log_size":174,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:31:35.774554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":778,"num_read_kb":1533,"num_write":277,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":23,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":22,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":3},{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":20,"num_pg":32,"stat_sum":{"num_bytes":4107,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":8214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":778,"num_read_kb":1533,"num_write":277,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":174,"ondisk_log_size":174,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738447,"num_pgs":132,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":36600,"kb_used_data":1260,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":104821000,"statfs":{"total":107374182400,"available":107336704000,"internally_reserved":0,"allocated":1290240,"data_stored":510670,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738447,"num_pgs":63,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":37176,"kb_used_data":1836,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":104820424,"statfs":{"total":107374182400,"available":107336114176,"internally_reserved":0,"allocated":1880064,"data_stored":1097341,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738447,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":37168,"kb_used_data":1828,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":104820432,"statfs":{"total":107374182400,"available":107336122368,"internally_reserved":0,"allocated":1871872,"data_stored":1098866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":3455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":3983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-16T07:31:17.448 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-03-16T07:31:17.448 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T07:31:17.970 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:31:17.970 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":87,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5957,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6827/2832753094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":2832753094},{"type":"v1","addr":"172.21.15.49:6827","nonce":2832753094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":78},{"gid":5961,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6829/3236120377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":3236120377},{"type":"v1","addr":"172.21.15.49:6829","nonce":3236120377}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":78},{"gid":5964,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6831/1238434429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":1238434429},{"type":"v1","addr":"172.21.15.49:6831","nonce":1238434429}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":78}],"filesystems":[{"mdsmap":{"epoch":81,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-16T07:30:58.238420+0000","modified":"2024-03-16T07:31:00.495716+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5968},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5968":{"gid":5968,"name":"d","rank":0,"incarnation":79,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6835/790210824","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":790210824},{"type":"v1","addr":"172.21.15.49:6835","nonce":790210824}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5968,"qdb_cluster":[5968]},"id":10},{"mdsmap":{"epoch":87,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-16T07:31:12.498747+0000","modified":"2024-03-16T07:31:15.331790+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5965},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5965":{"gid":5965,"name":"c","rank":0,"incarnation":83,"state":"up:active","state_seq":6,"addr":"172.21.15.49:6833/4146414383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":4146414383},{"type":"v1","addr":"172.21.15.49:6833","nonce":4146414383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"backup_fs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5965,"qdb_cluster":[5965]},"id":11}]} 2024-03-16T07:31:17.970 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 87 2024-03-16T07:31:18.486 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 87, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-03-16T07:31:12.498747+0000', 'modified': '2024-03-16T07:31:15.331790+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5965}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5965': {'gid': 5965, 'name': 'c', 'rank': 0, 'incarnation': 83, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.49:6833/4146414383', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.49:6832', 'nonce': 4146414383}, {'type': 'v1', 'addr': '172.21.15.49:6833', 'nonce': 4146414383}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [23], 'metadata_pool': 22, 'enabled': True, 'fs_name': 'backup_fs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5965, 'qdb_cluster': [5965]} 2024-03-16T07:31:18.486 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-03-16T07:31:18.486 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-03-16T07:31:18.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-16T07:31:18.638+0000 7f3746ffd640 0 client.6100 ms_handle_reset on v2:172.21.15.49:6832/4146414383 2024-03-16T07:31:18.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-16T07:31:18.661+0000 7f3746ffd640 0 client.6102 ms_handle_reset on v2:172.21.15.49:6832/4146414383 2024-03-16T07:31:18.660 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-03-16T07:31:18.660 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_fsid": "f91af061-9eac-4793-87fa-8d27ae3d242f", 2024-03-16T07:31:18.661 INFO:teuthology.orchestra.run.smithi049.stdout: "whoami": 0, 2024-03-16T07:31:18.661 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 5965, 2024-03-16T07:31:18.661 INFO:teuthology.orchestra.run.smithi049.stdout: "want_state": "up:active", 2024-03-16T07:31:18.661 INFO:teuthology.orchestra.run.smithi049.stdout: "state": "up:active", 2024-03-16T07:31:18.661 INFO:teuthology.orchestra.run.smithi049.stdout: "fs_name": "backup_fs", 2024-03-16T07:31:18.661 INFO:teuthology.orchestra.run.smithi049.stdout: "rank_uptime": 5.7024940170000002, 2024-03-16T07:31:18.661 INFO:teuthology.orchestra.run.smithi049.stdout: "mdsmap_epoch": 87, 2024-03-16T07:31:18.661 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch": 123, 2024-03-16T07:31:18.661 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch_barrier": 123, 2024-03-16T07:31:18.661 INFO:teuthology.orchestra.run.smithi049.stdout: "uptime": 25.104460469999999 2024-03-16T07:31:18.661 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-03-16T07:31:18.672 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable mirroring 2024-03-16T07:31:19.998 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-03-16T07:31:19.998 DEBUG:teuthology.orchestra.run.smithi049:counter dump for fs: cephfs> ceph --admin-daemon /var/run/ceph/cephfs-mirror.asok counter dump 2024-03-16T07:31:20.129 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-03-16T07:31:20.129 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker": [ 2024-03-16T07:31:20.129 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:31:20.129 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:31:20.130 INFO:teuthology.orchestra.run.smithi049.stdout: "id": "0" 2024-03-16T07:31:20.130 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:31:20.130 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:31:20.130 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_ready_timeouts": 0, 2024-03-16T07:31:20.130 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_idle_timeouts": 0 2024-03-16T07:31:20.131 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:31:20.131 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:31:20.131 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:31:20.131 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:31:20.131 INFO:teuthology.orchestra.run.smithi049.stdout: "id": "1" 2024-03-16T07:31:20.131 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:31:20.132 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:31:20.132 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_ready_timeouts": 0, 2024-03-16T07:31:20.132 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_idle_timeouts": 0 2024-03-16T07:31:20.132 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:31:20.132 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:31:20.133 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:31:20.133 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:31:20.133 INFO:teuthology.orchestra.run.smithi049.stdout: "id": "2" 2024-03-16T07:31:20.133 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:31:20.133 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:31:20.133 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_ready_timeouts": 0, 2024-03-16T07:31:20.134 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_idle_timeouts": 0 2024-03-16T07:31:20.134 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:31:20.134 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:31:20.134 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:31:20.134 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-0": [ 2024-03-16T07:31:20.134 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:31:20.134 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:31:20.134 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:31:20.134 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 8, 2024-03-16T07:31:20.134 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 84, 2024-03-16T07:31:20.134 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 1152, 2024-03-16T07:31:20.134 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 649584, 2024-03-16T07:31:20.134 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 17, 2024-03-16T07:31:20.135 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 4, 2024-03-16T07:31:20.135 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 0.274121516, 2024-03-16T07:31:20.135 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.088415543, 2024-03-16T07:31:20.135 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 0.148279879, 2024-03-16T07:31:20.135 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-03-16T07:31:20.135 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T07:31:20.135 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 76, 2024-03-16T07:31:20.135 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.164316378, 2024-03-16T07:31:20.135 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.002162057 2024-03-16T07:31:20.135 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:31:20.135 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-03-16T07:31:20.135 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:31:20.135 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:31:20.135 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:31:20.136 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:31:20.136 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 1152, 2024-03-16T07:31:20.136 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 649584 2024-03-16T07:31:20.136 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:31:20.136 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:31:20.136 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:31:20.136 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-1": [ 2024-03-16T07:31:20.136 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:31:20.136 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:31:20.136 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:31:20.136 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 83, 2024-03-16T07:31:20.137 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 5, 2024-03-16T07:31:20.137 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 342448, 2024-03-16T07:31:20.137 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 1136, 2024-03-16T07:31:20.137 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 3, 2024-03-16T07:31:20.137 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 0, 2024-03-16T07:31:20.137 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 0.430798117, 2024-03-16T07:31:20.137 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.004251757, 2024-03-16T07:31:20.137 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 0.278804054, 2024-03-16T07:31:20.137 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.132770044, 2024-03-16T07:31:20.137 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T07:31:20.138 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 5, 2024-03-16T07:31:20.138 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.054797003, 2024-03-16T07:31:20.138 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.010959400 2024-03-16T07:31:20.138 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:31:20.138 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-03-16T07:31:20.138 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:31:20.138 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:31:20.138 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:31:20.138 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:31:20.138 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 342448, 2024-03-16T07:31:20.138 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 1136 2024-03-16T07:31:20.138 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:31:20.138 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:31:20.138 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:31:20.138 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-2": [ 2024-03-16T07:31:20.139 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:31:20.139 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:31:20.139 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:31:20.139 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 48, 2024-03-16T07:31:20.139 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 8, 2024-03-16T07:31:20.139 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 1783456, 2024-03-16T07:31:20.139 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 1600, 2024-03-16T07:31:20.139 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 2, 2024-03-16T07:31:20.139 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 1, 2024-03-16T07:31:20.139 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 0.911208382, 2024-03-16T07:31:20.139 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.007124998, 2024-03-16T07:31:20.139 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 1.751871329, 2024-03-16T07:31:20.139 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-03-16T07:31:20.139 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T07:31:20.139 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 8, 2024-03-16T07:31:20.139 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.161009804, 2024-03-16T07:31:20.140 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.020126225 2024-03-16T07:31:20.140 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:31:20.140 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-03-16T07:31:20.140 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:31:20.140 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:31:20.140 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:31:20.140 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:31:20.140 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 1783456, 2024-03-16T07:31:20.140 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 1600 2024-03-16T07:31:20.140 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:31:20.140 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:31:20.140 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:31:20.140 INFO:teuthology.orchestra.run.smithi049.stdout: "cct": [ 2024-03-16T07:31:20.140 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:31:20.141 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:31:20.141 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:31:20.141 INFO:teuthology.orchestra.run.smithi049.stdout: "total_workers": 0, 2024-03-16T07:31:20.141 INFO:teuthology.orchestra.run.smithi049.stdout: "unhealthy_workers": 0 2024-03-16T07:31:20.141 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:31:20.141 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:31:20.141 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:31:20.141 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs_mirror": [ 2024-03-16T07:31:20.141 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:31:20.141 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:31:20.141 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:31:20.141 INFO:teuthology.orchestra.run.smithi049.stdout: "mirrored_filesystems": 0, 2024-03-16T07:31:20.141 INFO:teuthology.orchestra.run.smithi049.stdout: "mirror_enable_failures": 0 2024-03-16T07:31:20.141 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:31:20.141 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:31:20.141 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:31:20.142 INFO:teuthology.orchestra.run.smithi049.stdout: "mempool": [ 2024-03-16T07:31:20.142 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:31:20.142 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:31:20.142 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:31:20.142 INFO:teuthology.orchestra.run.smithi049.stdout: "bloom_filter_bytes": 0, 2024-03-16T07:31:20.142 INFO:teuthology.orchestra.run.smithi049.stdout: "bloom_filter_items": 0, 2024-03-16T07:31:20.142 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_alloc_bytes": 0, 2024-03-16T07:31:20.142 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_alloc_items": 0, 2024-03-16T07:31:20.142 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_data_bytes": 0, 2024-03-16T07:31:20.142 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_data_items": 0, 2024-03-16T07:31:20.142 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_onode_bytes": 0, 2024-03-16T07:31:20.142 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_onode_items": 0, 2024-03-16T07:31:20.142 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_meta_bytes": 0, 2024-03-16T07:31:20.142 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_meta_items": 0, 2024-03-16T07:31:20.142 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_other_bytes": 0, 2024-03-16T07:31:20.143 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_other_items": 0, 2024-03-16T07:31:20.143 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_buffer_bytes": 0, 2024-03-16T07:31:20.143 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_buffer_items": 0, 2024-03-16T07:31:20.143 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_extent_bytes": 0, 2024-03-16T07:31:20.143 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_extent_items": 0, 2024-03-16T07:31:20.143 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_blob_bytes": 0, 2024-03-16T07:31:20.143 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_blob_items": 0, 2024-03-16T07:31:20.143 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_shared_blob_bytes": 0, 2024-03-16T07:31:20.143 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_shared_blob_items": 0, 2024-03-16T07:31:20.143 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_inline_bl_bytes": 0, 2024-03-16T07:31:20.143 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_inline_bl_items": 0, 2024-03-16T07:31:20.143 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_fsck_bytes": 0, 2024-03-16T07:31:20.143 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_fsck_items": 0, 2024-03-16T07:31:20.143 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_txc_bytes": 0, 2024-03-16T07:31:20.143 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_txc_items": 0, 2024-03-16T07:31:20.144 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_deferred_bytes": 0, 2024-03-16T07:31:20.144 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_deferred_items": 0, 2024-03-16T07:31:20.144 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_bytes": 0, 2024-03-16T07:31:20.144 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_items": 0, 2024-03-16T07:31:20.144 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_bytes": 0, 2024-03-16T07:31:20.144 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_items": 0, 2024-03-16T07:31:20.144 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_reader_bytes": 0, 2024-03-16T07:31:20.144 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_reader_items": 0, 2024-03-16T07:31:20.144 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_writer_bytes": 0, 2024-03-16T07:31:20.144 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_writer_items": 0, 2024-03-16T07:31:20.144 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_anon_bytes": 149234, 2024-03-16T07:31:20.144 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_anon_items": 26, 2024-03-16T07:31:20.144 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_meta_bytes": 0, 2024-03-16T07:31:20.144 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_meta_items": 0, 2024-03-16T07:31:20.144 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_bytes": 0, 2024-03-16T07:31:20.145 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_items": 0, 2024-03-16T07:31:20.145 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_mapbl_bytes": 0, 2024-03-16T07:31:20.145 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_mapbl_items": 0, 2024-03-16T07:31:20.145 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pglog_bytes": 0, 2024-03-16T07:31:20.145 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pglog_items": 0, 2024-03-16T07:31:20.145 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_bytes": 4824, 2024-03-16T07:31:20.145 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_items": 52, 2024-03-16T07:31:20.145 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_mapping_bytes": 0, 2024-03-16T07:31:20.145 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_mapping_items": 0, 2024-03-16T07:31:20.145 INFO:teuthology.orchestra.run.smithi049.stdout: "pgmap_bytes": 0, 2024-03-16T07:31:20.145 INFO:teuthology.orchestra.run.smithi049.stdout: "pgmap_items": 0, 2024-03-16T07:31:20.145 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_co_bytes": 0, 2024-03-16T07:31:20.145 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_co_items": 0, 2024-03-16T07:31:20.145 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_1_bytes": 0, 2024-03-16T07:31:20.146 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_1_items": 0, 2024-03-16T07:31:20.146 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_2_bytes": 0, 2024-03-16T07:31:20.146 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_2_items": 0 2024-03-16T07:31:20.146 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:31:20.146 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:31:20.146 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:31:20.146 INFO:teuthology.orchestra.run.smithi049.stdout: "objecter": [ 2024-03-16T07:31:20.146 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:31:20.146 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:31:20.146 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:31:20.146 INFO:teuthology.orchestra.run.smithi049.stdout: "op_active": 0, 2024-03-16T07:31:20.146 INFO:teuthology.orchestra.run.smithi049.stdout: "op_laggy": 0, 2024-03-16T07:31:20.146 INFO:teuthology.orchestra.run.smithi049.stdout: "op_send": 0, 2024-03-16T07:31:20.146 INFO:teuthology.orchestra.run.smithi049.stdout: "op_send_bytes": 0, 2024-03-16T07:31:20.146 INFO:teuthology.orchestra.run.smithi049.stdout: "op_resend": 0, 2024-03-16T07:31:20.147 INFO:teuthology.orchestra.run.smithi049.stdout: "op_reply": 0, 2024-03-16T07:31:20.147 INFO:teuthology.orchestra.run.smithi049.stdout: "op_latency": { 2024-03-16T07:31:20.147 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:31:20.147 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:31:20.147 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:31:20.147 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:31:20.147 INFO:teuthology.orchestra.run.smithi049.stdout: "op_inflight": 0, 2024-03-16T07:31:20.147 INFO:teuthology.orchestra.run.smithi049.stdout: "oplen_avg": { 2024-03-16T07:31:20.147 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:31:20.147 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0 2024-03-16T07:31:20.147 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:31:20.147 INFO:teuthology.orchestra.run.smithi049.stdout: "op": 0, 2024-03-16T07:31:20.147 INFO:teuthology.orchestra.run.smithi049.stdout: "op_r": 0, 2024-03-16T07:31:20.147 INFO:teuthology.orchestra.run.smithi049.stdout: "op_w": 0, 2024-03-16T07:31:20.148 INFO:teuthology.orchestra.run.smithi049.stdout: "op_rmw": 0, 2024-03-16T07:31:20.148 INFO:teuthology.orchestra.run.smithi049.stdout: "op_pg": 0, 2024-03-16T07:31:20.148 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_stat": 0, 2024-03-16T07:31:20.148 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_create": 0, 2024-03-16T07:31:20.148 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_read": 0, 2024-03-16T07:31:20.148 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_write": 0, 2024-03-16T07:31:20.148 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_writefull": 0, 2024-03-16T07:31:20.148 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_writesame": 0, 2024-03-16T07:31:20.148 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_append": 0, 2024-03-16T07:31:20.148 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_zero": 0, 2024-03-16T07:31:20.148 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_truncate": 0, 2024-03-16T07:31:20.148 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_delete": 0, 2024-03-16T07:31:20.148 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_mapext": 0, 2024-03-16T07:31:20.148 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_sparse_read": 0, 2024-03-16T07:31:20.149 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_clonerange": 0, 2024-03-16T07:31:20.149 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_getxattr": 0, 2024-03-16T07:31:20.149 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_setxattr": 0, 2024-03-16T07:31:20.149 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_cmpxattr": 0, 2024-03-16T07:31:20.149 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_rmxattr": 0, 2024-03-16T07:31:20.149 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_resetxattrs": 0, 2024-03-16T07:31:20.149 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_call": 0, 2024-03-16T07:31:20.149 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_watch": 0, 2024-03-16T07:31:20.149 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_notify": 0, 2024-03-16T07:31:20.149 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_src_cmpxattr": 0, 2024-03-16T07:31:20.149 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_pgls": 0, 2024-03-16T07:31:20.149 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_pgls_filter": 0, 2024-03-16T07:31:20.149 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_other": 0, 2024-03-16T07:31:20.150 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_active": 0, 2024-03-16T07:31:20.150 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_send": 0, 2024-03-16T07:31:20.150 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_resend": 0, 2024-03-16T07:31:20.150 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_ping": 0, 2024-03-16T07:31:20.150 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_active": 0, 2024-03-16T07:31:20.150 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_send": 0, 2024-03-16T07:31:20.150 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_resend": 0, 2024-03-16T07:31:20.150 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_active": 0, 2024-03-16T07:31:20.150 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_send": 0, 2024-03-16T07:31:20.150 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_resend": 0, 2024-03-16T07:31:20.150 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_active": 0, 2024-03-16T07:31:20.150 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_send": 0, 2024-03-16T07:31:20.150 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_resend": 0, 2024-03-16T07:31:20.150 INFO:teuthology.orchestra.run.smithi049.stdout: "command_active": 0, 2024-03-16T07:31:20.151 INFO:teuthology.orchestra.run.smithi049.stdout: "command_send": 0, 2024-03-16T07:31:20.151 INFO:teuthology.orchestra.run.smithi049.stdout: "command_resend": 0, 2024-03-16T07:31:20.151 INFO:teuthology.orchestra.run.smithi049.stdout: "map_epoch": 0, 2024-03-16T07:31:20.151 INFO:teuthology.orchestra.run.smithi049.stdout: "map_full": 0, 2024-03-16T07:31:20.151 INFO:teuthology.orchestra.run.smithi049.stdout: "map_inc": 0, 2024-03-16T07:31:20.151 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_sessions": 0, 2024-03-16T07:31:20.151 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_session_open": 0, 2024-03-16T07:31:20.151 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_session_close": 0, 2024-03-16T07:31:20.151 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_laggy": 0, 2024-03-16T07:31:20.151 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_wr": 0, 2024-03-16T07:31:20.151 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_rd": 0, 2024-03-16T07:31:20.151 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_del": 0 2024-03-16T07:31:20.151 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:31:20.151 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:31:20.151 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:31:20.151 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-msgr_dispatch_throttler-client": [ 2024-03-16T07:31:20.152 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:31:20.152 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:31:20.152 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:31:20.152 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:31:20.152 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-03-16T07:31:20.152 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:31:20.152 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 83, 2024-03-16T07:31:20.152 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 331181, 2024-03-16T07:31:20.152 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:31:20.152 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 83, 2024-03-16T07:31:20.152 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:31:20.152 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:31:20.152 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 83, 2024-03-16T07:31:20.153 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 331181, 2024-03-16T07:31:20.153 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:31:20.153 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:31:20.153 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:31:20.153 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:31:20.153 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:31:20.153 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:31:20.153 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:31:20.153 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:31:20.153 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-msgr_dispatch_throttler-radosclient": [ 2024-03-16T07:31:20.153 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:31:20.153 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:31:20.153 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:31:20.154 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:31:20.154 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-03-16T07:31:20.154 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:31:20.154 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 53, 2024-03-16T07:31:20.154 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 1776545, 2024-03-16T07:31:20.154 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:31:20.154 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 53, 2024-03-16T07:31:20.154 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:31:20.154 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:31:20.154 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 53, 2024-03-16T07:31:20.154 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 1776545, 2024-03-16T07:31:20.155 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:31:20.155 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:31:20.155 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:31:20.155 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:31:20.155 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:31:20.155 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:31:20.155 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:31:20.155 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:31:20.155 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-objecter_bytes": [ 2024-03-16T07:31:20.155 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:31:20.155 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:31:20.155 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:31:20.155 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:31:20.156 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-03-16T07:31:20.156 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:31:20.156 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 0, 2024-03-16T07:31:20.156 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 0, 2024-03-16T07:31:20.156 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:31:20.156 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 0, 2024-03-16T07:31:20.156 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:31:20.156 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:31:20.156 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 0, 2024-03-16T07:31:20.156 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 0, 2024-03-16T07:31:20.156 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:31:20.156 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:31:20.156 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:31:20.156 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:31:20.156 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:31:20.157 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:31:20.157 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:31:20.157 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:31:20.157 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-objecter_ops": [ 2024-03-16T07:31:20.157 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:31:20.157 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:31:20.157 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:31:20.157 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:31:20.157 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 1024, 2024-03-16T07:31:20.157 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:31:20.157 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 0, 2024-03-16T07:31:20.157 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 0, 2024-03-16T07:31:20.158 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:31:20.158 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 0, 2024-03-16T07:31:20.158 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:31:20.158 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:31:20.158 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 0, 2024-03-16T07:31:20.158 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 0, 2024-03-16T07:31:20.158 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:31:20.158 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:31:20.158 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:31:20.158 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:31:20.159 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:31:20.159 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:31:20.159 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:31:20.159 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2024-03-16T07:31:20.159 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-03-16T07:31:20.160 DEBUG:tasks.cephfs.test_mirroring:command returned={ "AsyncMessenger::Worker": [ { "labels": { "id": "0" }, "counters": { "msgr_connection_ready_timeouts": 0, "msgr_connection_idle_timeouts": 0 } }, { "labels": { "id": "1" }, "counters": { "msgr_connection_ready_timeouts": 0, "msgr_connection_idle_timeouts": 0 } }, { "labels": { "id": "2" }, "counters": { "msgr_connection_ready_timeouts": 0, "msgr_connection_idle_timeouts": 0 } } ], "AsyncMessenger::Worker-0": [ { "labels": {}, "counters": { "msgr_recv_messages": 8, "msgr_send_messages": 84, "msgr_recv_bytes": 1152, "msgr_send_bytes": 649584, "msgr_created_connections": 17, "msgr_active_connections": 4, "msgr_running_total_time": 0.274121516, "msgr_running_send_time": 0.088415543, "msgr_running_recv_time": 0.148279879, "msgr_running_fast_dispatch_time": 0.000000000, "msgr_send_messages_queue_lat": { "avgcount": 76, "sum": 0.164316378, "avgtime": 0.002162057 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "msgr_recv_encrypted_bytes": 1152, "msgr_send_encrypted_bytes": 649584 } } ], "AsyncMessenger::Worker-1": [ { "labels": {}, "counters": { "msgr_recv_messages": 83, "msgr_send_messages": 5, "msgr_recv_bytes": 342448, "msgr_send_bytes": 1136, "msgr_created_connections": 3, "msgr_active_connections": 0, "msgr_running_total_time": 0.430798117, "msgr_running_send_time": 0.004251757, "msgr_running_recv_time": 0.278804054, "msgr_running_fast_dispatch_time": 0.132770044, "msgr_send_messages_queue_lat": { "avgcount": 5, "sum": 0.054797003, "avgtime": 0.010959400 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "msgr_recv_encrypted_bytes": 342448, "msgr_send_encrypted_bytes": 1136 } } ], "AsyncMessenger::Worker-2": [ { "labels": {}, "counters": { "msgr_recv_messages": 48, "msgr_send_messages": 8, "msgr_recv_bytes": 1783456, "msgr_send_bytes": 1600, "msgr_created_connections": 2, "msgr_active_connections": 1, "msgr_running_total_time": 0.911208382, "msgr_running_send_time": 0.007124998, "msgr_running_recv_time": 1.751871329, "msgr_running_fast_dispatch_time": 0.000000000, "msgr_send_messages_queue_lat": { "avgcount": 8, "sum": 0.161009804, "avgtime": 0.020126225 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "msgr_recv_encrypted_bytes": 1783456, "msgr_send_encrypted_bytes": 1600 } } ], "cct": [ { "labels": {}, "counters": { "total_workers": 0, "unhealthy_workers": 0 } } ], "cephfs_mirror": [ { "labels": {}, "counters": { "mirrored_filesystems": 0, "mirror_enable_failures": 0 } } ], "mempool": [ { "labels": {}, "counters": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_cache_buffer_bytes": 0, "bluestore_cache_buffer_items": 0, "bluestore_extent_bytes": 0, "bluestore_extent_items": 0, "bluestore_blob_bytes": 0, "bluestore_blob_items": 0, "bluestore_shared_blob_bytes": 0, "bluestore_shared_blob_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_items": 0, "bluefs_bytes": 0, "bluefs_items": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "buffer_anon_bytes": 149234, "buffer_anon_items": 26, "buffer_meta_bytes": 0, "buffer_meta_items": 0, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 4824, "osdmap_items": 52, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "mds_co_bytes": 0, "mds_co_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 } } ], "objecter": [ { "labels": {}, "counters": { "op_active": 0, "op_laggy": 0, "op_send": 0, "op_send_bytes": 0, "op_resend": 0, "op_reply": 0, "op_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "op_inflight": 0, "oplen_avg": { "avgcount": 0, "sum": 0 }, "op": 0, "op_r": 0, "op_w": 0, "op_rmw": 0, "op_pg": 0, "osdop_stat": 0, "osdop_create": 0, "osdop_read": 0, "osdop_write": 0, "osdop_writefull": 0, "osdop_writesame": 0, "osdop_append": 0, "osdop_zero": 0, "osdop_truncate": 0, "osdop_delete": 0, "osdop_mapext": 0, "osdop_sparse_read": 0, "osdop_clonerange": 0, "osdop_getxattr": 0, "osdop_setxattr": 0, "osdop_cmpxattr": 0, "osdop_rmxattr": 0, "osdop_resetxattrs": 0, "osdop_call": 0, "osdop_watch": 0, "osdop_notify": 0, "osdop_src_cmpxattr": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_other": 0, "linger_active": 0, "linger_send": 0, "linger_resend": 0, "linger_ping": 0, "poolop_active": 0, "poolop_send": 0, "poolop_resend": 0, "poolstat_active": 0, "poolstat_send": 0, "poolstat_resend": 0, "statfs_active": 0, "statfs_send": 0, "statfs_resend": 0, "command_active": 0, "command_send": 0, "command_resend": 0, "map_epoch": 0, "map_full": 0, "map_inc": 0, "osd_sessions": 0, "osd_session_open": 0, "osd_session_close": 0, "osd_laggy": 0, "omap_wr": 0, "omap_rd": 0, "omap_del": 0 } } ], "throttle-msgr_dispatch_throttler-client": [ { "labels": {}, "counters": { "val": 0, "max": 104857600, "get_started": 0, "get": 83, "get_sum": 331181, "get_or_fail_fail": 0, "get_or_fail_success": 83, "take": 0, "take_sum": 0, "put": 83, "put_sum": 331181, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ], "throttle-msgr_dispatch_throttler-radosclient": [ { "labels": {}, "counters": { "val": 0, "max": 104857600, "get_started": 0, "get": 53, "get_sum": 1776545, "get_or_fail_fail": 0, "get_or_fail_success": 53, "take": 0, "take_sum": 0, "put": 53, "put_sum": 1776545, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ], "throttle-objecter_bytes": [ { "labels": {}, "counters": { "val": 0, "max": 104857600, "get_started": 0, "get": 0, "get_sum": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "take": 0, "take_sum": 0, "put": 0, "put_sum": 0, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ], "throttle-objecter_ops": [ { "labels": {}, "counters": { "val": 0, "max": 1024, "get_started": 0, "get": 0, "get_sum": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "take": 0, "take_sum": 0, "put": 0, "put_sum": 0, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ] } 2024-03-16T07:31:20.160 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snapshot mirror enable cephfs 2024-03-16T07:31:20.431 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:31:20.431+0000 7f445cd53040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-16T07:31:20.480 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:31:20.481+0000 7f445cd53040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-16T07:31:20.887 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:31:20.888+0000 7f445cd53040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-16T07:31:20.934 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:31:20.934+0000 7f445cd53040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-16T07:31:20.981 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:31:20.981+0000 7f445cd53040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-16T07:31:21.072 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:31:21.073+0000 7f445cd53040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-16T07:31:21.148 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:31:21.149+0000 7f445cd53040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-16T07:31:21.366 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:31:21.367+0000 7f445cd53040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-16T07:31:21.444 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:31:21.445+0000 7f445cd53040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-16T07:31:21.488 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:31:21.489+0000 7f445cd53040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-16T07:31:21.540 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:31:21.541+0000 7f445cd53040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-16T07:31:21.586 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:31:21.586+0000 7f445cd53040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-16T07:31:21.984 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:31:21.985+0000 7f445cd53040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-16T07:31:22.211 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:31:22.212+0000 7f445cd53040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-16T07:31:22.380 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:31:22.380+0000 7f445cd53040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-16T07:31:22.458 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:31:22.458+0000 7f445cd53040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-16T07:31:22.642 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:31:22.643+0000 7f445cd53040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-16T07:31:22.757 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:31:22.757+0000 7f445cd53040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-16T07:31:22.918 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:31:22.918+0000 7f445cd53040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-16T07:31:22.962 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:31:22.963+0000 7f445cd53040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-16T07:31:23.088 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:31:23.088+0000 7f445cd53040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-16T07:31:23.749 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:31:23.748+0000 7f445cd53040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-16T07:31:24.030 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:31:24.030+0000 7f445cd53040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-16T07:31:24.081 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:31:24.082+0000 7f445cd53040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-16T07:31:24.202 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:31:24.203+0000 7f445cd53040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-16T07:31:24.316 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:31:24.316+0000 7f43dd09a640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:31:24.316 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:31:24.316+0000 7f43dd09a640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:31:24.316 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:31:24.316+0000 7f43dd09a640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:31:24.316 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:31:24.316+0000 7f43dd09a640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:31:24.316 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:31:24.316+0000 7f43dd09a640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:31:24.316 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:31:24.316+0000 7f43da094640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:31:24.316 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:31:24.316+0000 7f43da094640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:31:24.316 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:31:24.316+0000 7f43da094640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:31:24.316 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:31:24.316+0000 7f43da094640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:31:24.316 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:31:24.316+0000 7f43da094640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:31:24.336 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:31:24.337+0000 7f43da094640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:31:24.336 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:31:24.337+0000 7f43da094640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:31:24.336 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:31:24.337+0000 7f43da094640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:31:24.336 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:31:24.337+0000 7f43da094640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:31:24.336 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:31:24.337+0000 7f43da094640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:31:24.337 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:31:24.338+0000 7f43dd09a640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:31:24.337 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:31:24.338+0000 7f43dd09a640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:31:24.337 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:31:24.338+0000 7f43dd09a640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:31:24.338 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:31:24.338+0000 7f43dd09a640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:31:24.338 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:31:24.338+0000 7f43dd09a640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:31:26.228 INFO:teuthology.orchestra.run.smithi049.stdout:{} 2024-03-16T07:31:36.247 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-03-16T07:31:36.247 DEBUG:teuthology.orchestra.run.smithi049:mirror status for fs: cephfs> ceph --admin-daemon /var/run/ceph/cephfs-mirror.asok fs mirror status cephfs@10 2024-03-16T07:31:36.344 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-03-16T07:31:36.344 INFO:teuthology.orchestra.run.smithi049.stdout: "rados_inst": "172.21.15.49:0/1607336277", 2024-03-16T07:31:36.344 INFO:teuthology.orchestra.run.smithi049.stdout: "peers": {}, 2024-03-16T07:31:36.344 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_dirs": { 2024-03-16T07:31:36.344 INFO:teuthology.orchestra.run.smithi049.stdout: "dir_count": 0 2024-03-16T07:31:36.344 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:31:36.344 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-03-16T07:31:36.351 DEBUG:tasks.cephfs.test_mirroring:command returned={ "rados_inst": "172.21.15.49:0/1607336277", "peers": {}, "snap_dirs": { "dir_count": 0 } } 2024-03-16T07:31:36.351 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-03-16T07:31:36.352 DEBUG:teuthology.orchestra.run.smithi049:counter dump for fs: cephfs> ceph --admin-daemon /var/run/ceph/cephfs-mirror.asok counter dump 2024-03-16T07:31:36.466 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-03-16T07:31:36.466 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker": [ 2024-03-16T07:31:36.466 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:31:36.466 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:31:36.466 INFO:teuthology.orchestra.run.smithi049.stdout: "id": "0" 2024-03-16T07:31:36.466 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:31:36.467 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:31:36.467 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_ready_timeouts": 0, 2024-03-16T07:31:36.467 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_idle_timeouts": 0 2024-03-16T07:31:36.467 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:31:36.467 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:31:36.467 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:31:36.467 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:31:36.467 INFO:teuthology.orchestra.run.smithi049.stdout: "id": "1" 2024-03-16T07:31:36.467 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:31:36.467 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:31:36.467 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_ready_timeouts": 0, 2024-03-16T07:31:36.467 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_idle_timeouts": 0 2024-03-16T07:31:36.467 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:31:36.467 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:31:36.467 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:31:36.468 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:31:36.468 INFO:teuthology.orchestra.run.smithi049.stdout: "id": "2" 2024-03-16T07:31:36.468 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:31:36.468 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:31:36.468 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_ready_timeouts": 0, 2024-03-16T07:31:36.468 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_idle_timeouts": 0 2024-03-16T07:31:36.468 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:31:36.468 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:31:36.468 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:31:36.468 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-0": [ 2024-03-16T07:31:36.468 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:31:36.468 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:31:36.468 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:31:36.468 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 9, 2024-03-16T07:31:36.468 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 88, 2024-03-16T07:31:36.468 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 1296, 2024-03-16T07:31:36.469 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 729264, 2024-03-16T07:31:36.469 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 18, 2024-03-16T07:31:36.469 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 5, 2024-03-16T07:31:36.469 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 0.284874686, 2024-03-16T07:31:36.469 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.094522069, 2024-03-16T07:31:36.469 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 0.151373566, 2024-03-16T07:31:36.469 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-03-16T07:31:36.469 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T07:31:36.469 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 80, 2024-03-16T07:31:36.469 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.169240562, 2024-03-16T07:31:36.469 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.002115507 2024-03-16T07:31:36.469 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:31:36.469 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-03-16T07:31:36.469 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:31:36.470 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:31:36.470 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:31:36.470 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:31:36.470 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 1296, 2024-03-16T07:31:36.470 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 729264 2024-03-16T07:31:36.470 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:31:36.470 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:31:36.470 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:31:36.470 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-1": [ 2024-03-16T07:31:36.470 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:31:36.470 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:31:36.470 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:31:36.470 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 84, 2024-03-16T07:31:36.470 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 5, 2024-03-16T07:31:36.471 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 347328, 2024-03-16T07:31:36.471 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 1136, 2024-03-16T07:31:36.471 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 3, 2024-03-16T07:31:36.471 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 0, 2024-03-16T07:31:36.471 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 0.435031228, 2024-03-16T07:31:36.471 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.004398143, 2024-03-16T07:31:36.471 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 0.281441946, 2024-03-16T07:31:36.471 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.133745091, 2024-03-16T07:31:36.471 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T07:31:36.471 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 5, 2024-03-16T07:31:36.471 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.054797003, 2024-03-16T07:31:36.471 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.010959400 2024-03-16T07:31:36.471 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:31:36.471 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-03-16T07:31:36.471 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:31:36.471 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:31:36.471 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:31:36.472 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:31:36.472 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 347328, 2024-03-16T07:31:36.472 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 1136 2024-03-16T07:31:36.472 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:31:36.472 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:31:36.472 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:31:36.472 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-2": [ 2024-03-16T07:31:36.472 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:31:36.472 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:31:36.472 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:31:36.472 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 52, 2024-03-16T07:31:36.472 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 8, 2024-03-16T07:31:36.472 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 1965600, 2024-03-16T07:31:36.472 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 1600, 2024-03-16T07:31:36.472 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 2, 2024-03-16T07:31:36.472 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 1, 2024-03-16T07:31:36.473 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 0.986275508, 2024-03-16T07:31:36.473 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.007191906, 2024-03-16T07:31:36.473 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 1.891958650, 2024-03-16T07:31:36.473 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-03-16T07:31:36.473 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T07:31:36.473 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 8, 2024-03-16T07:31:36.473 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.161009804, 2024-03-16T07:31:36.473 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.020126225 2024-03-16T07:31:36.473 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:31:36.473 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-03-16T07:31:36.473 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:31:36.473 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:31:36.473 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:31:36.473 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:31:36.473 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 1965600, 2024-03-16T07:31:36.473 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 1600 2024-03-16T07:31:36.473 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:31:36.474 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:31:36.474 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:31:36.474 INFO:teuthology.orchestra.run.smithi049.stdout: "cct": [ 2024-03-16T07:31:36.474 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:31:36.474 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:31:36.474 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:31:36.474 INFO:teuthology.orchestra.run.smithi049.stdout: "total_workers": 0, 2024-03-16T07:31:36.474 INFO:teuthology.orchestra.run.smithi049.stdout: "unhealthy_workers": 0 2024-03-16T07:31:36.474 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:31:36.474 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:31:36.474 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:31:36.474 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs_mirror": [ 2024-03-16T07:31:36.474 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:31:36.474 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:31:36.474 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:31:36.474 INFO:teuthology.orchestra.run.smithi049.stdout: "mirrored_filesystems": 1, 2024-03-16T07:31:36.475 INFO:teuthology.orchestra.run.smithi049.stdout: "mirror_enable_failures": 0 2024-03-16T07:31:36.475 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:31:36.475 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:31:36.475 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:31:36.475 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs_mirror_mirrored_filesystems": [ 2024-03-16T07:31:36.475 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:31:36.475 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:31:36.475 INFO:teuthology.orchestra.run.smithi049.stdout: "filesystem": "cephfs" 2024-03-16T07:31:36.475 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:31:36.475 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:31:36.475 INFO:teuthology.orchestra.run.smithi049.stdout: "mirroring_peers": 0, 2024-03-16T07:31:36.475 INFO:teuthology.orchestra.run.smithi049.stdout: "directory_count": 0 2024-03-16T07:31:36.475 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:31:36.475 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:31:36.475 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:31:36.475 INFO:teuthology.orchestra.run.smithi049.stdout: "mempool": [ 2024-03-16T07:31:36.476 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:31:36.476 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:31:36.476 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:31:36.476 INFO:teuthology.orchestra.run.smithi049.stdout: "bloom_filter_bytes": 0, 2024-03-16T07:31:36.476 INFO:teuthology.orchestra.run.smithi049.stdout: "bloom_filter_items": 0, 2024-03-16T07:31:36.476 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_alloc_bytes": 0, 2024-03-16T07:31:36.476 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_alloc_items": 0, 2024-03-16T07:31:36.476 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_data_bytes": 0, 2024-03-16T07:31:36.476 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_data_items": 0, 2024-03-16T07:31:36.476 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_onode_bytes": 0, 2024-03-16T07:31:36.476 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_onode_items": 0, 2024-03-16T07:31:36.476 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_meta_bytes": 0, 2024-03-16T07:31:36.476 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_meta_items": 0, 2024-03-16T07:31:36.476 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_other_bytes": 0, 2024-03-16T07:31:36.476 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_other_items": 0, 2024-03-16T07:31:36.476 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_buffer_bytes": 0, 2024-03-16T07:31:36.477 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_buffer_items": 0, 2024-03-16T07:31:36.477 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_extent_bytes": 0, 2024-03-16T07:31:36.477 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_extent_items": 0, 2024-03-16T07:31:36.477 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_blob_bytes": 0, 2024-03-16T07:31:36.477 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_blob_items": 0, 2024-03-16T07:31:36.477 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_shared_blob_bytes": 0, 2024-03-16T07:31:36.477 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_shared_blob_items": 0, 2024-03-16T07:31:36.477 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_inline_bl_bytes": 0, 2024-03-16T07:31:36.477 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_inline_bl_items": 0, 2024-03-16T07:31:36.477 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_fsck_bytes": 0, 2024-03-16T07:31:36.477 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_fsck_items": 0, 2024-03-16T07:31:36.477 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_txc_bytes": 0, 2024-03-16T07:31:36.477 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_txc_items": 0, 2024-03-16T07:31:36.477 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_deferred_bytes": 0, 2024-03-16T07:31:36.478 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_deferred_items": 0, 2024-03-16T07:31:36.478 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_bytes": 0, 2024-03-16T07:31:36.478 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_items": 0, 2024-03-16T07:31:36.478 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_bytes": 0, 2024-03-16T07:31:36.478 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_items": 0, 2024-03-16T07:31:36.478 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_reader_bytes": 0, 2024-03-16T07:31:36.478 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_reader_items": 0, 2024-03-16T07:31:36.478 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_writer_bytes": 0, 2024-03-16T07:31:36.478 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_writer_items": 0, 2024-03-16T07:31:36.478 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_anon_bytes": 183567, 2024-03-16T07:31:36.478 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_anon_items": 55, 2024-03-16T07:31:36.478 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_meta_bytes": 0, 2024-03-16T07:31:36.478 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_meta_items": 0, 2024-03-16T07:31:36.478 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_bytes": 0, 2024-03-16T07:31:36.478 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_items": 0, 2024-03-16T07:31:36.479 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_mapbl_bytes": 0, 2024-03-16T07:31:36.479 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_mapbl_items": 0, 2024-03-16T07:31:36.479 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pglog_bytes": 0, 2024-03-16T07:31:36.479 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pglog_items": 0, 2024-03-16T07:31:36.479 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_bytes": 18952, 2024-03-16T07:31:36.479 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_items": 184, 2024-03-16T07:31:36.479 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_mapping_bytes": 0, 2024-03-16T07:31:36.479 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_mapping_items": 0, 2024-03-16T07:31:36.479 INFO:teuthology.orchestra.run.smithi049.stdout: "pgmap_bytes": 0, 2024-03-16T07:31:36.479 INFO:teuthology.orchestra.run.smithi049.stdout: "pgmap_items": 0, 2024-03-16T07:31:36.479 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_co_bytes": 0, 2024-03-16T07:31:36.479 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_co_items": 0, 2024-03-16T07:31:36.479 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_1_bytes": 0, 2024-03-16T07:31:36.479 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_1_items": 0, 2024-03-16T07:31:36.479 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_2_bytes": 0, 2024-03-16T07:31:36.480 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_2_items": 0 2024-03-16T07:31:36.480 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:31:36.480 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:31:36.480 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:31:36.480 INFO:teuthology.orchestra.run.smithi049.stdout: "objecter": [ 2024-03-16T07:31:36.480 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:31:36.480 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:31:36.480 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:31:36.480 INFO:teuthology.orchestra.run.smithi049.stdout: "op_active": 0, 2024-03-16T07:31:36.480 INFO:teuthology.orchestra.run.smithi049.stdout: "op_laggy": 0, 2024-03-16T07:31:36.480 INFO:teuthology.orchestra.run.smithi049.stdout: "op_send": 0, 2024-03-16T07:31:36.480 INFO:teuthology.orchestra.run.smithi049.stdout: "op_send_bytes": 0, 2024-03-16T07:31:36.480 INFO:teuthology.orchestra.run.smithi049.stdout: "op_resend": 0, 2024-03-16T07:31:36.480 INFO:teuthology.orchestra.run.smithi049.stdout: "op_reply": 0, 2024-03-16T07:31:36.480 INFO:teuthology.orchestra.run.smithi049.stdout: "op_latency": { 2024-03-16T07:31:36.480 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:31:36.481 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:31:36.481 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:31:36.481 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:31:36.481 INFO:teuthology.orchestra.run.smithi049.stdout: "op_inflight": 0, 2024-03-16T07:31:36.481 INFO:teuthology.orchestra.run.smithi049.stdout: "oplen_avg": { 2024-03-16T07:31:36.481 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:31:36.481 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0 2024-03-16T07:31:36.481 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:31:36.481 INFO:teuthology.orchestra.run.smithi049.stdout: "op": 0, 2024-03-16T07:31:36.481 INFO:teuthology.orchestra.run.smithi049.stdout: "op_r": 0, 2024-03-16T07:31:36.481 INFO:teuthology.orchestra.run.smithi049.stdout: "op_w": 0, 2024-03-16T07:31:36.481 INFO:teuthology.orchestra.run.smithi049.stdout: "op_rmw": 0, 2024-03-16T07:31:36.481 INFO:teuthology.orchestra.run.smithi049.stdout: "op_pg": 0, 2024-03-16T07:31:36.481 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_stat": 0, 2024-03-16T07:31:36.481 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_create": 0, 2024-03-16T07:31:36.481 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_read": 0, 2024-03-16T07:31:36.482 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_write": 0, 2024-03-16T07:31:36.482 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_writefull": 0, 2024-03-16T07:31:36.482 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_writesame": 0, 2024-03-16T07:31:36.482 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_append": 0, 2024-03-16T07:31:36.482 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_zero": 0, 2024-03-16T07:31:36.482 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_truncate": 0, 2024-03-16T07:31:36.482 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_delete": 0, 2024-03-16T07:31:36.482 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_mapext": 0, 2024-03-16T07:31:36.482 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_sparse_read": 0, 2024-03-16T07:31:36.482 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_clonerange": 0, 2024-03-16T07:31:36.482 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_getxattr": 0, 2024-03-16T07:31:36.482 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_setxattr": 0, 2024-03-16T07:31:36.482 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_cmpxattr": 0, 2024-03-16T07:31:36.482 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_rmxattr": 0, 2024-03-16T07:31:36.482 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_resetxattrs": 0, 2024-03-16T07:31:36.482 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_call": 0, 2024-03-16T07:31:36.483 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_watch": 0, 2024-03-16T07:31:36.483 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_notify": 0, 2024-03-16T07:31:36.483 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_src_cmpxattr": 0, 2024-03-16T07:31:36.483 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_pgls": 0, 2024-03-16T07:31:36.483 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_pgls_filter": 0, 2024-03-16T07:31:36.483 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_other": 0, 2024-03-16T07:31:36.483 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_active": 0, 2024-03-16T07:31:36.483 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_send": 0, 2024-03-16T07:31:36.483 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_resend": 0, 2024-03-16T07:31:36.483 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_ping": 0, 2024-03-16T07:31:36.483 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_active": 0, 2024-03-16T07:31:36.483 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_send": 0, 2024-03-16T07:31:36.483 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_resend": 0, 2024-03-16T07:31:36.483 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_active": 0, 2024-03-16T07:31:36.483 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_send": 0, 2024-03-16T07:31:36.484 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_resend": 0, 2024-03-16T07:31:36.484 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_active": 0, 2024-03-16T07:31:36.484 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_send": 0, 2024-03-16T07:31:36.484 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_resend": 0, 2024-03-16T07:31:36.484 INFO:teuthology.orchestra.run.smithi049.stdout: "command_active": 0, 2024-03-16T07:31:36.484 INFO:teuthology.orchestra.run.smithi049.stdout: "command_send": 0, 2024-03-16T07:31:36.484 INFO:teuthology.orchestra.run.smithi049.stdout: "command_resend": 0, 2024-03-16T07:31:36.484 INFO:teuthology.orchestra.run.smithi049.stdout: "map_epoch": 0, 2024-03-16T07:31:36.484 INFO:teuthology.orchestra.run.smithi049.stdout: "map_full": 0, 2024-03-16T07:31:36.484 INFO:teuthology.orchestra.run.smithi049.stdout: "map_inc": 0, 2024-03-16T07:31:36.484 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_sessions": 0, 2024-03-16T07:31:36.484 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_session_open": 0, 2024-03-16T07:31:36.484 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_session_close": 0, 2024-03-16T07:31:36.484 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_laggy": 0, 2024-03-16T07:31:36.484 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_wr": 0, 2024-03-16T07:31:36.484 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_rd": 0, 2024-03-16T07:31:36.484 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_del": 0 2024-03-16T07:31:36.485 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:31:36.485 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:31:36.485 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:31:36.485 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-msgr_dispatch_throttler-client": [ 2024-03-16T07:31:36.485 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:31:36.485 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:31:36.485 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:31:36.485 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:31:36.485 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-03-16T07:31:36.485 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:31:36.485 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 84, 2024-03-16T07:31:36.485 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 335927, 2024-03-16T07:31:36.485 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:31:36.485 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 84, 2024-03-16T07:31:36.485 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:31:36.485 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:31:36.485 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 84, 2024-03-16T07:31:36.486 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 335927, 2024-03-16T07:31:36.486 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:31:36.486 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:31:36.486 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:31:36.486 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:31:36.486 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:31:36.486 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:31:36.486 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:31:36.486 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:31:36.486 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-msgr_dispatch_throttler-radosclient": [ 2024-03-16T07:31:36.486 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:31:36.486 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:31:36.486 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:31:36.486 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:31:36.486 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-03-16T07:31:36.486 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:31:36.487 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 58, 2024-03-16T07:31:36.487 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 1958145, 2024-03-16T07:31:36.487 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:31:36.487 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 58, 2024-03-16T07:31:36.487 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:31:36.487 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:31:36.487 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 58, 2024-03-16T07:31:36.487 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 1958145, 2024-03-16T07:31:36.487 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:31:36.487 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:31:36.487 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:31:36.487 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:31:36.487 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:31:36.487 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:31:36.487 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:31:36.487 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:31:36.487 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-objecter_bytes": [ 2024-03-16T07:31:36.488 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:31:36.488 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:31:36.488 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:31:36.488 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:31:36.488 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-03-16T07:31:36.488 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:31:36.488 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 0, 2024-03-16T07:31:36.488 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 0, 2024-03-16T07:31:36.488 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:31:36.488 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 0, 2024-03-16T07:31:36.488 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:31:36.488 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:31:36.488 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 0, 2024-03-16T07:31:36.488 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 0, 2024-03-16T07:31:36.488 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:31:36.488 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:31:36.488 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:31:36.488 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:31:36.489 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:31:36.489 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:31:36.489 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:31:36.489 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:31:36.489 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-objecter_ops": [ 2024-03-16T07:31:36.489 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:31:36.489 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:31:36.489 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:31:36.489 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:31:36.489 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 1024, 2024-03-16T07:31:36.489 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:31:36.489 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 0, 2024-03-16T07:31:36.489 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 0, 2024-03-16T07:31:36.489 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:31:36.489 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 0, 2024-03-16T07:31:36.489 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:31:36.489 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:31:36.490 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 0, 2024-03-16T07:31:36.490 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 0, 2024-03-16T07:31:36.490 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:31:36.490 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:31:36.490 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:31:36.490 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:31:36.490 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:31:36.490 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:31:36.490 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:31:36.490 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2024-03-16T07:31:36.490 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-03-16T07:31:36.491 DEBUG:tasks.cephfs.test_mirroring:command returned={ "AsyncMessenger::Worker": [ { "labels": { "id": "0" }, "counters": { "msgr_connection_ready_timeouts": 0, "msgr_connection_idle_timeouts": 0 } }, { "labels": { "id": "1" }, "counters": { "msgr_connection_ready_timeouts": 0, "msgr_connection_idle_timeouts": 0 } }, { "labels": { "id": "2" }, "counters": { "msgr_connection_ready_timeouts": 0, "msgr_connection_idle_timeouts": 0 } } ], "AsyncMessenger::Worker-0": [ { "labels": {}, "counters": { "msgr_recv_messages": 9, "msgr_send_messages": 88, "msgr_recv_bytes": 1296, "msgr_send_bytes": 729264, "msgr_created_connections": 18, "msgr_active_connections": 5, "msgr_running_total_time": 0.284874686, "msgr_running_send_time": 0.094522069, "msgr_running_recv_time": 0.151373566, "msgr_running_fast_dispatch_time": 0.000000000, "msgr_send_messages_queue_lat": { "avgcount": 80, "sum": 0.169240562, "avgtime": 0.002115507 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "msgr_recv_encrypted_bytes": 1296, "msgr_send_encrypted_bytes": 729264 } } ], "AsyncMessenger::Worker-1": [ { "labels": {}, "counters": { "msgr_recv_messages": 84, "msgr_send_messages": 5, "msgr_recv_bytes": 347328, "msgr_send_bytes": 1136, "msgr_created_connections": 3, "msgr_active_connections": 0, "msgr_running_total_time": 0.435031228, "msgr_running_send_time": 0.004398143, "msgr_running_recv_time": 0.281441946, "msgr_running_fast_dispatch_time": 0.133745091, "msgr_send_messages_queue_lat": { "avgcount": 5, "sum": 0.054797003, "avgtime": 0.010959400 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "msgr_recv_encrypted_bytes": 347328, "msgr_send_encrypted_bytes": 1136 } } ], "AsyncMessenger::Worker-2": [ { "labels": {}, "counters": { "msgr_recv_messages": 52, "msgr_send_messages": 8, "msgr_recv_bytes": 1965600, "msgr_send_bytes": 1600, "msgr_created_connections": 2, "msgr_active_connections": 1, "msgr_running_total_time": 0.986275508, "msgr_running_send_time": 0.007191906, "msgr_running_recv_time": 1.891958650, "msgr_running_fast_dispatch_time": 0.000000000, "msgr_send_messages_queue_lat": { "avgcount": 8, "sum": 0.161009804, "avgtime": 0.020126225 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "msgr_recv_encrypted_bytes": 1965600, "msgr_send_encrypted_bytes": 1600 } } ], "cct": [ { "labels": {}, "counters": { "total_workers": 0, "unhealthy_workers": 0 } } ], "cephfs_mirror": [ { "labels": {}, "counters": { "mirrored_filesystems": 1, "mirror_enable_failures": 0 } } ], "cephfs_mirror_mirrored_filesystems": [ { "labels": { "filesystem": "cephfs" }, "counters": { "mirroring_peers": 0, "directory_count": 0 } } ], "mempool": [ { "labels": {}, "counters": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_cache_buffer_bytes": 0, "bluestore_cache_buffer_items": 0, "bluestore_extent_bytes": 0, "bluestore_extent_items": 0, "bluestore_blob_bytes": 0, "bluestore_blob_items": 0, "bluestore_shared_blob_bytes": 0, "bluestore_shared_blob_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_items": 0, "bluefs_bytes": 0, "bluefs_items": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "buffer_anon_bytes": 183567, "buffer_anon_items": 55, "buffer_meta_bytes": 0, "buffer_meta_items": 0, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 18952, "osdmap_items": 184, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "mds_co_bytes": 0, "mds_co_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 } } ], "objecter": [ { "labels": {}, "counters": { "op_active": 0, "op_laggy": 0, "op_send": 0, "op_send_bytes": 0, "op_resend": 0, "op_reply": 0, "op_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "op_inflight": 0, "oplen_avg": { "avgcount": 0, "sum": 0 }, "op": 0, "op_r": 0, "op_w": 0, "op_rmw": 0, "op_pg": 0, "osdop_stat": 0, "osdop_create": 0, "osdop_read": 0, "osdop_write": 0, "osdop_writefull": 0, "osdop_writesame": 0, "osdop_append": 0, "osdop_zero": 0, "osdop_truncate": 0, "osdop_delete": 0, "osdop_mapext": 0, "osdop_sparse_read": 0, "osdop_clonerange": 0, "osdop_getxattr": 0, "osdop_setxattr": 0, "osdop_cmpxattr": 0, "osdop_rmxattr": 0, "osdop_resetxattrs": 0, "osdop_call": 0, "osdop_watch": 0, "osdop_notify": 0, "osdop_src_cmpxattr": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_other": 0, "linger_active": 0, "linger_send": 0, "linger_resend": 0, "linger_ping": 0, "poolop_active": 0, "poolop_send": 0, "poolop_resend": 0, "poolstat_active": 0, "poolstat_send": 0, "poolstat_resend": 0, "statfs_active": 0, "statfs_send": 0, "statfs_resend": 0, "command_active": 0, "command_send": 0, "command_resend": 0, "map_epoch": 0, "map_full": 0, "map_inc": 0, "osd_sessions": 0, "osd_session_open": 0, "osd_session_close": 0, "osd_laggy": 0, "omap_wr": 0, "omap_rd": 0, "omap_del": 0 } } ], "throttle-msgr_dispatch_throttler-client": [ { "labels": {}, "counters": { "val": 0, "max": 104857600, "get_started": 0, "get": 84, "get_sum": 335927, "get_or_fail_fail": 0, "get_or_fail_success": 84, "take": 0, "take_sum": 0, "put": 84, "put_sum": 335927, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ], "throttle-msgr_dispatch_throttler-radosclient": [ { "labels": {}, "counters": { "val": 0, "max": 104857600, "get_started": 0, "get": 58, "get_sum": 1958145, "get_or_fail_fail": 0, "get_or_fail_success": 58, "take": 0, "take_sum": 0, "put": 58, "put_sum": 1958145, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ], "throttle-objecter_bytes": [ { "labels": {}, "counters": { "val": 0, "max": 104857600, "get_started": 0, "get": 0, "get_sum": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "take": 0, "take_sum": 0, "put": 0, "put_sum": 0, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ], "throttle-objecter_ops": [ { "labels": {}, "counters": { "val": 0, "max": 1024, "get_started": 0, "get": 0, "get_sum": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "take": 0, "take_sum": 0, "put": 0, "put_sum": 0, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ] } 2024-03-16T07:31:36.491 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-03-16T07:31:36.492 DEBUG:teuthology.orchestra.run.smithi049:counter dump for fs: cephfs> ceph --admin-daemon /var/run/ceph/cephfs-mirror.asok counter dump 2024-03-16T07:31:36.596 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-03-16T07:31:36.596 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker": [ 2024-03-16T07:31:36.596 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:31:36.596 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:31:36.596 INFO:teuthology.orchestra.run.smithi049.stdout: "id": "0" 2024-03-16T07:31:36.596 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:31:36.597 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:31:36.597 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_ready_timeouts": 0, 2024-03-16T07:31:36.597 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_idle_timeouts": 0 2024-03-16T07:31:36.597 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:31:36.597 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:31:36.597 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:31:36.597 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:31:36.597 INFO:teuthology.orchestra.run.smithi049.stdout: "id": "1" 2024-03-16T07:31:36.597 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:31:36.597 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:31:36.597 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_ready_timeouts": 0, 2024-03-16T07:31:36.597 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_idle_timeouts": 0 2024-03-16T07:31:36.597 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:31:36.597 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:31:36.597 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:31:36.597 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:31:36.598 INFO:teuthology.orchestra.run.smithi049.stdout: "id": "2" 2024-03-16T07:31:36.598 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:31:36.598 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:31:36.598 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_ready_timeouts": 0, 2024-03-16T07:31:36.598 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_idle_timeouts": 0 2024-03-16T07:31:36.598 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:31:36.598 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:31:36.598 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:31:36.598 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-0": [ 2024-03-16T07:31:36.598 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:31:36.598 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:31:36.598 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:31:36.598 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 9, 2024-03-16T07:31:36.598 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 88, 2024-03-16T07:31:36.598 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 1296, 2024-03-16T07:31:36.599 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 729264, 2024-03-16T07:31:36.599 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 18, 2024-03-16T07:31:36.599 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 5, 2024-03-16T07:31:36.599 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 0.284874686, 2024-03-16T07:31:36.599 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.094522069, 2024-03-16T07:31:36.599 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 0.151373566, 2024-03-16T07:31:36.599 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-03-16T07:31:36.599 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T07:31:36.599 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 80, 2024-03-16T07:31:36.599 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.169240562, 2024-03-16T07:31:36.599 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.002115507 2024-03-16T07:31:36.599 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:31:36.599 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-03-16T07:31:36.599 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:31:36.599 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:31:36.600 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:31:36.600 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:31:36.600 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 1296, 2024-03-16T07:31:36.600 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 729264 2024-03-16T07:31:36.600 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:31:36.600 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:31:36.600 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:31:36.600 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-1": [ 2024-03-16T07:31:36.600 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:31:36.600 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:31:36.600 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:31:36.600 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 84, 2024-03-16T07:31:36.600 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 5, 2024-03-16T07:31:36.600 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 347328, 2024-03-16T07:31:36.600 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 1136, 2024-03-16T07:31:36.601 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 3, 2024-03-16T07:31:36.601 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 0, 2024-03-16T07:31:36.601 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 0.435031228, 2024-03-16T07:31:36.601 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.004398143, 2024-03-16T07:31:36.601 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 0.281441946, 2024-03-16T07:31:36.601 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.133745091, 2024-03-16T07:31:36.601 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T07:31:36.601 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 5, 2024-03-16T07:31:36.601 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.054797003, 2024-03-16T07:31:36.601 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.010959400 2024-03-16T07:31:36.601 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:31:36.601 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-03-16T07:31:36.601 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:31:36.601 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:31:36.601 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:31:36.601 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:31:36.601 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 347328, 2024-03-16T07:31:36.602 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 1136 2024-03-16T07:31:36.602 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:31:36.602 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:31:36.602 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:31:36.602 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-2": [ 2024-03-16T07:31:36.602 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:31:36.602 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:31:36.602 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:31:36.602 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 52, 2024-03-16T07:31:36.602 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 8, 2024-03-16T07:31:36.602 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 1965600, 2024-03-16T07:31:36.602 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 1600, 2024-03-16T07:31:36.602 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 2, 2024-03-16T07:31:36.602 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 1, 2024-03-16T07:31:36.602 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 0.986275508, 2024-03-16T07:31:36.603 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.007191906, 2024-03-16T07:31:36.603 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 1.891958650, 2024-03-16T07:31:36.603 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-03-16T07:31:36.603 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T07:31:36.603 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 8, 2024-03-16T07:31:36.603 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.161009804, 2024-03-16T07:31:36.603 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.020126225 2024-03-16T07:31:36.603 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:31:36.603 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-03-16T07:31:36.603 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:31:36.603 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:31:36.603 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:31:36.603 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:31:36.603 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 1965600, 2024-03-16T07:31:36.603 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 1600 2024-03-16T07:31:36.603 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:31:36.603 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:31:36.604 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:31:36.604 INFO:teuthology.orchestra.run.smithi049.stdout: "cct": [ 2024-03-16T07:31:36.604 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:31:36.604 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:31:36.604 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:31:36.604 INFO:teuthology.orchestra.run.smithi049.stdout: "total_workers": 0, 2024-03-16T07:31:36.604 INFO:teuthology.orchestra.run.smithi049.stdout: "unhealthy_workers": 0 2024-03-16T07:31:36.604 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:31:36.604 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:31:36.604 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:31:36.604 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs_mirror": [ 2024-03-16T07:31:36.604 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:31:36.604 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:31:36.604 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:31:36.604 INFO:teuthology.orchestra.run.smithi049.stdout: "mirrored_filesystems": 1, 2024-03-16T07:31:36.604 INFO:teuthology.orchestra.run.smithi049.stdout: "mirror_enable_failures": 0 2024-03-16T07:31:36.604 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:31:36.605 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:31:36.605 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:31:36.605 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs_mirror_mirrored_filesystems": [ 2024-03-16T07:31:36.605 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:31:36.605 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:31:36.605 INFO:teuthology.orchestra.run.smithi049.stdout: "filesystem": "cephfs" 2024-03-16T07:31:36.605 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:31:36.605 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:31:36.605 INFO:teuthology.orchestra.run.smithi049.stdout: "mirroring_peers": 0, 2024-03-16T07:31:36.605 INFO:teuthology.orchestra.run.smithi049.stdout: "directory_count": 0 2024-03-16T07:31:36.605 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:31:36.605 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:31:36.605 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:31:36.605 INFO:teuthology.orchestra.run.smithi049.stdout: "mempool": [ 2024-03-16T07:31:36.605 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:31:36.605 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:31:36.605 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:31:36.606 INFO:teuthology.orchestra.run.smithi049.stdout: "bloom_filter_bytes": 0, 2024-03-16T07:31:36.606 INFO:teuthology.orchestra.run.smithi049.stdout: "bloom_filter_items": 0, 2024-03-16T07:31:36.606 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_alloc_bytes": 0, 2024-03-16T07:31:36.606 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_alloc_items": 0, 2024-03-16T07:31:36.606 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_data_bytes": 0, 2024-03-16T07:31:36.606 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_data_items": 0, 2024-03-16T07:31:36.606 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_onode_bytes": 0, 2024-03-16T07:31:36.606 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_onode_items": 0, 2024-03-16T07:31:36.606 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_meta_bytes": 0, 2024-03-16T07:31:36.606 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_meta_items": 0, 2024-03-16T07:31:36.606 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_other_bytes": 0, 2024-03-16T07:31:36.606 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_other_items": 0, 2024-03-16T07:31:36.606 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_buffer_bytes": 0, 2024-03-16T07:31:36.606 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_buffer_items": 0, 2024-03-16T07:31:36.606 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_extent_bytes": 0, 2024-03-16T07:31:36.607 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_extent_items": 0, 2024-03-16T07:31:36.607 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_blob_bytes": 0, 2024-03-16T07:31:36.607 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_blob_items": 0, 2024-03-16T07:31:36.607 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_shared_blob_bytes": 0, 2024-03-16T07:31:36.607 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_shared_blob_items": 0, 2024-03-16T07:31:36.607 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_inline_bl_bytes": 0, 2024-03-16T07:31:36.607 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_inline_bl_items": 0, 2024-03-16T07:31:36.607 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_fsck_bytes": 0, 2024-03-16T07:31:36.607 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_fsck_items": 0, 2024-03-16T07:31:36.607 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_txc_bytes": 0, 2024-03-16T07:31:36.607 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_txc_items": 0, 2024-03-16T07:31:36.607 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_deferred_bytes": 0, 2024-03-16T07:31:36.607 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_deferred_items": 0, 2024-03-16T07:31:36.607 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_bytes": 0, 2024-03-16T07:31:36.607 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_items": 0, 2024-03-16T07:31:36.607 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_bytes": 0, 2024-03-16T07:31:36.607 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_items": 0, 2024-03-16T07:31:36.608 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_reader_bytes": 0, 2024-03-16T07:31:36.608 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_reader_items": 0, 2024-03-16T07:31:36.608 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_writer_bytes": 0, 2024-03-16T07:31:36.608 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_writer_items": 0, 2024-03-16T07:31:36.608 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_anon_bytes": 183567, 2024-03-16T07:31:36.608 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_anon_items": 55, 2024-03-16T07:31:36.608 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_meta_bytes": 0, 2024-03-16T07:31:36.608 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_meta_items": 0, 2024-03-16T07:31:36.608 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_bytes": 0, 2024-03-16T07:31:36.608 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_items": 0, 2024-03-16T07:31:36.608 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_mapbl_bytes": 0, 2024-03-16T07:31:36.608 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_mapbl_items": 0, 2024-03-16T07:31:36.608 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pglog_bytes": 0, 2024-03-16T07:31:36.608 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pglog_items": 0, 2024-03-16T07:31:36.608 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_bytes": 18952, 2024-03-16T07:31:36.608 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_items": 184, 2024-03-16T07:31:36.609 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_mapping_bytes": 0, 2024-03-16T07:31:36.609 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_mapping_items": 0, 2024-03-16T07:31:36.609 INFO:teuthology.orchestra.run.smithi049.stdout: "pgmap_bytes": 0, 2024-03-16T07:31:36.609 INFO:teuthology.orchestra.run.smithi049.stdout: "pgmap_items": 0, 2024-03-16T07:31:36.609 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_co_bytes": 0, 2024-03-16T07:31:36.609 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_co_items": 0, 2024-03-16T07:31:36.609 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_1_bytes": 0, 2024-03-16T07:31:36.609 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_1_items": 0, 2024-03-16T07:31:36.609 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_2_bytes": 0, 2024-03-16T07:31:36.609 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_2_items": 0 2024-03-16T07:31:36.609 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:31:36.609 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:31:36.609 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:31:36.609 INFO:teuthology.orchestra.run.smithi049.stdout: "objecter": [ 2024-03-16T07:31:36.609 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:31:36.610 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:31:36.610 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:31:36.610 INFO:teuthology.orchestra.run.smithi049.stdout: "op_active": 0, 2024-03-16T07:31:36.610 INFO:teuthology.orchestra.run.smithi049.stdout: "op_laggy": 0, 2024-03-16T07:31:36.610 INFO:teuthology.orchestra.run.smithi049.stdout: "op_send": 0, 2024-03-16T07:31:36.610 INFO:teuthology.orchestra.run.smithi049.stdout: "op_send_bytes": 0, 2024-03-16T07:31:36.610 INFO:teuthology.orchestra.run.smithi049.stdout: "op_resend": 0, 2024-03-16T07:31:36.610 INFO:teuthology.orchestra.run.smithi049.stdout: "op_reply": 0, 2024-03-16T07:31:36.610 INFO:teuthology.orchestra.run.smithi049.stdout: "op_latency": { 2024-03-16T07:31:36.610 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:31:36.610 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:31:36.610 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:31:36.610 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:31:36.610 INFO:teuthology.orchestra.run.smithi049.stdout: "op_inflight": 0, 2024-03-16T07:31:36.611 INFO:teuthology.orchestra.run.smithi049.stdout: "oplen_avg": { 2024-03-16T07:31:36.611 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:31:36.611 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0 2024-03-16T07:31:36.611 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:31:36.611 INFO:teuthology.orchestra.run.smithi049.stdout: "op": 0, 2024-03-16T07:31:36.611 INFO:teuthology.orchestra.run.smithi049.stdout: "op_r": 0, 2024-03-16T07:31:36.611 INFO:teuthology.orchestra.run.smithi049.stdout: "op_w": 0, 2024-03-16T07:31:36.611 INFO:teuthology.orchestra.run.smithi049.stdout: "op_rmw": 0, 2024-03-16T07:31:36.611 INFO:teuthology.orchestra.run.smithi049.stdout: "op_pg": 0, 2024-03-16T07:31:36.611 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_stat": 0, 2024-03-16T07:31:36.611 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_create": 0, 2024-03-16T07:31:36.611 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_read": 0, 2024-03-16T07:31:36.611 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_write": 0, 2024-03-16T07:31:36.611 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_writefull": 0, 2024-03-16T07:31:36.611 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_writesame": 0, 2024-03-16T07:31:36.611 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_append": 0, 2024-03-16T07:31:36.612 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_zero": 0, 2024-03-16T07:31:36.612 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_truncate": 0, 2024-03-16T07:31:36.612 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_delete": 0, 2024-03-16T07:31:36.612 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_mapext": 0, 2024-03-16T07:31:36.612 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_sparse_read": 0, 2024-03-16T07:31:36.612 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_clonerange": 0, 2024-03-16T07:31:36.612 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_getxattr": 0, 2024-03-16T07:31:36.612 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_setxattr": 0, 2024-03-16T07:31:36.612 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_cmpxattr": 0, 2024-03-16T07:31:36.612 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_rmxattr": 0, 2024-03-16T07:31:36.612 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_resetxattrs": 0, 2024-03-16T07:31:36.612 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_call": 0, 2024-03-16T07:31:36.612 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_watch": 0, 2024-03-16T07:31:36.612 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_notify": 0, 2024-03-16T07:31:36.612 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_src_cmpxattr": 0, 2024-03-16T07:31:36.613 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_pgls": 0, 2024-03-16T07:31:36.613 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_pgls_filter": 0, 2024-03-16T07:31:36.613 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_other": 0, 2024-03-16T07:31:36.613 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_active": 0, 2024-03-16T07:31:36.613 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_send": 0, 2024-03-16T07:31:36.613 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_resend": 0, 2024-03-16T07:31:36.613 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_ping": 0, 2024-03-16T07:31:36.613 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_active": 0, 2024-03-16T07:31:36.613 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_send": 0, 2024-03-16T07:31:36.613 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_resend": 0, 2024-03-16T07:31:36.613 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_active": 0, 2024-03-16T07:31:36.613 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_send": 0, 2024-03-16T07:31:36.613 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_resend": 0, 2024-03-16T07:31:36.613 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_active": 0, 2024-03-16T07:31:36.613 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_send": 0, 2024-03-16T07:31:36.613 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_resend": 0, 2024-03-16T07:31:36.613 INFO:teuthology.orchestra.run.smithi049.stdout: "command_active": 0, 2024-03-16T07:31:36.613 INFO:teuthology.orchestra.run.smithi049.stdout: "command_send": 0, 2024-03-16T07:31:36.614 INFO:teuthology.orchestra.run.smithi049.stdout: "command_resend": 0, 2024-03-16T07:31:36.614 INFO:teuthology.orchestra.run.smithi049.stdout: "map_epoch": 0, 2024-03-16T07:31:36.614 INFO:teuthology.orchestra.run.smithi049.stdout: "map_full": 0, 2024-03-16T07:31:36.614 INFO:teuthology.orchestra.run.smithi049.stdout: "map_inc": 0, 2024-03-16T07:31:36.614 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_sessions": 0, 2024-03-16T07:31:36.614 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_session_open": 0, 2024-03-16T07:31:36.614 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_session_close": 0, 2024-03-16T07:31:36.614 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_laggy": 0, 2024-03-16T07:31:36.614 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_wr": 0, 2024-03-16T07:31:36.614 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_rd": 0, 2024-03-16T07:31:36.614 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_del": 0 2024-03-16T07:31:36.614 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:31:36.614 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:31:36.614 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:31:36.614 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-msgr_dispatch_throttler-client": [ 2024-03-16T07:31:36.615 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:31:36.615 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:31:36.615 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:31:36.615 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:31:36.615 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-03-16T07:31:36.615 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:31:36.615 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 84, 2024-03-16T07:31:36.615 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 335927, 2024-03-16T07:31:36.615 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:31:36.615 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 84, 2024-03-16T07:31:36.615 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:31:36.615 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:31:36.615 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 84, 2024-03-16T07:31:36.615 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 335927, 2024-03-16T07:31:36.615 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:31:36.615 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:31:36.615 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:31:36.616 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:31:36.616 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:31:36.616 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:31:36.616 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:31:36.616 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:31:36.616 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-msgr_dispatch_throttler-radosclient": [ 2024-03-16T07:31:36.616 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:31:36.616 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:31:36.616 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:31:36.616 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:31:36.616 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-03-16T07:31:36.616 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:31:36.616 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 58, 2024-03-16T07:31:36.616 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 1958145, 2024-03-16T07:31:36.616 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:31:36.616 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 58, 2024-03-16T07:31:36.617 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:31:36.617 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:31:36.617 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 58, 2024-03-16T07:31:36.617 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 1958145, 2024-03-16T07:31:36.617 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:31:36.617 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:31:36.617 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:31:36.617 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:31:36.617 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:31:36.617 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:31:36.617 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:31:36.617 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:31:36.617 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-objecter_bytes": [ 2024-03-16T07:31:36.617 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:31:36.617 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:31:36.617 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:31:36.618 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:31:36.618 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-03-16T07:31:36.618 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:31:36.618 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 0, 2024-03-16T07:31:36.618 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 0, 2024-03-16T07:31:36.618 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:31:36.618 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 0, 2024-03-16T07:31:36.618 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:31:36.618 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:31:36.618 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 0, 2024-03-16T07:31:36.618 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 0, 2024-03-16T07:31:36.618 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:31:36.618 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:31:36.618 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:31:36.618 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:31:36.619 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:31:36.619 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:31:36.619 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:31:36.619 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:31:36.619 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-objecter_ops": [ 2024-03-16T07:31:36.619 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:31:36.619 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:31:36.619 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:31:36.619 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:31:36.619 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 1024, 2024-03-16T07:31:36.619 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:31:36.619 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 0, 2024-03-16T07:31:36.619 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 0, 2024-03-16T07:31:36.619 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:31:36.619 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 0, 2024-03-16T07:31:36.619 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:31:36.620 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:31:36.620 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 0, 2024-03-16T07:31:36.620 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 0, 2024-03-16T07:31:36.620 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:31:36.620 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:31:36.620 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:31:36.620 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:31:36.620 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:31:36.620 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:31:36.620 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:31:36.620 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2024-03-16T07:31:36.620 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-03-16T07:31:36.621 DEBUG:tasks.cephfs.test_mirroring:command returned={ "AsyncMessenger::Worker": [ { "labels": { "id": "0" }, "counters": { "msgr_connection_ready_timeouts": 0, "msgr_connection_idle_timeouts": 0 } }, { "labels": { "id": "1" }, "counters": { "msgr_connection_ready_timeouts": 0, "msgr_connection_idle_timeouts": 0 } }, { "labels": { "id": "2" }, "counters": { "msgr_connection_ready_timeouts": 0, "msgr_connection_idle_timeouts": 0 } } ], "AsyncMessenger::Worker-0": [ { "labels": {}, "counters": { "msgr_recv_messages": 9, "msgr_send_messages": 88, "msgr_recv_bytes": 1296, "msgr_send_bytes": 729264, "msgr_created_connections": 18, "msgr_active_connections": 5, "msgr_running_total_time": 0.284874686, "msgr_running_send_time": 0.094522069, "msgr_running_recv_time": 0.151373566, "msgr_running_fast_dispatch_time": 0.000000000, "msgr_send_messages_queue_lat": { "avgcount": 80, "sum": 0.169240562, "avgtime": 0.002115507 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "msgr_recv_encrypted_bytes": 1296, "msgr_send_encrypted_bytes": 729264 } } ], "AsyncMessenger::Worker-1": [ { "labels": {}, "counters": { "msgr_recv_messages": 84, "msgr_send_messages": 5, "msgr_recv_bytes": 347328, "msgr_send_bytes": 1136, "msgr_created_connections": 3, "msgr_active_connections": 0, "msgr_running_total_time": 0.435031228, "msgr_running_send_time": 0.004398143, "msgr_running_recv_time": 0.281441946, "msgr_running_fast_dispatch_time": 0.133745091, "msgr_send_messages_queue_lat": { "avgcount": 5, "sum": 0.054797003, "avgtime": 0.010959400 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "msgr_recv_encrypted_bytes": 347328, "msgr_send_encrypted_bytes": 1136 } } ], "AsyncMessenger::Worker-2": [ { "labels": {}, "counters": { "msgr_recv_messages": 52, "msgr_send_messages": 8, "msgr_recv_bytes": 1965600, "msgr_send_bytes": 1600, "msgr_created_connections": 2, "msgr_active_connections": 1, "msgr_running_total_time": 0.986275508, "msgr_running_send_time": 0.007191906, "msgr_running_recv_time": 1.891958650, "msgr_running_fast_dispatch_time": 0.000000000, "msgr_send_messages_queue_lat": { "avgcount": 8, "sum": 0.161009804, "avgtime": 0.020126225 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "msgr_recv_encrypted_bytes": 1965600, "msgr_send_encrypted_bytes": 1600 } } ], "cct": [ { "labels": {}, "counters": { "total_workers": 0, "unhealthy_workers": 0 } } ], "cephfs_mirror": [ { "labels": {}, "counters": { "mirrored_filesystems": 1, "mirror_enable_failures": 0 } } ], "cephfs_mirror_mirrored_filesystems": [ { "labels": { "filesystem": "cephfs" }, "counters": { "mirroring_peers": 0, "directory_count": 0 } } ], "mempool": [ { "labels": {}, "counters": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_cache_buffer_bytes": 0, "bluestore_cache_buffer_items": 0, "bluestore_extent_bytes": 0, "bluestore_extent_items": 0, "bluestore_blob_bytes": 0, "bluestore_blob_items": 0, "bluestore_shared_blob_bytes": 0, "bluestore_shared_blob_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_items": 0, "bluefs_bytes": 0, "bluefs_items": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "buffer_anon_bytes": 183567, "buffer_anon_items": 55, "buffer_meta_bytes": 0, "buffer_meta_items": 0, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 18952, "osdmap_items": 184, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "mds_co_bytes": 0, "mds_co_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 } } ], "objecter": [ { "labels": {}, "counters": { "op_active": 0, "op_laggy": 0, "op_send": 0, "op_send_bytes": 0, "op_resend": 0, "op_reply": 0, "op_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "op_inflight": 0, "oplen_avg": { "avgcount": 0, "sum": 0 }, "op": 0, "op_r": 0, "op_w": 0, "op_rmw": 0, "op_pg": 0, "osdop_stat": 0, "osdop_create": 0, "osdop_read": 0, "osdop_write": 0, "osdop_writefull": 0, "osdop_writesame": 0, "osdop_append": 0, "osdop_zero": 0, "osdop_truncate": 0, "osdop_delete": 0, "osdop_mapext": 0, "osdop_sparse_read": 0, "osdop_clonerange": 0, "osdop_getxattr": 0, "osdop_setxattr": 0, "osdop_cmpxattr": 0, "osdop_rmxattr": 0, "osdop_resetxattrs": 0, "osdop_call": 0, "osdop_watch": 0, "osdop_notify": 0, "osdop_src_cmpxattr": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_other": 0, "linger_active": 0, "linger_send": 0, "linger_resend": 0, "linger_ping": 0, "poolop_active": 0, "poolop_send": 0, "poolop_resend": 0, "poolstat_active": 0, "poolstat_send": 0, "poolstat_resend": 0, "statfs_active": 0, "statfs_send": 0, "statfs_resend": 0, "command_active": 0, "command_send": 0, "command_resend": 0, "map_epoch": 0, "map_full": 0, "map_inc": 0, "osd_sessions": 0, "osd_session_open": 0, "osd_session_close": 0, "osd_laggy": 0, "omap_wr": 0, "omap_rd": 0, "omap_del": 0 } } ], "throttle-msgr_dispatch_throttler-client": [ { "labels": {}, "counters": { "val": 0, "max": 104857600, "get_started": 0, "get": 84, "get_sum": 335927, "get_or_fail_fail": 0, "get_or_fail_success": 84, "take": 0, "take_sum": 0, "put": 84, "put_sum": 335927, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ], "throttle-msgr_dispatch_throttler-radosclient": [ { "labels": {}, "counters": { "val": 0, "max": 104857600, "get_started": 0, "get": 58, "get_sum": 1958145, "get_or_fail_fail": 0, "get_or_fail_success": 58, "take": 0, "take_sum": 0, "put": 58, "put_sum": 1958145, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ], "throttle-objecter_bytes": [ { "labels": {}, "counters": { "val": 0, "max": 104857600, "get_started": 0, "get": 0, "get_sum": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "take": 0, "take_sum": 0, "put": 0, "put_sum": 0, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ], "throttle-objecter_ops": [ { "labels": {}, "counters": { "val": 0, "max": 1024, "get_started": 0, "get": 0, "get_sum": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "take": 0, "take_sum": 0, "put": 0, "put_sum": 0, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ] } 2024-03-16T07:31:36.621 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snapshot mirror disable cephfs 2024-03-16T07:31:37.279 INFO:teuthology.orchestra.run.smithi049.stdout:{} 2024-03-16T07:31:38.800 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T07:31:47.298 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-03-16T07:31:47.298 DEBUG:teuthology.orchestra.run.smithi049:mirror status for fs: cephfs> ceph --admin-daemon /var/run/ceph/cephfs-mirror.asok fs mirror status cephfs@10 2024-03-16T07:31:47.396 INFO:teuthology.orchestra.run.smithi049.stderr:no valid command found; 10 closest matches: 2024-03-16T07:31:47.396 INFO:teuthology.orchestra.run.smithi049.stderr:0 2024-03-16T07:31:47.396 INFO:teuthology.orchestra.run.smithi049.stderr:1 2024-03-16T07:31:47.396 INFO:teuthology.orchestra.run.smithi049.stderr:2 2024-03-16T07:31:47.396 INFO:teuthology.orchestra.run.smithi049.stderr:abort 2024-03-16T07:31:47.396 INFO:teuthology.orchestra.run.smithi049.stderr:assert 2024-03-16T07:31:47.396 INFO:teuthology.orchestra.run.smithi049.stderr:config diff 2024-03-16T07:31:47.396 INFO:teuthology.orchestra.run.smithi049.stderr:config diff get 2024-03-16T07:31:47.396 INFO:teuthology.orchestra.run.smithi049.stderr:config get 2024-03-16T07:31:47.396 INFO:teuthology.orchestra.run.smithi049.stderr:config help [] 2024-03-16T07:31:47.397 INFO:teuthology.orchestra.run.smithi049.stderr:config set ... 2024-03-16T07:31:47.397 INFO:teuthology.orchestra.run.smithi049.stderr:admin_socket: invalid command 2024-03-16T07:31:47.397 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-03-16T07:31:47.398 WARNING:tasks.cephfs.test_mirroring:mirror daemon command with label "mirror status for fs: cephfs" failed: Command failed (mirror status for fs: cephfs) on smithi049 with status 22: 'ceph --admin-daemon /var/run/ceph/cephfs-mirror.asok fs mirror status cephfs@10' 2024-03-16T07:31:47.398 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-03-16T07:31:47.398 DEBUG:teuthology.orchestra.run.smithi049:counter dump for fs: cephfs> ceph --admin-daemon /var/run/ceph/cephfs-mirror.asok counter dump 2024-03-16T07:31:47.515 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-03-16T07:31:47.515 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker": [ 2024-03-16T07:31:47.515 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:31:47.515 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:31:47.515 INFO:teuthology.orchestra.run.smithi049.stdout: "id": "0" 2024-03-16T07:31:47.515 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:31:47.515 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:31:47.516 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_ready_timeouts": 0, 2024-03-16T07:31:47.516 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_idle_timeouts": 0 2024-03-16T07:31:47.516 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:31:47.516 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:31:47.516 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:31:47.516 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:31:47.516 INFO:teuthology.orchestra.run.smithi049.stdout: "id": "1" 2024-03-16T07:31:47.516 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:31:47.516 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:31:47.516 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_ready_timeouts": 0, 2024-03-16T07:31:47.516 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_idle_timeouts": 0 2024-03-16T07:31:47.516 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:31:47.516 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:31:47.516 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:31:47.516 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:31:47.517 INFO:teuthology.orchestra.run.smithi049.stdout: "id": "2" 2024-03-16T07:31:47.517 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:31:47.517 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:31:47.517 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_ready_timeouts": 0, 2024-03-16T07:31:47.517 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_idle_timeouts": 0 2024-03-16T07:31:47.517 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:31:47.517 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:31:47.517 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:31:47.517 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-0": [ 2024-03-16T07:31:47.517 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:31:47.517 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:31:47.517 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:31:47.517 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 9, 2024-03-16T07:31:47.518 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 90, 2024-03-16T07:31:47.518 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 1296, 2024-03-16T07:31:47.518 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 729776, 2024-03-16T07:31:47.518 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 18, 2024-03-16T07:31:47.518 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 5, 2024-03-16T07:31:47.518 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 0.285659361, 2024-03-16T07:31:47.518 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.095236691, 2024-03-16T07:31:47.518 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 0.151373566, 2024-03-16T07:31:47.518 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-03-16T07:31:47.518 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T07:31:47.518 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 82, 2024-03-16T07:31:47.518 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.169570323, 2024-03-16T07:31:47.518 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.002067930 2024-03-16T07:31:47.518 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:31:47.519 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-03-16T07:31:47.519 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:31:47.519 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:31:47.519 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:31:47.519 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:31:47.519 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 1296, 2024-03-16T07:31:47.519 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 729776 2024-03-16T07:31:47.519 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:31:47.519 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:31:47.519 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:31:47.519 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-1": [ 2024-03-16T07:31:47.519 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:31:47.519 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:31:47.519 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:31:47.520 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 85, 2024-03-16T07:31:47.520 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 5, 2024-03-16T07:31:47.520 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 352208, 2024-03-16T07:31:47.520 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 1136, 2024-03-16T07:31:47.520 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 3, 2024-03-16T07:31:47.520 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 0, 2024-03-16T07:31:47.520 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 0.439532234, 2024-03-16T07:31:47.520 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.004463339, 2024-03-16T07:31:47.520 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 0.283742671, 2024-03-16T07:31:47.520 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.135474423, 2024-03-16T07:31:47.520 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T07:31:47.520 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 5, 2024-03-16T07:31:47.520 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.054797003, 2024-03-16T07:31:47.520 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.010959400 2024-03-16T07:31:47.521 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:31:47.521 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-03-16T07:31:47.521 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:31:47.521 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:31:47.521 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:31:47.521 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:31:47.521 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 352208, 2024-03-16T07:31:47.521 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 1136 2024-03-16T07:31:47.521 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:31:47.521 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:31:47.521 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:31:47.521 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-2": [ 2024-03-16T07:31:47.521 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:31:47.521 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:31:47.521 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:31:47.522 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 52, 2024-03-16T07:31:47.522 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 8, 2024-03-16T07:31:47.522 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 1965600, 2024-03-16T07:31:47.522 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 1600, 2024-03-16T07:31:47.522 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 2, 2024-03-16T07:31:47.522 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 1, 2024-03-16T07:31:47.522 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 0.986664628, 2024-03-16T07:31:47.522 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.007245065, 2024-03-16T07:31:47.522 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 1.892103658, 2024-03-16T07:31:47.522 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-03-16T07:31:47.522 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T07:31:47.522 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 8, 2024-03-16T07:31:47.522 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.161009804, 2024-03-16T07:31:47.523 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.020126225 2024-03-16T07:31:47.523 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:31:47.523 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-03-16T07:31:47.523 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:31:47.523 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:31:47.523 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:31:47.523 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:31:47.523 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 1965600, 2024-03-16T07:31:47.523 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 1600 2024-03-16T07:31:47.523 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:31:47.523 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:31:47.523 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:31:47.523 INFO:teuthology.orchestra.run.smithi049.stdout: "cct": [ 2024-03-16T07:31:47.524 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:31:47.524 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:31:47.524 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:31:47.524 INFO:teuthology.orchestra.run.smithi049.stdout: "total_workers": 0, 2024-03-16T07:31:47.524 INFO:teuthology.orchestra.run.smithi049.stdout: "unhealthy_workers": 0 2024-03-16T07:31:47.524 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:31:47.524 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:31:47.524 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:31:47.524 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs_mirror": [ 2024-03-16T07:31:47.524 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:31:47.524 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:31:47.524 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:31:47.524 INFO:teuthology.orchestra.run.smithi049.stdout: "mirrored_filesystems": 0, 2024-03-16T07:31:47.524 INFO:teuthology.orchestra.run.smithi049.stdout: "mirror_enable_failures": 0 2024-03-16T07:31:47.524 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:31:47.524 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:31:47.525 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:31:47.525 INFO:teuthology.orchestra.run.smithi049.stdout: "mempool": [ 2024-03-16T07:31:47.525 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:31:47.525 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:31:47.525 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:31:47.525 INFO:teuthology.orchestra.run.smithi049.stdout: "bloom_filter_bytes": 0, 2024-03-16T07:31:47.525 INFO:teuthology.orchestra.run.smithi049.stdout: "bloom_filter_items": 0, 2024-03-16T07:31:47.525 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_alloc_bytes": 0, 2024-03-16T07:31:47.525 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_alloc_items": 0, 2024-03-16T07:31:47.525 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_data_bytes": 0, 2024-03-16T07:31:47.525 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_data_items": 0, 2024-03-16T07:31:47.525 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_onode_bytes": 0, 2024-03-16T07:31:47.525 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_onode_items": 0, 2024-03-16T07:31:47.525 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_meta_bytes": 0, 2024-03-16T07:31:47.525 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_meta_items": 0, 2024-03-16T07:31:47.526 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_other_bytes": 0, 2024-03-16T07:31:47.526 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_other_items": 0, 2024-03-16T07:31:47.526 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_buffer_bytes": 0, 2024-03-16T07:31:47.526 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_buffer_items": 0, 2024-03-16T07:31:47.526 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_extent_bytes": 0, 2024-03-16T07:31:47.526 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_extent_items": 0, 2024-03-16T07:31:47.526 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_blob_bytes": 0, 2024-03-16T07:31:47.526 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_blob_items": 0, 2024-03-16T07:31:47.526 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_shared_blob_bytes": 0, 2024-03-16T07:31:47.526 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_shared_blob_items": 0, 2024-03-16T07:31:47.526 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_inline_bl_bytes": 0, 2024-03-16T07:31:47.526 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_inline_bl_items": 0, 2024-03-16T07:31:47.526 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_fsck_bytes": 0, 2024-03-16T07:31:47.526 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_fsck_items": 0, 2024-03-16T07:31:47.526 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_txc_bytes": 0, 2024-03-16T07:31:47.527 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_txc_items": 0, 2024-03-16T07:31:47.527 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_deferred_bytes": 0, 2024-03-16T07:31:47.527 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_deferred_items": 0, 2024-03-16T07:31:47.527 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_bytes": 0, 2024-03-16T07:31:47.527 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_items": 0, 2024-03-16T07:31:47.527 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_bytes": 0, 2024-03-16T07:31:47.527 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_items": 0, 2024-03-16T07:31:47.527 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_reader_bytes": 0, 2024-03-16T07:31:47.527 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_reader_items": 0, 2024-03-16T07:31:47.527 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_writer_bytes": 0, 2024-03-16T07:31:47.527 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_writer_items": 0, 2024-03-16T07:31:47.527 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_anon_bytes": 149234, 2024-03-16T07:31:47.527 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_anon_items": 26, 2024-03-16T07:31:47.527 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_meta_bytes": 0, 2024-03-16T07:31:47.527 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_meta_items": 0, 2024-03-16T07:31:47.527 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_bytes": 0, 2024-03-16T07:31:47.527 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_items": 0, 2024-03-16T07:31:47.528 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_mapbl_bytes": 0, 2024-03-16T07:31:47.528 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_mapbl_items": 0, 2024-03-16T07:31:47.528 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pglog_bytes": 0, 2024-03-16T07:31:47.528 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pglog_items": 0, 2024-03-16T07:31:47.528 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_bytes": 4824, 2024-03-16T07:31:47.528 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_items": 52, 2024-03-16T07:31:47.528 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_mapping_bytes": 0, 2024-03-16T07:31:47.528 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_mapping_items": 0, 2024-03-16T07:31:47.528 INFO:teuthology.orchestra.run.smithi049.stdout: "pgmap_bytes": 0, 2024-03-16T07:31:47.528 INFO:teuthology.orchestra.run.smithi049.stdout: "pgmap_items": 0, 2024-03-16T07:31:47.528 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_co_bytes": 0, 2024-03-16T07:31:47.528 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_co_items": 0, 2024-03-16T07:31:47.528 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_1_bytes": 0, 2024-03-16T07:31:47.528 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_1_items": 0, 2024-03-16T07:31:47.528 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_2_bytes": 0, 2024-03-16T07:31:47.528 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_2_items": 0 2024-03-16T07:31:47.528 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:31:47.529 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:31:47.529 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:31:47.529 INFO:teuthology.orchestra.run.smithi049.stdout: "objecter": [ 2024-03-16T07:31:47.529 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:31:47.529 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:31:47.529 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:31:47.529 INFO:teuthology.orchestra.run.smithi049.stdout: "op_active": 0, 2024-03-16T07:31:47.529 INFO:teuthology.orchestra.run.smithi049.stdout: "op_laggy": 0, 2024-03-16T07:31:47.529 INFO:teuthology.orchestra.run.smithi049.stdout: "op_send": 0, 2024-03-16T07:31:47.529 INFO:teuthology.orchestra.run.smithi049.stdout: "op_send_bytes": 0, 2024-03-16T07:31:47.529 INFO:teuthology.orchestra.run.smithi049.stdout: "op_resend": 0, 2024-03-16T07:31:47.529 INFO:teuthology.orchestra.run.smithi049.stdout: "op_reply": 0, 2024-03-16T07:31:47.529 INFO:teuthology.orchestra.run.smithi049.stdout: "op_latency": { 2024-03-16T07:31:47.529 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:31:47.529 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:31:47.529 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:31:47.530 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:31:47.530 INFO:teuthology.orchestra.run.smithi049.stdout: "op_inflight": 0, 2024-03-16T07:31:47.530 INFO:teuthology.orchestra.run.smithi049.stdout: "oplen_avg": { 2024-03-16T07:31:47.530 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:31:47.530 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0 2024-03-16T07:31:47.530 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:31:47.530 INFO:teuthology.orchestra.run.smithi049.stdout: "op": 0, 2024-03-16T07:31:47.530 INFO:teuthology.orchestra.run.smithi049.stdout: "op_r": 0, 2024-03-16T07:31:47.530 INFO:teuthology.orchestra.run.smithi049.stdout: "op_w": 0, 2024-03-16T07:31:47.530 INFO:teuthology.orchestra.run.smithi049.stdout: "op_rmw": 0, 2024-03-16T07:31:47.530 INFO:teuthology.orchestra.run.smithi049.stdout: "op_pg": 0, 2024-03-16T07:31:47.530 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_stat": 0, 2024-03-16T07:31:47.530 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_create": 0, 2024-03-16T07:31:47.530 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_read": 0, 2024-03-16T07:31:47.531 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_write": 0, 2024-03-16T07:31:47.531 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_writefull": 0, 2024-03-16T07:31:47.531 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_writesame": 0, 2024-03-16T07:31:47.531 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_append": 0, 2024-03-16T07:31:47.531 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_zero": 0, 2024-03-16T07:31:47.531 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_truncate": 0, 2024-03-16T07:31:47.531 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_delete": 0, 2024-03-16T07:31:47.531 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_mapext": 0, 2024-03-16T07:31:47.531 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_sparse_read": 0, 2024-03-16T07:31:47.531 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_clonerange": 0, 2024-03-16T07:31:47.531 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_getxattr": 0, 2024-03-16T07:31:47.531 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_setxattr": 0, 2024-03-16T07:31:47.531 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_cmpxattr": 0, 2024-03-16T07:31:47.531 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_rmxattr": 0, 2024-03-16T07:31:47.531 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_resetxattrs": 0, 2024-03-16T07:31:47.531 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_call": 0, 2024-03-16T07:31:47.532 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_watch": 0, 2024-03-16T07:31:47.532 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_notify": 0, 2024-03-16T07:31:47.532 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_src_cmpxattr": 0, 2024-03-16T07:31:47.532 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_pgls": 0, 2024-03-16T07:31:47.532 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_pgls_filter": 0, 2024-03-16T07:31:47.532 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_other": 0, 2024-03-16T07:31:47.532 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_active": 0, 2024-03-16T07:31:47.532 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_send": 0, 2024-03-16T07:31:47.532 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_resend": 0, 2024-03-16T07:31:47.532 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_ping": 0, 2024-03-16T07:31:47.532 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_active": 0, 2024-03-16T07:31:47.532 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_send": 0, 2024-03-16T07:31:47.532 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_resend": 0, 2024-03-16T07:31:47.532 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_active": 0, 2024-03-16T07:31:47.532 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_send": 0, 2024-03-16T07:31:47.533 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_resend": 0, 2024-03-16T07:31:47.533 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_active": 0, 2024-03-16T07:31:47.533 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_send": 0, 2024-03-16T07:31:47.533 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_resend": 0, 2024-03-16T07:31:47.533 INFO:teuthology.orchestra.run.smithi049.stdout: "command_active": 0, 2024-03-16T07:31:47.533 INFO:teuthology.orchestra.run.smithi049.stdout: "command_send": 0, 2024-03-16T07:31:47.533 INFO:teuthology.orchestra.run.smithi049.stdout: "command_resend": 0, 2024-03-16T07:31:47.533 INFO:teuthology.orchestra.run.smithi049.stdout: "map_epoch": 0, 2024-03-16T07:31:47.533 INFO:teuthology.orchestra.run.smithi049.stdout: "map_full": 0, 2024-03-16T07:31:47.533 INFO:teuthology.orchestra.run.smithi049.stdout: "map_inc": 0, 2024-03-16T07:31:47.533 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_sessions": 0, 2024-03-16T07:31:47.533 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_session_open": 0, 2024-03-16T07:31:47.533 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_session_close": 0, 2024-03-16T07:31:47.533 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_laggy": 0, 2024-03-16T07:31:47.533 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_wr": 0, 2024-03-16T07:31:47.534 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_rd": 0, 2024-03-16T07:31:47.534 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_del": 0 2024-03-16T07:31:47.534 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:31:47.534 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:31:47.534 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:31:47.534 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-msgr_dispatch_throttler-client": [ 2024-03-16T07:31:47.534 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:31:47.534 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:31:47.534 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:31:47.534 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:31:47.534 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-03-16T07:31:47.534 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:31:47.534 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 85, 2024-03-16T07:31:47.534 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 340673, 2024-03-16T07:31:47.534 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:31:47.534 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 85, 2024-03-16T07:31:47.535 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:31:47.535 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:31:47.535 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 85, 2024-03-16T07:31:47.535 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 340673, 2024-03-16T07:31:47.535 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:31:47.535 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:31:47.535 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:31:47.535 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:31:47.535 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:31:47.535 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:31:47.535 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:31:47.535 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:31:47.535 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-msgr_dispatch_throttler-radosclient": [ 2024-03-16T07:31:47.535 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:31:47.535 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:31:47.535 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:31:47.535 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:31:47.536 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-03-16T07:31:47.536 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:31:47.536 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 58, 2024-03-16T07:31:47.536 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 1958145, 2024-03-16T07:31:47.536 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:31:47.536 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 58, 2024-03-16T07:31:47.536 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:31:47.536 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:31:47.536 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 58, 2024-03-16T07:31:47.536 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 1958145, 2024-03-16T07:31:47.536 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:31:47.536 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:31:47.536 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:31:47.536 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:31:47.536 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:31:47.536 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:31:47.537 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:31:47.537 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:31:47.537 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-objecter_bytes": [ 2024-03-16T07:31:47.537 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:31:47.537 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:31:47.537 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:31:47.537 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:31:47.537 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-03-16T07:31:47.537 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:31:47.537 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 0, 2024-03-16T07:31:47.537 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 0, 2024-03-16T07:31:47.537 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:31:47.537 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 0, 2024-03-16T07:31:47.537 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:31:47.537 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:31:47.537 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 0, 2024-03-16T07:31:47.538 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 0, 2024-03-16T07:31:47.538 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:31:47.538 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:31:47.538 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:31:47.538 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:31:47.538 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:31:47.538 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:31:47.538 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:31:47.538 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:31:47.538 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-objecter_ops": [ 2024-03-16T07:31:47.538 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:31:47.538 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:31:47.538 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:31:47.538 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:31:47.538 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 1024, 2024-03-16T07:31:47.539 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:31:47.539 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 0, 2024-03-16T07:31:47.539 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 0, 2024-03-16T07:31:47.539 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:31:47.539 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 0, 2024-03-16T07:31:47.539 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:31:47.539 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:31:47.539 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 0, 2024-03-16T07:31:47.539 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 0, 2024-03-16T07:31:47.539 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:31:47.539 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:31:47.539 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:31:47.539 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:31:47.539 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:31:47.539 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:31:47.540 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:31:47.540 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2024-03-16T07:31:47.540 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-03-16T07:31:47.540 DEBUG:tasks.cephfs.test_mirroring:command returned={ "AsyncMessenger::Worker": [ { "labels": { "id": "0" }, "counters": { "msgr_connection_ready_timeouts": 0, "msgr_connection_idle_timeouts": 0 } }, { "labels": { "id": "1" }, "counters": { "msgr_connection_ready_timeouts": 0, "msgr_connection_idle_timeouts": 0 } }, { "labels": { "id": "2" }, "counters": { "msgr_connection_ready_timeouts": 0, "msgr_connection_idle_timeouts": 0 } } ], "AsyncMessenger::Worker-0": [ { "labels": {}, "counters": { "msgr_recv_messages": 9, "msgr_send_messages": 90, "msgr_recv_bytes": 1296, "msgr_send_bytes": 729776, "msgr_created_connections": 18, "msgr_active_connections": 5, "msgr_running_total_time": 0.285659361, "msgr_running_send_time": 0.095236691, "msgr_running_recv_time": 0.151373566, "msgr_running_fast_dispatch_time": 0.000000000, "msgr_send_messages_queue_lat": { "avgcount": 82, "sum": 0.169570323, "avgtime": 0.002067930 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "msgr_recv_encrypted_bytes": 1296, "msgr_send_encrypted_bytes": 729776 } } ], "AsyncMessenger::Worker-1": [ { "labels": {}, "counters": { "msgr_recv_messages": 85, "msgr_send_messages": 5, "msgr_recv_bytes": 352208, "msgr_send_bytes": 1136, "msgr_created_connections": 3, "msgr_active_connections": 0, "msgr_running_total_time": 0.439532234, "msgr_running_send_time": 0.004463339, "msgr_running_recv_time": 0.283742671, "msgr_running_fast_dispatch_time": 0.135474423, "msgr_send_messages_queue_lat": { "avgcount": 5, "sum": 0.054797003, "avgtime": 0.010959400 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "msgr_recv_encrypted_bytes": 352208, "msgr_send_encrypted_bytes": 1136 } } ], "AsyncMessenger::Worker-2": [ { "labels": {}, "counters": { "msgr_recv_messages": 52, "msgr_send_messages": 8, "msgr_recv_bytes": 1965600, "msgr_send_bytes": 1600, "msgr_created_connections": 2, "msgr_active_connections": 1, "msgr_running_total_time": 0.986664628, "msgr_running_send_time": 0.007245065, "msgr_running_recv_time": 1.892103658, "msgr_running_fast_dispatch_time": 0.000000000, "msgr_send_messages_queue_lat": { "avgcount": 8, "sum": 0.161009804, "avgtime": 0.020126225 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "msgr_recv_encrypted_bytes": 1965600, "msgr_send_encrypted_bytes": 1600 } } ], "cct": [ { "labels": {}, "counters": { "total_workers": 0, "unhealthy_workers": 0 } } ], "cephfs_mirror": [ { "labels": {}, "counters": { "mirrored_filesystems": 0, "mirror_enable_failures": 0 } } ], "mempool": [ { "labels": {}, "counters": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_cache_buffer_bytes": 0, "bluestore_cache_buffer_items": 0, "bluestore_extent_bytes": 0, "bluestore_extent_items": 0, "bluestore_blob_bytes": 0, "bluestore_blob_items": 0, "bluestore_shared_blob_bytes": 0, "bluestore_shared_blob_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_items": 0, "bluefs_bytes": 0, "bluefs_items": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "buffer_anon_bytes": 149234, "buffer_anon_items": 26, "buffer_meta_bytes": 0, "buffer_meta_items": 0, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 4824, "osdmap_items": 52, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "mds_co_bytes": 0, "mds_co_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 } } ], "objecter": [ { "labels": {}, "counters": { "op_active": 0, "op_laggy": 0, "op_send": 0, "op_send_bytes": 0, "op_resend": 0, "op_reply": 0, "op_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "op_inflight": 0, "oplen_avg": { "avgcount": 0, "sum": 0 }, "op": 0, "op_r": 0, "op_w": 0, "op_rmw": 0, "op_pg": 0, "osdop_stat": 0, "osdop_create": 0, "osdop_read": 0, "osdop_write": 0, "osdop_writefull": 0, "osdop_writesame": 0, "osdop_append": 0, "osdop_zero": 0, "osdop_truncate": 0, "osdop_delete": 0, "osdop_mapext": 0, "osdop_sparse_read": 0, "osdop_clonerange": 0, "osdop_getxattr": 0, "osdop_setxattr": 0, "osdop_cmpxattr": 0, "osdop_rmxattr": 0, "osdop_resetxattrs": 0, "osdop_call": 0, "osdop_watch": 0, "osdop_notify": 0, "osdop_src_cmpxattr": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_other": 0, "linger_active": 0, "linger_send": 0, "linger_resend": 0, "linger_ping": 0, "poolop_active": 0, "poolop_send": 0, "poolop_resend": 0, "poolstat_active": 0, "poolstat_send": 0, "poolstat_resend": 0, "statfs_active": 0, "statfs_send": 0, "statfs_resend": 0, "command_active": 0, "command_send": 0, "command_resend": 0, "map_epoch": 0, "map_full": 0, "map_inc": 0, "osd_sessions": 0, "osd_session_open": 0, "osd_session_close": 0, "osd_laggy": 0, "omap_wr": 0, "omap_rd": 0, "omap_del": 0 } } ], "throttle-msgr_dispatch_throttler-client": [ { "labels": {}, "counters": { "val": 0, "max": 104857600, "get_started": 0, "get": 85, "get_sum": 340673, "get_or_fail_fail": 0, "get_or_fail_success": 85, "take": 0, "take_sum": 0, "put": 85, "put_sum": 340673, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ], "throttle-msgr_dispatch_throttler-radosclient": [ { "labels": {}, "counters": { "val": 0, "max": 104857600, "get_started": 0, "get": 58, "get_sum": 1958145, "get_or_fail_fail": 0, "get_or_fail_success": 58, "take": 0, "take_sum": 0, "put": 58, "put_sum": 1958145, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ], "throttle-objecter_bytes": [ { "labels": {}, "counters": { "val": 0, "max": 104857600, "get_started": 0, "get": 0, "get_sum": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "take": 0, "take_sum": 0, "put": 0, "put_sum": 0, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ], "throttle-objecter_ops": [ { "labels": {}, "counters": { "val": 0, "max": 1024, "get_started": 0, "get": 0, "get_sum": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "take": 0, "take_sum": 0, "put": 0, "put_sum": 0, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ] } 2024-03-16T07:31:47.541 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable mirroring 2024-03-16T07:31:48.303 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-03-16T07:31:48.303 DEBUG:teuthology.orchestra.run.smithi049:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-03-16T07:31:48.358 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-03-16T07:31:48.359 INFO:tasks.cephfs.mount:Terminating background process 2024-03-16T07:31:48.359 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-03-16T07:31:48.359 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-16T07:31:48.375 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T07:31:48.836 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:31:48.837+0000 7f1ef724d040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-16T07:31:48.872 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:31:48.872 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":125,"fsid":"f91af061-9eac-4793-87fa-8d27ae3d242f","created":"2024-03-16T07:24:20.357868+0000","modified":"2024-03-16T07:31:38.279332+0000","last_up_change":"2024-03-16T07:24:27.474980+0000","last_in_change":"2024-03-16T07:24:21.254179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T07:24:28.947521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2024-03-16T07:30:56.548783+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2024-03-16T07:30:57.216365+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"119","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"backup_fs_metadata","create_time":"2024-03-16T07:31:10.087893+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"backup_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.309999942779541,"score_stable":1.309999942779541,"optimal_score":1,"raw_score_acting":1.309999942779541,"raw_score_stable":1.309999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"backup_fs_data","create_time":"2024-03-16T07:31:11.310351+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"123","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"backup_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1699999570846558,"score_stable":1.1699999570846558,"optimal_score":1,"raw_score_acting":1.1699999570846558,"raw_score_stable":1.1699999570846558,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2df14aac-98dc-4e3c-ae7e-9eb677aa30be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6801","nonce":2744935777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6803","nonce":2744935777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6807","nonce":2744935777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6805","nonce":2744935777}]},"public_addr":"172.21.15.49:6801/2744935777","cluster_addr":"172.21.15.49:6803/2744935777","heartbeat_back_addr":"172.21.15.49:6807/2744935777","heartbeat_front_addr":"172.21.15.49:6805/2744935777","state":["exists","up"]},{"osd":1,"uuid":"80461bd9-59ef-46df-9eea-bad92d960c57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6811","nonce":1655120118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6815","nonce":1655120118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6821","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6823","nonce":1655120118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6817","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6819","nonce":1655120118}]},"public_addr":"172.21.15.49:6811/1655120118","cluster_addr":"172.21.15.49:6815/1655120118","heartbeat_back_addr":"172.21.15.49:6823/1655120118","heartbeat_front_addr":"172.21.15.49:6819/1655120118","state":["exists","up"]},{"osd":2,"uuid":"d6bf40eb-6e42-4ec9-8b3d-0b6c5a6def79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6810","nonce":3815472376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6814","nonce":3815472376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6822","nonce":3815472376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6818","nonce":3815472376}]},"public_addr":"172.21.15.49:6810/3815472376","cluster_addr":"172.21.15.49:6814/3815472376","heartbeat_back_addr":"172.21.15.49:6822/3815472376","heartbeat_front_addr":"172.21.15.49:6818/3815472376","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.641492+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.668598+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.614940+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.49:0/1607336277":"2024-03-16T08:31:38.260139+0000","172.21.15.49:0/2796699112":"2024-03-17T07:31:24.218576+0000","172.21.15.49:0/4127385302":"2024-03-17T07:31:24.218576+0000","172.21.15.49:0/3937267129":"2024-03-17T07:31:24.218576+0000","172.21.15.49:0/934796449":"2024-03-17T07:31:24.218576+0000","172.21.15.49:0/2909845685":"2024-03-17T07:31:24.218576+0000","172.21.15.49:6825/4290948241":"2024-03-17T07:31:24.218576+0000","172.21.15.49:6824/4290948241":"2024-03-17T07:31:24.218576+0000","172.21.15.49:0/2032191852":"2024-03-17T07:31:24.218576+0000","172.21.15.49:0/269511731":"2024-03-17T07:31:24.218576+0000","172.21.15.49:0/726462256":"2024-03-17T07:31:24.218576+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T07:31:48.886 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-16T07:24:28.947521+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 20, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-16T07:30:56.548783+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '118', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 21, 'pool_name': 'cephfs_data', 'create_time': '2024-03-16T07:30:57.216365+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '119', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 22, 'pool_name': 'backup_fs_metadata', 'create_time': '2024-03-16T07:31:10.087893+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '122', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'backup_fs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.309999942779541, 'score_stable': 1.309999942779541, 'optimal_score': 1, 'raw_score_acting': 1.309999942779541, 'raw_score_stable': 1.309999942779541, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 23, 'pool_name': 'backup_fs_data', 'create_time': '2024-03-16T07:31:11.310351+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '123', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'backup_fs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1699999570846558, 'score_stable': 1.1699999570846558, 'optimal_score': 1, 'raw_score_acting': 1.1699999570846558, 'raw_score_stable': 1.1699999570846558, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-16T07:31:48.887 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-16T07:31:48.887 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:31:48.887+0000 7f1ef724d040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-16T07:31:49.253 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2024-03-16T07:31:49.271 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-16T07:31:49.316 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:31:49.317+0000 7f1ef724d040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-16T07:31:49.364 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:31:49.364+0000 7f1ef724d040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-16T07:31:49.411 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:31:49.411+0000 7f1ef724d040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-16T07:31:49.466 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:31:49.467+0000 7f1ef724d040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-16T07:31:49.511 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:31:49.512+0000 7f1ef724d040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-16T07:31:49.631 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:31:49.631+0000 7f1ef724d040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-16T07:31:49.687 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:31:49.688+0000 7f1ef724d040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-16T07:31:49.694 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2024-03-16T07:31:49.707 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-16T07:31:49.741 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:31:49.742+0000 7f1ef724d040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-16T07:31:49.822 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:31:49.822+0000 7f1ef724d040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-16T07:31:49.885 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:31:49.886+0000 7f1ef724d040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-16T07:31:50.087 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2024-03-16T07:31:50.101 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get backup_fs_metadata pg_num 2024-03-16T07:31:50.251 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:31:50.251+0000 7f1ef724d040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-16T07:31:50.454 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:31:50.455+0000 7f1ef724d040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-16T07:31:50.469 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2024-03-16T07:31:50.483 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get backup_fs_data pg_num 2024-03-16T07:31:50.565 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:31:50.566+0000 7f1ef724d040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-16T07:31:50.613 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:31:50.614+0000 7f1ef724d040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-16T07:31:50.731 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:31:50.732+0000 7f1ef724d040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-16T07:31:50.828 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:31:50.828+0000 7f1ef724d040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-16T07:31:50.895 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2024-03-16T07:31:50.914 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-16T07:31:51.083 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:31:51.084+0000 7f1ef724d040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-16T07:31:51.151 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:31:51.152+0000 7f1ef724d040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-16T07:31:51.325 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:31:51.326+0000 7f1ef724d040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-16T07:31:51.339 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/1607336277 2024-03-16T08:31:38.260139+0000 2024-03-16T07:31:51.339 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/2796699112 2024-03-17T07:31:24.218576+0000 2024-03-16T07:31:51.340 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/4127385302 2024-03-17T07:31:24.218576+0000 2024-03-16T07:31:51.340 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/3937267129 2024-03-17T07:31:24.218576+0000 2024-03-16T07:31:51.340 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/934796449 2024-03-17T07:31:24.218576+0000 2024-03-16T07:31:51.340 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/2909845685 2024-03-17T07:31:24.218576+0000 2024-03-16T07:31:51.340 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:6825/4290948241 2024-03-17T07:31:24.218576+0000 2024-03-16T07:31:51.340 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:6824/4290948241 2024-03-17T07:31:24.218576+0000 2024-03-16T07:31:51.340 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/2032191852 2024-03-17T07:31:24.218576+0000 2024-03-16T07:31:51.340 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/269511731 2024-03-17T07:31:24.218576+0000 2024-03-16T07:31:51.340 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/726462256 2024-03-17T07:31:24.218576+0000 2024-03-16T07:31:51.340 INFO:teuthology.orchestra.run.smithi049.stderr:listed 11 entries 2024-03-16T07:31:51.353 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi049.front.sepia.ceph.com... 2024-03-16T07:31:51.353 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:31:51.353 DEBUG:teuthology.orchestra.run.smithi049:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-03-16T07:31:51.382 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi049.stderr:ceph-fuse[70210]: fuse finished with error 0 and tester_r 0 2024-03-16T07:31:51.385 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi049.front.sepia.ceph.com 2024-03-16T07:31:51.385 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:31:51.385 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-03-16T07:31:51.494 INFO:tasks.cephfs.mount:Terminating background process 2024-03-16T07:31:51.495 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-03-16T07:31:51.495 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-16T07:31:51.512 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T07:31:51.860 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:31:51.860 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":125,"fsid":"f91af061-9eac-4793-87fa-8d27ae3d242f","created":"2024-03-16T07:24:20.357868+0000","modified":"2024-03-16T07:31:38.279332+0000","last_up_change":"2024-03-16T07:24:27.474980+0000","last_in_change":"2024-03-16T07:24:21.254179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T07:24:28.947521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2024-03-16T07:30:56.548783+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2024-03-16T07:30:57.216365+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"119","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"backup_fs_metadata","create_time":"2024-03-16T07:31:10.087893+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"backup_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.309999942779541,"score_stable":1.309999942779541,"optimal_score":1,"raw_score_acting":1.309999942779541,"raw_score_stable":1.309999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"backup_fs_data","create_time":"2024-03-16T07:31:11.310351+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"123","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"backup_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1699999570846558,"score_stable":1.1699999570846558,"optimal_score":1,"raw_score_acting":1.1699999570846558,"raw_score_stable":1.1699999570846558,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2df14aac-98dc-4e3c-ae7e-9eb677aa30be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6801","nonce":2744935777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6803","nonce":2744935777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6807","nonce":2744935777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6805","nonce":2744935777}]},"public_addr":"172.21.15.49:6801/2744935777","cluster_addr":"172.21.15.49:6803/2744935777","heartbeat_back_addr":"172.21.15.49:6807/2744935777","heartbeat_front_addr":"172.21.15.49:6805/2744935777","state":["exists","up"]},{"osd":1,"uuid":"80461bd9-59ef-46df-9eea-bad92d960c57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6811","nonce":1655120118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6815","nonce":1655120118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6821","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6823","nonce":1655120118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6817","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6819","nonce":1655120118}]},"public_addr":"172.21.15.49:6811/1655120118","cluster_addr":"172.21.15.49:6815/1655120118","heartbeat_back_addr":"172.21.15.49:6823/1655120118","heartbeat_front_addr":"172.21.15.49:6819/1655120118","state":["exists","up"]},{"osd":2,"uuid":"d6bf40eb-6e42-4ec9-8b3d-0b6c5a6def79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6810","nonce":3815472376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6814","nonce":3815472376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6822","nonce":3815472376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6818","nonce":3815472376}]},"public_addr":"172.21.15.49:6810/3815472376","cluster_addr":"172.21.15.49:6814/3815472376","heartbeat_back_addr":"172.21.15.49:6822/3815472376","heartbeat_front_addr":"172.21.15.49:6818/3815472376","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.641492+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.668598+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.614940+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.49:0/1607336277":"2024-03-16T08:31:38.260139+0000","172.21.15.49:0/2796699112":"2024-03-17T07:31:24.218576+0000","172.21.15.49:0/4127385302":"2024-03-17T07:31:24.218576+0000","172.21.15.49:0/3937267129":"2024-03-17T07:31:24.218576+0000","172.21.15.49:0/934796449":"2024-03-17T07:31:24.218576+0000","172.21.15.49:0/2909845685":"2024-03-17T07:31:24.218576+0000","172.21.15.49:6825/4290948241":"2024-03-17T07:31:24.218576+0000","172.21.15.49:6824/4290948241":"2024-03-17T07:31:24.218576+0000","172.21.15.49:0/2032191852":"2024-03-17T07:31:24.218576+0000","172.21.15.49:0/269511731":"2024-03-17T07:31:24.218576+0000","172.21.15.49:0/726462256":"2024-03-17T07:31:24.218576+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T07:31:51.876 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-16T07:24:28.947521+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 20, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-16T07:30:56.548783+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '118', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 21, 'pool_name': 'cephfs_data', 'create_time': '2024-03-16T07:30:57.216365+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '119', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 22, 'pool_name': 'backup_fs_metadata', 'create_time': '2024-03-16T07:31:10.087893+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '122', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'backup_fs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.309999942779541, 'score_stable': 1.309999942779541, 'optimal_score': 1, 'raw_score_acting': 1.309999942779541, 'raw_score_stable': 1.309999942779541, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 23, 'pool_name': 'backup_fs_data', 'create_time': '2024-03-16T07:31:11.310351+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '123', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'backup_fs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1699999570846558, 'score_stable': 1.1699999570846558, 'optimal_score': 1, 'raw_score_acting': 1.1699999570846558, 'raw_score_stable': 1.1699999570846558, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-16T07:31:51.877 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-16T07:31:52.187 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:31:52.188+0000 7f1ef724d040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-16T07:31:52.274 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2024-03-16T07:31:52.292 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-16T07:31:52.600 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2024-03-16T07:31:52.601 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:31:52.602+0000 7f1ef724d040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-16T07:31:52.615 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-16T07:31:52.655 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:31:52.656+0000 7f1ef724d040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-16T07:31:52.783 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:31:52.784+0000 7f1ef724d040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-16T07:31:52.889 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:31:52.890+0000 7f1e7bd1d640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:31:52.889 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:31:52.890+0000 7f1e7bd1d640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:31:52.889 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:31:52.890+0000 7f1e7bd1d640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:31:52.890 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:31:52.890+0000 7f1e7bd1d640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:31:52.890 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:31:52.890+0000 7f1e7bd1d640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:31:52.890 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:31:52.890+0000 7f1e78d17640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:31:52.891 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:31:52.890+0000 7f1e78d17640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:31:52.891 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:31:52.890+0000 7f1e78d17640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:31:52.891 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:31:52.890+0000 7f1e78d17640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:31:52.891 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:31:52.890+0000 7f1e78d17640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:31:52.901 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:31:52.901+0000 7f1e78d17640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:31:52.901 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:31:52.901+0000 7f1e78d17640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:31:52.902 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:31:52.901+0000 7f1e78d17640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:31:52.902 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:31:52.901+0000 7f1e78d17640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:31:52.902 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:31:52.901+0000 7f1e78d17640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:31:52.902 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:31:52.903+0000 7f1e7bd1d640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:31:52.902 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:31:52.903+0000 7f1e7bd1d640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:31:52.903 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:31:52.903+0000 7f1e7bd1d640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:31:52.903 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:31:52.903+0000 7f1e7bd1d640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:31:52.903 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:31:52.903+0000 7f1e7bd1d640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:31:53.002 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2024-03-16T07:31:53.015 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get backup_fs_metadata pg_num 2024-03-16T07:31:53.410 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2024-03-16T07:31:53.426 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get backup_fs_data pg_num 2024-03-16T07:31:53.757 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2024-03-16T07:31:53.770 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-16T07:31:54.096 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/4108966126 2024-03-17T07:31:52.798658+0000 2024-03-16T07:31:54.097 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/1180114677 2024-03-17T07:31:52.798658+0000 2024-03-16T07:31:54.097 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/4162628828 2024-03-17T07:31:52.798658+0000 2024-03-16T07:31:54.097 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/895997313 2024-03-17T07:31:52.798658+0000 2024-03-16T07:31:54.097 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/2679898715 2024-03-17T07:31:52.798658+0000 2024-03-16T07:31:54.097 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/150444877 2024-03-17T07:31:52.798658+0000 2024-03-16T07:31:54.097 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/1607336277 2024-03-16T08:31:38.260139+0000 2024-03-16T07:31:54.097 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/2796699112 2024-03-17T07:31:24.218576+0000 2024-03-16T07:31:54.097 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/2644243140 2024-03-17T07:31:52.798658+0000 2024-03-16T07:31:54.097 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/4127385302 2024-03-17T07:31:24.218576+0000 2024-03-16T07:31:54.097 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:6824/880369579 2024-03-17T07:31:52.798658+0000 2024-03-16T07:31:54.097 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/4217593943 2024-03-17T07:31:52.798658+0000 2024-03-16T07:31:54.097 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/3937267129 2024-03-17T07:31:24.218576+0000 2024-03-16T07:31:54.097 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:6825/880369579 2024-03-17T07:31:52.798658+0000 2024-03-16T07:31:54.098 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/934796449 2024-03-17T07:31:24.218576+0000 2024-03-16T07:31:54.098 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/2909845685 2024-03-17T07:31:24.218576+0000 2024-03-16T07:31:54.098 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:6825/4290948241 2024-03-17T07:31:24.218576+0000 2024-03-16T07:31:54.098 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/3788890827 2024-03-17T07:31:52.798658+0000 2024-03-16T07:31:54.098 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:6824/4290948241 2024-03-17T07:31:24.218576+0000 2024-03-16T07:31:54.098 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/2032191852 2024-03-17T07:31:24.218576+0000 2024-03-16T07:31:54.098 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/269511731 2024-03-17T07:31:24.218576+0000 2024-03-16T07:31:54.098 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/726462256 2024-03-17T07:31:24.218576+0000 2024-03-16T07:31:54.098 INFO:teuthology.orchestra.run.smithi049.stderr:listed 22 entries 2024-03-16T07:31:54.109 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi049.front.sepia.ceph.com... 2024-03-16T07:31:54.109 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:31:54.109 DEBUG:teuthology.orchestra.run.smithi049:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2024-03-16T07:31:54.139 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi049.stderr:ceph-fuse[70628]: fuse finished with error 0 and tester_r 0 2024-03-16T07:31:54.140 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi049.front.sepia.ceph.com 2024-03-16T07:31:54.141 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:31:54.141 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-03-16T07:31:54.302 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T07:31:54.721 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:31:54.722 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":89,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5957,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6827/2832753094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":2832753094},{"type":"v1","addr":"172.21.15.49:6827","nonce":2832753094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":78},{"gid":5961,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6829/3236120377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":3236120377},{"type":"v1","addr":"172.21.15.49:6829","nonce":3236120377}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":78},{"gid":5964,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6831/1238434429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":1238434429},{"type":"v1","addr":"172.21.15.49:6831","nonce":1238434429}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":78}],"filesystems":[{"mdsmap":{"epoch":89,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-16T07:30:58.238420+0000","modified":"2024-03-16T07:31:36.952836+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5968},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5968":{"gid":5968,"name":"d","rank":0,"incarnation":79,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6835/790210824","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":790210824},{"type":"v1","addr":"172.21.15.49:6835","nonce":790210824}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5968,"qdb_cluster":[5968]},"id":10},{"mdsmap":{"epoch":87,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-16T07:31:12.498747+0000","modified":"2024-03-16T07:31:15.331790+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5965},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5965":{"gid":5965,"name":"c","rank":0,"incarnation":83,"state":"up:active","state_seq":6,"addr":"172.21.15.49:6833/4146414383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":4146414383},{"type":"v1","addr":"172.21.15.49:6833","nonce":4146414383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"backup_fs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5965,"qdb_cluster":[5965]},"id":11}]} 2024-03-16T07:31:54.722 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 89 2024-03-16T07:31:54.736 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T07:31:55.201 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:31:55.202 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":126,"fsid":"f91af061-9eac-4793-87fa-8d27ae3d242f","created":"2024-03-16T07:24:20.357868+0000","modified":"2024-03-16T07:31:52.798713+0000","last_up_change":"2024-03-16T07:24:27.474980+0000","last_in_change":"2024-03-16T07:24:21.254179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T07:24:28.947521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2024-03-16T07:30:56.548783+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2024-03-16T07:30:57.216365+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"119","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"backup_fs_metadata","create_time":"2024-03-16T07:31:10.087893+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"backup_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.309999942779541,"score_stable":1.309999942779541,"optimal_score":1,"raw_score_acting":1.309999942779541,"raw_score_stable":1.309999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"backup_fs_data","create_time":"2024-03-16T07:31:11.310351+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"123","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"backup_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1699999570846558,"score_stable":1.1699999570846558,"optimal_score":1,"raw_score_acting":1.1699999570846558,"raw_score_stable":1.1699999570846558,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2df14aac-98dc-4e3c-ae7e-9eb677aa30be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6801","nonce":2744935777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6803","nonce":2744935777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6807","nonce":2744935777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6805","nonce":2744935777}]},"public_addr":"172.21.15.49:6801/2744935777","cluster_addr":"172.21.15.49:6803/2744935777","heartbeat_back_addr":"172.21.15.49:6807/2744935777","heartbeat_front_addr":"172.21.15.49:6805/2744935777","state":["exists","up"]},{"osd":1,"uuid":"80461bd9-59ef-46df-9eea-bad92d960c57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6811","nonce":1655120118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6815","nonce":1655120118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6821","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6823","nonce":1655120118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6817","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6819","nonce":1655120118}]},"public_addr":"172.21.15.49:6811/1655120118","cluster_addr":"172.21.15.49:6815/1655120118","heartbeat_back_addr":"172.21.15.49:6823/1655120118","heartbeat_front_addr":"172.21.15.49:6819/1655120118","state":["exists","up"]},{"osd":2,"uuid":"d6bf40eb-6e42-4ec9-8b3d-0b6c5a6def79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6810","nonce":3815472376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6814","nonce":3815472376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6822","nonce":3815472376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6818","nonce":3815472376}]},"public_addr":"172.21.15.49:6810/3815472376","cluster_addr":"172.21.15.49:6814/3815472376","heartbeat_back_addr":"172.21.15.49:6822/3815472376","heartbeat_front_addr":"172.21.15.49:6818/3815472376","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.641492+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.668598+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.614940+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.49:0/4108966126":"2024-03-17T07:31:52.798658+0000","172.21.15.49:0/1180114677":"2024-03-17T07:31:52.798658+0000","172.21.15.49:0/4162628828":"2024-03-17T07:31:52.798658+0000","172.21.15.49:0/895997313":"2024-03-17T07:31:52.798658+0000","172.21.15.49:0/2679898715":"2024-03-17T07:31:52.798658+0000","172.21.15.49:0/150444877":"2024-03-17T07:31:52.798658+0000","172.21.15.49:0/1607336277":"2024-03-16T08:31:38.260139+0000","172.21.15.49:0/2796699112":"2024-03-17T07:31:24.218576+0000","172.21.15.49:0/2644243140":"2024-03-17T07:31:52.798658+0000","172.21.15.49:0/4127385302":"2024-03-17T07:31:24.218576+0000","172.21.15.49:6824/880369579":"2024-03-17T07:31:52.798658+0000","172.21.15.49:0/4217593943":"2024-03-17T07:31:52.798658+0000","172.21.15.49:0/3937267129":"2024-03-17T07:31:24.218576+0000","172.21.15.49:6825/880369579":"2024-03-17T07:31:52.798658+0000","172.21.15.49:0/934796449":"2024-03-17T07:31:24.218576+0000","172.21.15.49:0/2909845685":"2024-03-17T07:31:24.218576+0000","172.21.15.49:6825/4290948241":"2024-03-17T07:31:24.218576+0000","172.21.15.49:0/3788890827":"2024-03-17T07:31:52.798658+0000","172.21.15.49:6824/4290948241":"2024-03-17T07:31:24.218576+0000","172.21.15.49:0/2032191852":"2024-03-17T07:31:24.218576+0000","172.21.15.49:0/269511731":"2024-03-17T07:31:24.218576+0000","172.21.15.49:0/726462256":"2024-03-17T07:31:24.218576+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T07:31:55.215 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-16T07:24:28.947521+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 20, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-16T07:30:56.548783+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '118', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 21, 'pool_name': 'cephfs_data', 'create_time': '2024-03-16T07:30:57.216365+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '119', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 22, 'pool_name': 'backup_fs_metadata', 'create_time': '2024-03-16T07:31:10.087893+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '122', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'backup_fs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.309999942779541, 'score_stable': 1.309999942779541, 'optimal_score': 1, 'raw_score_acting': 1.309999942779541, 'raw_score_stable': 1.309999942779541, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 23, 'pool_name': 'backup_fs_data', 'create_time': '2024-03-16T07:31:11.310351+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '123', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'backup_fs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1699999570846558, 'score_stable': 1.1699999570846558, 'optimal_score': 1, 'raw_score_acting': 1.1699999570846558, 'raw_score_stable': 1.1699999570846558, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-16T07:31:55.215 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-16T07:31:55.580 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2024-03-16T07:31:55.593 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-16T07:31:55.907 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2024-03-16T07:31:55.920 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-16T07:31:56.310 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2024-03-16T07:31:56.323 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get backup_fs_metadata pg_num 2024-03-16T07:31:56.626 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2024-03-16T07:31:56.639 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get backup_fs_data pg_num 2024-03-16T07:31:56.942 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2024-03-16T07:31:56.955 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T07:31:57.299 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:31:57.299 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":89,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5957,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6827/2832753094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":2832753094},{"type":"v1","addr":"172.21.15.49:6827","nonce":2832753094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":78},{"gid":5961,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6829/3236120377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":3236120377},{"type":"v1","addr":"172.21.15.49:6829","nonce":3236120377}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":78},{"gid":5964,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6831/1238434429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":1238434429},{"type":"v1","addr":"172.21.15.49:6831","nonce":1238434429}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":78}],"filesystems":[{"mdsmap":{"epoch":89,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-16T07:30:58.238420+0000","modified":"2024-03-16T07:31:36.952836+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5968},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5968":{"gid":5968,"name":"d","rank":0,"incarnation":79,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6835/790210824","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":790210824},{"type":"v1","addr":"172.21.15.49:6835","nonce":790210824}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5968,"qdb_cluster":[5968]},"id":10},{"mdsmap":{"epoch":87,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-16T07:31:12.498747+0000","modified":"2024-03-16T07:31:15.331790+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5965},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5965":{"gid":5965,"name":"c","rank":0,"incarnation":83,"state":"up:active","state_seq":6,"addr":"172.21.15.49:6833/4146414383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":4146414383},{"type":"v1","addr":"172.21.15.49:6833","nonce":4146414383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"backup_fs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5965,"qdb_cluster":[5965]},"id":11}]} 2024-03-16T07:31:57.299 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 89 2024-03-16T07:31:57.313 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T07:31:57.618 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:31:57.618 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":126,"fsid":"f91af061-9eac-4793-87fa-8d27ae3d242f","created":"2024-03-16T07:24:20.357868+0000","modified":"2024-03-16T07:31:52.798713+0000","last_up_change":"2024-03-16T07:24:27.474980+0000","last_in_change":"2024-03-16T07:24:21.254179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T07:24:28.947521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2024-03-16T07:30:56.548783+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2024-03-16T07:30:57.216365+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"119","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"backup_fs_metadata","create_time":"2024-03-16T07:31:10.087893+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"backup_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.309999942779541,"score_stable":1.309999942779541,"optimal_score":1,"raw_score_acting":1.309999942779541,"raw_score_stable":1.309999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"backup_fs_data","create_time":"2024-03-16T07:31:11.310351+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"123","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"backup_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1699999570846558,"score_stable":1.1699999570846558,"optimal_score":1,"raw_score_acting":1.1699999570846558,"raw_score_stable":1.1699999570846558,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2df14aac-98dc-4e3c-ae7e-9eb677aa30be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6801","nonce":2744935777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6803","nonce":2744935777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6807","nonce":2744935777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6805","nonce":2744935777}]},"public_addr":"172.21.15.49:6801/2744935777","cluster_addr":"172.21.15.49:6803/2744935777","heartbeat_back_addr":"172.21.15.49:6807/2744935777","heartbeat_front_addr":"172.21.15.49:6805/2744935777","state":["exists","up"]},{"osd":1,"uuid":"80461bd9-59ef-46df-9eea-bad92d960c57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6811","nonce":1655120118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6815","nonce":1655120118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6821","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6823","nonce":1655120118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6817","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6819","nonce":1655120118}]},"public_addr":"172.21.15.49:6811/1655120118","cluster_addr":"172.21.15.49:6815/1655120118","heartbeat_back_addr":"172.21.15.49:6823/1655120118","heartbeat_front_addr":"172.21.15.49:6819/1655120118","state":["exists","up"]},{"osd":2,"uuid":"d6bf40eb-6e42-4ec9-8b3d-0b6c5a6def79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6810","nonce":3815472376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6814","nonce":3815472376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6822","nonce":3815472376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6818","nonce":3815472376}]},"public_addr":"172.21.15.49:6810/3815472376","cluster_addr":"172.21.15.49:6814/3815472376","heartbeat_back_addr":"172.21.15.49:6822/3815472376","heartbeat_front_addr":"172.21.15.49:6818/3815472376","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.641492+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.668598+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.614940+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.49:0/4108966126":"2024-03-17T07:31:52.798658+0000","172.21.15.49:0/1180114677":"2024-03-17T07:31:52.798658+0000","172.21.15.49:0/4162628828":"2024-03-17T07:31:52.798658+0000","172.21.15.49:0/895997313":"2024-03-17T07:31:52.798658+0000","172.21.15.49:0/2679898715":"2024-03-17T07:31:52.798658+0000","172.21.15.49:0/150444877":"2024-03-17T07:31:52.798658+0000","172.21.15.49:0/1607336277":"2024-03-16T08:31:38.260139+0000","172.21.15.49:0/2796699112":"2024-03-17T07:31:24.218576+0000","172.21.15.49:0/2644243140":"2024-03-17T07:31:52.798658+0000","172.21.15.49:0/4127385302":"2024-03-17T07:31:24.218576+0000","172.21.15.49:6824/880369579":"2024-03-17T07:31:52.798658+0000","172.21.15.49:0/4217593943":"2024-03-17T07:31:52.798658+0000","172.21.15.49:0/3937267129":"2024-03-17T07:31:24.218576+0000","172.21.15.49:6825/880369579":"2024-03-17T07:31:52.798658+0000","172.21.15.49:0/934796449":"2024-03-17T07:31:24.218576+0000","172.21.15.49:0/2909845685":"2024-03-17T07:31:24.218576+0000","172.21.15.49:6825/4290948241":"2024-03-17T07:31:24.218576+0000","172.21.15.49:0/3788890827":"2024-03-17T07:31:52.798658+0000","172.21.15.49:6824/4290948241":"2024-03-17T07:31:24.218576+0000","172.21.15.49:0/2032191852":"2024-03-17T07:31:24.218576+0000","172.21.15.49:0/269511731":"2024-03-17T07:31:24.218576+0000","172.21.15.49:0/726462256":"2024-03-17T07:31:24.218576+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T07:31:57.635 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-03-16T07:31:57.636 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T07:31:58.047 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:31:58.047 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":89,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5957,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6827/2832753094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":2832753094},{"type":"v1","addr":"172.21.15.49:6827","nonce":2832753094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":78},{"gid":5961,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6829/3236120377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":3236120377},{"type":"v1","addr":"172.21.15.49:6829","nonce":3236120377}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":78},{"gid":5964,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6831/1238434429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":1238434429},{"type":"v1","addr":"172.21.15.49:6831","nonce":1238434429}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":78}],"filesystems":[{"mdsmap":{"epoch":89,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-16T07:30:58.238420+0000","modified":"2024-03-16T07:31:36.952836+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5968},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5968":{"gid":5968,"name":"d","rank":0,"incarnation":79,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6835/790210824","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":790210824},{"type":"v1","addr":"172.21.15.49:6835","nonce":790210824}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5968,"qdb_cluster":[5968]},"id":10},{"mdsmap":{"epoch":87,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-16T07:31:12.498747+0000","modified":"2024-03-16T07:31:15.331790+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5965},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5965":{"gid":5965,"name":"c","rank":0,"incarnation":83,"state":"up:active","state_seq":6,"addr":"172.21.15.49:6833/4146414383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":4146414383},{"type":"v1","addr":"172.21.15.49:6833","nonce":4146414383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"backup_fs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5965,"qdb_cluster":[5965]},"id":11}]} 2024-03-16T07:31:58.047 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 89 2024-03-16T07:31:58.059 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T07:31:58.404 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:31:58.404 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":89,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5957,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6827/2832753094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":2832753094},{"type":"v1","addr":"172.21.15.49:6827","nonce":2832753094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":78},{"gid":5961,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6829/3236120377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":3236120377},{"type":"v1","addr":"172.21.15.49:6829","nonce":3236120377}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":78},{"gid":5964,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6831/1238434429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":1238434429},{"type":"v1","addr":"172.21.15.49:6831","nonce":1238434429}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":78}],"filesystems":[{"mdsmap":{"epoch":89,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-16T07:30:58.238420+0000","modified":"2024-03-16T07:31:36.952836+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5968},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5968":{"gid":5968,"name":"d","rank":0,"incarnation":79,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6835/790210824","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":790210824},{"type":"v1","addr":"172.21.15.49:6835","nonce":790210824}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5968,"qdb_cluster":[5968]},"id":10},{"mdsmap":{"epoch":87,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-16T07:31:12.498747+0000","modified":"2024-03-16T07:31:15.331790+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5965},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5965":{"gid":5965,"name":"c","rank":0,"incarnation":83,"state":"up:active","state_seq":6,"addr":"172.21.15.49:6833/4146414383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":4146414383},{"type":"v1","addr":"172.21.15.49:6833","nonce":4146414383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"backup_fs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5965,"qdb_cluster":[5965]},"id":11}]} 2024-03-16T07:31:58.404 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 89 2024-03-16T07:31:58.416 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T07:31:58.726 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:31:58.727 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":126,"fsid":"f91af061-9eac-4793-87fa-8d27ae3d242f","created":"2024-03-16T07:24:20.357868+0000","modified":"2024-03-16T07:31:52.798713+0000","last_up_change":"2024-03-16T07:24:27.474980+0000","last_in_change":"2024-03-16T07:24:21.254179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T07:24:28.947521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2024-03-16T07:30:56.548783+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2024-03-16T07:30:57.216365+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"119","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"backup_fs_metadata","create_time":"2024-03-16T07:31:10.087893+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"backup_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.309999942779541,"score_stable":1.309999942779541,"optimal_score":1,"raw_score_acting":1.309999942779541,"raw_score_stable":1.309999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"backup_fs_data","create_time":"2024-03-16T07:31:11.310351+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"123","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"backup_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1699999570846558,"score_stable":1.1699999570846558,"optimal_score":1,"raw_score_acting":1.1699999570846558,"raw_score_stable":1.1699999570846558,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2df14aac-98dc-4e3c-ae7e-9eb677aa30be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6801","nonce":2744935777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6803","nonce":2744935777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6807","nonce":2744935777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6805","nonce":2744935777}]},"public_addr":"172.21.15.49:6801/2744935777","cluster_addr":"172.21.15.49:6803/2744935777","heartbeat_back_addr":"172.21.15.49:6807/2744935777","heartbeat_front_addr":"172.21.15.49:6805/2744935777","state":["exists","up"]},{"osd":1,"uuid":"80461bd9-59ef-46df-9eea-bad92d960c57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6811","nonce":1655120118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6815","nonce":1655120118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6821","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6823","nonce":1655120118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6817","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6819","nonce":1655120118}]},"public_addr":"172.21.15.49:6811/1655120118","cluster_addr":"172.21.15.49:6815/1655120118","heartbeat_back_addr":"172.21.15.49:6823/1655120118","heartbeat_front_addr":"172.21.15.49:6819/1655120118","state":["exists","up"]},{"osd":2,"uuid":"d6bf40eb-6e42-4ec9-8b3d-0b6c5a6def79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6810","nonce":3815472376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6814","nonce":3815472376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6822","nonce":3815472376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6818","nonce":3815472376}]},"public_addr":"172.21.15.49:6810/3815472376","cluster_addr":"172.21.15.49:6814/3815472376","heartbeat_back_addr":"172.21.15.49:6822/3815472376","heartbeat_front_addr":"172.21.15.49:6818/3815472376","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.641492+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.668598+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.614940+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.49:0/4108966126":"2024-03-17T07:31:52.798658+0000","172.21.15.49:0/1180114677":"2024-03-17T07:31:52.798658+0000","172.21.15.49:0/4162628828":"2024-03-17T07:31:52.798658+0000","172.21.15.49:0/895997313":"2024-03-17T07:31:52.798658+0000","172.21.15.49:0/2679898715":"2024-03-17T07:31:52.798658+0000","172.21.15.49:0/150444877":"2024-03-17T07:31:52.798658+0000","172.21.15.49:0/1607336277":"2024-03-16T08:31:38.260139+0000","172.21.15.49:0/2796699112":"2024-03-17T07:31:24.218576+0000","172.21.15.49:0/2644243140":"2024-03-17T07:31:52.798658+0000","172.21.15.49:0/4127385302":"2024-03-17T07:31:24.218576+0000","172.21.15.49:6824/880369579":"2024-03-17T07:31:52.798658+0000","172.21.15.49:0/4217593943":"2024-03-17T07:31:52.798658+0000","172.21.15.49:0/3937267129":"2024-03-17T07:31:24.218576+0000","172.21.15.49:6825/880369579":"2024-03-17T07:31:52.798658+0000","172.21.15.49:0/934796449":"2024-03-17T07:31:24.218576+0000","172.21.15.49:0/2909845685":"2024-03-17T07:31:24.218576+0000","172.21.15.49:6825/4290948241":"2024-03-17T07:31:24.218576+0000","172.21.15.49:0/3788890827":"2024-03-17T07:31:52.798658+0000","172.21.15.49:6824/4290948241":"2024-03-17T07:31:24.218576+0000","172.21.15.49:0/2032191852":"2024-03-17T07:31:24.218576+0000","172.21.15.49:0/269511731":"2024-03-17T07:31:24.218576+0000","172.21.15.49:0/726462256":"2024-03-17T07:31:24.218576+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T07:31:58.739 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-03-16T07:31:59.191 INFO:tasks.ceph.mon.a.smithi049.stderr:2024-03-16T07:31:59.192+0000 7feb67011640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-03-16T07:31:59.192 INFO:teuthology.orchestra.run.smithi049.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-03-16T07:31:59.194 INFO:tasks.ceph.mds.d.smithi049.stderr: -400> 2024-03-16T07:31:04.528+0000 7f9e719fd640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-03-16T07:31:59.209 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-03-16T07:31:59.220 INFO:tasks.ceph.mds.d.smithi049.stdout:starting mds.d at 2024-03-16T07:32:00.206 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-03-16T07:32:01.300 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_metadata' removed 2024-03-16T07:32:01.318 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-03-16T07:32:02.302 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_data' removed 2024-03-16T07:32:02.324 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T07:32:02.630 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:32:02.631 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":129,"fsid":"f91af061-9eac-4793-87fa-8d27ae3d242f","created":"2024-03-16T07:24:20.357868+0000","modified":"2024-03-16T07:32:02.302228+0000","last_up_change":"2024-03-16T07:24:27.474980+0000","last_in_change":"2024-03-16T07:24:21.254179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T07:24:28.947521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"backup_fs_metadata","create_time":"2024-03-16T07:31:10.087893+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"backup_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.309999942779541,"score_stable":1.309999942779541,"optimal_score":1,"raw_score_acting":1.309999942779541,"raw_score_stable":1.309999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"backup_fs_data","create_time":"2024-03-16T07:31:11.310351+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"123","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"backup_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1699999570846558,"score_stable":1.1699999570846558,"optimal_score":1,"raw_score_acting":1.1699999570846558,"raw_score_stable":1.1699999570846558,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2df14aac-98dc-4e3c-ae7e-9eb677aa30be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6801","nonce":2744935777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6803","nonce":2744935777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6807","nonce":2744935777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6805","nonce":2744935777}]},"public_addr":"172.21.15.49:6801/2744935777","cluster_addr":"172.21.15.49:6803/2744935777","heartbeat_back_addr":"172.21.15.49:6807/2744935777","heartbeat_front_addr":"172.21.15.49:6805/2744935777","state":["exists","up"]},{"osd":1,"uuid":"80461bd9-59ef-46df-9eea-bad92d960c57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6811","nonce":1655120118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6815","nonce":1655120118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6821","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6823","nonce":1655120118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6817","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6819","nonce":1655120118}]},"public_addr":"172.21.15.49:6811/1655120118","cluster_addr":"172.21.15.49:6815/1655120118","heartbeat_back_addr":"172.21.15.49:6823/1655120118","heartbeat_front_addr":"172.21.15.49:6819/1655120118","state":["exists","up"]},{"osd":2,"uuid":"d6bf40eb-6e42-4ec9-8b3d-0b6c5a6def79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6810","nonce":3815472376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6814","nonce":3815472376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6822","nonce":3815472376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6818","nonce":3815472376}]},"public_addr":"172.21.15.49:6810/3815472376","cluster_addr":"172.21.15.49:6814/3815472376","heartbeat_back_addr":"172.21.15.49:6822/3815472376","heartbeat_front_addr":"172.21.15.49:6818/3815472376","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.641492+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.668598+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.614940+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.49:6834/790210824":"2024-03-17T07:31:59.193735+0000","172.21.15.49:0/4108966126":"2024-03-17T07:31:52.798658+0000","172.21.15.49:0/1180114677":"2024-03-17T07:31:52.798658+0000","172.21.15.49:0/4162628828":"2024-03-17T07:31:52.798658+0000","172.21.15.49:0/895997313":"2024-03-17T07:31:52.798658+0000","172.21.15.49:0/2679898715":"2024-03-17T07:31:52.798658+0000","172.21.15.49:0/150444877":"2024-03-17T07:31:52.798658+0000","172.21.15.49:0/1607336277":"2024-03-16T08:31:38.260139+0000","172.21.15.49:0/2796699112":"2024-03-17T07:31:24.218576+0000","172.21.15.49:0/2644243140":"2024-03-17T07:31:52.798658+0000","172.21.15.49:0/4127385302":"2024-03-17T07:31:24.218576+0000","172.21.15.49:6824/880369579":"2024-03-17T07:31:52.798658+0000","172.21.15.49:0/4217593943":"2024-03-17T07:31:52.798658+0000","172.21.15.49:0/3937267129":"2024-03-17T07:31:24.218576+0000","172.21.15.49:6835/790210824":"2024-03-17T07:31:59.193735+0000","172.21.15.49:6825/880369579":"2024-03-17T07:31:52.798658+0000","172.21.15.49:0/934796449":"2024-03-17T07:31:24.218576+0000","172.21.15.49:0/2909845685":"2024-03-17T07:31:24.218576+0000","172.21.15.49:6825/4290948241":"2024-03-17T07:31:24.218576+0000","172.21.15.49:0/3788890827":"2024-03-17T07:31:52.798658+0000","172.21.15.49:6824/4290948241":"2024-03-17T07:31:24.218576+0000","172.21.15.49:0/2032191852":"2024-03-17T07:31:24.218576+0000","172.21.15.49:0/269511731":"2024-03-17T07:31:24.218576+0000","172.21.15.49:0/726462256":"2024-03-17T07:31:24.218576+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T07:32:02.644 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-16T07:24:28.947521+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 22, 'pool_name': 'backup_fs_metadata', 'create_time': '2024-03-16T07:31:10.087893+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '122', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'backup_fs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.309999942779541, 'score_stable': 1.309999942779541, 'optimal_score': 1, 'raw_score_acting': 1.309999942779541, 'raw_score_stable': 1.309999942779541, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 23, 'pool_name': 'backup_fs_data', 'create_time': '2024-03-16T07:31:11.310351+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '123', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'backup_fs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1699999570846558, 'score_stable': 1.1699999570846558, 'optimal_score': 1, 'raw_score_acting': 1.1699999570846558, 'raw_score_stable': 1.1699999570846558, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-16T07:32:02.644 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-16T07:32:03.003 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2024-03-16T07:32:03.017 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get backup_fs_metadata pg_num 2024-03-16T07:32:03.328 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2024-03-16T07:32:03.341 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get backup_fs_data pg_num 2024-03-16T07:32:03.748 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2024-03-16T07:32:03.766 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T07:32:04.111 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:32:04.112 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":91,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5957,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6827/2832753094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":2832753094},{"type":"v1","addr":"172.21.15.49:6827","nonce":2832753094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":78},{"gid":5961,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6829/3236120377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":3236120377},{"type":"v1","addr":"172.21.15.49:6829","nonce":3236120377}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":78},{"gid":5964,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6831/1238434429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":1238434429},{"type":"v1","addr":"172.21.15.49:6831","nonce":1238434429}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":78},{"gid":6239,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/2017589037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":2017589037},{"type":"v1","addr":"172.21.15.49:6835","nonce":2017589037}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":91}],"filesystems":[{"mdsmap":{"epoch":87,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-16T07:31:12.498747+0000","modified":"2024-03-16T07:31:15.331790+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5965},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5965":{"gid":5965,"name":"c","rank":0,"incarnation":83,"state":"up:active","state_seq":6,"addr":"172.21.15.49:6833/4146414383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":4146414383},{"type":"v1","addr":"172.21.15.49:6833","nonce":4146414383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"backup_fs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5965,"qdb_cluster":[5965]},"id":11}]} 2024-03-16T07:32:04.112 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 91 2024-03-16T07:32:04.125 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T07:32:04.426 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:32:04.426 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":129,"fsid":"f91af061-9eac-4793-87fa-8d27ae3d242f","created":"2024-03-16T07:24:20.357868+0000","modified":"2024-03-16T07:32:02.302228+0000","last_up_change":"2024-03-16T07:24:27.474980+0000","last_in_change":"2024-03-16T07:24:21.254179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T07:24:28.947521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"backup_fs_metadata","create_time":"2024-03-16T07:31:10.087893+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"backup_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.309999942779541,"score_stable":1.309999942779541,"optimal_score":1,"raw_score_acting":1.309999942779541,"raw_score_stable":1.309999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"backup_fs_data","create_time":"2024-03-16T07:31:11.310351+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"123","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"backup_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1699999570846558,"score_stable":1.1699999570846558,"optimal_score":1,"raw_score_acting":1.1699999570846558,"raw_score_stable":1.1699999570846558,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2df14aac-98dc-4e3c-ae7e-9eb677aa30be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6801","nonce":2744935777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6803","nonce":2744935777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6807","nonce":2744935777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6805","nonce":2744935777}]},"public_addr":"172.21.15.49:6801/2744935777","cluster_addr":"172.21.15.49:6803/2744935777","heartbeat_back_addr":"172.21.15.49:6807/2744935777","heartbeat_front_addr":"172.21.15.49:6805/2744935777","state":["exists","up"]},{"osd":1,"uuid":"80461bd9-59ef-46df-9eea-bad92d960c57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6811","nonce":1655120118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6815","nonce":1655120118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6821","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6823","nonce":1655120118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6817","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6819","nonce":1655120118}]},"public_addr":"172.21.15.49:6811/1655120118","cluster_addr":"172.21.15.49:6815/1655120118","heartbeat_back_addr":"172.21.15.49:6823/1655120118","heartbeat_front_addr":"172.21.15.49:6819/1655120118","state":["exists","up"]},{"osd":2,"uuid":"d6bf40eb-6e42-4ec9-8b3d-0b6c5a6def79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6810","nonce":3815472376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6814","nonce":3815472376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6822","nonce":3815472376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6818","nonce":3815472376}]},"public_addr":"172.21.15.49:6810/3815472376","cluster_addr":"172.21.15.49:6814/3815472376","heartbeat_back_addr":"172.21.15.49:6822/3815472376","heartbeat_front_addr":"172.21.15.49:6818/3815472376","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.641492+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.668598+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.614940+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.49:6834/790210824":"2024-03-17T07:31:59.193735+0000","172.21.15.49:0/4108966126":"2024-03-17T07:31:52.798658+0000","172.21.15.49:0/1180114677":"2024-03-17T07:31:52.798658+0000","172.21.15.49:0/4162628828":"2024-03-17T07:31:52.798658+0000","172.21.15.49:0/895997313":"2024-03-17T07:31:52.798658+0000","172.21.15.49:0/2679898715":"2024-03-17T07:31:52.798658+0000","172.21.15.49:0/150444877":"2024-03-17T07:31:52.798658+0000","172.21.15.49:0/1607336277":"2024-03-16T08:31:38.260139+0000","172.21.15.49:0/2796699112":"2024-03-17T07:31:24.218576+0000","172.21.15.49:0/2644243140":"2024-03-17T07:31:52.798658+0000","172.21.15.49:0/4127385302":"2024-03-17T07:31:24.218576+0000","172.21.15.49:6824/880369579":"2024-03-17T07:31:52.798658+0000","172.21.15.49:0/4217593943":"2024-03-17T07:31:52.798658+0000","172.21.15.49:0/3937267129":"2024-03-17T07:31:24.218576+0000","172.21.15.49:6835/790210824":"2024-03-17T07:31:59.193735+0000","172.21.15.49:6825/880369579":"2024-03-17T07:31:52.798658+0000","172.21.15.49:0/934796449":"2024-03-17T07:31:24.218576+0000","172.21.15.49:0/2909845685":"2024-03-17T07:31:24.218576+0000","172.21.15.49:6825/4290948241":"2024-03-17T07:31:24.218576+0000","172.21.15.49:0/3788890827":"2024-03-17T07:31:52.798658+0000","172.21.15.49:6824/4290948241":"2024-03-17T07:31:24.218576+0000","172.21.15.49:0/2032191852":"2024-03-17T07:31:24.218576+0000","172.21.15.49:0/269511731":"2024-03-17T07:31:24.218576+0000","172.21.15.49:0/726462256":"2024-03-17T07:31:24.218576+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T07:32:04.439 INFO:tasks.cephfs.filesystem:Destroying file system backup_fs and related pools 2024-03-16T07:32:04.439 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T07:32:04.783 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:32:04.783 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":91,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5957,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6827/2832753094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":2832753094},{"type":"v1","addr":"172.21.15.49:6827","nonce":2832753094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":78},{"gid":5961,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6829/3236120377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":3236120377},{"type":"v1","addr":"172.21.15.49:6829","nonce":3236120377}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":78},{"gid":5964,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6831/1238434429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":1238434429},{"type":"v1","addr":"172.21.15.49:6831","nonce":1238434429}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":78},{"gid":6239,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/2017589037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":2017589037},{"type":"v1","addr":"172.21.15.49:6835","nonce":2017589037}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":91}],"filesystems":[{"mdsmap":{"epoch":87,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-16T07:31:12.498747+0000","modified":"2024-03-16T07:31:15.331790+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5965},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5965":{"gid":5965,"name":"c","rank":0,"incarnation":83,"state":"up:active","state_seq":6,"addr":"172.21.15.49:6833/4146414383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":4146414383},{"type":"v1","addr":"172.21.15.49:6833","nonce":4146414383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"backup_fs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5965,"qdb_cluster":[5965]},"id":11}]} 2024-03-16T07:32:04.784 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 91 2024-03-16T07:32:04.800 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T07:32:05.141 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:32:05.141 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":91,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5957,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6827/2832753094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":2832753094},{"type":"v1","addr":"172.21.15.49:6827","nonce":2832753094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":78},{"gid":5961,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6829/3236120377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":3236120377},{"type":"v1","addr":"172.21.15.49:6829","nonce":3236120377}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":78},{"gid":5964,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6831/1238434429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":1238434429},{"type":"v1","addr":"172.21.15.49:6831","nonce":1238434429}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":78},{"gid":6239,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/2017589037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":2017589037},{"type":"v1","addr":"172.21.15.49:6835","nonce":2017589037}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":91}],"filesystems":[{"mdsmap":{"epoch":87,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-16T07:31:12.498747+0000","modified":"2024-03-16T07:31:15.331790+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5965},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5965":{"gid":5965,"name":"c","rank":0,"incarnation":83,"state":"up:active","state_seq":6,"addr":"172.21.15.49:6833/4146414383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":4146414383},{"type":"v1","addr":"172.21.15.49:6833","nonce":4146414383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"backup_fs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5965,"qdb_cluster":[5965]},"id":11}]} 2024-03-16T07:32:05.142 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 91 2024-03-16T07:32:05.154 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T07:32:05.493 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:32:05.493 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":129,"fsid":"f91af061-9eac-4793-87fa-8d27ae3d242f","created":"2024-03-16T07:24:20.357868+0000","modified":"2024-03-16T07:32:02.302228+0000","last_up_change":"2024-03-16T07:24:27.474980+0000","last_in_change":"2024-03-16T07:24:21.254179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T07:24:28.947521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"backup_fs_metadata","create_time":"2024-03-16T07:31:10.087893+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"backup_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.309999942779541,"score_stable":1.309999942779541,"optimal_score":1,"raw_score_acting":1.309999942779541,"raw_score_stable":1.309999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"backup_fs_data","create_time":"2024-03-16T07:31:11.310351+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"123","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"backup_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1699999570846558,"score_stable":1.1699999570846558,"optimal_score":1,"raw_score_acting":1.1699999570846558,"raw_score_stable":1.1699999570846558,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2df14aac-98dc-4e3c-ae7e-9eb677aa30be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6801","nonce":2744935777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6803","nonce":2744935777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6807","nonce":2744935777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6805","nonce":2744935777}]},"public_addr":"172.21.15.49:6801/2744935777","cluster_addr":"172.21.15.49:6803/2744935777","heartbeat_back_addr":"172.21.15.49:6807/2744935777","heartbeat_front_addr":"172.21.15.49:6805/2744935777","state":["exists","up"]},{"osd":1,"uuid":"80461bd9-59ef-46df-9eea-bad92d960c57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6811","nonce":1655120118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6815","nonce":1655120118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6821","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6823","nonce":1655120118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6817","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6819","nonce":1655120118}]},"public_addr":"172.21.15.49:6811/1655120118","cluster_addr":"172.21.15.49:6815/1655120118","heartbeat_back_addr":"172.21.15.49:6823/1655120118","heartbeat_front_addr":"172.21.15.49:6819/1655120118","state":["exists","up"]},{"osd":2,"uuid":"d6bf40eb-6e42-4ec9-8b3d-0b6c5a6def79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6810","nonce":3815472376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6814","nonce":3815472376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6822","nonce":3815472376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6818","nonce":3815472376}]},"public_addr":"172.21.15.49:6810/3815472376","cluster_addr":"172.21.15.49:6814/3815472376","heartbeat_back_addr":"172.21.15.49:6822/3815472376","heartbeat_front_addr":"172.21.15.49:6818/3815472376","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.641492+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.668598+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.614940+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.49:6834/790210824":"2024-03-17T07:31:59.193735+0000","172.21.15.49:0/4108966126":"2024-03-17T07:31:52.798658+0000","172.21.15.49:0/1180114677":"2024-03-17T07:31:52.798658+0000","172.21.15.49:0/4162628828":"2024-03-17T07:31:52.798658+0000","172.21.15.49:0/895997313":"2024-03-17T07:31:52.798658+0000","172.21.15.49:0/2679898715":"2024-03-17T07:31:52.798658+0000","172.21.15.49:0/150444877":"2024-03-17T07:31:52.798658+0000","172.21.15.49:0/1607336277":"2024-03-16T08:31:38.260139+0000","172.21.15.49:0/2796699112":"2024-03-17T07:31:24.218576+0000","172.21.15.49:0/2644243140":"2024-03-17T07:31:52.798658+0000","172.21.15.49:0/4127385302":"2024-03-17T07:31:24.218576+0000","172.21.15.49:6824/880369579":"2024-03-17T07:31:52.798658+0000","172.21.15.49:0/4217593943":"2024-03-17T07:31:52.798658+0000","172.21.15.49:0/3937267129":"2024-03-17T07:31:24.218576+0000","172.21.15.49:6835/790210824":"2024-03-17T07:31:59.193735+0000","172.21.15.49:6825/880369579":"2024-03-17T07:31:52.798658+0000","172.21.15.49:0/934796449":"2024-03-17T07:31:24.218576+0000","172.21.15.49:0/2909845685":"2024-03-17T07:31:24.218576+0000","172.21.15.49:6825/4290948241":"2024-03-17T07:31:24.218576+0000","172.21.15.49:0/3788890827":"2024-03-17T07:31:52.798658+0000","172.21.15.49:6824/4290948241":"2024-03-17T07:31:24.218576+0000","172.21.15.49:0/2032191852":"2024-03-17T07:31:24.218576+0000","172.21.15.49:0/269511731":"2024-03-17T07:31:24.218576+0000","172.21.15.49:0/726462256":"2024-03-17T07:31:24.218576+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T07:32:05.506 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail backup_fs 2024-03-16T07:32:05.853 INFO:tasks.ceph.mon.a.smithi049.stderr:2024-03-16T07:32:05.854+0000 7feb67011640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-03-16T07:32:05.853 INFO:teuthology.orchestra.run.smithi049.stderr:backup_fs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-03-16T07:32:05.855 INFO:tasks.ceph.mds.c.smithi049.stderr: -349> 2024-03-16T07:31:14.527+0000 7fdfd00aa640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-03-16T07:32:05.868 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm backup_fs --yes-i-really-mean-it 2024-03-16T07:32:05.880 INFO:tasks.ceph.mds.c.smithi049.stdout:starting mds.c at 2024-03-16T07:32:06.871 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm backup_fs_metadata backup_fs_metadata --yes-i-really-really-mean-it 2024-03-16T07:32:07.855 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'backup_fs_metadata' removed 2024-03-16T07:32:07.876 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm backup_fs_data backup_fs_data --yes-i-really-really-mean-it 2024-03-16T07:32:08.856 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'backup_fs_data' removed 2024-03-16T07:32:08.856 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T07:32:08.879 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-03-16T07:32:09.243 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_mirroring.TestMirroring.test_basic_mirror_commands' 2024-03-16T07:32:09.870 INFO:tasks.cephfs_test_runner:test_basic_mirror_commands (tasks.cephfs.test_mirroring.TestMirroring) ... ok 2024-03-16T07:32:09.870 INFO:tasks.cephfs_test_runner:Starting test: test_cephfs_mirror_blocklist (tasks.cephfs.test_mirroring.TestMirroring) 2024-03-16T07:32:09.870 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T07:32:10.172 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:32:10.172 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":132,"fsid":"f91af061-9eac-4793-87fa-8d27ae3d242f","created":"2024-03-16T07:24:20.357868+0000","modified":"2024-03-16T07:32:08.857297+0000","last_up_change":"2024-03-16T07:24:27.474980+0000","last_in_change":"2024-03-16T07:24:21.254179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T07:24:28.947521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2df14aac-98dc-4e3c-ae7e-9eb677aa30be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6801","nonce":2744935777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6803","nonce":2744935777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6807","nonce":2744935777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6805","nonce":2744935777}]},"public_addr":"172.21.15.49:6801/2744935777","cluster_addr":"172.21.15.49:6803/2744935777","heartbeat_back_addr":"172.21.15.49:6807/2744935777","heartbeat_front_addr":"172.21.15.49:6805/2744935777","state":["exists","up"]},{"osd":1,"uuid":"80461bd9-59ef-46df-9eea-bad92d960c57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6811","nonce":1655120118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6815","nonce":1655120118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6821","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6823","nonce":1655120118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6817","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6819","nonce":1655120118}]},"public_addr":"172.21.15.49:6811/1655120118","cluster_addr":"172.21.15.49:6815/1655120118","heartbeat_back_addr":"172.21.15.49:6823/1655120118","heartbeat_front_addr":"172.21.15.49:6819/1655120118","state":["exists","up"]},{"osd":2,"uuid":"d6bf40eb-6e42-4ec9-8b3d-0b6c5a6def79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6810","nonce":3815472376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6814","nonce":3815472376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6822","nonce":3815472376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6818","nonce":3815472376}]},"public_addr":"172.21.15.49:6810/3815472376","cluster_addr":"172.21.15.49:6814/3815472376","heartbeat_back_addr":"172.21.15.49:6822/3815472376","heartbeat_front_addr":"172.21.15.49:6818/3815472376","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.641492+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.668598+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.614940+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.49:6832/4146414383":"2024-03-17T07:32:05.854988+0000","172.21.15.49:6834/790210824":"2024-03-17T07:31:59.193735+0000","172.21.15.49:6833/4146414383":"2024-03-17T07:32:05.854988+0000","172.21.15.49:0/4108966126":"2024-03-17T07:31:52.798658+0000","172.21.15.49:0/1180114677":"2024-03-17T07:31:52.798658+0000","172.21.15.49:0/4162628828":"2024-03-17T07:31:52.798658+0000","172.21.15.49:0/895997313":"2024-03-17T07:31:52.798658+0000","172.21.15.49:0/2679898715":"2024-03-17T07:31:52.798658+0000","172.21.15.49:0/150444877":"2024-03-17T07:31:52.798658+0000","172.21.15.49:0/1607336277":"2024-03-16T08:31:38.260139+0000","172.21.15.49:0/2796699112":"2024-03-17T07:31:24.218576+0000","172.21.15.49:0/2644243140":"2024-03-17T07:31:52.798658+0000","172.21.15.49:0/4127385302":"2024-03-17T07:31:24.218576+0000","172.21.15.49:6824/880369579":"2024-03-17T07:31:52.798658+0000","172.21.15.49:0/4217593943":"2024-03-17T07:31:52.798658+0000","172.21.15.49:0/3937267129":"2024-03-17T07:31:24.218576+0000","172.21.15.49:6835/790210824":"2024-03-17T07:31:59.193735+0000","172.21.15.49:6825/880369579":"2024-03-17T07:31:52.798658+0000","172.21.15.49:0/934796449":"2024-03-17T07:31:24.218576+0000","172.21.15.49:0/2909845685":"2024-03-17T07:31:24.218576+0000","172.21.15.49:6825/4290948241":"2024-03-17T07:31:24.218576+0000","172.21.15.49:0/3788890827":"2024-03-17T07:31:52.798658+0000","172.21.15.49:6824/4290948241":"2024-03-17T07:31:24.218576+0000","172.21.15.49:0/2032191852":"2024-03-17T07:31:24.218576+0000","172.21.15.49:0/269511731":"2024-03-17T07:31:24.218576+0000","172.21.15.49:0/726462256":"2024-03-17T07:31:24.218576+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T07:32:10.184 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-16T07:24:28.947521+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-16T07:32:10.185 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-16T07:32:10.489 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2024-03-16T07:32:10.503 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_mirroring.TestMirroring.test_cephfs_mirror_blocklist' 2024-03-16T07:32:11.877 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-03-16T07:32:12.205 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-03-16T07:32:12.205 DEBUG:teuthology.orchestra.run.smithi049:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-03-16T07:32:12.244 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-03-16T07:32:12.245 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-03-16T07:32:12.245 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-16T07:32:12.300 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056354,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497664k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=13886 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248828k,nr_inodes=812207,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497664k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2024-03-16T07:32:12.301 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-03-16T07:32:12.301 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-16T07:32:12.356 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056354,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497664k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=13886 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248828k,nr_inodes=812207,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497664k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2024-03-16T07:32:12.356 INFO:tasks.cephfs.cephfs_test_case:[, ] 2024-03-16T07:32:12.357 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T07:32:12.735 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:32:12.736 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":93,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5957,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6827/2832753094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":2832753094},{"type":"v1","addr":"172.21.15.49:6827","nonce":2832753094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":78},{"gid":5961,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6829/3236120377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":3236120377},{"type":"v1","addr":"172.21.15.49:6829","nonce":3236120377}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":78},{"gid":5964,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6831/1238434429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":1238434429},{"type":"v1","addr":"172.21.15.49:6831","nonce":1238434429}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":78},{"gid":6239,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/2017589037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":2017589037},{"type":"v1","addr":"172.21.15.49:6835","nonce":2017589037}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":91},{"gid":6281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6833/1599798821","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":1599798821},{"type":"v1","addr":"172.21.15.49:6833","nonce":1599798821}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":93}],"filesystems":[]} 2024-03-16T07:32:12.736 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 93 2024-03-16T07:32:12.748 INFO:tasks.ceph.mds.a:Restarting daemon 2024-03-16T07:32:12.748 INFO:tasks.ceph.mds.a:Stopping old one... 2024-03-16T07:32:12.748 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-03-16T07:32:12.748 INFO:teuthology.orchestra.run:waiting for 300 2024-03-16T07:32:12.749 INFO:tasks.ceph.mds.b:Restarting daemon 2024-03-16T07:32:12.749 INFO:tasks.ceph.mds.b:Stopping old one... 2024-03-16T07:32:12.749 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-03-16T07:32:12.749 INFO:teuthology.orchestra.run:waiting for 300 2024-03-16T07:32:12.749 INFO:tasks.ceph.mds.c:Restarting daemon 2024-03-16T07:32:12.749 INFO:tasks.ceph.mds.c:Stopping old one... 2024-03-16T07:32:12.749 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-03-16T07:32:12.749 INFO:teuthology.orchestra.run:waiting for 300 2024-03-16T07:32:12.750 INFO:tasks.ceph.mds.d:Restarting daemon 2024-03-16T07:32:12.750 INFO:tasks.ceph.mds.d:Stopping old one... 2024-03-16T07:32:12.750 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-03-16T07:32:12.750 INFO:teuthology.orchestra.run:waiting for 300 2024-03-16T07:32:12.750 INFO:tasks.ceph.mds.e:Restarting daemon 2024-03-16T07:32:12.750 INFO:tasks.ceph.mds.e:Stopping old one... 2024-03-16T07:32:12.750 DEBUG:tasks.ceph.mds.e:waiting for process to exit 2024-03-16T07:32:12.751 INFO:teuthology.orchestra.run:waiting for 300 2024-03-16T07:32:12.760 INFO:tasks.ceph.mds.b:Stopped 2024-03-16T07:32:12.760 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-03-16T07:32:12.761 INFO:tasks.ceph.mds.d:Stopped 2024-03-16T07:32:12.761 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-03-16T07:32:12.762 INFO:tasks.ceph.mds.e:Stopped 2024-03-16T07:32:12.762 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i e 2024-03-16T07:32:12.763 INFO:tasks.ceph.mds.a:Stopped 2024-03-16T07:32:12.763 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-03-16T07:32:12.764 INFO:tasks.ceph.mds.c:Stopped 2024-03-16T07:32:12.764 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-03-16T07:32:12.805 INFO:tasks.ceph.mds.b:Started 2024-03-16T07:32:12.805 INFO:tasks.ceph.mds.d:Started 2024-03-16T07:32:12.806 DEBUG:teuthology.parallel:result is None 2024-03-16T07:32:12.806 DEBUG:teuthology.parallel:result is None 2024-03-16T07:32:12.806 INFO:tasks.ceph.mds.e:Started 2024-03-16T07:32:12.807 INFO:tasks.ceph.mds.a:Started 2024-03-16T07:32:12.807 DEBUG:teuthology.parallel:result is None 2024-03-16T07:32:12.807 DEBUG:teuthology.parallel:result is None 2024-03-16T07:32:12.808 INFO:tasks.ceph.mds.c:Started 2024-03-16T07:32:12.808 DEBUG:teuthology.parallel:result is None 2024-03-16T07:32:12.808 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-03-16T07:32:12.903 INFO:tasks.ceph.mds.e.smithi049.stdout:starting mds.e at 2024-03-16T07:32:12.903 INFO:tasks.ceph.mds.d.smithi049.stdout:starting mds.d at 2024-03-16T07:32:12.920 INFO:tasks.ceph.mds.b.smithi049.stdout:starting mds.b at 2024-03-16T07:32:12.924 INFO:tasks.ceph.mds.c.smithi049.stdout:starting mds.c at 2024-03-16T07:32:12.927 INFO:tasks.ceph.mds.a.smithi049.stdout:starting mds.a at 2024-03-16T07:32:14.200 INFO:teuthology.orchestra.run.smithi049.stderr: removed all blocklist entries 2024-03-16T07:32:14.216 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-03-16T07:32:14.593 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:32:14.593 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-03-16T07:32:14.593 INFO:teuthology.orchestra.run.smithi049.stdout: "auth_dump": [ 2024-03-16T07:32:14.593 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:32:14.593 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.a", 2024-03-16T07:32:14.593 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAZSfVlKDkWLhAAVo2ZJMZSwTGLhocUPcHaUw==", 2024-03-16T07:32:14.593 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-03-16T07:32:14.594 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2024-03-16T07:32:14.594 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2024-03-16T07:32:14.594 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2024-03-16T07:32:14.594 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-03-16T07:32:14.594 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:32:14.594 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:32:14.594 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:32:14.594 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.b", 2024-03-16T07:32:14.594 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAZSfVl53IaNhAATOLh8Lzad03tyKQph1oowQ==", 2024-03-16T07:32:14.594 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-03-16T07:32:14.594 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2024-03-16T07:32:14.594 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2024-03-16T07:32:14.594 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2024-03-16T07:32:14.594 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-03-16T07:32:14.595 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:32:14.595 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:32:14.595 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:32:14.595 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.c", 2024-03-16T07:32:14.595 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAaSfVlI3p/AhAAZEetRkGlMLMEI7hMN7pS5w==", 2024-03-16T07:32:14.595 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-03-16T07:32:14.595 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2024-03-16T07:32:14.595 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2024-03-16T07:32:14.595 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2024-03-16T07:32:14.595 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-03-16T07:32:14.595 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:32:14.595 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:32:14.595 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:32:14.595 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.d", 2024-03-16T07:32:14.595 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAaSfVl3ueIChAA640lcZj8yUgH9jq7r7B+bA==", 2024-03-16T07:32:14.595 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-03-16T07:32:14.596 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2024-03-16T07:32:14.596 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2024-03-16T07:32:14.596 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2024-03-16T07:32:14.596 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-03-16T07:32:14.596 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:32:14.596 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:32:14.596 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:32:14.596 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.e", 2024-03-16T07:32:14.596 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAaSfVl8OySEhAAyF3ScxdSuQ0jhZhRbJ2gEg==", 2024-03-16T07:32:14.596 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-03-16T07:32:14.596 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2024-03-16T07:32:14.596 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2024-03-16T07:32:14.596 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2024-03-16T07:32:14.596 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-03-16T07:32:14.596 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:32:14.596 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:32:14.596 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:32:14.597 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.0", 2024-03-16T07:32:14.597 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAbSfVlNhmeKBAAVnxZbeNKU/kVViG2vb2+tQ==", 2024-03-16T07:32:14.597 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-03-16T07:32:14.597 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2024-03-16T07:32:14.597 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2024-03-16T07:32:14.597 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-03-16T07:32:14.597 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:32:14.597 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:32:14.597 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:32:14.597 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.1", 2024-03-16T07:32:14.597 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAdSfVlNNNkNhAAKhYH9tWxFT8HH6ZLMnaK7A==", 2024-03-16T07:32:14.597 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-03-16T07:32:14.597 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2024-03-16T07:32:14.597 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2024-03-16T07:32:14.597 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-03-16T07:32:14.597 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:32:14.598 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:32:14.598 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:32:14.598 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.2", 2024-03-16T07:32:14.598 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAgSfVlXJh1BxAAEOX+brDLOLTkp0thYQgMrw==", 2024-03-16T07:32:14.598 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-03-16T07:32:14.598 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2024-03-16T07:32:14.598 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2024-03-16T07:32:14.598 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-03-16T07:32:14.598 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:32:14.598 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:32:14.598 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:32:14.598 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.0", 2024-03-16T07:32:14.598 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAaSfVlmBmvGRAAaxdhkajaioVlq23dyv/g4g==", 2024-03-16T07:32:14.598 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-03-16T07:32:14.598 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2024-03-16T07:32:14.599 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow r", 2024-03-16T07:32:14.599 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-03-16T07:32:14.599 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:32:14.599 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:32:14.599 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:32:14.599 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.1", 2024-03-16T07:32:14.599 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAaSfVlCp2DHRAAdVsc+jh/QA74EBwffEqP5g==", 2024-03-16T07:32:14.599 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-03-16T07:32:14.599 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2024-03-16T07:32:14.599 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow r", 2024-03-16T07:32:14.599 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow rw", 2024-03-16T07:32:14.599 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rwx" 2024-03-16T07:32:14.599 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:32:14.599 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:32:14.599 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:32:14.600 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.admin", 2024-03-16T07:32:14.600 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAZSfVl0iRiFxAArXglVmR8MpJZNrXNv5tS7A==", 2024-03-16T07:32:14.600 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-03-16T07:32:14.600 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow *", 2024-03-16T07:32:14.600 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2024-03-16T07:32:14.600 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2024-03-16T07:32:14.600 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-03-16T07:32:14.600 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:32:14.600 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:32:14.600 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:32:14.600 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.mirror", 2024-03-16T07:32:14.600 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAaSfVldspUIRAAa1kAy23ZdMBfbhy+7HMVqA==", 2024-03-16T07:32:14.600 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-03-16T07:32:14.601 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow r", 2024-03-16T07:32:14.601 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow r", 2024-03-16T07:32:14.601 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "profile cephfs-mirror", 2024-03-16T07:32:14.601 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rw tag cephfs metadata=*, allow r tag cephfs data=*" 2024-03-16T07:32:14.601 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:32:14.601 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:32:14.601 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:32:14.601 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.mirror_remote", 2024-03-16T07:32:14.601 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAaSfVlaygzJRAAJVP9XACdC2Wikb4ZtKci9g==", 2024-03-16T07:32:14.601 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-03-16T07:32:14.601 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow rwps", 2024-03-16T07:32:14.601 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow r", 2024-03-16T07:32:14.601 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow r", 2024-03-16T07:32:14.601 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rw tag cephfs *=*" 2024-03-16T07:32:14.601 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:32:14.601 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:32:14.601 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:32:14.602 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mgr.x", 2024-03-16T07:32:14.602 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAZSfVlX9BEKhAAftDfT7+IPsQFhrTPl2h0SQ==", 2024-03-16T07:32:14.602 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-03-16T07:32:14.602 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow *", 2024-03-16T07:32:14.602 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile mgr", 2024-03-16T07:32:14.602 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-03-16T07:32:14.602 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:32:14.602 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:32:14.602 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2024-03-16T07:32:14.602 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-03-16T07:32:14.605 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T07:32:14.908 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:32:14.908 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":138,"fsid":"f91af061-9eac-4793-87fa-8d27ae3d242f","created":"2024-03-16T07:24:20.357868+0000","modified":"2024-03-16T07:32:14.201567+0000","last_up_change":"2024-03-16T07:24:27.474980+0000","last_in_change":"2024-03-16T07:24:21.254179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T07:24:28.947521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2df14aac-98dc-4e3c-ae7e-9eb677aa30be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6801","nonce":2744935777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6803","nonce":2744935777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6807","nonce":2744935777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6805","nonce":2744935777}]},"public_addr":"172.21.15.49:6801/2744935777","cluster_addr":"172.21.15.49:6803/2744935777","heartbeat_back_addr":"172.21.15.49:6807/2744935777","heartbeat_front_addr":"172.21.15.49:6805/2744935777","state":["exists","up"]},{"osd":1,"uuid":"80461bd9-59ef-46df-9eea-bad92d960c57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6811","nonce":1655120118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6815","nonce":1655120118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6821","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6823","nonce":1655120118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6817","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6819","nonce":1655120118}]},"public_addr":"172.21.15.49:6811/1655120118","cluster_addr":"172.21.15.49:6815/1655120118","heartbeat_back_addr":"172.21.15.49:6823/1655120118","heartbeat_front_addr":"172.21.15.49:6819/1655120118","state":["exists","up"]},{"osd":2,"uuid":"d6bf40eb-6e42-4ec9-8b3d-0b6c5a6def79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6810","nonce":3815472376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6814","nonce":3815472376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6822","nonce":3815472376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6818","nonce":3815472376}]},"public_addr":"172.21.15.49:6810/3815472376","cluster_addr":"172.21.15.49:6814/3815472376","heartbeat_back_addr":"172.21.15.49:6822/3815472376","heartbeat_front_addr":"172.21.15.49:6818/3815472376","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.641492+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.668598+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.614940+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T07:32:14.921 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-16T07:24:28.947521+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-16T07:32:14.921 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-16T07:32:15.224 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2024-03-16T07:32:15.237 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-03-16T07:32:15.542 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:32:15.542 INFO:teuthology.orchestra.run.smithi049.stdout:[ 2024-03-16T07:32:15.542 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:32:15.542 INFO:teuthology.orchestra.run.smithi049.stdout: "poolnum": 1, 2024-03-16T07:32:15.542 INFO:teuthology.orchestra.run.smithi049.stdout: "poolname": ".mgr" 2024-03-16T07:32:15.542 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:32:15.542 INFO:teuthology.orchestra.run.smithi049.stdout:] 2024-03-16T07:32:15.555 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-03-16T07:32:15.555 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-03-16T07:32:16.201 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_metadata' created 2024-03-16T07:32:16.220 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-03-16T07:32:17.205 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_data' created 2024-03-16T07:32:17.240 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-03-16T07:32:18.206 INFO:teuthology.orchestra.run.smithi049.stderr:new fs with metadata pool 24 and data pool 25 2024-03-16T07:32:18.247 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T07:32:18.554 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:32:18.554 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":141,"fsid":"f91af061-9eac-4793-87fa-8d27ae3d242f","created":"2024-03-16T07:24:20.357868+0000","modified":"2024-03-16T07:32:17.591730+0000","last_up_change":"2024-03-16T07:24:27.474980+0000","last_in_change":"2024-03-16T07:24:21.254179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T07:24:28.947521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_metadata","create_time":"2024-03-16T07:32:15.892059+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"141","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":25,"pool_name":"cephfs_data","create_time":"2024-03-16T07:32:16.561057+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"141","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2df14aac-98dc-4e3c-ae7e-9eb677aa30be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6801","nonce":2744935777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6803","nonce":2744935777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6807","nonce":2744935777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6805","nonce":2744935777}]},"public_addr":"172.21.15.49:6801/2744935777","cluster_addr":"172.21.15.49:6803/2744935777","heartbeat_back_addr":"172.21.15.49:6807/2744935777","heartbeat_front_addr":"172.21.15.49:6805/2744935777","state":["exists","up"]},{"osd":1,"uuid":"80461bd9-59ef-46df-9eea-bad92d960c57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6811","nonce":1655120118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6815","nonce":1655120118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6821","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6823","nonce":1655120118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6817","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6819","nonce":1655120118}]},"public_addr":"172.21.15.49:6811/1655120118","cluster_addr":"172.21.15.49:6815/1655120118","heartbeat_back_addr":"172.21.15.49:6823/1655120118","heartbeat_front_addr":"172.21.15.49:6819/1655120118","state":["exists","up"]},{"osd":2,"uuid":"d6bf40eb-6e42-4ec9-8b3d-0b6c5a6def79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6810","nonce":3815472376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6814","nonce":3815472376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6822","nonce":3815472376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6818","nonce":3815472376}]},"public_addr":"172.21.15.49:6810/3815472376","cluster_addr":"172.21.15.49:6814/3815472376","heartbeat_back_addr":"172.21.15.49:6822/3815472376","heartbeat_front_addr":"172.21.15.49:6818/3815472376","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.641492+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.668598+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.614940+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T07:32:18.566 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T07:32:18.871 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:32:18.872 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":141,"fsid":"f91af061-9eac-4793-87fa-8d27ae3d242f","created":"2024-03-16T07:24:20.357868+0000","modified":"2024-03-16T07:32:17.591730+0000","last_up_change":"2024-03-16T07:24:27.474980+0000","last_in_change":"2024-03-16T07:24:21.254179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T07:24:28.947521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_metadata","create_time":"2024-03-16T07:32:15.892059+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"141","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":25,"pool_name":"cephfs_data","create_time":"2024-03-16T07:32:16.561057+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"141","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2df14aac-98dc-4e3c-ae7e-9eb677aa30be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6801","nonce":2744935777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6803","nonce":2744935777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6807","nonce":2744935777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6805","nonce":2744935777}]},"public_addr":"172.21.15.49:6801/2744935777","cluster_addr":"172.21.15.49:6803/2744935777","heartbeat_back_addr":"172.21.15.49:6807/2744935777","heartbeat_front_addr":"172.21.15.49:6805/2744935777","state":["exists","up"]},{"osd":1,"uuid":"80461bd9-59ef-46df-9eea-bad92d960c57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6811","nonce":1655120118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6815","nonce":1655120118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6821","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6823","nonce":1655120118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6817","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6819","nonce":1655120118}]},"public_addr":"172.21.15.49:6811/1655120118","cluster_addr":"172.21.15.49:6815/1655120118","heartbeat_back_addr":"172.21.15.49:6823/1655120118","heartbeat_front_addr":"172.21.15.49:6819/1655120118","state":["exists","up"]},{"osd":2,"uuid":"d6bf40eb-6e42-4ec9-8b3d-0b6c5a6def79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6810","nonce":3815472376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6814","nonce":3815472376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6822","nonce":3815472376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6818","nonce":3815472376}]},"public_addr":"172.21.15.49:6810/3815472376","cluster_addr":"172.21.15.49:6814/3815472376","heartbeat_back_addr":"172.21.15.49:6822/3815472376","heartbeat_front_addr":"172.21.15.49:6818/3815472376","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.641492+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.668598+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.614940+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T07:32:18.884 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-03-16T07:32:20.234 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-03-16T07:32:20.234 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-03-16T07:32:21.395 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-03-16T07:32:21.396 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T07:32:21.867 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:32:21.867 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":99,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6315,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6828/2438276517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":2438276517},{"type":"v1","addr":"172.21.15.49:6828","nonce":2438276517}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":94},{"gid":6316,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6829/1412184122","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6827","nonce":1412184122},{"type":"v1","addr":"172.21.15.49:6829","nonce":1412184122}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":94},{"gid":6321,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6831/3610285344","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":3610285344},{"type":"v1","addr":"172.21.15.49:6831","nonce":3610285344}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":94},{"gid":6324,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6833/1457417734","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":1457417734},{"type":"v1","addr":"172.21.15.49:6833","nonce":1457417734}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":94}],"filesystems":[{"mdsmap":{"epoch":99,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-16T07:32:17.592092+0000","modified":"2024-03-16T07:32:20.584913+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6325},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6325":{"gid":6325,"name":"a","rank":0,"incarnation":95,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6835/2709512109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":2709512109},{"type":"v1","addr":"172.21.15.49:6835","nonce":2709512109}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6325,"qdb_cluster":[6325]},"id":12}]} 2024-03-16T07:32:21.867 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 99 2024-03-16T07:32:21.882 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T07:32:22.186 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:32:22.186 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":142,"fsid":"f91af061-9eac-4793-87fa-8d27ae3d242f","created":"2024-03-16T07:24:20.357868+0000","modified":"2024-03-16T07:32:19.216053+0000","last_up_change":"2024-03-16T07:24:27.474980+0000","last_in_change":"2024-03-16T07:24:21.254179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T07:24:28.947521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_metadata","create_time":"2024-03-16T07:32:15.892059+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"141","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":25,"pool_name":"cephfs_data","create_time":"2024-03-16T07:32:16.561057+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"142","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2df14aac-98dc-4e3c-ae7e-9eb677aa30be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6801","nonce":2744935777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6803","nonce":2744935777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6807","nonce":2744935777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6805","nonce":2744935777}]},"public_addr":"172.21.15.49:6801/2744935777","cluster_addr":"172.21.15.49:6803/2744935777","heartbeat_back_addr":"172.21.15.49:6807/2744935777","heartbeat_front_addr":"172.21.15.49:6805/2744935777","state":["exists","up"]},{"osd":1,"uuid":"80461bd9-59ef-46df-9eea-bad92d960c57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6811","nonce":1655120118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6815","nonce":1655120118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6821","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6823","nonce":1655120118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6817","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6819","nonce":1655120118}]},"public_addr":"172.21.15.49:6811/1655120118","cluster_addr":"172.21.15.49:6815/1655120118","heartbeat_back_addr":"172.21.15.49:6823/1655120118","heartbeat_front_addr":"172.21.15.49:6819/1655120118","state":["exists","up"]},{"osd":2,"uuid":"d6bf40eb-6e42-4ec9-8b3d-0b6c5a6def79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6810","nonce":3815472376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6814","nonce":3815472376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6822","nonce":3815472376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6818","nonce":3815472376}]},"public_addr":"172.21.15.49:6810/3815472376","cluster_addr":"172.21.15.49:6814/3815472376","heartbeat_back_addr":"172.21.15.49:6822/3815472376","heartbeat_front_addr":"172.21.15.49:6818/3815472376","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.641492+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.668598+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.614940+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T07:32:22.199 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-03-16T07:32:22.199 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-16T07:32:22.506 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:32:22.508 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2024-03-16T07:32:22.517 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":33,"stamp":"2024-03-16T07:32:20.822954+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":970,"num_read_kb":1945,"num_write":361,"num_write_kb":1908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":234,"ondisk_log_size":234,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":314572800,"kb_used":111476,"kb_used_data":5436,"kb_used_omap":4,"kb_used_meta":105979,"kb_avail":314461324,"statfs":{"total":322122547200,"available":322008395776,"internally_reserved":0,"allocated":5566464,"data_stored":2952454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":108522831},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.618905"},"pg_stats":[{"pgid":"25.3f","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.250017+0000","last_change":"2024-03-16T07:32:18.247962+0000","last_active":"2024-03-16T07:32:18.250017+0000","last_peered":"2024-03-16T07:32:18.250017+0000","last_clean":"2024-03-16T07:32:18.250017+0000","last_became_active":"2024-03-16T07:32:18.247621+0000","last_became_peered":"2024-03-16T07:32:18.247621+0000","last_unstale":"2024-03-16T07:32:18.250017+0000","last_undegraded":"2024-03-16T07:32:18.250017+0000","last_fullsized":"2024-03-16T07:32:18.250017+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:41:15.964881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.3e","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.249742+0000","last_change":"2024-03-16T07:32:18.246415+0000","last_active":"2024-03-16T07:32:18.249742+0000","last_peered":"2024-03-16T07:32:18.249742+0000","last_clean":"2024-03-16T07:32:18.249742+0000","last_became_active":"2024-03-16T07:32:18.246171+0000","last_became_peered":"2024-03-16T07:32:18.246171+0000","last_unstale":"2024-03-16T07:32:18.249742+0000","last_undegraded":"2024-03-16T07:32:18.249742+0000","last_fullsized":"2024-03-16T07:32:18.249742+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:10:31.726525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.3d","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.245959+0000","last_change":"2024-03-16T07:32:18.243582+0000","last_active":"2024-03-16T07:32:18.245959+0000","last_peered":"2024-03-16T07:32:18.245959+0000","last_clean":"2024-03-16T07:32:18.245959+0000","last_became_active":"2024-03-16T07:32:18.243189+0000","last_became_peered":"2024-03-16T07:32:18.243189+0000","last_unstale":"2024-03-16T07:32:18.245959+0000","last_undegraded":"2024-03-16T07:32:18.245959+0000","last_fullsized":"2024-03-16T07:32:18.245959+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:15:38.818060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.3c","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.247022+0000","last_change":"2024-03-16T07:32:18.245554+0000","last_active":"2024-03-16T07:32:18.247022+0000","last_peered":"2024-03-16T07:32:18.247022+0000","last_clean":"2024-03-16T07:32:18.247022+0000","last_became_active":"2024-03-16T07:32:18.245016+0000","last_became_peered":"2024-03-16T07:32:18.245016+0000","last_unstale":"2024-03-16T07:32:18.247022+0000","last_undegraded":"2024-03-16T07:32:18.247022+0000","last_fullsized":"2024-03-16T07:32:18.247022+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:51:17.400032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.3b","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.239524+0000","last_change":"2024-03-16T07:32:18.235990+0000","last_active":"2024-03-16T07:32:18.239524+0000","last_peered":"2024-03-16T07:32:18.239524+0000","last_clean":"2024-03-16T07:32:18.239524+0000","last_became_active":"2024-03-16T07:32:18.235735+0000","last_became_peered":"2024-03-16T07:32:18.235735+0000","last_unstale":"2024-03-16T07:32:18.239524+0000","last_undegraded":"2024-03-16T07:32:18.239524+0000","last_fullsized":"2024-03-16T07:32:18.239524+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:54:41.949813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.3a","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.244694+0000","last_change":"2024-03-16T07:32:18.243404+0000","last_active":"2024-03-16T07:32:18.244694+0000","last_peered":"2024-03-16T07:32:18.244694+0000","last_clean":"2024-03-16T07:32:18.244694+0000","last_became_active":"2024-03-16T07:32:18.243142+0000","last_became_peered":"2024-03-16T07:32:18.243142+0000","last_unstale":"2024-03-16T07:32:18.244694+0000","last_undegraded":"2024-03-16T07:32:18.244694+0000","last_fullsized":"2024-03-16T07:32:18.244694+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:45:51.099391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.39","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.242826+0000","last_change":"2024-03-16T07:32:18.240139+0000","last_active":"2024-03-16T07:32:18.242826+0000","last_peered":"2024-03-16T07:32:18.242826+0000","last_clean":"2024-03-16T07:32:18.242826+0000","last_became_active":"2024-03-16T07:32:18.238310+0000","last_became_peered":"2024-03-16T07:32:18.238310+0000","last_unstale":"2024-03-16T07:32:18.242826+0000","last_undegraded":"2024-03-16T07:32:18.242826+0000","last_fullsized":"2024-03-16T07:32:18.242826+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:20:21.637896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.38","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.246730+0000","last_change":"2024-03-16T07:32:18.245507+0000","last_active":"2024-03-16T07:32:18.246730+0000","last_peered":"2024-03-16T07:32:18.246730+0000","last_clean":"2024-03-16T07:32:18.246730+0000","last_became_active":"2024-03-16T07:32:18.245260+0000","last_became_peered":"2024-03-16T07:32:18.245260+0000","last_unstale":"2024-03-16T07:32:18.246730+0000","last_undegraded":"2024-03-16T07:32:18.246730+0000","last_fullsized":"2024-03-16T07:32:18.246730+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:16:33.993986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.37","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.249996+0000","last_change":"2024-03-16T07:32:18.247274+0000","last_active":"2024-03-16T07:32:18.249996+0000","last_peered":"2024-03-16T07:32:18.249996+0000","last_clean":"2024-03-16T07:32:18.249996+0000","last_became_active":"2024-03-16T07:32:18.247021+0000","last_became_peered":"2024-03-16T07:32:18.247021+0000","last_unstale":"2024-03-16T07:32:18.249996+0000","last_undegraded":"2024-03-16T07:32:18.249996+0000","last_fullsized":"2024-03-16T07:32:18.249996+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:30:33.178302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.36","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.242178+0000","last_change":"2024-03-16T07:32:18.239231+0000","last_active":"2024-03-16T07:32:18.242178+0000","last_peered":"2024-03-16T07:32:18.242178+0000","last_clean":"2024-03-16T07:32:18.242178+0000","last_became_active":"2024-03-16T07:32:18.238947+0000","last_became_peered":"2024-03-16T07:32:18.238947+0000","last_unstale":"2024-03-16T07:32:18.242178+0000","last_undegraded":"2024-03-16T07:32:18.242178+0000","last_fullsized":"2024-03-16T07:32:18.242178+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:26:04.314471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.35","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.238933+0000","last_change":"2024-03-16T07:32:18.237180+0000","last_active":"2024-03-16T07:32:18.238933+0000","last_peered":"2024-03-16T07:32:18.238933+0000","last_clean":"2024-03-16T07:32:18.238933+0000","last_became_active":"2024-03-16T07:32:18.236919+0000","last_became_peered":"2024-03-16T07:32:18.236919+0000","last_unstale":"2024-03-16T07:32:18.238933+0000","last_undegraded":"2024-03-16T07:32:18.238933+0000","last_fullsized":"2024-03-16T07:32:18.238933+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:08:10.533094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.34","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.242629+0000","last_change":"2024-03-16T07:32:18.241361+0000","last_active":"2024-03-16T07:32:18.242629+0000","last_peered":"2024-03-16T07:32:18.242629+0000","last_clean":"2024-03-16T07:32:18.242629+0000","last_became_active":"2024-03-16T07:32:18.240963+0000","last_became_peered":"2024-03-16T07:32:18.240963+0000","last_unstale":"2024-03-16T07:32:18.242629+0000","last_undegraded":"2024-03-16T07:32:18.242629+0000","last_fullsized":"2024-03-16T07:32:18.242629+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:11:47.343567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.33","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.245497+0000","last_change":"2024-03-16T07:32:18.244631+0000","last_active":"2024-03-16T07:32:18.245497+0000","last_peered":"2024-03-16T07:32:18.245497+0000","last_clean":"2024-03-16T07:32:18.245497+0000","last_became_active":"2024-03-16T07:32:18.244350+0000","last_became_peered":"2024-03-16T07:32:18.244350+0000","last_unstale":"2024-03-16T07:32:18.245497+0000","last_undegraded":"2024-03-16T07:32:18.245497+0000","last_fullsized":"2024-03-16T07:32:18.245497+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:33:33.149972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.32","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.249796+0000","last_change":"2024-03-16T07:32:18.247797+0000","last_active":"2024-03-16T07:32:18.249796+0000","last_peered":"2024-03-16T07:32:18.249796+0000","last_clean":"2024-03-16T07:32:18.249796+0000","last_became_active":"2024-03-16T07:32:18.247260+0000","last_became_peered":"2024-03-16T07:32:18.247260+0000","last_unstale":"2024-03-16T07:32:18.249796+0000","last_undegraded":"2024-03-16T07:32:18.249796+0000","last_fullsized":"2024-03-16T07:32:18.249796+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:11:08.101911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.31","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.242241+0000","last_change":"2024-03-16T07:32:18.233233+0000","last_active":"2024-03-16T07:32:18.242241+0000","last_peered":"2024-03-16T07:32:18.242241+0000","last_clean":"2024-03-16T07:32:18.242241+0000","last_became_active":"2024-03-16T07:32:18.232417+0000","last_became_peered":"2024-03-16T07:32:18.232417+0000","last_unstale":"2024-03-16T07:32:18.242241+0000","last_undegraded":"2024-03-16T07:32:18.242241+0000","last_fullsized":"2024-03-16T07:32:18.242241+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:46:13.531171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.30","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.226639+0000","last_change":"2024-03-16T07:32:18.225150+0000","last_active":"2024-03-16T07:32:18.226639+0000","last_peered":"2024-03-16T07:32:18.226639+0000","last_clean":"2024-03-16T07:32:18.226639+0000","last_became_active":"2024-03-16T07:32:18.224307+0000","last_became_peered":"2024-03-16T07:32:18.224307+0000","last_unstale":"2024-03-16T07:32:18.226639+0000","last_undegraded":"2024-03-16T07:32:18.226639+0000","last_fullsized":"2024-03-16T07:32:18.226639+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:03:50.228942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2f","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.250936+0000","last_change":"2024-03-16T07:32:18.248997+0000","last_active":"2024-03-16T07:32:18.250936+0000","last_peered":"2024-03-16T07:32:18.250936+0000","last_clean":"2024-03-16T07:32:18.250936+0000","last_became_active":"2024-03-16T07:32:18.248743+0000","last_became_peered":"2024-03-16T07:32:18.248743+0000","last_unstale":"2024-03-16T07:32:18.250936+0000","last_undegraded":"2024-03-16T07:32:18.250936+0000","last_fullsized":"2024-03-16T07:32:18.250936+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:03:26.209534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2e","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.238976+0000","last_change":"2024-03-16T07:32:18.233726+0000","last_active":"2024-03-16T07:32:18.238976+0000","last_peered":"2024-03-16T07:32:18.238976+0000","last_clean":"2024-03-16T07:32:18.238976+0000","last_became_active":"2024-03-16T07:32:18.232689+0000","last_became_peered":"2024-03-16T07:32:18.232689+0000","last_unstale":"2024-03-16T07:32:18.238976+0000","last_undegraded":"2024-03-16T07:32:18.238976+0000","last_fullsized":"2024-03-16T07:32:18.238976+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:36:57.985523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2d","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.243418+0000","last_change":"2024-03-16T07:32:18.236128+0000","last_active":"2024-03-16T07:32:18.243418+0000","last_peered":"2024-03-16T07:32:18.243418+0000","last_clean":"2024-03-16T07:32:18.243418+0000","last_became_active":"2024-03-16T07:32:18.235894+0000","last_became_peered":"2024-03-16T07:32:18.235894+0000","last_unstale":"2024-03-16T07:32:18.243418+0000","last_undegraded":"2024-03-16T07:32:18.243418+0000","last_fullsized":"2024-03-16T07:32:18.243418+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:16:46.510357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.2c","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.225133+0000","last_change":"2024-03-16T07:32:18.224575+0000","last_active":"2024-03-16T07:32:18.225133+0000","last_peered":"2024-03-16T07:32:18.225133+0000","last_clean":"2024-03-16T07:32:18.225133+0000","last_became_active":"2024-03-16T07:32:18.224316+0000","last_became_peered":"2024-03-16T07:32:18.224316+0000","last_unstale":"2024-03-16T07:32:18.225133+0000","last_undegraded":"2024-03-16T07:32:18.225133+0000","last_fullsized":"2024-03-16T07:32:18.225133+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:38:11.159687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2b","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.251471+0000","last_change":"2024-03-16T07:32:18.250300+0000","last_active":"2024-03-16T07:32:18.251471+0000","last_peered":"2024-03-16T07:32:18.251471+0000","last_clean":"2024-03-16T07:32:18.251471+0000","last_became_active":"2024-03-16T07:32:18.249983+0000","last_became_peered":"2024-03-16T07:32:18.249983+0000","last_unstale":"2024-03-16T07:32:18.251471+0000","last_undegraded":"2024-03-16T07:32:18.251471+0000","last_fullsized":"2024-03-16T07:32:18.251471+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:58:36.160396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2a","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.227852+0000","last_change":"2024-03-16T07:32:18.226323+0000","last_active":"2024-03-16T07:32:18.227852+0000","last_peered":"2024-03-16T07:32:18.227852+0000","last_clean":"2024-03-16T07:32:18.227852+0000","last_became_active":"2024-03-16T07:32:18.225946+0000","last_became_peered":"2024-03-16T07:32:18.225946+0000","last_unstale":"2024-03-16T07:32:18.227852+0000","last_undegraded":"2024-03-16T07:32:18.227852+0000","last_fullsized":"2024-03-16T07:32:18.227852+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:35:05.481260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.29","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.245200+0000","last_change":"2024-03-16T07:32:18.244224+0000","last_active":"2024-03-16T07:32:18.245200+0000","last_peered":"2024-03-16T07:32:18.245200+0000","last_clean":"2024-03-16T07:32:18.245200+0000","last_became_active":"2024-03-16T07:32:18.243900+0000","last_became_peered":"2024-03-16T07:32:18.243900+0000","last_unstale":"2024-03-16T07:32:18.245200+0000","last_undegraded":"2024-03-16T07:32:18.245200+0000","last_fullsized":"2024-03-16T07:32:18.245200+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:34:09.228347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.28","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.242455+0000","last_change":"2024-03-16T07:32:18.235208+0000","last_active":"2024-03-16T07:32:18.242455+0000","last_peered":"2024-03-16T07:32:18.242455+0000","last_clean":"2024-03-16T07:32:18.242455+0000","last_became_active":"2024-03-16T07:32:18.233745+0000","last_became_peered":"2024-03-16T07:32:18.233745+0000","last_unstale":"2024-03-16T07:32:18.242455+0000","last_undegraded":"2024-03-16T07:32:18.242455+0000","last_fullsized":"2024-03-16T07:32:18.242455+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:48:56.339661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.27","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.235043+0000","last_change":"2024-03-16T07:32:18.234600+0000","last_active":"2024-03-16T07:32:18.235043+0000","last_peered":"2024-03-16T07:32:18.235043+0000","last_clean":"2024-03-16T07:32:18.235043+0000","last_became_active":"2024-03-16T07:32:18.234355+0000","last_became_peered":"2024-03-16T07:32:18.234355+0000","last_unstale":"2024-03-16T07:32:18.235043+0000","last_undegraded":"2024-03-16T07:32:18.235043+0000","last_fullsized":"2024-03-16T07:32:18.235043+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:11:48.077846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.26","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.227732+0000","last_change":"2024-03-16T07:32:18.225540+0000","last_active":"2024-03-16T07:32:18.227732+0000","last_peered":"2024-03-16T07:32:18.227732+0000","last_clean":"2024-03-16T07:32:18.227732+0000","last_became_active":"2024-03-16T07:32:18.225284+0000","last_became_peered":"2024-03-16T07:32:18.225284+0000","last_unstale":"2024-03-16T07:32:18.227732+0000","last_undegraded":"2024-03-16T07:32:18.227732+0000","last_fullsized":"2024-03-16T07:32:18.227732+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:09:56.297700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.25","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.249990+0000","last_change":"2024-03-16T07:32:18.249523+0000","last_active":"2024-03-16T07:32:18.249990+0000","last_peered":"2024-03-16T07:32:18.249990+0000","last_clean":"2024-03-16T07:32:18.249990+0000","last_became_active":"2024-03-16T07:32:18.249244+0000","last_became_peered":"2024-03-16T07:32:18.249244+0000","last_unstale":"2024-03-16T07:32:18.249990+0000","last_undegraded":"2024-03-16T07:32:18.249990+0000","last_fullsized":"2024-03-16T07:32:18.249990+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:07:05.798965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.24","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.242197+0000","last_change":"2024-03-16T07:32:18.239570+0000","last_active":"2024-03-16T07:32:18.242197+0000","last_peered":"2024-03-16T07:32:18.242197+0000","last_clean":"2024-03-16T07:32:18.242197+0000","last_became_active":"2024-03-16T07:32:18.239318+0000","last_became_peered":"2024-03-16T07:32:18.239318+0000","last_unstale":"2024-03-16T07:32:18.242197+0000","last_undegraded":"2024-03-16T07:32:18.242197+0000","last_fullsized":"2024-03-16T07:32:18.242197+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:36:04.847955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.23","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.243113+0000","last_change":"2024-03-16T07:32:18.241882+0000","last_active":"2024-03-16T07:32:18.243113+0000","last_peered":"2024-03-16T07:32:18.243113+0000","last_clean":"2024-03-16T07:32:18.243113+0000","last_became_active":"2024-03-16T07:32:18.241443+0000","last_became_peered":"2024-03-16T07:32:18.241443+0000","last_unstale":"2024-03-16T07:32:18.243113+0000","last_undegraded":"2024-03-16T07:32:18.243113+0000","last_fullsized":"2024-03-16T07:32:18.243113+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:14:41.948370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.22","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.227833+0000","last_change":"2024-03-16T07:32:18.226198+0000","last_active":"2024-03-16T07:32:18.227833+0000","last_peered":"2024-03-16T07:32:18.227833+0000","last_clean":"2024-03-16T07:32:18.227833+0000","last_became_active":"2024-03-16T07:32:18.224070+0000","last_became_peered":"2024-03-16T07:32:18.224070+0000","last_unstale":"2024-03-16T07:32:18.227833+0000","last_undegraded":"2024-03-16T07:32:18.227833+0000","last_fullsized":"2024-03-16T07:32:18.227833+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:59:41.396759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.21","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.234677+0000","last_change":"2024-03-16T07:32:18.233960+0000","last_active":"2024-03-16T07:32:18.234677+0000","last_peered":"2024-03-16T07:32:18.234677+0000","last_clean":"2024-03-16T07:32:18.234677+0000","last_became_active":"2024-03-16T07:32:18.233732+0000","last_became_peered":"2024-03-16T07:32:18.233732+0000","last_unstale":"2024-03-16T07:32:18.234677+0000","last_undegraded":"2024-03-16T07:32:18.234677+0000","last_fullsized":"2024-03-16T07:32:18.234677+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:01:38.728287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.20","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.238991+0000","last_change":"2024-03-16T07:32:18.233834+0000","last_active":"2024-03-16T07:32:18.238991+0000","last_peered":"2024-03-16T07:32:18.238991+0000","last_clean":"2024-03-16T07:32:18.238991+0000","last_became_active":"2024-03-16T07:32:18.233597+0000","last_became_peered":"2024-03-16T07:32:18.233597+0000","last_unstale":"2024-03-16T07:32:18.238991+0000","last_undegraded":"2024-03-16T07:32:18.238991+0000","last_fullsized":"2024-03-16T07:32:18.238991+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:21:41.842380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1e","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.229455+0000","last_change":"2024-03-16T07:32:18.228560+0000","last_active":"2024-03-16T07:32:18.229455+0000","last_peered":"2024-03-16T07:32:18.229455+0000","last_clean":"2024-03-16T07:32:18.229455+0000","last_became_active":"2024-03-16T07:32:18.228293+0000","last_became_peered":"2024-03-16T07:32:18.228293+0000","last_unstale":"2024-03-16T07:32:18.229455+0000","last_undegraded":"2024-03-16T07:32:18.229455+0000","last_fullsized":"2024-03-16T07:32:18.229455+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:06:24.622898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.1f","version":"141'4","reported_seq":16,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.251051+0000","last_change":"2024-03-16T07:32:17.224916+0000","last_active":"2024-03-16T07:32:18.251051+0000","last_peered":"2024-03-16T07:32:18.251051+0000","last_clean":"2024-03-16T07:32:18.251051+0000","last_became_active":"2024-03-16T07:32:17.224654+0000","last_became_peered":"2024-03-16T07:32:17.224654+0000","last_unstale":"2024-03-16T07:32:18.251051+0000","last_undegraded":"2024-03-16T07:32:18.251051+0000","last_fullsized":"2024-03-16T07:32:18.251051+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_clean_scrub_stamp":"2024-03-16T07:32:16.202808+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:50:05.049365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1f","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.244546+0000","last_change":"2024-03-16T07:32:18.243113+0000","last_active":"2024-03-16T07:32:18.244546+0000","last_peered":"2024-03-16T07:32:18.244546+0000","last_clean":"2024-03-16T07:32:18.244546+0000","last_became_active":"2024-03-16T07:32:18.242717+0000","last_became_peered":"2024-03-16T07:32:18.242717+0000","last_unstale":"2024-03-16T07:32:18.244546+0000","last_undegraded":"2024-03-16T07:32:18.244546+0000","last_fullsized":"2024-03-16T07:32:18.244546+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:25:27.770126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1e","version":"141'1","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.242075+0000","last_change":"2024-03-16T07:32:17.232318+0000","last_active":"2024-03-16T07:32:18.242075+0000","last_peered":"2024-03-16T07:32:18.242075+0000","last_clean":"2024-03-16T07:32:18.242075+0000","last_became_active":"2024-03-16T07:32:17.230713+0000","last_became_peered":"2024-03-16T07:32:17.230713+0000","last_unstale":"2024-03-16T07:32:18.242075+0000","last_undegraded":"2024-03-16T07:32:18.242075+0000","last_fullsized":"2024-03-16T07:32:18.242075+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_clean_scrub_stamp":"2024-03-16T07:32:16.202808+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:18:34.025222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.1c","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.231285+0000","last_change":"2024-03-16T07:32:18.230121+0000","last_active":"2024-03-16T07:32:18.231285+0000","last_peered":"2024-03-16T07:32:18.231285+0000","last_clean":"2024-03-16T07:32:18.231285+0000","last_became_active":"2024-03-16T07:32:18.229075+0000","last_became_peered":"2024-03-16T07:32:18.229075+0000","last_unstale":"2024-03-16T07:32:18.231285+0000","last_undegraded":"2024-03-16T07:32:18.231285+0000","last_fullsized":"2024-03-16T07:32:18.231285+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:50:01.168314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.1d","version":"141'2","reported_seq":14,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.247975+0000","last_change":"2024-03-16T07:32:17.228396+0000","last_active":"2024-03-16T07:32:18.247975+0000","last_peered":"2024-03-16T07:32:18.247975+0000","last_clean":"2024-03-16T07:32:18.247975+0000","last_became_active":"2024-03-16T07:32:17.228131+0000","last_became_peered":"2024-03-16T07:32:17.228131+0000","last_unstale":"2024-03-16T07:32:18.247975+0000","last_undegraded":"2024-03-16T07:32:18.247975+0000","last_fullsized":"2024-03-16T07:32:18.247975+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_clean_scrub_stamp":"2024-03-16T07:32:16.202808+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:05:23.959390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1d","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.249969+0000","last_change":"2024-03-16T07:32:18.249490+0000","last_active":"2024-03-16T07:32:18.249969+0000","last_peered":"2024-03-16T07:32:18.249969+0000","last_clean":"2024-03-16T07:32:18.249969+0000","last_became_active":"2024-03-16T07:32:18.249036+0000","last_became_peered":"2024-03-16T07:32:18.249036+0000","last_unstale":"2024-03-16T07:32:18.249969+0000","last_undegraded":"2024-03-16T07:32:18.249969+0000","last_fullsized":"2024-03-16T07:32:18.249969+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:48:48.765327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.1c","version":"141'2","reported_seq":14,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.242398+0000","last_change":"2024-03-16T07:32:17.230842+0000","last_active":"2024-03-16T07:32:18.242398+0000","last_peered":"2024-03-16T07:32:18.242398+0000","last_clean":"2024-03-16T07:32:18.242398+0000","last_became_active":"2024-03-16T07:32:17.230593+0000","last_became_peered":"2024-03-16T07:32:17.230593+0000","last_unstale":"2024-03-16T07:32:18.242398+0000","last_undegraded":"2024-03-16T07:32:18.242398+0000","last_fullsized":"2024-03-16T07:32:18.242398+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_clean_scrub_stamp":"2024-03-16T07:32:16.202808+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:03:33.084093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.1a","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.227811+0000","last_change":"2024-03-16T07:32:18.226108+0000","last_active":"2024-03-16T07:32:18.227811+0000","last_peered":"2024-03-16T07:32:18.227811+0000","last_clean":"2024-03-16T07:32:18.227811+0000","last_became_active":"2024-03-16T07:32:18.223749+0000","last_became_peered":"2024-03-16T07:32:18.223749+0000","last_unstale":"2024-03-16T07:32:18.227811+0000","last_undegraded":"2024-03-16T07:32:18.227811+0000","last_fullsized":"2024-03-16T07:32:18.227811+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:18:02.109767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1b","version":"141'1","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.251398+0000","last_change":"2024-03-16T07:32:17.225004+0000","last_active":"2024-03-16T07:32:18.251398+0000","last_peered":"2024-03-16T07:32:18.251398+0000","last_clean":"2024-03-16T07:32:18.251398+0000","last_became_active":"2024-03-16T07:32:17.224306+0000","last_became_peered":"2024-03-16T07:32:17.224306+0000","last_unstale":"2024-03-16T07:32:18.251398+0000","last_undegraded":"2024-03-16T07:32:18.251398+0000","last_fullsized":"2024-03-16T07:32:18.251398+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_clean_scrub_stamp":"2024-03-16T07:32:16.202808+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:58:22.521647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1b","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.242882+0000","last_change":"2024-03-16T07:32:18.239642+0000","last_active":"2024-03-16T07:32:18.242882+0000","last_peered":"2024-03-16T07:32:18.242882+0000","last_clean":"2024-03-16T07:32:18.242882+0000","last_became_active":"2024-03-16T07:32:18.239335+0000","last_became_peered":"2024-03-16T07:32:18.239335+0000","last_unstale":"2024-03-16T07:32:18.242882+0000","last_undegraded":"2024-03-16T07:32:18.242882+0000","last_fullsized":"2024-03-16T07:32:18.242882+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:23:00.374407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.1a","version":"141'1","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.242158+0000","last_change":"2024-03-16T07:32:17.228025+0000","last_active":"2024-03-16T07:32:18.242158+0000","last_peered":"2024-03-16T07:32:18.242158+0000","last_clean":"2024-03-16T07:32:18.242158+0000","last_became_active":"2024-03-16T07:32:17.227533+0000","last_became_peered":"2024-03-16T07:32:17.227533+0000","last_unstale":"2024-03-16T07:32:18.242158+0000","last_undegraded":"2024-03-16T07:32:18.242158+0000","last_fullsized":"2024-03-16T07:32:18.242158+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_clean_scrub_stamp":"2024-03-16T07:32:16.202808+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:48:47.764111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.19","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.240890+0000","last_change":"2024-03-16T07:32:18.238620+0000","last_active":"2024-03-16T07:32:18.240890+0000","last_peered":"2024-03-16T07:32:18.240890+0000","last_clean":"2024-03-16T07:32:18.240890+0000","last_became_active":"2024-03-16T07:32:18.238143+0000","last_became_peered":"2024-03-16T07:32:18.238143+0000","last_unstale":"2024-03-16T07:32:18.240890+0000","last_undegraded":"2024-03-16T07:32:18.240890+0000","last_fullsized":"2024-03-16T07:32:18.240890+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:21:44.428460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.215056+0000","last_change":"2024-03-16T07:32:17.229868+0000","last_active":"2024-03-16T07:32:18.215056+0000","last_peered":"2024-03-16T07:32:18.215056+0000","last_clean":"2024-03-16T07:32:18.215056+0000","last_became_active":"2024-03-16T07:32:17.229220+0000","last_became_peered":"2024-03-16T07:32:17.229220+0000","last_unstale":"2024-03-16T07:32:18.215056+0000","last_undegraded":"2024-03-16T07:32:18.215056+0000","last_fullsized":"2024-03-16T07:32:18.215056+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_clean_scrub_stamp":"2024-03-16T07:32:16.202808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:39:17.803291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.16","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.248370+0000","last_change":"2024-03-16T07:32:18.246236+0000","last_active":"2024-03-16T07:32:18.248370+0000","last_peered":"2024-03-16T07:32:18.248370+0000","last_clean":"2024-03-16T07:32:18.248370+0000","last_became_active":"2024-03-16T07:32:18.244713+0000","last_became_peered":"2024-03-16T07:32:18.244713+0000","last_unstale":"2024-03-16T07:32:18.248370+0000","last_undegraded":"2024-03-16T07:32:18.248370+0000","last_fullsized":"2024-03-16T07:32:18.248370+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:50:35.825792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.219830+0000","last_change":"2024-03-16T07:32:17.232177+0000","last_active":"2024-03-16T07:32:18.219830+0000","last_peered":"2024-03-16T07:32:18.219830+0000","last_clean":"2024-03-16T07:32:18.219830+0000","last_became_active":"2024-03-16T07:32:17.231920+0000","last_became_peered":"2024-03-16T07:32:17.231920+0000","last_unstale":"2024-03-16T07:32:18.219830+0000","last_undegraded":"2024-03-16T07:32:18.219830+0000","last_fullsized":"2024-03-16T07:32:18.219830+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_clean_scrub_stamp":"2024-03-16T07:32:16.202808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:25:02.223110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.17","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.234737+0000","last_change":"2024-03-16T07:32:18.233309+0000","last_active":"2024-03-16T07:32:18.234737+0000","last_peered":"2024-03-16T07:32:18.234737+0000","last_clean":"2024-03-16T07:32:18.234737+0000","last_became_active":"2024-03-16T07:32:18.233047+0000","last_became_peered":"2024-03-16T07:32:18.233047+0000","last_unstale":"2024-03-16T07:32:18.234737+0000","last_undegraded":"2024-03-16T07:32:18.234737+0000","last_fullsized":"2024-03-16T07:32:18.234737+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:18:45.894739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.219125+0000","last_change":"2024-03-16T07:32:17.219997+0000","last_active":"2024-03-16T07:32:18.219125+0000","last_peered":"2024-03-16T07:32:18.219125+0000","last_clean":"2024-03-16T07:32:18.219125+0000","last_became_active":"2024-03-16T07:32:17.219744+0000","last_became_peered":"2024-03-16T07:32:17.219744+0000","last_unstale":"2024-03-16T07:32:18.219125+0000","last_undegraded":"2024-03-16T07:32:18.219125+0000","last_fullsized":"2024-03-16T07:32:18.219125+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_clean_scrub_stamp":"2024-03-16T07:32:16.202808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:31:19.141978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.14","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.227688+0000","last_change":"2024-03-16T07:32:18.224530+0000","last_active":"2024-03-16T07:32:18.227688+0000","last_peered":"2024-03-16T07:32:18.227688+0000","last_clean":"2024-03-16T07:32:18.227688+0000","last_became_active":"2024-03-16T07:32:18.223901+0000","last_became_peered":"2024-03-16T07:32:18.223901+0000","last_unstale":"2024-03-16T07:32:18.227688+0000","last_undegraded":"2024-03-16T07:32:18.227688+0000","last_fullsized":"2024-03-16T07:32:18.227688+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:35:32.540693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.15","version":"141'3","reported_seq":15,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.250869+0000","last_change":"2024-03-16T07:32:17.220743+0000","last_active":"2024-03-16T07:32:18.250869+0000","last_peered":"2024-03-16T07:32:18.250869+0000","last_clean":"2024-03-16T07:32:18.250869+0000","last_became_active":"2024-03-16T07:32:17.220474+0000","last_became_peered":"2024-03-16T07:32:17.220474+0000","last_unstale":"2024-03-16T07:32:18.250869+0000","last_undegraded":"2024-03-16T07:32:18.250869+0000","last_fullsized":"2024-03-16T07:32:18.250869+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_clean_scrub_stamp":"2024-03-16T07:32:16.202808+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:08:19.721367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.15","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.220312+0000","last_change":"2024-03-16T07:32:18.218886+0000","last_active":"2024-03-16T07:32:18.220312+0000","last_peered":"2024-03-16T07:32:18.220312+0000","last_clean":"2024-03-16T07:32:18.220312+0000","last_became_active":"2024-03-16T07:32:18.218602+0000","last_became_peered":"2024-03-16T07:32:18.218602+0000","last_unstale":"2024-03-16T07:32:18.220312+0000","last_undegraded":"2024-03-16T07:32:18.220312+0000","last_fullsized":"2024-03-16T07:32:18.220312+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:09:39.486105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.14","version":"141'6","reported_seq":18,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.252893+0000","last_change":"2024-03-16T07:32:17.228965+0000","last_active":"2024-03-16T07:32:18.252893+0000","last_peered":"2024-03-16T07:32:18.252893+0000","last_clean":"2024-03-16T07:32:18.252893+0000","last_became_active":"2024-03-16T07:32:17.228699+0000","last_became_peered":"2024-03-16T07:32:17.228699+0000","last_unstale":"2024-03-16T07:32:18.252893+0000","last_undegraded":"2024-03-16T07:32:18.252893+0000","last_fullsized":"2024-03-16T07:32:18.252893+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_clean_scrub_stamp":"2024-03-16T07:32:16.202808+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:21:38.597189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.12","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.249777+0000","last_change":"2024-03-16T07:32:18.247568+0000","last_active":"2024-03-16T07:32:18.249777+0000","last_peered":"2024-03-16T07:32:18.249777+0000","last_clean":"2024-03-16T07:32:18.249777+0000","last_became_active":"2024-03-16T07:32:18.246899+0000","last_became_peered":"2024-03-16T07:32:18.246899+0000","last_unstale":"2024-03-16T07:32:18.249777+0000","last_undegraded":"2024-03-16T07:32:18.249777+0000","last_fullsized":"2024-03-16T07:32:18.249777+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:17:17.145202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.13","version":"141'2","reported_seq":14,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.243678+0000","last_change":"2024-03-16T07:32:17.232223+0000","last_active":"2024-03-16T07:32:18.243678+0000","last_peered":"2024-03-16T07:32:18.243678+0000","last_clean":"2024-03-16T07:32:18.243678+0000","last_became_active":"2024-03-16T07:32:17.231976+0000","last_became_peered":"2024-03-16T07:32:17.231976+0000","last_unstale":"2024-03-16T07:32:18.243678+0000","last_undegraded":"2024-03-16T07:32:18.243678+0000","last_fullsized":"2024-03-16T07:32:18.243678+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_clean_scrub_stamp":"2024-03-16T07:32:16.202808+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:45:50.377077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.13","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.242903+0000","last_change":"2024-03-16T07:32:18.239778+0000","last_active":"2024-03-16T07:32:18.242903+0000","last_peered":"2024-03-16T07:32:18.242903+0000","last_clean":"2024-03-16T07:32:18.242903+0000","last_became_active":"2024-03-16T07:32:18.239495+0000","last_became_peered":"2024-03-16T07:32:18.239495+0000","last_unstale":"2024-03-16T07:32:18.242903+0000","last_undegraded":"2024-03-16T07:32:18.242903+0000","last_fullsized":"2024-03-16T07:32:18.242903+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:45:07.587766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.212352+0000","last_change":"2024-03-16T07:32:17.229415+0000","last_active":"2024-03-16T07:32:18.212352+0000","last_peered":"2024-03-16T07:32:18.212352+0000","last_clean":"2024-03-16T07:32:18.212352+0000","last_became_active":"2024-03-16T07:32:17.228693+0000","last_became_peered":"2024-03-16T07:32:17.228693+0000","last_unstale":"2024-03-16T07:32:18.212352+0000","last_undegraded":"2024-03-16T07:32:18.212352+0000","last_fullsized":"2024-03-16T07:32:18.212352+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_clean_scrub_stamp":"2024-03-16T07:32:16.202808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:43:02.024584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.10","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.242432+0000","last_change":"2024-03-16T07:32:18.234163+0000","last_active":"2024-03-16T07:32:18.242432+0000","last_peered":"2024-03-16T07:32:18.242432+0000","last_clean":"2024-03-16T07:32:18.242432+0000","last_became_active":"2024-03-16T07:32:18.233416+0000","last_became_peered":"2024-03-16T07:32:18.233416+0000","last_unstale":"2024-03-16T07:32:18.242432+0000","last_undegraded":"2024-03-16T07:32:18.242432+0000","last_fullsized":"2024-03-16T07:32:18.242432+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:59:37.088071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.213184+0000","last_change":"2024-03-16T07:32:17.231133+0000","last_active":"2024-03-16T07:32:18.213184+0000","last_peered":"2024-03-16T07:32:18.213184+0000","last_clean":"2024-03-16T07:32:18.213184+0000","last_became_active":"2024-03-16T07:32:17.230312+0000","last_became_peered":"2024-03-16T07:32:17.230312+0000","last_unstale":"2024-03-16T07:32:18.213184+0000","last_undegraded":"2024-03-16T07:32:18.213184+0000","last_fullsized":"2024-03-16T07:32:18.213184+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_clean_scrub_stamp":"2024-03-16T07:32:16.202808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:55:33.743467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.11","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.242219+0000","last_change":"2024-03-16T07:32:18.232664+0000","last_active":"2024-03-16T07:32:18.242219+0000","last_peered":"2024-03-16T07:32:18.242219+0000","last_clean":"2024-03-16T07:32:18.242219+0000","last_became_active":"2024-03-16T07:32:18.232084+0000","last_became_peered":"2024-03-16T07:32:18.232084+0000","last_unstale":"2024-03-16T07:32:18.242219+0000","last_undegraded":"2024-03-16T07:32:18.242219+0000","last_fullsized":"2024-03-16T07:32:18.242219+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:15:32.560189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.10","version":"141'8","reported_seq":20,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.252240+0000","last_change":"2024-03-16T07:32:17.225860+0000","last_active":"2024-03-16T07:32:18.252240+0000","last_peered":"2024-03-16T07:32:18.252240+0000","last_clean":"2024-03-16T07:32:18.252240+0000","last_became_active":"2024-03-16T07:32:17.225589+0000","last_became_peered":"2024-03-16T07:32:17.225589+0000","last_unstale":"2024-03-16T07:32:18.252240+0000","last_undegraded":"2024-03-16T07:32:18.252240+0000","last_fullsized":"2024-03-16T07:32:18.252240+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_clean_scrub_stamp":"2024-03-16T07:32:16.202808+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:41:14.963665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.e","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.227753+0000","last_change":"2024-03-16T07:32:18.226029+0000","last_active":"2024-03-16T07:32:18.227753+0000","last_peered":"2024-03-16T07:32:18.227753+0000","last_clean":"2024-03-16T07:32:18.227753+0000","last_became_active":"2024-03-16T07:32:18.225788+0000","last_became_peered":"2024-03-16T07:32:18.225788+0000","last_unstale":"2024-03-16T07:32:18.227753+0000","last_undegraded":"2024-03-16T07:32:18.227753+0000","last_fullsized":"2024-03-16T07:32:18.227753+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:32:58.620237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.f","version":"141'1","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.250894+0000","last_change":"2024-03-16T07:32:17.223445+0000","last_active":"2024-03-16T07:32:18.250894+0000","last_peered":"2024-03-16T07:32:18.250894+0000","last_clean":"2024-03-16T07:32:18.250894+0000","last_became_active":"2024-03-16T07:32:17.222651+0000","last_became_peered":"2024-03-16T07:32:17.222651+0000","last_unstale":"2024-03-16T07:32:18.250894+0000","last_undegraded":"2024-03-16T07:32:18.250894+0000","last_fullsized":"2024-03-16T07:32:18.250894+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_clean_scrub_stamp":"2024-03-16T07:32:16.202808+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:12:48.104487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.f","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.243238+0000","last_change":"2024-03-16T07:32:18.242423+0000","last_active":"2024-03-16T07:32:18.243238+0000","last_peered":"2024-03-16T07:32:18.243238+0000","last_clean":"2024-03-16T07:32:18.243238+0000","last_became_active":"2024-03-16T07:32:18.241803+0000","last_became_peered":"2024-03-16T07:32:18.241803+0000","last_unstale":"2024-03-16T07:32:18.243238+0000","last_undegraded":"2024-03-16T07:32:18.243238+0000","last_fullsized":"2024-03-16T07:32:18.243238+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:56:19.184801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.e","version":"141'2","reported_seq":14,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.243799+0000","last_change":"2024-03-16T07:32:17.231123+0000","last_active":"2024-03-16T07:32:18.243799+0000","last_peered":"2024-03-16T07:32:18.243799+0000","last_clean":"2024-03-16T07:32:18.243799+0000","last_became_active":"2024-03-16T07:32:17.230808+0000","last_became_peered":"2024-03-16T07:32:17.230808+0000","last_unstale":"2024-03-16T07:32:18.243799+0000","last_undegraded":"2024-03-16T07:32:18.243799+0000","last_fullsized":"2024-03-16T07:32:18.243799+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_clean_scrub_stamp":"2024-03-16T07:32:16.202808+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:59:19.582457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.c","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.250075+0000","last_change":"2024-03-16T07:32:18.248350+0000","last_active":"2024-03-16T07:32:18.250075+0000","last_peered":"2024-03-16T07:32:18.250075+0000","last_clean":"2024-03-16T07:32:18.250075+0000","last_became_active":"2024-03-16T07:32:18.247340+0000","last_became_peered":"2024-03-16T07:32:18.247340+0000","last_unstale":"2024-03-16T07:32:18.250075+0000","last_undegraded":"2024-03-16T07:32:18.250075+0000","last_fullsized":"2024-03-16T07:32:18.250075+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:08:20.722583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.d","version":"141'1","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.247246+0000","last_change":"2024-03-16T07:32:17.229616+0000","last_active":"2024-03-16T07:32:18.247246+0000","last_peered":"2024-03-16T07:32:18.247246+0000","last_clean":"2024-03-16T07:32:18.247246+0000","last_became_active":"2024-03-16T07:32:17.229279+0000","last_became_peered":"2024-03-16T07:32:17.229279+0000","last_unstale":"2024-03-16T07:32:18.247246+0000","last_undegraded":"2024-03-16T07:32:18.247246+0000","last_fullsized":"2024-03-16T07:32:18.247246+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_clean_scrub_stamp":"2024-03-16T07:32:16.202808+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:14:11.030073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.d","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.220291+0000","last_change":"2024-03-16T07:32:18.217887+0000","last_active":"2024-03-16T07:32:18.220291+0000","last_peered":"2024-03-16T07:32:18.220291+0000","last_clean":"2024-03-16T07:32:18.220291+0000","last_became_active":"2024-03-16T07:32:18.217641+0000","last_became_peered":"2024-03-16T07:32:18.217641+0000","last_unstale":"2024-03-16T07:32:18.220291+0000","last_undegraded":"2024-03-16T07:32:18.220291+0000","last_fullsized":"2024-03-16T07:32:18.220291+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:51:00.714093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.213842+0000","last_change":"2024-03-16T07:32:17.234400+0000","last_active":"2024-03-16T07:32:18.213842+0000","last_peered":"2024-03-16T07:32:18.213842+0000","last_clean":"2024-03-16T07:32:18.213842+0000","last_became_active":"2024-03-16T07:32:17.234140+0000","last_became_peered":"2024-03-16T07:32:17.234140+0000","last_unstale":"2024-03-16T07:32:18.213842+0000","last_undegraded":"2024-03-16T07:32:18.213842+0000","last_fullsized":"2024-03-16T07:32:18.213842+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_clean_scrub_stamp":"2024-03-16T07:32:16.202808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:30:19.976759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.a","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.226640+0000","last_change":"2024-03-16T07:32:18.224341+0000","last_active":"2024-03-16T07:32:18.226640+0000","last_peered":"2024-03-16T07:32:18.226640+0000","last_clean":"2024-03-16T07:32:18.226640+0000","last_became_active":"2024-03-16T07:32:18.223713+0000","last_became_peered":"2024-03-16T07:32:18.223713+0000","last_unstale":"2024-03-16T07:32:18.226640+0000","last_undegraded":"2024-03-16T07:32:18.226640+0000","last_fullsized":"2024-03-16T07:32:18.226640+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:36:27.670654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.b","version":"141'2","reported_seq":14,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.244082+0000","last_change":"2024-03-16T07:32:17.232593+0000","last_active":"2024-03-16T07:32:18.244082+0000","last_peered":"2024-03-16T07:32:18.244082+0000","last_clean":"2024-03-16T07:32:18.244082+0000","last_became_active":"2024-03-16T07:32:17.232337+0000","last_became_peered":"2024-03-16T07:32:17.232337+0000","last_unstale":"2024-03-16T07:32:18.244082+0000","last_undegraded":"2024-03-16T07:32:18.244082+0000","last_fullsized":"2024-03-16T07:32:18.244082+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_clean_scrub_stamp":"2024-03-16T07:32:16.202808+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:29:00.632805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.b","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.242920+0000","last_change":"2024-03-16T07:32:18.240156+0000","last_active":"2024-03-16T07:32:18.242920+0000","last_peered":"2024-03-16T07:32:18.242920+0000","last_clean":"2024-03-16T07:32:18.242920+0000","last_became_active":"2024-03-16T07:32:18.239925+0000","last_became_peered":"2024-03-16T07:32:18.239925+0000","last_unstale":"2024-03-16T07:32:18.242920+0000","last_undegraded":"2024-03-16T07:32:18.242920+0000","last_fullsized":"2024-03-16T07:32:18.242920+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:42:00.570394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.220898+0000","last_change":"2024-03-16T07:32:17.227713+0000","last_active":"2024-03-16T07:32:18.220898+0000","last_peered":"2024-03-16T07:32:18.220898+0000","last_clean":"2024-03-16T07:32:18.220898+0000","last_became_active":"2024-03-16T07:32:17.227251+0000","last_became_peered":"2024-03-16T07:32:17.227251+0000","last_unstale":"2024-03-16T07:32:18.220898+0000","last_undegraded":"2024-03-16T07:32:18.220898+0000","last_fullsized":"2024-03-16T07:32:18.220898+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_clean_scrub_stamp":"2024-03-16T07:32:16.202808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:07:04.797749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.8","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.229111+0000","last_change":"2024-03-16T07:32:18.225698+0000","last_active":"2024-03-16T07:32:18.229111+0000","last_peered":"2024-03-16T07:32:18.229111+0000","last_clean":"2024-03-16T07:32:18.229111+0000","last_became_active":"2024-03-16T07:32:18.223573+0000","last_became_peered":"2024-03-16T07:32:18.223573+0000","last_unstale":"2024-03-16T07:32:18.229111+0000","last_undegraded":"2024-03-16T07:32:18.229111+0000","last_fullsized":"2024-03-16T07:32:18.229111+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:27:48.582877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.219723+0000","last_change":"2024-03-16T07:32:17.233204+0000","last_active":"2024-03-16T07:32:18.219723+0000","last_peered":"2024-03-16T07:32:18.219723+0000","last_clean":"2024-03-16T07:32:18.219723+0000","last_became_active":"2024-03-16T07:32:17.232939+0000","last_became_peered":"2024-03-16T07:32:17.232939+0000","last_unstale":"2024-03-16T07:32:18.219723+0000","last_undegraded":"2024-03-16T07:32:18.219723+0000","last_fullsized":"2024-03-16T07:32:18.219723+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_clean_scrub_stamp":"2024-03-16T07:32:16.202808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:22:20.381122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.9","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.240871+0000","last_change":"2024-03-16T07:32:18.238541+0000","last_active":"2024-03-16T07:32:18.240871+0000","last_peered":"2024-03-16T07:32:18.240871+0000","last_clean":"2024-03-16T07:32:18.240871+0000","last_became_active":"2024-03-16T07:32:18.238016+0000","last_became_peered":"2024-03-16T07:32:18.238016+0000","last_unstale":"2024-03-16T07:32:18.240871+0000","last_undegraded":"2024-03-16T07:32:18.240871+0000","last_fullsized":"2024-03-16T07:32:18.240871+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:34:12.823633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.215352+0000","last_change":"2024-03-16T07:32:17.227872+0000","last_active":"2024-03-16T07:32:18.215352+0000","last_peered":"2024-03-16T07:32:18.215352+0000","last_clean":"2024-03-16T07:32:18.215352+0000","last_became_active":"2024-03-16T07:32:17.227600+0000","last_became_peered":"2024-03-16T07:32:17.227600+0000","last_unstale":"2024-03-16T07:32:18.215352+0000","last_undegraded":"2024-03-16T07:32:18.215352+0000","last_fullsized":"2024-03-16T07:32:18.215352+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_clean_scrub_stamp":"2024-03-16T07:32:16.202808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:56:01.743830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.6","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.238998+0000","last_change":"2024-03-16T07:32:18.233930+0000","last_active":"2024-03-16T07:32:18.238998+0000","last_peered":"2024-03-16T07:32:18.238998+0000","last_clean":"2024-03-16T07:32:18.238998+0000","last_became_active":"2024-03-16T07:32:18.233008+0000","last_became_peered":"2024-03-16T07:32:18.233008+0000","last_unstale":"2024-03-16T07:32:18.238998+0000","last_undegraded":"2024-03-16T07:32:18.238998+0000","last_fullsized":"2024-03-16T07:32:18.238998+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:46:56.524556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.7","version":"141'2","reported_seq":14,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.246335+0000","last_change":"2024-03-16T07:32:17.228514+0000","last_active":"2024-03-16T07:32:18.246335+0000","last_peered":"2024-03-16T07:32:18.246335+0000","last_clean":"2024-03-16T07:32:18.246335+0000","last_became_active":"2024-03-16T07:32:17.228200+0000","last_became_peered":"2024-03-16T07:32:17.228200+0000","last_unstale":"2024-03-16T07:32:18.246335+0000","last_undegraded":"2024-03-16T07:32:18.246335+0000","last_fullsized":"2024-03-16T07:32:18.246335+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_clean_scrub_stamp":"2024-03-16T07:32:16.202808+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:50:35.506990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.7","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.244524+0000","last_change":"2024-03-16T07:32:18.242678+0000","last_active":"2024-03-16T07:32:18.244524+0000","last_peered":"2024-03-16T07:32:18.244524+0000","last_clean":"2024-03-16T07:32:18.244524+0000","last_became_active":"2024-03-16T07:32:18.242069+0000","last_became_peered":"2024-03-16T07:32:18.242069+0000","last_unstale":"2024-03-16T07:32:18.244524+0000","last_undegraded":"2024-03-16T07:32:18.244524+0000","last_fullsized":"2024-03-16T07:32:18.244524+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:25:21.517836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.214134+0000","last_change":"2024-03-16T07:32:17.231485+0000","last_active":"2024-03-16T07:32:18.214134+0000","last_peered":"2024-03-16T07:32:18.214134+0000","last_clean":"2024-03-16T07:32:18.214134+0000","last_became_active":"2024-03-16T07:32:17.231153+0000","last_became_peered":"2024-03-16T07:32:17.231153+0000","last_unstale":"2024-03-16T07:32:18.214134+0000","last_undegraded":"2024-03-16T07:32:18.214134+0000","last_fullsized":"2024-03-16T07:32:18.214134+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_clean_scrub_stamp":"2024-03-16T07:32:16.202808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:55:27.684281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.4","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.250056+0000","last_change":"2024-03-16T07:32:18.248158+0000","last_active":"2024-03-16T07:32:18.250056+0000","last_peered":"2024-03-16T07:32:18.250056+0000","last_clean":"2024-03-16T07:32:18.250056+0000","last_became_active":"2024-03-16T07:32:18.246868+0000","last_became_peered":"2024-03-16T07:32:18.246868+0000","last_unstale":"2024-03-16T07:32:18.250056+0000","last_undegraded":"2024-03-16T07:32:18.250056+0000","last_fullsized":"2024-03-16T07:32:18.250056+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:56:02.745046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.213440+0000","last_change":"2024-03-16T07:32:17.231473+0000","last_active":"2024-03-16T07:32:18.213440+0000","last_peered":"2024-03-16T07:32:18.213440+0000","last_clean":"2024-03-16T07:32:18.213440+0000","last_became_active":"2024-03-16T07:32:17.231194+0000","last_became_peered":"2024-03-16T07:32:17.231194+0000","last_unstale":"2024-03-16T07:32:18.213440+0000","last_undegraded":"2024-03-16T07:32:18.213440+0000","last_fullsized":"2024-03-16T07:32:18.213440+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_clean_scrub_stamp":"2024-03-16T07:32:16.202808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:16:54.463382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.5","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.249948+0000","last_change":"2024-03-16T07:32:18.249281+0000","last_active":"2024-03-16T07:32:18.249948+0000","last_peered":"2024-03-16T07:32:18.249948+0000","last_clean":"2024-03-16T07:32:18.249948+0000","last_became_active":"2024-03-16T07:32:18.248490+0000","last_became_peered":"2024-03-16T07:32:18.248490+0000","last_unstale":"2024-03-16T07:32:18.249948+0000","last_undegraded":"2024-03-16T07:32:18.249948+0000","last_fullsized":"2024-03-16T07:32:18.249948+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:31:20.143195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.213987+0000","last_change":"2024-03-16T07:32:17.235245+0000","last_active":"2024-03-16T07:32:18.213987+0000","last_peered":"2024-03-16T07:32:18.213987+0000","last_clean":"2024-03-16T07:32:18.213987+0000","last_became_active":"2024-03-16T07:32:17.234881+0000","last_became_peered":"2024-03-16T07:32:17.234881+0000","last_unstale":"2024-03-16T07:32:18.213987+0000","last_undegraded":"2024-03-16T07:32:18.213987+0000","last_fullsized":"2024-03-16T07:32:18.213987+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_clean_scrub_stamp":"2024-03-16T07:32:16.202808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:22:04.317619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.2","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.249812+0000","last_change":"2024-03-16T07:32:18.247940+0000","last_active":"2024-03-16T07:32:18.249812+0000","last_peered":"2024-03-16T07:32:18.249812+0000","last_clean":"2024-03-16T07:32:18.249812+0000","last_became_active":"2024-03-16T07:32:18.247584+0000","last_became_peered":"2024-03-16T07:32:18.247584+0000","last_unstale":"2024-03-16T07:32:18.249812+0000","last_undegraded":"2024-03-16T07:32:18.249812+0000","last_fullsized":"2024-03-16T07:32:18.249812+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:39:18.804508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.225843+0000","last_change":"2024-03-16T07:32:17.226266+0000","last_active":"2024-03-16T07:32:18.225843+0000","last_peered":"2024-03-16T07:32:18.225843+0000","last_clean":"2024-03-16T07:32:18.225843+0000","last_became_active":"2024-03-16T07:32:17.226014+0000","last_became_peered":"2024-03-16T07:32:17.226014+0000","last_unstale":"2024-03-16T07:32:18.225843+0000","last_undegraded":"2024-03-16T07:32:18.225843+0000","last_fullsized":"2024-03-16T07:32:18.225843+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_clean_scrub_stamp":"2024-03-16T07:32:16.202808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:23:58.730547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.3","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.241257+0000","last_change":"2024-03-16T07:32:18.239059+0000","last_active":"2024-03-16T07:32:18.241257+0000","last_peered":"2024-03-16T07:32:18.241257+0000","last_clean":"2024-03-16T07:32:18.241257+0000","last_became_active":"2024-03-16T07:32:18.237797+0000","last_became_peered":"2024-03-16T07:32:18.237797+0000","last_unstale":"2024-03-16T07:32:18.241257+0000","last_undegraded":"2024-03-16T07:32:18.241257+0000","last_fullsized":"2024-03-16T07:32:18.241257+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:59:39.662853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.227536+0000","last_change":"2024-03-16T07:32:17.231212+0000","last_active":"2024-03-16T07:32:18.227536+0000","last_peered":"2024-03-16T07:32:18.227536+0000","last_clean":"2024-03-16T07:32:18.227536+0000","last_became_active":"2024-03-16T07:32:17.230958+0000","last_became_peered":"2024-03-16T07:32:17.230958+0000","last_unstale":"2024-03-16T07:32:18.227536+0000","last_undegraded":"2024-03-16T07:32:18.227536+0000","last_fullsized":"2024-03-16T07:32:18.227536+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_clean_scrub_stamp":"2024-03-16T07:32:16.202808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:03:51.994607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.0","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.245640+0000","last_change":"2024-03-16T07:32:18.244971+0000","last_active":"2024-03-16T07:32:18.245640+0000","last_peered":"2024-03-16T07:32:18.245640+0000","last_clean":"2024-03-16T07:32:18.245640+0000","last_became_active":"2024-03-16T07:32:18.244256+0000","last_became_peered":"2024-03-16T07:32:18.244256+0000","last_unstale":"2024-03-16T07:32:18.245640+0000","last_undegraded":"2024-03-16T07:32:18.245640+0000","last_fullsized":"2024-03-16T07:32:18.245640+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:17:45.128958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.219898+0000","last_change":"2024-03-16T07:32:17.233190+0000","last_active":"2024-03-16T07:32:18.219898+0000","last_peered":"2024-03-16T07:32:18.219898+0000","last_clean":"2024-03-16T07:32:18.219898+0000","last_became_active":"2024-03-16T07:32:17.232917+0000","last_became_peered":"2024-03-16T07:32:17.232917+0000","last_unstale":"2024-03-16T07:32:18.219898+0000","last_undegraded":"2024-03-16T07:32:18.219898+0000","last_fullsized":"2024-03-16T07:32:18.219898+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_clean_scrub_stamp":"2024-03-16T07:32:16.202808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:31:01.279190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.240850+0000","last_change":"2024-03-16T07:32:18.238398+0000","last_active":"2024-03-16T07:32:18.240850+0000","last_peered":"2024-03-16T07:32:18.240850+0000","last_clean":"2024-03-16T07:32:18.240850+0000","last_became_active":"2024-03-16T07:32:18.237807+0000","last_became_peered":"2024-03-16T07:32:18.237807+0000","last_unstale":"2024-03-16T07:32:18.240850+0000","last_undegraded":"2024-03-16T07:32:18.240850+0000","last_fullsized":"2024-03-16T07:32:18.240850+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:16:18.048818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.226682+0000","last_change":"2024-03-16T07:32:17.233414+0000","last_active":"2024-03-16T07:32:18.226682+0000","last_peered":"2024-03-16T07:32:18.226682+0000","last_clean":"2024-03-16T07:32:18.226682+0000","last_became_active":"2024-03-16T07:32:17.233153+0000","last_became_peered":"2024-03-16T07:32:17.233153+0000","last_unstale":"2024-03-16T07:32:18.226682+0000","last_undegraded":"2024-03-16T07:32:18.226682+0000","last_fullsized":"2024-03-16T07:32:18.226682+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_clean_scrub_stamp":"2024-03-16T07:32:16.202808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:06:54.148824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.18","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.222017+0000","last_change":"2024-03-16T07:32:18.218918+0000","last_active":"2024-03-16T07:32:18.222017+0000","last_peered":"2024-03-16T07:32:18.222017+0000","last_clean":"2024-03-16T07:32:18.222017+0000","last_became_active":"2024-03-16T07:32:18.218148+0000","last_became_peered":"2024-03-16T07:32:18.218148+0000","last_unstale":"2024-03-16T07:32:18.222017+0000","last_undegraded":"2024-03-16T07:32:18.222017+0000","last_fullsized":"2024-03-16T07:32:18.222017+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:19:39.332190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.211236+0000","last_change":"2024-03-16T07:32:17.230782+0000","last_active":"2024-03-16T07:32:18.211236+0000","last_peered":"2024-03-16T07:32:18.211236+0000","last_clean":"2024-03-16T07:32:18.211236+0000","last_became_active":"2024-03-16T07:32:17.229981+0000","last_became_peered":"2024-03-16T07:32:17.229981+0000","last_unstale":"2024-03-16T07:32:18.211236+0000","last_undegraded":"2024-03-16T07:32:18.211236+0000","last_fullsized":"2024-03-16T07:32:18.211236+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_clean_scrub_stamp":"2024-03-16T07:32:16.202808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:02:31.073119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"126'196","reported_seq":731,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.226505+0000","last_change":"2024-03-16T07:24:31.650537+0000","last_active":"2024-03-16T07:32:18.226505+0000","last_peered":"2024-03-16T07:32:18.226505+0000","last_clean":"2024-03-16T07:32:18.226505+0000","last_became_active":"2024-03-16T07:24:31.649574+0000","last_became_peered":"2024-03-16T07:24:31.649574+0000","last_unstale":"2024-03-16T07:32:18.226505+0000","last_undegraded":"2024-03-16T07:32:18.226505+0000","last_fullsized":"2024-03-16T07:32:18.226505+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:29.719970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:29.719970+0000","last_clean_scrub_stamp":"2024-03-16T07:24:29.719970+0000","objects_scrubbed":0,"log_size":196,"log_dups_size":0,"ondisk_log_size":196,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:31:35.774554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":970,"num_read_kb":1945,"num_write":317,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":25,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":24,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":970,"num_read_kb":1945,"num_write":317,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738459,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":36776,"kb_used_data":1428,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":104820824,"statfs":{"total":107374182400,"available":107336523776,"internally_reserved":0,"allocated":1462272,"data_stored":591767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738459,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":37328,"kb_used_data":1984,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":104820272,"statfs":{"total":107374182400,"available":107335958528,"internally_reserved":0,"allocated":2031616,"data_stored":1176906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738459,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":37372,"kb_used_data":2024,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":104820228,"statfs":{"total":107374182400,"available":107335913472,"internally_reserved":0,"allocated":2072576,"data_stored":1183781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-16T07:32:22.521 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-16T07:32:22.864 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:32:22.865 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2024-03-16T07:32:22.874 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":34,"stamp":"2024-03-16T07:32:22.823326+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":970,"num_read_kb":1945,"num_write":361,"num_write_kb":1908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":234,"ondisk_log_size":234,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":314572800,"kb_used":111476,"kb_used_data":5436,"kb_used_omap":4,"kb_used_meta":105979,"kb_avail":314461324,"statfs":{"total":322122547200,"available":322008395776,"internally_reserved":0,"allocated":5566464,"data_stored":2952454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":108522831},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001006"},"pg_stats":[{"pgid":"25.3f","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.250017+0000","last_change":"2024-03-16T07:32:18.247962+0000","last_active":"2024-03-16T07:32:18.250017+0000","last_peered":"2024-03-16T07:32:18.250017+0000","last_clean":"2024-03-16T07:32:18.250017+0000","last_became_active":"2024-03-16T07:32:18.247621+0000","last_became_peered":"2024-03-16T07:32:18.247621+0000","last_unstale":"2024-03-16T07:32:18.250017+0000","last_undegraded":"2024-03-16T07:32:18.250017+0000","last_fullsized":"2024-03-16T07:32:18.250017+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:41:15.964881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.3e","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.249742+0000","last_change":"2024-03-16T07:32:18.246415+0000","last_active":"2024-03-16T07:32:18.249742+0000","last_peered":"2024-03-16T07:32:18.249742+0000","last_clean":"2024-03-16T07:32:18.249742+0000","last_became_active":"2024-03-16T07:32:18.246171+0000","last_became_peered":"2024-03-16T07:32:18.246171+0000","last_unstale":"2024-03-16T07:32:18.249742+0000","last_undegraded":"2024-03-16T07:32:18.249742+0000","last_fullsized":"2024-03-16T07:32:18.249742+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:10:31.726525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.3d","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.245959+0000","last_change":"2024-03-16T07:32:18.243582+0000","last_active":"2024-03-16T07:32:18.245959+0000","last_peered":"2024-03-16T07:32:18.245959+0000","last_clean":"2024-03-16T07:32:18.245959+0000","last_became_active":"2024-03-16T07:32:18.243189+0000","last_became_peered":"2024-03-16T07:32:18.243189+0000","last_unstale":"2024-03-16T07:32:18.245959+0000","last_undegraded":"2024-03-16T07:32:18.245959+0000","last_fullsized":"2024-03-16T07:32:18.245959+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:15:38.818060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.3c","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.247022+0000","last_change":"2024-03-16T07:32:18.245554+0000","last_active":"2024-03-16T07:32:18.247022+0000","last_peered":"2024-03-16T07:32:18.247022+0000","last_clean":"2024-03-16T07:32:18.247022+0000","last_became_active":"2024-03-16T07:32:18.245016+0000","last_became_peered":"2024-03-16T07:32:18.245016+0000","last_unstale":"2024-03-16T07:32:18.247022+0000","last_undegraded":"2024-03-16T07:32:18.247022+0000","last_fullsized":"2024-03-16T07:32:18.247022+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:51:17.400032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.3b","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.239524+0000","last_change":"2024-03-16T07:32:18.235990+0000","last_active":"2024-03-16T07:32:18.239524+0000","last_peered":"2024-03-16T07:32:18.239524+0000","last_clean":"2024-03-16T07:32:18.239524+0000","last_became_active":"2024-03-16T07:32:18.235735+0000","last_became_peered":"2024-03-16T07:32:18.235735+0000","last_unstale":"2024-03-16T07:32:18.239524+0000","last_undegraded":"2024-03-16T07:32:18.239524+0000","last_fullsized":"2024-03-16T07:32:18.239524+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:54:41.949813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.3a","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.244694+0000","last_change":"2024-03-16T07:32:18.243404+0000","last_active":"2024-03-16T07:32:18.244694+0000","last_peered":"2024-03-16T07:32:18.244694+0000","last_clean":"2024-03-16T07:32:18.244694+0000","last_became_active":"2024-03-16T07:32:18.243142+0000","last_became_peered":"2024-03-16T07:32:18.243142+0000","last_unstale":"2024-03-16T07:32:18.244694+0000","last_undegraded":"2024-03-16T07:32:18.244694+0000","last_fullsized":"2024-03-16T07:32:18.244694+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:45:51.099391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.39","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.242826+0000","last_change":"2024-03-16T07:32:18.240139+0000","last_active":"2024-03-16T07:32:18.242826+0000","last_peered":"2024-03-16T07:32:18.242826+0000","last_clean":"2024-03-16T07:32:18.242826+0000","last_became_active":"2024-03-16T07:32:18.238310+0000","last_became_peered":"2024-03-16T07:32:18.238310+0000","last_unstale":"2024-03-16T07:32:18.242826+0000","last_undegraded":"2024-03-16T07:32:18.242826+0000","last_fullsized":"2024-03-16T07:32:18.242826+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:20:21.637896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.38","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.246730+0000","last_change":"2024-03-16T07:32:18.245507+0000","last_active":"2024-03-16T07:32:18.246730+0000","last_peered":"2024-03-16T07:32:18.246730+0000","last_clean":"2024-03-16T07:32:18.246730+0000","last_became_active":"2024-03-16T07:32:18.245260+0000","last_became_peered":"2024-03-16T07:32:18.245260+0000","last_unstale":"2024-03-16T07:32:18.246730+0000","last_undegraded":"2024-03-16T07:32:18.246730+0000","last_fullsized":"2024-03-16T07:32:18.246730+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:16:33.993986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.37","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.249996+0000","last_change":"2024-03-16T07:32:18.247274+0000","last_active":"2024-03-16T07:32:18.249996+0000","last_peered":"2024-03-16T07:32:18.249996+0000","last_clean":"2024-03-16T07:32:18.249996+0000","last_became_active":"2024-03-16T07:32:18.247021+0000","last_became_peered":"2024-03-16T07:32:18.247021+0000","last_unstale":"2024-03-16T07:32:18.249996+0000","last_undegraded":"2024-03-16T07:32:18.249996+0000","last_fullsized":"2024-03-16T07:32:18.249996+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:30:33.178302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.36","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.242178+0000","last_change":"2024-03-16T07:32:18.239231+0000","last_active":"2024-03-16T07:32:18.242178+0000","last_peered":"2024-03-16T07:32:18.242178+0000","last_clean":"2024-03-16T07:32:18.242178+0000","last_became_active":"2024-03-16T07:32:18.238947+0000","last_became_peered":"2024-03-16T07:32:18.238947+0000","last_unstale":"2024-03-16T07:32:18.242178+0000","last_undegraded":"2024-03-16T07:32:18.242178+0000","last_fullsized":"2024-03-16T07:32:18.242178+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:26:04.314471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.35","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.238933+0000","last_change":"2024-03-16T07:32:18.237180+0000","last_active":"2024-03-16T07:32:18.238933+0000","last_peered":"2024-03-16T07:32:18.238933+0000","last_clean":"2024-03-16T07:32:18.238933+0000","last_became_active":"2024-03-16T07:32:18.236919+0000","last_became_peered":"2024-03-16T07:32:18.236919+0000","last_unstale":"2024-03-16T07:32:18.238933+0000","last_undegraded":"2024-03-16T07:32:18.238933+0000","last_fullsized":"2024-03-16T07:32:18.238933+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:08:10.533094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.34","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.242629+0000","last_change":"2024-03-16T07:32:18.241361+0000","last_active":"2024-03-16T07:32:18.242629+0000","last_peered":"2024-03-16T07:32:18.242629+0000","last_clean":"2024-03-16T07:32:18.242629+0000","last_became_active":"2024-03-16T07:32:18.240963+0000","last_became_peered":"2024-03-16T07:32:18.240963+0000","last_unstale":"2024-03-16T07:32:18.242629+0000","last_undegraded":"2024-03-16T07:32:18.242629+0000","last_fullsized":"2024-03-16T07:32:18.242629+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:11:47.343567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.33","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.245497+0000","last_change":"2024-03-16T07:32:18.244631+0000","last_active":"2024-03-16T07:32:18.245497+0000","last_peered":"2024-03-16T07:32:18.245497+0000","last_clean":"2024-03-16T07:32:18.245497+0000","last_became_active":"2024-03-16T07:32:18.244350+0000","last_became_peered":"2024-03-16T07:32:18.244350+0000","last_unstale":"2024-03-16T07:32:18.245497+0000","last_undegraded":"2024-03-16T07:32:18.245497+0000","last_fullsized":"2024-03-16T07:32:18.245497+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:33:33.149972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.32","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.249796+0000","last_change":"2024-03-16T07:32:18.247797+0000","last_active":"2024-03-16T07:32:18.249796+0000","last_peered":"2024-03-16T07:32:18.249796+0000","last_clean":"2024-03-16T07:32:18.249796+0000","last_became_active":"2024-03-16T07:32:18.247260+0000","last_became_peered":"2024-03-16T07:32:18.247260+0000","last_unstale":"2024-03-16T07:32:18.249796+0000","last_undegraded":"2024-03-16T07:32:18.249796+0000","last_fullsized":"2024-03-16T07:32:18.249796+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:11:08.101911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.31","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.242241+0000","last_change":"2024-03-16T07:32:18.233233+0000","last_active":"2024-03-16T07:32:18.242241+0000","last_peered":"2024-03-16T07:32:18.242241+0000","last_clean":"2024-03-16T07:32:18.242241+0000","last_became_active":"2024-03-16T07:32:18.232417+0000","last_became_peered":"2024-03-16T07:32:18.232417+0000","last_unstale":"2024-03-16T07:32:18.242241+0000","last_undegraded":"2024-03-16T07:32:18.242241+0000","last_fullsized":"2024-03-16T07:32:18.242241+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:46:13.531171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.30","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.226639+0000","last_change":"2024-03-16T07:32:18.225150+0000","last_active":"2024-03-16T07:32:18.226639+0000","last_peered":"2024-03-16T07:32:18.226639+0000","last_clean":"2024-03-16T07:32:18.226639+0000","last_became_active":"2024-03-16T07:32:18.224307+0000","last_became_peered":"2024-03-16T07:32:18.224307+0000","last_unstale":"2024-03-16T07:32:18.226639+0000","last_undegraded":"2024-03-16T07:32:18.226639+0000","last_fullsized":"2024-03-16T07:32:18.226639+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:03:50.228942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2f","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.250936+0000","last_change":"2024-03-16T07:32:18.248997+0000","last_active":"2024-03-16T07:32:18.250936+0000","last_peered":"2024-03-16T07:32:18.250936+0000","last_clean":"2024-03-16T07:32:18.250936+0000","last_became_active":"2024-03-16T07:32:18.248743+0000","last_became_peered":"2024-03-16T07:32:18.248743+0000","last_unstale":"2024-03-16T07:32:18.250936+0000","last_undegraded":"2024-03-16T07:32:18.250936+0000","last_fullsized":"2024-03-16T07:32:18.250936+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:03:26.209534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2e","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.238976+0000","last_change":"2024-03-16T07:32:18.233726+0000","last_active":"2024-03-16T07:32:18.238976+0000","last_peered":"2024-03-16T07:32:18.238976+0000","last_clean":"2024-03-16T07:32:18.238976+0000","last_became_active":"2024-03-16T07:32:18.232689+0000","last_became_peered":"2024-03-16T07:32:18.232689+0000","last_unstale":"2024-03-16T07:32:18.238976+0000","last_undegraded":"2024-03-16T07:32:18.238976+0000","last_fullsized":"2024-03-16T07:32:18.238976+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:36:57.985523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2d","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.243418+0000","last_change":"2024-03-16T07:32:18.236128+0000","last_active":"2024-03-16T07:32:18.243418+0000","last_peered":"2024-03-16T07:32:18.243418+0000","last_clean":"2024-03-16T07:32:18.243418+0000","last_became_active":"2024-03-16T07:32:18.235894+0000","last_became_peered":"2024-03-16T07:32:18.235894+0000","last_unstale":"2024-03-16T07:32:18.243418+0000","last_undegraded":"2024-03-16T07:32:18.243418+0000","last_fullsized":"2024-03-16T07:32:18.243418+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:16:46.510357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.2c","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.225133+0000","last_change":"2024-03-16T07:32:18.224575+0000","last_active":"2024-03-16T07:32:18.225133+0000","last_peered":"2024-03-16T07:32:18.225133+0000","last_clean":"2024-03-16T07:32:18.225133+0000","last_became_active":"2024-03-16T07:32:18.224316+0000","last_became_peered":"2024-03-16T07:32:18.224316+0000","last_unstale":"2024-03-16T07:32:18.225133+0000","last_undegraded":"2024-03-16T07:32:18.225133+0000","last_fullsized":"2024-03-16T07:32:18.225133+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:38:11.159687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2b","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.251471+0000","last_change":"2024-03-16T07:32:18.250300+0000","last_active":"2024-03-16T07:32:18.251471+0000","last_peered":"2024-03-16T07:32:18.251471+0000","last_clean":"2024-03-16T07:32:18.251471+0000","last_became_active":"2024-03-16T07:32:18.249983+0000","last_became_peered":"2024-03-16T07:32:18.249983+0000","last_unstale":"2024-03-16T07:32:18.251471+0000","last_undegraded":"2024-03-16T07:32:18.251471+0000","last_fullsized":"2024-03-16T07:32:18.251471+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:58:36.160396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2a","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.227852+0000","last_change":"2024-03-16T07:32:18.226323+0000","last_active":"2024-03-16T07:32:18.227852+0000","last_peered":"2024-03-16T07:32:18.227852+0000","last_clean":"2024-03-16T07:32:18.227852+0000","last_became_active":"2024-03-16T07:32:18.225946+0000","last_became_peered":"2024-03-16T07:32:18.225946+0000","last_unstale":"2024-03-16T07:32:18.227852+0000","last_undegraded":"2024-03-16T07:32:18.227852+0000","last_fullsized":"2024-03-16T07:32:18.227852+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:35:05.481260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.29","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.245200+0000","last_change":"2024-03-16T07:32:18.244224+0000","last_active":"2024-03-16T07:32:18.245200+0000","last_peered":"2024-03-16T07:32:18.245200+0000","last_clean":"2024-03-16T07:32:18.245200+0000","last_became_active":"2024-03-16T07:32:18.243900+0000","last_became_peered":"2024-03-16T07:32:18.243900+0000","last_unstale":"2024-03-16T07:32:18.245200+0000","last_undegraded":"2024-03-16T07:32:18.245200+0000","last_fullsized":"2024-03-16T07:32:18.245200+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:34:09.228347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.28","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.242455+0000","last_change":"2024-03-16T07:32:18.235208+0000","last_active":"2024-03-16T07:32:18.242455+0000","last_peered":"2024-03-16T07:32:18.242455+0000","last_clean":"2024-03-16T07:32:18.242455+0000","last_became_active":"2024-03-16T07:32:18.233745+0000","last_became_peered":"2024-03-16T07:32:18.233745+0000","last_unstale":"2024-03-16T07:32:18.242455+0000","last_undegraded":"2024-03-16T07:32:18.242455+0000","last_fullsized":"2024-03-16T07:32:18.242455+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:48:56.339661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.27","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.235043+0000","last_change":"2024-03-16T07:32:18.234600+0000","last_active":"2024-03-16T07:32:18.235043+0000","last_peered":"2024-03-16T07:32:18.235043+0000","last_clean":"2024-03-16T07:32:18.235043+0000","last_became_active":"2024-03-16T07:32:18.234355+0000","last_became_peered":"2024-03-16T07:32:18.234355+0000","last_unstale":"2024-03-16T07:32:18.235043+0000","last_undegraded":"2024-03-16T07:32:18.235043+0000","last_fullsized":"2024-03-16T07:32:18.235043+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:11:48.077846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.26","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.227732+0000","last_change":"2024-03-16T07:32:18.225540+0000","last_active":"2024-03-16T07:32:18.227732+0000","last_peered":"2024-03-16T07:32:18.227732+0000","last_clean":"2024-03-16T07:32:18.227732+0000","last_became_active":"2024-03-16T07:32:18.225284+0000","last_became_peered":"2024-03-16T07:32:18.225284+0000","last_unstale":"2024-03-16T07:32:18.227732+0000","last_undegraded":"2024-03-16T07:32:18.227732+0000","last_fullsized":"2024-03-16T07:32:18.227732+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:09:56.297700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.25","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.249990+0000","last_change":"2024-03-16T07:32:18.249523+0000","last_active":"2024-03-16T07:32:18.249990+0000","last_peered":"2024-03-16T07:32:18.249990+0000","last_clean":"2024-03-16T07:32:18.249990+0000","last_became_active":"2024-03-16T07:32:18.249244+0000","last_became_peered":"2024-03-16T07:32:18.249244+0000","last_unstale":"2024-03-16T07:32:18.249990+0000","last_undegraded":"2024-03-16T07:32:18.249990+0000","last_fullsized":"2024-03-16T07:32:18.249990+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:07:05.798965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.24","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.242197+0000","last_change":"2024-03-16T07:32:18.239570+0000","last_active":"2024-03-16T07:32:18.242197+0000","last_peered":"2024-03-16T07:32:18.242197+0000","last_clean":"2024-03-16T07:32:18.242197+0000","last_became_active":"2024-03-16T07:32:18.239318+0000","last_became_peered":"2024-03-16T07:32:18.239318+0000","last_unstale":"2024-03-16T07:32:18.242197+0000","last_undegraded":"2024-03-16T07:32:18.242197+0000","last_fullsized":"2024-03-16T07:32:18.242197+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:36:04.847955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.23","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.243113+0000","last_change":"2024-03-16T07:32:18.241882+0000","last_active":"2024-03-16T07:32:18.243113+0000","last_peered":"2024-03-16T07:32:18.243113+0000","last_clean":"2024-03-16T07:32:18.243113+0000","last_became_active":"2024-03-16T07:32:18.241443+0000","last_became_peered":"2024-03-16T07:32:18.241443+0000","last_unstale":"2024-03-16T07:32:18.243113+0000","last_undegraded":"2024-03-16T07:32:18.243113+0000","last_fullsized":"2024-03-16T07:32:18.243113+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:14:41.948370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.22","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.227833+0000","last_change":"2024-03-16T07:32:18.226198+0000","last_active":"2024-03-16T07:32:18.227833+0000","last_peered":"2024-03-16T07:32:18.227833+0000","last_clean":"2024-03-16T07:32:18.227833+0000","last_became_active":"2024-03-16T07:32:18.224070+0000","last_became_peered":"2024-03-16T07:32:18.224070+0000","last_unstale":"2024-03-16T07:32:18.227833+0000","last_undegraded":"2024-03-16T07:32:18.227833+0000","last_fullsized":"2024-03-16T07:32:18.227833+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:59:41.396759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.21","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.234677+0000","last_change":"2024-03-16T07:32:18.233960+0000","last_active":"2024-03-16T07:32:18.234677+0000","last_peered":"2024-03-16T07:32:18.234677+0000","last_clean":"2024-03-16T07:32:18.234677+0000","last_became_active":"2024-03-16T07:32:18.233732+0000","last_became_peered":"2024-03-16T07:32:18.233732+0000","last_unstale":"2024-03-16T07:32:18.234677+0000","last_undegraded":"2024-03-16T07:32:18.234677+0000","last_fullsized":"2024-03-16T07:32:18.234677+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:01:38.728287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.20","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.238991+0000","last_change":"2024-03-16T07:32:18.233834+0000","last_active":"2024-03-16T07:32:18.238991+0000","last_peered":"2024-03-16T07:32:18.238991+0000","last_clean":"2024-03-16T07:32:18.238991+0000","last_became_active":"2024-03-16T07:32:18.233597+0000","last_became_peered":"2024-03-16T07:32:18.233597+0000","last_unstale":"2024-03-16T07:32:18.238991+0000","last_undegraded":"2024-03-16T07:32:18.238991+0000","last_fullsized":"2024-03-16T07:32:18.238991+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:21:41.842380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1e","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.229455+0000","last_change":"2024-03-16T07:32:18.228560+0000","last_active":"2024-03-16T07:32:18.229455+0000","last_peered":"2024-03-16T07:32:18.229455+0000","last_clean":"2024-03-16T07:32:18.229455+0000","last_became_active":"2024-03-16T07:32:18.228293+0000","last_became_peered":"2024-03-16T07:32:18.228293+0000","last_unstale":"2024-03-16T07:32:18.229455+0000","last_undegraded":"2024-03-16T07:32:18.229455+0000","last_fullsized":"2024-03-16T07:32:18.229455+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:06:24.622898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.1f","version":"141'4","reported_seq":16,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.251051+0000","last_change":"2024-03-16T07:32:17.224916+0000","last_active":"2024-03-16T07:32:18.251051+0000","last_peered":"2024-03-16T07:32:18.251051+0000","last_clean":"2024-03-16T07:32:18.251051+0000","last_became_active":"2024-03-16T07:32:17.224654+0000","last_became_peered":"2024-03-16T07:32:17.224654+0000","last_unstale":"2024-03-16T07:32:18.251051+0000","last_undegraded":"2024-03-16T07:32:18.251051+0000","last_fullsized":"2024-03-16T07:32:18.251051+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_clean_scrub_stamp":"2024-03-16T07:32:16.202808+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:50:05.049365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1f","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.244546+0000","last_change":"2024-03-16T07:32:18.243113+0000","last_active":"2024-03-16T07:32:18.244546+0000","last_peered":"2024-03-16T07:32:18.244546+0000","last_clean":"2024-03-16T07:32:18.244546+0000","last_became_active":"2024-03-16T07:32:18.242717+0000","last_became_peered":"2024-03-16T07:32:18.242717+0000","last_unstale":"2024-03-16T07:32:18.244546+0000","last_undegraded":"2024-03-16T07:32:18.244546+0000","last_fullsized":"2024-03-16T07:32:18.244546+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:25:27.770126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1e","version":"141'1","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.242075+0000","last_change":"2024-03-16T07:32:17.232318+0000","last_active":"2024-03-16T07:32:18.242075+0000","last_peered":"2024-03-16T07:32:18.242075+0000","last_clean":"2024-03-16T07:32:18.242075+0000","last_became_active":"2024-03-16T07:32:17.230713+0000","last_became_peered":"2024-03-16T07:32:17.230713+0000","last_unstale":"2024-03-16T07:32:18.242075+0000","last_undegraded":"2024-03-16T07:32:18.242075+0000","last_fullsized":"2024-03-16T07:32:18.242075+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_clean_scrub_stamp":"2024-03-16T07:32:16.202808+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:18:34.025222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.1c","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.231285+0000","last_change":"2024-03-16T07:32:18.230121+0000","last_active":"2024-03-16T07:32:18.231285+0000","last_peered":"2024-03-16T07:32:18.231285+0000","last_clean":"2024-03-16T07:32:18.231285+0000","last_became_active":"2024-03-16T07:32:18.229075+0000","last_became_peered":"2024-03-16T07:32:18.229075+0000","last_unstale":"2024-03-16T07:32:18.231285+0000","last_undegraded":"2024-03-16T07:32:18.231285+0000","last_fullsized":"2024-03-16T07:32:18.231285+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:50:01.168314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.1d","version":"141'2","reported_seq":14,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.247975+0000","last_change":"2024-03-16T07:32:17.228396+0000","last_active":"2024-03-16T07:32:18.247975+0000","last_peered":"2024-03-16T07:32:18.247975+0000","last_clean":"2024-03-16T07:32:18.247975+0000","last_became_active":"2024-03-16T07:32:17.228131+0000","last_became_peered":"2024-03-16T07:32:17.228131+0000","last_unstale":"2024-03-16T07:32:18.247975+0000","last_undegraded":"2024-03-16T07:32:18.247975+0000","last_fullsized":"2024-03-16T07:32:18.247975+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_clean_scrub_stamp":"2024-03-16T07:32:16.202808+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:05:23.959390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1d","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.249969+0000","last_change":"2024-03-16T07:32:18.249490+0000","last_active":"2024-03-16T07:32:18.249969+0000","last_peered":"2024-03-16T07:32:18.249969+0000","last_clean":"2024-03-16T07:32:18.249969+0000","last_became_active":"2024-03-16T07:32:18.249036+0000","last_became_peered":"2024-03-16T07:32:18.249036+0000","last_unstale":"2024-03-16T07:32:18.249969+0000","last_undegraded":"2024-03-16T07:32:18.249969+0000","last_fullsized":"2024-03-16T07:32:18.249969+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:48:48.765327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.1c","version":"141'2","reported_seq":14,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.242398+0000","last_change":"2024-03-16T07:32:17.230842+0000","last_active":"2024-03-16T07:32:18.242398+0000","last_peered":"2024-03-16T07:32:18.242398+0000","last_clean":"2024-03-16T07:32:18.242398+0000","last_became_active":"2024-03-16T07:32:17.230593+0000","last_became_peered":"2024-03-16T07:32:17.230593+0000","last_unstale":"2024-03-16T07:32:18.242398+0000","last_undegraded":"2024-03-16T07:32:18.242398+0000","last_fullsized":"2024-03-16T07:32:18.242398+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_clean_scrub_stamp":"2024-03-16T07:32:16.202808+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:03:33.084093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.1a","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.227811+0000","last_change":"2024-03-16T07:32:18.226108+0000","last_active":"2024-03-16T07:32:18.227811+0000","last_peered":"2024-03-16T07:32:18.227811+0000","last_clean":"2024-03-16T07:32:18.227811+0000","last_became_active":"2024-03-16T07:32:18.223749+0000","last_became_peered":"2024-03-16T07:32:18.223749+0000","last_unstale":"2024-03-16T07:32:18.227811+0000","last_undegraded":"2024-03-16T07:32:18.227811+0000","last_fullsized":"2024-03-16T07:32:18.227811+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:18:02.109767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1b","version":"141'1","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.251398+0000","last_change":"2024-03-16T07:32:17.225004+0000","last_active":"2024-03-16T07:32:18.251398+0000","last_peered":"2024-03-16T07:32:18.251398+0000","last_clean":"2024-03-16T07:32:18.251398+0000","last_became_active":"2024-03-16T07:32:17.224306+0000","last_became_peered":"2024-03-16T07:32:17.224306+0000","last_unstale":"2024-03-16T07:32:18.251398+0000","last_undegraded":"2024-03-16T07:32:18.251398+0000","last_fullsized":"2024-03-16T07:32:18.251398+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_clean_scrub_stamp":"2024-03-16T07:32:16.202808+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:58:22.521647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1b","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.242882+0000","last_change":"2024-03-16T07:32:18.239642+0000","last_active":"2024-03-16T07:32:18.242882+0000","last_peered":"2024-03-16T07:32:18.242882+0000","last_clean":"2024-03-16T07:32:18.242882+0000","last_became_active":"2024-03-16T07:32:18.239335+0000","last_became_peered":"2024-03-16T07:32:18.239335+0000","last_unstale":"2024-03-16T07:32:18.242882+0000","last_undegraded":"2024-03-16T07:32:18.242882+0000","last_fullsized":"2024-03-16T07:32:18.242882+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:23:00.374407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.1a","version":"141'1","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.242158+0000","last_change":"2024-03-16T07:32:17.228025+0000","last_active":"2024-03-16T07:32:18.242158+0000","last_peered":"2024-03-16T07:32:18.242158+0000","last_clean":"2024-03-16T07:32:18.242158+0000","last_became_active":"2024-03-16T07:32:17.227533+0000","last_became_peered":"2024-03-16T07:32:17.227533+0000","last_unstale":"2024-03-16T07:32:18.242158+0000","last_undegraded":"2024-03-16T07:32:18.242158+0000","last_fullsized":"2024-03-16T07:32:18.242158+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_clean_scrub_stamp":"2024-03-16T07:32:16.202808+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:48:47.764111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.19","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.240890+0000","last_change":"2024-03-16T07:32:18.238620+0000","last_active":"2024-03-16T07:32:18.240890+0000","last_peered":"2024-03-16T07:32:18.240890+0000","last_clean":"2024-03-16T07:32:18.240890+0000","last_became_active":"2024-03-16T07:32:18.238143+0000","last_became_peered":"2024-03-16T07:32:18.238143+0000","last_unstale":"2024-03-16T07:32:18.240890+0000","last_undegraded":"2024-03-16T07:32:18.240890+0000","last_fullsized":"2024-03-16T07:32:18.240890+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:21:44.428460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.215056+0000","last_change":"2024-03-16T07:32:17.229868+0000","last_active":"2024-03-16T07:32:18.215056+0000","last_peered":"2024-03-16T07:32:18.215056+0000","last_clean":"2024-03-16T07:32:18.215056+0000","last_became_active":"2024-03-16T07:32:17.229220+0000","last_became_peered":"2024-03-16T07:32:17.229220+0000","last_unstale":"2024-03-16T07:32:18.215056+0000","last_undegraded":"2024-03-16T07:32:18.215056+0000","last_fullsized":"2024-03-16T07:32:18.215056+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_clean_scrub_stamp":"2024-03-16T07:32:16.202808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:39:17.803291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.16","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.248370+0000","last_change":"2024-03-16T07:32:18.246236+0000","last_active":"2024-03-16T07:32:18.248370+0000","last_peered":"2024-03-16T07:32:18.248370+0000","last_clean":"2024-03-16T07:32:18.248370+0000","last_became_active":"2024-03-16T07:32:18.244713+0000","last_became_peered":"2024-03-16T07:32:18.244713+0000","last_unstale":"2024-03-16T07:32:18.248370+0000","last_undegraded":"2024-03-16T07:32:18.248370+0000","last_fullsized":"2024-03-16T07:32:18.248370+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:50:35.825792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.219830+0000","last_change":"2024-03-16T07:32:17.232177+0000","last_active":"2024-03-16T07:32:18.219830+0000","last_peered":"2024-03-16T07:32:18.219830+0000","last_clean":"2024-03-16T07:32:18.219830+0000","last_became_active":"2024-03-16T07:32:17.231920+0000","last_became_peered":"2024-03-16T07:32:17.231920+0000","last_unstale":"2024-03-16T07:32:18.219830+0000","last_undegraded":"2024-03-16T07:32:18.219830+0000","last_fullsized":"2024-03-16T07:32:18.219830+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_clean_scrub_stamp":"2024-03-16T07:32:16.202808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:25:02.223110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.17","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.234737+0000","last_change":"2024-03-16T07:32:18.233309+0000","last_active":"2024-03-16T07:32:18.234737+0000","last_peered":"2024-03-16T07:32:18.234737+0000","last_clean":"2024-03-16T07:32:18.234737+0000","last_became_active":"2024-03-16T07:32:18.233047+0000","last_became_peered":"2024-03-16T07:32:18.233047+0000","last_unstale":"2024-03-16T07:32:18.234737+0000","last_undegraded":"2024-03-16T07:32:18.234737+0000","last_fullsized":"2024-03-16T07:32:18.234737+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:18:45.894739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.219125+0000","last_change":"2024-03-16T07:32:17.219997+0000","last_active":"2024-03-16T07:32:18.219125+0000","last_peered":"2024-03-16T07:32:18.219125+0000","last_clean":"2024-03-16T07:32:18.219125+0000","last_became_active":"2024-03-16T07:32:17.219744+0000","last_became_peered":"2024-03-16T07:32:17.219744+0000","last_unstale":"2024-03-16T07:32:18.219125+0000","last_undegraded":"2024-03-16T07:32:18.219125+0000","last_fullsized":"2024-03-16T07:32:18.219125+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_clean_scrub_stamp":"2024-03-16T07:32:16.202808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:31:19.141978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.14","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.227688+0000","last_change":"2024-03-16T07:32:18.224530+0000","last_active":"2024-03-16T07:32:18.227688+0000","last_peered":"2024-03-16T07:32:18.227688+0000","last_clean":"2024-03-16T07:32:18.227688+0000","last_became_active":"2024-03-16T07:32:18.223901+0000","last_became_peered":"2024-03-16T07:32:18.223901+0000","last_unstale":"2024-03-16T07:32:18.227688+0000","last_undegraded":"2024-03-16T07:32:18.227688+0000","last_fullsized":"2024-03-16T07:32:18.227688+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:35:32.540693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.15","version":"141'3","reported_seq":15,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.250869+0000","last_change":"2024-03-16T07:32:17.220743+0000","last_active":"2024-03-16T07:32:18.250869+0000","last_peered":"2024-03-16T07:32:18.250869+0000","last_clean":"2024-03-16T07:32:18.250869+0000","last_became_active":"2024-03-16T07:32:17.220474+0000","last_became_peered":"2024-03-16T07:32:17.220474+0000","last_unstale":"2024-03-16T07:32:18.250869+0000","last_undegraded":"2024-03-16T07:32:18.250869+0000","last_fullsized":"2024-03-16T07:32:18.250869+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_clean_scrub_stamp":"2024-03-16T07:32:16.202808+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:08:19.721367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.15","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.220312+0000","last_change":"2024-03-16T07:32:18.218886+0000","last_active":"2024-03-16T07:32:18.220312+0000","last_peered":"2024-03-16T07:32:18.220312+0000","last_clean":"2024-03-16T07:32:18.220312+0000","last_became_active":"2024-03-16T07:32:18.218602+0000","last_became_peered":"2024-03-16T07:32:18.218602+0000","last_unstale":"2024-03-16T07:32:18.220312+0000","last_undegraded":"2024-03-16T07:32:18.220312+0000","last_fullsized":"2024-03-16T07:32:18.220312+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:09:39.486105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.14","version":"141'6","reported_seq":18,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.252893+0000","last_change":"2024-03-16T07:32:17.228965+0000","last_active":"2024-03-16T07:32:18.252893+0000","last_peered":"2024-03-16T07:32:18.252893+0000","last_clean":"2024-03-16T07:32:18.252893+0000","last_became_active":"2024-03-16T07:32:17.228699+0000","last_became_peered":"2024-03-16T07:32:17.228699+0000","last_unstale":"2024-03-16T07:32:18.252893+0000","last_undegraded":"2024-03-16T07:32:18.252893+0000","last_fullsized":"2024-03-16T07:32:18.252893+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_clean_scrub_stamp":"2024-03-16T07:32:16.202808+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:21:38.597189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.12","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.249777+0000","last_change":"2024-03-16T07:32:18.247568+0000","last_active":"2024-03-16T07:32:18.249777+0000","last_peered":"2024-03-16T07:32:18.249777+0000","last_clean":"2024-03-16T07:32:18.249777+0000","last_became_active":"2024-03-16T07:32:18.246899+0000","last_became_peered":"2024-03-16T07:32:18.246899+0000","last_unstale":"2024-03-16T07:32:18.249777+0000","last_undegraded":"2024-03-16T07:32:18.249777+0000","last_fullsized":"2024-03-16T07:32:18.249777+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:17:17.145202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.13","version":"141'2","reported_seq":14,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.243678+0000","last_change":"2024-03-16T07:32:17.232223+0000","last_active":"2024-03-16T07:32:18.243678+0000","last_peered":"2024-03-16T07:32:18.243678+0000","last_clean":"2024-03-16T07:32:18.243678+0000","last_became_active":"2024-03-16T07:32:17.231976+0000","last_became_peered":"2024-03-16T07:32:17.231976+0000","last_unstale":"2024-03-16T07:32:18.243678+0000","last_undegraded":"2024-03-16T07:32:18.243678+0000","last_fullsized":"2024-03-16T07:32:18.243678+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_clean_scrub_stamp":"2024-03-16T07:32:16.202808+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:45:50.377077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.13","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.242903+0000","last_change":"2024-03-16T07:32:18.239778+0000","last_active":"2024-03-16T07:32:18.242903+0000","last_peered":"2024-03-16T07:32:18.242903+0000","last_clean":"2024-03-16T07:32:18.242903+0000","last_became_active":"2024-03-16T07:32:18.239495+0000","last_became_peered":"2024-03-16T07:32:18.239495+0000","last_unstale":"2024-03-16T07:32:18.242903+0000","last_undegraded":"2024-03-16T07:32:18.242903+0000","last_fullsized":"2024-03-16T07:32:18.242903+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:45:07.587766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.212352+0000","last_change":"2024-03-16T07:32:17.229415+0000","last_active":"2024-03-16T07:32:18.212352+0000","last_peered":"2024-03-16T07:32:18.212352+0000","last_clean":"2024-03-16T07:32:18.212352+0000","last_became_active":"2024-03-16T07:32:17.228693+0000","last_became_peered":"2024-03-16T07:32:17.228693+0000","last_unstale":"2024-03-16T07:32:18.212352+0000","last_undegraded":"2024-03-16T07:32:18.212352+0000","last_fullsized":"2024-03-16T07:32:18.212352+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_clean_scrub_stamp":"2024-03-16T07:32:16.202808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:43:02.024584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.10","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.242432+0000","last_change":"2024-03-16T07:32:18.234163+0000","last_active":"2024-03-16T07:32:18.242432+0000","last_peered":"2024-03-16T07:32:18.242432+0000","last_clean":"2024-03-16T07:32:18.242432+0000","last_became_active":"2024-03-16T07:32:18.233416+0000","last_became_peered":"2024-03-16T07:32:18.233416+0000","last_unstale":"2024-03-16T07:32:18.242432+0000","last_undegraded":"2024-03-16T07:32:18.242432+0000","last_fullsized":"2024-03-16T07:32:18.242432+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:59:37.088071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.213184+0000","last_change":"2024-03-16T07:32:17.231133+0000","last_active":"2024-03-16T07:32:18.213184+0000","last_peered":"2024-03-16T07:32:18.213184+0000","last_clean":"2024-03-16T07:32:18.213184+0000","last_became_active":"2024-03-16T07:32:17.230312+0000","last_became_peered":"2024-03-16T07:32:17.230312+0000","last_unstale":"2024-03-16T07:32:18.213184+0000","last_undegraded":"2024-03-16T07:32:18.213184+0000","last_fullsized":"2024-03-16T07:32:18.213184+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_clean_scrub_stamp":"2024-03-16T07:32:16.202808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:55:33.743467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.11","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.242219+0000","last_change":"2024-03-16T07:32:18.232664+0000","last_active":"2024-03-16T07:32:18.242219+0000","last_peered":"2024-03-16T07:32:18.242219+0000","last_clean":"2024-03-16T07:32:18.242219+0000","last_became_active":"2024-03-16T07:32:18.232084+0000","last_became_peered":"2024-03-16T07:32:18.232084+0000","last_unstale":"2024-03-16T07:32:18.242219+0000","last_undegraded":"2024-03-16T07:32:18.242219+0000","last_fullsized":"2024-03-16T07:32:18.242219+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:15:32.560189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.10","version":"141'8","reported_seq":20,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.252240+0000","last_change":"2024-03-16T07:32:17.225860+0000","last_active":"2024-03-16T07:32:18.252240+0000","last_peered":"2024-03-16T07:32:18.252240+0000","last_clean":"2024-03-16T07:32:18.252240+0000","last_became_active":"2024-03-16T07:32:17.225589+0000","last_became_peered":"2024-03-16T07:32:17.225589+0000","last_unstale":"2024-03-16T07:32:18.252240+0000","last_undegraded":"2024-03-16T07:32:18.252240+0000","last_fullsized":"2024-03-16T07:32:18.252240+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_clean_scrub_stamp":"2024-03-16T07:32:16.202808+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:41:14.963665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.e","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.227753+0000","last_change":"2024-03-16T07:32:18.226029+0000","last_active":"2024-03-16T07:32:18.227753+0000","last_peered":"2024-03-16T07:32:18.227753+0000","last_clean":"2024-03-16T07:32:18.227753+0000","last_became_active":"2024-03-16T07:32:18.225788+0000","last_became_peered":"2024-03-16T07:32:18.225788+0000","last_unstale":"2024-03-16T07:32:18.227753+0000","last_undegraded":"2024-03-16T07:32:18.227753+0000","last_fullsized":"2024-03-16T07:32:18.227753+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:32:58.620237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.f","version":"141'1","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.250894+0000","last_change":"2024-03-16T07:32:17.223445+0000","last_active":"2024-03-16T07:32:18.250894+0000","last_peered":"2024-03-16T07:32:18.250894+0000","last_clean":"2024-03-16T07:32:18.250894+0000","last_became_active":"2024-03-16T07:32:17.222651+0000","last_became_peered":"2024-03-16T07:32:17.222651+0000","last_unstale":"2024-03-16T07:32:18.250894+0000","last_undegraded":"2024-03-16T07:32:18.250894+0000","last_fullsized":"2024-03-16T07:32:18.250894+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_clean_scrub_stamp":"2024-03-16T07:32:16.202808+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:12:48.104487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.f","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.243238+0000","last_change":"2024-03-16T07:32:18.242423+0000","last_active":"2024-03-16T07:32:18.243238+0000","last_peered":"2024-03-16T07:32:18.243238+0000","last_clean":"2024-03-16T07:32:18.243238+0000","last_became_active":"2024-03-16T07:32:18.241803+0000","last_became_peered":"2024-03-16T07:32:18.241803+0000","last_unstale":"2024-03-16T07:32:18.243238+0000","last_undegraded":"2024-03-16T07:32:18.243238+0000","last_fullsized":"2024-03-16T07:32:18.243238+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:56:19.184801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.e","version":"141'2","reported_seq":14,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.243799+0000","last_change":"2024-03-16T07:32:17.231123+0000","last_active":"2024-03-16T07:32:18.243799+0000","last_peered":"2024-03-16T07:32:18.243799+0000","last_clean":"2024-03-16T07:32:18.243799+0000","last_became_active":"2024-03-16T07:32:17.230808+0000","last_became_peered":"2024-03-16T07:32:17.230808+0000","last_unstale":"2024-03-16T07:32:18.243799+0000","last_undegraded":"2024-03-16T07:32:18.243799+0000","last_fullsized":"2024-03-16T07:32:18.243799+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_clean_scrub_stamp":"2024-03-16T07:32:16.202808+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:59:19.582457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.c","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.250075+0000","last_change":"2024-03-16T07:32:18.248350+0000","last_active":"2024-03-16T07:32:18.250075+0000","last_peered":"2024-03-16T07:32:18.250075+0000","last_clean":"2024-03-16T07:32:18.250075+0000","last_became_active":"2024-03-16T07:32:18.247340+0000","last_became_peered":"2024-03-16T07:32:18.247340+0000","last_unstale":"2024-03-16T07:32:18.250075+0000","last_undegraded":"2024-03-16T07:32:18.250075+0000","last_fullsized":"2024-03-16T07:32:18.250075+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:08:20.722583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.d","version":"141'1","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.247246+0000","last_change":"2024-03-16T07:32:17.229616+0000","last_active":"2024-03-16T07:32:18.247246+0000","last_peered":"2024-03-16T07:32:18.247246+0000","last_clean":"2024-03-16T07:32:18.247246+0000","last_became_active":"2024-03-16T07:32:17.229279+0000","last_became_peered":"2024-03-16T07:32:17.229279+0000","last_unstale":"2024-03-16T07:32:18.247246+0000","last_undegraded":"2024-03-16T07:32:18.247246+0000","last_fullsized":"2024-03-16T07:32:18.247246+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_clean_scrub_stamp":"2024-03-16T07:32:16.202808+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:14:11.030073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.d","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.220291+0000","last_change":"2024-03-16T07:32:18.217887+0000","last_active":"2024-03-16T07:32:18.220291+0000","last_peered":"2024-03-16T07:32:18.220291+0000","last_clean":"2024-03-16T07:32:18.220291+0000","last_became_active":"2024-03-16T07:32:18.217641+0000","last_became_peered":"2024-03-16T07:32:18.217641+0000","last_unstale":"2024-03-16T07:32:18.220291+0000","last_undegraded":"2024-03-16T07:32:18.220291+0000","last_fullsized":"2024-03-16T07:32:18.220291+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:51:00.714093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.213842+0000","last_change":"2024-03-16T07:32:17.234400+0000","last_active":"2024-03-16T07:32:18.213842+0000","last_peered":"2024-03-16T07:32:18.213842+0000","last_clean":"2024-03-16T07:32:18.213842+0000","last_became_active":"2024-03-16T07:32:17.234140+0000","last_became_peered":"2024-03-16T07:32:17.234140+0000","last_unstale":"2024-03-16T07:32:18.213842+0000","last_undegraded":"2024-03-16T07:32:18.213842+0000","last_fullsized":"2024-03-16T07:32:18.213842+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_clean_scrub_stamp":"2024-03-16T07:32:16.202808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:30:19.976759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.a","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.226640+0000","last_change":"2024-03-16T07:32:18.224341+0000","last_active":"2024-03-16T07:32:18.226640+0000","last_peered":"2024-03-16T07:32:18.226640+0000","last_clean":"2024-03-16T07:32:18.226640+0000","last_became_active":"2024-03-16T07:32:18.223713+0000","last_became_peered":"2024-03-16T07:32:18.223713+0000","last_unstale":"2024-03-16T07:32:18.226640+0000","last_undegraded":"2024-03-16T07:32:18.226640+0000","last_fullsized":"2024-03-16T07:32:18.226640+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:36:27.670654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.b","version":"141'2","reported_seq":14,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.244082+0000","last_change":"2024-03-16T07:32:17.232593+0000","last_active":"2024-03-16T07:32:18.244082+0000","last_peered":"2024-03-16T07:32:18.244082+0000","last_clean":"2024-03-16T07:32:18.244082+0000","last_became_active":"2024-03-16T07:32:17.232337+0000","last_became_peered":"2024-03-16T07:32:17.232337+0000","last_unstale":"2024-03-16T07:32:18.244082+0000","last_undegraded":"2024-03-16T07:32:18.244082+0000","last_fullsized":"2024-03-16T07:32:18.244082+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_clean_scrub_stamp":"2024-03-16T07:32:16.202808+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:29:00.632805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.b","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.242920+0000","last_change":"2024-03-16T07:32:18.240156+0000","last_active":"2024-03-16T07:32:18.242920+0000","last_peered":"2024-03-16T07:32:18.242920+0000","last_clean":"2024-03-16T07:32:18.242920+0000","last_became_active":"2024-03-16T07:32:18.239925+0000","last_became_peered":"2024-03-16T07:32:18.239925+0000","last_unstale":"2024-03-16T07:32:18.242920+0000","last_undegraded":"2024-03-16T07:32:18.242920+0000","last_fullsized":"2024-03-16T07:32:18.242920+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:42:00.570394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.220898+0000","last_change":"2024-03-16T07:32:17.227713+0000","last_active":"2024-03-16T07:32:18.220898+0000","last_peered":"2024-03-16T07:32:18.220898+0000","last_clean":"2024-03-16T07:32:18.220898+0000","last_became_active":"2024-03-16T07:32:17.227251+0000","last_became_peered":"2024-03-16T07:32:17.227251+0000","last_unstale":"2024-03-16T07:32:18.220898+0000","last_undegraded":"2024-03-16T07:32:18.220898+0000","last_fullsized":"2024-03-16T07:32:18.220898+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_clean_scrub_stamp":"2024-03-16T07:32:16.202808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:07:04.797749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.8","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.229111+0000","last_change":"2024-03-16T07:32:18.225698+0000","last_active":"2024-03-16T07:32:18.229111+0000","last_peered":"2024-03-16T07:32:18.229111+0000","last_clean":"2024-03-16T07:32:18.229111+0000","last_became_active":"2024-03-16T07:32:18.223573+0000","last_became_peered":"2024-03-16T07:32:18.223573+0000","last_unstale":"2024-03-16T07:32:18.229111+0000","last_undegraded":"2024-03-16T07:32:18.229111+0000","last_fullsized":"2024-03-16T07:32:18.229111+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:27:48.582877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.219723+0000","last_change":"2024-03-16T07:32:17.233204+0000","last_active":"2024-03-16T07:32:18.219723+0000","last_peered":"2024-03-16T07:32:18.219723+0000","last_clean":"2024-03-16T07:32:18.219723+0000","last_became_active":"2024-03-16T07:32:17.232939+0000","last_became_peered":"2024-03-16T07:32:17.232939+0000","last_unstale":"2024-03-16T07:32:18.219723+0000","last_undegraded":"2024-03-16T07:32:18.219723+0000","last_fullsized":"2024-03-16T07:32:18.219723+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_clean_scrub_stamp":"2024-03-16T07:32:16.202808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:22:20.381122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.9","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.240871+0000","last_change":"2024-03-16T07:32:18.238541+0000","last_active":"2024-03-16T07:32:18.240871+0000","last_peered":"2024-03-16T07:32:18.240871+0000","last_clean":"2024-03-16T07:32:18.240871+0000","last_became_active":"2024-03-16T07:32:18.238016+0000","last_became_peered":"2024-03-16T07:32:18.238016+0000","last_unstale":"2024-03-16T07:32:18.240871+0000","last_undegraded":"2024-03-16T07:32:18.240871+0000","last_fullsized":"2024-03-16T07:32:18.240871+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:34:12.823633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.215352+0000","last_change":"2024-03-16T07:32:17.227872+0000","last_active":"2024-03-16T07:32:18.215352+0000","last_peered":"2024-03-16T07:32:18.215352+0000","last_clean":"2024-03-16T07:32:18.215352+0000","last_became_active":"2024-03-16T07:32:17.227600+0000","last_became_peered":"2024-03-16T07:32:17.227600+0000","last_unstale":"2024-03-16T07:32:18.215352+0000","last_undegraded":"2024-03-16T07:32:18.215352+0000","last_fullsized":"2024-03-16T07:32:18.215352+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_clean_scrub_stamp":"2024-03-16T07:32:16.202808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:56:01.743830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.6","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.238998+0000","last_change":"2024-03-16T07:32:18.233930+0000","last_active":"2024-03-16T07:32:18.238998+0000","last_peered":"2024-03-16T07:32:18.238998+0000","last_clean":"2024-03-16T07:32:18.238998+0000","last_became_active":"2024-03-16T07:32:18.233008+0000","last_became_peered":"2024-03-16T07:32:18.233008+0000","last_unstale":"2024-03-16T07:32:18.238998+0000","last_undegraded":"2024-03-16T07:32:18.238998+0000","last_fullsized":"2024-03-16T07:32:18.238998+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:46:56.524556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.7","version":"141'2","reported_seq":14,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.246335+0000","last_change":"2024-03-16T07:32:17.228514+0000","last_active":"2024-03-16T07:32:18.246335+0000","last_peered":"2024-03-16T07:32:18.246335+0000","last_clean":"2024-03-16T07:32:18.246335+0000","last_became_active":"2024-03-16T07:32:17.228200+0000","last_became_peered":"2024-03-16T07:32:17.228200+0000","last_unstale":"2024-03-16T07:32:18.246335+0000","last_undegraded":"2024-03-16T07:32:18.246335+0000","last_fullsized":"2024-03-16T07:32:18.246335+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_clean_scrub_stamp":"2024-03-16T07:32:16.202808+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:50:35.506990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.7","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.244524+0000","last_change":"2024-03-16T07:32:18.242678+0000","last_active":"2024-03-16T07:32:18.244524+0000","last_peered":"2024-03-16T07:32:18.244524+0000","last_clean":"2024-03-16T07:32:18.244524+0000","last_became_active":"2024-03-16T07:32:18.242069+0000","last_became_peered":"2024-03-16T07:32:18.242069+0000","last_unstale":"2024-03-16T07:32:18.244524+0000","last_undegraded":"2024-03-16T07:32:18.244524+0000","last_fullsized":"2024-03-16T07:32:18.244524+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:25:21.517836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.214134+0000","last_change":"2024-03-16T07:32:17.231485+0000","last_active":"2024-03-16T07:32:18.214134+0000","last_peered":"2024-03-16T07:32:18.214134+0000","last_clean":"2024-03-16T07:32:18.214134+0000","last_became_active":"2024-03-16T07:32:17.231153+0000","last_became_peered":"2024-03-16T07:32:17.231153+0000","last_unstale":"2024-03-16T07:32:18.214134+0000","last_undegraded":"2024-03-16T07:32:18.214134+0000","last_fullsized":"2024-03-16T07:32:18.214134+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_clean_scrub_stamp":"2024-03-16T07:32:16.202808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:55:27.684281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.4","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.250056+0000","last_change":"2024-03-16T07:32:18.248158+0000","last_active":"2024-03-16T07:32:18.250056+0000","last_peered":"2024-03-16T07:32:18.250056+0000","last_clean":"2024-03-16T07:32:18.250056+0000","last_became_active":"2024-03-16T07:32:18.246868+0000","last_became_peered":"2024-03-16T07:32:18.246868+0000","last_unstale":"2024-03-16T07:32:18.250056+0000","last_undegraded":"2024-03-16T07:32:18.250056+0000","last_fullsized":"2024-03-16T07:32:18.250056+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:56:02.745046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.213440+0000","last_change":"2024-03-16T07:32:17.231473+0000","last_active":"2024-03-16T07:32:18.213440+0000","last_peered":"2024-03-16T07:32:18.213440+0000","last_clean":"2024-03-16T07:32:18.213440+0000","last_became_active":"2024-03-16T07:32:17.231194+0000","last_became_peered":"2024-03-16T07:32:17.231194+0000","last_unstale":"2024-03-16T07:32:18.213440+0000","last_undegraded":"2024-03-16T07:32:18.213440+0000","last_fullsized":"2024-03-16T07:32:18.213440+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_clean_scrub_stamp":"2024-03-16T07:32:16.202808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:16:54.463382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.5","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.249948+0000","last_change":"2024-03-16T07:32:18.249281+0000","last_active":"2024-03-16T07:32:18.249948+0000","last_peered":"2024-03-16T07:32:18.249948+0000","last_clean":"2024-03-16T07:32:18.249948+0000","last_became_active":"2024-03-16T07:32:18.248490+0000","last_became_peered":"2024-03-16T07:32:18.248490+0000","last_unstale":"2024-03-16T07:32:18.249948+0000","last_undegraded":"2024-03-16T07:32:18.249948+0000","last_fullsized":"2024-03-16T07:32:18.249948+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:31:20.143195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.213987+0000","last_change":"2024-03-16T07:32:17.235245+0000","last_active":"2024-03-16T07:32:18.213987+0000","last_peered":"2024-03-16T07:32:18.213987+0000","last_clean":"2024-03-16T07:32:18.213987+0000","last_became_active":"2024-03-16T07:32:17.234881+0000","last_became_peered":"2024-03-16T07:32:17.234881+0000","last_unstale":"2024-03-16T07:32:18.213987+0000","last_undegraded":"2024-03-16T07:32:18.213987+0000","last_fullsized":"2024-03-16T07:32:18.213987+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_clean_scrub_stamp":"2024-03-16T07:32:16.202808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:22:04.317619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.2","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.249812+0000","last_change":"2024-03-16T07:32:18.247940+0000","last_active":"2024-03-16T07:32:18.249812+0000","last_peered":"2024-03-16T07:32:18.249812+0000","last_clean":"2024-03-16T07:32:18.249812+0000","last_became_active":"2024-03-16T07:32:18.247584+0000","last_became_peered":"2024-03-16T07:32:18.247584+0000","last_unstale":"2024-03-16T07:32:18.249812+0000","last_undegraded":"2024-03-16T07:32:18.249812+0000","last_fullsized":"2024-03-16T07:32:18.249812+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:39:18.804508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.225843+0000","last_change":"2024-03-16T07:32:17.226266+0000","last_active":"2024-03-16T07:32:18.225843+0000","last_peered":"2024-03-16T07:32:18.225843+0000","last_clean":"2024-03-16T07:32:18.225843+0000","last_became_active":"2024-03-16T07:32:17.226014+0000","last_became_peered":"2024-03-16T07:32:17.226014+0000","last_unstale":"2024-03-16T07:32:18.225843+0000","last_undegraded":"2024-03-16T07:32:18.225843+0000","last_fullsized":"2024-03-16T07:32:18.225843+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_clean_scrub_stamp":"2024-03-16T07:32:16.202808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:23:58.730547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.3","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.241257+0000","last_change":"2024-03-16T07:32:18.239059+0000","last_active":"2024-03-16T07:32:18.241257+0000","last_peered":"2024-03-16T07:32:18.241257+0000","last_clean":"2024-03-16T07:32:18.241257+0000","last_became_active":"2024-03-16T07:32:18.237797+0000","last_became_peered":"2024-03-16T07:32:18.237797+0000","last_unstale":"2024-03-16T07:32:18.241257+0000","last_undegraded":"2024-03-16T07:32:18.241257+0000","last_fullsized":"2024-03-16T07:32:18.241257+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:59:39.662853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.227536+0000","last_change":"2024-03-16T07:32:17.231212+0000","last_active":"2024-03-16T07:32:18.227536+0000","last_peered":"2024-03-16T07:32:18.227536+0000","last_clean":"2024-03-16T07:32:18.227536+0000","last_became_active":"2024-03-16T07:32:17.230958+0000","last_became_peered":"2024-03-16T07:32:17.230958+0000","last_unstale":"2024-03-16T07:32:18.227536+0000","last_undegraded":"2024-03-16T07:32:18.227536+0000","last_fullsized":"2024-03-16T07:32:18.227536+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_clean_scrub_stamp":"2024-03-16T07:32:16.202808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:03:51.994607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.0","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.245640+0000","last_change":"2024-03-16T07:32:18.244971+0000","last_active":"2024-03-16T07:32:18.245640+0000","last_peered":"2024-03-16T07:32:18.245640+0000","last_clean":"2024-03-16T07:32:18.245640+0000","last_became_active":"2024-03-16T07:32:18.244256+0000","last_became_peered":"2024-03-16T07:32:18.244256+0000","last_unstale":"2024-03-16T07:32:18.245640+0000","last_undegraded":"2024-03-16T07:32:18.245640+0000","last_fullsized":"2024-03-16T07:32:18.245640+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:17:45.128958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.219898+0000","last_change":"2024-03-16T07:32:17.233190+0000","last_active":"2024-03-16T07:32:18.219898+0000","last_peered":"2024-03-16T07:32:18.219898+0000","last_clean":"2024-03-16T07:32:18.219898+0000","last_became_active":"2024-03-16T07:32:17.232917+0000","last_became_peered":"2024-03-16T07:32:17.232917+0000","last_unstale":"2024-03-16T07:32:18.219898+0000","last_undegraded":"2024-03-16T07:32:18.219898+0000","last_fullsized":"2024-03-16T07:32:18.219898+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_clean_scrub_stamp":"2024-03-16T07:32:16.202808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:31:01.279190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.240850+0000","last_change":"2024-03-16T07:32:18.238398+0000","last_active":"2024-03-16T07:32:18.240850+0000","last_peered":"2024-03-16T07:32:18.240850+0000","last_clean":"2024-03-16T07:32:18.240850+0000","last_became_active":"2024-03-16T07:32:18.237807+0000","last_became_peered":"2024-03-16T07:32:18.237807+0000","last_unstale":"2024-03-16T07:32:18.240850+0000","last_undegraded":"2024-03-16T07:32:18.240850+0000","last_fullsized":"2024-03-16T07:32:18.240850+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:16:18.048818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.226682+0000","last_change":"2024-03-16T07:32:17.233414+0000","last_active":"2024-03-16T07:32:18.226682+0000","last_peered":"2024-03-16T07:32:18.226682+0000","last_clean":"2024-03-16T07:32:18.226682+0000","last_became_active":"2024-03-16T07:32:17.233153+0000","last_became_peered":"2024-03-16T07:32:17.233153+0000","last_unstale":"2024-03-16T07:32:18.226682+0000","last_undegraded":"2024-03-16T07:32:18.226682+0000","last_fullsized":"2024-03-16T07:32:18.226682+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_clean_scrub_stamp":"2024-03-16T07:32:16.202808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:06:54.148824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.18","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.222017+0000","last_change":"2024-03-16T07:32:18.218918+0000","last_active":"2024-03-16T07:32:18.222017+0000","last_peered":"2024-03-16T07:32:18.222017+0000","last_clean":"2024-03-16T07:32:18.222017+0000","last_became_active":"2024-03-16T07:32:18.218148+0000","last_became_peered":"2024-03-16T07:32:18.218148+0000","last_unstale":"2024-03-16T07:32:18.222017+0000","last_undegraded":"2024-03-16T07:32:18.222017+0000","last_fullsized":"2024-03-16T07:32:18.222017+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:19:39.332190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.211236+0000","last_change":"2024-03-16T07:32:17.230782+0000","last_active":"2024-03-16T07:32:18.211236+0000","last_peered":"2024-03-16T07:32:18.211236+0000","last_clean":"2024-03-16T07:32:18.211236+0000","last_became_active":"2024-03-16T07:32:17.229981+0000","last_became_peered":"2024-03-16T07:32:17.229981+0000","last_unstale":"2024-03-16T07:32:18.211236+0000","last_undegraded":"2024-03-16T07:32:18.211236+0000","last_fullsized":"2024-03-16T07:32:18.211236+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_clean_scrub_stamp":"2024-03-16T07:32:16.202808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:02:31.073119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"126'196","reported_seq":731,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-03-16T07:32:18.226505+0000","last_change":"2024-03-16T07:24:31.650537+0000","last_active":"2024-03-16T07:32:18.226505+0000","last_peered":"2024-03-16T07:32:18.226505+0000","last_clean":"2024-03-16T07:32:18.226505+0000","last_became_active":"2024-03-16T07:24:31.649574+0000","last_became_peered":"2024-03-16T07:24:31.649574+0000","last_unstale":"2024-03-16T07:32:18.226505+0000","last_undegraded":"2024-03-16T07:32:18.226505+0000","last_fullsized":"2024-03-16T07:32:18.226505+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:29.719970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:29.719970+0000","last_clean_scrub_stamp":"2024-03-16T07:24:29.719970+0000","objects_scrubbed":0,"log_size":196,"log_dups_size":0,"ondisk_log_size":196,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:31:35.774554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":970,"num_read_kb":1945,"num_write":317,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":25,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":24,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":970,"num_read_kb":1945,"num_write":317,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738459,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":36776,"kb_used_data":1428,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":104820824,"statfs":{"total":107374182400,"available":107336523776,"internally_reserved":0,"allocated":1462272,"data_stored":591767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738459,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":37328,"kb_used_data":1984,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":104820272,"statfs":{"total":107374182400,"available":107335958528,"internally_reserved":0,"allocated":2031616,"data_stored":1176906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738459,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":37372,"kb_used_data":2024,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":104820228,"statfs":{"total":107374182400,"available":107335913472,"internally_reserved":0,"allocated":2072576,"data_stored":1183781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-16T07:32:22.879 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-03-16T07:32:22.880 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-03-16T07:32:23.299 INFO:teuthology.orchestra.run.smithi049.stdout:[client.0] 2024-03-16T07:32:23.299 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQAaSfVlmBmvGRAAaxdhkajaioVlq23dyv/g4g== 2024-03-16T07:32:23.299 INFO:teuthology.orchestra.run.smithi049.stdout: caps mds = "allow" 2024-03-16T07:32:23.299 INFO:teuthology.orchestra.run.smithi049.stdout: caps mon = "allow r" 2024-03-16T07:32:23.299 INFO:teuthology.orchestra.run.smithi049.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-03-16T07:32:23.299 INFO:teuthology.orchestra.run.smithi049.stderr:updated caps for client.0 2024-03-16T07:32:23.312 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T07:32:23.651 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:32:23.651 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":99,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6315,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6828/2438276517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":2438276517},{"type":"v1","addr":"172.21.15.49:6828","nonce":2438276517}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":94},{"gid":6316,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6829/1412184122","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6827","nonce":1412184122},{"type":"v1","addr":"172.21.15.49:6829","nonce":1412184122}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":94},{"gid":6321,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6831/3610285344","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":3610285344},{"type":"v1","addr":"172.21.15.49:6831","nonce":3610285344}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":94},{"gid":6324,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6833/1457417734","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":1457417734},{"type":"v1","addr":"172.21.15.49:6833","nonce":1457417734}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":94}],"filesystems":[{"mdsmap":{"epoch":99,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-16T07:32:17.592092+0000","modified":"2024-03-16T07:32:20.584913+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6325},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6325":{"gid":6325,"name":"a","rank":0,"incarnation":95,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6835/2709512109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":2709512109},{"type":"v1","addr":"172.21.15.49:6835","nonce":2709512109}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6325,"qdb_cluster":[6325]},"id":12}]} 2024-03-16T07:32:23.651 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 99 2024-03-16T07:32:23.869 INFO:tasks.ceph.mds.a.smithi049.stderr:2024-03-16T07:32:23.870+0000 7fc8351f2640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-03-16T07:32:24.166 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 99, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-03-16T07:32:17.592092+0000', 'modified': '2024-03-16T07:32:20.584913+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6325}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6325': {'gid': 6325, 'name': 'a', 'rank': 0, 'incarnation': 95, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.49:6835/2709512109', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.49:6834', 'nonce': 2709512109}, {'type': 'v1', 'addr': '172.21.15.49:6835', 'nonce': 2709512109}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [25], 'metadata_pool': 24, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 6325, 'qdb_cluster': [6325]} 2024-03-16T07:32:24.166 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-03-16T07:32:24.166 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-03-16T07:32:24.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-16T07:32:24.289+0000 7fc6777fe640 0 client.6384 ms_handle_reset on v2:172.21.15.49:6834/2709512109 2024-03-16T07:32:24.312 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-16T07:32:24.313+0000 7fc6777fe640 0 client.6386 ms_handle_reset on v2:172.21.15.49:6834/2709512109 2024-03-16T07:32:24.312 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-03-16T07:32:24.312 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_fsid": "f91af061-9eac-4793-87fa-8d27ae3d242f", 2024-03-16T07:32:24.312 INFO:teuthology.orchestra.run.smithi049.stdout: "whoami": 0, 2024-03-16T07:32:24.313 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 6325, 2024-03-16T07:32:24.313 INFO:teuthology.orchestra.run.smithi049.stdout: "want_state": "up:active", 2024-03-16T07:32:24.313 INFO:teuthology.orchestra.run.smithi049.stdout: "state": "up:active", 2024-03-16T07:32:24.313 INFO:teuthology.orchestra.run.smithi049.stdout: "fs_name": "cephfs", 2024-03-16T07:32:24.313 INFO:teuthology.orchestra.run.smithi049.stdout: "rank_uptime": 6.1054721220000001, 2024-03-16T07:32:24.313 INFO:teuthology.orchestra.run.smithi049.stdout: "mdsmap_epoch": 99, 2024-03-16T07:32:24.313 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch": 142, 2024-03-16T07:32:24.313 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch_barrier": 142, 2024-03-16T07:32:24.313 INFO:teuthology.orchestra.run.smithi049.stdout: "uptime": 11.382508657000001 2024-03-16T07:32:24.313 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-03-16T07:32:24.323 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-03-16T07:32:24.727 INFO:teuthology.orchestra.run.smithi049.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-03-16T07:32:24.740 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-03-16T07:32:24.740 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-03-16T07:32:24.740 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi049.front.sepia.ceph.com 2024-03-16T07:32:24.740 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-03-16T07:32:24.740 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-03-16T07:32:24.740 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-03-16T07:32:24.740 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-03-16T07:32:24.740 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-03-16T07:32:24.741 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-03-16T07:32:24.741 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:32:24.741 DEBUG:teuthology.orchestra.run.smithi049:> ip addr 2024-03-16T07:32:24.756 INFO:teuthology.orchestra.run.smithi049.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-16T07:32:24.756 INFO:teuthology.orchestra.run.smithi049.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-16T07:32:24.756 INFO:teuthology.orchestra.run.smithi049.stdout: inet 127.0.0.1/8 scope host lo 2024-03-16T07:32:24.756 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-03-16T07:32:24.756 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 ::1/128 scope host 2024-03-16T07:32:24.757 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-03-16T07:32:24.757 INFO:teuthology.orchestra.run.smithi049.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-16T07:32:24.757 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:6b:ff:84 brd ff:ff:ff:ff:ff:ff 2024-03-16T07:32:24.757 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp7s0f0 2024-03-16T07:32:24.757 INFO:teuthology.orchestra.run.smithi049.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-16T07:32:24.757 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:6b:ff:85 brd ff:ff:ff:ff:ff:ff 2024-03-16T07:32:24.757 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp7s0f1 2024-03-16T07:32:24.757 INFO:teuthology.orchestra.run.smithi049.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-03-16T07:32:24.757 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:bd:15:66 brd ff:ff:ff:ff:ff:ff 2024-03-16T07:32:24.757 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp1s0f0 2024-03-16T07:32:24.757 INFO:teuthology.orchestra.run.smithi049.stdout: inet 172.21.15.49/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-03-16T07:32:24.757 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft 41963sec preferred_lft 41963sec 2024-03-16T07:32:24.757 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::ec4:7aff:febd:1566/64 scope link noprefixroute 2024-03-16T07:32:24.757 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-03-16T07:32:24.757 INFO:teuthology.orchestra.run.smithi049.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-16T07:32:24.758 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:bd:15:67 brd ff:ff:ff:ff:ff:ff 2024-03-16T07:32:24.758 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp1s0f1 2024-03-16T07:32:24.758 INFO:teuthology.orchestra.run.smithi049.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-03-16T07:32:24.758 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether a2:f1:88:c1:22:e7 brd ff:ff:ff:ff:ff:ff 2024-03-16T07:32:24.758 INFO:teuthology.orchestra.run.smithi049.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-03-16T07:32:24.758 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-03-16T07:32:24.758 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::e0e6:55ff:fe4d:1d68/64 scope link 2024-03-16T07:32:24.758 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-03-16T07:32:24.758 INFO:teuthology.orchestra.run.smithi049.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-03-16T07:32:24.758 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether ee:10:71:d7:68:c4 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-16T07:32:24.758 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::ec10:71ff:fed7:68c4/64 scope link 2024-03-16T07:32:24.758 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-03-16T07:32:24.758 INFO:teuthology.orchestra.run.smithi049.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-03-16T07:32:24.759 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether a2:f1:88:c1:22:e7 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-16T07:32:24.759 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::a0f1:88ff:fec1:22e7/64 scope link 2024-03-16T07:32:24.759 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-03-16T07:32:24.759 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:32:24.759 DEBUG:teuthology.orchestra.run.smithi049:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-03-16T07:32:24.826 INFO:teuthology.orchestra.run.smithi049.stdout:1 2024-03-16T07:32:24.828 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:32:24.828 DEBUG:teuthology.orchestra.run.smithi049:> route 2024-03-16T07:32:24.884 INFO:teuthology.orchestra.run.smithi049.stdout:Kernel IP routing table 2024-03-16T07:32:24.884 INFO:teuthology.orchestra.run.smithi049.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-03-16T07:32:24.884 INFO:teuthology.orchestra.run.smithi049.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-03-16T07:32:24.884 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-03-16T07:32:24.884 INFO:teuthology.orchestra.run.smithi049.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-03-16T07:32:24.885 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-16T07:32:24.885 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-03-16T07:32:24.885 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-03-16T07:32:24.885 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-03-16T07:32:24.885 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-03-16T07:32:24.885 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-03-16T07:32:24.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-16T07:32:24 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-16T07:32:25.026 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-16T07:32:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-16T07:32:25.032 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:32:25.033 DEBUG:teuthology.orchestra.run.smithi049:> ip netns list 2024-03-16T07:32:25.049 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 1) 2024-03-16T07:32:25.049 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-03-16T07:32:25.049 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-03-16T07:32:25.049 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:32:25.049 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link set brx.0 up 2024-03-16T07:32:25.119 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-03-16T07:32:25.119 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-16T07:32:25.120 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-03-16T07:32:25.176 INFO:teuthology.orchestra.run.smithi049.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-03-16T07:32:25.176 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-16T07:32:25.176 DEBUG:teuthology.orchestra.run.smithi049:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-03-16T07:32:25.233 DEBUG:teuthology.orchestra.run.smithi049:> sudo modprobe fuse 2024-03-16T07:32:25.304 DEBUG:teuthology.orchestra.run.smithi049:> cat /proc/self/mounts | awk '{print $2}' 2024-03-16T07:32:25.361 INFO:teuthology.orchestra.run.smithi049.stdout:/proc 2024-03-16T07:32:25.362 INFO:teuthology.orchestra.run.smithi049.stdout:/sys 2024-03-16T07:32:25.362 INFO:teuthology.orchestra.run.smithi049.stdout:/dev 2024-03-16T07:32:25.362 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/security 2024-03-16T07:32:25.362 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/shm 2024-03-16T07:32:25.362 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/pts 2024-03-16T07:32:25.362 INFO:teuthology.orchestra.run.smithi049.stdout:/run 2024-03-16T07:32:25.362 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/cgroup 2024-03-16T07:32:25.362 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/pstore 2024-03-16T07:32:25.362 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/bpf 2024-03-16T07:32:25.362 INFO:teuthology.orchestra.run.smithi049.stdout:/ 2024-03-16T07:32:25.363 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/selinux 2024-03-16T07:32:25.363 INFO:teuthology.orchestra.run.smithi049.stdout:/proc/sys/fs/binfmt_misc 2024-03-16T07:32:25.363 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/mqueue 2024-03-16T07:32:25.363 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/hugepages 2024-03-16T07:32:25.363 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/debug 2024-03-16T07:32:25.363 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/tracing 2024-03-16T07:32:25.363 INFO:teuthology.orchestra.run.smithi049.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-03-16T07:32:25.363 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/fuse/connections 2024-03-16T07:32:25.363 INFO:teuthology.orchestra.run.smithi049.stdout:/run/credentials/systemd-sysctl.service 2024-03-16T07:32:25.363 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/config 2024-03-16T07:32:25.363 INFO:teuthology.orchestra.run.smithi049.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-03-16T07:32:25.363 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/nfs/rpc_pipefs 2024-03-16T07:32:25.364 INFO:teuthology.orchestra.run.smithi049.stdout:/run/user/1000 2024-03-16T07:32:25.364 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph 2024-03-16T07:32:25.364 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-0 2024-03-16T07:32:25.364 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-1 2024-03-16T07:32:25.364 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-2 2024-03-16T07:32:25.364 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns 2024-03-16T07:32:25.364 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-16T07:32:25.364 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-16T07:32:25.364 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-16T07:32:25.364 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-16T07:32:25.365 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:32:25.365 DEBUG:teuthology.orchestra.run.smithi049:> ls /sys/fs/fuse/connections 2024-03-16T07:32:25.416 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-03-16T07:32:25.417 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-03-16T07:32:25.459 DEBUG:teuthology.orchestra.run.smithi049:> sudo modprobe fuse 2024-03-16T07:32:25.490 DEBUG:teuthology.orchestra.run.smithi049:> cat /proc/self/mounts | awk '{print $2}' 2024-03-16T07:32:25.547 INFO:teuthology.orchestra.run.smithi049.stdout:/proc 2024-03-16T07:32:25.547 INFO:teuthology.orchestra.run.smithi049.stdout:/sys 2024-03-16T07:32:25.547 INFO:teuthology.orchestra.run.smithi049.stdout:/dev 2024-03-16T07:32:25.547 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/security 2024-03-16T07:32:25.547 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/shm 2024-03-16T07:32:25.547 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/pts 2024-03-16T07:32:25.547 INFO:teuthology.orchestra.run.smithi049.stdout:/run 2024-03-16T07:32:25.548 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/cgroup 2024-03-16T07:32:25.548 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/pstore 2024-03-16T07:32:25.548 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/bpf 2024-03-16T07:32:25.548 INFO:teuthology.orchestra.run.smithi049.stdout:/ 2024-03-16T07:32:25.548 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/selinux 2024-03-16T07:32:25.548 INFO:teuthology.orchestra.run.smithi049.stdout:/proc/sys/fs/binfmt_misc 2024-03-16T07:32:25.548 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/mqueue 2024-03-16T07:32:25.548 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/hugepages 2024-03-16T07:32:25.548 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/debug 2024-03-16T07:32:25.548 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/tracing 2024-03-16T07:32:25.548 INFO:teuthology.orchestra.run.smithi049.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-03-16T07:32:25.548 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/fuse/connections 2024-03-16T07:32:25.548 INFO:teuthology.orchestra.run.smithi049.stdout:/run/credentials/systemd-sysctl.service 2024-03-16T07:32:25.548 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/config 2024-03-16T07:32:25.548 INFO:teuthology.orchestra.run.smithi049.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-03-16T07:32:25.548 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/nfs/rpc_pipefs 2024-03-16T07:32:25.549 INFO:teuthology.orchestra.run.smithi049.stdout:/run/user/1000 2024-03-16T07:32:25.549 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph 2024-03-16T07:32:25.549 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-0 2024-03-16T07:32:25.549 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-1 2024-03-16T07:32:25.549 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-2 2024-03-16T07:32:25.549 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns 2024-03-16T07:32:25.549 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-16T07:32:25.549 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-16T07:32:25.549 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-16T07:32:25.549 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-16T07:32:25.549 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:32:25.549 DEBUG:teuthology.orchestra.run.smithi049:> ls /sys/fs/fuse/connections 2024-03-16T07:32:25.554 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi049.stderr:2024-03-16T07:32:25.555+0000 7fccab63c480 -1 init, newargv = 0x55edacaccff0 newargc=15 2024-03-16T07:32:25.554 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi049.stderr:ceph-fuse[75960]: starting ceph client 2024-03-16T07:32:25.557 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi049.stderr:ceph-fuse[75960]: starting fuse 2024-03-16T07:32:25.570 INFO:teuthology.orchestra.run.smithi049.stdout:41 2024-03-16T07:32:25.570 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2024-03-16T07:32:25.571 DEBUG:teuthology.orchestra.run.smithi049:> sudo stdin-killer -- python3 -c ' 2024-03-16T07:32:25.571 DEBUG:teuthology.orchestra.run.smithi049:> import glob 2024-03-16T07:32:25.571 DEBUG:teuthology.orchestra.run.smithi049:> import re 2024-03-16T07:32:25.571 DEBUG:teuthology.orchestra.run.smithi049:> import os 2024-03-16T07:32:25.571 DEBUG:teuthology.orchestra.run.smithi049:> import subprocess 2024-03-16T07:32:25.571 DEBUG:teuthology.orchestra.run.smithi049:> 2024-03-16T07:32:25.571 DEBUG:teuthology.orchestra.run.smithi049:> def _find_admin_socket(client_name): 2024-03-16T07:32:25.571 DEBUG:teuthology.orchestra.run.smithi049:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-03-16T07:32:25.571 DEBUG:teuthology.orchestra.run.smithi049:> files = glob.glob(asok_path) 2024-03-16T07:32:25.571 DEBUG:teuthology.orchestra.run.smithi049:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-03-16T07:32:25.571 DEBUG:teuthology.orchestra.run.smithi049:> 2024-03-16T07:32:25.571 DEBUG:teuthology.orchestra.run.smithi049:> # Given a non-glob path, it better be there 2024-03-16T07:32:25.571 DEBUG:teuthology.orchestra.run.smithi049:> if "*" not in asok_path: 2024-03-16T07:32:25.571 DEBUG:teuthology.orchestra.run.smithi049:> assert(len(files) == 1) 2024-03-16T07:32:25.571 DEBUG:teuthology.orchestra.run.smithi049:> return files[0] 2024-03-16T07:32:25.572 DEBUG:teuthology.orchestra.run.smithi049:> 2024-03-16T07:32:25.572 DEBUG:teuthology.orchestra.run.smithi049:> for f in files: 2024-03-16T07:32:25.572 DEBUG:teuthology.orchestra.run.smithi049:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-03-16T07:32:25.572 DEBUG:teuthology.orchestra.run.smithi049:> if os.path.exists("/proc/{0}".format(pid)): 2024-03-16T07:32:25.572 DEBUG:teuthology.orchestra.run.smithi049:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-03-16T07:32:25.572 DEBUG:teuthology.orchestra.run.smithi049:> contents = proc_f.read() 2024-03-16T07:32:25.572 DEBUG:teuthology.orchestra.run.smithi049:> if mountpoint in contents: 2024-03-16T07:32:25.572 DEBUG:teuthology.orchestra.run.smithi049:> return f 2024-03-16T07:32:25.572 DEBUG:teuthology.orchestra.run.smithi049:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-03-16T07:32:25.572 DEBUG:teuthology.orchestra.run.smithi049:> 2024-03-16T07:32:25.572 DEBUG:teuthology.orchestra.run.smithi049:> print(_find_admin_socket("client.0")) 2024-03-16T07:32:25.572 DEBUG:teuthology.orchestra.run.smithi049:> ' 2024-03-16T07:32:25.695 INFO:teuthology.orchestra.run.smithi049.stdout:/var/run/ceph/ceph-client.0.75960.asok 2024-03-16T07:32:25.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-16T07:32:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-16T07:32:25.705 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.75960.asok 2024-03-16T07:32:25.706 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:32:25.706 DEBUG:teuthology.orchestra.run.smithi049:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.75960.asok status 2024-03-16T07:32:25.848 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-03-16T07:32:25.848 INFO:teuthology.orchestra.run.smithi049.stdout: "metadata": { 2024-03-16T07:32:25.848 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph_sha1": "3d78f5ba07bf18880172c07d4d7b4ac00c9d30af", 2024-03-16T07:32:25.848 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph_version": "ceph version 19.0.0-2162-g3d78f5ba (3d78f5ba07bf18880172c07d4d7b4ac00c9d30af) squid (dev)", 2024-03-16T07:32:25.848 INFO:teuthology.orchestra.run.smithi049.stdout: "entity_id": "0", 2024-03-16T07:32:25.849 INFO:teuthology.orchestra.run.smithi049.stdout: "hostname": "smithi049", 2024-03-16T07:32:25.849 INFO:teuthology.orchestra.run.smithi049.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-03-16T07:32:25.849 INFO:teuthology.orchestra.run.smithi049.stdout: "pid": "75960", 2024-03-16T07:32:25.849 INFO:teuthology.orchestra.run.smithi049.stdout: "root": "/" 2024-03-16T07:32:25.849 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:32:25.849 INFO:teuthology.orchestra.run.smithi049.stdout: "dentry_count": 0, 2024-03-16T07:32:25.849 INFO:teuthology.orchestra.run.smithi049.stdout: "dentry_pinned_count": 0, 2024-03-16T07:32:25.849 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 6392, 2024-03-16T07:32:25.849 INFO:teuthology.orchestra.run.smithi049.stdout: "inst": { 2024-03-16T07:32:25.849 INFO:teuthology.orchestra.run.smithi049.stdout: "name": { 2024-03-16T07:32:25.849 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "client", 2024-03-16T07:32:25.849 INFO:teuthology.orchestra.run.smithi049.stdout: "num": 6392 2024-03-16T07:32:25.849 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:32:25.849 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": { 2024-03-16T07:32:25.849 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2024-03-16T07:32:25.850 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "192.168.0.1:0", 2024-03-16T07:32:25.850 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 2705931191 2024-03-16T07:32:25.850 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:32:25.850 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:32:25.850 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": { 2024-03-16T07:32:25.850 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2024-03-16T07:32:25.850 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "192.168.0.1:0", 2024-03-16T07:32:25.850 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 2705931191 2024-03-16T07:32:25.850 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:32:25.850 INFO:teuthology.orchestra.run.smithi049.stdout: "inst_str": "client.6392 192.168.0.1:0/2705931191", 2024-03-16T07:32:25.850 INFO:teuthology.orchestra.run.smithi049.stdout: "addr_str": "192.168.0.1:0/2705931191", 2024-03-16T07:32:25.850 INFO:teuthology.orchestra.run.smithi049.stdout: "inode_count": 1, 2024-03-16T07:32:25.850 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_epoch": 99, 2024-03-16T07:32:25.850 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_epoch": 142, 2024-03-16T07:32:25.850 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_epoch_barrier": 0, 2024-03-16T07:32:25.851 INFO:teuthology.orchestra.run.smithi049.stdout: "blocklisted": false, 2024-03-16T07:32:25.851 INFO:teuthology.orchestra.run.smithi049.stdout: "fs_name": "cephfs" 2024-03-16T07:32:25.851 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-03-16T07:32:25.856 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:32:25.856 DEBUG:teuthology.orchestra.run.smithi049:> stat --file-system '--printf=%T 2024-03-16T07:32:25.856 DEBUG:teuthology.orchestra.run.smithi049:> ' -- /home/ubuntu/cephtest/mnt.0 2024-03-16T07:32:25.872 INFO:teuthology.orchestra.run.smithi049.stdout:fuseblk 2024-03-16T07:32:25.872 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-03-16T07:32:25.872 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:32:25.872 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-03-16T07:32:25.943 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-03-16T07:32:26.332 INFO:teuthology.orchestra.run.smithi049.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-03-16T07:32:26.345 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-03-16T07:32:26.345 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-03-16T07:32:26.345 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi049.front.sepia.ceph.com 2024-03-16T07:32:26.345 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-03-16T07:32:26.345 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-03-16T07:32:26.345 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-03-16T07:32:26.345 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-03-16T07:32:26.345 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-03-16T07:32:26.345 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-03-16T07:32:26.345 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:32:26.346 DEBUG:teuthology.orchestra.run.smithi049:> ip addr 2024-03-16T07:32:26.362 INFO:teuthology.orchestra.run.smithi049.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-16T07:32:26.362 INFO:teuthology.orchestra.run.smithi049.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-16T07:32:26.362 INFO:teuthology.orchestra.run.smithi049.stdout: inet 127.0.0.1/8 scope host lo 2024-03-16T07:32:26.362 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-03-16T07:32:26.363 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 ::1/128 scope host 2024-03-16T07:32:26.363 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-03-16T07:32:26.363 INFO:teuthology.orchestra.run.smithi049.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-16T07:32:26.363 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:6b:ff:84 brd ff:ff:ff:ff:ff:ff 2024-03-16T07:32:26.363 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp7s0f0 2024-03-16T07:32:26.363 INFO:teuthology.orchestra.run.smithi049.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-16T07:32:26.363 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:6b:ff:85 brd ff:ff:ff:ff:ff:ff 2024-03-16T07:32:26.363 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp7s0f1 2024-03-16T07:32:26.363 INFO:teuthology.orchestra.run.smithi049.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-03-16T07:32:26.363 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:bd:15:66 brd ff:ff:ff:ff:ff:ff 2024-03-16T07:32:26.363 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp1s0f0 2024-03-16T07:32:26.363 INFO:teuthology.orchestra.run.smithi049.stdout: inet 172.21.15.49/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-03-16T07:32:26.363 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft 41961sec preferred_lft 41961sec 2024-03-16T07:32:26.363 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::ec4:7aff:febd:1566/64 scope link noprefixroute 2024-03-16T07:32:26.363 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-03-16T07:32:26.364 INFO:teuthology.orchestra.run.smithi049.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-16T07:32:26.364 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:bd:15:67 brd ff:ff:ff:ff:ff:ff 2024-03-16T07:32:26.364 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp1s0f1 2024-03-16T07:32:26.364 INFO:teuthology.orchestra.run.smithi049.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-03-16T07:32:26.364 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether a2:f1:88:c1:22:e7 brd ff:ff:ff:ff:ff:ff 2024-03-16T07:32:26.364 INFO:teuthology.orchestra.run.smithi049.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-03-16T07:32:26.364 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-03-16T07:32:26.364 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::e0e6:55ff:fe4d:1d68/64 scope link 2024-03-16T07:32:26.364 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-03-16T07:32:26.364 INFO:teuthology.orchestra.run.smithi049.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-03-16T07:32:26.364 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether ee:10:71:d7:68:c4 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-16T07:32:26.364 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::ec10:71ff:fed7:68c4/64 scope link 2024-03-16T07:32:26.364 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-03-16T07:32:26.364 INFO:teuthology.orchestra.run.smithi049.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-03-16T07:32:26.365 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether a2:f1:88:c1:22:e7 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-16T07:32:26.365 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::a0f1:88ff:fec1:22e7/64 scope link 2024-03-16T07:32:26.365 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-03-16T07:32:26.365 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:32:26.365 DEBUG:teuthology.orchestra.run.smithi049:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-03-16T07:32:26.433 INFO:teuthology.orchestra.run.smithi049.stdout:1 2024-03-16T07:32:26.434 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:32:26.434 DEBUG:teuthology.orchestra.run.smithi049:> route 2024-03-16T07:32:26.490 INFO:teuthology.orchestra.run.smithi049.stdout:Kernel IP routing table 2024-03-16T07:32:26.491 INFO:teuthology.orchestra.run.smithi049.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-03-16T07:32:26.491 INFO:teuthology.orchestra.run.smithi049.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-03-16T07:32:26.491 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-03-16T07:32:26.491 INFO:teuthology.orchestra.run.smithi049.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-03-16T07:32:26.491 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-16T07:32:26.491 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-03-16T07:32:26.491 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-03-16T07:32:26.491 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-03-16T07:32:26.491 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-03-16T07:32:26.492 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-03-16T07:32:26.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-16T07:32:26 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-16T07:32:26.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-16T07:32:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-16T07:32:26.650 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:32:26.650 DEBUG:teuthology.orchestra.run.smithi049:> ip netns list 2024-03-16T07:32:26.665 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 1) 2024-03-16T07:32:26.665 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-03-16T07:32:26.665 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-03-16T07:32:26.665 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:32:26.665 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link set brx.1 up 2024-03-16T07:32:26.735 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-03-16T07:32:26.736 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-16T07:32:26.736 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-03-16T07:32:26.792 INFO:teuthology.orchestra.run.smithi049.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-03-16T07:32:26.792 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-16T07:32:26.792 DEBUG:teuthology.orchestra.run.smithi049:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-03-16T07:32:26.847 DEBUG:teuthology.orchestra.run.smithi049:> sudo modprobe fuse 2024-03-16T07:32:26.919 DEBUG:teuthology.orchestra.run.smithi049:> cat /proc/self/mounts | awk '{print $2}' 2024-03-16T07:32:26.975 INFO:teuthology.orchestra.run.smithi049.stdout:/proc 2024-03-16T07:32:26.975 INFO:teuthology.orchestra.run.smithi049.stdout:/sys 2024-03-16T07:32:26.975 INFO:teuthology.orchestra.run.smithi049.stdout:/dev 2024-03-16T07:32:26.975 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/security 2024-03-16T07:32:26.975 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/shm 2024-03-16T07:32:26.975 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/pts 2024-03-16T07:32:26.975 INFO:teuthology.orchestra.run.smithi049.stdout:/run 2024-03-16T07:32:26.975 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/cgroup 2024-03-16T07:32:26.975 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/pstore 2024-03-16T07:32:26.975 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/bpf 2024-03-16T07:32:26.975 INFO:teuthology.orchestra.run.smithi049.stdout:/ 2024-03-16T07:32:26.975 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/selinux 2024-03-16T07:32:26.975 INFO:teuthology.orchestra.run.smithi049.stdout:/proc/sys/fs/binfmt_misc 2024-03-16T07:32:26.976 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/mqueue 2024-03-16T07:32:26.976 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/hugepages 2024-03-16T07:32:26.976 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/debug 2024-03-16T07:32:26.976 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/tracing 2024-03-16T07:32:26.976 INFO:teuthology.orchestra.run.smithi049.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-03-16T07:32:26.976 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/fuse/connections 2024-03-16T07:32:26.976 INFO:teuthology.orchestra.run.smithi049.stdout:/run/credentials/systemd-sysctl.service 2024-03-16T07:32:26.976 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/config 2024-03-16T07:32:26.976 INFO:teuthology.orchestra.run.smithi049.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-03-16T07:32:26.976 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/nfs/rpc_pipefs 2024-03-16T07:32:26.976 INFO:teuthology.orchestra.run.smithi049.stdout:/run/user/1000 2024-03-16T07:32:26.976 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph 2024-03-16T07:32:26.976 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-0 2024-03-16T07:32:26.976 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-1 2024-03-16T07:32:26.976 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-2 2024-03-16T07:32:26.977 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns 2024-03-16T07:32:26.977 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-16T07:32:26.977 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-16T07:32:26.977 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-16T07:32:26.977 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-16T07:32:26.977 INFO:teuthology.orchestra.run.smithi049.stdout:/home/ubuntu/cephtest/mnt.0 2024-03-16T07:32:26.977 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:32:26.977 DEBUG:teuthology.orchestra.run.smithi049:> ls /sys/fs/fuse/connections 2024-03-16T07:32:27.030 INFO:teuthology.orchestra.run.smithi049.stdout:41 2024-03-16T07:32:27.030 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [41] 2024-03-16T07:32:27.030 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-03-16T07:32:27.072 DEBUG:teuthology.orchestra.run.smithi049:> sudo modprobe fuse 2024-03-16T07:32:27.103 DEBUG:teuthology.orchestra.run.smithi049:> cat /proc/self/mounts | awk '{print $2}' 2024-03-16T07:32:27.161 INFO:teuthology.orchestra.run.smithi049.stdout:/proc 2024-03-16T07:32:27.161 INFO:teuthology.orchestra.run.smithi049.stdout:/sys 2024-03-16T07:32:27.161 INFO:teuthology.orchestra.run.smithi049.stdout:/dev 2024-03-16T07:32:27.162 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/security 2024-03-16T07:32:27.162 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/shm 2024-03-16T07:32:27.162 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/pts 2024-03-16T07:32:27.162 INFO:teuthology.orchestra.run.smithi049.stdout:/run 2024-03-16T07:32:27.162 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/cgroup 2024-03-16T07:32:27.162 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/pstore 2024-03-16T07:32:27.162 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/bpf 2024-03-16T07:32:27.162 INFO:teuthology.orchestra.run.smithi049.stdout:/ 2024-03-16T07:32:27.163 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/selinux 2024-03-16T07:32:27.163 INFO:teuthology.orchestra.run.smithi049.stdout:/proc/sys/fs/binfmt_misc 2024-03-16T07:32:27.163 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/mqueue 2024-03-16T07:32:27.163 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/hugepages 2024-03-16T07:32:27.163 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/debug 2024-03-16T07:32:27.163 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/tracing 2024-03-16T07:32:27.163 INFO:teuthology.orchestra.run.smithi049.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-03-16T07:32:27.163 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/fuse/connections 2024-03-16T07:32:27.163 INFO:teuthology.orchestra.run.smithi049.stdout:/run/credentials/systemd-sysctl.service 2024-03-16T07:32:27.164 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/config 2024-03-16T07:32:27.164 INFO:teuthology.orchestra.run.smithi049.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-03-16T07:32:27.164 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/nfs/rpc_pipefs 2024-03-16T07:32:27.164 INFO:teuthology.orchestra.run.smithi049.stdout:/run/user/1000 2024-03-16T07:32:27.164 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph 2024-03-16T07:32:27.164 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-0 2024-03-16T07:32:27.164 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-1 2024-03-16T07:32:27.164 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-2 2024-03-16T07:32:27.164 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns 2024-03-16T07:32:27.165 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-16T07:32:27.165 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-16T07:32:27.165 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-16T07:32:27.165 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-16T07:32:27.165 INFO:teuthology.orchestra.run.smithi049.stdout:/home/ubuntu/cephtest/mnt.0 2024-03-16T07:32:27.165 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:32:27.165 DEBUG:teuthology.orchestra.run.smithi049:> ls /sys/fs/fuse/connections 2024-03-16T07:32:27.168 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi049.stderr:2024-03-16T07:32:27.169+0000 7f0f18c6d480 -1 init, newargv = 0x55ae7e73d070 newargc=15 2024-03-16T07:32:27.168 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi049.stderr:ceph-fuse[76378]: starting ceph client 2024-03-16T07:32:27.172 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi049.stderr:ceph-fuse[76378]: starting fuse 2024-03-16T07:32:27.184 INFO:teuthology.orchestra.run.smithi049.stdout:41 2024-03-16T07:32:27.184 INFO:teuthology.orchestra.run.smithi049.stdout:44 2024-03-16T07:32:27.185 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41, 44] 2024-03-16T07:32:27.185 DEBUG:teuthology.orchestra.run.smithi049:> sudo stdin-killer -- python3 -c ' 2024-03-16T07:32:27.185 DEBUG:teuthology.orchestra.run.smithi049:> import glob 2024-03-16T07:32:27.185 DEBUG:teuthology.orchestra.run.smithi049:> import re 2024-03-16T07:32:27.185 DEBUG:teuthology.orchestra.run.smithi049:> import os 2024-03-16T07:32:27.185 DEBUG:teuthology.orchestra.run.smithi049:> import subprocess 2024-03-16T07:32:27.185 DEBUG:teuthology.orchestra.run.smithi049:> 2024-03-16T07:32:27.185 DEBUG:teuthology.orchestra.run.smithi049:> def _find_admin_socket(client_name): 2024-03-16T07:32:27.185 DEBUG:teuthology.orchestra.run.smithi049:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-03-16T07:32:27.185 DEBUG:teuthology.orchestra.run.smithi049:> files = glob.glob(asok_path) 2024-03-16T07:32:27.185 DEBUG:teuthology.orchestra.run.smithi049:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-03-16T07:32:27.185 DEBUG:teuthology.orchestra.run.smithi049:> 2024-03-16T07:32:27.186 DEBUG:teuthology.orchestra.run.smithi049:> # Given a non-glob path, it better be there 2024-03-16T07:32:27.186 DEBUG:teuthology.orchestra.run.smithi049:> if "*" not in asok_path: 2024-03-16T07:32:27.186 DEBUG:teuthology.orchestra.run.smithi049:> assert(len(files) == 1) 2024-03-16T07:32:27.186 DEBUG:teuthology.orchestra.run.smithi049:> return files[0] 2024-03-16T07:32:27.186 DEBUG:teuthology.orchestra.run.smithi049:> 2024-03-16T07:32:27.186 DEBUG:teuthology.orchestra.run.smithi049:> for f in files: 2024-03-16T07:32:27.186 DEBUG:teuthology.orchestra.run.smithi049:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-03-16T07:32:27.186 DEBUG:teuthology.orchestra.run.smithi049:> if os.path.exists("/proc/{0}".format(pid)): 2024-03-16T07:32:27.186 DEBUG:teuthology.orchestra.run.smithi049:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-03-16T07:32:27.186 DEBUG:teuthology.orchestra.run.smithi049:> contents = proc_f.read() 2024-03-16T07:32:27.186 DEBUG:teuthology.orchestra.run.smithi049:> if mountpoint in contents: 2024-03-16T07:32:27.186 DEBUG:teuthology.orchestra.run.smithi049:> return f 2024-03-16T07:32:27.186 DEBUG:teuthology.orchestra.run.smithi049:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-03-16T07:32:27.186 DEBUG:teuthology.orchestra.run.smithi049:> 2024-03-16T07:32:27.186 DEBUG:teuthology.orchestra.run.smithi049:> print(_find_admin_socket("client.1")) 2024-03-16T07:32:27.186 DEBUG:teuthology.orchestra.run.smithi049:> ' 2024-03-16T07:32:27.314 INFO:teuthology.orchestra.run.smithi049.stdout:/var/run/ceph/ceph-client.1.76378.asok 2024-03-16T07:32:27.318 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-16T07:32:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-16T07:32:27.327 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.76378.asok 2024-03-16T07:32:27.328 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:32:27.328 DEBUG:teuthology.orchestra.run.smithi049:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.76378.asok status 2024-03-16T07:32:27.470 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-03-16T07:32:27.470 INFO:teuthology.orchestra.run.smithi049.stdout: "metadata": { 2024-03-16T07:32:27.470 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph_sha1": "3d78f5ba07bf18880172c07d4d7b4ac00c9d30af", 2024-03-16T07:32:27.471 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph_version": "ceph version 19.0.0-2162-g3d78f5ba (3d78f5ba07bf18880172c07d4d7b4ac00c9d30af) squid (dev)", 2024-03-16T07:32:27.471 INFO:teuthology.orchestra.run.smithi049.stdout: "entity_id": "1", 2024-03-16T07:32:27.471 INFO:teuthology.orchestra.run.smithi049.stdout: "hostname": "smithi049", 2024-03-16T07:32:27.471 INFO:teuthology.orchestra.run.smithi049.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-03-16T07:32:27.471 INFO:teuthology.orchestra.run.smithi049.stdout: "pid": "76378", 2024-03-16T07:32:27.471 INFO:teuthology.orchestra.run.smithi049.stdout: "root": "/" 2024-03-16T07:32:27.471 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:32:27.471 INFO:teuthology.orchestra.run.smithi049.stdout: "dentry_count": 0, 2024-03-16T07:32:27.471 INFO:teuthology.orchestra.run.smithi049.stdout: "dentry_pinned_count": 0, 2024-03-16T07:32:27.471 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 6398, 2024-03-16T07:32:27.471 INFO:teuthology.orchestra.run.smithi049.stdout: "inst": { 2024-03-16T07:32:27.471 INFO:teuthology.orchestra.run.smithi049.stdout: "name": { 2024-03-16T07:32:27.471 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "client", 2024-03-16T07:32:27.472 INFO:teuthology.orchestra.run.smithi049.stdout: "num": 6398 2024-03-16T07:32:27.472 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:32:27.472 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": { 2024-03-16T07:32:27.472 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2024-03-16T07:32:27.472 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "192.168.0.2:0", 2024-03-16T07:32:27.472 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 2113784454 2024-03-16T07:32:27.472 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:32:27.472 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:32:27.472 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": { 2024-03-16T07:32:27.472 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2024-03-16T07:32:27.472 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "192.168.0.2:0", 2024-03-16T07:32:27.472 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 2113784454 2024-03-16T07:32:27.472 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:32:27.472 INFO:teuthology.orchestra.run.smithi049.stdout: "inst_str": "client.6398 192.168.0.2:0/2113784454", 2024-03-16T07:32:27.473 INFO:teuthology.orchestra.run.smithi049.stdout: "addr_str": "192.168.0.2:0/2113784454", 2024-03-16T07:32:27.473 INFO:teuthology.orchestra.run.smithi049.stdout: "inode_count": 1, 2024-03-16T07:32:27.473 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_epoch": 99, 2024-03-16T07:32:27.473 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_epoch": 142, 2024-03-16T07:32:27.473 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_epoch_barrier": 0, 2024-03-16T07:32:27.473 INFO:teuthology.orchestra.run.smithi049.stdout: "blocklisted": false, 2024-03-16T07:32:27.473 INFO:teuthology.orchestra.run.smithi049.stdout: "fs_name": "cephfs" 2024-03-16T07:32:27.473 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-03-16T07:32:27.479 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:32:27.479 DEBUG:teuthology.orchestra.run.smithi049:> stat --file-system '--printf=%T 2024-03-16T07:32:27.479 DEBUG:teuthology.orchestra.run.smithi049:> ' -- /home/ubuntu/cephtest/mnt.1 2024-03-16T07:32:27.494 INFO:teuthology.orchestra.run.smithi049.stdout:fuseblk 2024-03-16T07:32:27.495 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-03-16T07:32:27.495 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:32:27.495 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-03-16T07:32:27.566 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2024-03-16T07:32:28.247 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T07:32:28.548 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:32:28.548 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":142,"fsid":"f91af061-9eac-4793-87fa-8d27ae3d242f","created":"2024-03-16T07:24:20.357868+0000","modified":"2024-03-16T07:32:19.216053+0000","last_up_change":"2024-03-16T07:24:27.474980+0000","last_in_change":"2024-03-16T07:24:21.254179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T07:24:28.947521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_metadata","create_time":"2024-03-16T07:32:15.892059+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"141","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":25,"pool_name":"cephfs_data","create_time":"2024-03-16T07:32:16.561057+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"142","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2df14aac-98dc-4e3c-ae7e-9eb677aa30be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6801","nonce":2744935777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6803","nonce":2744935777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6807","nonce":2744935777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6805","nonce":2744935777}]},"public_addr":"172.21.15.49:6801/2744935777","cluster_addr":"172.21.15.49:6803/2744935777","heartbeat_back_addr":"172.21.15.49:6807/2744935777","heartbeat_front_addr":"172.21.15.49:6805/2744935777","state":["exists","up"]},{"osd":1,"uuid":"80461bd9-59ef-46df-9eea-bad92d960c57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6811","nonce":1655120118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6815","nonce":1655120118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6821","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6823","nonce":1655120118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6817","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6819","nonce":1655120118}]},"public_addr":"172.21.15.49:6811/1655120118","cluster_addr":"172.21.15.49:6815/1655120118","heartbeat_back_addr":"172.21.15.49:6823/1655120118","heartbeat_front_addr":"172.21.15.49:6819/1655120118","state":["exists","up"]},{"osd":2,"uuid":"d6bf40eb-6e42-4ec9-8b3d-0b6c5a6def79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6810","nonce":3815472376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6814","nonce":3815472376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6822","nonce":3815472376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6818","nonce":3815472376}]},"public_addr":"172.21.15.49:6810/3815472376","cluster_addr":"172.21.15.49:6814/3815472376","heartbeat_back_addr":"172.21.15.49:6822/3815472376","heartbeat_front_addr":"172.21.15.49:6818/3815472376","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.641492+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.668598+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.614940+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T07:32:28.561 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-16T07:24:28.947521+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 24, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-16T07:32:15.892059+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '141', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 25, 'pool_name': 'cephfs_data', 'create_time': '2024-03-16T07:32:16.561057+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '142', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-16T07:32:28.561 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-16T07:32:28.865 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2024-03-16T07:32:28.877 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-16T07:32:29.180 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2024-03-16T07:32:29.192 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-16T07:32:29.501 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2024-03-16T07:32:29.514 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-03-16T07:32:29.820 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:32:29.820 INFO:teuthology.orchestra.run.smithi049.stdout:[ 2024-03-16T07:32:29.820 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:32:29.820 INFO:teuthology.orchestra.run.smithi049.stdout: "poolnum": 1, 2024-03-16T07:32:29.820 INFO:teuthology.orchestra.run.smithi049.stdout: "poolname": ".mgr" 2024-03-16T07:32:29.820 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:32:29.820 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:32:29.820 INFO:teuthology.orchestra.run.smithi049.stdout: "poolnum": 24, 2024-03-16T07:32:29.820 INFO:teuthology.orchestra.run.smithi049.stdout: "poolname": "cephfs_metadata" 2024-03-16T07:32:29.821 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:32:29.821 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:32:29.821 INFO:teuthology.orchestra.run.smithi049.stdout: "poolnum": 25, 2024-03-16T07:32:29.821 INFO:teuthology.orchestra.run.smithi049.stdout: "poolname": "cephfs_data" 2024-03-16T07:32:29.821 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:32:29.821 INFO:teuthology.orchestra.run.smithi049.stdout:] 2024-03-16T07:32:29.832 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'backup_fs' 2024-03-16T07:32:29.832 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create backup_fs_metadata --pg_num_min 64 2024-03-16T07:32:30.235 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'backup_fs_metadata' created 2024-03-16T07:32:30.254 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create backup_fs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-03-16T07:32:31.238 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'backup_fs_data' created 2024-03-16T07:32:31.271 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new backup_fs backup_fs_metadata backup_fs_data 2024-03-16T07:32:32.238 INFO:teuthology.orchestra.run.smithi049.stderr:new fs with metadata pool 26 and data pool 27 2024-03-16T07:32:32.272 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T07:32:32.583 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:32:32.583 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":145,"fsid":"f91af061-9eac-4793-87fa-8d27ae3d242f","created":"2024-03-16T07:24:20.357868+0000","modified":"2024-03-16T07:32:31.616594+0000","last_up_change":"2024-03-16T07:24:27.474980+0000","last_in_change":"2024-03-16T07:24:21.254179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":27,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T07:24:28.947521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_metadata","create_time":"2024-03-16T07:32:15.892059+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"141","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":25,"pool_name":"cephfs_data","create_time":"2024-03-16T07:32:16.561057+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"142","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":26,"pool_name":"backup_fs_metadata","create_time":"2024-03-16T07:32:30.176149+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"145","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"backup_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.309999942779541,"score_stable":1.309999942779541,"optimal_score":1,"raw_score_acting":1.309999942779541,"raw_score_stable":1.309999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":27,"pool_name":"backup_fs_data","create_time":"2024-03-16T07:32:30.596010+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"145","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"backup_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2df14aac-98dc-4e3c-ae7e-9eb677aa30be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6801","nonce":2744935777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6803","nonce":2744935777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6807","nonce":2744935777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6805","nonce":2744935777}]},"public_addr":"172.21.15.49:6801/2744935777","cluster_addr":"172.21.15.49:6803/2744935777","heartbeat_back_addr":"172.21.15.49:6807/2744935777","heartbeat_front_addr":"172.21.15.49:6805/2744935777","state":["exists","up"]},{"osd":1,"uuid":"80461bd9-59ef-46df-9eea-bad92d960c57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6811","nonce":1655120118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6815","nonce":1655120118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6821","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6823","nonce":1655120118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6817","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6819","nonce":1655120118}]},"public_addr":"172.21.15.49:6811/1655120118","cluster_addr":"172.21.15.49:6815/1655120118","heartbeat_back_addr":"172.21.15.49:6823/1655120118","heartbeat_front_addr":"172.21.15.49:6819/1655120118","state":["exists","up"]},{"osd":2,"uuid":"d6bf40eb-6e42-4ec9-8b3d-0b6c5a6def79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6810","nonce":3815472376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6814","nonce":3815472376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6822","nonce":3815472376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6818","nonce":3815472376}]},"public_addr":"172.21.15.49:6810/3815472376","cluster_addr":"172.21.15.49:6814/3815472376","heartbeat_back_addr":"172.21.15.49:6822/3815472376","heartbeat_front_addr":"172.21.15.49:6818/3815472376","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.641492+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.668598+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.614940+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T07:32:32.595 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T07:32:32.974 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:32:32.974 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":145,"fsid":"f91af061-9eac-4793-87fa-8d27ae3d242f","created":"2024-03-16T07:24:20.357868+0000","modified":"2024-03-16T07:32:31.616594+0000","last_up_change":"2024-03-16T07:24:27.474980+0000","last_in_change":"2024-03-16T07:24:21.254179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":27,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T07:24:28.947521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_metadata","create_time":"2024-03-16T07:32:15.892059+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"141","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":25,"pool_name":"cephfs_data","create_time":"2024-03-16T07:32:16.561057+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"142","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":26,"pool_name":"backup_fs_metadata","create_time":"2024-03-16T07:32:30.176149+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"145","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"backup_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.309999942779541,"score_stable":1.309999942779541,"optimal_score":1,"raw_score_acting":1.309999942779541,"raw_score_stable":1.309999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":27,"pool_name":"backup_fs_data","create_time":"2024-03-16T07:32:30.596010+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"145","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"backup_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2df14aac-98dc-4e3c-ae7e-9eb677aa30be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6801","nonce":2744935777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6803","nonce":2744935777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6807","nonce":2744935777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6805","nonce":2744935777}]},"public_addr":"172.21.15.49:6801/2744935777","cluster_addr":"172.21.15.49:6803/2744935777","heartbeat_back_addr":"172.21.15.49:6807/2744935777","heartbeat_front_addr":"172.21.15.49:6805/2744935777","state":["exists","up"]},{"osd":1,"uuid":"80461bd9-59ef-46df-9eea-bad92d960c57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6811","nonce":1655120118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6815","nonce":1655120118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6821","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6823","nonce":1655120118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6817","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6819","nonce":1655120118}]},"public_addr":"172.21.15.49:6811/1655120118","cluster_addr":"172.21.15.49:6815/1655120118","heartbeat_back_addr":"172.21.15.49:6823/1655120118","heartbeat_front_addr":"172.21.15.49:6819/1655120118","state":["exists","up"]},{"osd":2,"uuid":"d6bf40eb-6e42-4ec9-8b3d-0b6c5a6def79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6810","nonce":3815472376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6814","nonce":3815472376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6822","nonce":3815472376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6818","nonce":3815472376}]},"public_addr":"172.21.15.49:6810/3815472376","cluster_addr":"172.21.15.49:6814/3815472376","heartbeat_back_addr":"172.21.15.49:6822/3815472376","heartbeat_front_addr":"172.21.15.49:6818/3815472376","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.641492+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.668598+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.614940+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T07:32:32.989 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set backup_fs standby_count_wanted 0 2024-03-16T07:32:33.870 INFO:tasks.ceph.mds.c.smithi049.stderr:2024-03-16T07:32:33.870+0000 7fc3077a7640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-03-16T07:32:34.265 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-03-16T07:32:34.266 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set backup_fs allow_standby_replay false 2024-03-16T07:32:35.269 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'backup_fs' 2024-03-16T07:32:35.269 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T07:32:35.608 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:32:35.609 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":105,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6315,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6828/2438276517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":2438276517},{"type":"v1","addr":"172.21.15.49:6828","nonce":2438276517}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":94},{"gid":6316,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6829/1412184122","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6827","nonce":1412184122},{"type":"v1","addr":"172.21.15.49:6829","nonce":1412184122}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":94},{"gid":6321,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6831/3610285344","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":3610285344},{"type":"v1","addr":"172.21.15.49:6831","nonce":3610285344}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":94}],"filesystems":[{"mdsmap":{"epoch":99,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-16T07:32:17.592092+0000","modified":"2024-03-16T07:32:20.584913+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6325},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6325":{"gid":6325,"name":"a","rank":0,"incarnation":95,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6835/2709512109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":2709512109},{"type":"v1","addr":"172.21.15.49:6835","nonce":2709512109}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6325,"qdb_cluster":[6325]},"id":12},{"mdsmap":{"epoch":105,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-16T07:32:31.616889+0000","modified":"2024-03-16T07:32:34.616124+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6324},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6324":{"gid":6324,"name":"c","rank":0,"incarnation":101,"state":"up:active","state_seq":6,"addr":"172.21.15.49:6833/1457417734","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":1457417734},{"type":"v1","addr":"172.21.15.49:6833","nonce":1457417734}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[27],"metadata_pool":26,"enabled":true,"fs_name":"backup_fs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6324,"qdb_cluster":[6324]},"id":13}]} 2024-03-16T07:32:35.609 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 105 2024-03-16T07:32:35.621 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T07:32:35.957 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:32:35.957 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":146,"fsid":"f91af061-9eac-4793-87fa-8d27ae3d242f","created":"2024-03-16T07:24:20.357868+0000","modified":"2024-03-16T07:32:33.246113+0000","last_up_change":"2024-03-16T07:24:27.474980+0000","last_in_change":"2024-03-16T07:24:21.254179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":27,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T07:24:28.947521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_metadata","create_time":"2024-03-16T07:32:15.892059+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"141","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":25,"pool_name":"cephfs_data","create_time":"2024-03-16T07:32:16.561057+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"142","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":26,"pool_name":"backup_fs_metadata","create_time":"2024-03-16T07:32:30.176149+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"145","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"backup_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.309999942779541,"score_stable":1.309999942779541,"optimal_score":1,"raw_score_acting":1.309999942779541,"raw_score_stable":1.309999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":27,"pool_name":"backup_fs_data","create_time":"2024-03-16T07:32:30.596010+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"146","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"backup_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2df14aac-98dc-4e3c-ae7e-9eb677aa30be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6801","nonce":2744935777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6803","nonce":2744935777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6807","nonce":2744935777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6805","nonce":2744935777}]},"public_addr":"172.21.15.49:6801/2744935777","cluster_addr":"172.21.15.49:6803/2744935777","heartbeat_back_addr":"172.21.15.49:6807/2744935777","heartbeat_front_addr":"172.21.15.49:6805/2744935777","state":["exists","up"]},{"osd":1,"uuid":"80461bd9-59ef-46df-9eea-bad92d960c57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6811","nonce":1655120118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6815","nonce":1655120118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6821","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6823","nonce":1655120118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6817","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6819","nonce":1655120118}]},"public_addr":"172.21.15.49:6811/1655120118","cluster_addr":"172.21.15.49:6815/1655120118","heartbeat_back_addr":"172.21.15.49:6823/1655120118","heartbeat_front_addr":"172.21.15.49:6819/1655120118","state":["exists","up"]},{"osd":2,"uuid":"d6bf40eb-6e42-4ec9-8b3d-0b6c5a6def79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6810","nonce":3815472376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6814","nonce":3815472376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6822","nonce":3815472376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6818","nonce":3815472376}]},"public_addr":"172.21.15.49:6810/3815472376","cluster_addr":"172.21.15.49:6814/3815472376","heartbeat_back_addr":"172.21.15.49:6822/3815472376","heartbeat_front_addr":"172.21.15.49:6818/3815472376","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.641492+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.668598+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.614940+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T07:32:35.970 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-03-16T07:32:35.970 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-16T07:32:36.285 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:32:36.288 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2024-03-16T07:32:36.295 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":44,"stamp":"2024-03-16T07:32:34.825552+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596885,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":970,"num_read_kb":1945,"num_write":408,"num_write_kb":1925,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":275,"ondisk_log_size":275,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":316,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":314572800,"kb_used":111692,"kb_used_data":5656,"kb_used_omap":4,"kb_used_meta":105979,"kb_avail":314461108,"statfs":{"total":322122547200,"available":322008174592,"internally_reserved":0,"allocated":5791744,"data_stored":3027464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":108522831},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.587838"},"pg_stats":[{"pgid":"27.3d","version":"0'0","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-03-16T07:32:33.252761+0000","last_change":"2024-03-16T07:32:32.265428+0000","last_active":"2024-03-16T07:32:33.252761+0000","last_peered":"2024-03-16T07:32:33.252761+0000","last_clean":"2024-03-16T07:32:33.252761+0000","last_became_active":"2024-03-16T07:32:32.265011+0000","last_became_peered":"2024-03-16T07:32:32.265011+0000","last_unstale":"2024-03-16T07:32:33.252761+0000","last_undegraded":"2024-03-16T07:32:33.252761+0000","last_fullsized":"2024-03-16T07:32:33.252761+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_clean_scrub_stamp":"2024-03-16T07:32:31.237650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:06:27.795818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.3f","version":"0'0","reported_seq":18,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.254495+0000","last_change":"2024-03-16T07:32:18.247962+0000","last_active":"2024-03-16T07:32:32.254495+0000","last_peered":"2024-03-16T07:32:32.254495+0000","last_clean":"2024-03-16T07:32:32.254495+0000","last_became_active":"2024-03-16T07:32:18.247621+0000","last_became_peered":"2024-03-16T07:32:18.247621+0000","last_unstale":"2024-03-16T07:32:32.254495+0000","last_undegraded":"2024-03-16T07:32:32.254495+0000","last_fullsized":"2024-03-16T07:32:32.254495+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:08:10.533094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.3c","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.267833+0000","last_change":"2024-03-16T07:32:32.263178+0000","last_active":"2024-03-16T07:32:32.267833+0000","last_peered":"2024-03-16T07:32:32.267833+0000","last_clean":"2024-03-16T07:32:32.267833+0000","last_became_active":"2024-03-16T07:32:32.261328+0000","last_became_peered":"2024-03-16T07:32:32.261328+0000","last_unstale":"2024-03-16T07:32:32.267833+0000","last_undegraded":"2024-03-16T07:32:32.267833+0000","last_fullsized":"2024-03-16T07:32:32.267833+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_clean_scrub_stamp":"2024-03-16T07:32:31.237650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:36:41.704280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.3e","version":"0'0","reported_seq":18,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.255429+0000","last_change":"2024-03-16T07:32:18.246415+0000","last_active":"2024-03-16T07:32:32.255429+0000","last_peered":"2024-03-16T07:32:32.255429+0000","last_clean":"2024-03-16T07:32:32.255429+0000","last_became_active":"2024-03-16T07:32:18.246171+0000","last_became_peered":"2024-03-16T07:32:18.246171+0000","last_unstale":"2024-03-16T07:32:32.255429+0000","last_undegraded":"2024-03-16T07:32:32.255429+0000","last_fullsized":"2024-03-16T07:32:32.255429+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:45:07.587766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.3f","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.284912+0000","last_change":"2024-03-16T07:32:32.276789+0000","last_active":"2024-03-16T07:32:32.284912+0000","last_peered":"2024-03-16T07:32:32.284912+0000","last_clean":"2024-03-16T07:32:32.284912+0000","last_became_active":"2024-03-16T07:32:32.275579+0000","last_became_peered":"2024-03-16T07:32:32.275579+0000","last_unstale":"2024-03-16T07:32:32.284912+0000","last_undegraded":"2024-03-16T07:32:32.284912+0000","last_fullsized":"2024-03-16T07:32:32.284912+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_clean_scrub_stamp":"2024-03-16T07:32:31.237650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:49:16.588043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.3d","version":"0'0","reported_seq":18,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.250831+0000","last_change":"2024-03-16T07:32:18.243582+0000","last_active":"2024-03-16T07:32:32.250831+0000","last_peered":"2024-03-16T07:32:32.250831+0000","last_clean":"2024-03-16T07:32:32.250831+0000","last_became_active":"2024-03-16T07:32:18.243189+0000","last_became_peered":"2024-03-16T07:32:18.243189+0000","last_unstale":"2024-03-16T07:32:32.250831+0000","last_undegraded":"2024-03-16T07:32:32.250831+0000","last_fullsized":"2024-03-16T07:32:32.250831+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:03:26.209534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.3e","version":"0'0","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-03-16T07:32:33.253428+0000","last_change":"2024-03-16T07:32:32.281211+0000","last_active":"2024-03-16T07:32:33.253428+0000","last_peered":"2024-03-16T07:32:33.253428+0000","last_clean":"2024-03-16T07:32:33.253428+0000","last_became_active":"2024-03-16T07:32:32.280951+0000","last_became_peered":"2024-03-16T07:32:32.280951+0000","last_unstale":"2024-03-16T07:32:33.253428+0000","last_undegraded":"2024-03-16T07:32:33.253428+0000","last_fullsized":"2024-03-16T07:32:33.253428+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_clean_scrub_stamp":"2024-03-16T07:32:31.237650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:12:12.874649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.3c","version":"0'0","reported_seq":18,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.250920+0000","last_change":"2024-03-16T07:32:18.245554+0000","last_active":"2024-03-16T07:32:32.250920+0000","last_peered":"2024-03-16T07:32:32.250920+0000","last_clean":"2024-03-16T07:32:32.250920+0000","last_became_active":"2024-03-16T07:32:18.245016+0000","last_became_peered":"2024-03-16T07:32:18.245016+0000","last_unstale":"2024-03-16T07:32:32.250920+0000","last_undegraded":"2024-03-16T07:32:32.250920+0000","last_fullsized":"2024-03-16T07:32:32.250920+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:59:39.662853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.39","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.286052+0000","last_change":"2024-03-16T07:32:32.278551+0000","last_active":"2024-03-16T07:32:32.286052+0000","last_peered":"2024-03-16T07:32:32.286052+0000","last_clean":"2024-03-16T07:32:32.286052+0000","last_became_active":"2024-03-16T07:32:32.275414+0000","last_became_peered":"2024-03-16T07:32:32.275414+0000","last_unstale":"2024-03-16T07:32:32.286052+0000","last_undegraded":"2024-03-16T07:32:32.286052+0000","last_fullsized":"2024-03-16T07:32:32.286052+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_clean_scrub_stamp":"2024-03-16T07:32:31.237650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:23:19.424033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.3b","version":"0'0","reported_seq":20,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-03-16T07:32:33.252981+0000","last_change":"2024-03-16T07:32:18.235990+0000","last_active":"2024-03-16T07:32:33.252981+0000","last_peered":"2024-03-16T07:32:33.252981+0000","last_clean":"2024-03-16T07:32:33.252981+0000","last_became_active":"2024-03-16T07:32:18.235735+0000","last_became_peered":"2024-03-16T07:32:18.235735+0000","last_unstale":"2024-03-16T07:32:33.252981+0000","last_undegraded":"2024-03-16T07:32:33.252981+0000","last_fullsized":"2024-03-16T07:32:33.252981+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:23:21.663692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.38","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.284654+0000","last_change":"2024-03-16T07:32:32.281691+0000","last_active":"2024-03-16T07:32:32.284654+0000","last_peered":"2024-03-16T07:32:32.284654+0000","last_clean":"2024-03-16T07:32:32.284654+0000","last_became_active":"2024-03-16T07:32:32.281302+0000","last_became_peered":"2024-03-16T07:32:32.281302+0000","last_unstale":"2024-03-16T07:32:32.284654+0000","last_undegraded":"2024-03-16T07:32:32.284654+0000","last_fullsized":"2024-03-16T07:32:32.284654+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_clean_scrub_stamp":"2024-03-16T07:32:31.237650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:56:33.218427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.3a","version":"0'0","reported_seq":18,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.249364+0000","last_change":"2024-03-16T07:32:18.243404+0000","last_active":"2024-03-16T07:32:32.249364+0000","last_peered":"2024-03-16T07:32:32.249364+0000","last_clean":"2024-03-16T07:32:32.249364+0000","last_became_active":"2024-03-16T07:32:18.243142+0000","last_became_peered":"2024-03-16T07:32:18.243142+0000","last_unstale":"2024-03-16T07:32:32.249364+0000","last_undegraded":"2024-03-16T07:32:32.249364+0000","last_fullsized":"2024-03-16T07:32:32.249364+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:38:11.159687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.3b","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.284700+0000","last_change":"2024-03-16T07:32:32.282487+0000","last_active":"2024-03-16T07:32:32.284700+0000","last_peered":"2024-03-16T07:32:32.284700+0000","last_clean":"2024-03-16T07:32:32.284700+0000","last_became_active":"2024-03-16T07:32:32.281245+0000","last_became_peered":"2024-03-16T07:32:32.281245+0000","last_unstale":"2024-03-16T07:32:32.284700+0000","last_undegraded":"2024-03-16T07:32:32.284700+0000","last_fullsized":"2024-03-16T07:32:32.284700+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_clean_scrub_stamp":"2024-03-16T07:32:31.237650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:25:35.551462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.39","version":"0'0","reported_seq":20,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-03-16T07:32:33.251307+0000","last_change":"2024-03-16T07:32:18.240139+0000","last_active":"2024-03-16T07:32:33.251307+0000","last_peered":"2024-03-16T07:32:33.251307+0000","last_clean":"2024-03-16T07:32:33.251307+0000","last_became_active":"2024-03-16T07:32:18.238310+0000","last_became_peered":"2024-03-16T07:32:18.238310+0000","last_unstale":"2024-03-16T07:32:33.251307+0000","last_undegraded":"2024-03-16T07:32:33.251307+0000","last_fullsized":"2024-03-16T07:32:33.251307+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:48:26.150691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.3a","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.263194+0000","last_change":"2024-03-16T07:32:32.257930+0000","last_active":"2024-03-16T07:32:32.263194+0000","last_peered":"2024-03-16T07:32:32.263194+0000","last_clean":"2024-03-16T07:32:32.263194+0000","last_became_active":"2024-03-16T07:32:32.257679+0000","last_became_peered":"2024-03-16T07:32:32.257679+0000","last_unstale":"2024-03-16T07:32:32.263194+0000","last_undegraded":"2024-03-16T07:32:32.263194+0000","last_fullsized":"2024-03-16T07:32:32.263194+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_clean_scrub_stamp":"2024-03-16T07:32:31.237650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:55:42.719123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.38","version":"0'0","reported_seq":18,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.257452+0000","last_change":"2024-03-16T07:32:18.245507+0000","last_active":"2024-03-16T07:32:32.257452+0000","last_peered":"2024-03-16T07:32:32.257452+0000","last_clean":"2024-03-16T07:32:32.257452+0000","last_became_active":"2024-03-16T07:32:18.245260+0000","last_became_peered":"2024-03-16T07:32:18.245260+0000","last_unstale":"2024-03-16T07:32:32.257452+0000","last_undegraded":"2024-03-16T07:32:32.257452+0000","last_fullsized":"2024-03-16T07:32:32.257452+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:03:50.228942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.35","version":"0'0","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-03-16T07:32:33.252774+0000","last_change":"2024-03-16T07:32:32.265239+0000","last_active":"2024-03-16T07:32:33.252774+0000","last_peered":"2024-03-16T07:32:33.252774+0000","last_clean":"2024-03-16T07:32:33.252774+0000","last_became_active":"2024-03-16T07:32:32.264685+0000","last_became_peered":"2024-03-16T07:32:32.264685+0000","last_unstale":"2024-03-16T07:32:33.252774+0000","last_undegraded":"2024-03-16T07:32:33.252774+0000","last_fullsized":"2024-03-16T07:32:33.252774+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_clean_scrub_stamp":"2024-03-16T07:32:31.237650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:28:51.886419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.37","version":"0'0","reported_seq":18,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.254584+0000","last_change":"2024-03-16T07:32:18.247274+0000","last_active":"2024-03-16T07:32:32.254584+0000","last_peered":"2024-03-16T07:32:32.254584+0000","last_clean":"2024-03-16T07:32:32.254584+0000","last_became_active":"2024-03-16T07:32:18.247021+0000","last_became_peered":"2024-03-16T07:32:18.247021+0000","last_unstale":"2024-03-16T07:32:32.254584+0000","last_undegraded":"2024-03-16T07:32:32.254584+0000","last_fullsized":"2024-03-16T07:32:32.254584+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:21:44.428460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.34","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.285073+0000","last_change":"2024-03-16T07:32:32.279247+0000","last_active":"2024-03-16T07:32:32.285073+0000","last_peered":"2024-03-16T07:32:32.285073+0000","last_clean":"2024-03-16T07:32:32.285073+0000","last_became_active":"2024-03-16T07:32:32.278709+0000","last_became_peered":"2024-03-16T07:32:32.278709+0000","last_unstale":"2024-03-16T07:32:32.285073+0000","last_undegraded":"2024-03-16T07:32:32.285073+0000","last_fullsized":"2024-03-16T07:32:32.285073+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_clean_scrub_stamp":"2024-03-16T07:32:31.237650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:12:31.983454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.36","version":"0'0","reported_seq":18,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.267335+0000","last_change":"2024-03-16T07:32:18.239231+0000","last_active":"2024-03-16T07:32:32.267335+0000","last_peered":"2024-03-16T07:32:32.267335+0000","last_clean":"2024-03-16T07:32:32.267335+0000","last_became_active":"2024-03-16T07:32:18.238947+0000","last_became_peered":"2024-03-16T07:32:18.238947+0000","last_unstale":"2024-03-16T07:32:32.267335+0000","last_undegraded":"2024-03-16T07:32:32.267335+0000","last_fullsized":"2024-03-16T07:32:32.267335+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:50:21.074348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.37","version":"0'0","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-03-16T07:32:33.254214+0000","last_change":"2024-03-16T07:32:32.266498+0000","last_active":"2024-03-16T07:32:33.254214+0000","last_peered":"2024-03-16T07:32:33.254214+0000","last_clean":"2024-03-16T07:32:33.254214+0000","last_became_active":"2024-03-16T07:32:32.266248+0000","last_became_peered":"2024-03-16T07:32:32.266248+0000","last_unstale":"2024-03-16T07:32:33.254214+0000","last_undegraded":"2024-03-16T07:32:33.254214+0000","last_fullsized":"2024-03-16T07:32:33.254214+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_clean_scrub_stamp":"2024-03-16T07:32:31.237650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:07:44.253482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.35","version":"0'0","reported_seq":20,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-03-16T07:32:33.253197+0000","last_change":"2024-03-16T07:32:18.237180+0000","last_active":"2024-03-16T07:32:33.253197+0000","last_peered":"2024-03-16T07:32:33.253197+0000","last_clean":"2024-03-16T07:32:33.253197+0000","last_became_active":"2024-03-16T07:32:18.236919+0000","last_became_peered":"2024-03-16T07:32:18.236919+0000","last_unstale":"2024-03-16T07:32:33.253197+0000","last_undegraded":"2024-03-16T07:32:33.253197+0000","last_fullsized":"2024-03-16T07:32:33.253197+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:57:24.911547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.36","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.289898+0000","last_change":"2024-03-16T07:32:32.289338+0000","last_active":"2024-03-16T07:32:32.289898+0000","last_peered":"2024-03-16T07:32:32.289898+0000","last_clean":"2024-03-16T07:32:32.289898+0000","last_became_active":"2024-03-16T07:32:32.288993+0000","last_became_peered":"2024-03-16T07:32:32.288993+0000","last_unstale":"2024-03-16T07:32:32.289898+0000","last_undegraded":"2024-03-16T07:32:32.289898+0000","last_fullsized":"2024-03-16T07:32:32.289898+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_clean_scrub_stamp":"2024-03-16T07:32:31.237650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:44:21.268108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.34","version":"0'0","reported_seq":18,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.256279+0000","last_change":"2024-03-16T07:32:18.241361+0000","last_active":"2024-03-16T07:32:32.256279+0000","last_peered":"2024-03-16T07:32:32.256279+0000","last_clean":"2024-03-16T07:32:32.256279+0000","last_became_active":"2024-03-16T07:32:18.240963+0000","last_became_peered":"2024-03-16T07:32:18.240963+0000","last_unstale":"2024-03-16T07:32:32.256279+0000","last_undegraded":"2024-03-16T07:32:32.256279+0000","last_fullsized":"2024-03-16T07:32:32.256279+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:39:23.980376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.31","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.275342+0000","last_change":"2024-03-16T07:32:32.274867+0000","last_active":"2024-03-16T07:32:32.275342+0000","last_peered":"2024-03-16T07:32:32.275342+0000","last_clean":"2024-03-16T07:32:32.275342+0000","last_became_active":"2024-03-16T07:32:32.274114+0000","last_became_peered":"2024-03-16T07:32:32.274114+0000","last_unstale":"2024-03-16T07:32:32.275342+0000","last_undegraded":"2024-03-16T07:32:32.275342+0000","last_fullsized":"2024-03-16T07:32:32.275342+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_clean_scrub_stamp":"2024-03-16T07:32:31.237650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:52:18.397174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.33","version":"0'0","reported_seq":18,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.252045+0000","last_change":"2024-03-16T07:32:18.244631+0000","last_active":"2024-03-16T07:32:32.252045+0000","last_peered":"2024-03-16T07:32:32.252045+0000","last_clean":"2024-03-16T07:32:32.252045+0000","last_became_active":"2024-03-16T07:32:18.244350+0000","last_became_peered":"2024-03-16T07:32:18.244350+0000","last_unstale":"2024-03-16T07:32:32.252045+0000","last_undegraded":"2024-03-16T07:32:32.252045+0000","last_fullsized":"2024-03-16T07:32:32.252045+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:46:56.524556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.30","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.273269+0000","last_change":"2024-03-16T07:32:32.270883+0000","last_active":"2024-03-16T07:32:32.273269+0000","last_peered":"2024-03-16T07:32:32.273269+0000","last_clean":"2024-03-16T07:32:32.273269+0000","last_became_active":"2024-03-16T07:32:32.270630+0000","last_became_peered":"2024-03-16T07:32:32.270630+0000","last_unstale":"2024-03-16T07:32:32.273269+0000","last_undegraded":"2024-03-16T07:32:32.273269+0000","last_fullsized":"2024-03-16T07:32:32.273269+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_clean_scrub_stamp":"2024-03-16T07:32:31.237650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:18:16.143393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.32","version":"0'0","reported_seq":18,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.249453+0000","last_change":"2024-03-16T07:32:18.247797+0000","last_active":"2024-03-16T07:32:32.249453+0000","last_peered":"2024-03-16T07:32:32.249453+0000","last_clean":"2024-03-16T07:32:32.249453+0000","last_became_active":"2024-03-16T07:32:18.247260+0000","last_became_peered":"2024-03-16T07:32:18.247260+0000","last_unstale":"2024-03-16T07:32:32.249453+0000","last_undegraded":"2024-03-16T07:32:32.249453+0000","last_fullsized":"2024-03-16T07:32:32.249453+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:50:06.050581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.33","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.284719+0000","last_change":"2024-03-16T07:32:32.282683+0000","last_active":"2024-03-16T07:32:32.284719+0000","last_peered":"2024-03-16T07:32:32.284719+0000","last_clean":"2024-03-16T07:32:32.284719+0000","last_became_active":"2024-03-16T07:32:32.282249+0000","last_became_peered":"2024-03-16T07:32:32.282249+0000","last_unstale":"2024-03-16T07:32:32.284719+0000","last_undegraded":"2024-03-16T07:32:32.284719+0000","last_fullsized":"2024-03-16T07:32:32.284719+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_clean_scrub_stamp":"2024-03-16T07:32:31.237650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:25:41.803751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.31","version":"0'0","reported_seq":18,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.260062+0000","last_change":"2024-03-16T07:32:18.233233+0000","last_active":"2024-03-16T07:32:32.260062+0000","last_peered":"2024-03-16T07:32:32.260062+0000","last_clean":"2024-03-16T07:32:32.260062+0000","last_became_active":"2024-03-16T07:32:18.232417+0000","last_became_peered":"2024-03-16T07:32:18.232417+0000","last_unstale":"2024-03-16T07:32:32.260062+0000","last_undegraded":"2024-03-16T07:32:32.260062+0000","last_fullsized":"2024-03-16T07:32:32.260062+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:59:16.749516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.32","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.288178+0000","last_change":"2024-03-16T07:32:32.287225+0000","last_active":"2024-03-16T07:32:32.288178+0000","last_peered":"2024-03-16T07:32:32.288178+0000","last_clean":"2024-03-16T07:32:32.288178+0000","last_became_active":"2024-03-16T07:32:32.286951+0000","last_became_peered":"2024-03-16T07:32:32.286951+0000","last_unstale":"2024-03-16T07:32:32.288178+0000","last_undegraded":"2024-03-16T07:32:32.288178+0000","last_fullsized":"2024-03-16T07:32:32.288178+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_clean_scrub_stamp":"2024-03-16T07:32:31.237650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:49:26.553174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.30","version":"0'0","reported_seq":20,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-03-16T07:32:33.251634+0000","last_change":"2024-03-16T07:32:18.225150+0000","last_active":"2024-03-16T07:32:33.251634+0000","last_peered":"2024-03-16T07:32:33.251634+0000","last_clean":"2024-03-16T07:32:33.251634+0000","last_became_active":"2024-03-16T07:32:18.224307+0000","last_became_peered":"2024-03-16T07:32:18.224307+0000","last_unstale":"2024-03-16T07:32:33.251634+0000","last_undegraded":"2024-03-16T07:32:33.251634+0000","last_fullsized":"2024-03-16T07:32:33.251634+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:47:18.145134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.2d","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.284640+0000","last_change":"2024-03-16T07:32:32.283732+0000","last_active":"2024-03-16T07:32:32.284640+0000","last_peered":"2024-03-16T07:32:32.284640+0000","last_clean":"2024-03-16T07:32:32.284640+0000","last_became_active":"2024-03-16T07:32:32.283280+0000","last_became_peered":"2024-03-16T07:32:32.283280+0000","last_unstale":"2024-03-16T07:32:32.284640+0000","last_undegraded":"2024-03-16T07:32:32.284640+0000","last_fullsized":"2024-03-16T07:32:32.284640+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_clean_scrub_stamp":"2024-03-16T07:32:31.237650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:14:52.522588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.2f","version":"0'0","reported_seq":20,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-03-16T07:32:33.254227+0000","last_change":"2024-03-16T07:32:18.248997+0000","last_active":"2024-03-16T07:32:33.254227+0000","last_peered":"2024-03-16T07:32:33.254227+0000","last_clean":"2024-03-16T07:32:33.254227+0000","last_became_active":"2024-03-16T07:32:18.248743+0000","last_became_peered":"2024-03-16T07:32:18.248743+0000","last_unstale":"2024-03-16T07:32:33.254227+0000","last_undegraded":"2024-03-16T07:32:33.254227+0000","last_fullsized":"2024-03-16T07:32:33.254227+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:34:24.065048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.2c","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.279101+0000","last_change":"2024-03-16T07:32:32.278021+0000","last_active":"2024-03-16T07:32:32.279101+0000","last_peered":"2024-03-16T07:32:32.279101+0000","last_clean":"2024-03-16T07:32:32.279101+0000","last_became_active":"2024-03-16T07:32:32.277755+0000","last_became_peered":"2024-03-16T07:32:32.277755+0000","last_unstale":"2024-03-16T07:32:32.279101+0000","last_undegraded":"2024-03-16T07:32:32.279101+0000","last_fullsized":"2024-03-16T07:32:32.279101+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_clean_scrub_stamp":"2024-03-16T07:32:31.237650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:46:27.564797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.2e","version":"0'0","reported_seq":20,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-03-16T07:32:33.253857+0000","last_change":"2024-03-16T07:32:18.233726+0000","last_active":"2024-03-16T07:32:33.253857+0000","last_peered":"2024-03-16T07:32:33.253857+0000","last_clean":"2024-03-16T07:32:33.253857+0000","last_became_active":"2024-03-16T07:32:18.232689+0000","last_became_peered":"2024-03-16T07:32:18.232689+0000","last_unstale":"2024-03-16T07:32:33.253857+0000","last_undegraded":"2024-03-16T07:32:33.253857+0000","last_fullsized":"2024-03-16T07:32:33.253857+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:17:44.160585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.2f","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.284932+0000","last_change":"2024-03-16T07:32:32.278225+0000","last_active":"2024-03-16T07:32:32.284932+0000","last_peered":"2024-03-16T07:32:32.284932+0000","last_clean":"2024-03-16T07:32:32.284932+0000","last_became_active":"2024-03-16T07:32:32.276572+0000","last_became_peered":"2024-03-16T07:32:32.276572+0000","last_unstale":"2024-03-16T07:32:32.284932+0000","last_undegraded":"2024-03-16T07:32:32.284932+0000","last_fullsized":"2024-03-16T07:32:32.284932+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_clean_scrub_stamp":"2024-03-16T07:32:31.237650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:11:29.141431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.2d","version":"0'0","reported_seq":18,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.256121+0000","last_change":"2024-03-16T07:32:18.236128+0000","last_active":"2024-03-16T07:32:32.256121+0000","last_peered":"2024-03-16T07:32:32.256121+0000","last_clean":"2024-03-16T07:32:32.256121+0000","last_became_active":"2024-03-16T07:32:18.235894+0000","last_became_peered":"2024-03-16T07:32:18.235894+0000","last_unstale":"2024-03-16T07:32:32.256121+0000","last_undegraded":"2024-03-16T07:32:32.256121+0000","last_fullsized":"2024-03-16T07:32:32.256121+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:43:36.044253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.2e","version":"0'0","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-03-16T07:32:33.253566+0000","last_change":"2024-03-16T07:32:32.279938+0000","last_active":"2024-03-16T07:32:33.253566+0000","last_peered":"2024-03-16T07:32:33.253566+0000","last_clean":"2024-03-16T07:32:33.253566+0000","last_became_active":"2024-03-16T07:32:32.279700+0000","last_became_peered":"2024-03-16T07:32:32.279700+0000","last_unstale":"2024-03-16T07:32:33.253566+0000","last_undegraded":"2024-03-16T07:32:33.253566+0000","last_fullsized":"2024-03-16T07:32:33.253566+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_clean_scrub_stamp":"2024-03-16T07:32:31.237650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:47:05.414566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2c","version":"0'0","reported_seq":20,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-03-16T07:32:33.253247+0000","last_change":"2024-03-16T07:32:18.224575+0000","last_active":"2024-03-16T07:32:33.253247+0000","last_peered":"2024-03-16T07:32:33.253247+0000","last_clean":"2024-03-16T07:32:33.253247+0000","last_became_active":"2024-03-16T07:32:18.224316+0000","last_became_peered":"2024-03-16T07:32:18.224316+0000","last_unstale":"2024-03-16T07:32:33.253247+0000","last_undegraded":"2024-03-16T07:32:33.253247+0000","last_fullsized":"2024-03-16T07:32:33.253247+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:01:12.599303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.29","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.273146+0000","last_change":"2024-03-16T07:32:32.269394+0000","last_active":"2024-03-16T07:32:32.273146+0000","last_peered":"2024-03-16T07:32:32.273146+0000","last_clean":"2024-03-16T07:32:32.273146+0000","last_became_active":"2024-03-16T07:32:32.269140+0000","last_became_peered":"2024-03-16T07:32:32.269140+0000","last_unstale":"2024-03-16T07:32:32.273146+0000","last_undegraded":"2024-03-16T07:32:32.273146+0000","last_fullsized":"2024-03-16T07:32:32.273146+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_clean_scrub_stamp":"2024-03-16T07:32:31.237650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:10:10.331326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.2b","version":"0'0","reported_seq":20,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-03-16T07:32:33.253176+0000","last_change":"2024-03-16T07:32:18.250300+0000","last_active":"2024-03-16T07:32:33.253176+0000","last_peered":"2024-03-16T07:32:33.253176+0000","last_clean":"2024-03-16T07:32:33.253176+0000","last_became_active":"2024-03-16T07:32:18.249983+0000","last_became_peered":"2024-03-16T07:32:18.249983+0000","last_unstale":"2024-03-16T07:32:33.253176+0000","last_undegraded":"2024-03-16T07:32:33.253176+0000","last_fullsized":"2024-03-16T07:32:33.253176+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:04:10.017926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.28","version":"0'0","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-03-16T07:32:33.252180+0000","last_change":"2024-03-16T07:32:32.266744+0000","last_active":"2024-03-16T07:32:33.252180+0000","last_peered":"2024-03-16T07:32:33.252180+0000","last_clean":"2024-03-16T07:32:33.252180+0000","last_became_active":"2024-03-16T07:32:32.266484+0000","last_became_peered":"2024-03-16T07:32:32.266484+0000","last_unstale":"2024-03-16T07:32:33.252180+0000","last_undegraded":"2024-03-16T07:32:33.252180+0000","last_fullsized":"2024-03-16T07:32:33.252180+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_clean_scrub_stamp":"2024-03-16T07:32:31.237650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:59:30.783141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2a","version":"0'0","reported_seq":18,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.264888+0000","last_change":"2024-03-16T07:32:18.226323+0000","last_active":"2024-03-16T07:32:32.264888+0000","last_peered":"2024-03-16T07:32:32.264888+0000","last_clean":"2024-03-16T07:32:32.264888+0000","last_became_active":"2024-03-16T07:32:18.225946+0000","last_became_peered":"2024-03-16T07:32:18.225946+0000","last_unstale":"2024-03-16T07:32:32.264888+0000","last_undegraded":"2024-03-16T07:32:32.264888+0000","last_fullsized":"2024-03-16T07:32:32.264888+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:07:22.597390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.2b","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.274592+0000","last_change":"2024-03-16T07:32:32.273297+0000","last_active":"2024-03-16T07:32:32.274592+0000","last_peered":"2024-03-16T07:32:32.274592+0000","last_clean":"2024-03-16T07:32:32.274592+0000","last_became_active":"2024-03-16T07:32:32.273073+0000","last_became_peered":"2024-03-16T07:32:32.273073+0000","last_unstale":"2024-03-16T07:32:32.274592+0000","last_undegraded":"2024-03-16T07:32:32.274592+0000","last_fullsized":"2024-03-16T07:32:32.274592+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_clean_scrub_stamp":"2024-03-16T07:32:31.237650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:57:27.376465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.29","version":"0'0","reported_seq":18,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.250168+0000","last_change":"2024-03-16T07:32:18.244224+0000","last_active":"2024-03-16T07:32:32.250168+0000","last_peered":"2024-03-16T07:32:32.250168+0000","last_clean":"2024-03-16T07:32:32.250168+0000","last_became_active":"2024-03-16T07:32:18.243900+0000","last_became_peered":"2024-03-16T07:32:18.243900+0000","last_unstale":"2024-03-16T07:32:32.250168+0000","last_undegraded":"2024-03-16T07:32:32.250168+0000","last_fullsized":"2024-03-16T07:32:32.250168+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:36:57.985523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.2a","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.286035+0000","last_change":"2024-03-16T07:32:32.284727+0000","last_active":"2024-03-16T07:32:32.286035+0000","last_peered":"2024-03-16T07:32:32.286035+0000","last_clean":"2024-03-16T07:32:32.286035+0000","last_became_active":"2024-03-16T07:32:32.284316+0000","last_became_peered":"2024-03-16T07:32:32.284316+0000","last_unstale":"2024-03-16T07:32:32.286035+0000","last_undegraded":"2024-03-16T07:32:32.286035+0000","last_fullsized":"2024-03-16T07:32:32.286035+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_clean_scrub_stamp":"2024-03-16T07:32:31.237650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:13:51.207210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.28","version":"0'0","reported_seq":18,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.266336+0000","last_change":"2024-03-16T07:32:18.235208+0000","last_active":"2024-03-16T07:32:32.266336+0000","last_peered":"2024-03-16T07:32:32.266336+0000","last_clean":"2024-03-16T07:32:32.266336+0000","last_became_active":"2024-03-16T07:32:18.233745+0000","last_became_peered":"2024-03-16T07:32:18.233745+0000","last_unstale":"2024-03-16T07:32:32.266336+0000","last_undegraded":"2024-03-16T07:32:32.266336+0000","last_fullsized":"2024-03-16T07:32:32.266336+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:14:38.488963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.25","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.284989+0000","last_change":"2024-03-16T07:32:32.277983+0000","last_active":"2024-03-16T07:32:32.284989+0000","last_peered":"2024-03-16T07:32:32.284989+0000","last_clean":"2024-03-16T07:32:32.284989+0000","last_became_active":"2024-03-16T07:32:32.277748+0000","last_became_peered":"2024-03-16T07:32:32.277748+0000","last_unstale":"2024-03-16T07:32:32.284989+0000","last_undegraded":"2024-03-16T07:32:32.284989+0000","last_fullsized":"2024-03-16T07:32:32.284989+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_clean_scrub_stamp":"2024-03-16T07:32:31.237650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:16:18.155901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.27","version":"0'0","reported_seq":18,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.254690+0000","last_change":"2024-03-16T07:32:18.234600+0000","last_active":"2024-03-16T07:32:32.254690+0000","last_peered":"2024-03-16T07:32:32.254690+0000","last_clean":"2024-03-16T07:32:32.254690+0000","last_became_active":"2024-03-16T07:32:18.234355+0000","last_became_peered":"2024-03-16T07:32:18.234355+0000","last_unstale":"2024-03-16T07:32:32.254690+0000","last_undegraded":"2024-03-16T07:32:32.254690+0000","last_fullsized":"2024-03-16T07:32:32.254690+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:36:04.847955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.24","version":"0'0","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-03-16T07:32:33.252935+0000","last_change":"2024-03-16T07:32:32.266170+0000","last_active":"2024-03-16T07:32:33.252935+0000","last_peered":"2024-03-16T07:32:33.252935+0000","last_clean":"2024-03-16T07:32:33.252935+0000","last_became_active":"2024-03-16T07:32:32.265678+0000","last_became_peered":"2024-03-16T07:32:32.265678+0000","last_unstale":"2024-03-16T07:32:33.252935+0000","last_undegraded":"2024-03-16T07:32:33.252935+0000","last_fullsized":"2024-03-16T07:32:33.252935+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_clean_scrub_stamp":"2024-03-16T07:32:31.237650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:08:02.408020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.26","version":"0'0","reported_seq":18,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.267428+0000","last_change":"2024-03-16T07:32:18.225540+0000","last_active":"2024-03-16T07:32:32.267428+0000","last_peered":"2024-03-16T07:32:32.267428+0000","last_clean":"2024-03-16T07:32:32.267428+0000","last_became_active":"2024-03-16T07:32:18.225284+0000","last_became_peered":"2024-03-16T07:32:18.225284+0000","last_unstale":"2024-03-16T07:32:32.267428+0000","last_undegraded":"2024-03-16T07:32:32.267428+0000","last_fullsized":"2024-03-16T07:32:32.267428+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:22:39.336541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.27","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.264280+0000","last_change":"2024-03-16T07:32:32.260970+0000","last_active":"2024-03-16T07:32:32.264280+0000","last_peered":"2024-03-16T07:32:32.264280+0000","last_clean":"2024-03-16T07:32:32.264280+0000","last_became_active":"2024-03-16T07:32:32.259356+0000","last_became_peered":"2024-03-16T07:32:32.259356+0000","last_unstale":"2024-03-16T07:32:32.264280+0000","last_undegraded":"2024-03-16T07:32:32.264280+0000","last_fullsized":"2024-03-16T07:32:32.264280+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_clean_scrub_stamp":"2024-03-16T07:32:31.237650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:19:53.365815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.25","version":"0'0","reported_seq":18,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.251090+0000","last_change":"2024-03-16T07:32:18.249523+0000","last_active":"2024-03-16T07:32:32.251090+0000","last_peered":"2024-03-16T07:32:32.251090+0000","last_clean":"2024-03-16T07:32:32.251090+0000","last_became_active":"2024-03-16T07:32:18.249244+0000","last_became_peered":"2024-03-16T07:32:18.249244+0000","last_unstale":"2024-03-16T07:32:32.251090+0000","last_undegraded":"2024-03-16T07:32:32.251090+0000","last_fullsized":"2024-03-16T07:32:32.251090+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:40:16.544671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.26","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.289844+0000","last_change":"2024-03-16T07:32:32.288935+0000","last_active":"2024-03-16T07:32:32.289844+0000","last_peered":"2024-03-16T07:32:32.289844+0000","last_clean":"2024-03-16T07:32:32.289844+0000","last_became_active":"2024-03-16T07:32:32.288407+0000","last_became_peered":"2024-03-16T07:32:32.288407+0000","last_unstale":"2024-03-16T07:32:32.289844+0000","last_undegraded":"2024-03-16T07:32:32.289844+0000","last_fullsized":"2024-03-16T07:32:32.289844+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_clean_scrub_stamp":"2024-03-16T07:32:31.237650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:02:38.183314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.24","version":"0'0","reported_seq":20,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-03-16T07:32:33.253335+0000","last_change":"2024-03-16T07:32:18.239570+0000","last_active":"2024-03-16T07:32:33.253335+0000","last_peered":"2024-03-16T07:32:33.253335+0000","last_clean":"2024-03-16T07:32:33.253335+0000","last_became_active":"2024-03-16T07:32:18.239318+0000","last_became_peered":"2024-03-16T07:32:18.239318+0000","last_unstale":"2024-03-16T07:32:33.253335+0000","last_undegraded":"2024-03-16T07:32:33.253335+0000","last_fullsized":"2024-03-16T07:32:33.253335+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:56:27.850737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.21","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.274980+0000","last_change":"2024-03-16T07:32:32.273394+0000","last_active":"2024-03-16T07:32:32.274980+0000","last_peered":"2024-03-16T07:32:32.274980+0000","last_clean":"2024-03-16T07:32:32.274980+0000","last_became_active":"2024-03-16T07:32:32.273147+0000","last_became_peered":"2024-03-16T07:32:32.273147+0000","last_unstale":"2024-03-16T07:32:32.274980+0000","last_undegraded":"2024-03-16T07:32:32.274980+0000","last_fullsized":"2024-03-16T07:32:32.274980+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_clean_scrub_stamp":"2024-03-16T07:32:31.237650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:17:05.381343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.23","version":"0'0","reported_seq":18,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.260861+0000","last_change":"2024-03-16T07:32:18.241882+0000","last_active":"2024-03-16T07:32:32.260861+0000","last_peered":"2024-03-16T07:32:32.260861+0000","last_clean":"2024-03-16T07:32:32.260861+0000","last_became_active":"2024-03-16T07:32:18.241443+0000","last_became_peered":"2024-03-16T07:32:18.241443+0000","last_unstale":"2024-03-16T07:32:32.260861+0000","last_undegraded":"2024-03-16T07:32:32.260861+0000","last_fullsized":"2024-03-16T07:32:32.260861+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:11:58.841024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.20","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.288151+0000","last_change":"2024-03-16T07:32:32.287100+0000","last_active":"2024-03-16T07:32:32.288151+0000","last_peered":"2024-03-16T07:32:32.288151+0000","last_clean":"2024-03-16T07:32:32.288151+0000","last_became_active":"2024-03-16T07:32:32.286865+0000","last_became_peered":"2024-03-16T07:32:32.286865+0000","last_unstale":"2024-03-16T07:32:32.288151+0000","last_undegraded":"2024-03-16T07:32:32.288151+0000","last_fullsized":"2024-03-16T07:32:32.288151+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_clean_scrub_stamp":"2024-03-16T07:32:31.237650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:17:04.052783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.22","version":"0'0","reported_seq":18,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.266420+0000","last_change":"2024-03-16T07:32:18.226198+0000","last_active":"2024-03-16T07:32:32.266420+0000","last_peered":"2024-03-16T07:32:32.266420+0000","last_clean":"2024-03-16T07:32:32.266420+0000","last_became_active":"2024-03-16T07:32:18.224070+0000","last_became_peered":"2024-03-16T07:32:18.224070+0000","last_unstale":"2024-03-16T07:32:32.266420+0000","last_undegraded":"2024-03-16T07:32:32.266420+0000","last_fullsized":"2024-03-16T07:32:32.266420+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:49:04.864326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.23","version":"0'0","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-03-16T07:32:33.252403+0000","last_change":"2024-03-16T07:32:32.262790+0000","last_active":"2024-03-16T07:32:33.252403+0000","last_peered":"2024-03-16T07:32:33.252403+0000","last_clean":"2024-03-16T07:32:33.252403+0000","last_became_active":"2024-03-16T07:32:32.262566+0000","last_became_peered":"2024-03-16T07:32:32.262566+0000","last_unstale":"2024-03-16T07:32:33.252403+0000","last_undegraded":"2024-03-16T07:32:33.252403+0000","last_fullsized":"2024-03-16T07:32:33.252403+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_clean_scrub_stamp":"2024-03-16T07:32:31.237650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:20:09.973405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.21","version":"0'0","reported_seq":18,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.250283+0000","last_change":"2024-03-16T07:32:18.233960+0000","last_active":"2024-03-16T07:32:32.250283+0000","last_peered":"2024-03-16T07:32:32.250283+0000","last_clean":"2024-03-16T07:32:32.250283+0000","last_became_active":"2024-03-16T07:32:18.233732+0000","last_became_peered":"2024-03-16T07:32:18.233732+0000","last_unstale":"2024-03-16T07:32:32.250283+0000","last_undegraded":"2024-03-16T07:32:32.250283+0000","last_fullsized":"2024-03-16T07:32:32.250283+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:16:18.048818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.22","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.284656+0000","last_change":"2024-03-16T07:32:32.280733+0000","last_active":"2024-03-16T07:32:32.284656+0000","last_peered":"2024-03-16T07:32:32.284656+0000","last_clean":"2024-03-16T07:32:32.284656+0000","last_became_active":"2024-03-16T07:32:32.280496+0000","last_became_peered":"2024-03-16T07:32:32.280496+0000","last_unstale":"2024-03-16T07:32:32.284656+0000","last_undegraded":"2024-03-16T07:32:32.284656+0000","last_fullsized":"2024-03-16T07:32:32.284656+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_clean_scrub_stamp":"2024-03-16T07:32:31.237650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:26:18.348097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.20","version":"0'0","reported_seq":20,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-03-16T07:32:33.251726+0000","last_change":"2024-03-16T07:32:18.233834+0000","last_active":"2024-03-16T07:32:33.251726+0000","last_peered":"2024-03-16T07:32:33.251726+0000","last_clean":"2024-03-16T07:32:33.251726+0000","last_became_active":"2024-03-16T07:32:18.233597+0000","last_became_peered":"2024-03-16T07:32:18.233597+0000","last_unstale":"2024-03-16T07:32:33.251726+0000","last_undegraded":"2024-03-16T07:32:33.251726+0000","last_fullsized":"2024-03-16T07:32:33.251726+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:37:27.058282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.1c","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.285053+0000","last_change":"2024-03-16T07:32:32.278511+0000","last_active":"2024-03-16T07:32:32.285053+0000","last_peered":"2024-03-16T07:32:32.285053+0000","last_clean":"2024-03-16T07:32:32.285053+0000","last_became_active":"2024-03-16T07:32:32.275788+0000","last_became_peered":"2024-03-16T07:32:32.275788+0000","last_unstale":"2024-03-16T07:32:32.285053+0000","last_undegraded":"2024-03-16T07:32:32.285053+0000","last_fullsized":"2024-03-16T07:32:32.285053+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_clean_scrub_stamp":"2024-03-16T07:32:31.237650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:34:40.342413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.1d","version":"145'2","reported_seq":16,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-03-16T07:32:33.253034+0000","last_change":"2024-03-16T07:32:31.265311+0000","last_active":"2024-03-16T07:32:33.253034+0000","last_peered":"2024-03-16T07:32:33.253034+0000","last_clean":"2024-03-16T07:32:33.253034+0000","last_became_active":"2024-03-16T07:32:31.264922+0000","last_became_peered":"2024-03-16T07:32:31.264922+0000","last_unstale":"2024-03-16T07:32:33.253034+0000","last_undegraded":"2024-03-16T07:32:33.253034+0000","last_fullsized":"2024-03-16T07:32:33.253034+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:30.234218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:30.234218+0000","last_clean_scrub_stamp":"2024-03-16T07:32:30.234218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:35:45.570886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1e","version":"0'0","reported_seq":18,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.255534+0000","last_change":"2024-03-16T07:32:18.228560+0000","last_active":"2024-03-16T07:32:32.255534+0000","last_peered":"2024-03-16T07:32:32.255534+0000","last_clean":"2024-03-16T07:32:32.255534+0000","last_became_active":"2024-03-16T07:32:18.228293+0000","last_became_peered":"2024-03-16T07:32:18.228293+0000","last_unstale":"2024-03-16T07:32:32.255534+0000","last_undegraded":"2024-03-16T07:32:32.255534+0000","last_fullsized":"2024-03-16T07:32:32.255534+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:42:00.570394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.1f","version":"141'4","reported_seq":26,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-03-16T07:32:33.254397+0000","last_change":"2024-03-16T07:32:17.224916+0000","last_active":"2024-03-16T07:32:33.254397+0000","last_peered":"2024-03-16T07:32:33.254397+0000","last_clean":"2024-03-16T07:32:33.254397+0000","last_became_active":"2024-03-16T07:32:17.224654+0000","last_became_peered":"2024-03-16T07:32:17.224654+0000","last_unstale":"2024-03-16T07:32:33.254397+0000","last_undegraded":"2024-03-16T07:32:33.254397+0000","last_fullsized":"2024-03-16T07:32:33.254397+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_clean_scrub_stamp":"2024-03-16T07:32:16.202808+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:50:05.049365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.1d","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.264412+0000","last_change":"2024-03-16T07:32:32.259518+0000","last_active":"2024-03-16T07:32:32.264412+0000","last_peered":"2024-03-16T07:32:32.264412+0000","last_clean":"2024-03-16T07:32:32.264412+0000","last_became_active":"2024-03-16T07:32:32.259250+0000","last_became_peered":"2024-03-16T07:32:32.259250+0000","last_unstale":"2024-03-16T07:32:32.264412+0000","last_undegraded":"2024-03-16T07:32:32.264412+0000","last_fullsized":"2024-03-16T07:32:32.264412+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_clean_scrub_stamp":"2024-03-16T07:32:31.237650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:09:53.519731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.1c","version":"145'2","reported_seq":14,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.291503+0000","last_change":"2024-03-16T07:32:31.264503+0000","last_active":"2024-03-16T07:32:32.291503+0000","last_peered":"2024-03-16T07:32:32.291503+0000","last_clean":"2024-03-16T07:32:32.291503+0000","last_became_active":"2024-03-16T07:32:31.263690+0000","last_became_peered":"2024-03-16T07:32:31.263690+0000","last_unstale":"2024-03-16T07:32:32.291503+0000","last_undegraded":"2024-03-16T07:32:32.291503+0000","last_fullsized":"2024-03-16T07:32:32.291503+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:30.234218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:30.234218+0000","last_clean_scrub_stamp":"2024-03-16T07:32:30.234218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:02:45.104528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1f","version":"0'0","reported_seq":18,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.260467+0000","last_change":"2024-03-16T07:32:18.243113+0000","last_active":"2024-03-16T07:32:32.260467+0000","last_peered":"2024-03-16T07:32:32.260467+0000","last_clean":"2024-03-16T07:32:32.260467+0000","last_became_active":"2024-03-16T07:32:18.242717+0000","last_became_peered":"2024-03-16T07:32:18.242717+0000","last_unstale":"2024-03-16T07:32:32.260467+0000","last_undegraded":"2024-03-16T07:32:32.260467+0000","last_fullsized":"2024-03-16T07:32:32.260467+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:46:51.380941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1e","version":"141'1","reported_seq":21,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.267542+0000","last_change":"2024-03-16T07:32:17.232318+0000","last_active":"2024-03-16T07:32:32.267542+0000","last_peered":"2024-03-16T07:32:32.267542+0000","last_clean":"2024-03-16T07:32:32.267542+0000","last_became_active":"2024-03-16T07:32:17.230713+0000","last_became_peered":"2024-03-16T07:32:17.230713+0000","last_unstale":"2024-03-16T07:32:32.267542+0000","last_undegraded":"2024-03-16T07:32:32.267542+0000","last_fullsized":"2024-03-16T07:32:32.267542+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_clean_scrub_stamp":"2024-03-16T07:32:16.202808+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:18:34.025222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.1e","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.289047+0000","last_change":"2024-03-16T07:32:32.288007+0000","last_active":"2024-03-16T07:32:32.289047+0000","last_peered":"2024-03-16T07:32:32.289047+0000","last_clean":"2024-03-16T07:32:32.289047+0000","last_became_active":"2024-03-16T07:32:32.287226+0000","last_became_peered":"2024-03-16T07:32:32.287226+0000","last_unstale":"2024-03-16T07:32:32.289047+0000","last_undegraded":"2024-03-16T07:32:32.289047+0000","last_fullsized":"2024-03-16T07:32:32.289047+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_clean_scrub_stamp":"2024-03-16T07:32:31.237650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:32:37.722293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.1f","version":"145'4","reported_seq":16,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.289882+0000","last_change":"2024-03-16T07:32:31.269220+0000","last_active":"2024-03-16T07:32:32.289882+0000","last_peered":"2024-03-16T07:32:32.289882+0000","last_clean":"2024-03-16T07:32:32.289882+0000","last_became_active":"2024-03-16T07:32:31.268984+0000","last_became_peered":"2024-03-16T07:32:31.268984+0000","last_unstale":"2024-03-16T07:32:32.289882+0000","last_undegraded":"2024-03-16T07:32:32.289882+0000","last_fullsized":"2024-03-16T07:32:32.289882+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:30.234218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:30.234218+0000","last_clean_scrub_stamp":"2024-03-16T07:32:30.234218+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:01:51.570542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.1c","version":"0'0","reported_seq":18,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.251024+0000","last_change":"2024-03-16T07:32:18.230121+0000","last_active":"2024-03-16T07:32:32.251024+0000","last_peered":"2024-03-16T07:32:32.251024+0000","last_clean":"2024-03-16T07:32:32.251024+0000","last_became_active":"2024-03-16T07:32:18.229075+0000","last_became_peered":"2024-03-16T07:32:18.229075+0000","last_unstale":"2024-03-16T07:32:32.251024+0000","last_undegraded":"2024-03-16T07:32:32.251024+0000","last_fullsized":"2024-03-16T07:32:32.251024+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:34:12.823633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.1d","version":"141'2","reported_seq":22,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.251386+0000","last_change":"2024-03-16T07:32:17.228396+0000","last_active":"2024-03-16T07:32:32.251386+0000","last_peered":"2024-03-16T07:32:32.251386+0000","last_clean":"2024-03-16T07:32:32.251386+0000","last_became_active":"2024-03-16T07:32:17.228131+0000","last_became_peered":"2024-03-16T07:32:17.228131+0000","last_unstale":"2024-03-16T07:32:32.251386+0000","last_undegraded":"2024-03-16T07:32:32.251386+0000","last_fullsized":"2024-03-16T07:32:32.251386+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_clean_scrub_stamp":"2024-03-16T07:32:16.202808+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:05:23.959390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.1f","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.273026+0000","last_change":"2024-03-16T07:32:32.269094+0000","last_active":"2024-03-16T07:32:32.273026+0000","last_peered":"2024-03-16T07:32:32.273026+0000","last_clean":"2024-03-16T07:32:32.273026+0000","last_became_active":"2024-03-16T07:32:32.268831+0000","last_became_peered":"2024-03-16T07:32:32.268831+0000","last_unstale":"2024-03-16T07:32:32.273026+0000","last_undegraded":"2024-03-16T07:32:32.273026+0000","last_fullsized":"2024-03-16T07:32:32.273026+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_clean_scrub_stamp":"2024-03-16T07:32:31.237650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:35:46.574318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.1e","version":"145'1","reported_seq":13,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.289387+0000","last_change":"2024-03-16T07:32:31.268826+0000","last_active":"2024-03-16T07:32:32.289387+0000","last_peered":"2024-03-16T07:32:32.289387+0000","last_clean":"2024-03-16T07:32:32.289387+0000","last_became_active":"2024-03-16T07:32:31.268594+0000","last_became_peered":"2024-03-16T07:32:31.268594+0000","last_unstale":"2024-03-16T07:32:32.289387+0000","last_undegraded":"2024-03-16T07:32:32.289387+0000","last_fullsized":"2024-03-16T07:32:32.289387+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:30.234218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:30.234218+0000","last_clean_scrub_stamp":"2024-03-16T07:32:30.234218+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:37:22.740932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.1d","version":"0'0","reported_seq":18,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.251186+0000","last_change":"2024-03-16T07:32:18.249490+0000","last_active":"2024-03-16T07:32:32.251186+0000","last_peered":"2024-03-16T07:32:32.251186+0000","last_clean":"2024-03-16T07:32:32.251186+0000","last_became_active":"2024-03-16T07:32:18.249036+0000","last_became_peered":"2024-03-16T07:32:18.249036+0000","last_unstale":"2024-03-16T07:32:32.251186+0000","last_undegraded":"2024-03-16T07:32:32.251186+0000","last_fullsized":"2024-03-16T07:32:32.251186+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:48:26.150691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.1c","version":"141'2","reported_seq":22,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.256532+0000","last_change":"2024-03-16T07:32:17.230842+0000","last_active":"2024-03-16T07:32:32.256532+0000","last_peered":"2024-03-16T07:32:32.256532+0000","last_clean":"2024-03-16T07:32:32.256532+0000","last_became_active":"2024-03-16T07:32:17.230593+0000","last_became_peered":"2024-03-16T07:32:17.230593+0000","last_unstale":"2024-03-16T07:32:32.256532+0000","last_undegraded":"2024-03-16T07:32:32.256532+0000","last_fullsized":"2024-03-16T07:32:32.256532+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_clean_scrub_stamp":"2024-03-16T07:32:16.202808+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:03:33.084093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.18","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.284633+0000","last_change":"2024-03-16T07:32:32.281543+0000","last_active":"2024-03-16T07:32:32.284633+0000","last_peered":"2024-03-16T07:32:32.284633+0000","last_clean":"2024-03-16T07:32:32.284633+0000","last_became_active":"2024-03-16T07:32:32.280978+0000","last_became_peered":"2024-03-16T07:32:32.280978+0000","last_unstale":"2024-03-16T07:32:32.284633+0000","last_undegraded":"2024-03-16T07:32:32.284633+0000","last_fullsized":"2024-03-16T07:32:32.284633+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_clean_scrub_stamp":"2024-03-16T07:32:31.237650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:14:55.981996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.19","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.250094+0000","last_change":"2024-03-16T07:32:31.258676+0000","last_active":"2024-03-16T07:32:32.250094+0000","last_peered":"2024-03-16T07:32:32.250094+0000","last_clean":"2024-03-16T07:32:32.250094+0000","last_became_active":"2024-03-16T07:32:31.258453+0000","last_became_peered":"2024-03-16T07:32:31.258453+0000","last_unstale":"2024-03-16T07:32:32.250094+0000","last_undegraded":"2024-03-16T07:32:32.250094+0000","last_fullsized":"2024-03-16T07:32:32.250094+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:30.234218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:30.234218+0000","last_clean_scrub_stamp":"2024-03-16T07:32:30.234218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:30:25.672232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1a","version":"0'0","reported_seq":18,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.266524+0000","last_change":"2024-03-16T07:32:18.226108+0000","last_active":"2024-03-16T07:32:32.266524+0000","last_peered":"2024-03-16T07:32:32.266524+0000","last_clean":"2024-03-16T07:32:32.266524+0000","last_became_active":"2024-03-16T07:32:18.223749+0000","last_became_peered":"2024-03-16T07:32:18.223749+0000","last_unstale":"2024-03-16T07:32:32.266524+0000","last_undegraded":"2024-03-16T07:32:32.266524+0000","last_fullsized":"2024-03-16T07:32:32.266524+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:28:37.852794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1b","version":"141'1","reported_seq":23,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-03-16T07:32:33.253570+0000","last_change":"2024-03-16T07:32:17.225004+0000","last_active":"2024-03-16T07:32:33.253570+0000","last_peered":"2024-03-16T07:32:33.253570+0000","last_clean":"2024-03-16T07:32:33.253570+0000","last_became_active":"2024-03-16T07:32:17.224306+0000","last_became_peered":"2024-03-16T07:32:17.224306+0000","last_unstale":"2024-03-16T07:32:33.253570+0000","last_undegraded":"2024-03-16T07:32:33.253570+0000","last_fullsized":"2024-03-16T07:32:33.253570+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_clean_scrub_stamp":"2024-03-16T07:32:16.202808+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:58:22.521647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.19","version":"0'0","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-03-16T07:32:33.251433+0000","last_change":"2024-03-16T07:32:32.276999+0000","last_active":"2024-03-16T07:32:33.251433+0000","last_peered":"2024-03-16T07:32:33.251433+0000","last_clean":"2024-03-16T07:32:33.251433+0000","last_became_active":"2024-03-16T07:32:32.276728+0000","last_became_peered":"2024-03-16T07:32:32.276728+0000","last_unstale":"2024-03-16T07:32:33.251433+0000","last_undegraded":"2024-03-16T07:32:33.251433+0000","last_fullsized":"2024-03-16T07:32:33.251433+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_clean_scrub_stamp":"2024-03-16T07:32:31.237650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:07:36.631016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.18","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.256958+0000","last_change":"2024-03-16T07:32:31.259217+0000","last_active":"2024-03-16T07:32:32.256958+0000","last_peered":"2024-03-16T07:32:32.256958+0000","last_clean":"2024-03-16T07:32:32.256958+0000","last_became_active":"2024-03-16T07:32:31.258967+0000","last_became_peered":"2024-03-16T07:32:31.258967+0000","last_unstale":"2024-03-16T07:32:32.256958+0000","last_undegraded":"2024-03-16T07:32:32.256958+0000","last_fullsized":"2024-03-16T07:32:32.256958+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:30.234218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:30.234218+0000","last_clean_scrub_stamp":"2024-03-16T07:32:30.234218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:30:34.008169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1b","version":"0'0","reported_seq":20,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-03-16T07:32:33.253271+0000","last_change":"2024-03-16T07:32:18.239642+0000","last_active":"2024-03-16T07:32:33.253271+0000","last_peered":"2024-03-16T07:32:33.253271+0000","last_clean":"2024-03-16T07:32:33.253271+0000","last_became_active":"2024-03-16T07:32:18.239335+0000","last_became_peered":"2024-03-16T07:32:18.239335+0000","last_unstale":"2024-03-16T07:32:33.253271+0000","last_undegraded":"2024-03-16T07:32:33.253271+0000","last_fullsized":"2024-03-16T07:32:33.253271+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:40:23.016092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.1a","version":"141'1","reported_seq":23,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-03-16T07:32:33.251802+0000","last_change":"2024-03-16T07:32:17.228025+0000","last_active":"2024-03-16T07:32:33.251802+0000","last_peered":"2024-03-16T07:32:33.251802+0000","last_clean":"2024-03-16T07:32:33.251802+0000","last_became_active":"2024-03-16T07:32:17.227533+0000","last_became_peered":"2024-03-16T07:32:17.227533+0000","last_unstale":"2024-03-16T07:32:33.251802+0000","last_undegraded":"2024-03-16T07:32:33.251802+0000","last_fullsized":"2024-03-16T07:32:33.251802+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_clean_scrub_stamp":"2024-03-16T07:32:16.202808+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:48:47.764111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.1b","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.273189+0000","last_change":"2024-03-16T07:32:32.270618+0000","last_active":"2024-03-16T07:32:32.273189+0000","last_peered":"2024-03-16T07:32:32.273189+0000","last_clean":"2024-03-16T07:32:32.273189+0000","last_became_active":"2024-03-16T07:32:32.269697+0000","last_became_peered":"2024-03-16T07:32:32.269697+0000","last_unstale":"2024-03-16T07:32:32.273189+0000","last_undegraded":"2024-03-16T07:32:32.273189+0000","last_fullsized":"2024-03-16T07:32:32.273189+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_clean_scrub_stamp":"2024-03-16T07:32:31.237650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:33:12.653863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.1a","version":"145'1","reported_seq":13,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.280951+0000","last_change":"2024-03-16T07:32:31.263928+0000","last_active":"2024-03-16T07:32:32.280951+0000","last_peered":"2024-03-16T07:32:32.280951+0000","last_clean":"2024-03-16T07:32:32.280951+0000","last_became_active":"2024-03-16T07:32:31.263668+0000","last_became_peered":"2024-03-16T07:32:31.263668+0000","last_unstale":"2024-03-16T07:32:32.280951+0000","last_undegraded":"2024-03-16T07:32:32.280951+0000","last_fullsized":"2024-03-16T07:32:32.280951+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:30.234218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:30.234218+0000","last_clean_scrub_stamp":"2024-03-16T07:32:30.234218+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:58:57.460618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.19","version":"0'0","reported_seq":20,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-03-16T07:32:33.251695+0000","last_change":"2024-03-16T07:32:18.238620+0000","last_active":"2024-03-16T07:32:33.251695+0000","last_peered":"2024-03-16T07:32:33.251695+0000","last_clean":"2024-03-16T07:32:33.251695+0000","last_became_active":"2024-03-16T07:32:18.238143+0000","last_became_peered":"2024-03-16T07:32:18.238143+0000","last_unstale":"2024-03-16T07:32:33.251695+0000","last_undegraded":"2024-03-16T07:32:33.251695+0000","last_fullsized":"2024-03-16T07:32:33.251695+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:58:10.258632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":22,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-03-16T07:32:33.251813+0000","last_change":"2024-03-16T07:32:17.229868+0000","last_active":"2024-03-16T07:32:33.251813+0000","last_peered":"2024-03-16T07:32:33.251813+0000","last_clean":"2024-03-16T07:32:33.251813+0000","last_became_active":"2024-03-16T07:32:17.229220+0000","last_became_peered":"2024-03-16T07:32:17.229220+0000","last_unstale":"2024-03-16T07:32:33.251813+0000","last_undegraded":"2024-03-16T07:32:33.251813+0000","last_fullsized":"2024-03-16T07:32:33.251813+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_clean_scrub_stamp":"2024-03-16T07:32:16.202808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:39:17.803291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.14","version":"0'0","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-03-16T07:32:33.252431+0000","last_change":"2024-03-16T07:32:32.265001+0000","last_active":"2024-03-16T07:32:33.252431+0000","last_peered":"2024-03-16T07:32:33.252431+0000","last_clean":"2024-03-16T07:32:33.252431+0000","last_became_active":"2024-03-16T07:32:32.264777+0000","last_became_peered":"2024-03-16T07:32:32.264777+0000","last_unstale":"2024-03-16T07:32:33.252431+0000","last_undegraded":"2024-03-16T07:32:33.252431+0000","last_fullsized":"2024-03-16T07:32:33.252431+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_clean_scrub_stamp":"2024-03-16T07:32:31.237650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:49:18.897952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.15","version":"145'3","reported_seq":15,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.291072+0000","last_change":"2024-03-16T07:32:31.261234+0000","last_active":"2024-03-16T07:32:32.291072+0000","last_peered":"2024-03-16T07:32:32.291072+0000","last_clean":"2024-03-16T07:32:32.291072+0000","last_became_active":"2024-03-16T07:32:31.260970+0000","last_became_peered":"2024-03-16T07:32:31.260970+0000","last_unstale":"2024-03-16T07:32:32.291072+0000","last_undegraded":"2024-03-16T07:32:32.291072+0000","last_fullsized":"2024-03-16T07:32:32.291072+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:30.234218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:30.234218+0000","last_clean_scrub_stamp":"2024-03-16T07:32:30.234218+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:45:03.910240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.16","version":"0'0","reported_seq":18,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.255633+0000","last_change":"2024-03-16T07:32:18.246236+0000","last_active":"2024-03-16T07:32:32.255633+0000","last_peered":"2024-03-16T07:32:32.255633+0000","last_clean":"2024-03-16T07:32:32.255633+0000","last_became_active":"2024-03-16T07:32:18.244713+0000","last_became_peered":"2024-03-16T07:32:18.244713+0000","last_unstale":"2024-03-16T07:32:32.255633+0000","last_undegraded":"2024-03-16T07:32:32.255633+0000","last_fullsized":"2024-03-16T07:32:32.255633+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:58:36.160396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":20,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.255324+0000","last_change":"2024-03-16T07:32:17.232177+0000","last_active":"2024-03-16T07:32:32.255324+0000","last_peered":"2024-03-16T07:32:32.255324+0000","last_clean":"2024-03-16T07:32:32.255324+0000","last_became_active":"2024-03-16T07:32:17.231920+0000","last_became_peered":"2024-03-16T07:32:17.231920+0000","last_unstale":"2024-03-16T07:32:32.255324+0000","last_undegraded":"2024-03-16T07:32:32.255324+0000","last_fullsized":"2024-03-16T07:32:32.255324+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_clean_scrub_stamp":"2024-03-16T07:32:16.202808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:25:02.223110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.15","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.284970+0000","last_change":"2024-03-16T07:32:32.275386+0000","last_active":"2024-03-16T07:32:32.284970+0000","last_peered":"2024-03-16T07:32:32.284970+0000","last_clean":"2024-03-16T07:32:32.284970+0000","last_became_active":"2024-03-16T07:32:32.274914+0000","last_became_peered":"2024-03-16T07:32:32.274914+0000","last_unstale":"2024-03-16T07:32:32.284970+0000","last_undegraded":"2024-03-16T07:32:32.284970+0000","last_fullsized":"2024-03-16T07:32:32.284970+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_clean_scrub_stamp":"2024-03-16T07:32:31.237650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:25:56.023405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.14","version":"145'6","reported_seq":20,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-03-16T07:32:33.252548+0000","last_change":"2024-03-16T07:32:31.265081+0000","last_active":"2024-03-16T07:32:33.252548+0000","last_peered":"2024-03-16T07:32:33.252548+0000","last_clean":"2024-03-16T07:32:33.252548+0000","last_became_active":"2024-03-16T07:32:31.264834+0000","last_became_peered":"2024-03-16T07:32:31.264834+0000","last_unstale":"2024-03-16T07:32:33.252548+0000","last_undegraded":"2024-03-16T07:32:33.252548+0000","last_fullsized":"2024-03-16T07:32:33.252548+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:30.234218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:30.234218+0000","last_clean_scrub_stamp":"2024-03-16T07:32:30.234218+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:22:18.349029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.17","version":"0'0","reported_seq":18,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.255222+0000","last_change":"2024-03-16T07:32:18.233309+0000","last_active":"2024-03-16T07:32:32.255222+0000","last_peered":"2024-03-16T07:32:32.255222+0000","last_clean":"2024-03-16T07:32:32.255222+0000","last_became_active":"2024-03-16T07:32:18.233047+0000","last_became_peered":"2024-03-16T07:32:18.233047+0000","last_unstale":"2024-03-16T07:32:32.255222+0000","last_undegraded":"2024-03-16T07:32:32.255222+0000","last_fullsized":"2024-03-16T07:32:32.255222+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:20:21.637896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":22,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-03-16T07:32:33.253952+0000","last_change":"2024-03-16T07:32:17.219997+0000","last_active":"2024-03-16T07:32:33.253952+0000","last_peered":"2024-03-16T07:32:33.253952+0000","last_clean":"2024-03-16T07:32:33.253952+0000","last_became_active":"2024-03-16T07:32:17.219744+0000","last_became_peered":"2024-03-16T07:32:17.219744+0000","last_unstale":"2024-03-16T07:32:33.253952+0000","last_undegraded":"2024-03-16T07:32:33.253952+0000","last_fullsized":"2024-03-16T07:32:33.253952+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_clean_scrub_stamp":"2024-03-16T07:32:16.202808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:31:19.141978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.16","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.263327+0000","last_change":"2024-03-16T07:32:32.257977+0000","last_active":"2024-03-16T07:32:32.263327+0000","last_peered":"2024-03-16T07:32:32.263327+0000","last_clean":"2024-03-16T07:32:32.263327+0000","last_became_active":"2024-03-16T07:32:32.257739+0000","last_became_peered":"2024-03-16T07:32:32.257739+0000","last_unstale":"2024-03-16T07:32:32.263327+0000","last_undegraded":"2024-03-16T07:32:32.263327+0000","last_fullsized":"2024-03-16T07:32:32.263327+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_clean_scrub_stamp":"2024-03-16T07:32:31.237650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:51:14.747719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.17","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.254322+0000","last_change":"2024-03-16T07:32:31.262922+0000","last_active":"2024-03-16T07:32:32.254322+0000","last_peered":"2024-03-16T07:32:32.254322+0000","last_clean":"2024-03-16T07:32:32.254322+0000","last_became_active":"2024-03-16T07:32:31.262664+0000","last_became_peered":"2024-03-16T07:32:31.262664+0000","last_unstale":"2024-03-16T07:32:32.254322+0000","last_undegraded":"2024-03-16T07:32:32.254322+0000","last_fullsized":"2024-03-16T07:32:32.254322+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:30.234218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:30.234218+0000","last_clean_scrub_stamp":"2024-03-16T07:32:30.234218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:55:47.774877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.14","version":"0'0","reported_seq":18,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.256373+0000","last_change":"2024-03-16T07:32:18.224530+0000","last_active":"2024-03-16T07:32:32.256373+0000","last_peered":"2024-03-16T07:32:32.256373+0000","last_clean":"2024-03-16T07:32:32.256373+0000","last_became_active":"2024-03-16T07:32:18.223901+0000","last_became_peered":"2024-03-16T07:32:18.223901+0000","last_unstale":"2024-03-16T07:32:32.256373+0000","last_undegraded":"2024-03-16T07:32:32.256373+0000","last_fullsized":"2024-03-16T07:32:32.256373+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:34:54.412590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.15","version":"141'3","reported_seq":25,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-03-16T07:32:33.253411+0000","last_change":"2024-03-16T07:32:17.220743+0000","last_active":"2024-03-16T07:32:33.253411+0000","last_peered":"2024-03-16T07:32:33.253411+0000","last_clean":"2024-03-16T07:32:33.253411+0000","last_became_active":"2024-03-16T07:32:17.220474+0000","last_became_peered":"2024-03-16T07:32:17.220474+0000","last_unstale":"2024-03-16T07:32:33.253411+0000","last_undegraded":"2024-03-16T07:32:33.253411+0000","last_fullsized":"2024-03-16T07:32:33.253411+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_clean_scrub_stamp":"2024-03-16T07:32:16.202808+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:08:19.721367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.17","version":"0'0","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-03-16T07:32:33.253892+0000","last_change":"2024-03-16T07:32:32.265954+0000","last_active":"2024-03-16T07:32:33.253892+0000","last_peered":"2024-03-16T07:32:33.253892+0000","last_clean":"2024-03-16T07:32:33.253892+0000","last_became_active":"2024-03-16T07:32:32.265646+0000","last_became_peered":"2024-03-16T07:32:32.265646+0000","last_unstale":"2024-03-16T07:32:33.253892+0000","last_undegraded":"2024-03-16T07:32:33.253892+0000","last_fullsized":"2024-03-16T07:32:33.253892+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_clean_scrub_stamp":"2024-03-16T07:32:31.237650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:53:53.108260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.16","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.254948+0000","last_change":"2024-03-16T07:32:31.264431+0000","last_active":"2024-03-16T07:32:32.254948+0000","last_peered":"2024-03-16T07:32:32.254948+0000","last_clean":"2024-03-16T07:32:32.254948+0000","last_became_active":"2024-03-16T07:32:31.264194+0000","last_became_peered":"2024-03-16T07:32:31.264194+0000","last_unstale":"2024-03-16T07:32:32.254948+0000","last_undegraded":"2024-03-16T07:32:32.254948+0000","last_fullsized":"2024-03-16T07:32:32.254948+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:30.234218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:30.234218+0000","last_clean_scrub_stamp":"2024-03-16T07:32:30.234218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:17:08.494791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.15","version":"0'0","reported_seq":18,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.256279+0000","last_change":"2024-03-16T07:32:18.218886+0000","last_active":"2024-03-16T07:32:32.256279+0000","last_peered":"2024-03-16T07:32:32.256279+0000","last_clean":"2024-03-16T07:32:32.256279+0000","last_became_active":"2024-03-16T07:32:18.218602+0000","last_became_peered":"2024-03-16T07:32:18.218602+0000","last_unstale":"2024-03-16T07:32:32.256279+0000","last_undegraded":"2024-03-16T07:32:32.256279+0000","last_fullsized":"2024-03-16T07:32:32.256279+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:15:59.980959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.14","version":"142'8","reported_seq":28,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.251285+0000","last_change":"2024-03-16T07:32:17.228965+0000","last_active":"2024-03-16T07:32:32.251285+0000","last_peered":"2024-03-16T07:32:32.251285+0000","last_clean":"2024-03-16T07:32:32.251285+0000","last_became_active":"2024-03-16T07:32:17.228699+0000","last_became_peered":"2024-03-16T07:32:17.228699+0000","last_unstale":"2024-03-16T07:32:32.251285+0000","last_undegraded":"2024-03-16T07:32:32.251285+0000","last_fullsized":"2024-03-16T07:32:32.251285+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_clean_scrub_stamp":"2024-03-16T07:32:16.202808+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:21:38.597189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3309,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.10","version":"0'0","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-03-16T07:32:33.250989+0000","last_change":"2024-03-16T07:32:32.282230+0000","last_active":"2024-03-16T07:32:33.250989+0000","last_peered":"2024-03-16T07:32:33.250989+0000","last_clean":"2024-03-16T07:32:33.250989+0000","last_became_active":"2024-03-16T07:32:32.281902+0000","last_became_peered":"2024-03-16T07:32:32.281902+0000","last_unstale":"2024-03-16T07:32:33.250989+0000","last_undegraded":"2024-03-16T07:32:33.250989+0000","last_fullsized":"2024-03-16T07:32:33.250989+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_clean_scrub_stamp":"2024-03-16T07:32:31.237650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:14:52.522588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.11","version":"0'0","reported_seq":14,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-03-16T07:32:33.251079+0000","last_change":"2024-03-16T07:32:31.265535+0000","last_active":"2024-03-16T07:32:33.251079+0000","last_peered":"2024-03-16T07:32:33.251079+0000","last_clean":"2024-03-16T07:32:33.251079+0000","last_became_active":"2024-03-16T07:32:31.265266+0000","last_became_peered":"2024-03-16T07:32:31.265266+0000","last_unstale":"2024-03-16T07:32:33.251079+0000","last_undegraded":"2024-03-16T07:32:33.251079+0000","last_fullsized":"2024-03-16T07:32:33.251079+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:30.234218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:30.234218+0000","last_clean_scrub_stamp":"2024-03-16T07:32:30.234218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:51:13.744287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.12","version":"0'0","reported_seq":18,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.249540+0000","last_change":"2024-03-16T07:32:18.247568+0000","last_active":"2024-03-16T07:32:32.249540+0000","last_peered":"2024-03-16T07:32:32.249540+0000","last_clean":"2024-03-16T07:32:32.249540+0000","last_became_active":"2024-03-16T07:32:18.246899+0000","last_became_peered":"2024-03-16T07:32:18.246899+0000","last_unstale":"2024-03-16T07:32:32.249540+0000","last_undegraded":"2024-03-16T07:32:32.249540+0000","last_fullsized":"2024-03-16T07:32:32.249540+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:21:41.842380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.13","version":"141'2","reported_seq":22,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.263630+0000","last_change":"2024-03-16T07:32:17.232223+0000","last_active":"2024-03-16T07:32:32.263630+0000","last_peered":"2024-03-16T07:32:32.263630+0000","last_clean":"2024-03-16T07:32:32.263630+0000","last_became_active":"2024-03-16T07:32:17.231976+0000","last_became_peered":"2024-03-16T07:32:17.231976+0000","last_unstale":"2024-03-16T07:32:32.263630+0000","last_undegraded":"2024-03-16T07:32:32.263630+0000","last_fullsized":"2024-03-16T07:32:32.263630+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_clean_scrub_stamp":"2024-03-16T07:32:16.202808+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:45:50.377077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.11","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.275086+0000","last_change":"2024-03-16T07:32:32.274685+0000","last_active":"2024-03-16T07:32:32.275086+0000","last_peered":"2024-03-16T07:32:32.275086+0000","last_clean":"2024-03-16T07:32:32.275086+0000","last_became_active":"2024-03-16T07:32:32.273972+0000","last_became_peered":"2024-03-16T07:32:32.273972+0000","last_unstale":"2024-03-16T07:32:32.275086+0000","last_undegraded":"2024-03-16T07:32:32.275086+0000","last_fullsized":"2024-03-16T07:32:32.275086+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_clean_scrub_stamp":"2024-03-16T07:32:31.237650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:18:49.247054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.10","version":"145'8","reported_seq":22,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-03-16T07:32:33.251359+0000","last_change":"2024-03-16T07:32:31.265461+0000","last_active":"2024-03-16T07:32:33.251359+0000","last_peered":"2024-03-16T07:32:33.251359+0000","last_clean":"2024-03-16T07:32:33.251359+0000","last_became_active":"2024-03-16T07:32:31.265067+0000","last_became_peered":"2024-03-16T07:32:31.265067+0000","last_unstale":"2024-03-16T07:32:33.251359+0000","last_undegraded":"2024-03-16T07:32:33.251359+0000","last_fullsized":"2024-03-16T07:32:33.251359+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:30.234218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:30.234218+0000","last_clean_scrub_stamp":"2024-03-16T07:32:30.234218+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:30:34.008169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.13","version":"0'0","reported_seq":20,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-03-16T07:32:33.253371+0000","last_change":"2024-03-16T07:32:18.239778+0000","last_active":"2024-03-16T07:32:33.253371+0000","last_peered":"2024-03-16T07:32:33.253371+0000","last_clean":"2024-03-16T07:32:33.253371+0000","last_became_active":"2024-03-16T07:32:18.239495+0000","last_became_peered":"2024-03-16T07:32:18.239495+0000","last_unstale":"2024-03-16T07:32:33.253371+0000","last_undegraded":"2024-03-16T07:32:33.253371+0000","last_fullsized":"2024-03-16T07:32:33.253371+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:29:47.654447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":20,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.266705+0000","last_change":"2024-03-16T07:32:17.229415+0000","last_active":"2024-03-16T07:32:32.266705+0000","last_peered":"2024-03-16T07:32:32.266705+0000","last_clean":"2024-03-16T07:32:32.266705+0000","last_became_active":"2024-03-16T07:32:17.228693+0000","last_became_peered":"2024-03-16T07:32:17.228693+0000","last_unstale":"2024-03-16T07:32:32.266705+0000","last_undegraded":"2024-03-16T07:32:32.266705+0000","last_fullsized":"2024-03-16T07:32:32.266705+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_clean_scrub_stamp":"2024-03-16T07:32:16.202808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:43:02.024584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.12","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.284634+0000","last_change":"2024-03-16T07:32:32.280540+0000","last_active":"2024-03-16T07:32:32.284634+0000","last_peered":"2024-03-16T07:32:32.284634+0000","last_clean":"2024-03-16T07:32:32.284634+0000","last_became_active":"2024-03-16T07:32:32.280061+0000","last_became_peered":"2024-03-16T07:32:32.280061+0000","last_unstale":"2024-03-16T07:32:32.284634+0000","last_undegraded":"2024-03-16T07:32:32.284634+0000","last_fullsized":"2024-03-16T07:32:32.284634+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_clean_scrub_stamp":"2024-03-16T07:32:31.237650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:17:00.543982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.13","version":"145'2","reported_seq":16,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-03-16T07:32:33.252590+0000","last_change":"2024-03-16T07:32:31.267097+0000","last_active":"2024-03-16T07:32:33.252590+0000","last_peered":"2024-03-16T07:32:33.252590+0000","last_clean":"2024-03-16T07:32:33.252590+0000","last_became_active":"2024-03-16T07:32:31.266866+0000","last_became_peered":"2024-03-16T07:32:31.266866+0000","last_unstale":"2024-03-16T07:32:33.252590+0000","last_undegraded":"2024-03-16T07:32:33.252590+0000","last_fullsized":"2024-03-16T07:32:33.252590+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:30.234218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:30.234218+0000","last_clean_scrub_stamp":"2024-03-16T07:32:30.234218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:10:09.327894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.10","version":"0'0","reported_seq":18,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.266429+0000","last_change":"2024-03-16T07:32:18.234163+0000","last_active":"2024-03-16T07:32:32.266429+0000","last_peered":"2024-03-16T07:32:32.266429+0000","last_clean":"2024-03-16T07:32:32.266429+0000","last_became_active":"2024-03-16T07:32:18.233416+0000","last_became_peered":"2024-03-16T07:32:18.233416+0000","last_unstale":"2024-03-16T07:32:32.266429+0000","last_undegraded":"2024-03-16T07:32:32.266429+0000","last_fullsized":"2024-03-16T07:32:32.266429+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:48:39.058475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":20,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.260347+0000","last_change":"2024-03-16T07:32:17.231133+0000","last_active":"2024-03-16T07:32:32.260347+0000","last_peered":"2024-03-16T07:32:32.260347+0000","last_clean":"2024-03-16T07:32:32.260347+0000","last_became_active":"2024-03-16T07:32:17.230312+0000","last_became_peered":"2024-03-16T07:32:17.230312+0000","last_unstale":"2024-03-16T07:32:32.260347+0000","last_undegraded":"2024-03-16T07:32:32.260347+0000","last_fullsized":"2024-03-16T07:32:32.260347+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_clean_scrub_stamp":"2024-03-16T07:32:16.202808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:55:33.743467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.13","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.284580+0000","last_change":"2024-03-16T07:32:32.280289+0000","last_active":"2024-03-16T07:32:32.284580+0000","last_peered":"2024-03-16T07:32:32.284580+0000","last_clean":"2024-03-16T07:32:32.284580+0000","last_became_active":"2024-03-16T07:32:32.280007+0000","last_became_peered":"2024-03-16T07:32:32.280007+0000","last_unstale":"2024-03-16T07:32:32.284580+0000","last_undegraded":"2024-03-16T07:32:32.284580+0000","last_fullsized":"2024-03-16T07:32:32.284580+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_clean_scrub_stamp":"2024-03-16T07:32:31.237650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:59:51.121697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.12","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.264346+0000","last_change":"2024-03-16T07:32:31.268660+0000","last_active":"2024-03-16T07:32:32.264346+0000","last_peered":"2024-03-16T07:32:32.264346+0000","last_clean":"2024-03-16T07:32:32.264346+0000","last_became_active":"2024-03-16T07:32:31.268418+0000","last_became_peered":"2024-03-16T07:32:31.268418+0000","last_unstale":"2024-03-16T07:32:32.264346+0000","last_undegraded":"2024-03-16T07:32:32.264346+0000","last_fullsized":"2024-03-16T07:32:32.264346+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:30.234218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:30.234218+0000","last_clean_scrub_stamp":"2024-03-16T07:32:30.234218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:50:03.104056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.11","version":"0'0","reported_seq":18,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.260161+0000","last_change":"2024-03-16T07:32:18.232664+0000","last_active":"2024-03-16T07:32:32.260161+0000","last_peered":"2024-03-16T07:32:32.260161+0000","last_clean":"2024-03-16T07:32:32.260161+0000","last_became_active":"2024-03-16T07:32:18.232084+0000","last_became_peered":"2024-03-16T07:32:18.232084+0000","last_unstale":"2024-03-16T07:32:32.260161+0000","last_undegraded":"2024-03-16T07:32:32.260161+0000","last_fullsized":"2024-03-16T07:32:32.260161+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:05:26.371341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.10","version":"141'8","reported_seq":30,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-03-16T07:32:33.251903+0000","last_change":"2024-03-16T07:32:17.225860+0000","last_active":"2024-03-16T07:32:33.251903+0000","last_peered":"2024-03-16T07:32:33.251903+0000","last_clean":"2024-03-16T07:32:33.251903+0000","last_became_active":"2024-03-16T07:32:17.225589+0000","last_became_peered":"2024-03-16T07:32:17.225589+0000","last_unstale":"2024-03-16T07:32:33.251903+0000","last_undegraded":"2024-03-16T07:32:33.251903+0000","last_fullsized":"2024-03-16T07:32:33.251903+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_clean_scrub_stamp":"2024-03-16T07:32:16.202808+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:41:14.963665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.c","version":"0'0","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-03-16T07:32:33.252422+0000","last_change":"2024-03-16T07:32:32.266203+0000","last_active":"2024-03-16T07:32:33.252422+0000","last_peered":"2024-03-16T07:32:33.252422+0000","last_clean":"2024-03-16T07:32:33.252422+0000","last_became_active":"2024-03-16T07:32:32.265944+0000","last_became_peered":"2024-03-16T07:32:32.265944+0000","last_unstale":"2024-03-16T07:32:33.252422+0000","last_undegraded":"2024-03-16T07:32:33.252422+0000","last_fullsized":"2024-03-16T07:32:33.252422+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_clean_scrub_stamp":"2024-03-16T07:32:31.237650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:05:40.404967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.d","version":"145'1","reported_seq":15,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-03-16T07:32:33.252925+0000","last_change":"2024-03-16T07:32:31.264052+0000","last_active":"2024-03-16T07:32:33.252925+0000","last_peered":"2024-03-16T07:32:33.252925+0000","last_clean":"2024-03-16T07:32:33.252925+0000","last_became_active":"2024-03-16T07:32:31.263832+0000","last_became_peered":"2024-03-16T07:32:31.263832+0000","last_unstale":"2024-03-16T07:32:33.252925+0000","last_undegraded":"2024-03-16T07:32:33.252925+0000","last_fullsized":"2024-03-16T07:32:33.252925+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:30.234218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:30.234218+0000","last_clean_scrub_stamp":"2024-03-16T07:32:30.234218+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:36:40.700848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.e","version":"0'0","reported_seq":18,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.267437+0000","last_change":"2024-03-16T07:32:18.226029+0000","last_active":"2024-03-16T07:32:32.267437+0000","last_peered":"2024-03-16T07:32:32.267437+0000","last_clean":"2024-03-16T07:32:32.267437+0000","last_became_active":"2024-03-16T07:32:18.225788+0000","last_became_peered":"2024-03-16T07:32:18.225788+0000","last_unstale":"2024-03-16T07:32:32.267437+0000","last_undegraded":"2024-03-16T07:32:32.267437+0000","last_fullsized":"2024-03-16T07:32:32.267437+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:48:50.739716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.f","version":"141'1","reported_seq":23,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-03-16T07:32:33.254399+0000","last_change":"2024-03-16T07:32:17.223445+0000","last_active":"2024-03-16T07:32:33.254399+0000","last_peered":"2024-03-16T07:32:33.254399+0000","last_clean":"2024-03-16T07:32:33.254399+0000","last_became_active":"2024-03-16T07:32:17.222651+0000","last_became_peered":"2024-03-16T07:32:17.222651+0000","last_unstale":"2024-03-16T07:32:33.254399+0000","last_undegraded":"2024-03-16T07:32:33.254399+0000","last_fullsized":"2024-03-16T07:32:33.254399+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_clean_scrub_stamp":"2024-03-16T07:32:16.202808+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:12:48.104487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.d","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.275439+0000","last_change":"2024-03-16T07:32:32.275029+0000","last_active":"2024-03-16T07:32:32.275439+0000","last_peered":"2024-03-16T07:32:32.275439+0000","last_clean":"2024-03-16T07:32:32.275439+0000","last_became_active":"2024-03-16T07:32:32.274715+0000","last_became_peered":"2024-03-16T07:32:32.274715+0000","last_unstale":"2024-03-16T07:32:32.275439+0000","last_undegraded":"2024-03-16T07:32:32.275439+0000","last_fullsized":"2024-03-16T07:32:32.275439+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_clean_scrub_stamp":"2024-03-16T07:32:31.237650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:31:12.717700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.c","version":"0'0","reported_seq":14,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-03-16T07:32:33.252659+0000","last_change":"2024-03-16T07:32:31.265671+0000","last_active":"2024-03-16T07:32:33.252659+0000","last_peered":"2024-03-16T07:32:33.252659+0000","last_clean":"2024-03-16T07:32:33.252659+0000","last_became_active":"2024-03-16T07:32:31.265417+0000","last_became_peered":"2024-03-16T07:32:31.265417+0000","last_unstale":"2024-03-16T07:32:33.252659+0000","last_undegraded":"2024-03-16T07:32:33.252659+0000","last_fullsized":"2024-03-16T07:32:33.252659+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:30.234218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:30.234218+0000","last_clean_scrub_stamp":"2024-03-16T07:32:30.234218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:18:48.056632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.f","version":"0'0","reported_seq":18,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.260566+0000","last_change":"2024-03-16T07:32:18.242423+0000","last_active":"2024-03-16T07:32:32.260566+0000","last_peered":"2024-03-16T07:32:32.260566+0000","last_clean":"2024-03-16T07:32:32.260566+0000","last_became_active":"2024-03-16T07:32:18.241803+0000","last_became_peered":"2024-03-16T07:32:18.241803+0000","last_unstale":"2024-03-16T07:32:32.260566+0000","last_undegraded":"2024-03-16T07:32:32.260566+0000","last_fullsized":"2024-03-16T07:32:32.260566+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:07:30.219856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.e","version":"141'2","reported_seq":22,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.255724+0000","last_change":"2024-03-16T07:32:17.231123+0000","last_active":"2024-03-16T07:32:32.255724+0000","last_peered":"2024-03-16T07:32:32.255724+0000","last_clean":"2024-03-16T07:32:32.255724+0000","last_became_active":"2024-03-16T07:32:17.230808+0000","last_became_peered":"2024-03-16T07:32:17.230808+0000","last_unstale":"2024-03-16T07:32:32.255724+0000","last_undegraded":"2024-03-16T07:32:32.255724+0000","last_fullsized":"2024-03-16T07:32:32.255724+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_clean_scrub_stamp":"2024-03-16T07:32:16.202808+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:59:19.582457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.e","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.289856+0000","last_change":"2024-03-16T07:32:32.289228+0000","last_active":"2024-03-16T07:32:32.289856+0000","last_peered":"2024-03-16T07:32:32.289856+0000","last_clean":"2024-03-16T07:32:32.289856+0000","last_became_active":"2024-03-16T07:32:32.288143+0000","last_became_peered":"2024-03-16T07:32:32.288143+0000","last_unstale":"2024-03-16T07:32:32.289856+0000","last_undegraded":"2024-03-16T07:32:32.289856+0000","last_fullsized":"2024-03-16T07:32:32.289856+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_clean_scrub_stamp":"2024-03-16T07:32:31.237650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:45:24.129110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.f","version":"145'1","reported_seq":13,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.269851+0000","last_change":"2024-03-16T07:32:31.261808+0000","last_active":"2024-03-16T07:32:32.269851+0000","last_peered":"2024-03-16T07:32:32.269851+0000","last_clean":"2024-03-16T07:32:32.269851+0000","last_became_active":"2024-03-16T07:32:31.261560+0000","last_became_peered":"2024-03-16T07:32:31.261560+0000","last_unstale":"2024-03-16T07:32:32.269851+0000","last_undegraded":"2024-03-16T07:32:32.269851+0000","last_fullsized":"2024-03-16T07:32:32.269851+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:30.234218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:30.234218+0000","last_clean_scrub_stamp":"2024-03-16T07:32:30.234218+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:14:25.061483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.c","version":"0'0","reported_seq":18,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.251108+0000","last_change":"2024-03-16T07:32:18.248350+0000","last_active":"2024-03-16T07:32:32.251108+0000","last_peered":"2024-03-16T07:32:32.251108+0000","last_clean":"2024-03-16T07:32:32.251108+0000","last_became_active":"2024-03-16T07:32:18.247340+0000","last_became_peered":"2024-03-16T07:32:18.247340+0000","last_unstale":"2024-03-16T07:32:32.251108+0000","last_undegraded":"2024-03-16T07:32:32.251108+0000","last_fullsized":"2024-03-16T07:32:32.251108+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:23:00.374407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.d","version":"141'1","reported_seq":21,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.256470+0000","last_change":"2024-03-16T07:32:17.229616+0000","last_active":"2024-03-16T07:32:32.256470+0000","last_peered":"2024-03-16T07:32:32.256470+0000","last_clean":"2024-03-16T07:32:32.256470+0000","last_became_active":"2024-03-16T07:32:17.229279+0000","last_became_peered":"2024-03-16T07:32:17.229279+0000","last_unstale":"2024-03-16T07:32:32.256470+0000","last_undegraded":"2024-03-16T07:32:32.256470+0000","last_fullsized":"2024-03-16T07:32:32.256470+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_clean_scrub_stamp":"2024-03-16T07:32:16.202808+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:14:11.030073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.f","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.278739+0000","last_change":"2024-03-16T07:32:32.277258+0000","last_active":"2024-03-16T07:32:32.278739+0000","last_peered":"2024-03-16T07:32:32.278739+0000","last_clean":"2024-03-16T07:32:32.278739+0000","last_became_active":"2024-03-16T07:32:32.276989+0000","last_became_peered":"2024-03-16T07:32:32.276989+0000","last_unstale":"2024-03-16T07:32:32.278739+0000","last_undegraded":"2024-03-16T07:32:32.278739+0000","last_fullsized":"2024-03-16T07:32:32.278739+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_clean_scrub_stamp":"2024-03-16T07:32:31.237650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:59:55.430384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.e","version":"145'2","reported_seq":16,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-03-16T07:32:33.253718+0000","last_change":"2024-03-16T07:32:31.263636+0000","last_active":"2024-03-16T07:32:33.253718+0000","last_peered":"2024-03-16T07:32:33.253718+0000","last_clean":"2024-03-16T07:32:33.253718+0000","last_became_active":"2024-03-16T07:32:31.263340+0000","last_became_peered":"2024-03-16T07:32:31.263340+0000","last_unstale":"2024-03-16T07:32:33.253718+0000","last_undegraded":"2024-03-16T07:32:33.253718+0000","last_fullsized":"2024-03-16T07:32:33.253718+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:30.234218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:30.234218+0000","last_clean_scrub_stamp":"2024-03-16T07:32:30.234218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:09:52.516299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.d","version":"0'0","reported_seq":18,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.256318+0000","last_change":"2024-03-16T07:32:18.217887+0000","last_active":"2024-03-16T07:32:32.256318+0000","last_peered":"2024-03-16T07:32:32.256318+0000","last_clean":"2024-03-16T07:32:32.256318+0000","last_became_active":"2024-03-16T07:32:18.217641+0000","last_became_peered":"2024-03-16T07:32:18.217641+0000","last_unstale":"2024-03-16T07:32:32.256318+0000","last_undegraded":"2024-03-16T07:32:32.256318+0000","last_fullsized":"2024-03-16T07:32:32.256318+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:53:39.074634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":20,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.256634+0000","last_change":"2024-03-16T07:32:17.234400+0000","last_active":"2024-03-16T07:32:32.256634+0000","last_peered":"2024-03-16T07:32:32.256634+0000","last_clean":"2024-03-16T07:32:32.256634+0000","last_became_active":"2024-03-16T07:32:17.234140+0000","last_became_peered":"2024-03-16T07:32:17.234140+0000","last_unstale":"2024-03-16T07:32:32.256634+0000","last_undegraded":"2024-03-16T07:32:32.256634+0000","last_fullsized":"2024-03-16T07:32:32.256634+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_clean_scrub_stamp":"2024-03-16T07:32:16.202808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:30:19.976759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.8","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.273248+0000","last_change":"2024-03-16T07:32:32.270595+0000","last_active":"2024-03-16T07:32:32.273248+0000","last_peered":"2024-03-16T07:32:32.273248+0000","last_clean":"2024-03-16T07:32:32.273248+0000","last_became_active":"2024-03-16T07:32:32.269246+0000","last_became_peered":"2024-03-16T07:32:32.269246+0000","last_unstale":"2024-03-16T07:32:32.273248+0000","last_undegraded":"2024-03-16T07:32:32.273248+0000","last_fullsized":"2024-03-16T07:32:32.273248+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_clean_scrub_stamp":"2024-03-16T07:32:31.237650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:28:02.616503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.9","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.256486+0000","last_change":"2024-03-16T07:32:31.268108+0000","last_active":"2024-03-16T07:32:32.256486+0000","last_peered":"2024-03-16T07:32:32.256486+0000","last_clean":"2024-03-16T07:32:32.256486+0000","last_became_active":"2024-03-16T07:32:31.267874+0000","last_became_peered":"2024-03-16T07:32:31.267874+0000","last_unstale":"2024-03-16T07:32:32.256486+0000","last_undegraded":"2024-03-16T07:32:32.256486+0000","last_fullsized":"2024-03-16T07:32:32.256486+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:30.234218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:30.234218+0000","last_clean_scrub_stamp":"2024-03-16T07:32:30.234218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:16:06.545909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.a","version":"0'0","reported_seq":18,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.266620+0000","last_change":"2024-03-16T07:32:18.224341+0000","last_active":"2024-03-16T07:32:32.266620+0000","last_peered":"2024-03-16T07:32:32.266620+0000","last_clean":"2024-03-16T07:32:32.266620+0000","last_became_active":"2024-03-16T07:32:18.223713+0000","last_became_peered":"2024-03-16T07:32:18.223713+0000","last_unstale":"2024-03-16T07:32:32.266620+0000","last_undegraded":"2024-03-16T07:32:32.266620+0000","last_fullsized":"2024-03-16T07:32:32.266620+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:07:48.374395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.b","version":"141'2","reported_seq":22,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.252140+0000","last_change":"2024-03-16T07:32:17.232593+0000","last_active":"2024-03-16T07:32:32.252140+0000","last_peered":"2024-03-16T07:32:32.252140+0000","last_clean":"2024-03-16T07:32:32.252140+0000","last_became_active":"2024-03-16T07:32:17.232337+0000","last_became_peered":"2024-03-16T07:32:17.232337+0000","last_unstale":"2024-03-16T07:32:32.252140+0000","last_undegraded":"2024-03-16T07:32:32.252140+0000","last_fullsized":"2024-03-16T07:32:32.252140+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_clean_scrub_stamp":"2024-03-16T07:32:16.202808+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:29:00.632805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.9","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.284557+0000","last_change":"2024-03-16T07:32:32.281004+0000","last_active":"2024-03-16T07:32:32.284557+0000","last_peered":"2024-03-16T07:32:32.284557+0000","last_clean":"2024-03-16T07:32:32.284557+0000","last_became_active":"2024-03-16T07:32:32.280748+0000","last_became_peered":"2024-03-16T07:32:32.280748+0000","last_unstale":"2024-03-16T07:32:32.284557+0000","last_undegraded":"2024-03-16T07:32:32.284557+0000","last_fullsized":"2024-03-16T07:32:32.284557+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_clean_scrub_stamp":"2024-03-16T07:32:31.237650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:12:01.377193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.8","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.257097+0000","last_change":"2024-03-16T07:32:31.256093+0000","last_active":"2024-03-16T07:32:32.257097+0000","last_peered":"2024-03-16T07:32:32.257097+0000","last_clean":"2024-03-16T07:32:32.257097+0000","last_became_active":"2024-03-16T07:32:31.255831+0000","last_became_peered":"2024-03-16T07:32:31.255831+0000","last_unstale":"2024-03-16T07:32:32.257097+0000","last_undegraded":"2024-03-16T07:32:32.257097+0000","last_fullsized":"2024-03-16T07:32:32.257097+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:30.234218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:30.234218+0000","last_clean_scrub_stamp":"2024-03-16T07:32:30.234218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:22:18.349029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.b","version":"0'0","reported_seq":20,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-03-16T07:32:33.253470+0000","last_change":"2024-03-16T07:32:18.240156+0000","last_active":"2024-03-16T07:32:33.253470+0000","last_peered":"2024-03-16T07:32:33.253470+0000","last_clean":"2024-03-16T07:32:33.253470+0000","last_became_active":"2024-03-16T07:32:18.239925+0000","last_became_peered":"2024-03-16T07:32:18.239925+0000","last_unstale":"2024-03-16T07:32:33.253470+0000","last_undegraded":"2024-03-16T07:32:33.253470+0000","last_fullsized":"2024-03-16T07:32:33.253470+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:18:49.338437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":22,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-03-16T07:32:33.251909+0000","last_change":"2024-03-16T07:32:17.227713+0000","last_active":"2024-03-16T07:32:33.251909+0000","last_peered":"2024-03-16T07:32:33.251909+0000","last_clean":"2024-03-16T07:32:33.251909+0000","last_became_active":"2024-03-16T07:32:17.227251+0000","last_became_peered":"2024-03-16T07:32:17.227251+0000","last_unstale":"2024-03-16T07:32:33.251909+0000","last_undegraded":"2024-03-16T07:32:33.251909+0000","last_fullsized":"2024-03-16T07:32:33.251909+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_clean_scrub_stamp":"2024-03-16T07:32:16.202808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:07:04.797749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.a","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.284597+0000","last_change":"2024-03-16T07:32:32.280319+0000","last_active":"2024-03-16T07:32:32.284597+0000","last_peered":"2024-03-16T07:32:32.284597+0000","last_clean":"2024-03-16T07:32:32.284597+0000","last_became_active":"2024-03-16T07:32:32.279654+0000","last_became_peered":"2024-03-16T07:32:32.279654+0000","last_unstale":"2024-03-16T07:32:32.284597+0000","last_undegraded":"2024-03-16T07:32:32.284597+0000","last_fullsized":"2024-03-16T07:32:32.284597+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_clean_scrub_stamp":"2024-03-16T07:32:31.237650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:49:10.373286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.b","version":"145'2","reported_seq":14,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.289755+0000","last_change":"2024-03-16T07:32:31.268842+0000","last_active":"2024-03-16T07:32:32.289755+0000","last_peered":"2024-03-16T07:32:32.289755+0000","last_clean":"2024-03-16T07:32:32.289755+0000","last_became_active":"2024-03-16T07:32:31.268625+0000","last_became_peered":"2024-03-16T07:32:31.268625+0000","last_unstale":"2024-03-16T07:32:32.289755+0000","last_undegraded":"2024-03-16T07:32:32.289755+0000","last_fullsized":"2024-03-16T07:32:32.289755+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:30.234218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:30.234218+0000","last_clean_scrub_stamp":"2024-03-16T07:32:30.234218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:44:13.780054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.8","version":"0'0","reported_seq":18,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.266519+0000","last_change":"2024-03-16T07:32:18.225698+0000","last_active":"2024-03-16T07:32:32.266519+0000","last_peered":"2024-03-16T07:32:32.266519+0000","last_clean":"2024-03-16T07:32:32.266519+0000","last_became_active":"2024-03-16T07:32:18.223573+0000","last_became_peered":"2024-03-16T07:32:18.223573+0000","last_unstale":"2024-03-16T07:32:32.266519+0000","last_undegraded":"2024-03-16T07:32:32.266519+0000","last_fullsized":"2024-03-16T07:32:32.266519+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:19:55.939779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":20,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.250285+0000","last_change":"2024-03-16T07:32:17.233204+0000","last_active":"2024-03-16T07:32:32.250285+0000","last_peered":"2024-03-16T07:32:32.250285+0000","last_clean":"2024-03-16T07:32:32.250285+0000","last_became_active":"2024-03-16T07:32:17.232939+0000","last_became_peered":"2024-03-16T07:32:17.232939+0000","last_unstale":"2024-03-16T07:32:32.250285+0000","last_undegraded":"2024-03-16T07:32:32.250285+0000","last_fullsized":"2024-03-16T07:32:32.250285+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_clean_scrub_stamp":"2024-03-16T07:32:16.202808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:22:20.381122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.b","version":"0'0","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-03-16T07:32:33.253124+0000","last_change":"2024-03-16T07:32:32.262011+0000","last_active":"2024-03-16T07:32:33.253124+0000","last_peered":"2024-03-16T07:32:33.253124+0000","last_clean":"2024-03-16T07:32:33.253124+0000","last_became_active":"2024-03-16T07:32:32.261781+0000","last_became_peered":"2024-03-16T07:32:32.261781+0000","last_unstale":"2024-03-16T07:32:33.253124+0000","last_undegraded":"2024-03-16T07:32:33.253124+0000","last_fullsized":"2024-03-16T07:32:33.253124+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_clean_scrub_stamp":"2024-03-16T07:32:31.237650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:43:50.077878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.a","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.267304+0000","last_change":"2024-03-16T07:32:31.268460+0000","last_active":"2024-03-16T07:32:32.267304+0000","last_peered":"2024-03-16T07:32:32.267304+0000","last_clean":"2024-03-16T07:32:32.267304+0000","last_became_active":"2024-03-16T07:32:31.268022+0000","last_became_peered":"2024-03-16T07:32:31.268022+0000","last_unstale":"2024-03-16T07:32:32.267304+0000","last_undegraded":"2024-03-16T07:32:32.267304+0000","last_fullsized":"2024-03-16T07:32:32.267304+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:30.234218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:30.234218+0000","last_clean_scrub_stamp":"2024-03-16T07:32:30.234218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:13:43.596119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.9","version":"0'0","reported_seq":20,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-03-16T07:32:33.251794+0000","last_change":"2024-03-16T07:32:18.238541+0000","last_active":"2024-03-16T07:32:33.251794+0000","last_peered":"2024-03-16T07:32:33.251794+0000","last_clean":"2024-03-16T07:32:33.251794+0000","last_became_active":"2024-03-16T07:32:18.238016+0000","last_became_peered":"2024-03-16T07:32:18.238016+0000","last_unstale":"2024-03-16T07:32:33.251794+0000","last_undegraded":"2024-03-16T07:32:33.251794+0000","last_fullsized":"2024-03-16T07:32:33.251794+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:22:34.169555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":22,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-03-16T07:32:33.252003+0000","last_change":"2024-03-16T07:32:17.227872+0000","last_active":"2024-03-16T07:32:33.252003+0000","last_peered":"2024-03-16T07:32:33.252003+0000","last_clean":"2024-03-16T07:32:33.252003+0000","last_became_active":"2024-03-16T07:32:17.227600+0000","last_became_peered":"2024-03-16T07:32:17.227600+0000","last_unstale":"2024-03-16T07:32:33.252003+0000","last_undegraded":"2024-03-16T07:32:33.252003+0000","last_fullsized":"2024-03-16T07:32:33.252003+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_clean_scrub_stamp":"2024-03-16T07:32:16.202808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:56:01.743830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.4","version":"0'0","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-03-16T07:32:33.253143+0000","last_change":"2024-03-16T07:32:32.265999+0000","last_active":"2024-03-16T07:32:33.253143+0000","last_peered":"2024-03-16T07:32:33.253143+0000","last_clean":"2024-03-16T07:32:33.253143+0000","last_became_active":"2024-03-16T07:32:32.265623+0000","last_became_peered":"2024-03-16T07:32:32.265623+0000","last_unstale":"2024-03-16T07:32:33.253143+0000","last_undegraded":"2024-03-16T07:32:33.253143+0000","last_fullsized":"2024-03-16T07:32:33.253143+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_clean_scrub_stamp":"2024-03-16T07:32:31.237650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:16:14.014584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.5","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.251036+0000","last_change":"2024-03-16T07:32:31.260799+0000","last_active":"2024-03-16T07:32:32.251036+0000","last_peered":"2024-03-16T07:32:32.251036+0000","last_clean":"2024-03-16T07:32:32.251036+0000","last_became_active":"2024-03-16T07:32:31.260168+0000","last_became_peered":"2024-03-16T07:32:31.260168+0000","last_unstale":"2024-03-16T07:32:32.251036+0000","last_undegraded":"2024-03-16T07:32:32.251036+0000","last_fullsized":"2024-03-16T07:32:32.251036+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:30.234218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:30.234218+0000","last_clean_scrub_stamp":"2024-03-16T07:32:30.234218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:46:04.408487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.6","version":"0'0","reported_seq":20,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-03-16T07:32:33.253933+0000","last_change":"2024-03-16T07:32:18.233930+0000","last_active":"2024-03-16T07:32:33.253933+0000","last_peered":"2024-03-16T07:32:33.253933+0000","last_clean":"2024-03-16T07:32:33.253933+0000","last_became_active":"2024-03-16T07:32:18.233008+0000","last_became_peered":"2024-03-16T07:32:18.233008+0000","last_unstale":"2024-03-16T07:32:33.253933+0000","last_undegraded":"2024-03-16T07:32:33.253933+0000","last_fullsized":"2024-03-16T07:32:33.253933+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:23:38.116248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.7","version":"141'2","reported_seq":22,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.260923+0000","last_change":"2024-03-16T07:32:17.228514+0000","last_active":"2024-03-16T07:32:32.260923+0000","last_peered":"2024-03-16T07:32:32.260923+0000","last_clean":"2024-03-16T07:32:32.260923+0000","last_became_active":"2024-03-16T07:32:17.228200+0000","last_became_peered":"2024-03-16T07:32:17.228200+0000","last_unstale":"2024-03-16T07:32:32.260923+0000","last_undegraded":"2024-03-16T07:32:32.260923+0000","last_fullsized":"2024-03-16T07:32:32.260923+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_clean_scrub_stamp":"2024-03-16T07:32:16.202808+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:50:35.506990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.5","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.274926+0000","last_change":"2024-03-16T07:32:32.274602+0000","last_active":"2024-03-16T07:32:32.274926+0000","last_peered":"2024-03-16T07:32:32.274926+0000","last_clean":"2024-03-16T07:32:32.274926+0000","last_became_active":"2024-03-16T07:32:32.272654+0000","last_became_peered":"2024-03-16T07:32:32.272654+0000","last_unstale":"2024-03-16T07:32:32.274926+0000","last_undegraded":"2024-03-16T07:32:32.274926+0000","last_fullsized":"2024-03-16T07:32:32.274926+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_clean_scrub_stamp":"2024-03-16T07:32:31.237650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:15:57.124592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.4","version":"0'0","reported_seq":14,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-03-16T07:32:33.252749+0000","last_change":"2024-03-16T07:32:31.266746+0000","last_active":"2024-03-16T07:32:33.252749+0000","last_peered":"2024-03-16T07:32:33.252749+0000","last_clean":"2024-03-16T07:32:33.252749+0000","last_became_active":"2024-03-16T07:32:31.266527+0000","last_became_peered":"2024-03-16T07:32:31.266527+0000","last_unstale":"2024-03-16T07:32:33.252749+0000","last_undegraded":"2024-03-16T07:32:33.252749+0000","last_fullsized":"2024-03-16T07:32:33.252749+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:30.234218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:30.234218+0000","last_clean_scrub_stamp":"2024-03-16T07:32:30.234218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:55:41.715691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.7","version":"0'0","reported_seq":18,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.260659+0000","last_change":"2024-03-16T07:32:18.242678+0000","last_active":"2024-03-16T07:32:32.260659+0000","last_peered":"2024-03-16T07:32:32.260659+0000","last_clean":"2024-03-16T07:32:32.260659+0000","last_became_active":"2024-03-16T07:32:18.242069+0000","last_became_peered":"2024-03-16T07:32:18.242069+0000","last_unstale":"2024-03-16T07:32:32.260659+0000","last_undegraded":"2024-03-16T07:32:32.260659+0000","last_fullsized":"2024-03-16T07:32:32.260659+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:47:32.797133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.6","version":"142'1","reported_seq":21,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.267594+0000","last_change":"2024-03-16T07:32:17.231485+0000","last_active":"2024-03-16T07:32:32.267594+0000","last_peered":"2024-03-16T07:32:32.267594+0000","last_clean":"2024-03-16T07:32:32.267594+0000","last_became_active":"2024-03-16T07:32:17.231153+0000","last_became_peered":"2024-03-16T07:32:17.231153+0000","last_unstale":"2024-03-16T07:32:32.267594+0000","last_undegraded":"2024-03-16T07:32:32.267594+0000","last_fullsized":"2024-03-16T07:32:32.267594+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_clean_scrub_stamp":"2024-03-16T07:32:16.202808+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:55:27.684281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.6","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.288814+0000","last_change":"2024-03-16T07:32:32.285858+0000","last_active":"2024-03-16T07:32:32.288814+0000","last_peered":"2024-03-16T07:32:32.288814+0000","last_clean":"2024-03-16T07:32:32.288814+0000","last_became_active":"2024-03-16T07:32:32.285617+0000","last_became_peered":"2024-03-16T07:32:32.285617+0000","last_unstale":"2024-03-16T07:32:32.288814+0000","last_undegraded":"2024-03-16T07:32:32.288814+0000","last_fullsized":"2024-03-16T07:32:32.288814+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_clean_scrub_stamp":"2024-03-16T07:32:31.237650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:09:50.831688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.7","version":"145'2","reported_seq":16,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-03-16T07:32:33.254007+0000","last_change":"2024-03-16T07:32:31.263908+0000","last_active":"2024-03-16T07:32:33.254007+0000","last_peered":"2024-03-16T07:32:33.254007+0000","last_clean":"2024-03-16T07:32:33.254007+0000","last_became_active":"2024-03-16T07:32:31.263371+0000","last_became_peered":"2024-03-16T07:32:31.263371+0000","last_unstale":"2024-03-16T07:32:33.254007+0000","last_undegraded":"2024-03-16T07:32:33.254007+0000","last_fullsized":"2024-03-16T07:32:33.254007+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:30.234218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:30.234218+0000","last_clean_scrub_stamp":"2024-03-16T07:32:30.234218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:19:52.362383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.4","version":"0'0","reported_seq":18,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.251197+0000","last_change":"2024-03-16T07:32:18.248158+0000","last_active":"2024-03-16T07:32:32.251197+0000","last_peered":"2024-03-16T07:32:32.251197+0000","last_clean":"2024-03-16T07:32:32.251197+0000","last_became_active":"2024-03-16T07:32:18.246868+0000","last_became_peered":"2024-03-16T07:32:18.246868+0000","last_unstale":"2024-03-16T07:32:32.251197+0000","last_undegraded":"2024-03-16T07:32:32.251197+0000","last_fullsized":"2024-03-16T07:32:32.251197+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:47:18.145134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":20,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.256563+0000","last_change":"2024-03-16T07:32:17.231473+0000","last_active":"2024-03-16T07:32:32.256563+0000","last_peered":"2024-03-16T07:32:32.256563+0000","last_clean":"2024-03-16T07:32:32.256563+0000","last_became_active":"2024-03-16T07:32:17.231194+0000","last_became_peered":"2024-03-16T07:32:17.231194+0000","last_unstale":"2024-03-16T07:32:32.256563+0000","last_undegraded":"2024-03-16T07:32:32.256563+0000","last_fullsized":"2024-03-16T07:32:32.256563+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_clean_scrub_stamp":"2024-03-16T07:32:16.202808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:16:54.463382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.7","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.287513+0000","last_change":"2024-03-16T07:32:32.286065+0000","last_active":"2024-03-16T07:32:32.287513+0000","last_peered":"2024-03-16T07:32:32.287513+0000","last_clean":"2024-03-16T07:32:32.287513+0000","last_became_active":"2024-03-16T07:32:32.285817+0000","last_became_peered":"2024-03-16T07:32:32.285817+0000","last_unstale":"2024-03-16T07:32:32.287513+0000","last_undegraded":"2024-03-16T07:32:32.287513+0000","last_fullsized":"2024-03-16T07:32:32.287513+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_clean_scrub_stamp":"2024-03-16T07:32:31.237650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:55:59.569803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.6","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.255088+0000","last_change":"2024-03-16T07:32:31.258036+0000","last_active":"2024-03-16T07:32:32.255088+0000","last_peered":"2024-03-16T07:32:32.255088+0000","last_clean":"2024-03-16T07:32:32.255088+0000","last_became_active":"2024-03-16T07:32:31.257788+0000","last_became_peered":"2024-03-16T07:32:31.257788+0000","last_unstale":"2024-03-16T07:32:32.255088+0000","last_undegraded":"2024-03-16T07:32:32.255088+0000","last_fullsized":"2024-03-16T07:32:32.255088+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:30.234218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:30.234218+0000","last_clean_scrub_stamp":"2024-03-16T07:32:30.234218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:03:47.115503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.5","version":"0'0","reported_seq":18,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.251282+0000","last_change":"2024-03-16T07:32:18.249281+0000","last_active":"2024-03-16T07:32:32.251282+0000","last_peered":"2024-03-16T07:32:32.251282+0000","last_clean":"2024-03-16T07:32:32.251282+0000","last_became_active":"2024-03-16T07:32:18.248490+0000","last_became_peered":"2024-03-16T07:32:18.248490+0000","last_unstale":"2024-03-16T07:32:32.251282+0000","last_undegraded":"2024-03-16T07:32:32.251282+0000","last_fullsized":"2024-03-16T07:32:32.251282+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:37:27.058282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":20,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.256721+0000","last_change":"2024-03-16T07:32:17.235245+0000","last_active":"2024-03-16T07:32:32.256721+0000","last_peered":"2024-03-16T07:32:32.256721+0000","last_clean":"2024-03-16T07:32:32.256721+0000","last_became_active":"2024-03-16T07:32:17.234881+0000","last_became_peered":"2024-03-16T07:32:17.234881+0000","last_unstale":"2024-03-16T07:32:32.256721+0000","last_undegraded":"2024-03-16T07:32:32.256721+0000","last_fullsized":"2024-03-16T07:32:32.256721+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_clean_scrub_stamp":"2024-03-16T07:32:16.202808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:22:04.317619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.0","version":"0'0","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-03-16T07:32:33.251136+0000","last_change":"2024-03-16T07:32:32.282233+0000","last_active":"2024-03-16T07:32:33.251136+0000","last_peered":"2024-03-16T07:32:33.251136+0000","last_clean":"2024-03-16T07:32:33.251136+0000","last_became_active":"2024-03-16T07:32:32.281754+0000","last_became_peered":"2024-03-16T07:32:32.281754+0000","last_unstale":"2024-03-16T07:32:33.251136+0000","last_undegraded":"2024-03-16T07:32:33.251136+0000","last_fullsized":"2024-03-16T07:32:33.251136+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_clean_scrub_stamp":"2024-03-16T07:32:31.237650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:48:53.092100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.1","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.259866+0000","last_change":"2024-03-16T07:32:31.268019+0000","last_active":"2024-03-16T07:32:32.259866+0000","last_peered":"2024-03-16T07:32:32.259866+0000","last_clean":"2024-03-16T07:32:32.259866+0000","last_became_active":"2024-03-16T07:32:31.267745+0000","last_became_peered":"2024-03-16T07:32:31.267745+0000","last_unstale":"2024-03-16T07:32:32.259866+0000","last_undegraded":"2024-03-16T07:32:32.259866+0000","last_fullsized":"2024-03-16T07:32:32.259866+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:30.234218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:30.234218+0000","last_clean_scrub_stamp":"2024-03-16T07:32:30.234218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:17:22.947350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.2","version":"0'0","reported_seq":18,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.249631+0000","last_change":"2024-03-16T07:32:18.247940+0000","last_active":"2024-03-16T07:32:32.249631+0000","last_peered":"2024-03-16T07:32:32.249631+0000","last_clean":"2024-03-16T07:32:32.249631+0000","last_became_active":"2024-03-16T07:32:18.247584+0000","last_became_peered":"2024-03-16T07:32:18.247584+0000","last_unstale":"2024-03-16T07:32:32.249631+0000","last_undegraded":"2024-03-16T07:32:32.249631+0000","last_fullsized":"2024-03-16T07:32:32.249631+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:54:41.949813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":20,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.252236+0000","last_change":"2024-03-16T07:32:17.226266+0000","last_active":"2024-03-16T07:32:32.252236+0000","last_peered":"2024-03-16T07:32:32.252236+0000","last_clean":"2024-03-16T07:32:32.252236+0000","last_became_active":"2024-03-16T07:32:17.226014+0000","last_became_peered":"2024-03-16T07:32:17.226014+0000","last_unstale":"2024-03-16T07:32:32.252236+0000","last_undegraded":"2024-03-16T07:32:32.252236+0000","last_fullsized":"2024-03-16T07:32:32.252236+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_clean_scrub_stamp":"2024-03-16T07:32:16.202808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:23:58.730547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.1","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.279071+0000","last_change":"2024-03-16T07:32:32.278595+0000","last_active":"2024-03-16T07:32:32.279071+0000","last_peered":"2024-03-16T07:32:32.279071+0000","last_clean":"2024-03-16T07:32:32.279071+0000","last_became_active":"2024-03-16T07:32:32.278350+0000","last_became_peered":"2024-03-16T07:32:32.278350+0000","last_unstale":"2024-03-16T07:32:32.279071+0000","last_undegraded":"2024-03-16T07:32:32.279071+0000","last_fullsized":"2024-03-16T07:32:32.279071+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_clean_scrub_stamp":"2024-03-16T07:32:31.237650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:15:46.593815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.0","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.257240+0000","last_change":"2024-03-16T07:32:31.264512+0000","last_active":"2024-03-16T07:32:32.257240+0000","last_peered":"2024-03-16T07:32:32.257240+0000","last_clean":"2024-03-16T07:32:32.257240+0000","last_became_active":"2024-03-16T07:32:31.264003+0000","last_became_peered":"2024-03-16T07:32:31.264003+0000","last_unstale":"2024-03-16T07:32:32.257240+0000","last_undegraded":"2024-03-16T07:32:32.257240+0000","last_fullsized":"2024-03-16T07:32:32.257240+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:30.234218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:30.234218+0000","last_clean_scrub_stamp":"2024-03-16T07:32:30.234218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:18:48.056632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.3","version":"0'0","reported_seq":20,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-03-16T07:32:33.253527+0000","last_change":"2024-03-16T07:32:18.239059+0000","last_active":"2024-03-16T07:32:33.253527+0000","last_peered":"2024-03-16T07:32:33.253527+0000","last_clean":"2024-03-16T07:32:33.253527+0000","last_became_active":"2024-03-16T07:32:18.237797+0000","last_became_peered":"2024-03-16T07:32:18.237797+0000","last_unstale":"2024-03-16T07:32:33.253527+0000","last_undegraded":"2024-03-16T07:32:33.253527+0000","last_fullsized":"2024-03-16T07:32:33.253527+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:56:48.810836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":20,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.249845+0000","last_change":"2024-03-16T07:32:17.231212+0000","last_active":"2024-03-16T07:32:32.249845+0000","last_peered":"2024-03-16T07:32:32.249845+0000","last_clean":"2024-03-16T07:32:32.249845+0000","last_became_active":"2024-03-16T07:32:17.230958+0000","last_became_peered":"2024-03-16T07:32:17.230958+0000","last_unstale":"2024-03-16T07:32:32.249845+0000","last_undegraded":"2024-03-16T07:32:32.249845+0000","last_fullsized":"2024-03-16T07:32:32.249845+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_clean_scrub_stamp":"2024-03-16T07:32:16.202808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:03:51.994607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.2","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.284843+0000","last_change":"2024-03-16T07:32:32.275564+0000","last_active":"2024-03-16T07:32:32.284843+0000","last_peered":"2024-03-16T07:32:32.284843+0000","last_clean":"2024-03-16T07:32:32.284843+0000","last_became_active":"2024-03-16T07:32:32.275288+0000","last_became_peered":"2024-03-16T07:32:32.275288+0000","last_unstale":"2024-03-16T07:32:32.284843+0000","last_undegraded":"2024-03-16T07:32:32.284843+0000","last_fullsized":"2024-03-16T07:32:32.284843+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_clean_scrub_stamp":"2024-03-16T07:32:31.237650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:54:55.605740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.3","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.251535+0000","last_change":"2024-03-16T07:32:31.253806+0000","last_active":"2024-03-16T07:32:32.251535+0000","last_peered":"2024-03-16T07:32:32.251535+0000","last_clean":"2024-03-16T07:32:32.251535+0000","last_became_active":"2024-03-16T07:32:31.253507+0000","last_became_peered":"2024-03-16T07:32:31.253507+0000","last_unstale":"2024-03-16T07:32:32.251535+0000","last_undegraded":"2024-03-16T07:32:32.251535+0000","last_fullsized":"2024-03-16T07:32:32.251535+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:30.234218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:30.234218+0000","last_clean_scrub_stamp":"2024-03-16T07:32:30.234218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:50:49.538400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.0","version":"0'0","reported_seq":18,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.257545+0000","last_change":"2024-03-16T07:32:18.244971+0000","last_active":"2024-03-16T07:32:32.257545+0000","last_peered":"2024-03-16T07:32:32.257545+0000","last_clean":"2024-03-16T07:32:32.257545+0000","last_became_active":"2024-03-16T07:32:18.244256+0000","last_became_peered":"2024-03-16T07:32:18.244256+0000","last_unstale":"2024-03-16T07:32:32.257545+0000","last_undegraded":"2024-03-16T07:32:32.257545+0000","last_fullsized":"2024-03-16T07:32:32.257545+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:12:49.105703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":20,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.250394+0000","last_change":"2024-03-16T07:32:17.233190+0000","last_active":"2024-03-16T07:32:32.250394+0000","last_peered":"2024-03-16T07:32:32.250394+0000","last_clean":"2024-03-16T07:32:32.250394+0000","last_became_active":"2024-03-16T07:32:17.232917+0000","last_became_peered":"2024-03-16T07:32:17.232917+0000","last_unstale":"2024-03-16T07:32:32.250394+0000","last_undegraded":"2024-03-16T07:32:32.250394+0000","last_fullsized":"2024-03-16T07:32:32.250394+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_clean_scrub_stamp":"2024-03-16T07:32:16.202808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:31:01.279190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.3","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.278815+0000","last_change":"2024-03-16T07:32:32.278013+0000","last_active":"2024-03-16T07:32:32.278815+0000","last_peered":"2024-03-16T07:32:32.278815+0000","last_clean":"2024-03-16T07:32:32.278815+0000","last_became_active":"2024-03-16T07:32:32.277770+0000","last_became_peered":"2024-03-16T07:32:32.277770+0000","last_unstale":"2024-03-16T07:32:32.278815+0000","last_undegraded":"2024-03-16T07:32:32.278815+0000","last_fullsized":"2024-03-16T07:32:32.278815+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_clean_scrub_stamp":"2024-03-16T07:32:31.237650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:35:19.514886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.2","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.249317+0000","last_change":"2024-03-16T07:32:31.259348+0000","last_active":"2024-03-16T07:32:32.249317+0000","last_peered":"2024-03-16T07:32:32.249317+0000","last_clean":"2024-03-16T07:32:32.249317+0000","last_became_active":"2024-03-16T07:32:31.259086+0000","last_became_peered":"2024-03-16T07:32:31.259086+0000","last_unstale":"2024-03-16T07:32:32.249317+0000","last_undegraded":"2024-03-16T07:32:32.249317+0000","last_fullsized":"2024-03-16T07:32:32.249317+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:30.234218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:30.234218+0000","last_clean_scrub_stamp":"2024-03-16T07:32:30.234218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:55:21.238125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1","version":"0'0","reported_seq":20,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-03-16T07:32:33.251889+0000","last_change":"2024-03-16T07:32:18.238398+0000","last_active":"2024-03-16T07:32:33.251889+0000","last_peered":"2024-03-16T07:32:33.251889+0000","last_clean":"2024-03-16T07:32:33.251889+0000","last_became_active":"2024-03-16T07:32:18.237807+0000","last_became_peered":"2024-03-16T07:32:18.237807+0000","last_unstale":"2024-03-16T07:32:33.251889+0000","last_undegraded":"2024-03-16T07:32:33.251889+0000","last_fullsized":"2024-03-16T07:32:33.251889+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:29:43.283549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":20,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.257723+0000","last_change":"2024-03-16T07:32:17.233414+0000","last_active":"2024-03-16T07:32:32.257723+0000","last_peered":"2024-03-16T07:32:32.257723+0000","last_clean":"2024-03-16T07:32:32.257723+0000","last_became_active":"2024-03-16T07:32:17.233153+0000","last_became_peered":"2024-03-16T07:32:17.233153+0000","last_unstale":"2024-03-16T07:32:32.257723+0000","last_undegraded":"2024-03-16T07:32:32.257723+0000","last_fullsized":"2024-03-16T07:32:32.257723+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_clean_scrub_stamp":"2024-03-16T07:32:16.202808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:06:54.148824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.1a","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.273560+0000","last_change":"2024-03-16T07:32:32.271483+0000","last_active":"2024-03-16T07:32:32.273560+0000","last_peered":"2024-03-16T07:32:32.273560+0000","last_clean":"2024-03-16T07:32:32.273560+0000","last_became_active":"2024-03-16T07:32:32.271244+0000","last_became_peered":"2024-03-16T07:32:32.271244+0000","last_unstale":"2024-03-16T07:32:32.273560+0000","last_undegraded":"2024-03-16T07:32:32.273560+0000","last_fullsized":"2024-03-16T07:32:32.273560+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_clean_scrub_stamp":"2024-03-16T07:32:31.237650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:01:22.947696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.1b","version":"145'1","reported_seq":13,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.269991+0000","last_change":"2024-03-16T07:32:31.261168+0000","last_active":"2024-03-16T07:32:32.269991+0000","last_peered":"2024-03-16T07:32:32.269991+0000","last_clean":"2024-03-16T07:32:32.269991+0000","last_became_active":"2024-03-16T07:32:31.260562+0000","last_became_peered":"2024-03-16T07:32:31.260562+0000","last_unstale":"2024-03-16T07:32:32.269991+0000","last_undegraded":"2024-03-16T07:32:32.269991+0000","last_fullsized":"2024-03-16T07:32:32.269991+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:30.234218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:30.234218+0000","last_clean_scrub_stamp":"2024-03-16T07:32:30.234218+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:43:16.055994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.18","version":"0'0","reported_seq":18,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.267586+0000","last_change":"2024-03-16T07:32:18.218918+0000","last_active":"2024-03-16T07:32:32.267586+0000","last_peered":"2024-03-16T07:32:32.267586+0000","last_clean":"2024-03-16T07:32:32.267586+0000","last_became_active":"2024-03-16T07:32:18.218148+0000","last_became_peered":"2024-03-16T07:32:18.218148+0000","last_unstale":"2024-03-16T07:32:32.267586+0000","last_undegraded":"2024-03-16T07:32:32.267586+0000","last_fullsized":"2024-03-16T07:32:32.267586+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:06:13.762192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":20,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.260254+0000","last_change":"2024-03-16T07:32:17.230782+0000","last_active":"2024-03-16T07:32:32.260254+0000","last_peered":"2024-03-16T07:32:32.260254+0000","last_clean":"2024-03-16T07:32:32.260254+0000","last_became_active":"2024-03-16T07:32:17.229981+0000","last_became_peered":"2024-03-16T07:32:17.229981+0000","last_unstale":"2024-03-16T07:32:32.260254+0000","last_undegraded":"2024-03-16T07:32:32.260254+0000","last_fullsized":"2024-03-16T07:32:32.260254+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_clean_scrub_stamp":"2024-03-16T07:32:16.202808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:02:31.073119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"126'196","reported_seq":739,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.257845+0000","last_change":"2024-03-16T07:24:31.650537+0000","last_active":"2024-03-16T07:32:32.257845+0000","last_peered":"2024-03-16T07:32:32.257845+0000","last_clean":"2024-03-16T07:32:32.257845+0000","last_became_active":"2024-03-16T07:24:31.649574+0000","last_became_peered":"2024-03-16T07:24:31.649574+0000","last_unstale":"2024-03-16T07:32:32.257845+0000","last_undegraded":"2024-03-16T07:32:32.257845+0000","last_fullsized":"2024-03-16T07:32:32.257845+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:29.719970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:29.719970+0000","last_clean_scrub_stamp":"2024-03-16T07:24:29.719970+0000","objects_scrubbed":0,"log_size":196,"log_dups_size":0,"ondisk_log_size":196,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:31:35.774554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":970,"num_read_kb":1945,"num_write":317,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":26,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":3},{"poolid":25,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":24,"num_pg":32,"stat_sum":{"num_bytes":4107,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":8214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":3},{"poolid":27,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":970,"num_read_kb":1945,"num_write":317,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738462,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":36856,"kb_used_data":1508,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":104820744,"statfs":{"total":107374182400,"available":107336441856,"internally_reserved":0,"allocated":1544192,"data_stored":617580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738462,"num_pgs":107,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":37420,"kb_used_data":2076,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":104820180,"statfs":{"total":107374182400,"available":107335864320,"internally_reserved":0,"allocated":2125824,"data_stored":1205138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738462,"num_pgs":136,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":37416,"kb_used_data":2072,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":104820184,"statfs":{"total":107374182400,"available":107335868416,"internally_reserved":0,"allocated":2121728,"data_stored":1204746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":4107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-16T07:32:36.303 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-16T07:32:36.688 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:32:36.691 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2024-03-16T07:32:36.695 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":44,"stamp":"2024-03-16T07:32:34.825552+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596885,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":970,"num_read_kb":1945,"num_write":408,"num_write_kb":1925,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":275,"ondisk_log_size":275,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":316,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":314572800,"kb_used":111692,"kb_used_data":5656,"kb_used_omap":4,"kb_used_meta":105979,"kb_avail":314461108,"statfs":{"total":322122547200,"available":322008174592,"internally_reserved":0,"allocated":5791744,"data_stored":3027464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":108522831},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.587838"},"pg_stats":[{"pgid":"27.3d","version":"0'0","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-03-16T07:32:33.252761+0000","last_change":"2024-03-16T07:32:32.265428+0000","last_active":"2024-03-16T07:32:33.252761+0000","last_peered":"2024-03-16T07:32:33.252761+0000","last_clean":"2024-03-16T07:32:33.252761+0000","last_became_active":"2024-03-16T07:32:32.265011+0000","last_became_peered":"2024-03-16T07:32:32.265011+0000","last_unstale":"2024-03-16T07:32:33.252761+0000","last_undegraded":"2024-03-16T07:32:33.252761+0000","last_fullsized":"2024-03-16T07:32:33.252761+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_clean_scrub_stamp":"2024-03-16T07:32:31.237650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:06:27.795818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.3f","version":"0'0","reported_seq":18,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.254495+0000","last_change":"2024-03-16T07:32:18.247962+0000","last_active":"2024-03-16T07:32:32.254495+0000","last_peered":"2024-03-16T07:32:32.254495+0000","last_clean":"2024-03-16T07:32:32.254495+0000","last_became_active":"2024-03-16T07:32:18.247621+0000","last_became_peered":"2024-03-16T07:32:18.247621+0000","last_unstale":"2024-03-16T07:32:32.254495+0000","last_undegraded":"2024-03-16T07:32:32.254495+0000","last_fullsized":"2024-03-16T07:32:32.254495+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:08:10.533094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.3c","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.267833+0000","last_change":"2024-03-16T07:32:32.263178+0000","last_active":"2024-03-16T07:32:32.267833+0000","last_peered":"2024-03-16T07:32:32.267833+0000","last_clean":"2024-03-16T07:32:32.267833+0000","last_became_active":"2024-03-16T07:32:32.261328+0000","last_became_peered":"2024-03-16T07:32:32.261328+0000","last_unstale":"2024-03-16T07:32:32.267833+0000","last_undegraded":"2024-03-16T07:32:32.267833+0000","last_fullsized":"2024-03-16T07:32:32.267833+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_clean_scrub_stamp":"2024-03-16T07:32:31.237650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:36:41.704280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.3e","version":"0'0","reported_seq":18,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.255429+0000","last_change":"2024-03-16T07:32:18.246415+0000","last_active":"2024-03-16T07:32:32.255429+0000","last_peered":"2024-03-16T07:32:32.255429+0000","last_clean":"2024-03-16T07:32:32.255429+0000","last_became_active":"2024-03-16T07:32:18.246171+0000","last_became_peered":"2024-03-16T07:32:18.246171+0000","last_unstale":"2024-03-16T07:32:32.255429+0000","last_undegraded":"2024-03-16T07:32:32.255429+0000","last_fullsized":"2024-03-16T07:32:32.255429+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:45:07.587766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.3f","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.284912+0000","last_change":"2024-03-16T07:32:32.276789+0000","last_active":"2024-03-16T07:32:32.284912+0000","last_peered":"2024-03-16T07:32:32.284912+0000","last_clean":"2024-03-16T07:32:32.284912+0000","last_became_active":"2024-03-16T07:32:32.275579+0000","last_became_peered":"2024-03-16T07:32:32.275579+0000","last_unstale":"2024-03-16T07:32:32.284912+0000","last_undegraded":"2024-03-16T07:32:32.284912+0000","last_fullsized":"2024-03-16T07:32:32.284912+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_clean_scrub_stamp":"2024-03-16T07:32:31.237650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:49:16.588043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.3d","version":"0'0","reported_seq":18,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.250831+0000","last_change":"2024-03-16T07:32:18.243582+0000","last_active":"2024-03-16T07:32:32.250831+0000","last_peered":"2024-03-16T07:32:32.250831+0000","last_clean":"2024-03-16T07:32:32.250831+0000","last_became_active":"2024-03-16T07:32:18.243189+0000","last_became_peered":"2024-03-16T07:32:18.243189+0000","last_unstale":"2024-03-16T07:32:32.250831+0000","last_undegraded":"2024-03-16T07:32:32.250831+0000","last_fullsized":"2024-03-16T07:32:32.250831+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:03:26.209534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.3e","version":"0'0","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-03-16T07:32:33.253428+0000","last_change":"2024-03-16T07:32:32.281211+0000","last_active":"2024-03-16T07:32:33.253428+0000","last_peered":"2024-03-16T07:32:33.253428+0000","last_clean":"2024-03-16T07:32:33.253428+0000","last_became_active":"2024-03-16T07:32:32.280951+0000","last_became_peered":"2024-03-16T07:32:32.280951+0000","last_unstale":"2024-03-16T07:32:33.253428+0000","last_undegraded":"2024-03-16T07:32:33.253428+0000","last_fullsized":"2024-03-16T07:32:33.253428+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_clean_scrub_stamp":"2024-03-16T07:32:31.237650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:12:12.874649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.3c","version":"0'0","reported_seq":18,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.250920+0000","last_change":"2024-03-16T07:32:18.245554+0000","last_active":"2024-03-16T07:32:32.250920+0000","last_peered":"2024-03-16T07:32:32.250920+0000","last_clean":"2024-03-16T07:32:32.250920+0000","last_became_active":"2024-03-16T07:32:18.245016+0000","last_became_peered":"2024-03-16T07:32:18.245016+0000","last_unstale":"2024-03-16T07:32:32.250920+0000","last_undegraded":"2024-03-16T07:32:32.250920+0000","last_fullsized":"2024-03-16T07:32:32.250920+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:59:39.662853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.39","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.286052+0000","last_change":"2024-03-16T07:32:32.278551+0000","last_active":"2024-03-16T07:32:32.286052+0000","last_peered":"2024-03-16T07:32:32.286052+0000","last_clean":"2024-03-16T07:32:32.286052+0000","last_became_active":"2024-03-16T07:32:32.275414+0000","last_became_peered":"2024-03-16T07:32:32.275414+0000","last_unstale":"2024-03-16T07:32:32.286052+0000","last_undegraded":"2024-03-16T07:32:32.286052+0000","last_fullsized":"2024-03-16T07:32:32.286052+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_clean_scrub_stamp":"2024-03-16T07:32:31.237650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:23:19.424033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.3b","version":"0'0","reported_seq":20,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-03-16T07:32:33.252981+0000","last_change":"2024-03-16T07:32:18.235990+0000","last_active":"2024-03-16T07:32:33.252981+0000","last_peered":"2024-03-16T07:32:33.252981+0000","last_clean":"2024-03-16T07:32:33.252981+0000","last_became_active":"2024-03-16T07:32:18.235735+0000","last_became_peered":"2024-03-16T07:32:18.235735+0000","last_unstale":"2024-03-16T07:32:33.252981+0000","last_undegraded":"2024-03-16T07:32:33.252981+0000","last_fullsized":"2024-03-16T07:32:33.252981+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:23:21.663692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.38","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.284654+0000","last_change":"2024-03-16T07:32:32.281691+0000","last_active":"2024-03-16T07:32:32.284654+0000","last_peered":"2024-03-16T07:32:32.284654+0000","last_clean":"2024-03-16T07:32:32.284654+0000","last_became_active":"2024-03-16T07:32:32.281302+0000","last_became_peered":"2024-03-16T07:32:32.281302+0000","last_unstale":"2024-03-16T07:32:32.284654+0000","last_undegraded":"2024-03-16T07:32:32.284654+0000","last_fullsized":"2024-03-16T07:32:32.284654+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_clean_scrub_stamp":"2024-03-16T07:32:31.237650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:56:33.218427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.3a","version":"0'0","reported_seq":18,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.249364+0000","last_change":"2024-03-16T07:32:18.243404+0000","last_active":"2024-03-16T07:32:32.249364+0000","last_peered":"2024-03-16T07:32:32.249364+0000","last_clean":"2024-03-16T07:32:32.249364+0000","last_became_active":"2024-03-16T07:32:18.243142+0000","last_became_peered":"2024-03-16T07:32:18.243142+0000","last_unstale":"2024-03-16T07:32:32.249364+0000","last_undegraded":"2024-03-16T07:32:32.249364+0000","last_fullsized":"2024-03-16T07:32:32.249364+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:38:11.159687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.3b","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.284700+0000","last_change":"2024-03-16T07:32:32.282487+0000","last_active":"2024-03-16T07:32:32.284700+0000","last_peered":"2024-03-16T07:32:32.284700+0000","last_clean":"2024-03-16T07:32:32.284700+0000","last_became_active":"2024-03-16T07:32:32.281245+0000","last_became_peered":"2024-03-16T07:32:32.281245+0000","last_unstale":"2024-03-16T07:32:32.284700+0000","last_undegraded":"2024-03-16T07:32:32.284700+0000","last_fullsized":"2024-03-16T07:32:32.284700+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_clean_scrub_stamp":"2024-03-16T07:32:31.237650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:25:35.551462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.39","version":"0'0","reported_seq":20,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-03-16T07:32:33.251307+0000","last_change":"2024-03-16T07:32:18.240139+0000","last_active":"2024-03-16T07:32:33.251307+0000","last_peered":"2024-03-16T07:32:33.251307+0000","last_clean":"2024-03-16T07:32:33.251307+0000","last_became_active":"2024-03-16T07:32:18.238310+0000","last_became_peered":"2024-03-16T07:32:18.238310+0000","last_unstale":"2024-03-16T07:32:33.251307+0000","last_undegraded":"2024-03-16T07:32:33.251307+0000","last_fullsized":"2024-03-16T07:32:33.251307+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:48:26.150691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.3a","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.263194+0000","last_change":"2024-03-16T07:32:32.257930+0000","last_active":"2024-03-16T07:32:32.263194+0000","last_peered":"2024-03-16T07:32:32.263194+0000","last_clean":"2024-03-16T07:32:32.263194+0000","last_became_active":"2024-03-16T07:32:32.257679+0000","last_became_peered":"2024-03-16T07:32:32.257679+0000","last_unstale":"2024-03-16T07:32:32.263194+0000","last_undegraded":"2024-03-16T07:32:32.263194+0000","last_fullsized":"2024-03-16T07:32:32.263194+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_clean_scrub_stamp":"2024-03-16T07:32:31.237650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:55:42.719123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.38","version":"0'0","reported_seq":18,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.257452+0000","last_change":"2024-03-16T07:32:18.245507+0000","last_active":"2024-03-16T07:32:32.257452+0000","last_peered":"2024-03-16T07:32:32.257452+0000","last_clean":"2024-03-16T07:32:32.257452+0000","last_became_active":"2024-03-16T07:32:18.245260+0000","last_became_peered":"2024-03-16T07:32:18.245260+0000","last_unstale":"2024-03-16T07:32:32.257452+0000","last_undegraded":"2024-03-16T07:32:32.257452+0000","last_fullsized":"2024-03-16T07:32:32.257452+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:03:50.228942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.35","version":"0'0","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-03-16T07:32:33.252774+0000","last_change":"2024-03-16T07:32:32.265239+0000","last_active":"2024-03-16T07:32:33.252774+0000","last_peered":"2024-03-16T07:32:33.252774+0000","last_clean":"2024-03-16T07:32:33.252774+0000","last_became_active":"2024-03-16T07:32:32.264685+0000","last_became_peered":"2024-03-16T07:32:32.264685+0000","last_unstale":"2024-03-16T07:32:33.252774+0000","last_undegraded":"2024-03-16T07:32:33.252774+0000","last_fullsized":"2024-03-16T07:32:33.252774+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_clean_scrub_stamp":"2024-03-16T07:32:31.237650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:28:51.886419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.37","version":"0'0","reported_seq":18,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.254584+0000","last_change":"2024-03-16T07:32:18.247274+0000","last_active":"2024-03-16T07:32:32.254584+0000","last_peered":"2024-03-16T07:32:32.254584+0000","last_clean":"2024-03-16T07:32:32.254584+0000","last_became_active":"2024-03-16T07:32:18.247021+0000","last_became_peered":"2024-03-16T07:32:18.247021+0000","last_unstale":"2024-03-16T07:32:32.254584+0000","last_undegraded":"2024-03-16T07:32:32.254584+0000","last_fullsized":"2024-03-16T07:32:32.254584+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:21:44.428460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.34","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.285073+0000","last_change":"2024-03-16T07:32:32.279247+0000","last_active":"2024-03-16T07:32:32.285073+0000","last_peered":"2024-03-16T07:32:32.285073+0000","last_clean":"2024-03-16T07:32:32.285073+0000","last_became_active":"2024-03-16T07:32:32.278709+0000","last_became_peered":"2024-03-16T07:32:32.278709+0000","last_unstale":"2024-03-16T07:32:32.285073+0000","last_undegraded":"2024-03-16T07:32:32.285073+0000","last_fullsized":"2024-03-16T07:32:32.285073+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_clean_scrub_stamp":"2024-03-16T07:32:31.237650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:12:31.983454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.36","version":"0'0","reported_seq":18,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.267335+0000","last_change":"2024-03-16T07:32:18.239231+0000","last_active":"2024-03-16T07:32:32.267335+0000","last_peered":"2024-03-16T07:32:32.267335+0000","last_clean":"2024-03-16T07:32:32.267335+0000","last_became_active":"2024-03-16T07:32:18.238947+0000","last_became_peered":"2024-03-16T07:32:18.238947+0000","last_unstale":"2024-03-16T07:32:32.267335+0000","last_undegraded":"2024-03-16T07:32:32.267335+0000","last_fullsized":"2024-03-16T07:32:32.267335+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:50:21.074348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.37","version":"0'0","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-03-16T07:32:33.254214+0000","last_change":"2024-03-16T07:32:32.266498+0000","last_active":"2024-03-16T07:32:33.254214+0000","last_peered":"2024-03-16T07:32:33.254214+0000","last_clean":"2024-03-16T07:32:33.254214+0000","last_became_active":"2024-03-16T07:32:32.266248+0000","last_became_peered":"2024-03-16T07:32:32.266248+0000","last_unstale":"2024-03-16T07:32:33.254214+0000","last_undegraded":"2024-03-16T07:32:33.254214+0000","last_fullsized":"2024-03-16T07:32:33.254214+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_clean_scrub_stamp":"2024-03-16T07:32:31.237650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:07:44.253482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.35","version":"0'0","reported_seq":20,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-03-16T07:32:33.253197+0000","last_change":"2024-03-16T07:32:18.237180+0000","last_active":"2024-03-16T07:32:33.253197+0000","last_peered":"2024-03-16T07:32:33.253197+0000","last_clean":"2024-03-16T07:32:33.253197+0000","last_became_active":"2024-03-16T07:32:18.236919+0000","last_became_peered":"2024-03-16T07:32:18.236919+0000","last_unstale":"2024-03-16T07:32:33.253197+0000","last_undegraded":"2024-03-16T07:32:33.253197+0000","last_fullsized":"2024-03-16T07:32:33.253197+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:57:24.911547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.36","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.289898+0000","last_change":"2024-03-16T07:32:32.289338+0000","last_active":"2024-03-16T07:32:32.289898+0000","last_peered":"2024-03-16T07:32:32.289898+0000","last_clean":"2024-03-16T07:32:32.289898+0000","last_became_active":"2024-03-16T07:32:32.288993+0000","last_became_peered":"2024-03-16T07:32:32.288993+0000","last_unstale":"2024-03-16T07:32:32.289898+0000","last_undegraded":"2024-03-16T07:32:32.289898+0000","last_fullsized":"2024-03-16T07:32:32.289898+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_clean_scrub_stamp":"2024-03-16T07:32:31.237650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:44:21.268108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.34","version":"0'0","reported_seq":18,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.256279+0000","last_change":"2024-03-16T07:32:18.241361+0000","last_active":"2024-03-16T07:32:32.256279+0000","last_peered":"2024-03-16T07:32:32.256279+0000","last_clean":"2024-03-16T07:32:32.256279+0000","last_became_active":"2024-03-16T07:32:18.240963+0000","last_became_peered":"2024-03-16T07:32:18.240963+0000","last_unstale":"2024-03-16T07:32:32.256279+0000","last_undegraded":"2024-03-16T07:32:32.256279+0000","last_fullsized":"2024-03-16T07:32:32.256279+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:39:23.980376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.31","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.275342+0000","last_change":"2024-03-16T07:32:32.274867+0000","last_active":"2024-03-16T07:32:32.275342+0000","last_peered":"2024-03-16T07:32:32.275342+0000","last_clean":"2024-03-16T07:32:32.275342+0000","last_became_active":"2024-03-16T07:32:32.274114+0000","last_became_peered":"2024-03-16T07:32:32.274114+0000","last_unstale":"2024-03-16T07:32:32.275342+0000","last_undegraded":"2024-03-16T07:32:32.275342+0000","last_fullsized":"2024-03-16T07:32:32.275342+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_clean_scrub_stamp":"2024-03-16T07:32:31.237650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:52:18.397174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.33","version":"0'0","reported_seq":18,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.252045+0000","last_change":"2024-03-16T07:32:18.244631+0000","last_active":"2024-03-16T07:32:32.252045+0000","last_peered":"2024-03-16T07:32:32.252045+0000","last_clean":"2024-03-16T07:32:32.252045+0000","last_became_active":"2024-03-16T07:32:18.244350+0000","last_became_peered":"2024-03-16T07:32:18.244350+0000","last_unstale":"2024-03-16T07:32:32.252045+0000","last_undegraded":"2024-03-16T07:32:32.252045+0000","last_fullsized":"2024-03-16T07:32:32.252045+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:46:56.524556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.30","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.273269+0000","last_change":"2024-03-16T07:32:32.270883+0000","last_active":"2024-03-16T07:32:32.273269+0000","last_peered":"2024-03-16T07:32:32.273269+0000","last_clean":"2024-03-16T07:32:32.273269+0000","last_became_active":"2024-03-16T07:32:32.270630+0000","last_became_peered":"2024-03-16T07:32:32.270630+0000","last_unstale":"2024-03-16T07:32:32.273269+0000","last_undegraded":"2024-03-16T07:32:32.273269+0000","last_fullsized":"2024-03-16T07:32:32.273269+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_clean_scrub_stamp":"2024-03-16T07:32:31.237650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:18:16.143393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.32","version":"0'0","reported_seq":18,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.249453+0000","last_change":"2024-03-16T07:32:18.247797+0000","last_active":"2024-03-16T07:32:32.249453+0000","last_peered":"2024-03-16T07:32:32.249453+0000","last_clean":"2024-03-16T07:32:32.249453+0000","last_became_active":"2024-03-16T07:32:18.247260+0000","last_became_peered":"2024-03-16T07:32:18.247260+0000","last_unstale":"2024-03-16T07:32:32.249453+0000","last_undegraded":"2024-03-16T07:32:32.249453+0000","last_fullsized":"2024-03-16T07:32:32.249453+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:50:06.050581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.33","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.284719+0000","last_change":"2024-03-16T07:32:32.282683+0000","last_active":"2024-03-16T07:32:32.284719+0000","last_peered":"2024-03-16T07:32:32.284719+0000","last_clean":"2024-03-16T07:32:32.284719+0000","last_became_active":"2024-03-16T07:32:32.282249+0000","last_became_peered":"2024-03-16T07:32:32.282249+0000","last_unstale":"2024-03-16T07:32:32.284719+0000","last_undegraded":"2024-03-16T07:32:32.284719+0000","last_fullsized":"2024-03-16T07:32:32.284719+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_clean_scrub_stamp":"2024-03-16T07:32:31.237650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:25:41.803751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.31","version":"0'0","reported_seq":18,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.260062+0000","last_change":"2024-03-16T07:32:18.233233+0000","last_active":"2024-03-16T07:32:32.260062+0000","last_peered":"2024-03-16T07:32:32.260062+0000","last_clean":"2024-03-16T07:32:32.260062+0000","last_became_active":"2024-03-16T07:32:18.232417+0000","last_became_peered":"2024-03-16T07:32:18.232417+0000","last_unstale":"2024-03-16T07:32:32.260062+0000","last_undegraded":"2024-03-16T07:32:32.260062+0000","last_fullsized":"2024-03-16T07:32:32.260062+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:59:16.749516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.32","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.288178+0000","last_change":"2024-03-16T07:32:32.287225+0000","last_active":"2024-03-16T07:32:32.288178+0000","last_peered":"2024-03-16T07:32:32.288178+0000","last_clean":"2024-03-16T07:32:32.288178+0000","last_became_active":"2024-03-16T07:32:32.286951+0000","last_became_peered":"2024-03-16T07:32:32.286951+0000","last_unstale":"2024-03-16T07:32:32.288178+0000","last_undegraded":"2024-03-16T07:32:32.288178+0000","last_fullsized":"2024-03-16T07:32:32.288178+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_clean_scrub_stamp":"2024-03-16T07:32:31.237650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:49:26.553174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.30","version":"0'0","reported_seq":20,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-03-16T07:32:33.251634+0000","last_change":"2024-03-16T07:32:18.225150+0000","last_active":"2024-03-16T07:32:33.251634+0000","last_peered":"2024-03-16T07:32:33.251634+0000","last_clean":"2024-03-16T07:32:33.251634+0000","last_became_active":"2024-03-16T07:32:18.224307+0000","last_became_peered":"2024-03-16T07:32:18.224307+0000","last_unstale":"2024-03-16T07:32:33.251634+0000","last_undegraded":"2024-03-16T07:32:33.251634+0000","last_fullsized":"2024-03-16T07:32:33.251634+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:47:18.145134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.2d","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.284640+0000","last_change":"2024-03-16T07:32:32.283732+0000","last_active":"2024-03-16T07:32:32.284640+0000","last_peered":"2024-03-16T07:32:32.284640+0000","last_clean":"2024-03-16T07:32:32.284640+0000","last_became_active":"2024-03-16T07:32:32.283280+0000","last_became_peered":"2024-03-16T07:32:32.283280+0000","last_unstale":"2024-03-16T07:32:32.284640+0000","last_undegraded":"2024-03-16T07:32:32.284640+0000","last_fullsized":"2024-03-16T07:32:32.284640+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_clean_scrub_stamp":"2024-03-16T07:32:31.237650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:14:52.522588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.2f","version":"0'0","reported_seq":20,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-03-16T07:32:33.254227+0000","last_change":"2024-03-16T07:32:18.248997+0000","last_active":"2024-03-16T07:32:33.254227+0000","last_peered":"2024-03-16T07:32:33.254227+0000","last_clean":"2024-03-16T07:32:33.254227+0000","last_became_active":"2024-03-16T07:32:18.248743+0000","last_became_peered":"2024-03-16T07:32:18.248743+0000","last_unstale":"2024-03-16T07:32:33.254227+0000","last_undegraded":"2024-03-16T07:32:33.254227+0000","last_fullsized":"2024-03-16T07:32:33.254227+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:34:24.065048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.2c","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.279101+0000","last_change":"2024-03-16T07:32:32.278021+0000","last_active":"2024-03-16T07:32:32.279101+0000","last_peered":"2024-03-16T07:32:32.279101+0000","last_clean":"2024-03-16T07:32:32.279101+0000","last_became_active":"2024-03-16T07:32:32.277755+0000","last_became_peered":"2024-03-16T07:32:32.277755+0000","last_unstale":"2024-03-16T07:32:32.279101+0000","last_undegraded":"2024-03-16T07:32:32.279101+0000","last_fullsized":"2024-03-16T07:32:32.279101+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_clean_scrub_stamp":"2024-03-16T07:32:31.237650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:46:27.564797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.2e","version":"0'0","reported_seq":20,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-03-16T07:32:33.253857+0000","last_change":"2024-03-16T07:32:18.233726+0000","last_active":"2024-03-16T07:32:33.253857+0000","last_peered":"2024-03-16T07:32:33.253857+0000","last_clean":"2024-03-16T07:32:33.253857+0000","last_became_active":"2024-03-16T07:32:18.232689+0000","last_became_peered":"2024-03-16T07:32:18.232689+0000","last_unstale":"2024-03-16T07:32:33.253857+0000","last_undegraded":"2024-03-16T07:32:33.253857+0000","last_fullsized":"2024-03-16T07:32:33.253857+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:17:44.160585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.2f","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.284932+0000","last_change":"2024-03-16T07:32:32.278225+0000","last_active":"2024-03-16T07:32:32.284932+0000","last_peered":"2024-03-16T07:32:32.284932+0000","last_clean":"2024-03-16T07:32:32.284932+0000","last_became_active":"2024-03-16T07:32:32.276572+0000","last_became_peered":"2024-03-16T07:32:32.276572+0000","last_unstale":"2024-03-16T07:32:32.284932+0000","last_undegraded":"2024-03-16T07:32:32.284932+0000","last_fullsized":"2024-03-16T07:32:32.284932+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_clean_scrub_stamp":"2024-03-16T07:32:31.237650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:11:29.141431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.2d","version":"0'0","reported_seq":18,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.256121+0000","last_change":"2024-03-16T07:32:18.236128+0000","last_active":"2024-03-16T07:32:32.256121+0000","last_peered":"2024-03-16T07:32:32.256121+0000","last_clean":"2024-03-16T07:32:32.256121+0000","last_became_active":"2024-03-16T07:32:18.235894+0000","last_became_peered":"2024-03-16T07:32:18.235894+0000","last_unstale":"2024-03-16T07:32:32.256121+0000","last_undegraded":"2024-03-16T07:32:32.256121+0000","last_fullsized":"2024-03-16T07:32:32.256121+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:43:36.044253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.2e","version":"0'0","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-03-16T07:32:33.253566+0000","last_change":"2024-03-16T07:32:32.279938+0000","last_active":"2024-03-16T07:32:33.253566+0000","last_peered":"2024-03-16T07:32:33.253566+0000","last_clean":"2024-03-16T07:32:33.253566+0000","last_became_active":"2024-03-16T07:32:32.279700+0000","last_became_peered":"2024-03-16T07:32:32.279700+0000","last_unstale":"2024-03-16T07:32:33.253566+0000","last_undegraded":"2024-03-16T07:32:33.253566+0000","last_fullsized":"2024-03-16T07:32:33.253566+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_clean_scrub_stamp":"2024-03-16T07:32:31.237650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:47:05.414566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2c","version":"0'0","reported_seq":20,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-03-16T07:32:33.253247+0000","last_change":"2024-03-16T07:32:18.224575+0000","last_active":"2024-03-16T07:32:33.253247+0000","last_peered":"2024-03-16T07:32:33.253247+0000","last_clean":"2024-03-16T07:32:33.253247+0000","last_became_active":"2024-03-16T07:32:18.224316+0000","last_became_peered":"2024-03-16T07:32:18.224316+0000","last_unstale":"2024-03-16T07:32:33.253247+0000","last_undegraded":"2024-03-16T07:32:33.253247+0000","last_fullsized":"2024-03-16T07:32:33.253247+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:01:12.599303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.29","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.273146+0000","last_change":"2024-03-16T07:32:32.269394+0000","last_active":"2024-03-16T07:32:32.273146+0000","last_peered":"2024-03-16T07:32:32.273146+0000","last_clean":"2024-03-16T07:32:32.273146+0000","last_became_active":"2024-03-16T07:32:32.269140+0000","last_became_peered":"2024-03-16T07:32:32.269140+0000","last_unstale":"2024-03-16T07:32:32.273146+0000","last_undegraded":"2024-03-16T07:32:32.273146+0000","last_fullsized":"2024-03-16T07:32:32.273146+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_clean_scrub_stamp":"2024-03-16T07:32:31.237650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:10:10.331326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.2b","version":"0'0","reported_seq":20,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-03-16T07:32:33.253176+0000","last_change":"2024-03-16T07:32:18.250300+0000","last_active":"2024-03-16T07:32:33.253176+0000","last_peered":"2024-03-16T07:32:33.253176+0000","last_clean":"2024-03-16T07:32:33.253176+0000","last_became_active":"2024-03-16T07:32:18.249983+0000","last_became_peered":"2024-03-16T07:32:18.249983+0000","last_unstale":"2024-03-16T07:32:33.253176+0000","last_undegraded":"2024-03-16T07:32:33.253176+0000","last_fullsized":"2024-03-16T07:32:33.253176+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:04:10.017926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.28","version":"0'0","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-03-16T07:32:33.252180+0000","last_change":"2024-03-16T07:32:32.266744+0000","last_active":"2024-03-16T07:32:33.252180+0000","last_peered":"2024-03-16T07:32:33.252180+0000","last_clean":"2024-03-16T07:32:33.252180+0000","last_became_active":"2024-03-16T07:32:32.266484+0000","last_became_peered":"2024-03-16T07:32:32.266484+0000","last_unstale":"2024-03-16T07:32:33.252180+0000","last_undegraded":"2024-03-16T07:32:33.252180+0000","last_fullsized":"2024-03-16T07:32:33.252180+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_clean_scrub_stamp":"2024-03-16T07:32:31.237650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:59:30.783141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2a","version":"0'0","reported_seq":18,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.264888+0000","last_change":"2024-03-16T07:32:18.226323+0000","last_active":"2024-03-16T07:32:32.264888+0000","last_peered":"2024-03-16T07:32:32.264888+0000","last_clean":"2024-03-16T07:32:32.264888+0000","last_became_active":"2024-03-16T07:32:18.225946+0000","last_became_peered":"2024-03-16T07:32:18.225946+0000","last_unstale":"2024-03-16T07:32:32.264888+0000","last_undegraded":"2024-03-16T07:32:32.264888+0000","last_fullsized":"2024-03-16T07:32:32.264888+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:07:22.597390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.2b","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.274592+0000","last_change":"2024-03-16T07:32:32.273297+0000","last_active":"2024-03-16T07:32:32.274592+0000","last_peered":"2024-03-16T07:32:32.274592+0000","last_clean":"2024-03-16T07:32:32.274592+0000","last_became_active":"2024-03-16T07:32:32.273073+0000","last_became_peered":"2024-03-16T07:32:32.273073+0000","last_unstale":"2024-03-16T07:32:32.274592+0000","last_undegraded":"2024-03-16T07:32:32.274592+0000","last_fullsized":"2024-03-16T07:32:32.274592+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_clean_scrub_stamp":"2024-03-16T07:32:31.237650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:57:27.376465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.29","version":"0'0","reported_seq":18,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.250168+0000","last_change":"2024-03-16T07:32:18.244224+0000","last_active":"2024-03-16T07:32:32.250168+0000","last_peered":"2024-03-16T07:32:32.250168+0000","last_clean":"2024-03-16T07:32:32.250168+0000","last_became_active":"2024-03-16T07:32:18.243900+0000","last_became_peered":"2024-03-16T07:32:18.243900+0000","last_unstale":"2024-03-16T07:32:32.250168+0000","last_undegraded":"2024-03-16T07:32:32.250168+0000","last_fullsized":"2024-03-16T07:32:32.250168+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:36:57.985523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.2a","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.286035+0000","last_change":"2024-03-16T07:32:32.284727+0000","last_active":"2024-03-16T07:32:32.286035+0000","last_peered":"2024-03-16T07:32:32.286035+0000","last_clean":"2024-03-16T07:32:32.286035+0000","last_became_active":"2024-03-16T07:32:32.284316+0000","last_became_peered":"2024-03-16T07:32:32.284316+0000","last_unstale":"2024-03-16T07:32:32.286035+0000","last_undegraded":"2024-03-16T07:32:32.286035+0000","last_fullsized":"2024-03-16T07:32:32.286035+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_clean_scrub_stamp":"2024-03-16T07:32:31.237650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:13:51.207210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.28","version":"0'0","reported_seq":18,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.266336+0000","last_change":"2024-03-16T07:32:18.235208+0000","last_active":"2024-03-16T07:32:32.266336+0000","last_peered":"2024-03-16T07:32:32.266336+0000","last_clean":"2024-03-16T07:32:32.266336+0000","last_became_active":"2024-03-16T07:32:18.233745+0000","last_became_peered":"2024-03-16T07:32:18.233745+0000","last_unstale":"2024-03-16T07:32:32.266336+0000","last_undegraded":"2024-03-16T07:32:32.266336+0000","last_fullsized":"2024-03-16T07:32:32.266336+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:14:38.488963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.25","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.284989+0000","last_change":"2024-03-16T07:32:32.277983+0000","last_active":"2024-03-16T07:32:32.284989+0000","last_peered":"2024-03-16T07:32:32.284989+0000","last_clean":"2024-03-16T07:32:32.284989+0000","last_became_active":"2024-03-16T07:32:32.277748+0000","last_became_peered":"2024-03-16T07:32:32.277748+0000","last_unstale":"2024-03-16T07:32:32.284989+0000","last_undegraded":"2024-03-16T07:32:32.284989+0000","last_fullsized":"2024-03-16T07:32:32.284989+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_clean_scrub_stamp":"2024-03-16T07:32:31.237650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:16:18.155901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.27","version":"0'0","reported_seq":18,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.254690+0000","last_change":"2024-03-16T07:32:18.234600+0000","last_active":"2024-03-16T07:32:32.254690+0000","last_peered":"2024-03-16T07:32:32.254690+0000","last_clean":"2024-03-16T07:32:32.254690+0000","last_became_active":"2024-03-16T07:32:18.234355+0000","last_became_peered":"2024-03-16T07:32:18.234355+0000","last_unstale":"2024-03-16T07:32:32.254690+0000","last_undegraded":"2024-03-16T07:32:32.254690+0000","last_fullsized":"2024-03-16T07:32:32.254690+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:36:04.847955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.24","version":"0'0","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-03-16T07:32:33.252935+0000","last_change":"2024-03-16T07:32:32.266170+0000","last_active":"2024-03-16T07:32:33.252935+0000","last_peered":"2024-03-16T07:32:33.252935+0000","last_clean":"2024-03-16T07:32:33.252935+0000","last_became_active":"2024-03-16T07:32:32.265678+0000","last_became_peered":"2024-03-16T07:32:32.265678+0000","last_unstale":"2024-03-16T07:32:33.252935+0000","last_undegraded":"2024-03-16T07:32:33.252935+0000","last_fullsized":"2024-03-16T07:32:33.252935+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_clean_scrub_stamp":"2024-03-16T07:32:31.237650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:08:02.408020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.26","version":"0'0","reported_seq":18,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.267428+0000","last_change":"2024-03-16T07:32:18.225540+0000","last_active":"2024-03-16T07:32:32.267428+0000","last_peered":"2024-03-16T07:32:32.267428+0000","last_clean":"2024-03-16T07:32:32.267428+0000","last_became_active":"2024-03-16T07:32:18.225284+0000","last_became_peered":"2024-03-16T07:32:18.225284+0000","last_unstale":"2024-03-16T07:32:32.267428+0000","last_undegraded":"2024-03-16T07:32:32.267428+0000","last_fullsized":"2024-03-16T07:32:32.267428+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:22:39.336541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.27","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.264280+0000","last_change":"2024-03-16T07:32:32.260970+0000","last_active":"2024-03-16T07:32:32.264280+0000","last_peered":"2024-03-16T07:32:32.264280+0000","last_clean":"2024-03-16T07:32:32.264280+0000","last_became_active":"2024-03-16T07:32:32.259356+0000","last_became_peered":"2024-03-16T07:32:32.259356+0000","last_unstale":"2024-03-16T07:32:32.264280+0000","last_undegraded":"2024-03-16T07:32:32.264280+0000","last_fullsized":"2024-03-16T07:32:32.264280+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_clean_scrub_stamp":"2024-03-16T07:32:31.237650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:19:53.365815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.25","version":"0'0","reported_seq":18,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.251090+0000","last_change":"2024-03-16T07:32:18.249523+0000","last_active":"2024-03-16T07:32:32.251090+0000","last_peered":"2024-03-16T07:32:32.251090+0000","last_clean":"2024-03-16T07:32:32.251090+0000","last_became_active":"2024-03-16T07:32:18.249244+0000","last_became_peered":"2024-03-16T07:32:18.249244+0000","last_unstale":"2024-03-16T07:32:32.251090+0000","last_undegraded":"2024-03-16T07:32:32.251090+0000","last_fullsized":"2024-03-16T07:32:32.251090+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:40:16.544671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.26","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.289844+0000","last_change":"2024-03-16T07:32:32.288935+0000","last_active":"2024-03-16T07:32:32.289844+0000","last_peered":"2024-03-16T07:32:32.289844+0000","last_clean":"2024-03-16T07:32:32.289844+0000","last_became_active":"2024-03-16T07:32:32.288407+0000","last_became_peered":"2024-03-16T07:32:32.288407+0000","last_unstale":"2024-03-16T07:32:32.289844+0000","last_undegraded":"2024-03-16T07:32:32.289844+0000","last_fullsized":"2024-03-16T07:32:32.289844+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_clean_scrub_stamp":"2024-03-16T07:32:31.237650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:02:38.183314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.24","version":"0'0","reported_seq":20,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-03-16T07:32:33.253335+0000","last_change":"2024-03-16T07:32:18.239570+0000","last_active":"2024-03-16T07:32:33.253335+0000","last_peered":"2024-03-16T07:32:33.253335+0000","last_clean":"2024-03-16T07:32:33.253335+0000","last_became_active":"2024-03-16T07:32:18.239318+0000","last_became_peered":"2024-03-16T07:32:18.239318+0000","last_unstale":"2024-03-16T07:32:33.253335+0000","last_undegraded":"2024-03-16T07:32:33.253335+0000","last_fullsized":"2024-03-16T07:32:33.253335+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:56:27.850737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.21","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.274980+0000","last_change":"2024-03-16T07:32:32.273394+0000","last_active":"2024-03-16T07:32:32.274980+0000","last_peered":"2024-03-16T07:32:32.274980+0000","last_clean":"2024-03-16T07:32:32.274980+0000","last_became_active":"2024-03-16T07:32:32.273147+0000","last_became_peered":"2024-03-16T07:32:32.273147+0000","last_unstale":"2024-03-16T07:32:32.274980+0000","last_undegraded":"2024-03-16T07:32:32.274980+0000","last_fullsized":"2024-03-16T07:32:32.274980+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_clean_scrub_stamp":"2024-03-16T07:32:31.237650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:17:05.381343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.23","version":"0'0","reported_seq":18,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.260861+0000","last_change":"2024-03-16T07:32:18.241882+0000","last_active":"2024-03-16T07:32:32.260861+0000","last_peered":"2024-03-16T07:32:32.260861+0000","last_clean":"2024-03-16T07:32:32.260861+0000","last_became_active":"2024-03-16T07:32:18.241443+0000","last_became_peered":"2024-03-16T07:32:18.241443+0000","last_unstale":"2024-03-16T07:32:32.260861+0000","last_undegraded":"2024-03-16T07:32:32.260861+0000","last_fullsized":"2024-03-16T07:32:32.260861+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:11:58.841024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.20","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.288151+0000","last_change":"2024-03-16T07:32:32.287100+0000","last_active":"2024-03-16T07:32:32.288151+0000","last_peered":"2024-03-16T07:32:32.288151+0000","last_clean":"2024-03-16T07:32:32.288151+0000","last_became_active":"2024-03-16T07:32:32.286865+0000","last_became_peered":"2024-03-16T07:32:32.286865+0000","last_unstale":"2024-03-16T07:32:32.288151+0000","last_undegraded":"2024-03-16T07:32:32.288151+0000","last_fullsized":"2024-03-16T07:32:32.288151+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_clean_scrub_stamp":"2024-03-16T07:32:31.237650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:17:04.052783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.22","version":"0'0","reported_seq":18,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.266420+0000","last_change":"2024-03-16T07:32:18.226198+0000","last_active":"2024-03-16T07:32:32.266420+0000","last_peered":"2024-03-16T07:32:32.266420+0000","last_clean":"2024-03-16T07:32:32.266420+0000","last_became_active":"2024-03-16T07:32:18.224070+0000","last_became_peered":"2024-03-16T07:32:18.224070+0000","last_unstale":"2024-03-16T07:32:32.266420+0000","last_undegraded":"2024-03-16T07:32:32.266420+0000","last_fullsized":"2024-03-16T07:32:32.266420+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:49:04.864326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.23","version":"0'0","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-03-16T07:32:33.252403+0000","last_change":"2024-03-16T07:32:32.262790+0000","last_active":"2024-03-16T07:32:33.252403+0000","last_peered":"2024-03-16T07:32:33.252403+0000","last_clean":"2024-03-16T07:32:33.252403+0000","last_became_active":"2024-03-16T07:32:32.262566+0000","last_became_peered":"2024-03-16T07:32:32.262566+0000","last_unstale":"2024-03-16T07:32:33.252403+0000","last_undegraded":"2024-03-16T07:32:33.252403+0000","last_fullsized":"2024-03-16T07:32:33.252403+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_clean_scrub_stamp":"2024-03-16T07:32:31.237650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:20:09.973405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.21","version":"0'0","reported_seq":18,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.250283+0000","last_change":"2024-03-16T07:32:18.233960+0000","last_active":"2024-03-16T07:32:32.250283+0000","last_peered":"2024-03-16T07:32:32.250283+0000","last_clean":"2024-03-16T07:32:32.250283+0000","last_became_active":"2024-03-16T07:32:18.233732+0000","last_became_peered":"2024-03-16T07:32:18.233732+0000","last_unstale":"2024-03-16T07:32:32.250283+0000","last_undegraded":"2024-03-16T07:32:32.250283+0000","last_fullsized":"2024-03-16T07:32:32.250283+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:16:18.048818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.22","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.284656+0000","last_change":"2024-03-16T07:32:32.280733+0000","last_active":"2024-03-16T07:32:32.284656+0000","last_peered":"2024-03-16T07:32:32.284656+0000","last_clean":"2024-03-16T07:32:32.284656+0000","last_became_active":"2024-03-16T07:32:32.280496+0000","last_became_peered":"2024-03-16T07:32:32.280496+0000","last_unstale":"2024-03-16T07:32:32.284656+0000","last_undegraded":"2024-03-16T07:32:32.284656+0000","last_fullsized":"2024-03-16T07:32:32.284656+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_clean_scrub_stamp":"2024-03-16T07:32:31.237650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:26:18.348097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.20","version":"0'0","reported_seq":20,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-03-16T07:32:33.251726+0000","last_change":"2024-03-16T07:32:18.233834+0000","last_active":"2024-03-16T07:32:33.251726+0000","last_peered":"2024-03-16T07:32:33.251726+0000","last_clean":"2024-03-16T07:32:33.251726+0000","last_became_active":"2024-03-16T07:32:18.233597+0000","last_became_peered":"2024-03-16T07:32:18.233597+0000","last_unstale":"2024-03-16T07:32:33.251726+0000","last_undegraded":"2024-03-16T07:32:33.251726+0000","last_fullsized":"2024-03-16T07:32:33.251726+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:37:27.058282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.1c","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.285053+0000","last_change":"2024-03-16T07:32:32.278511+0000","last_active":"2024-03-16T07:32:32.285053+0000","last_peered":"2024-03-16T07:32:32.285053+0000","last_clean":"2024-03-16T07:32:32.285053+0000","last_became_active":"2024-03-16T07:32:32.275788+0000","last_became_peered":"2024-03-16T07:32:32.275788+0000","last_unstale":"2024-03-16T07:32:32.285053+0000","last_undegraded":"2024-03-16T07:32:32.285053+0000","last_fullsized":"2024-03-16T07:32:32.285053+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_clean_scrub_stamp":"2024-03-16T07:32:31.237650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:34:40.342413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.1d","version":"145'2","reported_seq":16,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-03-16T07:32:33.253034+0000","last_change":"2024-03-16T07:32:31.265311+0000","last_active":"2024-03-16T07:32:33.253034+0000","last_peered":"2024-03-16T07:32:33.253034+0000","last_clean":"2024-03-16T07:32:33.253034+0000","last_became_active":"2024-03-16T07:32:31.264922+0000","last_became_peered":"2024-03-16T07:32:31.264922+0000","last_unstale":"2024-03-16T07:32:33.253034+0000","last_undegraded":"2024-03-16T07:32:33.253034+0000","last_fullsized":"2024-03-16T07:32:33.253034+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:30.234218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:30.234218+0000","last_clean_scrub_stamp":"2024-03-16T07:32:30.234218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:35:45.570886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1e","version":"0'0","reported_seq":18,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.255534+0000","last_change":"2024-03-16T07:32:18.228560+0000","last_active":"2024-03-16T07:32:32.255534+0000","last_peered":"2024-03-16T07:32:32.255534+0000","last_clean":"2024-03-16T07:32:32.255534+0000","last_became_active":"2024-03-16T07:32:18.228293+0000","last_became_peered":"2024-03-16T07:32:18.228293+0000","last_unstale":"2024-03-16T07:32:32.255534+0000","last_undegraded":"2024-03-16T07:32:32.255534+0000","last_fullsized":"2024-03-16T07:32:32.255534+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:42:00.570394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.1f","version":"141'4","reported_seq":26,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-03-16T07:32:33.254397+0000","last_change":"2024-03-16T07:32:17.224916+0000","last_active":"2024-03-16T07:32:33.254397+0000","last_peered":"2024-03-16T07:32:33.254397+0000","last_clean":"2024-03-16T07:32:33.254397+0000","last_became_active":"2024-03-16T07:32:17.224654+0000","last_became_peered":"2024-03-16T07:32:17.224654+0000","last_unstale":"2024-03-16T07:32:33.254397+0000","last_undegraded":"2024-03-16T07:32:33.254397+0000","last_fullsized":"2024-03-16T07:32:33.254397+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_clean_scrub_stamp":"2024-03-16T07:32:16.202808+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:50:05.049365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.1d","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.264412+0000","last_change":"2024-03-16T07:32:32.259518+0000","last_active":"2024-03-16T07:32:32.264412+0000","last_peered":"2024-03-16T07:32:32.264412+0000","last_clean":"2024-03-16T07:32:32.264412+0000","last_became_active":"2024-03-16T07:32:32.259250+0000","last_became_peered":"2024-03-16T07:32:32.259250+0000","last_unstale":"2024-03-16T07:32:32.264412+0000","last_undegraded":"2024-03-16T07:32:32.264412+0000","last_fullsized":"2024-03-16T07:32:32.264412+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_clean_scrub_stamp":"2024-03-16T07:32:31.237650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:09:53.519731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.1c","version":"145'2","reported_seq":14,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.291503+0000","last_change":"2024-03-16T07:32:31.264503+0000","last_active":"2024-03-16T07:32:32.291503+0000","last_peered":"2024-03-16T07:32:32.291503+0000","last_clean":"2024-03-16T07:32:32.291503+0000","last_became_active":"2024-03-16T07:32:31.263690+0000","last_became_peered":"2024-03-16T07:32:31.263690+0000","last_unstale":"2024-03-16T07:32:32.291503+0000","last_undegraded":"2024-03-16T07:32:32.291503+0000","last_fullsized":"2024-03-16T07:32:32.291503+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:30.234218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:30.234218+0000","last_clean_scrub_stamp":"2024-03-16T07:32:30.234218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:02:45.104528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1f","version":"0'0","reported_seq":18,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.260467+0000","last_change":"2024-03-16T07:32:18.243113+0000","last_active":"2024-03-16T07:32:32.260467+0000","last_peered":"2024-03-16T07:32:32.260467+0000","last_clean":"2024-03-16T07:32:32.260467+0000","last_became_active":"2024-03-16T07:32:18.242717+0000","last_became_peered":"2024-03-16T07:32:18.242717+0000","last_unstale":"2024-03-16T07:32:32.260467+0000","last_undegraded":"2024-03-16T07:32:32.260467+0000","last_fullsized":"2024-03-16T07:32:32.260467+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:46:51.380941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1e","version":"141'1","reported_seq":21,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.267542+0000","last_change":"2024-03-16T07:32:17.232318+0000","last_active":"2024-03-16T07:32:32.267542+0000","last_peered":"2024-03-16T07:32:32.267542+0000","last_clean":"2024-03-16T07:32:32.267542+0000","last_became_active":"2024-03-16T07:32:17.230713+0000","last_became_peered":"2024-03-16T07:32:17.230713+0000","last_unstale":"2024-03-16T07:32:32.267542+0000","last_undegraded":"2024-03-16T07:32:32.267542+0000","last_fullsized":"2024-03-16T07:32:32.267542+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_clean_scrub_stamp":"2024-03-16T07:32:16.202808+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:18:34.025222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.1e","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.289047+0000","last_change":"2024-03-16T07:32:32.288007+0000","last_active":"2024-03-16T07:32:32.289047+0000","last_peered":"2024-03-16T07:32:32.289047+0000","last_clean":"2024-03-16T07:32:32.289047+0000","last_became_active":"2024-03-16T07:32:32.287226+0000","last_became_peered":"2024-03-16T07:32:32.287226+0000","last_unstale":"2024-03-16T07:32:32.289047+0000","last_undegraded":"2024-03-16T07:32:32.289047+0000","last_fullsized":"2024-03-16T07:32:32.289047+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_clean_scrub_stamp":"2024-03-16T07:32:31.237650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:32:37.722293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.1f","version":"145'4","reported_seq":16,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.289882+0000","last_change":"2024-03-16T07:32:31.269220+0000","last_active":"2024-03-16T07:32:32.289882+0000","last_peered":"2024-03-16T07:32:32.289882+0000","last_clean":"2024-03-16T07:32:32.289882+0000","last_became_active":"2024-03-16T07:32:31.268984+0000","last_became_peered":"2024-03-16T07:32:31.268984+0000","last_unstale":"2024-03-16T07:32:32.289882+0000","last_undegraded":"2024-03-16T07:32:32.289882+0000","last_fullsized":"2024-03-16T07:32:32.289882+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:30.234218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:30.234218+0000","last_clean_scrub_stamp":"2024-03-16T07:32:30.234218+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:01:51.570542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.1c","version":"0'0","reported_seq":18,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.251024+0000","last_change":"2024-03-16T07:32:18.230121+0000","last_active":"2024-03-16T07:32:32.251024+0000","last_peered":"2024-03-16T07:32:32.251024+0000","last_clean":"2024-03-16T07:32:32.251024+0000","last_became_active":"2024-03-16T07:32:18.229075+0000","last_became_peered":"2024-03-16T07:32:18.229075+0000","last_unstale":"2024-03-16T07:32:32.251024+0000","last_undegraded":"2024-03-16T07:32:32.251024+0000","last_fullsized":"2024-03-16T07:32:32.251024+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:34:12.823633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.1d","version":"141'2","reported_seq":22,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.251386+0000","last_change":"2024-03-16T07:32:17.228396+0000","last_active":"2024-03-16T07:32:32.251386+0000","last_peered":"2024-03-16T07:32:32.251386+0000","last_clean":"2024-03-16T07:32:32.251386+0000","last_became_active":"2024-03-16T07:32:17.228131+0000","last_became_peered":"2024-03-16T07:32:17.228131+0000","last_unstale":"2024-03-16T07:32:32.251386+0000","last_undegraded":"2024-03-16T07:32:32.251386+0000","last_fullsized":"2024-03-16T07:32:32.251386+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_clean_scrub_stamp":"2024-03-16T07:32:16.202808+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:05:23.959390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.1f","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.273026+0000","last_change":"2024-03-16T07:32:32.269094+0000","last_active":"2024-03-16T07:32:32.273026+0000","last_peered":"2024-03-16T07:32:32.273026+0000","last_clean":"2024-03-16T07:32:32.273026+0000","last_became_active":"2024-03-16T07:32:32.268831+0000","last_became_peered":"2024-03-16T07:32:32.268831+0000","last_unstale":"2024-03-16T07:32:32.273026+0000","last_undegraded":"2024-03-16T07:32:32.273026+0000","last_fullsized":"2024-03-16T07:32:32.273026+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_clean_scrub_stamp":"2024-03-16T07:32:31.237650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:35:46.574318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.1e","version":"145'1","reported_seq":13,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.289387+0000","last_change":"2024-03-16T07:32:31.268826+0000","last_active":"2024-03-16T07:32:32.289387+0000","last_peered":"2024-03-16T07:32:32.289387+0000","last_clean":"2024-03-16T07:32:32.289387+0000","last_became_active":"2024-03-16T07:32:31.268594+0000","last_became_peered":"2024-03-16T07:32:31.268594+0000","last_unstale":"2024-03-16T07:32:32.289387+0000","last_undegraded":"2024-03-16T07:32:32.289387+0000","last_fullsized":"2024-03-16T07:32:32.289387+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:30.234218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:30.234218+0000","last_clean_scrub_stamp":"2024-03-16T07:32:30.234218+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:37:22.740932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.1d","version":"0'0","reported_seq":18,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.251186+0000","last_change":"2024-03-16T07:32:18.249490+0000","last_active":"2024-03-16T07:32:32.251186+0000","last_peered":"2024-03-16T07:32:32.251186+0000","last_clean":"2024-03-16T07:32:32.251186+0000","last_became_active":"2024-03-16T07:32:18.249036+0000","last_became_peered":"2024-03-16T07:32:18.249036+0000","last_unstale":"2024-03-16T07:32:32.251186+0000","last_undegraded":"2024-03-16T07:32:32.251186+0000","last_fullsized":"2024-03-16T07:32:32.251186+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:48:26.150691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.1c","version":"141'2","reported_seq":22,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.256532+0000","last_change":"2024-03-16T07:32:17.230842+0000","last_active":"2024-03-16T07:32:32.256532+0000","last_peered":"2024-03-16T07:32:32.256532+0000","last_clean":"2024-03-16T07:32:32.256532+0000","last_became_active":"2024-03-16T07:32:17.230593+0000","last_became_peered":"2024-03-16T07:32:17.230593+0000","last_unstale":"2024-03-16T07:32:32.256532+0000","last_undegraded":"2024-03-16T07:32:32.256532+0000","last_fullsized":"2024-03-16T07:32:32.256532+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_clean_scrub_stamp":"2024-03-16T07:32:16.202808+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:03:33.084093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.18","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.284633+0000","last_change":"2024-03-16T07:32:32.281543+0000","last_active":"2024-03-16T07:32:32.284633+0000","last_peered":"2024-03-16T07:32:32.284633+0000","last_clean":"2024-03-16T07:32:32.284633+0000","last_became_active":"2024-03-16T07:32:32.280978+0000","last_became_peered":"2024-03-16T07:32:32.280978+0000","last_unstale":"2024-03-16T07:32:32.284633+0000","last_undegraded":"2024-03-16T07:32:32.284633+0000","last_fullsized":"2024-03-16T07:32:32.284633+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_clean_scrub_stamp":"2024-03-16T07:32:31.237650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:14:55.981996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.19","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.250094+0000","last_change":"2024-03-16T07:32:31.258676+0000","last_active":"2024-03-16T07:32:32.250094+0000","last_peered":"2024-03-16T07:32:32.250094+0000","last_clean":"2024-03-16T07:32:32.250094+0000","last_became_active":"2024-03-16T07:32:31.258453+0000","last_became_peered":"2024-03-16T07:32:31.258453+0000","last_unstale":"2024-03-16T07:32:32.250094+0000","last_undegraded":"2024-03-16T07:32:32.250094+0000","last_fullsized":"2024-03-16T07:32:32.250094+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:30.234218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:30.234218+0000","last_clean_scrub_stamp":"2024-03-16T07:32:30.234218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:30:25.672232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1a","version":"0'0","reported_seq":18,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.266524+0000","last_change":"2024-03-16T07:32:18.226108+0000","last_active":"2024-03-16T07:32:32.266524+0000","last_peered":"2024-03-16T07:32:32.266524+0000","last_clean":"2024-03-16T07:32:32.266524+0000","last_became_active":"2024-03-16T07:32:18.223749+0000","last_became_peered":"2024-03-16T07:32:18.223749+0000","last_unstale":"2024-03-16T07:32:32.266524+0000","last_undegraded":"2024-03-16T07:32:32.266524+0000","last_fullsized":"2024-03-16T07:32:32.266524+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:28:37.852794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1b","version":"141'1","reported_seq":23,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-03-16T07:32:33.253570+0000","last_change":"2024-03-16T07:32:17.225004+0000","last_active":"2024-03-16T07:32:33.253570+0000","last_peered":"2024-03-16T07:32:33.253570+0000","last_clean":"2024-03-16T07:32:33.253570+0000","last_became_active":"2024-03-16T07:32:17.224306+0000","last_became_peered":"2024-03-16T07:32:17.224306+0000","last_unstale":"2024-03-16T07:32:33.253570+0000","last_undegraded":"2024-03-16T07:32:33.253570+0000","last_fullsized":"2024-03-16T07:32:33.253570+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_clean_scrub_stamp":"2024-03-16T07:32:16.202808+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:58:22.521647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.19","version":"0'0","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-03-16T07:32:33.251433+0000","last_change":"2024-03-16T07:32:32.276999+0000","last_active":"2024-03-16T07:32:33.251433+0000","last_peered":"2024-03-16T07:32:33.251433+0000","last_clean":"2024-03-16T07:32:33.251433+0000","last_became_active":"2024-03-16T07:32:32.276728+0000","last_became_peered":"2024-03-16T07:32:32.276728+0000","last_unstale":"2024-03-16T07:32:33.251433+0000","last_undegraded":"2024-03-16T07:32:33.251433+0000","last_fullsized":"2024-03-16T07:32:33.251433+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_clean_scrub_stamp":"2024-03-16T07:32:31.237650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:07:36.631016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.18","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.256958+0000","last_change":"2024-03-16T07:32:31.259217+0000","last_active":"2024-03-16T07:32:32.256958+0000","last_peered":"2024-03-16T07:32:32.256958+0000","last_clean":"2024-03-16T07:32:32.256958+0000","last_became_active":"2024-03-16T07:32:31.258967+0000","last_became_peered":"2024-03-16T07:32:31.258967+0000","last_unstale":"2024-03-16T07:32:32.256958+0000","last_undegraded":"2024-03-16T07:32:32.256958+0000","last_fullsized":"2024-03-16T07:32:32.256958+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:30.234218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:30.234218+0000","last_clean_scrub_stamp":"2024-03-16T07:32:30.234218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:30:34.008169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1b","version":"0'0","reported_seq":20,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-03-16T07:32:33.253271+0000","last_change":"2024-03-16T07:32:18.239642+0000","last_active":"2024-03-16T07:32:33.253271+0000","last_peered":"2024-03-16T07:32:33.253271+0000","last_clean":"2024-03-16T07:32:33.253271+0000","last_became_active":"2024-03-16T07:32:18.239335+0000","last_became_peered":"2024-03-16T07:32:18.239335+0000","last_unstale":"2024-03-16T07:32:33.253271+0000","last_undegraded":"2024-03-16T07:32:33.253271+0000","last_fullsized":"2024-03-16T07:32:33.253271+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:40:23.016092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.1a","version":"141'1","reported_seq":23,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-03-16T07:32:33.251802+0000","last_change":"2024-03-16T07:32:17.228025+0000","last_active":"2024-03-16T07:32:33.251802+0000","last_peered":"2024-03-16T07:32:33.251802+0000","last_clean":"2024-03-16T07:32:33.251802+0000","last_became_active":"2024-03-16T07:32:17.227533+0000","last_became_peered":"2024-03-16T07:32:17.227533+0000","last_unstale":"2024-03-16T07:32:33.251802+0000","last_undegraded":"2024-03-16T07:32:33.251802+0000","last_fullsized":"2024-03-16T07:32:33.251802+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_clean_scrub_stamp":"2024-03-16T07:32:16.202808+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:48:47.764111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.1b","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.273189+0000","last_change":"2024-03-16T07:32:32.270618+0000","last_active":"2024-03-16T07:32:32.273189+0000","last_peered":"2024-03-16T07:32:32.273189+0000","last_clean":"2024-03-16T07:32:32.273189+0000","last_became_active":"2024-03-16T07:32:32.269697+0000","last_became_peered":"2024-03-16T07:32:32.269697+0000","last_unstale":"2024-03-16T07:32:32.273189+0000","last_undegraded":"2024-03-16T07:32:32.273189+0000","last_fullsized":"2024-03-16T07:32:32.273189+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_clean_scrub_stamp":"2024-03-16T07:32:31.237650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:33:12.653863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.1a","version":"145'1","reported_seq":13,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.280951+0000","last_change":"2024-03-16T07:32:31.263928+0000","last_active":"2024-03-16T07:32:32.280951+0000","last_peered":"2024-03-16T07:32:32.280951+0000","last_clean":"2024-03-16T07:32:32.280951+0000","last_became_active":"2024-03-16T07:32:31.263668+0000","last_became_peered":"2024-03-16T07:32:31.263668+0000","last_unstale":"2024-03-16T07:32:32.280951+0000","last_undegraded":"2024-03-16T07:32:32.280951+0000","last_fullsized":"2024-03-16T07:32:32.280951+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:30.234218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:30.234218+0000","last_clean_scrub_stamp":"2024-03-16T07:32:30.234218+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:58:57.460618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.19","version":"0'0","reported_seq":20,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-03-16T07:32:33.251695+0000","last_change":"2024-03-16T07:32:18.238620+0000","last_active":"2024-03-16T07:32:33.251695+0000","last_peered":"2024-03-16T07:32:33.251695+0000","last_clean":"2024-03-16T07:32:33.251695+0000","last_became_active":"2024-03-16T07:32:18.238143+0000","last_became_peered":"2024-03-16T07:32:18.238143+0000","last_unstale":"2024-03-16T07:32:33.251695+0000","last_undegraded":"2024-03-16T07:32:33.251695+0000","last_fullsized":"2024-03-16T07:32:33.251695+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:58:10.258632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":22,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-03-16T07:32:33.251813+0000","last_change":"2024-03-16T07:32:17.229868+0000","last_active":"2024-03-16T07:32:33.251813+0000","last_peered":"2024-03-16T07:32:33.251813+0000","last_clean":"2024-03-16T07:32:33.251813+0000","last_became_active":"2024-03-16T07:32:17.229220+0000","last_became_peered":"2024-03-16T07:32:17.229220+0000","last_unstale":"2024-03-16T07:32:33.251813+0000","last_undegraded":"2024-03-16T07:32:33.251813+0000","last_fullsized":"2024-03-16T07:32:33.251813+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_clean_scrub_stamp":"2024-03-16T07:32:16.202808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:39:17.803291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.14","version":"0'0","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-03-16T07:32:33.252431+0000","last_change":"2024-03-16T07:32:32.265001+0000","last_active":"2024-03-16T07:32:33.252431+0000","last_peered":"2024-03-16T07:32:33.252431+0000","last_clean":"2024-03-16T07:32:33.252431+0000","last_became_active":"2024-03-16T07:32:32.264777+0000","last_became_peered":"2024-03-16T07:32:32.264777+0000","last_unstale":"2024-03-16T07:32:33.252431+0000","last_undegraded":"2024-03-16T07:32:33.252431+0000","last_fullsized":"2024-03-16T07:32:33.252431+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_clean_scrub_stamp":"2024-03-16T07:32:31.237650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:49:18.897952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.15","version":"145'3","reported_seq":15,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.291072+0000","last_change":"2024-03-16T07:32:31.261234+0000","last_active":"2024-03-16T07:32:32.291072+0000","last_peered":"2024-03-16T07:32:32.291072+0000","last_clean":"2024-03-16T07:32:32.291072+0000","last_became_active":"2024-03-16T07:32:31.260970+0000","last_became_peered":"2024-03-16T07:32:31.260970+0000","last_unstale":"2024-03-16T07:32:32.291072+0000","last_undegraded":"2024-03-16T07:32:32.291072+0000","last_fullsized":"2024-03-16T07:32:32.291072+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:30.234218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:30.234218+0000","last_clean_scrub_stamp":"2024-03-16T07:32:30.234218+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:45:03.910240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.16","version":"0'0","reported_seq":18,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.255633+0000","last_change":"2024-03-16T07:32:18.246236+0000","last_active":"2024-03-16T07:32:32.255633+0000","last_peered":"2024-03-16T07:32:32.255633+0000","last_clean":"2024-03-16T07:32:32.255633+0000","last_became_active":"2024-03-16T07:32:18.244713+0000","last_became_peered":"2024-03-16T07:32:18.244713+0000","last_unstale":"2024-03-16T07:32:32.255633+0000","last_undegraded":"2024-03-16T07:32:32.255633+0000","last_fullsized":"2024-03-16T07:32:32.255633+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:58:36.160396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":20,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.255324+0000","last_change":"2024-03-16T07:32:17.232177+0000","last_active":"2024-03-16T07:32:32.255324+0000","last_peered":"2024-03-16T07:32:32.255324+0000","last_clean":"2024-03-16T07:32:32.255324+0000","last_became_active":"2024-03-16T07:32:17.231920+0000","last_became_peered":"2024-03-16T07:32:17.231920+0000","last_unstale":"2024-03-16T07:32:32.255324+0000","last_undegraded":"2024-03-16T07:32:32.255324+0000","last_fullsized":"2024-03-16T07:32:32.255324+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_clean_scrub_stamp":"2024-03-16T07:32:16.202808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:25:02.223110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.15","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.284970+0000","last_change":"2024-03-16T07:32:32.275386+0000","last_active":"2024-03-16T07:32:32.284970+0000","last_peered":"2024-03-16T07:32:32.284970+0000","last_clean":"2024-03-16T07:32:32.284970+0000","last_became_active":"2024-03-16T07:32:32.274914+0000","last_became_peered":"2024-03-16T07:32:32.274914+0000","last_unstale":"2024-03-16T07:32:32.284970+0000","last_undegraded":"2024-03-16T07:32:32.284970+0000","last_fullsized":"2024-03-16T07:32:32.284970+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_clean_scrub_stamp":"2024-03-16T07:32:31.237650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:25:56.023405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.14","version":"145'6","reported_seq":20,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-03-16T07:32:33.252548+0000","last_change":"2024-03-16T07:32:31.265081+0000","last_active":"2024-03-16T07:32:33.252548+0000","last_peered":"2024-03-16T07:32:33.252548+0000","last_clean":"2024-03-16T07:32:33.252548+0000","last_became_active":"2024-03-16T07:32:31.264834+0000","last_became_peered":"2024-03-16T07:32:31.264834+0000","last_unstale":"2024-03-16T07:32:33.252548+0000","last_undegraded":"2024-03-16T07:32:33.252548+0000","last_fullsized":"2024-03-16T07:32:33.252548+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:30.234218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:30.234218+0000","last_clean_scrub_stamp":"2024-03-16T07:32:30.234218+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:22:18.349029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.17","version":"0'0","reported_seq":18,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.255222+0000","last_change":"2024-03-16T07:32:18.233309+0000","last_active":"2024-03-16T07:32:32.255222+0000","last_peered":"2024-03-16T07:32:32.255222+0000","last_clean":"2024-03-16T07:32:32.255222+0000","last_became_active":"2024-03-16T07:32:18.233047+0000","last_became_peered":"2024-03-16T07:32:18.233047+0000","last_unstale":"2024-03-16T07:32:32.255222+0000","last_undegraded":"2024-03-16T07:32:32.255222+0000","last_fullsized":"2024-03-16T07:32:32.255222+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:20:21.637896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":22,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-03-16T07:32:33.253952+0000","last_change":"2024-03-16T07:32:17.219997+0000","last_active":"2024-03-16T07:32:33.253952+0000","last_peered":"2024-03-16T07:32:33.253952+0000","last_clean":"2024-03-16T07:32:33.253952+0000","last_became_active":"2024-03-16T07:32:17.219744+0000","last_became_peered":"2024-03-16T07:32:17.219744+0000","last_unstale":"2024-03-16T07:32:33.253952+0000","last_undegraded":"2024-03-16T07:32:33.253952+0000","last_fullsized":"2024-03-16T07:32:33.253952+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_clean_scrub_stamp":"2024-03-16T07:32:16.202808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:31:19.141978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.16","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.263327+0000","last_change":"2024-03-16T07:32:32.257977+0000","last_active":"2024-03-16T07:32:32.263327+0000","last_peered":"2024-03-16T07:32:32.263327+0000","last_clean":"2024-03-16T07:32:32.263327+0000","last_became_active":"2024-03-16T07:32:32.257739+0000","last_became_peered":"2024-03-16T07:32:32.257739+0000","last_unstale":"2024-03-16T07:32:32.263327+0000","last_undegraded":"2024-03-16T07:32:32.263327+0000","last_fullsized":"2024-03-16T07:32:32.263327+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_clean_scrub_stamp":"2024-03-16T07:32:31.237650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:51:14.747719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.17","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.254322+0000","last_change":"2024-03-16T07:32:31.262922+0000","last_active":"2024-03-16T07:32:32.254322+0000","last_peered":"2024-03-16T07:32:32.254322+0000","last_clean":"2024-03-16T07:32:32.254322+0000","last_became_active":"2024-03-16T07:32:31.262664+0000","last_became_peered":"2024-03-16T07:32:31.262664+0000","last_unstale":"2024-03-16T07:32:32.254322+0000","last_undegraded":"2024-03-16T07:32:32.254322+0000","last_fullsized":"2024-03-16T07:32:32.254322+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:30.234218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:30.234218+0000","last_clean_scrub_stamp":"2024-03-16T07:32:30.234218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:55:47.774877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.14","version":"0'0","reported_seq":18,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.256373+0000","last_change":"2024-03-16T07:32:18.224530+0000","last_active":"2024-03-16T07:32:32.256373+0000","last_peered":"2024-03-16T07:32:32.256373+0000","last_clean":"2024-03-16T07:32:32.256373+0000","last_became_active":"2024-03-16T07:32:18.223901+0000","last_became_peered":"2024-03-16T07:32:18.223901+0000","last_unstale":"2024-03-16T07:32:32.256373+0000","last_undegraded":"2024-03-16T07:32:32.256373+0000","last_fullsized":"2024-03-16T07:32:32.256373+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:34:54.412590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.15","version":"141'3","reported_seq":25,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-03-16T07:32:33.253411+0000","last_change":"2024-03-16T07:32:17.220743+0000","last_active":"2024-03-16T07:32:33.253411+0000","last_peered":"2024-03-16T07:32:33.253411+0000","last_clean":"2024-03-16T07:32:33.253411+0000","last_became_active":"2024-03-16T07:32:17.220474+0000","last_became_peered":"2024-03-16T07:32:17.220474+0000","last_unstale":"2024-03-16T07:32:33.253411+0000","last_undegraded":"2024-03-16T07:32:33.253411+0000","last_fullsized":"2024-03-16T07:32:33.253411+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_clean_scrub_stamp":"2024-03-16T07:32:16.202808+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:08:19.721367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.17","version":"0'0","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-03-16T07:32:33.253892+0000","last_change":"2024-03-16T07:32:32.265954+0000","last_active":"2024-03-16T07:32:33.253892+0000","last_peered":"2024-03-16T07:32:33.253892+0000","last_clean":"2024-03-16T07:32:33.253892+0000","last_became_active":"2024-03-16T07:32:32.265646+0000","last_became_peered":"2024-03-16T07:32:32.265646+0000","last_unstale":"2024-03-16T07:32:33.253892+0000","last_undegraded":"2024-03-16T07:32:33.253892+0000","last_fullsized":"2024-03-16T07:32:33.253892+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_clean_scrub_stamp":"2024-03-16T07:32:31.237650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:53:53.108260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.16","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.254948+0000","last_change":"2024-03-16T07:32:31.264431+0000","last_active":"2024-03-16T07:32:32.254948+0000","last_peered":"2024-03-16T07:32:32.254948+0000","last_clean":"2024-03-16T07:32:32.254948+0000","last_became_active":"2024-03-16T07:32:31.264194+0000","last_became_peered":"2024-03-16T07:32:31.264194+0000","last_unstale":"2024-03-16T07:32:32.254948+0000","last_undegraded":"2024-03-16T07:32:32.254948+0000","last_fullsized":"2024-03-16T07:32:32.254948+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:30.234218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:30.234218+0000","last_clean_scrub_stamp":"2024-03-16T07:32:30.234218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:17:08.494791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.15","version":"0'0","reported_seq":18,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.256279+0000","last_change":"2024-03-16T07:32:18.218886+0000","last_active":"2024-03-16T07:32:32.256279+0000","last_peered":"2024-03-16T07:32:32.256279+0000","last_clean":"2024-03-16T07:32:32.256279+0000","last_became_active":"2024-03-16T07:32:18.218602+0000","last_became_peered":"2024-03-16T07:32:18.218602+0000","last_unstale":"2024-03-16T07:32:32.256279+0000","last_undegraded":"2024-03-16T07:32:32.256279+0000","last_fullsized":"2024-03-16T07:32:32.256279+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:15:59.980959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.14","version":"142'8","reported_seq":28,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.251285+0000","last_change":"2024-03-16T07:32:17.228965+0000","last_active":"2024-03-16T07:32:32.251285+0000","last_peered":"2024-03-16T07:32:32.251285+0000","last_clean":"2024-03-16T07:32:32.251285+0000","last_became_active":"2024-03-16T07:32:17.228699+0000","last_became_peered":"2024-03-16T07:32:17.228699+0000","last_unstale":"2024-03-16T07:32:32.251285+0000","last_undegraded":"2024-03-16T07:32:32.251285+0000","last_fullsized":"2024-03-16T07:32:32.251285+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_clean_scrub_stamp":"2024-03-16T07:32:16.202808+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:21:38.597189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3309,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.10","version":"0'0","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-03-16T07:32:33.250989+0000","last_change":"2024-03-16T07:32:32.282230+0000","last_active":"2024-03-16T07:32:33.250989+0000","last_peered":"2024-03-16T07:32:33.250989+0000","last_clean":"2024-03-16T07:32:33.250989+0000","last_became_active":"2024-03-16T07:32:32.281902+0000","last_became_peered":"2024-03-16T07:32:32.281902+0000","last_unstale":"2024-03-16T07:32:33.250989+0000","last_undegraded":"2024-03-16T07:32:33.250989+0000","last_fullsized":"2024-03-16T07:32:33.250989+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_clean_scrub_stamp":"2024-03-16T07:32:31.237650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:14:52.522588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.11","version":"0'0","reported_seq":14,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-03-16T07:32:33.251079+0000","last_change":"2024-03-16T07:32:31.265535+0000","last_active":"2024-03-16T07:32:33.251079+0000","last_peered":"2024-03-16T07:32:33.251079+0000","last_clean":"2024-03-16T07:32:33.251079+0000","last_became_active":"2024-03-16T07:32:31.265266+0000","last_became_peered":"2024-03-16T07:32:31.265266+0000","last_unstale":"2024-03-16T07:32:33.251079+0000","last_undegraded":"2024-03-16T07:32:33.251079+0000","last_fullsized":"2024-03-16T07:32:33.251079+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:30.234218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:30.234218+0000","last_clean_scrub_stamp":"2024-03-16T07:32:30.234218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:51:13.744287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.12","version":"0'0","reported_seq":18,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.249540+0000","last_change":"2024-03-16T07:32:18.247568+0000","last_active":"2024-03-16T07:32:32.249540+0000","last_peered":"2024-03-16T07:32:32.249540+0000","last_clean":"2024-03-16T07:32:32.249540+0000","last_became_active":"2024-03-16T07:32:18.246899+0000","last_became_peered":"2024-03-16T07:32:18.246899+0000","last_unstale":"2024-03-16T07:32:32.249540+0000","last_undegraded":"2024-03-16T07:32:32.249540+0000","last_fullsized":"2024-03-16T07:32:32.249540+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:21:41.842380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.13","version":"141'2","reported_seq":22,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.263630+0000","last_change":"2024-03-16T07:32:17.232223+0000","last_active":"2024-03-16T07:32:32.263630+0000","last_peered":"2024-03-16T07:32:32.263630+0000","last_clean":"2024-03-16T07:32:32.263630+0000","last_became_active":"2024-03-16T07:32:17.231976+0000","last_became_peered":"2024-03-16T07:32:17.231976+0000","last_unstale":"2024-03-16T07:32:32.263630+0000","last_undegraded":"2024-03-16T07:32:32.263630+0000","last_fullsized":"2024-03-16T07:32:32.263630+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_clean_scrub_stamp":"2024-03-16T07:32:16.202808+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:45:50.377077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.11","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.275086+0000","last_change":"2024-03-16T07:32:32.274685+0000","last_active":"2024-03-16T07:32:32.275086+0000","last_peered":"2024-03-16T07:32:32.275086+0000","last_clean":"2024-03-16T07:32:32.275086+0000","last_became_active":"2024-03-16T07:32:32.273972+0000","last_became_peered":"2024-03-16T07:32:32.273972+0000","last_unstale":"2024-03-16T07:32:32.275086+0000","last_undegraded":"2024-03-16T07:32:32.275086+0000","last_fullsized":"2024-03-16T07:32:32.275086+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_clean_scrub_stamp":"2024-03-16T07:32:31.237650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:18:49.247054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.10","version":"145'8","reported_seq":22,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-03-16T07:32:33.251359+0000","last_change":"2024-03-16T07:32:31.265461+0000","last_active":"2024-03-16T07:32:33.251359+0000","last_peered":"2024-03-16T07:32:33.251359+0000","last_clean":"2024-03-16T07:32:33.251359+0000","last_became_active":"2024-03-16T07:32:31.265067+0000","last_became_peered":"2024-03-16T07:32:31.265067+0000","last_unstale":"2024-03-16T07:32:33.251359+0000","last_undegraded":"2024-03-16T07:32:33.251359+0000","last_fullsized":"2024-03-16T07:32:33.251359+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:30.234218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:30.234218+0000","last_clean_scrub_stamp":"2024-03-16T07:32:30.234218+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:30:34.008169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.13","version":"0'0","reported_seq":20,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-03-16T07:32:33.253371+0000","last_change":"2024-03-16T07:32:18.239778+0000","last_active":"2024-03-16T07:32:33.253371+0000","last_peered":"2024-03-16T07:32:33.253371+0000","last_clean":"2024-03-16T07:32:33.253371+0000","last_became_active":"2024-03-16T07:32:18.239495+0000","last_became_peered":"2024-03-16T07:32:18.239495+0000","last_unstale":"2024-03-16T07:32:33.253371+0000","last_undegraded":"2024-03-16T07:32:33.253371+0000","last_fullsized":"2024-03-16T07:32:33.253371+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:29:47.654447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":20,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.266705+0000","last_change":"2024-03-16T07:32:17.229415+0000","last_active":"2024-03-16T07:32:32.266705+0000","last_peered":"2024-03-16T07:32:32.266705+0000","last_clean":"2024-03-16T07:32:32.266705+0000","last_became_active":"2024-03-16T07:32:17.228693+0000","last_became_peered":"2024-03-16T07:32:17.228693+0000","last_unstale":"2024-03-16T07:32:32.266705+0000","last_undegraded":"2024-03-16T07:32:32.266705+0000","last_fullsized":"2024-03-16T07:32:32.266705+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_clean_scrub_stamp":"2024-03-16T07:32:16.202808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:43:02.024584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.12","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.284634+0000","last_change":"2024-03-16T07:32:32.280540+0000","last_active":"2024-03-16T07:32:32.284634+0000","last_peered":"2024-03-16T07:32:32.284634+0000","last_clean":"2024-03-16T07:32:32.284634+0000","last_became_active":"2024-03-16T07:32:32.280061+0000","last_became_peered":"2024-03-16T07:32:32.280061+0000","last_unstale":"2024-03-16T07:32:32.284634+0000","last_undegraded":"2024-03-16T07:32:32.284634+0000","last_fullsized":"2024-03-16T07:32:32.284634+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_clean_scrub_stamp":"2024-03-16T07:32:31.237650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:17:00.543982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.13","version":"145'2","reported_seq":16,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-03-16T07:32:33.252590+0000","last_change":"2024-03-16T07:32:31.267097+0000","last_active":"2024-03-16T07:32:33.252590+0000","last_peered":"2024-03-16T07:32:33.252590+0000","last_clean":"2024-03-16T07:32:33.252590+0000","last_became_active":"2024-03-16T07:32:31.266866+0000","last_became_peered":"2024-03-16T07:32:31.266866+0000","last_unstale":"2024-03-16T07:32:33.252590+0000","last_undegraded":"2024-03-16T07:32:33.252590+0000","last_fullsized":"2024-03-16T07:32:33.252590+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:30.234218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:30.234218+0000","last_clean_scrub_stamp":"2024-03-16T07:32:30.234218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:10:09.327894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.10","version":"0'0","reported_seq":18,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.266429+0000","last_change":"2024-03-16T07:32:18.234163+0000","last_active":"2024-03-16T07:32:32.266429+0000","last_peered":"2024-03-16T07:32:32.266429+0000","last_clean":"2024-03-16T07:32:32.266429+0000","last_became_active":"2024-03-16T07:32:18.233416+0000","last_became_peered":"2024-03-16T07:32:18.233416+0000","last_unstale":"2024-03-16T07:32:32.266429+0000","last_undegraded":"2024-03-16T07:32:32.266429+0000","last_fullsized":"2024-03-16T07:32:32.266429+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:48:39.058475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":20,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.260347+0000","last_change":"2024-03-16T07:32:17.231133+0000","last_active":"2024-03-16T07:32:32.260347+0000","last_peered":"2024-03-16T07:32:32.260347+0000","last_clean":"2024-03-16T07:32:32.260347+0000","last_became_active":"2024-03-16T07:32:17.230312+0000","last_became_peered":"2024-03-16T07:32:17.230312+0000","last_unstale":"2024-03-16T07:32:32.260347+0000","last_undegraded":"2024-03-16T07:32:32.260347+0000","last_fullsized":"2024-03-16T07:32:32.260347+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_clean_scrub_stamp":"2024-03-16T07:32:16.202808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:55:33.743467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.13","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.284580+0000","last_change":"2024-03-16T07:32:32.280289+0000","last_active":"2024-03-16T07:32:32.284580+0000","last_peered":"2024-03-16T07:32:32.284580+0000","last_clean":"2024-03-16T07:32:32.284580+0000","last_became_active":"2024-03-16T07:32:32.280007+0000","last_became_peered":"2024-03-16T07:32:32.280007+0000","last_unstale":"2024-03-16T07:32:32.284580+0000","last_undegraded":"2024-03-16T07:32:32.284580+0000","last_fullsized":"2024-03-16T07:32:32.284580+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_clean_scrub_stamp":"2024-03-16T07:32:31.237650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:59:51.121697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.12","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.264346+0000","last_change":"2024-03-16T07:32:31.268660+0000","last_active":"2024-03-16T07:32:32.264346+0000","last_peered":"2024-03-16T07:32:32.264346+0000","last_clean":"2024-03-16T07:32:32.264346+0000","last_became_active":"2024-03-16T07:32:31.268418+0000","last_became_peered":"2024-03-16T07:32:31.268418+0000","last_unstale":"2024-03-16T07:32:32.264346+0000","last_undegraded":"2024-03-16T07:32:32.264346+0000","last_fullsized":"2024-03-16T07:32:32.264346+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:30.234218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:30.234218+0000","last_clean_scrub_stamp":"2024-03-16T07:32:30.234218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:50:03.104056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.11","version":"0'0","reported_seq":18,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.260161+0000","last_change":"2024-03-16T07:32:18.232664+0000","last_active":"2024-03-16T07:32:32.260161+0000","last_peered":"2024-03-16T07:32:32.260161+0000","last_clean":"2024-03-16T07:32:32.260161+0000","last_became_active":"2024-03-16T07:32:18.232084+0000","last_became_peered":"2024-03-16T07:32:18.232084+0000","last_unstale":"2024-03-16T07:32:32.260161+0000","last_undegraded":"2024-03-16T07:32:32.260161+0000","last_fullsized":"2024-03-16T07:32:32.260161+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:05:26.371341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.10","version":"141'8","reported_seq":30,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-03-16T07:32:33.251903+0000","last_change":"2024-03-16T07:32:17.225860+0000","last_active":"2024-03-16T07:32:33.251903+0000","last_peered":"2024-03-16T07:32:33.251903+0000","last_clean":"2024-03-16T07:32:33.251903+0000","last_became_active":"2024-03-16T07:32:17.225589+0000","last_became_peered":"2024-03-16T07:32:17.225589+0000","last_unstale":"2024-03-16T07:32:33.251903+0000","last_undegraded":"2024-03-16T07:32:33.251903+0000","last_fullsized":"2024-03-16T07:32:33.251903+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_clean_scrub_stamp":"2024-03-16T07:32:16.202808+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:41:14.963665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.c","version":"0'0","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-03-16T07:32:33.252422+0000","last_change":"2024-03-16T07:32:32.266203+0000","last_active":"2024-03-16T07:32:33.252422+0000","last_peered":"2024-03-16T07:32:33.252422+0000","last_clean":"2024-03-16T07:32:33.252422+0000","last_became_active":"2024-03-16T07:32:32.265944+0000","last_became_peered":"2024-03-16T07:32:32.265944+0000","last_unstale":"2024-03-16T07:32:33.252422+0000","last_undegraded":"2024-03-16T07:32:33.252422+0000","last_fullsized":"2024-03-16T07:32:33.252422+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_clean_scrub_stamp":"2024-03-16T07:32:31.237650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:05:40.404967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.d","version":"145'1","reported_seq":15,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-03-16T07:32:33.252925+0000","last_change":"2024-03-16T07:32:31.264052+0000","last_active":"2024-03-16T07:32:33.252925+0000","last_peered":"2024-03-16T07:32:33.252925+0000","last_clean":"2024-03-16T07:32:33.252925+0000","last_became_active":"2024-03-16T07:32:31.263832+0000","last_became_peered":"2024-03-16T07:32:31.263832+0000","last_unstale":"2024-03-16T07:32:33.252925+0000","last_undegraded":"2024-03-16T07:32:33.252925+0000","last_fullsized":"2024-03-16T07:32:33.252925+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:30.234218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:30.234218+0000","last_clean_scrub_stamp":"2024-03-16T07:32:30.234218+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:36:40.700848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.e","version":"0'0","reported_seq":18,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.267437+0000","last_change":"2024-03-16T07:32:18.226029+0000","last_active":"2024-03-16T07:32:32.267437+0000","last_peered":"2024-03-16T07:32:32.267437+0000","last_clean":"2024-03-16T07:32:32.267437+0000","last_became_active":"2024-03-16T07:32:18.225788+0000","last_became_peered":"2024-03-16T07:32:18.225788+0000","last_unstale":"2024-03-16T07:32:32.267437+0000","last_undegraded":"2024-03-16T07:32:32.267437+0000","last_fullsized":"2024-03-16T07:32:32.267437+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:48:50.739716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.f","version":"141'1","reported_seq":23,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-03-16T07:32:33.254399+0000","last_change":"2024-03-16T07:32:17.223445+0000","last_active":"2024-03-16T07:32:33.254399+0000","last_peered":"2024-03-16T07:32:33.254399+0000","last_clean":"2024-03-16T07:32:33.254399+0000","last_became_active":"2024-03-16T07:32:17.222651+0000","last_became_peered":"2024-03-16T07:32:17.222651+0000","last_unstale":"2024-03-16T07:32:33.254399+0000","last_undegraded":"2024-03-16T07:32:33.254399+0000","last_fullsized":"2024-03-16T07:32:33.254399+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_clean_scrub_stamp":"2024-03-16T07:32:16.202808+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:12:48.104487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.d","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.275439+0000","last_change":"2024-03-16T07:32:32.275029+0000","last_active":"2024-03-16T07:32:32.275439+0000","last_peered":"2024-03-16T07:32:32.275439+0000","last_clean":"2024-03-16T07:32:32.275439+0000","last_became_active":"2024-03-16T07:32:32.274715+0000","last_became_peered":"2024-03-16T07:32:32.274715+0000","last_unstale":"2024-03-16T07:32:32.275439+0000","last_undegraded":"2024-03-16T07:32:32.275439+0000","last_fullsized":"2024-03-16T07:32:32.275439+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_clean_scrub_stamp":"2024-03-16T07:32:31.237650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:31:12.717700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.c","version":"0'0","reported_seq":14,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-03-16T07:32:33.252659+0000","last_change":"2024-03-16T07:32:31.265671+0000","last_active":"2024-03-16T07:32:33.252659+0000","last_peered":"2024-03-16T07:32:33.252659+0000","last_clean":"2024-03-16T07:32:33.252659+0000","last_became_active":"2024-03-16T07:32:31.265417+0000","last_became_peered":"2024-03-16T07:32:31.265417+0000","last_unstale":"2024-03-16T07:32:33.252659+0000","last_undegraded":"2024-03-16T07:32:33.252659+0000","last_fullsized":"2024-03-16T07:32:33.252659+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:30.234218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:30.234218+0000","last_clean_scrub_stamp":"2024-03-16T07:32:30.234218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:18:48.056632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.f","version":"0'0","reported_seq":18,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.260566+0000","last_change":"2024-03-16T07:32:18.242423+0000","last_active":"2024-03-16T07:32:32.260566+0000","last_peered":"2024-03-16T07:32:32.260566+0000","last_clean":"2024-03-16T07:32:32.260566+0000","last_became_active":"2024-03-16T07:32:18.241803+0000","last_became_peered":"2024-03-16T07:32:18.241803+0000","last_unstale":"2024-03-16T07:32:32.260566+0000","last_undegraded":"2024-03-16T07:32:32.260566+0000","last_fullsized":"2024-03-16T07:32:32.260566+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:07:30.219856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.e","version":"141'2","reported_seq":22,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.255724+0000","last_change":"2024-03-16T07:32:17.231123+0000","last_active":"2024-03-16T07:32:32.255724+0000","last_peered":"2024-03-16T07:32:32.255724+0000","last_clean":"2024-03-16T07:32:32.255724+0000","last_became_active":"2024-03-16T07:32:17.230808+0000","last_became_peered":"2024-03-16T07:32:17.230808+0000","last_unstale":"2024-03-16T07:32:32.255724+0000","last_undegraded":"2024-03-16T07:32:32.255724+0000","last_fullsized":"2024-03-16T07:32:32.255724+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_clean_scrub_stamp":"2024-03-16T07:32:16.202808+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:59:19.582457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.e","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.289856+0000","last_change":"2024-03-16T07:32:32.289228+0000","last_active":"2024-03-16T07:32:32.289856+0000","last_peered":"2024-03-16T07:32:32.289856+0000","last_clean":"2024-03-16T07:32:32.289856+0000","last_became_active":"2024-03-16T07:32:32.288143+0000","last_became_peered":"2024-03-16T07:32:32.288143+0000","last_unstale":"2024-03-16T07:32:32.289856+0000","last_undegraded":"2024-03-16T07:32:32.289856+0000","last_fullsized":"2024-03-16T07:32:32.289856+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_clean_scrub_stamp":"2024-03-16T07:32:31.237650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:45:24.129110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.f","version":"145'1","reported_seq":13,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.269851+0000","last_change":"2024-03-16T07:32:31.261808+0000","last_active":"2024-03-16T07:32:32.269851+0000","last_peered":"2024-03-16T07:32:32.269851+0000","last_clean":"2024-03-16T07:32:32.269851+0000","last_became_active":"2024-03-16T07:32:31.261560+0000","last_became_peered":"2024-03-16T07:32:31.261560+0000","last_unstale":"2024-03-16T07:32:32.269851+0000","last_undegraded":"2024-03-16T07:32:32.269851+0000","last_fullsized":"2024-03-16T07:32:32.269851+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:30.234218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:30.234218+0000","last_clean_scrub_stamp":"2024-03-16T07:32:30.234218+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:14:25.061483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.c","version":"0'0","reported_seq":18,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.251108+0000","last_change":"2024-03-16T07:32:18.248350+0000","last_active":"2024-03-16T07:32:32.251108+0000","last_peered":"2024-03-16T07:32:32.251108+0000","last_clean":"2024-03-16T07:32:32.251108+0000","last_became_active":"2024-03-16T07:32:18.247340+0000","last_became_peered":"2024-03-16T07:32:18.247340+0000","last_unstale":"2024-03-16T07:32:32.251108+0000","last_undegraded":"2024-03-16T07:32:32.251108+0000","last_fullsized":"2024-03-16T07:32:32.251108+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:23:00.374407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.d","version":"141'1","reported_seq":21,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.256470+0000","last_change":"2024-03-16T07:32:17.229616+0000","last_active":"2024-03-16T07:32:32.256470+0000","last_peered":"2024-03-16T07:32:32.256470+0000","last_clean":"2024-03-16T07:32:32.256470+0000","last_became_active":"2024-03-16T07:32:17.229279+0000","last_became_peered":"2024-03-16T07:32:17.229279+0000","last_unstale":"2024-03-16T07:32:32.256470+0000","last_undegraded":"2024-03-16T07:32:32.256470+0000","last_fullsized":"2024-03-16T07:32:32.256470+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_clean_scrub_stamp":"2024-03-16T07:32:16.202808+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:14:11.030073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.f","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.278739+0000","last_change":"2024-03-16T07:32:32.277258+0000","last_active":"2024-03-16T07:32:32.278739+0000","last_peered":"2024-03-16T07:32:32.278739+0000","last_clean":"2024-03-16T07:32:32.278739+0000","last_became_active":"2024-03-16T07:32:32.276989+0000","last_became_peered":"2024-03-16T07:32:32.276989+0000","last_unstale":"2024-03-16T07:32:32.278739+0000","last_undegraded":"2024-03-16T07:32:32.278739+0000","last_fullsized":"2024-03-16T07:32:32.278739+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_clean_scrub_stamp":"2024-03-16T07:32:31.237650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:59:55.430384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.e","version":"145'2","reported_seq":16,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-03-16T07:32:33.253718+0000","last_change":"2024-03-16T07:32:31.263636+0000","last_active":"2024-03-16T07:32:33.253718+0000","last_peered":"2024-03-16T07:32:33.253718+0000","last_clean":"2024-03-16T07:32:33.253718+0000","last_became_active":"2024-03-16T07:32:31.263340+0000","last_became_peered":"2024-03-16T07:32:31.263340+0000","last_unstale":"2024-03-16T07:32:33.253718+0000","last_undegraded":"2024-03-16T07:32:33.253718+0000","last_fullsized":"2024-03-16T07:32:33.253718+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:30.234218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:30.234218+0000","last_clean_scrub_stamp":"2024-03-16T07:32:30.234218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:09:52.516299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.d","version":"0'0","reported_seq":18,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.256318+0000","last_change":"2024-03-16T07:32:18.217887+0000","last_active":"2024-03-16T07:32:32.256318+0000","last_peered":"2024-03-16T07:32:32.256318+0000","last_clean":"2024-03-16T07:32:32.256318+0000","last_became_active":"2024-03-16T07:32:18.217641+0000","last_became_peered":"2024-03-16T07:32:18.217641+0000","last_unstale":"2024-03-16T07:32:32.256318+0000","last_undegraded":"2024-03-16T07:32:32.256318+0000","last_fullsized":"2024-03-16T07:32:32.256318+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:53:39.074634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":20,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.256634+0000","last_change":"2024-03-16T07:32:17.234400+0000","last_active":"2024-03-16T07:32:32.256634+0000","last_peered":"2024-03-16T07:32:32.256634+0000","last_clean":"2024-03-16T07:32:32.256634+0000","last_became_active":"2024-03-16T07:32:17.234140+0000","last_became_peered":"2024-03-16T07:32:17.234140+0000","last_unstale":"2024-03-16T07:32:32.256634+0000","last_undegraded":"2024-03-16T07:32:32.256634+0000","last_fullsized":"2024-03-16T07:32:32.256634+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_clean_scrub_stamp":"2024-03-16T07:32:16.202808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:30:19.976759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.8","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.273248+0000","last_change":"2024-03-16T07:32:32.270595+0000","last_active":"2024-03-16T07:32:32.273248+0000","last_peered":"2024-03-16T07:32:32.273248+0000","last_clean":"2024-03-16T07:32:32.273248+0000","last_became_active":"2024-03-16T07:32:32.269246+0000","last_became_peered":"2024-03-16T07:32:32.269246+0000","last_unstale":"2024-03-16T07:32:32.273248+0000","last_undegraded":"2024-03-16T07:32:32.273248+0000","last_fullsized":"2024-03-16T07:32:32.273248+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_clean_scrub_stamp":"2024-03-16T07:32:31.237650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:28:02.616503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.9","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.256486+0000","last_change":"2024-03-16T07:32:31.268108+0000","last_active":"2024-03-16T07:32:32.256486+0000","last_peered":"2024-03-16T07:32:32.256486+0000","last_clean":"2024-03-16T07:32:32.256486+0000","last_became_active":"2024-03-16T07:32:31.267874+0000","last_became_peered":"2024-03-16T07:32:31.267874+0000","last_unstale":"2024-03-16T07:32:32.256486+0000","last_undegraded":"2024-03-16T07:32:32.256486+0000","last_fullsized":"2024-03-16T07:32:32.256486+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:30.234218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:30.234218+0000","last_clean_scrub_stamp":"2024-03-16T07:32:30.234218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:16:06.545909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.a","version":"0'0","reported_seq":18,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.266620+0000","last_change":"2024-03-16T07:32:18.224341+0000","last_active":"2024-03-16T07:32:32.266620+0000","last_peered":"2024-03-16T07:32:32.266620+0000","last_clean":"2024-03-16T07:32:32.266620+0000","last_became_active":"2024-03-16T07:32:18.223713+0000","last_became_peered":"2024-03-16T07:32:18.223713+0000","last_unstale":"2024-03-16T07:32:32.266620+0000","last_undegraded":"2024-03-16T07:32:32.266620+0000","last_fullsized":"2024-03-16T07:32:32.266620+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:07:48.374395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.b","version":"141'2","reported_seq":22,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.252140+0000","last_change":"2024-03-16T07:32:17.232593+0000","last_active":"2024-03-16T07:32:32.252140+0000","last_peered":"2024-03-16T07:32:32.252140+0000","last_clean":"2024-03-16T07:32:32.252140+0000","last_became_active":"2024-03-16T07:32:17.232337+0000","last_became_peered":"2024-03-16T07:32:17.232337+0000","last_unstale":"2024-03-16T07:32:32.252140+0000","last_undegraded":"2024-03-16T07:32:32.252140+0000","last_fullsized":"2024-03-16T07:32:32.252140+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_clean_scrub_stamp":"2024-03-16T07:32:16.202808+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:29:00.632805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.9","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.284557+0000","last_change":"2024-03-16T07:32:32.281004+0000","last_active":"2024-03-16T07:32:32.284557+0000","last_peered":"2024-03-16T07:32:32.284557+0000","last_clean":"2024-03-16T07:32:32.284557+0000","last_became_active":"2024-03-16T07:32:32.280748+0000","last_became_peered":"2024-03-16T07:32:32.280748+0000","last_unstale":"2024-03-16T07:32:32.284557+0000","last_undegraded":"2024-03-16T07:32:32.284557+0000","last_fullsized":"2024-03-16T07:32:32.284557+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_clean_scrub_stamp":"2024-03-16T07:32:31.237650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:12:01.377193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.8","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.257097+0000","last_change":"2024-03-16T07:32:31.256093+0000","last_active":"2024-03-16T07:32:32.257097+0000","last_peered":"2024-03-16T07:32:32.257097+0000","last_clean":"2024-03-16T07:32:32.257097+0000","last_became_active":"2024-03-16T07:32:31.255831+0000","last_became_peered":"2024-03-16T07:32:31.255831+0000","last_unstale":"2024-03-16T07:32:32.257097+0000","last_undegraded":"2024-03-16T07:32:32.257097+0000","last_fullsized":"2024-03-16T07:32:32.257097+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:30.234218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:30.234218+0000","last_clean_scrub_stamp":"2024-03-16T07:32:30.234218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:22:18.349029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.b","version":"0'0","reported_seq":20,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-03-16T07:32:33.253470+0000","last_change":"2024-03-16T07:32:18.240156+0000","last_active":"2024-03-16T07:32:33.253470+0000","last_peered":"2024-03-16T07:32:33.253470+0000","last_clean":"2024-03-16T07:32:33.253470+0000","last_became_active":"2024-03-16T07:32:18.239925+0000","last_became_peered":"2024-03-16T07:32:18.239925+0000","last_unstale":"2024-03-16T07:32:33.253470+0000","last_undegraded":"2024-03-16T07:32:33.253470+0000","last_fullsized":"2024-03-16T07:32:33.253470+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:18:49.338437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":22,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-03-16T07:32:33.251909+0000","last_change":"2024-03-16T07:32:17.227713+0000","last_active":"2024-03-16T07:32:33.251909+0000","last_peered":"2024-03-16T07:32:33.251909+0000","last_clean":"2024-03-16T07:32:33.251909+0000","last_became_active":"2024-03-16T07:32:17.227251+0000","last_became_peered":"2024-03-16T07:32:17.227251+0000","last_unstale":"2024-03-16T07:32:33.251909+0000","last_undegraded":"2024-03-16T07:32:33.251909+0000","last_fullsized":"2024-03-16T07:32:33.251909+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_clean_scrub_stamp":"2024-03-16T07:32:16.202808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:07:04.797749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.a","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.284597+0000","last_change":"2024-03-16T07:32:32.280319+0000","last_active":"2024-03-16T07:32:32.284597+0000","last_peered":"2024-03-16T07:32:32.284597+0000","last_clean":"2024-03-16T07:32:32.284597+0000","last_became_active":"2024-03-16T07:32:32.279654+0000","last_became_peered":"2024-03-16T07:32:32.279654+0000","last_unstale":"2024-03-16T07:32:32.284597+0000","last_undegraded":"2024-03-16T07:32:32.284597+0000","last_fullsized":"2024-03-16T07:32:32.284597+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_clean_scrub_stamp":"2024-03-16T07:32:31.237650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:49:10.373286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.b","version":"145'2","reported_seq":14,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.289755+0000","last_change":"2024-03-16T07:32:31.268842+0000","last_active":"2024-03-16T07:32:32.289755+0000","last_peered":"2024-03-16T07:32:32.289755+0000","last_clean":"2024-03-16T07:32:32.289755+0000","last_became_active":"2024-03-16T07:32:31.268625+0000","last_became_peered":"2024-03-16T07:32:31.268625+0000","last_unstale":"2024-03-16T07:32:32.289755+0000","last_undegraded":"2024-03-16T07:32:32.289755+0000","last_fullsized":"2024-03-16T07:32:32.289755+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:30.234218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:30.234218+0000","last_clean_scrub_stamp":"2024-03-16T07:32:30.234218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:44:13.780054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.8","version":"0'0","reported_seq":18,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.266519+0000","last_change":"2024-03-16T07:32:18.225698+0000","last_active":"2024-03-16T07:32:32.266519+0000","last_peered":"2024-03-16T07:32:32.266519+0000","last_clean":"2024-03-16T07:32:32.266519+0000","last_became_active":"2024-03-16T07:32:18.223573+0000","last_became_peered":"2024-03-16T07:32:18.223573+0000","last_unstale":"2024-03-16T07:32:32.266519+0000","last_undegraded":"2024-03-16T07:32:32.266519+0000","last_fullsized":"2024-03-16T07:32:32.266519+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:19:55.939779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":20,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.250285+0000","last_change":"2024-03-16T07:32:17.233204+0000","last_active":"2024-03-16T07:32:32.250285+0000","last_peered":"2024-03-16T07:32:32.250285+0000","last_clean":"2024-03-16T07:32:32.250285+0000","last_became_active":"2024-03-16T07:32:17.232939+0000","last_became_peered":"2024-03-16T07:32:17.232939+0000","last_unstale":"2024-03-16T07:32:32.250285+0000","last_undegraded":"2024-03-16T07:32:32.250285+0000","last_fullsized":"2024-03-16T07:32:32.250285+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_clean_scrub_stamp":"2024-03-16T07:32:16.202808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:22:20.381122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.b","version":"0'0","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-03-16T07:32:33.253124+0000","last_change":"2024-03-16T07:32:32.262011+0000","last_active":"2024-03-16T07:32:33.253124+0000","last_peered":"2024-03-16T07:32:33.253124+0000","last_clean":"2024-03-16T07:32:33.253124+0000","last_became_active":"2024-03-16T07:32:32.261781+0000","last_became_peered":"2024-03-16T07:32:32.261781+0000","last_unstale":"2024-03-16T07:32:33.253124+0000","last_undegraded":"2024-03-16T07:32:33.253124+0000","last_fullsized":"2024-03-16T07:32:33.253124+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_clean_scrub_stamp":"2024-03-16T07:32:31.237650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:43:50.077878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.a","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.267304+0000","last_change":"2024-03-16T07:32:31.268460+0000","last_active":"2024-03-16T07:32:32.267304+0000","last_peered":"2024-03-16T07:32:32.267304+0000","last_clean":"2024-03-16T07:32:32.267304+0000","last_became_active":"2024-03-16T07:32:31.268022+0000","last_became_peered":"2024-03-16T07:32:31.268022+0000","last_unstale":"2024-03-16T07:32:32.267304+0000","last_undegraded":"2024-03-16T07:32:32.267304+0000","last_fullsized":"2024-03-16T07:32:32.267304+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:30.234218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:30.234218+0000","last_clean_scrub_stamp":"2024-03-16T07:32:30.234218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:13:43.596119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.9","version":"0'0","reported_seq":20,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-03-16T07:32:33.251794+0000","last_change":"2024-03-16T07:32:18.238541+0000","last_active":"2024-03-16T07:32:33.251794+0000","last_peered":"2024-03-16T07:32:33.251794+0000","last_clean":"2024-03-16T07:32:33.251794+0000","last_became_active":"2024-03-16T07:32:18.238016+0000","last_became_peered":"2024-03-16T07:32:18.238016+0000","last_unstale":"2024-03-16T07:32:33.251794+0000","last_undegraded":"2024-03-16T07:32:33.251794+0000","last_fullsized":"2024-03-16T07:32:33.251794+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:22:34.169555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":22,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-03-16T07:32:33.252003+0000","last_change":"2024-03-16T07:32:17.227872+0000","last_active":"2024-03-16T07:32:33.252003+0000","last_peered":"2024-03-16T07:32:33.252003+0000","last_clean":"2024-03-16T07:32:33.252003+0000","last_became_active":"2024-03-16T07:32:17.227600+0000","last_became_peered":"2024-03-16T07:32:17.227600+0000","last_unstale":"2024-03-16T07:32:33.252003+0000","last_undegraded":"2024-03-16T07:32:33.252003+0000","last_fullsized":"2024-03-16T07:32:33.252003+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_clean_scrub_stamp":"2024-03-16T07:32:16.202808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:56:01.743830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.4","version":"0'0","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-03-16T07:32:33.253143+0000","last_change":"2024-03-16T07:32:32.265999+0000","last_active":"2024-03-16T07:32:33.253143+0000","last_peered":"2024-03-16T07:32:33.253143+0000","last_clean":"2024-03-16T07:32:33.253143+0000","last_became_active":"2024-03-16T07:32:32.265623+0000","last_became_peered":"2024-03-16T07:32:32.265623+0000","last_unstale":"2024-03-16T07:32:33.253143+0000","last_undegraded":"2024-03-16T07:32:33.253143+0000","last_fullsized":"2024-03-16T07:32:33.253143+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_clean_scrub_stamp":"2024-03-16T07:32:31.237650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:16:14.014584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.5","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.251036+0000","last_change":"2024-03-16T07:32:31.260799+0000","last_active":"2024-03-16T07:32:32.251036+0000","last_peered":"2024-03-16T07:32:32.251036+0000","last_clean":"2024-03-16T07:32:32.251036+0000","last_became_active":"2024-03-16T07:32:31.260168+0000","last_became_peered":"2024-03-16T07:32:31.260168+0000","last_unstale":"2024-03-16T07:32:32.251036+0000","last_undegraded":"2024-03-16T07:32:32.251036+0000","last_fullsized":"2024-03-16T07:32:32.251036+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:30.234218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:30.234218+0000","last_clean_scrub_stamp":"2024-03-16T07:32:30.234218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:46:04.408487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.6","version":"0'0","reported_seq":20,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-03-16T07:32:33.253933+0000","last_change":"2024-03-16T07:32:18.233930+0000","last_active":"2024-03-16T07:32:33.253933+0000","last_peered":"2024-03-16T07:32:33.253933+0000","last_clean":"2024-03-16T07:32:33.253933+0000","last_became_active":"2024-03-16T07:32:18.233008+0000","last_became_peered":"2024-03-16T07:32:18.233008+0000","last_unstale":"2024-03-16T07:32:33.253933+0000","last_undegraded":"2024-03-16T07:32:33.253933+0000","last_fullsized":"2024-03-16T07:32:33.253933+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:23:38.116248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.7","version":"141'2","reported_seq":22,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.260923+0000","last_change":"2024-03-16T07:32:17.228514+0000","last_active":"2024-03-16T07:32:32.260923+0000","last_peered":"2024-03-16T07:32:32.260923+0000","last_clean":"2024-03-16T07:32:32.260923+0000","last_became_active":"2024-03-16T07:32:17.228200+0000","last_became_peered":"2024-03-16T07:32:17.228200+0000","last_unstale":"2024-03-16T07:32:32.260923+0000","last_undegraded":"2024-03-16T07:32:32.260923+0000","last_fullsized":"2024-03-16T07:32:32.260923+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_clean_scrub_stamp":"2024-03-16T07:32:16.202808+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:50:35.506990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.5","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.274926+0000","last_change":"2024-03-16T07:32:32.274602+0000","last_active":"2024-03-16T07:32:32.274926+0000","last_peered":"2024-03-16T07:32:32.274926+0000","last_clean":"2024-03-16T07:32:32.274926+0000","last_became_active":"2024-03-16T07:32:32.272654+0000","last_became_peered":"2024-03-16T07:32:32.272654+0000","last_unstale":"2024-03-16T07:32:32.274926+0000","last_undegraded":"2024-03-16T07:32:32.274926+0000","last_fullsized":"2024-03-16T07:32:32.274926+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_clean_scrub_stamp":"2024-03-16T07:32:31.237650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:15:57.124592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.4","version":"0'0","reported_seq":14,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-03-16T07:32:33.252749+0000","last_change":"2024-03-16T07:32:31.266746+0000","last_active":"2024-03-16T07:32:33.252749+0000","last_peered":"2024-03-16T07:32:33.252749+0000","last_clean":"2024-03-16T07:32:33.252749+0000","last_became_active":"2024-03-16T07:32:31.266527+0000","last_became_peered":"2024-03-16T07:32:31.266527+0000","last_unstale":"2024-03-16T07:32:33.252749+0000","last_undegraded":"2024-03-16T07:32:33.252749+0000","last_fullsized":"2024-03-16T07:32:33.252749+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:30.234218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:30.234218+0000","last_clean_scrub_stamp":"2024-03-16T07:32:30.234218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:55:41.715691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.7","version":"0'0","reported_seq":18,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.260659+0000","last_change":"2024-03-16T07:32:18.242678+0000","last_active":"2024-03-16T07:32:32.260659+0000","last_peered":"2024-03-16T07:32:32.260659+0000","last_clean":"2024-03-16T07:32:32.260659+0000","last_became_active":"2024-03-16T07:32:18.242069+0000","last_became_peered":"2024-03-16T07:32:18.242069+0000","last_unstale":"2024-03-16T07:32:32.260659+0000","last_undegraded":"2024-03-16T07:32:32.260659+0000","last_fullsized":"2024-03-16T07:32:32.260659+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:47:32.797133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.6","version":"142'1","reported_seq":21,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.267594+0000","last_change":"2024-03-16T07:32:17.231485+0000","last_active":"2024-03-16T07:32:32.267594+0000","last_peered":"2024-03-16T07:32:32.267594+0000","last_clean":"2024-03-16T07:32:32.267594+0000","last_became_active":"2024-03-16T07:32:17.231153+0000","last_became_peered":"2024-03-16T07:32:17.231153+0000","last_unstale":"2024-03-16T07:32:32.267594+0000","last_undegraded":"2024-03-16T07:32:32.267594+0000","last_fullsized":"2024-03-16T07:32:32.267594+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_clean_scrub_stamp":"2024-03-16T07:32:16.202808+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:55:27.684281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.6","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.288814+0000","last_change":"2024-03-16T07:32:32.285858+0000","last_active":"2024-03-16T07:32:32.288814+0000","last_peered":"2024-03-16T07:32:32.288814+0000","last_clean":"2024-03-16T07:32:32.288814+0000","last_became_active":"2024-03-16T07:32:32.285617+0000","last_became_peered":"2024-03-16T07:32:32.285617+0000","last_unstale":"2024-03-16T07:32:32.288814+0000","last_undegraded":"2024-03-16T07:32:32.288814+0000","last_fullsized":"2024-03-16T07:32:32.288814+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_clean_scrub_stamp":"2024-03-16T07:32:31.237650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:09:50.831688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.7","version":"145'2","reported_seq":16,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-03-16T07:32:33.254007+0000","last_change":"2024-03-16T07:32:31.263908+0000","last_active":"2024-03-16T07:32:33.254007+0000","last_peered":"2024-03-16T07:32:33.254007+0000","last_clean":"2024-03-16T07:32:33.254007+0000","last_became_active":"2024-03-16T07:32:31.263371+0000","last_became_peered":"2024-03-16T07:32:31.263371+0000","last_unstale":"2024-03-16T07:32:33.254007+0000","last_undegraded":"2024-03-16T07:32:33.254007+0000","last_fullsized":"2024-03-16T07:32:33.254007+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:30.234218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:30.234218+0000","last_clean_scrub_stamp":"2024-03-16T07:32:30.234218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:19:52.362383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.4","version":"0'0","reported_seq":18,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.251197+0000","last_change":"2024-03-16T07:32:18.248158+0000","last_active":"2024-03-16T07:32:32.251197+0000","last_peered":"2024-03-16T07:32:32.251197+0000","last_clean":"2024-03-16T07:32:32.251197+0000","last_became_active":"2024-03-16T07:32:18.246868+0000","last_became_peered":"2024-03-16T07:32:18.246868+0000","last_unstale":"2024-03-16T07:32:32.251197+0000","last_undegraded":"2024-03-16T07:32:32.251197+0000","last_fullsized":"2024-03-16T07:32:32.251197+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:47:18.145134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":20,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.256563+0000","last_change":"2024-03-16T07:32:17.231473+0000","last_active":"2024-03-16T07:32:32.256563+0000","last_peered":"2024-03-16T07:32:32.256563+0000","last_clean":"2024-03-16T07:32:32.256563+0000","last_became_active":"2024-03-16T07:32:17.231194+0000","last_became_peered":"2024-03-16T07:32:17.231194+0000","last_unstale":"2024-03-16T07:32:32.256563+0000","last_undegraded":"2024-03-16T07:32:32.256563+0000","last_fullsized":"2024-03-16T07:32:32.256563+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_clean_scrub_stamp":"2024-03-16T07:32:16.202808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:16:54.463382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.7","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.287513+0000","last_change":"2024-03-16T07:32:32.286065+0000","last_active":"2024-03-16T07:32:32.287513+0000","last_peered":"2024-03-16T07:32:32.287513+0000","last_clean":"2024-03-16T07:32:32.287513+0000","last_became_active":"2024-03-16T07:32:32.285817+0000","last_became_peered":"2024-03-16T07:32:32.285817+0000","last_unstale":"2024-03-16T07:32:32.287513+0000","last_undegraded":"2024-03-16T07:32:32.287513+0000","last_fullsized":"2024-03-16T07:32:32.287513+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_clean_scrub_stamp":"2024-03-16T07:32:31.237650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:55:59.569803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.6","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.255088+0000","last_change":"2024-03-16T07:32:31.258036+0000","last_active":"2024-03-16T07:32:32.255088+0000","last_peered":"2024-03-16T07:32:32.255088+0000","last_clean":"2024-03-16T07:32:32.255088+0000","last_became_active":"2024-03-16T07:32:31.257788+0000","last_became_peered":"2024-03-16T07:32:31.257788+0000","last_unstale":"2024-03-16T07:32:32.255088+0000","last_undegraded":"2024-03-16T07:32:32.255088+0000","last_fullsized":"2024-03-16T07:32:32.255088+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:30.234218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:30.234218+0000","last_clean_scrub_stamp":"2024-03-16T07:32:30.234218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:03:47.115503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.5","version":"0'0","reported_seq":18,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.251282+0000","last_change":"2024-03-16T07:32:18.249281+0000","last_active":"2024-03-16T07:32:32.251282+0000","last_peered":"2024-03-16T07:32:32.251282+0000","last_clean":"2024-03-16T07:32:32.251282+0000","last_became_active":"2024-03-16T07:32:18.248490+0000","last_became_peered":"2024-03-16T07:32:18.248490+0000","last_unstale":"2024-03-16T07:32:32.251282+0000","last_undegraded":"2024-03-16T07:32:32.251282+0000","last_fullsized":"2024-03-16T07:32:32.251282+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:37:27.058282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":20,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.256721+0000","last_change":"2024-03-16T07:32:17.235245+0000","last_active":"2024-03-16T07:32:32.256721+0000","last_peered":"2024-03-16T07:32:32.256721+0000","last_clean":"2024-03-16T07:32:32.256721+0000","last_became_active":"2024-03-16T07:32:17.234881+0000","last_became_peered":"2024-03-16T07:32:17.234881+0000","last_unstale":"2024-03-16T07:32:32.256721+0000","last_undegraded":"2024-03-16T07:32:32.256721+0000","last_fullsized":"2024-03-16T07:32:32.256721+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_clean_scrub_stamp":"2024-03-16T07:32:16.202808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:22:04.317619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.0","version":"0'0","reported_seq":12,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-03-16T07:32:33.251136+0000","last_change":"2024-03-16T07:32:32.282233+0000","last_active":"2024-03-16T07:32:33.251136+0000","last_peered":"2024-03-16T07:32:33.251136+0000","last_clean":"2024-03-16T07:32:33.251136+0000","last_became_active":"2024-03-16T07:32:32.281754+0000","last_became_peered":"2024-03-16T07:32:32.281754+0000","last_unstale":"2024-03-16T07:32:33.251136+0000","last_undegraded":"2024-03-16T07:32:33.251136+0000","last_fullsized":"2024-03-16T07:32:33.251136+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_clean_scrub_stamp":"2024-03-16T07:32:31.237650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:48:53.092100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.1","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.259866+0000","last_change":"2024-03-16T07:32:31.268019+0000","last_active":"2024-03-16T07:32:32.259866+0000","last_peered":"2024-03-16T07:32:32.259866+0000","last_clean":"2024-03-16T07:32:32.259866+0000","last_became_active":"2024-03-16T07:32:31.267745+0000","last_became_peered":"2024-03-16T07:32:31.267745+0000","last_unstale":"2024-03-16T07:32:32.259866+0000","last_undegraded":"2024-03-16T07:32:32.259866+0000","last_fullsized":"2024-03-16T07:32:32.259866+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:30.234218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:30.234218+0000","last_clean_scrub_stamp":"2024-03-16T07:32:30.234218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:17:22.947350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.2","version":"0'0","reported_seq":18,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.249631+0000","last_change":"2024-03-16T07:32:18.247940+0000","last_active":"2024-03-16T07:32:32.249631+0000","last_peered":"2024-03-16T07:32:32.249631+0000","last_clean":"2024-03-16T07:32:32.249631+0000","last_became_active":"2024-03-16T07:32:18.247584+0000","last_became_peered":"2024-03-16T07:32:18.247584+0000","last_unstale":"2024-03-16T07:32:32.249631+0000","last_undegraded":"2024-03-16T07:32:32.249631+0000","last_fullsized":"2024-03-16T07:32:32.249631+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:54:41.949813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":20,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.252236+0000","last_change":"2024-03-16T07:32:17.226266+0000","last_active":"2024-03-16T07:32:32.252236+0000","last_peered":"2024-03-16T07:32:32.252236+0000","last_clean":"2024-03-16T07:32:32.252236+0000","last_became_active":"2024-03-16T07:32:17.226014+0000","last_became_peered":"2024-03-16T07:32:17.226014+0000","last_unstale":"2024-03-16T07:32:32.252236+0000","last_undegraded":"2024-03-16T07:32:32.252236+0000","last_fullsized":"2024-03-16T07:32:32.252236+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_clean_scrub_stamp":"2024-03-16T07:32:16.202808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:23:58.730547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.1","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.279071+0000","last_change":"2024-03-16T07:32:32.278595+0000","last_active":"2024-03-16T07:32:32.279071+0000","last_peered":"2024-03-16T07:32:32.279071+0000","last_clean":"2024-03-16T07:32:32.279071+0000","last_became_active":"2024-03-16T07:32:32.278350+0000","last_became_peered":"2024-03-16T07:32:32.278350+0000","last_unstale":"2024-03-16T07:32:32.279071+0000","last_undegraded":"2024-03-16T07:32:32.279071+0000","last_fullsized":"2024-03-16T07:32:32.279071+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_clean_scrub_stamp":"2024-03-16T07:32:31.237650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:15:46.593815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.0","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.257240+0000","last_change":"2024-03-16T07:32:31.264512+0000","last_active":"2024-03-16T07:32:32.257240+0000","last_peered":"2024-03-16T07:32:32.257240+0000","last_clean":"2024-03-16T07:32:32.257240+0000","last_became_active":"2024-03-16T07:32:31.264003+0000","last_became_peered":"2024-03-16T07:32:31.264003+0000","last_unstale":"2024-03-16T07:32:32.257240+0000","last_undegraded":"2024-03-16T07:32:32.257240+0000","last_fullsized":"2024-03-16T07:32:32.257240+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:30.234218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:30.234218+0000","last_clean_scrub_stamp":"2024-03-16T07:32:30.234218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:18:48.056632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.3","version":"0'0","reported_seq":20,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-03-16T07:32:33.253527+0000","last_change":"2024-03-16T07:32:18.239059+0000","last_active":"2024-03-16T07:32:33.253527+0000","last_peered":"2024-03-16T07:32:33.253527+0000","last_clean":"2024-03-16T07:32:33.253527+0000","last_became_active":"2024-03-16T07:32:18.237797+0000","last_became_peered":"2024-03-16T07:32:18.237797+0000","last_unstale":"2024-03-16T07:32:33.253527+0000","last_undegraded":"2024-03-16T07:32:33.253527+0000","last_fullsized":"2024-03-16T07:32:33.253527+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:56:48.810836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":20,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.249845+0000","last_change":"2024-03-16T07:32:17.231212+0000","last_active":"2024-03-16T07:32:32.249845+0000","last_peered":"2024-03-16T07:32:32.249845+0000","last_clean":"2024-03-16T07:32:32.249845+0000","last_became_active":"2024-03-16T07:32:17.230958+0000","last_became_peered":"2024-03-16T07:32:17.230958+0000","last_unstale":"2024-03-16T07:32:32.249845+0000","last_undegraded":"2024-03-16T07:32:32.249845+0000","last_fullsized":"2024-03-16T07:32:32.249845+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_clean_scrub_stamp":"2024-03-16T07:32:16.202808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:03:51.994607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.2","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.284843+0000","last_change":"2024-03-16T07:32:32.275564+0000","last_active":"2024-03-16T07:32:32.284843+0000","last_peered":"2024-03-16T07:32:32.284843+0000","last_clean":"2024-03-16T07:32:32.284843+0000","last_became_active":"2024-03-16T07:32:32.275288+0000","last_became_peered":"2024-03-16T07:32:32.275288+0000","last_unstale":"2024-03-16T07:32:32.284843+0000","last_undegraded":"2024-03-16T07:32:32.284843+0000","last_fullsized":"2024-03-16T07:32:32.284843+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_clean_scrub_stamp":"2024-03-16T07:32:31.237650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:54:55.605740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.3","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.251535+0000","last_change":"2024-03-16T07:32:31.253806+0000","last_active":"2024-03-16T07:32:32.251535+0000","last_peered":"2024-03-16T07:32:32.251535+0000","last_clean":"2024-03-16T07:32:32.251535+0000","last_became_active":"2024-03-16T07:32:31.253507+0000","last_became_peered":"2024-03-16T07:32:31.253507+0000","last_unstale":"2024-03-16T07:32:32.251535+0000","last_undegraded":"2024-03-16T07:32:32.251535+0000","last_fullsized":"2024-03-16T07:32:32.251535+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:30.234218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:30.234218+0000","last_clean_scrub_stamp":"2024-03-16T07:32:30.234218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:50:49.538400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.0","version":"0'0","reported_seq":18,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.257545+0000","last_change":"2024-03-16T07:32:18.244971+0000","last_active":"2024-03-16T07:32:32.257545+0000","last_peered":"2024-03-16T07:32:32.257545+0000","last_clean":"2024-03-16T07:32:32.257545+0000","last_became_active":"2024-03-16T07:32:18.244256+0000","last_became_peered":"2024-03-16T07:32:18.244256+0000","last_unstale":"2024-03-16T07:32:32.257545+0000","last_undegraded":"2024-03-16T07:32:32.257545+0000","last_fullsized":"2024-03-16T07:32:32.257545+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:12:49.105703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":20,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.250394+0000","last_change":"2024-03-16T07:32:17.233190+0000","last_active":"2024-03-16T07:32:32.250394+0000","last_peered":"2024-03-16T07:32:32.250394+0000","last_clean":"2024-03-16T07:32:32.250394+0000","last_became_active":"2024-03-16T07:32:17.232917+0000","last_became_peered":"2024-03-16T07:32:17.232917+0000","last_unstale":"2024-03-16T07:32:32.250394+0000","last_undegraded":"2024-03-16T07:32:32.250394+0000","last_fullsized":"2024-03-16T07:32:32.250394+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_clean_scrub_stamp":"2024-03-16T07:32:16.202808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:31:01.279190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.3","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.278815+0000","last_change":"2024-03-16T07:32:32.278013+0000","last_active":"2024-03-16T07:32:32.278815+0000","last_peered":"2024-03-16T07:32:32.278815+0000","last_clean":"2024-03-16T07:32:32.278815+0000","last_became_active":"2024-03-16T07:32:32.277770+0000","last_became_peered":"2024-03-16T07:32:32.277770+0000","last_unstale":"2024-03-16T07:32:32.278815+0000","last_undegraded":"2024-03-16T07:32:32.278815+0000","last_fullsized":"2024-03-16T07:32:32.278815+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_clean_scrub_stamp":"2024-03-16T07:32:31.237650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:35:19.514886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.2","version":"0'0","reported_seq":12,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.249317+0000","last_change":"2024-03-16T07:32:31.259348+0000","last_active":"2024-03-16T07:32:32.249317+0000","last_peered":"2024-03-16T07:32:32.249317+0000","last_clean":"2024-03-16T07:32:32.249317+0000","last_became_active":"2024-03-16T07:32:31.259086+0000","last_became_peered":"2024-03-16T07:32:31.259086+0000","last_unstale":"2024-03-16T07:32:32.249317+0000","last_undegraded":"2024-03-16T07:32:32.249317+0000","last_fullsized":"2024-03-16T07:32:32.249317+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:30.234218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:30.234218+0000","last_clean_scrub_stamp":"2024-03-16T07:32:30.234218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:55:21.238125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1","version":"0'0","reported_seq":20,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-03-16T07:32:33.251889+0000","last_change":"2024-03-16T07:32:18.238398+0000","last_active":"2024-03-16T07:32:33.251889+0000","last_peered":"2024-03-16T07:32:33.251889+0000","last_clean":"2024-03-16T07:32:33.251889+0000","last_became_active":"2024-03-16T07:32:18.237807+0000","last_became_peered":"2024-03-16T07:32:18.237807+0000","last_unstale":"2024-03-16T07:32:33.251889+0000","last_undegraded":"2024-03-16T07:32:33.251889+0000","last_fullsized":"2024-03-16T07:32:33.251889+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:29:43.283549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":20,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.257723+0000","last_change":"2024-03-16T07:32:17.233414+0000","last_active":"2024-03-16T07:32:32.257723+0000","last_peered":"2024-03-16T07:32:32.257723+0000","last_clean":"2024-03-16T07:32:32.257723+0000","last_became_active":"2024-03-16T07:32:17.233153+0000","last_became_peered":"2024-03-16T07:32:17.233153+0000","last_unstale":"2024-03-16T07:32:32.257723+0000","last_undegraded":"2024-03-16T07:32:32.257723+0000","last_fullsized":"2024-03-16T07:32:32.257723+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_clean_scrub_stamp":"2024-03-16T07:32:16.202808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:06:54.148824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.1a","version":"0'0","reported_seq":9,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.273560+0000","last_change":"2024-03-16T07:32:32.271483+0000","last_active":"2024-03-16T07:32:32.273560+0000","last_peered":"2024-03-16T07:32:32.273560+0000","last_clean":"2024-03-16T07:32:32.273560+0000","last_became_active":"2024-03-16T07:32:32.271244+0000","last_became_peered":"2024-03-16T07:32:32.271244+0000","last_unstale":"2024-03-16T07:32:32.273560+0000","last_undegraded":"2024-03-16T07:32:32.273560+0000","last_fullsized":"2024-03-16T07:32:32.273560+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:31.237650+0000","last_clean_scrub_stamp":"2024-03-16T07:32:31.237650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:01:22.947696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.1b","version":"145'1","reported_seq":13,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.269991+0000","last_change":"2024-03-16T07:32:31.261168+0000","last_active":"2024-03-16T07:32:32.269991+0000","last_peered":"2024-03-16T07:32:32.269991+0000","last_clean":"2024-03-16T07:32:32.269991+0000","last_became_active":"2024-03-16T07:32:31.260562+0000","last_became_peered":"2024-03-16T07:32:31.260562+0000","last_unstale":"2024-03-16T07:32:32.269991+0000","last_undegraded":"2024-03-16T07:32:32.269991+0000","last_fullsized":"2024-03-16T07:32:32.269991+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":143,"last_epoch_clean":144,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:30.234218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:30.234218+0000","last_clean_scrub_stamp":"2024-03-16T07:32:30.234218+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:43:16.055994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.18","version":"0'0","reported_seq":18,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.267586+0000","last_change":"2024-03-16T07:32:18.218918+0000","last_active":"2024-03-16T07:32:32.267586+0000","last_peered":"2024-03-16T07:32:32.267586+0000","last_clean":"2024-03-16T07:32:32.267586+0000","last_became_active":"2024-03-16T07:32:18.218148+0000","last_became_peered":"2024-03-16T07:32:18.218148+0000","last_unstale":"2024-03-16T07:32:32.267586+0000","last_undegraded":"2024-03-16T07:32:32.267586+0000","last_fullsized":"2024-03-16T07:32:32.267586+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:17.204025+0000","last_clean_scrub_stamp":"2024-03-16T07:32:17.204025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:06:13.762192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":20,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.260254+0000","last_change":"2024-03-16T07:32:17.230782+0000","last_active":"2024-03-16T07:32:32.260254+0000","last_peered":"2024-03-16T07:32:32.260254+0000","last_clean":"2024-03-16T07:32:32.260254+0000","last_became_active":"2024-03-16T07:32:17.229981+0000","last_became_peered":"2024-03-16T07:32:17.229981+0000","last_unstale":"2024-03-16T07:32:32.260254+0000","last_undegraded":"2024-03-16T07:32:32.260254+0000","last_fullsized":"2024-03-16T07:32:32.260254+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:32:16.202808+0000","last_clean_scrub_stamp":"2024-03-16T07:32:16.202808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:02:31.073119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"126'196","reported_seq":739,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-03-16T07:32:32.257845+0000","last_change":"2024-03-16T07:24:31.650537+0000","last_active":"2024-03-16T07:32:32.257845+0000","last_peered":"2024-03-16T07:32:32.257845+0000","last_clean":"2024-03-16T07:32:32.257845+0000","last_became_active":"2024-03-16T07:24:31.649574+0000","last_became_peered":"2024-03-16T07:24:31.649574+0000","last_unstale":"2024-03-16T07:32:32.257845+0000","last_undegraded":"2024-03-16T07:32:32.257845+0000","last_fullsized":"2024-03-16T07:32:32.257845+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:29.719970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:29.719970+0000","last_clean_scrub_stamp":"2024-03-16T07:24:29.719970+0000","objects_scrubbed":0,"log_size":196,"log_dups_size":0,"ondisk_log_size":196,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:31:35.774554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":970,"num_read_kb":1945,"num_write":317,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":26,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":3},{"poolid":25,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":24,"num_pg":32,"stat_sum":{"num_bytes":4107,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":8214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":3},{"poolid":27,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":970,"num_read_kb":1945,"num_write":317,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738462,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":36856,"kb_used_data":1508,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":104820744,"statfs":{"total":107374182400,"available":107336441856,"internally_reserved":0,"allocated":1544192,"data_stored":617580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738462,"num_pgs":107,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":37420,"kb_used_data":2076,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":104820180,"statfs":{"total":107374182400,"available":107335864320,"internally_reserved":0,"allocated":2125824,"data_stored":1205138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738462,"num_pgs":136,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":37416,"kb_used_data":2072,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":104820184,"statfs":{"total":107374182400,"available":107335868416,"internally_reserved":0,"allocated":2121728,"data_stored":1204746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":4107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-16T07:32:36.702 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-03-16T07:32:36.703 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T07:32:37.082 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:32:37.082 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":105,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6315,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6828/2438276517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":2438276517},{"type":"v1","addr":"172.21.15.49:6828","nonce":2438276517}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":94},{"gid":6316,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6829/1412184122","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6827","nonce":1412184122},{"type":"v1","addr":"172.21.15.49:6829","nonce":1412184122}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":94},{"gid":6321,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6831/3610285344","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":3610285344},{"type":"v1","addr":"172.21.15.49:6831","nonce":3610285344}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":94}],"filesystems":[{"mdsmap":{"epoch":99,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-16T07:32:17.592092+0000","modified":"2024-03-16T07:32:20.584913+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6325},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6325":{"gid":6325,"name":"a","rank":0,"incarnation":95,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6835/2709512109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":2709512109},{"type":"v1","addr":"172.21.15.49:6835","nonce":2709512109}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6325,"qdb_cluster":[6325]},"id":12},{"mdsmap":{"epoch":105,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-16T07:32:31.616889+0000","modified":"2024-03-16T07:32:34.616124+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6324},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6324":{"gid":6324,"name":"c","rank":0,"incarnation":101,"state":"up:active","state_seq":6,"addr":"172.21.15.49:6833/1457417734","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":1457417734},{"type":"v1","addr":"172.21.15.49:6833","nonce":1457417734}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[27],"metadata_pool":26,"enabled":true,"fs_name":"backup_fs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6324,"qdb_cluster":[6324]},"id":13}]} 2024-03-16T07:32:37.083 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 105 2024-03-16T07:32:37.598 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 105, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-03-16T07:32:31.616889+0000', 'modified': '2024-03-16T07:32:34.616124+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6324}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6324': {'gid': 6324, 'name': 'c', 'rank': 0, 'incarnation': 101, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.49:6833/1457417734', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.49:6832', 'nonce': 1457417734}, {'type': 'v1', 'addr': '172.21.15.49:6833', 'nonce': 1457417734}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [27], 'metadata_pool': 26, 'enabled': True, 'fs_name': 'backup_fs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 6324, 'qdb_cluster': [6324]} 2024-03-16T07:32:37.599 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-03-16T07:32:37.599 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-03-16T07:32:37.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-16T07:32:37.725+0000 7f5f0d7fa640 0 client.6457 ms_handle_reset on v2:172.21.15.49:6832/1457417734 2024-03-16T07:32:37.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-16T07:32:37.748+0000 7f5f0d7fa640 0 client.6459 ms_handle_reset on v2:172.21.15.49:6832/1457417734 2024-03-16T07:32:37.747 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-03-16T07:32:37.747 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_fsid": "f91af061-9eac-4793-87fa-8d27ae3d242f", 2024-03-16T07:32:37.747 INFO:teuthology.orchestra.run.smithi049.stdout: "whoami": 0, 2024-03-16T07:32:37.747 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 6324, 2024-03-16T07:32:37.747 INFO:teuthology.orchestra.run.smithi049.stdout: "want_state": "up:active", 2024-03-16T07:32:37.747 INFO:teuthology.orchestra.run.smithi049.stdout: "state": "up:active", 2024-03-16T07:32:37.747 INFO:teuthology.orchestra.run.smithi049.stdout: "fs_name": "backup_fs", 2024-03-16T07:32:37.747 INFO:teuthology.orchestra.run.smithi049.stdout: "rank_uptime": 5.5071145169999998, 2024-03-16T07:32:37.747 INFO:teuthology.orchestra.run.smithi049.stdout: "mdsmap_epoch": 105, 2024-03-16T07:32:37.747 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch": 146, 2024-03-16T07:32:37.747 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch_barrier": 146, 2024-03-16T07:32:37.747 INFO:teuthology.orchestra.run.smithi049.stdout: "uptime": 24.820129928 2024-03-16T07:32:37.747 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-03-16T07:32:37.758 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable mirroring 2024-03-16T07:32:38.923 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T07:32:39.284 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-03-16T07:32:39.284 DEBUG:teuthology.orchestra.run.smithi049:counter dump for fs: cephfs> ceph --admin-daemon /var/run/ceph/cephfs-mirror.asok counter dump 2024-03-16T07:32:39.396 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-03-16T07:32:39.396 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker": [ 2024-03-16T07:32:39.396 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:32:39.396 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:32:39.396 INFO:teuthology.orchestra.run.smithi049.stdout: "id": "0" 2024-03-16T07:32:39.396 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:32:39.396 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:32:39.396 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_ready_timeouts": 0, 2024-03-16T07:32:39.396 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_idle_timeouts": 0 2024-03-16T07:32:39.397 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:32:39.397 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:32:39.397 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:32:39.397 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:32:39.397 INFO:teuthology.orchestra.run.smithi049.stdout: "id": "1" 2024-03-16T07:32:39.397 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:32:39.397 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:32:39.397 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_ready_timeouts": 0, 2024-03-16T07:32:39.397 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_idle_timeouts": 0 2024-03-16T07:32:39.397 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:32:39.397 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:32:39.397 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:32:39.397 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:32:39.397 INFO:teuthology.orchestra.run.smithi049.stdout: "id": "2" 2024-03-16T07:32:39.398 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:32:39.398 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:32:39.398 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_ready_timeouts": 0, 2024-03-16T07:32:39.398 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_idle_timeouts": 0 2024-03-16T07:32:39.398 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:32:39.398 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:32:39.398 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:32:39.398 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-0": [ 2024-03-16T07:32:39.398 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:32:39.398 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:32:39.398 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:32:39.398 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 10, 2024-03-16T07:32:39.398 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 103, 2024-03-16T07:32:39.398 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 1440, 2024-03-16T07:32:39.399 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 811056, 2024-03-16T07:32:39.399 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 21, 2024-03-16T07:32:39.399 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 2, 2024-03-16T07:32:39.399 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 0.310055581, 2024-03-16T07:32:39.399 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.107876852, 2024-03-16T07:32:39.399 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 0.158809854, 2024-03-16T07:32:39.399 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-03-16T07:32:39.399 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T07:32:39.399 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 93, 2024-03-16T07:32:39.399 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.177408866, 2024-03-16T07:32:39.399 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.001907622 2024-03-16T07:32:39.399 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:32:39.399 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-03-16T07:32:39.399 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:32:39.399 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:32:39.400 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:32:39.400 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:32:39.400 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 1440, 2024-03-16T07:32:39.400 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 811056 2024-03-16T07:32:39.400 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:32:39.400 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:32:39.400 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:32:39.400 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-1": [ 2024-03-16T07:32:39.400 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:32:39.400 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:32:39.400 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:32:39.400 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 101, 2024-03-16T07:32:39.400 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 5, 2024-03-16T07:32:39.400 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 421344, 2024-03-16T07:32:39.400 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 1136, 2024-03-16T07:32:39.401 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 3, 2024-03-16T07:32:39.401 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 0, 2024-03-16T07:32:39.401 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 0.489260927, 2024-03-16T07:32:39.401 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.004733568, 2024-03-16T07:32:39.401 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 0.316577288, 2024-03-16T07:32:39.401 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.150068710, 2024-03-16T07:32:39.401 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T07:32:39.401 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 5, 2024-03-16T07:32:39.401 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.054797003, 2024-03-16T07:32:39.401 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.010959400 2024-03-16T07:32:39.401 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:32:39.401 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-03-16T07:32:39.401 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:32:39.401 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:32:39.402 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:32:39.402 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:32:39.402 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 421344, 2024-03-16T07:32:39.402 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 1136 2024-03-16T07:32:39.402 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:32:39.402 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:32:39.402 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:32:39.402 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-2": [ 2024-03-16T07:32:39.402 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:32:39.402 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:32:39.402 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:32:39.402 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 58, 2024-03-16T07:32:39.402 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 8, 2024-03-16T07:32:39.402 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 2239088, 2024-03-16T07:32:39.402 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 1600, 2024-03-16T07:32:39.403 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 2, 2024-03-16T07:32:39.403 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 1, 2024-03-16T07:32:39.403 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 1.134487279, 2024-03-16T07:32:39.403 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.007573948, 2024-03-16T07:32:39.403 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 2.176649568, 2024-03-16T07:32:39.403 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-03-16T07:32:39.403 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T07:32:39.403 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 8, 2024-03-16T07:32:39.403 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.161009804, 2024-03-16T07:32:39.403 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.020126225 2024-03-16T07:32:39.403 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:32:39.403 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-03-16T07:32:39.403 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:32:39.403 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:32:39.404 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:32:39.404 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:32:39.404 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 2239088, 2024-03-16T07:32:39.404 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 1600 2024-03-16T07:32:39.404 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:32:39.404 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:32:39.404 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:32:39.404 INFO:teuthology.orchestra.run.smithi049.stdout: "cct": [ 2024-03-16T07:32:39.404 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:32:39.404 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:32:39.404 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:32:39.404 INFO:teuthology.orchestra.run.smithi049.stdout: "total_workers": 0, 2024-03-16T07:32:39.404 INFO:teuthology.orchestra.run.smithi049.stdout: "unhealthy_workers": 0 2024-03-16T07:32:39.404 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:32:39.404 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:32:39.405 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:32:39.405 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs_mirror": [ 2024-03-16T07:32:39.405 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:32:39.405 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:32:39.405 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:32:39.405 INFO:teuthology.orchestra.run.smithi049.stdout: "mirrored_filesystems": 0, 2024-03-16T07:32:39.405 INFO:teuthology.orchestra.run.smithi049.stdout: "mirror_enable_failures": 0 2024-03-16T07:32:39.405 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:32:39.405 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:32:39.405 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:32:39.405 INFO:teuthology.orchestra.run.smithi049.stdout: "mempool": [ 2024-03-16T07:32:39.405 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:32:39.405 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:32:39.405 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:32:39.405 INFO:teuthology.orchestra.run.smithi049.stdout: "bloom_filter_bytes": 0, 2024-03-16T07:32:39.406 INFO:teuthology.orchestra.run.smithi049.stdout: "bloom_filter_items": 0, 2024-03-16T07:32:39.406 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_alloc_bytes": 0, 2024-03-16T07:32:39.406 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_alloc_items": 0, 2024-03-16T07:32:39.406 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_data_bytes": 0, 2024-03-16T07:32:39.406 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_data_items": 0, 2024-03-16T07:32:39.406 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_onode_bytes": 0, 2024-03-16T07:32:39.406 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_onode_items": 0, 2024-03-16T07:32:39.406 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_meta_bytes": 0, 2024-03-16T07:32:39.406 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_meta_items": 0, 2024-03-16T07:32:39.406 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_other_bytes": 0, 2024-03-16T07:32:39.406 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_other_items": 0, 2024-03-16T07:32:39.406 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_buffer_bytes": 0, 2024-03-16T07:32:39.406 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_buffer_items": 0, 2024-03-16T07:32:39.406 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_extent_bytes": 0, 2024-03-16T07:32:39.407 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_extent_items": 0, 2024-03-16T07:32:39.407 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_blob_bytes": 0, 2024-03-16T07:32:39.407 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_blob_items": 0, 2024-03-16T07:32:39.407 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_shared_blob_bytes": 0, 2024-03-16T07:32:39.407 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_shared_blob_items": 0, 2024-03-16T07:32:39.407 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_inline_bl_bytes": 0, 2024-03-16T07:32:39.407 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_inline_bl_items": 0, 2024-03-16T07:32:39.407 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_fsck_bytes": 0, 2024-03-16T07:32:39.407 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_fsck_items": 0, 2024-03-16T07:32:39.407 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_txc_bytes": 0, 2024-03-16T07:32:39.407 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_txc_items": 0, 2024-03-16T07:32:39.407 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_deferred_bytes": 0, 2024-03-16T07:32:39.407 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_deferred_items": 0, 2024-03-16T07:32:39.407 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_bytes": 0, 2024-03-16T07:32:39.408 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_items": 0, 2024-03-16T07:32:39.408 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_bytes": 0, 2024-03-16T07:32:39.408 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_items": 0, 2024-03-16T07:32:39.408 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_reader_bytes": 0, 2024-03-16T07:32:39.408 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_reader_items": 0, 2024-03-16T07:32:39.408 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_writer_bytes": 0, 2024-03-16T07:32:39.408 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_writer_items": 0, 2024-03-16T07:32:39.408 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_anon_bytes": 149234, 2024-03-16T07:32:39.408 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_anon_items": 26, 2024-03-16T07:32:39.408 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_meta_bytes": 0, 2024-03-16T07:32:39.408 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_meta_items": 0, 2024-03-16T07:32:39.408 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_bytes": 0, 2024-03-16T07:32:39.408 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_items": 0, 2024-03-16T07:32:39.409 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_mapbl_bytes": 0, 2024-03-16T07:32:39.409 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_mapbl_items": 0, 2024-03-16T07:32:39.409 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pglog_bytes": 0, 2024-03-16T07:32:39.409 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pglog_items": 0, 2024-03-16T07:32:39.409 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_bytes": 4824, 2024-03-16T07:32:39.409 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_items": 52, 2024-03-16T07:32:39.409 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_mapping_bytes": 0, 2024-03-16T07:32:39.409 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_mapping_items": 0, 2024-03-16T07:32:39.409 INFO:teuthology.orchestra.run.smithi049.stdout: "pgmap_bytes": 0, 2024-03-16T07:32:39.409 INFO:teuthology.orchestra.run.smithi049.stdout: "pgmap_items": 0, 2024-03-16T07:32:39.409 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_co_bytes": 0, 2024-03-16T07:32:39.409 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_co_items": 0, 2024-03-16T07:32:39.409 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_1_bytes": 0, 2024-03-16T07:32:39.409 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_1_items": 0, 2024-03-16T07:32:39.410 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_2_bytes": 0, 2024-03-16T07:32:39.410 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_2_items": 0 2024-03-16T07:32:39.410 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:32:39.410 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:32:39.410 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:32:39.410 INFO:teuthology.orchestra.run.smithi049.stdout: "objecter": [ 2024-03-16T07:32:39.410 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:32:39.410 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:32:39.410 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:32:39.410 INFO:teuthology.orchestra.run.smithi049.stdout: "op_active": 0, 2024-03-16T07:32:39.410 INFO:teuthology.orchestra.run.smithi049.stdout: "op_laggy": 0, 2024-03-16T07:32:39.410 INFO:teuthology.orchestra.run.smithi049.stdout: "op_send": 0, 2024-03-16T07:32:39.410 INFO:teuthology.orchestra.run.smithi049.stdout: "op_send_bytes": 0, 2024-03-16T07:32:39.410 INFO:teuthology.orchestra.run.smithi049.stdout: "op_resend": 0, 2024-03-16T07:32:39.410 INFO:teuthology.orchestra.run.smithi049.stdout: "op_reply": 0, 2024-03-16T07:32:39.411 INFO:teuthology.orchestra.run.smithi049.stdout: "op_latency": { 2024-03-16T07:32:39.411 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:32:39.411 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:32:39.411 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:32:39.411 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:32:39.411 INFO:teuthology.orchestra.run.smithi049.stdout: "op_inflight": 0, 2024-03-16T07:32:39.411 INFO:teuthology.orchestra.run.smithi049.stdout: "oplen_avg": { 2024-03-16T07:32:39.411 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:32:39.411 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0 2024-03-16T07:32:39.411 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:32:39.411 INFO:teuthology.orchestra.run.smithi049.stdout: "op": 0, 2024-03-16T07:32:39.411 INFO:teuthology.orchestra.run.smithi049.stdout: "op_r": 0, 2024-03-16T07:32:39.412 INFO:teuthology.orchestra.run.smithi049.stdout: "op_w": 0, 2024-03-16T07:32:39.412 INFO:teuthology.orchestra.run.smithi049.stdout: "op_rmw": 0, 2024-03-16T07:32:39.412 INFO:teuthology.orchestra.run.smithi049.stdout: "op_pg": 0, 2024-03-16T07:32:39.412 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_stat": 0, 2024-03-16T07:32:39.412 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_create": 0, 2024-03-16T07:32:39.412 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_read": 0, 2024-03-16T07:32:39.412 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_write": 0, 2024-03-16T07:32:39.412 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_writefull": 0, 2024-03-16T07:32:39.412 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_writesame": 0, 2024-03-16T07:32:39.412 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_append": 0, 2024-03-16T07:32:39.412 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_zero": 0, 2024-03-16T07:32:39.412 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_truncate": 0, 2024-03-16T07:32:39.412 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_delete": 0, 2024-03-16T07:32:39.412 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_mapext": 0, 2024-03-16T07:32:39.413 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_sparse_read": 0, 2024-03-16T07:32:39.413 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_clonerange": 0, 2024-03-16T07:32:39.413 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_getxattr": 0, 2024-03-16T07:32:39.413 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_setxattr": 0, 2024-03-16T07:32:39.413 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_cmpxattr": 0, 2024-03-16T07:32:39.413 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_rmxattr": 0, 2024-03-16T07:32:39.413 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_resetxattrs": 0, 2024-03-16T07:32:39.413 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_call": 0, 2024-03-16T07:32:39.413 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_watch": 0, 2024-03-16T07:32:39.413 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_notify": 0, 2024-03-16T07:32:39.413 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_src_cmpxattr": 0, 2024-03-16T07:32:39.413 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_pgls": 0, 2024-03-16T07:32:39.413 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_pgls_filter": 0, 2024-03-16T07:32:39.413 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_other": 0, 2024-03-16T07:32:39.414 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_active": 0, 2024-03-16T07:32:39.414 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_send": 0, 2024-03-16T07:32:39.414 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_resend": 0, 2024-03-16T07:32:39.414 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_ping": 0, 2024-03-16T07:32:39.414 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_active": 0, 2024-03-16T07:32:39.414 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_send": 0, 2024-03-16T07:32:39.414 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_resend": 0, 2024-03-16T07:32:39.414 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_active": 0, 2024-03-16T07:32:39.414 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_send": 0, 2024-03-16T07:32:39.414 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_resend": 0, 2024-03-16T07:32:39.414 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_active": 0, 2024-03-16T07:32:39.414 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_send": 0, 2024-03-16T07:32:39.414 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_resend": 0, 2024-03-16T07:32:39.415 INFO:teuthology.orchestra.run.smithi049.stdout: "command_active": 0, 2024-03-16T07:32:39.415 INFO:teuthology.orchestra.run.smithi049.stdout: "command_send": 0, 2024-03-16T07:32:39.415 INFO:teuthology.orchestra.run.smithi049.stdout: "command_resend": 0, 2024-03-16T07:32:39.415 INFO:teuthology.orchestra.run.smithi049.stdout: "map_epoch": 0, 2024-03-16T07:32:39.415 INFO:teuthology.orchestra.run.smithi049.stdout: "map_full": 0, 2024-03-16T07:32:39.415 INFO:teuthology.orchestra.run.smithi049.stdout: "map_inc": 0, 2024-03-16T07:32:39.415 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_sessions": 0, 2024-03-16T07:32:39.415 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_session_open": 0, 2024-03-16T07:32:39.415 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_session_close": 0, 2024-03-16T07:32:39.415 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_laggy": 0, 2024-03-16T07:32:39.415 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_wr": 0, 2024-03-16T07:32:39.415 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_rd": 0, 2024-03-16T07:32:39.415 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_del": 0 2024-03-16T07:32:39.415 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:32:39.415 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:32:39.415 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:32:39.415 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-msgr_dispatch_throttler-client": [ 2024-03-16T07:32:39.416 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:32:39.416 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:32:39.416 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:32:39.416 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:32:39.416 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-03-16T07:32:39.416 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:32:39.416 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 101, 2024-03-16T07:32:39.416 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 407623, 2024-03-16T07:32:39.416 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:32:39.416 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 101, 2024-03-16T07:32:39.416 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:32:39.416 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:32:39.416 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 101, 2024-03-16T07:32:39.416 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 407623, 2024-03-16T07:32:39.416 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:32:39.416 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:32:39.417 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:32:39.417 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:32:39.417 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:32:39.417 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:32:39.417 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:32:39.417 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:32:39.417 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-msgr_dispatch_throttler-radosclient": [ 2024-03-16T07:32:39.417 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:32:39.417 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:32:39.417 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:32:39.417 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:32:39.417 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-03-16T07:32:39.417 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:32:39.417 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 65, 2024-03-16T07:32:39.417 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 2230825, 2024-03-16T07:32:39.417 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:32:39.418 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 65, 2024-03-16T07:32:39.418 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:32:39.418 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:32:39.418 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 65, 2024-03-16T07:32:39.418 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 2230825, 2024-03-16T07:32:39.418 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:32:39.418 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:32:39.418 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:32:39.418 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:32:39.418 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:32:39.418 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:32:39.418 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:32:39.418 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:32:39.418 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-objecter_bytes": [ 2024-03-16T07:32:39.419 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:32:39.419 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:32:39.419 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:32:39.419 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:32:39.419 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-03-16T07:32:39.419 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:32:39.419 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 0, 2024-03-16T07:32:39.419 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 0, 2024-03-16T07:32:39.419 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:32:39.419 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 0, 2024-03-16T07:32:39.419 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:32:39.419 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:32:39.419 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 0, 2024-03-16T07:32:39.419 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 0, 2024-03-16T07:32:39.419 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:32:39.420 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:32:39.420 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:32:39.420 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:32:39.420 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:32:39.420 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:32:39.420 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:32:39.420 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:32:39.420 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-objecter_ops": [ 2024-03-16T07:32:39.420 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:32:39.420 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:32:39.420 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:32:39.420 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:32:39.420 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 1024, 2024-03-16T07:32:39.420 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:32:39.420 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 0, 2024-03-16T07:32:39.420 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 0, 2024-03-16T07:32:39.421 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:32:39.421 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 0, 2024-03-16T07:32:39.421 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:32:39.421 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:32:39.421 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 0, 2024-03-16T07:32:39.421 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 0, 2024-03-16T07:32:39.421 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:32:39.422 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:32:39.422 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:32:39.422 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:32:39.422 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:32:39.422 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:32:39.422 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:32:39.422 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2024-03-16T07:32:39.422 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-03-16T07:32:39.424 DEBUG:tasks.cephfs.test_mirroring:command returned={ "AsyncMessenger::Worker": [ { "labels": { "id": "0" }, "counters": { "msgr_connection_ready_timeouts": 0, "msgr_connection_idle_timeouts": 0 } }, { "labels": { "id": "1" }, "counters": { "msgr_connection_ready_timeouts": 0, "msgr_connection_idle_timeouts": 0 } }, { "labels": { "id": "2" }, "counters": { "msgr_connection_ready_timeouts": 0, "msgr_connection_idle_timeouts": 0 } } ], "AsyncMessenger::Worker-0": [ { "labels": {}, "counters": { "msgr_recv_messages": 10, "msgr_send_messages": 103, "msgr_recv_bytes": 1440, "msgr_send_bytes": 811056, "msgr_created_connections": 21, "msgr_active_connections": 2, "msgr_running_total_time": 0.310055581, "msgr_running_send_time": 0.107876852, "msgr_running_recv_time": 0.158809854, "msgr_running_fast_dispatch_time": 0.000000000, "msgr_send_messages_queue_lat": { "avgcount": 93, "sum": 0.177408866, "avgtime": 0.001907622 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "msgr_recv_encrypted_bytes": 1440, "msgr_send_encrypted_bytes": 811056 } } ], "AsyncMessenger::Worker-1": [ { "labels": {}, "counters": { "msgr_recv_messages": 101, "msgr_send_messages": 5, "msgr_recv_bytes": 421344, "msgr_send_bytes": 1136, "msgr_created_connections": 3, "msgr_active_connections": 0, "msgr_running_total_time": 0.489260927, "msgr_running_send_time": 0.004733568, "msgr_running_recv_time": 0.316577288, "msgr_running_fast_dispatch_time": 0.150068710, "msgr_send_messages_queue_lat": { "avgcount": 5, "sum": 0.054797003, "avgtime": 0.010959400 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "msgr_recv_encrypted_bytes": 421344, "msgr_send_encrypted_bytes": 1136 } } ], "AsyncMessenger::Worker-2": [ { "labels": {}, "counters": { "msgr_recv_messages": 58, "msgr_send_messages": 8, "msgr_recv_bytes": 2239088, "msgr_send_bytes": 1600, "msgr_created_connections": 2, "msgr_active_connections": 1, "msgr_running_total_time": 1.134487279, "msgr_running_send_time": 0.007573948, "msgr_running_recv_time": 2.176649568, "msgr_running_fast_dispatch_time": 0.000000000, "msgr_send_messages_queue_lat": { "avgcount": 8, "sum": 0.161009804, "avgtime": 0.020126225 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "msgr_recv_encrypted_bytes": 2239088, "msgr_send_encrypted_bytes": 1600 } } ], "cct": [ { "labels": {}, "counters": { "total_workers": 0, "unhealthy_workers": 0 } } ], "cephfs_mirror": [ { "labels": {}, "counters": { "mirrored_filesystems": 0, "mirror_enable_failures": 0 } } ], "mempool": [ { "labels": {}, "counters": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_cache_buffer_bytes": 0, "bluestore_cache_buffer_items": 0, "bluestore_extent_bytes": 0, "bluestore_extent_items": 0, "bluestore_blob_bytes": 0, "bluestore_blob_items": 0, "bluestore_shared_blob_bytes": 0, "bluestore_shared_blob_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_items": 0, "bluefs_bytes": 0, "bluefs_items": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "buffer_anon_bytes": 149234, "buffer_anon_items": 26, "buffer_meta_bytes": 0, "buffer_meta_items": 0, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 4824, "osdmap_items": 52, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "mds_co_bytes": 0, "mds_co_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 } } ], "objecter": [ { "labels": {}, "counters": { "op_active": 0, "op_laggy": 0, "op_send": 0, "op_send_bytes": 0, "op_resend": 0, "op_reply": 0, "op_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "op_inflight": 0, "oplen_avg": { "avgcount": 0, "sum": 0 }, "op": 0, "op_r": 0, "op_w": 0, "op_rmw": 0, "op_pg": 0, "osdop_stat": 0, "osdop_create": 0, "osdop_read": 0, "osdop_write": 0, "osdop_writefull": 0, "osdop_writesame": 0, "osdop_append": 0, "osdop_zero": 0, "osdop_truncate": 0, "osdop_delete": 0, "osdop_mapext": 0, "osdop_sparse_read": 0, "osdop_clonerange": 0, "osdop_getxattr": 0, "osdop_setxattr": 0, "osdop_cmpxattr": 0, "osdop_rmxattr": 0, "osdop_resetxattrs": 0, "osdop_call": 0, "osdop_watch": 0, "osdop_notify": 0, "osdop_src_cmpxattr": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_other": 0, "linger_active": 0, "linger_send": 0, "linger_resend": 0, "linger_ping": 0, "poolop_active": 0, "poolop_send": 0, "poolop_resend": 0, "poolstat_active": 0, "poolstat_send": 0, "poolstat_resend": 0, "statfs_active": 0, "statfs_send": 0, "statfs_resend": 0, "command_active": 0, "command_send": 0, "command_resend": 0, "map_epoch": 0, "map_full": 0, "map_inc": 0, "osd_sessions": 0, "osd_session_open": 0, "osd_session_close": 0, "osd_laggy": 0, "omap_wr": 0, "omap_rd": 0, "omap_del": 0 } } ], "throttle-msgr_dispatch_throttler-client": [ { "labels": {}, "counters": { "val": 0, "max": 104857600, "get_started": 0, "get": 101, "get_sum": 407623, "get_or_fail_fail": 0, "get_or_fail_success": 101, "take": 0, "take_sum": 0, "put": 101, "put_sum": 407623, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ], "throttle-msgr_dispatch_throttler-radosclient": [ { "labels": {}, "counters": { "val": 0, "max": 104857600, "get_started": 0, "get": 65, "get_sum": 2230825, "get_or_fail_fail": 0, "get_or_fail_success": 65, "take": 0, "take_sum": 0, "put": 65, "put_sum": 2230825, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ], "throttle-objecter_bytes": [ { "labels": {}, "counters": { "val": 0, "max": 104857600, "get_started": 0, "get": 0, "get_sum": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "take": 0, "take_sum": 0, "put": 0, "put_sum": 0, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ], "throttle-objecter_ops": [ { "labels": {}, "counters": { "val": 0, "max": 1024, "get_started": 0, "get": 0, "get_sum": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "take": 0, "take_sum": 0, "put": 0, "put_sum": 0, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ] } 2024-03-16T07:32:39.424 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snapshot mirror enable cephfs 2024-03-16T07:32:39.778 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:32:39.779+0000 7fbb04017040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-16T07:32:39.826 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:32:39.828+0000 7fbb04017040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-16T07:32:40.235 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:32:40.237+0000 7fbb04017040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-16T07:32:40.293 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:32:40.295+0000 7fbb04017040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-16T07:32:40.372 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:32:40.373+0000 7fbb04017040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-16T07:32:40.445 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:32:40.447+0000 7fbb04017040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-16T07:32:40.489 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:32:40.491+0000 7fbb04017040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-16T07:32:40.608 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:32:40.610+0000 7fbb04017040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-16T07:32:40.664 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:32:40.666+0000 7fbb04017040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-16T07:32:40.720 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:32:40.722+0000 7fbb04017040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-16T07:32:40.810 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:32:40.811+0000 7fbb04017040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-16T07:32:40.888 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:32:40.890+0000 7fbb04017040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-16T07:32:41.326 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:32:41.328+0000 7fbb04017040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-16T07:32:41.540 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:32:41.541+0000 7fbb04017040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-16T07:32:41.636 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:32:41.638+0000 7fbb04017040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-16T07:32:41.681 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:32:41.683+0000 7fbb04017040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-16T07:32:41.847 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:32:41.849+0000 7fbb04017040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-16T07:32:41.943 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:32:41.944+0000 7fbb04017040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-16T07:32:42.141 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:32:42.143+0000 7fbb04017040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-16T07:32:42.197 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:32:42.198+0000 7fbb04017040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-16T07:32:42.331 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:32:42.332+0000 7fbb04017040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-16T07:32:43.006 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:32:43.007+0000 7fbb04017040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-16T07:32:43.287 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:32:43.289+0000 7fbb04017040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-16T07:32:43.339 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:32:43.340+0000 7fbb04017040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-16T07:32:43.459 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:32:43.461+0000 7fbb04017040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-16T07:32:43.547 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:32:43.548+0000 7fba80847640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:32:43.547 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:32:43.548+0000 7fba80847640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:32:43.547 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:32:43.548+0000 7fba80847640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:32:43.547 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:32:43.548+0000 7fba80847640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:32:43.547 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:32:43.548+0000 7fba80847640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:32:43.547 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:32:43.548+0000 7fba8384d640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:32:43.547 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:32:43.548+0000 7fba8384d640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:32:43.547 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:32:43.548+0000 7fba8384d640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:32:43.547 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:32:43.548+0000 7fba8384d640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:32:43.548 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:32:43.548+0000 7fba8384d640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:32:43.562 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:32:43.564+0000 7fba80847640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:32:43.562 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:32:43.564+0000 7fba80847640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:32:43.562 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:32:43.564+0000 7fba80847640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:32:43.562 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:32:43.564+0000 7fba80847640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:32:43.562 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:32:43.564+0000 7fba80847640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:32:43.563 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:32:43.564+0000 7fba8384d640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:32:43.563 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:32:43.564+0000 7fba8384d640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:32:43.563 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:32:43.564+0000 7fba8384d640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:32:43.563 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:32:43.564+0000 7fba8384d640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:32:43.563 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:32:43.564+0000 7fba8384d640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:32:45.484 INFO:teuthology.orchestra.run.smithi049.stdout:{} 2024-03-16T07:32:55.498 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-03-16T07:32:55.498 DEBUG:teuthology.orchestra.run.smithi049:mirror status for fs: cephfs> ceph --admin-daemon /var/run/ceph/cephfs-mirror.asok fs mirror status cephfs@12 2024-03-16T07:32:55.612 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-03-16T07:32:55.612 INFO:teuthology.orchestra.run.smithi049.stdout: "rados_inst": "172.21.15.49:0/4185192406", 2024-03-16T07:32:55.612 INFO:teuthology.orchestra.run.smithi049.stdout: "peers": {}, 2024-03-16T07:32:55.612 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_dirs": { 2024-03-16T07:32:55.613 INFO:teuthology.orchestra.run.smithi049.stdout: "dir_count": 0 2024-03-16T07:32:55.613 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:32:55.613 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-03-16T07:32:55.623 DEBUG:tasks.cephfs.test_mirroring:command returned={ "rados_inst": "172.21.15.49:0/4185192406", "peers": {}, "snap_dirs": { "dir_count": 0 } } 2024-03-16T07:32:55.623 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-03-16T07:32:55.623 DEBUG:teuthology.orchestra.run.smithi049:counter dump for fs: cephfs> ceph --admin-daemon /var/run/ceph/cephfs-mirror.asok counter dump 2024-03-16T07:32:55.753 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-03-16T07:32:55.753 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker": [ 2024-03-16T07:32:55.754 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:32:55.754 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:32:55.754 INFO:teuthology.orchestra.run.smithi049.stdout: "id": "0" 2024-03-16T07:32:55.754 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:32:55.754 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:32:55.754 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_ready_timeouts": 0, 2024-03-16T07:32:55.754 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_idle_timeouts": 0 2024-03-16T07:32:55.754 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:32:55.754 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:32:55.754 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:32:55.754 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:32:55.754 INFO:teuthology.orchestra.run.smithi049.stdout: "id": "1" 2024-03-16T07:32:55.754 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:32:55.755 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:32:55.755 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_ready_timeouts": 0, 2024-03-16T07:32:55.755 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_idle_timeouts": 0 2024-03-16T07:32:55.755 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:32:55.755 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:32:55.755 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:32:55.755 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:32:55.755 INFO:teuthology.orchestra.run.smithi049.stdout: "id": "2" 2024-03-16T07:32:55.755 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:32:55.755 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:32:55.755 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_ready_timeouts": 0, 2024-03-16T07:32:55.755 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_idle_timeouts": 0 2024-03-16T07:32:55.755 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:32:55.755 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:32:55.756 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:32:55.756 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-0": [ 2024-03-16T07:32:55.756 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:32:55.756 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:32:55.756 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:32:55.756 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 11, 2024-03-16T07:32:55.756 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 107, 2024-03-16T07:32:55.756 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 1584, 2024-03-16T07:32:55.756 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 890736, 2024-03-16T07:32:55.756 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 22, 2024-03-16T07:32:55.756 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 3, 2024-03-16T07:32:55.756 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 0.320531349, 2024-03-16T07:32:55.756 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.113834888, 2024-03-16T07:32:55.756 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 0.162060989, 2024-03-16T07:32:55.757 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-03-16T07:32:55.757 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T07:32:55.757 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 97, 2024-03-16T07:32:55.757 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.182682432, 2024-03-16T07:32:55.757 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.001883324 2024-03-16T07:32:55.757 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:32:55.757 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-03-16T07:32:55.757 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:32:55.757 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:32:55.757 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:32:55.757 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:32:55.757 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 1584, 2024-03-16T07:32:55.757 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 890736 2024-03-16T07:32:55.757 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:32:55.758 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:32:55.758 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:32:55.758 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-1": [ 2024-03-16T07:32:55.758 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:32:55.758 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:32:55.758 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:32:55.758 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 102, 2024-03-16T07:32:55.758 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 5, 2024-03-16T07:32:55.758 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 426224, 2024-03-16T07:32:55.758 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 1136, 2024-03-16T07:32:55.758 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 3, 2024-03-16T07:32:55.758 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 0, 2024-03-16T07:32:55.758 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 0.492896591, 2024-03-16T07:32:55.758 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.004833567, 2024-03-16T07:32:55.759 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 0.318859068, 2024-03-16T07:32:55.759 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.150931971, 2024-03-16T07:32:55.759 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T07:32:55.759 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 5, 2024-03-16T07:32:55.759 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.054797003, 2024-03-16T07:32:55.759 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.010959400 2024-03-16T07:32:55.759 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:32:55.759 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-03-16T07:32:55.759 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:32:55.759 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:32:55.759 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:32:55.759 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:32:55.759 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 426224, 2024-03-16T07:32:55.759 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 1136 2024-03-16T07:32:55.760 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:32:55.760 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:32:55.760 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:32:55.760 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-2": [ 2024-03-16T07:32:55.760 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:32:55.760 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:32:55.760 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:32:55.760 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 62, 2024-03-16T07:32:55.760 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 8, 2024-03-16T07:32:55.760 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 2421232, 2024-03-16T07:32:55.760 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 1600, 2024-03-16T07:32:55.760 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 2, 2024-03-16T07:32:55.760 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 1, 2024-03-16T07:32:55.760 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 1.301178173, 2024-03-16T07:32:55.760 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.007724612, 2024-03-16T07:32:55.761 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 2.433879921, 2024-03-16T07:32:55.761 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-03-16T07:32:55.761 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T07:32:55.761 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 8, 2024-03-16T07:32:55.761 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.161009804, 2024-03-16T07:32:55.761 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.020126225 2024-03-16T07:32:55.761 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:32:55.761 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-03-16T07:32:55.761 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:32:55.761 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:32:55.761 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:32:55.761 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:32:55.761 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 2421232, 2024-03-16T07:32:55.761 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 1600 2024-03-16T07:32:55.761 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:32:55.762 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:32:55.762 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:32:55.762 INFO:teuthology.orchestra.run.smithi049.stdout: "cct": [ 2024-03-16T07:32:55.762 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:32:55.762 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:32:55.762 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:32:55.762 INFO:teuthology.orchestra.run.smithi049.stdout: "total_workers": 0, 2024-03-16T07:32:55.762 INFO:teuthology.orchestra.run.smithi049.stdout: "unhealthy_workers": 0 2024-03-16T07:32:55.762 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:32:55.762 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:32:55.762 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:32:55.762 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs_mirror": [ 2024-03-16T07:32:55.762 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:32:55.762 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:32:55.763 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:32:55.763 INFO:teuthology.orchestra.run.smithi049.stdout: "mirrored_filesystems": 1, 2024-03-16T07:32:55.763 INFO:teuthology.orchestra.run.smithi049.stdout: "mirror_enable_failures": 0 2024-03-16T07:32:55.763 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:32:55.763 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:32:55.763 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:32:55.763 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs_mirror_mirrored_filesystems": [ 2024-03-16T07:32:55.763 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:32:55.763 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:32:55.763 INFO:teuthology.orchestra.run.smithi049.stdout: "filesystem": "cephfs" 2024-03-16T07:32:55.763 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:32:55.763 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:32:55.763 INFO:teuthology.orchestra.run.smithi049.stdout: "mirroring_peers": 0, 2024-03-16T07:32:55.763 INFO:teuthology.orchestra.run.smithi049.stdout: "directory_count": 0 2024-03-16T07:32:55.763 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:32:55.764 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:32:55.764 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:32:55.764 INFO:teuthology.orchestra.run.smithi049.stdout: "mempool": [ 2024-03-16T07:32:55.764 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:32:55.764 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:32:55.764 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:32:55.764 INFO:teuthology.orchestra.run.smithi049.stdout: "bloom_filter_bytes": 0, 2024-03-16T07:32:55.764 INFO:teuthology.orchestra.run.smithi049.stdout: "bloom_filter_items": 0, 2024-03-16T07:32:55.764 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_alloc_bytes": 0, 2024-03-16T07:32:55.764 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_alloc_items": 0, 2024-03-16T07:32:55.764 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_data_bytes": 0, 2024-03-16T07:32:55.764 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_data_items": 0, 2024-03-16T07:32:55.764 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_onode_bytes": 0, 2024-03-16T07:32:55.764 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_onode_items": 0, 2024-03-16T07:32:55.764 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_meta_bytes": 0, 2024-03-16T07:32:55.764 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_meta_items": 0, 2024-03-16T07:32:55.765 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_other_bytes": 0, 2024-03-16T07:32:55.765 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_other_items": 0, 2024-03-16T07:32:55.765 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_buffer_bytes": 0, 2024-03-16T07:32:55.765 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_buffer_items": 0, 2024-03-16T07:32:55.765 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_extent_bytes": 0, 2024-03-16T07:32:55.765 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_extent_items": 0, 2024-03-16T07:32:55.765 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_blob_bytes": 0, 2024-03-16T07:32:55.765 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_blob_items": 0, 2024-03-16T07:32:55.765 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_shared_blob_bytes": 0, 2024-03-16T07:32:55.765 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_shared_blob_items": 0, 2024-03-16T07:32:55.765 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_inline_bl_bytes": 0, 2024-03-16T07:32:55.765 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_inline_bl_items": 0, 2024-03-16T07:32:55.765 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_fsck_bytes": 0, 2024-03-16T07:32:55.765 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_fsck_items": 0, 2024-03-16T07:32:55.765 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_txc_bytes": 0, 2024-03-16T07:32:55.765 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_txc_items": 0, 2024-03-16T07:32:55.766 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_deferred_bytes": 0, 2024-03-16T07:32:55.766 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_deferred_items": 0, 2024-03-16T07:32:55.766 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_bytes": 0, 2024-03-16T07:32:55.766 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_items": 0, 2024-03-16T07:32:55.766 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_bytes": 0, 2024-03-16T07:32:55.766 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_items": 0, 2024-03-16T07:32:55.766 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_reader_bytes": 0, 2024-03-16T07:32:55.766 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_reader_items": 0, 2024-03-16T07:32:55.766 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_writer_bytes": 0, 2024-03-16T07:32:55.766 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_writer_items": 0, 2024-03-16T07:32:55.766 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_anon_bytes": 183567, 2024-03-16T07:32:55.766 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_anon_items": 55, 2024-03-16T07:32:55.766 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_meta_bytes": 0, 2024-03-16T07:32:55.766 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_meta_items": 0, 2024-03-16T07:32:55.766 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_bytes": 0, 2024-03-16T07:32:55.767 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_items": 0, 2024-03-16T07:32:55.767 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_mapbl_bytes": 0, 2024-03-16T07:32:55.767 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_mapbl_items": 0, 2024-03-16T07:32:55.767 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pglog_bytes": 0, 2024-03-16T07:32:55.767 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pglog_items": 0, 2024-03-16T07:32:55.767 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_bytes": 18952, 2024-03-16T07:32:55.767 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_items": 184, 2024-03-16T07:32:55.767 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_mapping_bytes": 0, 2024-03-16T07:32:55.767 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_mapping_items": 0, 2024-03-16T07:32:55.767 INFO:teuthology.orchestra.run.smithi049.stdout: "pgmap_bytes": 0, 2024-03-16T07:32:55.767 INFO:teuthology.orchestra.run.smithi049.stdout: "pgmap_items": 0, 2024-03-16T07:32:55.767 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_co_bytes": 0, 2024-03-16T07:32:55.767 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_co_items": 0, 2024-03-16T07:32:55.767 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_1_bytes": 0, 2024-03-16T07:32:55.767 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_1_items": 0, 2024-03-16T07:32:55.767 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_2_bytes": 0, 2024-03-16T07:32:55.767 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_2_items": 0 2024-03-16T07:32:55.768 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:32:55.768 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:32:55.768 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:32:55.768 INFO:teuthology.orchestra.run.smithi049.stdout: "objecter": [ 2024-03-16T07:32:55.768 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:32:55.768 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:32:55.768 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:32:55.768 INFO:teuthology.orchestra.run.smithi049.stdout: "op_active": 0, 2024-03-16T07:32:55.768 INFO:teuthology.orchestra.run.smithi049.stdout: "op_laggy": 0, 2024-03-16T07:32:55.768 INFO:teuthology.orchestra.run.smithi049.stdout: "op_send": 0, 2024-03-16T07:32:55.768 INFO:teuthology.orchestra.run.smithi049.stdout: "op_send_bytes": 0, 2024-03-16T07:32:55.768 INFO:teuthology.orchestra.run.smithi049.stdout: "op_resend": 0, 2024-03-16T07:32:55.768 INFO:teuthology.orchestra.run.smithi049.stdout: "op_reply": 0, 2024-03-16T07:32:55.768 INFO:teuthology.orchestra.run.smithi049.stdout: "op_latency": { 2024-03-16T07:32:55.768 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:32:55.768 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:32:55.769 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:32:55.769 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:32:55.769 INFO:teuthology.orchestra.run.smithi049.stdout: "op_inflight": 0, 2024-03-16T07:32:55.769 INFO:teuthology.orchestra.run.smithi049.stdout: "oplen_avg": { 2024-03-16T07:32:55.769 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:32:55.769 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0 2024-03-16T07:32:55.769 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:32:55.769 INFO:teuthology.orchestra.run.smithi049.stdout: "op": 0, 2024-03-16T07:32:55.769 INFO:teuthology.orchestra.run.smithi049.stdout: "op_r": 0, 2024-03-16T07:32:55.769 INFO:teuthology.orchestra.run.smithi049.stdout: "op_w": 0, 2024-03-16T07:32:55.769 INFO:teuthology.orchestra.run.smithi049.stdout: "op_rmw": 0, 2024-03-16T07:32:55.769 INFO:teuthology.orchestra.run.smithi049.stdout: "op_pg": 0, 2024-03-16T07:32:55.769 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_stat": 0, 2024-03-16T07:32:55.769 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_create": 0, 2024-03-16T07:32:55.769 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_read": 0, 2024-03-16T07:32:55.770 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_write": 0, 2024-03-16T07:32:55.770 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_writefull": 0, 2024-03-16T07:32:55.770 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_writesame": 0, 2024-03-16T07:32:55.770 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_append": 0, 2024-03-16T07:32:55.770 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_zero": 0, 2024-03-16T07:32:55.770 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_truncate": 0, 2024-03-16T07:32:55.770 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_delete": 0, 2024-03-16T07:32:55.770 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_mapext": 0, 2024-03-16T07:32:55.770 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_sparse_read": 0, 2024-03-16T07:32:55.770 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_clonerange": 0, 2024-03-16T07:32:55.770 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_getxattr": 0, 2024-03-16T07:32:55.770 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_setxattr": 0, 2024-03-16T07:32:55.770 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_cmpxattr": 0, 2024-03-16T07:32:55.770 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_rmxattr": 0, 2024-03-16T07:32:55.771 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_resetxattrs": 0, 2024-03-16T07:32:55.771 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_call": 0, 2024-03-16T07:32:55.771 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_watch": 0, 2024-03-16T07:32:55.771 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_notify": 0, 2024-03-16T07:32:55.771 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_src_cmpxattr": 0, 2024-03-16T07:32:55.771 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_pgls": 0, 2024-03-16T07:32:55.771 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_pgls_filter": 0, 2024-03-16T07:32:55.771 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_other": 0, 2024-03-16T07:32:55.771 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_active": 0, 2024-03-16T07:32:55.771 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_send": 0, 2024-03-16T07:32:55.771 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_resend": 0, 2024-03-16T07:32:55.771 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_ping": 0, 2024-03-16T07:32:55.771 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_active": 0, 2024-03-16T07:32:55.771 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_send": 0, 2024-03-16T07:32:55.771 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_resend": 0, 2024-03-16T07:32:55.771 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_active": 0, 2024-03-16T07:32:55.771 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_send": 0, 2024-03-16T07:32:55.772 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_resend": 0, 2024-03-16T07:32:55.772 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_active": 0, 2024-03-16T07:32:55.772 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_send": 0, 2024-03-16T07:32:55.772 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_resend": 0, 2024-03-16T07:32:55.772 INFO:teuthology.orchestra.run.smithi049.stdout: "command_active": 0, 2024-03-16T07:32:55.772 INFO:teuthology.orchestra.run.smithi049.stdout: "command_send": 0, 2024-03-16T07:32:55.772 INFO:teuthology.orchestra.run.smithi049.stdout: "command_resend": 0, 2024-03-16T07:32:55.772 INFO:teuthology.orchestra.run.smithi049.stdout: "map_epoch": 0, 2024-03-16T07:32:55.772 INFO:teuthology.orchestra.run.smithi049.stdout: "map_full": 0, 2024-03-16T07:32:55.772 INFO:teuthology.orchestra.run.smithi049.stdout: "map_inc": 0, 2024-03-16T07:32:55.772 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_sessions": 0, 2024-03-16T07:32:55.772 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_session_open": 0, 2024-03-16T07:32:55.772 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_session_close": 0, 2024-03-16T07:32:55.772 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_laggy": 0, 2024-03-16T07:32:55.772 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_wr": 0, 2024-03-16T07:32:55.772 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_rd": 0, 2024-03-16T07:32:55.773 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_del": 0 2024-03-16T07:32:55.773 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:32:55.773 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:32:55.773 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:32:55.773 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-msgr_dispatch_throttler-client": [ 2024-03-16T07:32:55.773 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:32:55.773 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:32:55.773 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:32:55.773 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:32:55.773 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-03-16T07:32:55.773 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:32:55.773 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 102, 2024-03-16T07:32:55.773 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 412369, 2024-03-16T07:32:55.773 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:32:55.773 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 102, 2024-03-16T07:32:55.773 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:32:55.773 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:32:55.774 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 102, 2024-03-16T07:32:55.774 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 412369, 2024-03-16T07:32:55.774 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:32:55.774 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:32:55.774 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:32:55.774 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:32:55.774 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:32:55.774 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:32:55.774 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:32:55.774 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:32:55.774 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-msgr_dispatch_throttler-radosclient": [ 2024-03-16T07:32:55.774 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:32:55.774 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:32:55.774 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:32:55.774 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:32:55.775 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-03-16T07:32:55.775 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:32:55.775 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 70, 2024-03-16T07:32:55.775 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 2412425, 2024-03-16T07:32:55.775 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:32:55.775 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 70, 2024-03-16T07:32:55.775 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:32:55.775 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:32:55.775 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 70, 2024-03-16T07:32:55.775 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 2412425, 2024-03-16T07:32:55.775 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:32:55.775 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:32:55.775 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:32:55.775 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:32:55.775 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:32:55.775 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:32:55.776 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:32:55.776 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:32:55.776 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-objecter_bytes": [ 2024-03-16T07:32:55.776 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:32:55.776 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:32:55.776 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:32:55.776 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:32:55.776 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-03-16T07:32:55.776 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:32:55.776 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 0, 2024-03-16T07:32:55.776 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 0, 2024-03-16T07:32:55.776 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:32:55.776 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 0, 2024-03-16T07:32:55.776 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:32:55.776 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:32:55.776 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 0, 2024-03-16T07:32:55.776 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 0, 2024-03-16T07:32:55.777 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:32:55.777 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:32:55.777 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:32:55.777 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:32:55.777 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:32:55.777 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:32:55.777 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:32:55.777 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:32:55.777 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-objecter_ops": [ 2024-03-16T07:32:55.777 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:32:55.777 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:32:55.777 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:32:55.777 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:32:55.777 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 1024, 2024-03-16T07:32:55.777 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:32:55.777 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 0, 2024-03-16T07:32:55.778 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 0, 2024-03-16T07:32:55.778 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:32:55.778 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 0, 2024-03-16T07:32:55.778 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:32:55.778 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:32:55.778 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 0, 2024-03-16T07:32:55.778 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 0, 2024-03-16T07:32:55.778 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:32:55.778 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:32:55.778 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:32:55.778 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:32:55.778 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:32:55.778 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:32:55.778 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:32:55.778 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2024-03-16T07:32:55.779 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-03-16T07:32:55.779 DEBUG:tasks.cephfs.test_mirroring:command returned={ "AsyncMessenger::Worker": [ { "labels": { "id": "0" }, "counters": { "msgr_connection_ready_timeouts": 0, "msgr_connection_idle_timeouts": 0 } }, { "labels": { "id": "1" }, "counters": { "msgr_connection_ready_timeouts": 0, "msgr_connection_idle_timeouts": 0 } }, { "labels": { "id": "2" }, "counters": { "msgr_connection_ready_timeouts": 0, "msgr_connection_idle_timeouts": 0 } } ], "AsyncMessenger::Worker-0": [ { "labels": {}, "counters": { "msgr_recv_messages": 11, "msgr_send_messages": 107, "msgr_recv_bytes": 1584, "msgr_send_bytes": 890736, "msgr_created_connections": 22, "msgr_active_connections": 3, "msgr_running_total_time": 0.320531349, "msgr_running_send_time": 0.113834888, "msgr_running_recv_time": 0.162060989, "msgr_running_fast_dispatch_time": 0.000000000, "msgr_send_messages_queue_lat": { "avgcount": 97, "sum": 0.182682432, "avgtime": 0.001883324 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "msgr_recv_encrypted_bytes": 1584, "msgr_send_encrypted_bytes": 890736 } } ], "AsyncMessenger::Worker-1": [ { "labels": {}, "counters": { "msgr_recv_messages": 102, "msgr_send_messages": 5, "msgr_recv_bytes": 426224, "msgr_send_bytes": 1136, "msgr_created_connections": 3, "msgr_active_connections": 0, "msgr_running_total_time": 0.492896591, "msgr_running_send_time": 0.004833567, "msgr_running_recv_time": 0.318859068, "msgr_running_fast_dispatch_time": 0.150931971, "msgr_send_messages_queue_lat": { "avgcount": 5, "sum": 0.054797003, "avgtime": 0.010959400 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "msgr_recv_encrypted_bytes": 426224, "msgr_send_encrypted_bytes": 1136 } } ], "AsyncMessenger::Worker-2": [ { "labels": {}, "counters": { "msgr_recv_messages": 62, "msgr_send_messages": 8, "msgr_recv_bytes": 2421232, "msgr_send_bytes": 1600, "msgr_created_connections": 2, "msgr_active_connections": 1, "msgr_running_total_time": 1.301178173, "msgr_running_send_time": 0.007724612, "msgr_running_recv_time": 2.433879921, "msgr_running_fast_dispatch_time": 0.000000000, "msgr_send_messages_queue_lat": { "avgcount": 8, "sum": 0.161009804, "avgtime": 0.020126225 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "msgr_recv_encrypted_bytes": 2421232, "msgr_send_encrypted_bytes": 1600 } } ], "cct": [ { "labels": {}, "counters": { "total_workers": 0, "unhealthy_workers": 0 } } ], "cephfs_mirror": [ { "labels": {}, "counters": { "mirrored_filesystems": 1, "mirror_enable_failures": 0 } } ], "cephfs_mirror_mirrored_filesystems": [ { "labels": { "filesystem": "cephfs" }, "counters": { "mirroring_peers": 0, "directory_count": 0 } } ], "mempool": [ { "labels": {}, "counters": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_cache_buffer_bytes": 0, "bluestore_cache_buffer_items": 0, "bluestore_extent_bytes": 0, "bluestore_extent_items": 0, "bluestore_blob_bytes": 0, "bluestore_blob_items": 0, "bluestore_shared_blob_bytes": 0, "bluestore_shared_blob_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_items": 0, "bluefs_bytes": 0, "bluefs_items": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "buffer_anon_bytes": 183567, "buffer_anon_items": 55, "buffer_meta_bytes": 0, "buffer_meta_items": 0, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 18952, "osdmap_items": 184, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "mds_co_bytes": 0, "mds_co_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 } } ], "objecter": [ { "labels": {}, "counters": { "op_active": 0, "op_laggy": 0, "op_send": 0, "op_send_bytes": 0, "op_resend": 0, "op_reply": 0, "op_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "op_inflight": 0, "oplen_avg": { "avgcount": 0, "sum": 0 }, "op": 0, "op_r": 0, "op_w": 0, "op_rmw": 0, "op_pg": 0, "osdop_stat": 0, "osdop_create": 0, "osdop_read": 0, "osdop_write": 0, "osdop_writefull": 0, "osdop_writesame": 0, "osdop_append": 0, "osdop_zero": 0, "osdop_truncate": 0, "osdop_delete": 0, "osdop_mapext": 0, "osdop_sparse_read": 0, "osdop_clonerange": 0, "osdop_getxattr": 0, "osdop_setxattr": 0, "osdop_cmpxattr": 0, "osdop_rmxattr": 0, "osdop_resetxattrs": 0, "osdop_call": 0, "osdop_watch": 0, "osdop_notify": 0, "osdop_src_cmpxattr": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_other": 0, "linger_active": 0, "linger_send": 0, "linger_resend": 0, "linger_ping": 0, "poolop_active": 0, "poolop_send": 0, "poolop_resend": 0, "poolstat_active": 0, "poolstat_send": 0, "poolstat_resend": 0, "statfs_active": 0, "statfs_send": 0, "statfs_resend": 0, "command_active": 0, "command_send": 0, "command_resend": 0, "map_epoch": 0, "map_full": 0, "map_inc": 0, "osd_sessions": 0, "osd_session_open": 0, "osd_session_close": 0, "osd_laggy": 0, "omap_wr": 0, "omap_rd": 0, "omap_del": 0 } } ], "throttle-msgr_dispatch_throttler-client": [ { "labels": {}, "counters": { "val": 0, "max": 104857600, "get_started": 0, "get": 102, "get_sum": 412369, "get_or_fail_fail": 0, "get_or_fail_success": 102, "take": 0, "take_sum": 0, "put": 102, "put_sum": 412369, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ], "throttle-msgr_dispatch_throttler-radosclient": [ { "labels": {}, "counters": { "val": 0, "max": 104857600, "get_started": 0, "get": 70, "get_sum": 2412425, "get_or_fail_fail": 0, "get_or_fail_success": 70, "take": 0, "take_sum": 0, "put": 70, "put_sum": 2412425, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ], "throttle-objecter_bytes": [ { "labels": {}, "counters": { "val": 0, "max": 104857600, "get_started": 0, "get": 0, "get_sum": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "take": 0, "take_sum": 0, "put": 0, "put_sum": 0, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ], "throttle-objecter_ops": [ { "labels": {}, "counters": { "val": 0, "max": 1024, "get_started": 0, "get": 0, "get_sum": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "take": 0, "take_sum": 0, "put": 0, "put_sum": 0, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ] } 2024-03-16T07:32:55.780 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-03-16T07:32:55.780 DEBUG:teuthology.orchestra.run.smithi049:counter dump for fs: cephfs> ceph --admin-daemon /var/run/ceph/cephfs-mirror.asok counter dump 2024-03-16T07:32:55.938 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-03-16T07:32:55.938 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker": [ 2024-03-16T07:32:55.938 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:32:55.938 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:32:55.938 INFO:teuthology.orchestra.run.smithi049.stdout: "id": "0" 2024-03-16T07:32:55.938 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:32:55.939 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:32:55.939 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_ready_timeouts": 0, 2024-03-16T07:32:55.939 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_idle_timeouts": 0 2024-03-16T07:32:55.939 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:32:55.939 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:32:55.939 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:32:55.939 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:32:55.939 INFO:teuthology.orchestra.run.smithi049.stdout: "id": "1" 2024-03-16T07:32:55.939 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:32:55.939 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:32:55.939 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_ready_timeouts": 0, 2024-03-16T07:32:55.939 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_idle_timeouts": 0 2024-03-16T07:32:55.939 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:32:55.939 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:32:55.939 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:32:55.940 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:32:55.940 INFO:teuthology.orchestra.run.smithi049.stdout: "id": "2" 2024-03-16T07:32:55.940 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:32:55.940 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:32:55.940 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_ready_timeouts": 0, 2024-03-16T07:32:55.940 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_idle_timeouts": 0 2024-03-16T07:32:55.940 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:32:55.940 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:32:55.940 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:32:55.940 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-0": [ 2024-03-16T07:32:55.940 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:32:55.940 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:32:55.940 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:32:55.940 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 11, 2024-03-16T07:32:55.940 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 107, 2024-03-16T07:32:55.941 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 1584, 2024-03-16T07:32:55.941 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 890736, 2024-03-16T07:32:55.941 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 22, 2024-03-16T07:32:55.941 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 3, 2024-03-16T07:32:55.941 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 0.320531349, 2024-03-16T07:32:55.941 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.113834888, 2024-03-16T07:32:55.941 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 0.162060989, 2024-03-16T07:32:55.941 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-03-16T07:32:55.941 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T07:32:55.941 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 97, 2024-03-16T07:32:55.941 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.182682432, 2024-03-16T07:32:55.941 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.001883324 2024-03-16T07:32:55.941 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:32:55.941 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-03-16T07:32:55.941 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:32:55.941 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:32:55.942 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:32:55.942 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:32:55.942 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 1584, 2024-03-16T07:32:55.942 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 890736 2024-03-16T07:32:55.942 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:32:55.942 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:32:55.942 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:32:55.942 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-1": [ 2024-03-16T07:32:55.942 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:32:55.942 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:32:55.942 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:32:55.942 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 102, 2024-03-16T07:32:55.942 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 5, 2024-03-16T07:32:55.942 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 426224, 2024-03-16T07:32:55.943 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 1136, 2024-03-16T07:32:55.943 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 3, 2024-03-16T07:32:55.943 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 0, 2024-03-16T07:32:55.943 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 0.492896591, 2024-03-16T07:32:55.943 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.004833567, 2024-03-16T07:32:55.943 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 0.318859068, 2024-03-16T07:32:55.943 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.150931971, 2024-03-16T07:32:55.943 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T07:32:55.943 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 5, 2024-03-16T07:32:55.943 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.054797003, 2024-03-16T07:32:55.943 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.010959400 2024-03-16T07:32:55.943 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:32:55.943 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-03-16T07:32:55.943 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:32:55.943 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:32:55.944 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:32:55.944 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:32:55.944 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 426224, 2024-03-16T07:32:55.944 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 1136 2024-03-16T07:32:55.944 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:32:55.944 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:32:55.944 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:32:55.944 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-2": [ 2024-03-16T07:32:55.944 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:32:55.944 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:32:55.944 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:32:55.944 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 62, 2024-03-16T07:32:55.944 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 8, 2024-03-16T07:32:55.944 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 2421232, 2024-03-16T07:32:55.944 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 1600, 2024-03-16T07:32:55.944 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 2, 2024-03-16T07:32:55.945 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 1, 2024-03-16T07:32:55.945 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 1.301178173, 2024-03-16T07:32:55.945 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.007724612, 2024-03-16T07:32:55.945 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 2.433879921, 2024-03-16T07:32:55.945 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-03-16T07:32:55.945 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T07:32:55.945 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 8, 2024-03-16T07:32:55.945 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.161009804, 2024-03-16T07:32:55.945 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.020126225 2024-03-16T07:32:55.945 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:32:55.945 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-03-16T07:32:55.945 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:32:55.945 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:32:55.945 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:32:55.945 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:32:55.946 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 2421232, 2024-03-16T07:32:55.946 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 1600 2024-03-16T07:32:55.946 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:32:55.946 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:32:55.946 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:32:55.946 INFO:teuthology.orchestra.run.smithi049.stdout: "cct": [ 2024-03-16T07:32:55.946 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:32:55.946 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:32:55.946 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:32:55.946 INFO:teuthology.orchestra.run.smithi049.stdout: "total_workers": 0, 2024-03-16T07:32:55.946 INFO:teuthology.orchestra.run.smithi049.stdout: "unhealthy_workers": 0 2024-03-16T07:32:55.946 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:32:55.946 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:32:55.946 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:32:55.946 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs_mirror": [ 2024-03-16T07:32:55.947 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:32:55.947 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:32:55.947 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:32:55.947 INFO:teuthology.orchestra.run.smithi049.stdout: "mirrored_filesystems": 1, 2024-03-16T07:32:55.947 INFO:teuthology.orchestra.run.smithi049.stdout: "mirror_enable_failures": 0 2024-03-16T07:32:55.947 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:32:55.947 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:32:55.947 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:32:55.947 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs_mirror_mirrored_filesystems": [ 2024-03-16T07:32:55.947 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:32:55.947 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:32:55.947 INFO:teuthology.orchestra.run.smithi049.stdout: "filesystem": "cephfs" 2024-03-16T07:32:55.947 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:32:55.947 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:32:55.947 INFO:teuthology.orchestra.run.smithi049.stdout: "mirroring_peers": 0, 2024-03-16T07:32:55.948 INFO:teuthology.orchestra.run.smithi049.stdout: "directory_count": 0 2024-03-16T07:32:55.948 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:32:55.948 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:32:55.948 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:32:55.948 INFO:teuthology.orchestra.run.smithi049.stdout: "mempool": [ 2024-03-16T07:32:55.948 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:32:55.948 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:32:55.948 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:32:55.948 INFO:teuthology.orchestra.run.smithi049.stdout: "bloom_filter_bytes": 0, 2024-03-16T07:32:55.948 INFO:teuthology.orchestra.run.smithi049.stdout: "bloom_filter_items": 0, 2024-03-16T07:32:55.948 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_alloc_bytes": 0, 2024-03-16T07:32:55.948 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_alloc_items": 0, 2024-03-16T07:32:55.948 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_data_bytes": 0, 2024-03-16T07:32:55.948 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_data_items": 0, 2024-03-16T07:32:55.948 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_onode_bytes": 0, 2024-03-16T07:32:55.949 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_onode_items": 0, 2024-03-16T07:32:55.949 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_meta_bytes": 0, 2024-03-16T07:32:55.949 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_meta_items": 0, 2024-03-16T07:32:55.949 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_other_bytes": 0, 2024-03-16T07:32:55.949 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_other_items": 0, 2024-03-16T07:32:55.949 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_buffer_bytes": 0, 2024-03-16T07:32:55.949 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_buffer_items": 0, 2024-03-16T07:32:55.949 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_extent_bytes": 0, 2024-03-16T07:32:55.949 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_extent_items": 0, 2024-03-16T07:32:55.949 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_blob_bytes": 0, 2024-03-16T07:32:55.949 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_blob_items": 0, 2024-03-16T07:32:55.949 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_shared_blob_bytes": 0, 2024-03-16T07:32:55.949 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_shared_blob_items": 0, 2024-03-16T07:32:55.949 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_inline_bl_bytes": 0, 2024-03-16T07:32:55.949 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_inline_bl_items": 0, 2024-03-16T07:32:55.949 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_fsck_bytes": 0, 2024-03-16T07:32:55.950 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_fsck_items": 0, 2024-03-16T07:32:55.950 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_txc_bytes": 0, 2024-03-16T07:32:55.950 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_txc_items": 0, 2024-03-16T07:32:55.950 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_deferred_bytes": 0, 2024-03-16T07:32:55.950 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_deferred_items": 0, 2024-03-16T07:32:55.950 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_bytes": 0, 2024-03-16T07:32:55.950 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_items": 0, 2024-03-16T07:32:55.950 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_bytes": 0, 2024-03-16T07:32:55.950 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_items": 0, 2024-03-16T07:32:55.950 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_reader_bytes": 0, 2024-03-16T07:32:55.950 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_reader_items": 0, 2024-03-16T07:32:55.950 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_writer_bytes": 0, 2024-03-16T07:32:55.950 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_writer_items": 0, 2024-03-16T07:32:55.950 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_anon_bytes": 183567, 2024-03-16T07:32:55.951 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_anon_items": 55, 2024-03-16T07:32:55.951 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_meta_bytes": 0, 2024-03-16T07:32:55.951 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_meta_items": 0, 2024-03-16T07:32:55.951 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_bytes": 0, 2024-03-16T07:32:55.951 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_items": 0, 2024-03-16T07:32:55.951 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_mapbl_bytes": 0, 2024-03-16T07:32:55.951 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_mapbl_items": 0, 2024-03-16T07:32:55.951 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pglog_bytes": 0, 2024-03-16T07:32:55.951 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pglog_items": 0, 2024-03-16T07:32:55.951 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_bytes": 18952, 2024-03-16T07:32:55.951 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_items": 184, 2024-03-16T07:32:55.951 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_mapping_bytes": 0, 2024-03-16T07:32:55.951 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_mapping_items": 0, 2024-03-16T07:32:55.951 INFO:teuthology.orchestra.run.smithi049.stdout: "pgmap_bytes": 0, 2024-03-16T07:32:55.951 INFO:teuthology.orchestra.run.smithi049.stdout: "pgmap_items": 0, 2024-03-16T07:32:55.951 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_co_bytes": 0, 2024-03-16T07:32:55.952 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_co_items": 0, 2024-03-16T07:32:55.952 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_1_bytes": 0, 2024-03-16T07:32:55.952 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_1_items": 0, 2024-03-16T07:32:55.952 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_2_bytes": 0, 2024-03-16T07:32:55.952 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_2_items": 0 2024-03-16T07:32:55.952 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:32:55.952 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:32:55.952 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:32:55.952 INFO:teuthology.orchestra.run.smithi049.stdout: "objecter": [ 2024-03-16T07:32:55.952 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:32:55.952 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:32:55.952 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:32:55.952 INFO:teuthology.orchestra.run.smithi049.stdout: "op_active": 0, 2024-03-16T07:32:55.952 INFO:teuthology.orchestra.run.smithi049.stdout: "op_laggy": 0, 2024-03-16T07:32:55.952 INFO:teuthology.orchestra.run.smithi049.stdout: "op_send": 0, 2024-03-16T07:32:55.953 INFO:teuthology.orchestra.run.smithi049.stdout: "op_send_bytes": 0, 2024-03-16T07:32:55.953 INFO:teuthology.orchestra.run.smithi049.stdout: "op_resend": 0, 2024-03-16T07:32:55.953 INFO:teuthology.orchestra.run.smithi049.stdout: "op_reply": 0, 2024-03-16T07:32:55.953 INFO:teuthology.orchestra.run.smithi049.stdout: "op_latency": { 2024-03-16T07:32:55.953 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:32:55.953 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:32:55.953 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:32:55.953 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:32:55.953 INFO:teuthology.orchestra.run.smithi049.stdout: "op_inflight": 0, 2024-03-16T07:32:55.953 INFO:teuthology.orchestra.run.smithi049.stdout: "oplen_avg": { 2024-03-16T07:32:55.953 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:32:55.953 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0 2024-03-16T07:32:55.953 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:32:55.953 INFO:teuthology.orchestra.run.smithi049.stdout: "op": 0, 2024-03-16T07:32:55.953 INFO:teuthology.orchestra.run.smithi049.stdout: "op_r": 0, 2024-03-16T07:32:55.954 INFO:teuthology.orchestra.run.smithi049.stdout: "op_w": 0, 2024-03-16T07:32:55.954 INFO:teuthology.orchestra.run.smithi049.stdout: "op_rmw": 0, 2024-03-16T07:32:55.954 INFO:teuthology.orchestra.run.smithi049.stdout: "op_pg": 0, 2024-03-16T07:32:55.954 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_stat": 0, 2024-03-16T07:32:55.954 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_create": 0, 2024-03-16T07:32:55.954 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_read": 0, 2024-03-16T07:32:55.954 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_write": 0, 2024-03-16T07:32:55.954 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_writefull": 0, 2024-03-16T07:32:55.954 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_writesame": 0, 2024-03-16T07:32:55.954 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_append": 0, 2024-03-16T07:32:55.955 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_zero": 0, 2024-03-16T07:32:55.955 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_truncate": 0, 2024-03-16T07:32:55.955 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_delete": 0, 2024-03-16T07:32:55.955 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_mapext": 0, 2024-03-16T07:32:55.955 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_sparse_read": 0, 2024-03-16T07:32:55.955 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_clonerange": 0, 2024-03-16T07:32:55.955 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_getxattr": 0, 2024-03-16T07:32:55.955 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_setxattr": 0, 2024-03-16T07:32:55.955 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_cmpxattr": 0, 2024-03-16T07:32:55.955 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_rmxattr": 0, 2024-03-16T07:32:55.955 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_resetxattrs": 0, 2024-03-16T07:32:55.955 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_call": 0, 2024-03-16T07:32:55.955 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_watch": 0, 2024-03-16T07:32:55.955 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_notify": 0, 2024-03-16T07:32:55.955 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_src_cmpxattr": 0, 2024-03-16T07:32:55.955 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_pgls": 0, 2024-03-16T07:32:55.956 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_pgls_filter": 0, 2024-03-16T07:32:55.956 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_other": 0, 2024-03-16T07:32:55.956 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_active": 0, 2024-03-16T07:32:55.956 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_send": 0, 2024-03-16T07:32:55.956 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_resend": 0, 2024-03-16T07:32:55.956 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_ping": 0, 2024-03-16T07:32:55.956 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_active": 0, 2024-03-16T07:32:55.956 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_send": 0, 2024-03-16T07:32:55.956 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_resend": 0, 2024-03-16T07:32:55.956 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_active": 0, 2024-03-16T07:32:55.956 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_send": 0, 2024-03-16T07:32:55.956 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_resend": 0, 2024-03-16T07:32:55.956 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_active": 0, 2024-03-16T07:32:55.956 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_send": 0, 2024-03-16T07:32:55.956 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_resend": 0, 2024-03-16T07:32:55.957 INFO:teuthology.orchestra.run.smithi049.stdout: "command_active": 0, 2024-03-16T07:32:55.957 INFO:teuthology.orchestra.run.smithi049.stdout: "command_send": 0, 2024-03-16T07:32:55.957 INFO:teuthology.orchestra.run.smithi049.stdout: "command_resend": 0, 2024-03-16T07:32:55.957 INFO:teuthology.orchestra.run.smithi049.stdout: "map_epoch": 0, 2024-03-16T07:32:55.957 INFO:teuthology.orchestra.run.smithi049.stdout: "map_full": 0, 2024-03-16T07:32:55.957 INFO:teuthology.orchestra.run.smithi049.stdout: "map_inc": 0, 2024-03-16T07:32:55.957 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_sessions": 0, 2024-03-16T07:32:55.957 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_session_open": 0, 2024-03-16T07:32:55.957 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_session_close": 0, 2024-03-16T07:32:55.957 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_laggy": 0, 2024-03-16T07:32:55.957 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_wr": 0, 2024-03-16T07:32:55.957 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_rd": 0, 2024-03-16T07:32:55.957 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_del": 0 2024-03-16T07:32:55.957 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:32:55.957 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:32:55.957 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:32:55.958 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-msgr_dispatch_throttler-client": [ 2024-03-16T07:32:55.958 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:32:55.958 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:32:55.958 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:32:55.958 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:32:55.958 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-03-16T07:32:55.958 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:32:55.958 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 102, 2024-03-16T07:32:55.958 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 412369, 2024-03-16T07:32:55.958 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:32:55.958 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 102, 2024-03-16T07:32:55.958 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:32:55.958 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:32:55.958 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 102, 2024-03-16T07:32:55.958 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 412369, 2024-03-16T07:32:55.959 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:32:55.959 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:32:55.959 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:32:55.959 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:32:55.959 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:32:55.959 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:32:55.959 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:32:55.959 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:32:55.959 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-msgr_dispatch_throttler-radosclient": [ 2024-03-16T07:32:55.959 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:32:55.959 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:32:55.959 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:32:55.959 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:32:55.959 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-03-16T07:32:55.960 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:32:55.960 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 70, 2024-03-16T07:32:55.960 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 2412425, 2024-03-16T07:32:55.960 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:32:55.960 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 70, 2024-03-16T07:32:55.960 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:32:55.960 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:32:55.960 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 70, 2024-03-16T07:32:55.960 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 2412425, 2024-03-16T07:32:55.960 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:32:55.960 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:32:55.960 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:32:55.960 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:32:55.960 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:32:55.960 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:32:55.961 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:32:55.961 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:32:55.961 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-objecter_bytes": [ 2024-03-16T07:32:55.961 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:32:55.961 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:32:55.961 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:32:55.961 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:32:55.961 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-03-16T07:32:55.961 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:32:55.961 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 0, 2024-03-16T07:32:55.961 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 0, 2024-03-16T07:32:55.961 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:32:55.961 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 0, 2024-03-16T07:32:55.961 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:32:55.961 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:32:55.961 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 0, 2024-03-16T07:32:55.962 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 0, 2024-03-16T07:32:55.962 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:32:55.962 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:32:55.962 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:32:55.962 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:32:55.962 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:32:55.962 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:32:55.962 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:32:55.962 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:32:55.962 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-objecter_ops": [ 2024-03-16T07:32:55.962 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:32:55.962 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:32:55.962 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:32:55.962 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:32:55.962 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 1024, 2024-03-16T07:32:55.963 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:32:55.963 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 0, 2024-03-16T07:32:55.963 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 0, 2024-03-16T07:32:55.963 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:32:55.963 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 0, 2024-03-16T07:32:55.963 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:32:55.963 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:32:55.963 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 0, 2024-03-16T07:32:55.963 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 0, 2024-03-16T07:32:55.963 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:32:55.963 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:32:55.963 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:32:55.963 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:32:55.963 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:32:55.964 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:32:55.964 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:32:55.964 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2024-03-16T07:32:55.964 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-03-16T07:32:55.965 DEBUG:tasks.cephfs.test_mirroring:command returned={ "AsyncMessenger::Worker": [ { "labels": { "id": "0" }, "counters": { "msgr_connection_ready_timeouts": 0, "msgr_connection_idle_timeouts": 0 } }, { "labels": { "id": "1" }, "counters": { "msgr_connection_ready_timeouts": 0, "msgr_connection_idle_timeouts": 0 } }, { "labels": { "id": "2" }, "counters": { "msgr_connection_ready_timeouts": 0, "msgr_connection_idle_timeouts": 0 } } ], "AsyncMessenger::Worker-0": [ { "labels": {}, "counters": { "msgr_recv_messages": 11, "msgr_send_messages": 107, "msgr_recv_bytes": 1584, "msgr_send_bytes": 890736, "msgr_created_connections": 22, "msgr_active_connections": 3, "msgr_running_total_time": 0.320531349, "msgr_running_send_time": 0.113834888, "msgr_running_recv_time": 0.162060989, "msgr_running_fast_dispatch_time": 0.000000000, "msgr_send_messages_queue_lat": { "avgcount": 97, "sum": 0.182682432, "avgtime": 0.001883324 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "msgr_recv_encrypted_bytes": 1584, "msgr_send_encrypted_bytes": 890736 } } ], "AsyncMessenger::Worker-1": [ { "labels": {}, "counters": { "msgr_recv_messages": 102, "msgr_send_messages": 5, "msgr_recv_bytes": 426224, "msgr_send_bytes": 1136, "msgr_created_connections": 3, "msgr_active_connections": 0, "msgr_running_total_time": 0.492896591, "msgr_running_send_time": 0.004833567, "msgr_running_recv_time": 0.318859068, "msgr_running_fast_dispatch_time": 0.150931971, "msgr_send_messages_queue_lat": { "avgcount": 5, "sum": 0.054797003, "avgtime": 0.010959400 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "msgr_recv_encrypted_bytes": 426224, "msgr_send_encrypted_bytes": 1136 } } ], "AsyncMessenger::Worker-2": [ { "labels": {}, "counters": { "msgr_recv_messages": 62, "msgr_send_messages": 8, "msgr_recv_bytes": 2421232, "msgr_send_bytes": 1600, "msgr_created_connections": 2, "msgr_active_connections": 1, "msgr_running_total_time": 1.301178173, "msgr_running_send_time": 0.007724612, "msgr_running_recv_time": 2.433879921, "msgr_running_fast_dispatch_time": 0.000000000, "msgr_send_messages_queue_lat": { "avgcount": 8, "sum": 0.161009804, "avgtime": 0.020126225 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "msgr_recv_encrypted_bytes": 2421232, "msgr_send_encrypted_bytes": 1600 } } ], "cct": [ { "labels": {}, "counters": { "total_workers": 0, "unhealthy_workers": 0 } } ], "cephfs_mirror": [ { "labels": {}, "counters": { "mirrored_filesystems": 1, "mirror_enable_failures": 0 } } ], "cephfs_mirror_mirrored_filesystems": [ { "labels": { "filesystem": "cephfs" }, "counters": { "mirroring_peers": 0, "directory_count": 0 } } ], "mempool": [ { "labels": {}, "counters": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_cache_buffer_bytes": 0, "bluestore_cache_buffer_items": 0, "bluestore_extent_bytes": 0, "bluestore_extent_items": 0, "bluestore_blob_bytes": 0, "bluestore_blob_items": 0, "bluestore_shared_blob_bytes": 0, "bluestore_shared_blob_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_items": 0, "bluefs_bytes": 0, "bluefs_items": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "buffer_anon_bytes": 183567, "buffer_anon_items": 55, "buffer_meta_bytes": 0, "buffer_meta_items": 0, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 18952, "osdmap_items": 184, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "mds_co_bytes": 0, "mds_co_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 } } ], "objecter": [ { "labels": {}, "counters": { "op_active": 0, "op_laggy": 0, "op_send": 0, "op_send_bytes": 0, "op_resend": 0, "op_reply": 0, "op_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "op_inflight": 0, "oplen_avg": { "avgcount": 0, "sum": 0 }, "op": 0, "op_r": 0, "op_w": 0, "op_rmw": 0, "op_pg": 0, "osdop_stat": 0, "osdop_create": 0, "osdop_read": 0, "osdop_write": 0, "osdop_writefull": 0, "osdop_writesame": 0, "osdop_append": 0, "osdop_zero": 0, "osdop_truncate": 0, "osdop_delete": 0, "osdop_mapext": 0, "osdop_sparse_read": 0, "osdop_clonerange": 0, "osdop_getxattr": 0, "osdop_setxattr": 0, "osdop_cmpxattr": 0, "osdop_rmxattr": 0, "osdop_resetxattrs": 0, "osdop_call": 0, "osdop_watch": 0, "osdop_notify": 0, "osdop_src_cmpxattr": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_other": 0, "linger_active": 0, "linger_send": 0, "linger_resend": 0, "linger_ping": 0, "poolop_active": 0, "poolop_send": 0, "poolop_resend": 0, "poolstat_active": 0, "poolstat_send": 0, "poolstat_resend": 0, "statfs_active": 0, "statfs_send": 0, "statfs_resend": 0, "command_active": 0, "command_send": 0, "command_resend": 0, "map_epoch": 0, "map_full": 0, "map_inc": 0, "osd_sessions": 0, "osd_session_open": 0, "osd_session_close": 0, "osd_laggy": 0, "omap_wr": 0, "omap_rd": 0, "omap_del": 0 } } ], "throttle-msgr_dispatch_throttler-client": [ { "labels": {}, "counters": { "val": 0, "max": 104857600, "get_started": 0, "get": 102, "get_sum": 412369, "get_or_fail_fail": 0, "get_or_fail_success": 102, "take": 0, "take_sum": 0, "put": 102, "put_sum": 412369, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ], "throttle-msgr_dispatch_throttler-radosclient": [ { "labels": {}, "counters": { "val": 0, "max": 104857600, "get_started": 0, "get": 70, "get_sum": 2412425, "get_or_fail_fail": 0, "get_or_fail_success": 70, "take": 0, "take_sum": 0, "put": 70, "put_sum": 2412425, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ], "throttle-objecter_bytes": [ { "labels": {}, "counters": { "val": 0, "max": 104857600, "get_started": 0, "get": 0, "get_sum": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "take": 0, "take_sum": 0, "put": 0, "put_sum": 0, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ], "throttle-objecter_ops": [ { "labels": {}, "counters": { "val": 0, "max": 1024, "get_started": 0, "get": 0, "get_sum": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "take": 0, "take_sum": 0, "put": 0, "put_sum": 0, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ] } 2024-03-16T07:32:55.965 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snapshot mirror peer_add cephfs client.mirror_remote@ceph backup_fs 2024-03-16T07:32:56.325 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:32:56.327+0000 7fba968f3640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:32:56.325 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:32:56.327+0000 7fba968f3640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:32:56.325 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:32:56.327+0000 7fba968f3640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:32:56.325 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:32:56.327+0000 7fba968f3640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:32:56.325 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:32:56.327+0000 7fba968f3640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:32:56.535 INFO:teuthology.orchestra.run.smithi049.stdout:{} 2024-03-16T07:33:06.549 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-03-16T07:33:06.549 DEBUG:teuthology.orchestra.run.smithi049:mirror status for fs: cephfs> ceph --admin-daemon /var/run/ceph/cephfs-mirror.asok fs mirror status cephfs@12 2024-03-16T07:33:06.652 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-03-16T07:33:06.652 INFO:teuthology.orchestra.run.smithi049.stdout: "rados_inst": "172.21.15.49:0/4185192406", 2024-03-16T07:33:06.652 INFO:teuthology.orchestra.run.smithi049.stdout: "peers": { 2024-03-16T07:33:06.653 INFO:teuthology.orchestra.run.smithi049.stdout: "140aa0e6-bddb-4f74-8622-2c5b40796ff5": { 2024-03-16T07:33:06.653 INFO:teuthology.orchestra.run.smithi049.stdout: "remote": { 2024-03-16T07:33:06.653 INFO:teuthology.orchestra.run.smithi049.stdout: "client_name": "client.mirror_remote", 2024-03-16T07:33:06.653 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_name": "ceph", 2024-03-16T07:33:06.653 INFO:teuthology.orchestra.run.smithi049.stdout: "fs_name": "backup_fs" 2024-03-16T07:33:06.653 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:33:06.653 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:33:06.653 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:33:06.653 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_dirs": { 2024-03-16T07:33:06.653 INFO:teuthology.orchestra.run.smithi049.stdout: "dir_count": 0 2024-03-16T07:33:06.653 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:33:06.653 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-03-16T07:33:06.660 DEBUG:tasks.cephfs.test_mirroring:command returned={ "rados_inst": "172.21.15.49:0/4185192406", "peers": { "140aa0e6-bddb-4f74-8622-2c5b40796ff5": { "remote": { "client_name": "client.mirror_remote", "cluster_name": "ceph", "fs_name": "backup_fs" } } }, "snap_dirs": { "dir_count": 0 } } 2024-03-16T07:33:06.661 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T07:33:07.032 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:33:07.033 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":107,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6315,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6828/2438276517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":2438276517},{"type":"v1","addr":"172.21.15.49:6828","nonce":2438276517}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":94},{"gid":6316,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6829/1412184122","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6827","nonce":1412184122},{"type":"v1","addr":"172.21.15.49:6829","nonce":1412184122}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":94},{"gid":6321,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6831/3610285344","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":3610285344},{"type":"v1","addr":"172.21.15.49:6831","nonce":3610285344}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":94}],"filesystems":[{"mdsmap":{"epoch":107,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-16T07:32:17.592092+0000","modified":"2024-03-16T07:32:56.339834+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6325},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6325":{"gid":6325,"name":"a","rank":0,"incarnation":95,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6835/2709512109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":2709512109},{"type":"v1","addr":"172.21.15.49:6835","nonce":2709512109}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6325,"qdb_cluster":[6325]},"id":12,"mirror_info":{"peers":{"140aa0e6-bddb-4f74-8622-2c5b40796ff5":{"remote":{"client_name":"client.mirror_remote","cluster_name":"ceph","fs_name":"backup_fs"}}}}},{"mdsmap":{"epoch":105,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-16T07:32:31.616889+0000","modified":"2024-03-16T07:32:34.616124+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6324},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6324":{"gid":6324,"name":"c","rank":0,"incarnation":101,"state":"up:active","state_seq":6,"addr":"172.21.15.49:6833/1457417734","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":1457417734},{"type":"v1","addr":"172.21.15.49:6833","nonce":1457417734}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[27],"metadata_pool":26,"enabled":true,"fs_name":"backup_fs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6324,"qdb_cluster":[6324]},"id":13}]} 2024-03-16T07:33:07.033 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 107 2024-03-16T07:33:07.045 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-03-16T07:33:07.045 DEBUG:teuthology.orchestra.run.smithi049:counter dump for fs: cephfs> ceph --admin-daemon /var/run/ceph/cephfs-mirror.asok counter dump 2024-03-16T07:33:07.150 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-03-16T07:33:07.150 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker": [ 2024-03-16T07:33:07.150 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:33:07.150 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:33:07.150 INFO:teuthology.orchestra.run.smithi049.stdout: "id": "0" 2024-03-16T07:33:07.151 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:33:07.151 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:33:07.151 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_ready_timeouts": 0, 2024-03-16T07:33:07.151 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_idle_timeouts": 0 2024-03-16T07:33:07.151 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:33:07.151 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:33:07.151 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:33:07.151 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:33:07.151 INFO:teuthology.orchestra.run.smithi049.stdout: "id": "1" 2024-03-16T07:33:07.151 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:33:07.151 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:33:07.151 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_ready_timeouts": 0, 2024-03-16T07:33:07.151 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_idle_timeouts": 0 2024-03-16T07:33:07.151 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:33:07.151 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:33:07.151 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:33:07.152 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:33:07.152 INFO:teuthology.orchestra.run.smithi049.stdout: "id": "2" 2024-03-16T07:33:07.152 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:33:07.152 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:33:07.152 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_ready_timeouts": 0, 2024-03-16T07:33:07.152 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_idle_timeouts": 0 2024-03-16T07:33:07.152 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:33:07.152 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:33:07.152 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:33:07.152 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-0": [ 2024-03-16T07:33:07.152 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:33:07.152 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:33:07.152 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:33:07.152 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 11, 2024-03-16T07:33:07.152 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 109, 2024-03-16T07:33:07.153 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 1584, 2024-03-16T07:33:07.153 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 891472, 2024-03-16T07:33:07.153 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 22, 2024-03-16T07:33:07.153 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 3, 2024-03-16T07:33:07.153 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 0.321323931, 2024-03-16T07:33:07.153 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.114561051, 2024-03-16T07:33:07.153 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 0.162060989, 2024-03-16T07:33:07.153 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-03-16T07:33:07.153 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T07:33:07.153 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 99, 2024-03-16T07:33:07.153 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.183018637, 2024-03-16T07:33:07.153 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.001848673 2024-03-16T07:33:07.153 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:33:07.153 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-03-16T07:33:07.153 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:33:07.153 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:33:07.153 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:33:07.154 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:33:07.154 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 1584, 2024-03-16T07:33:07.154 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 891472 2024-03-16T07:33:07.154 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:33:07.154 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:33:07.154 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:33:07.154 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-1": [ 2024-03-16T07:33:07.154 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:33:07.154 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:33:07.154 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:33:07.154 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 103, 2024-03-16T07:33:07.154 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 5, 2024-03-16T07:33:07.154 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 431200, 2024-03-16T07:33:07.154 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 1136, 2024-03-16T07:33:07.154 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 3, 2024-03-16T07:33:07.154 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 0, 2024-03-16T07:33:07.155 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 0.523896092, 2024-03-16T07:33:07.155 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.004877032, 2024-03-16T07:33:07.155 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 0.327859637, 2024-03-16T07:33:07.155 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.172734448, 2024-03-16T07:33:07.155 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T07:33:07.155 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 5, 2024-03-16T07:33:07.155 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.054797003, 2024-03-16T07:33:07.155 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.010959400 2024-03-16T07:33:07.155 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:33:07.155 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-03-16T07:33:07.155 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:33:07.155 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:33:07.155 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:33:07.155 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:33:07.155 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 431200, 2024-03-16T07:33:07.155 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 1136 2024-03-16T07:33:07.156 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:33:07.156 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:33:07.156 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:33:07.156 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-2": [ 2024-03-16T07:33:07.156 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:33:07.156 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:33:07.156 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:33:07.156 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 63, 2024-03-16T07:33:07.156 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 8, 2024-03-16T07:33:07.156 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 2467072, 2024-03-16T07:33:07.156 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 1600, 2024-03-16T07:33:07.156 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 2, 2024-03-16T07:33:07.156 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 1, 2024-03-16T07:33:07.156 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 1.330763766, 2024-03-16T07:33:07.156 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.007865017, 2024-03-16T07:33:07.157 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 2.488671750, 2024-03-16T07:33:07.157 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-03-16T07:33:07.157 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T07:33:07.157 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 8, 2024-03-16T07:33:07.157 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.161009804, 2024-03-16T07:33:07.157 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.020126225 2024-03-16T07:33:07.157 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:33:07.157 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-03-16T07:33:07.157 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:33:07.157 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:33:07.157 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:33:07.157 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:33:07.157 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 2467072, 2024-03-16T07:33:07.157 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 1600 2024-03-16T07:33:07.157 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:33:07.157 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:33:07.158 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:33:07.158 INFO:teuthology.orchestra.run.smithi049.stdout: "cct": [ 2024-03-16T07:33:07.158 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:33:07.158 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:33:07.158 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:33:07.158 INFO:teuthology.orchestra.run.smithi049.stdout: "total_workers": 0, 2024-03-16T07:33:07.158 INFO:teuthology.orchestra.run.smithi049.stdout: "unhealthy_workers": 0 2024-03-16T07:33:07.158 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:33:07.158 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:33:07.158 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:33:07.158 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs_mirror": [ 2024-03-16T07:33:07.158 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:33:07.158 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:33:07.158 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:33:07.158 INFO:teuthology.orchestra.run.smithi049.stdout: "mirrored_filesystems": 1, 2024-03-16T07:33:07.158 INFO:teuthology.orchestra.run.smithi049.stdout: "mirror_enable_failures": 0 2024-03-16T07:33:07.159 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:33:07.159 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:33:07.159 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:33:07.159 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs_mirror_mirrored_filesystems": [ 2024-03-16T07:33:07.159 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:33:07.159 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:33:07.159 INFO:teuthology.orchestra.run.smithi049.stdout: "filesystem": "cephfs" 2024-03-16T07:33:07.159 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:33:07.159 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:33:07.159 INFO:teuthology.orchestra.run.smithi049.stdout: "mirroring_peers": 1, 2024-03-16T07:33:07.159 INFO:teuthology.orchestra.run.smithi049.stdout: "directory_count": 0 2024-03-16T07:33:07.159 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:33:07.159 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:33:07.159 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:33:07.159 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs_mirror_peers": [ 2024-03-16T07:33:07.160 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:33:07.160 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:33:07.160 INFO:teuthology.orchestra.run.smithi049.stdout: "peer_cluster_filesystem": "backup_fs", 2024-03-16T07:33:07.160 INFO:teuthology.orchestra.run.smithi049.stdout: "peer_cluster_name": "ceph", 2024-03-16T07:33:07.160 INFO:teuthology.orchestra.run.smithi049.stdout: "source_filesystem": "cephfs", 2024-03-16T07:33:07.160 INFO:teuthology.orchestra.run.smithi049.stdout: "source_fscid": "12" 2024-03-16T07:33:07.160 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:33:07.160 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:33:07.160 INFO:teuthology.orchestra.run.smithi049.stdout: "snaps_synced": 0, 2024-03-16T07:33:07.160 INFO:teuthology.orchestra.run.smithi049.stdout: "snaps_deleted": 0, 2024-03-16T07:33:07.160 INFO:teuthology.orchestra.run.smithi049.stdout: "snaps_renamed": 0, 2024-03-16T07:33:07.160 INFO:teuthology.orchestra.run.smithi049.stdout: "sync_failures": 0, 2024-03-16T07:33:07.160 INFO:teuthology.orchestra.run.smithi049.stdout: "avg_sync_time": { 2024-03-16T07:33:07.160 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:33:07.160 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:33:07.160 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:33:07.160 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:33:07.161 INFO:teuthology.orchestra.run.smithi049.stdout: "sync_bytes": 0 2024-03-16T07:33:07.161 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:33:07.161 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:33:07.161 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:33:07.161 INFO:teuthology.orchestra.run.smithi049.stdout: "mempool": [ 2024-03-16T07:33:07.161 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:33:07.161 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:33:07.161 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:33:07.161 INFO:teuthology.orchestra.run.smithi049.stdout: "bloom_filter_bytes": 0, 2024-03-16T07:33:07.161 INFO:teuthology.orchestra.run.smithi049.stdout: "bloom_filter_items": 0, 2024-03-16T07:33:07.161 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_alloc_bytes": 0, 2024-03-16T07:33:07.161 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_alloc_items": 0, 2024-03-16T07:33:07.161 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_data_bytes": 0, 2024-03-16T07:33:07.161 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_data_items": 0, 2024-03-16T07:33:07.161 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_onode_bytes": 0, 2024-03-16T07:33:07.161 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_onode_items": 0, 2024-03-16T07:33:07.161 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_meta_bytes": 0, 2024-03-16T07:33:07.162 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_meta_items": 0, 2024-03-16T07:33:07.162 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_other_bytes": 0, 2024-03-16T07:33:07.162 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_other_items": 0, 2024-03-16T07:33:07.162 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_buffer_bytes": 0, 2024-03-16T07:33:07.162 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_buffer_items": 0, 2024-03-16T07:33:07.162 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_extent_bytes": 0, 2024-03-16T07:33:07.162 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_extent_items": 0, 2024-03-16T07:33:07.162 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_blob_bytes": 0, 2024-03-16T07:33:07.162 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_blob_items": 0, 2024-03-16T07:33:07.162 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_shared_blob_bytes": 0, 2024-03-16T07:33:07.162 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_shared_blob_items": 0, 2024-03-16T07:33:07.162 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_inline_bl_bytes": 0, 2024-03-16T07:33:07.162 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_inline_bl_items": 0, 2024-03-16T07:33:07.162 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_fsck_bytes": 0, 2024-03-16T07:33:07.162 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_fsck_items": 0, 2024-03-16T07:33:07.162 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_txc_bytes": 0, 2024-03-16T07:33:07.163 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_txc_items": 0, 2024-03-16T07:33:07.163 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_deferred_bytes": 0, 2024-03-16T07:33:07.163 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_deferred_items": 0, 2024-03-16T07:33:07.163 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_bytes": 0, 2024-03-16T07:33:07.163 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_items": 0, 2024-03-16T07:33:07.163 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_bytes": 0, 2024-03-16T07:33:07.163 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_items": 0, 2024-03-16T07:33:07.163 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_reader_bytes": 0, 2024-03-16T07:33:07.163 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_reader_items": 0, 2024-03-16T07:33:07.163 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_writer_bytes": 0, 2024-03-16T07:33:07.163 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_writer_items": 0, 2024-03-16T07:33:07.163 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_anon_bytes": 202322, 2024-03-16T07:33:07.163 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_anon_items": 77, 2024-03-16T07:33:07.163 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_meta_bytes": 0, 2024-03-16T07:33:07.163 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_meta_items": 0, 2024-03-16T07:33:07.163 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_bytes": 0, 2024-03-16T07:33:07.163 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_items": 0, 2024-03-16T07:33:07.164 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_mapbl_bytes": 0, 2024-03-16T07:33:07.164 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_mapbl_items": 0, 2024-03-16T07:33:07.164 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pglog_bytes": 0, 2024-03-16T07:33:07.164 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pglog_items": 0, 2024-03-16T07:33:07.164 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_bytes": 33080, 2024-03-16T07:33:07.164 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_items": 316, 2024-03-16T07:33:07.164 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_mapping_bytes": 0, 2024-03-16T07:33:07.164 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_mapping_items": 0, 2024-03-16T07:33:07.164 INFO:teuthology.orchestra.run.smithi049.stdout: "pgmap_bytes": 0, 2024-03-16T07:33:07.164 INFO:teuthology.orchestra.run.smithi049.stdout: "pgmap_items": 0, 2024-03-16T07:33:07.164 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_co_bytes": 0, 2024-03-16T07:33:07.164 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_co_items": 0, 2024-03-16T07:33:07.164 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_1_bytes": 0, 2024-03-16T07:33:07.164 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_1_items": 0, 2024-03-16T07:33:07.164 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_2_bytes": 0, 2024-03-16T07:33:07.164 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_2_items": 0 2024-03-16T07:33:07.165 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:33:07.165 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:33:07.165 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:33:07.165 INFO:teuthology.orchestra.run.smithi049.stdout: "objecter": [ 2024-03-16T07:33:07.165 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:33:07.165 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:33:07.165 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:33:07.165 INFO:teuthology.orchestra.run.smithi049.stdout: "op_active": 0, 2024-03-16T07:33:07.165 INFO:teuthology.orchestra.run.smithi049.stdout: "op_laggy": 0, 2024-03-16T07:33:07.165 INFO:teuthology.orchestra.run.smithi049.stdout: "op_send": 0, 2024-03-16T07:33:07.165 INFO:teuthology.orchestra.run.smithi049.stdout: "op_send_bytes": 0, 2024-03-16T07:33:07.165 INFO:teuthology.orchestra.run.smithi049.stdout: "op_resend": 0, 2024-03-16T07:33:07.165 INFO:teuthology.orchestra.run.smithi049.stdout: "op_reply": 0, 2024-03-16T07:33:07.165 INFO:teuthology.orchestra.run.smithi049.stdout: "op_latency": { 2024-03-16T07:33:07.165 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:33:07.165 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:33:07.166 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:33:07.166 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:33:07.166 INFO:teuthology.orchestra.run.smithi049.stdout: "op_inflight": 0, 2024-03-16T07:33:07.166 INFO:teuthology.orchestra.run.smithi049.stdout: "oplen_avg": { 2024-03-16T07:33:07.166 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:33:07.166 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0 2024-03-16T07:33:07.166 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:33:07.166 INFO:teuthology.orchestra.run.smithi049.stdout: "op": 0, 2024-03-16T07:33:07.166 INFO:teuthology.orchestra.run.smithi049.stdout: "op_r": 0, 2024-03-16T07:33:07.166 INFO:teuthology.orchestra.run.smithi049.stdout: "op_w": 0, 2024-03-16T07:33:07.166 INFO:teuthology.orchestra.run.smithi049.stdout: "op_rmw": 0, 2024-03-16T07:33:07.166 INFO:teuthology.orchestra.run.smithi049.stdout: "op_pg": 0, 2024-03-16T07:33:07.166 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_stat": 0, 2024-03-16T07:33:07.166 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_create": 0, 2024-03-16T07:33:07.166 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_read": 0, 2024-03-16T07:33:07.166 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_write": 0, 2024-03-16T07:33:07.167 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_writefull": 0, 2024-03-16T07:33:07.167 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_writesame": 0, 2024-03-16T07:33:07.167 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_append": 0, 2024-03-16T07:33:07.167 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_zero": 0, 2024-03-16T07:33:07.167 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_truncate": 0, 2024-03-16T07:33:07.167 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_delete": 0, 2024-03-16T07:33:07.167 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_mapext": 0, 2024-03-16T07:33:07.167 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_sparse_read": 0, 2024-03-16T07:33:07.167 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_clonerange": 0, 2024-03-16T07:33:07.167 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_getxattr": 0, 2024-03-16T07:33:07.167 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_setxattr": 0, 2024-03-16T07:33:07.167 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_cmpxattr": 0, 2024-03-16T07:33:07.167 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_rmxattr": 0, 2024-03-16T07:33:07.167 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_resetxattrs": 0, 2024-03-16T07:33:07.167 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_call": 0, 2024-03-16T07:33:07.167 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_watch": 0, 2024-03-16T07:33:07.168 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_notify": 0, 2024-03-16T07:33:07.168 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_src_cmpxattr": 0, 2024-03-16T07:33:07.168 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_pgls": 0, 2024-03-16T07:33:07.168 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_pgls_filter": 0, 2024-03-16T07:33:07.168 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_other": 0, 2024-03-16T07:33:07.168 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_active": 0, 2024-03-16T07:33:07.168 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_send": 0, 2024-03-16T07:33:07.168 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_resend": 0, 2024-03-16T07:33:07.168 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_ping": 0, 2024-03-16T07:33:07.168 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_active": 0, 2024-03-16T07:33:07.168 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_send": 0, 2024-03-16T07:33:07.168 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_resend": 0, 2024-03-16T07:33:07.168 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_active": 0, 2024-03-16T07:33:07.168 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_send": 0, 2024-03-16T07:33:07.168 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_resend": 0, 2024-03-16T07:33:07.168 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_active": 0, 2024-03-16T07:33:07.168 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_send": 0, 2024-03-16T07:33:07.169 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_resend": 0, 2024-03-16T07:33:07.169 INFO:teuthology.orchestra.run.smithi049.stdout: "command_active": 0, 2024-03-16T07:33:07.169 INFO:teuthology.orchestra.run.smithi049.stdout: "command_send": 0, 2024-03-16T07:33:07.169 INFO:teuthology.orchestra.run.smithi049.stdout: "command_resend": 0, 2024-03-16T07:33:07.169 INFO:teuthology.orchestra.run.smithi049.stdout: "map_epoch": 0, 2024-03-16T07:33:07.169 INFO:teuthology.orchestra.run.smithi049.stdout: "map_full": 0, 2024-03-16T07:33:07.169 INFO:teuthology.orchestra.run.smithi049.stdout: "map_inc": 0, 2024-03-16T07:33:07.169 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_sessions": 0, 2024-03-16T07:33:07.169 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_session_open": 0, 2024-03-16T07:33:07.169 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_session_close": 0, 2024-03-16T07:33:07.169 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_laggy": 0, 2024-03-16T07:33:07.169 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_wr": 0, 2024-03-16T07:33:07.169 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_rd": 0, 2024-03-16T07:33:07.169 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_del": 0 2024-03-16T07:33:07.169 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:33:07.169 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:33:07.170 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:33:07.170 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-msgr_dispatch_throttler-client": [ 2024-03-16T07:33:07.170 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:33:07.170 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:33:07.170 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:33:07.170 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:33:07.170 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-03-16T07:33:07.170 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:33:07.170 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 103, 2024-03-16T07:33:07.170 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 417212, 2024-03-16T07:33:07.170 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:33:07.170 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 103, 2024-03-16T07:33:07.170 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:33:07.170 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:33:07.171 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 103, 2024-03-16T07:33:07.171 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 417212, 2024-03-16T07:33:07.171 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:33:07.171 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:33:07.171 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:33:07.171 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:33:07.171 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:33:07.171 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:33:07.171 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:33:07.171 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:33:07.171 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-msgr_dispatch_throttler-radosclient": [ 2024-03-16T07:33:07.171 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:33:07.171 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:33:07.171 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:33:07.171 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:33:07.172 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-03-16T07:33:07.172 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:33:07.172 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 71, 2024-03-16T07:33:07.172 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 2458130, 2024-03-16T07:33:07.172 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:33:07.172 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 71, 2024-03-16T07:33:07.172 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:33:07.172 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:33:07.172 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 71, 2024-03-16T07:33:07.172 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 2458130, 2024-03-16T07:33:07.172 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:33:07.172 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:33:07.172 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:33:07.172 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:33:07.172 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:33:07.172 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:33:07.173 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:33:07.173 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:33:07.173 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-objecter_bytes": [ 2024-03-16T07:33:07.173 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:33:07.173 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:33:07.173 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:33:07.173 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:33:07.173 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-03-16T07:33:07.173 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:33:07.173 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 0, 2024-03-16T07:33:07.173 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 0, 2024-03-16T07:33:07.173 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:33:07.173 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 0, 2024-03-16T07:33:07.173 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:33:07.173 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:33:07.173 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 0, 2024-03-16T07:33:07.173 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 0, 2024-03-16T07:33:07.174 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:33:07.174 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:33:07.174 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:33:07.174 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:33:07.174 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:33:07.174 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:33:07.174 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:33:07.174 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:33:07.174 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-objecter_ops": [ 2024-03-16T07:33:07.174 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:33:07.174 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:33:07.174 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:33:07.174 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:33:07.174 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 1024, 2024-03-16T07:33:07.174 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:33:07.174 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 0, 2024-03-16T07:33:07.174 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 0, 2024-03-16T07:33:07.175 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:33:07.175 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 0, 2024-03-16T07:33:07.175 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:33:07.175 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:33:07.175 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 0, 2024-03-16T07:33:07.175 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 0, 2024-03-16T07:33:07.175 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:33:07.175 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:33:07.175 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:33:07.175 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:33:07.175 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:33:07.175 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:33:07.175 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:33:07.175 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2024-03-16T07:33:07.175 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-03-16T07:33:07.176 DEBUG:tasks.cephfs.test_mirroring:command returned={ "AsyncMessenger::Worker": [ { "labels": { "id": "0" }, "counters": { "msgr_connection_ready_timeouts": 0, "msgr_connection_idle_timeouts": 0 } }, { "labels": { "id": "1" }, "counters": { "msgr_connection_ready_timeouts": 0, "msgr_connection_idle_timeouts": 0 } }, { "labels": { "id": "2" }, "counters": { "msgr_connection_ready_timeouts": 0, "msgr_connection_idle_timeouts": 0 } } ], "AsyncMessenger::Worker-0": [ { "labels": {}, "counters": { "msgr_recv_messages": 11, "msgr_send_messages": 109, "msgr_recv_bytes": 1584, "msgr_send_bytes": 891472, "msgr_created_connections": 22, "msgr_active_connections": 3, "msgr_running_total_time": 0.321323931, "msgr_running_send_time": 0.114561051, "msgr_running_recv_time": 0.162060989, "msgr_running_fast_dispatch_time": 0.000000000, "msgr_send_messages_queue_lat": { "avgcount": 99, "sum": 0.183018637, "avgtime": 0.001848673 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "msgr_recv_encrypted_bytes": 1584, "msgr_send_encrypted_bytes": 891472 } } ], "AsyncMessenger::Worker-1": [ { "labels": {}, "counters": { "msgr_recv_messages": 103, "msgr_send_messages": 5, "msgr_recv_bytes": 431200, "msgr_send_bytes": 1136, "msgr_created_connections": 3, "msgr_active_connections": 0, "msgr_running_total_time": 0.523896092, "msgr_running_send_time": 0.004877032, "msgr_running_recv_time": 0.327859637, "msgr_running_fast_dispatch_time": 0.172734448, "msgr_send_messages_queue_lat": { "avgcount": 5, "sum": 0.054797003, "avgtime": 0.010959400 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "msgr_recv_encrypted_bytes": 431200, "msgr_send_encrypted_bytes": 1136 } } ], "AsyncMessenger::Worker-2": [ { "labels": {}, "counters": { "msgr_recv_messages": 63, "msgr_send_messages": 8, "msgr_recv_bytes": 2467072, "msgr_send_bytes": 1600, "msgr_created_connections": 2, "msgr_active_connections": 1, "msgr_running_total_time": 1.330763766, "msgr_running_send_time": 0.007865017, "msgr_running_recv_time": 2.488671750, "msgr_running_fast_dispatch_time": 0.000000000, "msgr_send_messages_queue_lat": { "avgcount": 8, "sum": 0.161009804, "avgtime": 0.020126225 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "msgr_recv_encrypted_bytes": 2467072, "msgr_send_encrypted_bytes": 1600 } } ], "cct": [ { "labels": {}, "counters": { "total_workers": 0, "unhealthy_workers": 0 } } ], "cephfs_mirror": [ { "labels": {}, "counters": { "mirrored_filesystems": 1, "mirror_enable_failures": 0 } } ], "cephfs_mirror_mirrored_filesystems": [ { "labels": { "filesystem": "cephfs" }, "counters": { "mirroring_peers": 1, "directory_count": 0 } } ], "cephfs_mirror_peers": [ { "labels": { "peer_cluster_filesystem": "backup_fs", "peer_cluster_name": "ceph", "source_filesystem": "cephfs", "source_fscid": "12" }, "counters": { "snaps_synced": 0, "snaps_deleted": 0, "snaps_renamed": 0, "sync_failures": 0, "avg_sync_time": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "sync_bytes": 0 } } ], "mempool": [ { "labels": {}, "counters": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_cache_buffer_bytes": 0, "bluestore_cache_buffer_items": 0, "bluestore_extent_bytes": 0, "bluestore_extent_items": 0, "bluestore_blob_bytes": 0, "bluestore_blob_items": 0, "bluestore_shared_blob_bytes": 0, "bluestore_shared_blob_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_items": 0, "bluefs_bytes": 0, "bluefs_items": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "buffer_anon_bytes": 202322, "buffer_anon_items": 77, "buffer_meta_bytes": 0, "buffer_meta_items": 0, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 33080, "osdmap_items": 316, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "mds_co_bytes": 0, "mds_co_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 } } ], "objecter": [ { "labels": {}, "counters": { "op_active": 0, "op_laggy": 0, "op_send": 0, "op_send_bytes": 0, "op_resend": 0, "op_reply": 0, "op_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "op_inflight": 0, "oplen_avg": { "avgcount": 0, "sum": 0 }, "op": 0, "op_r": 0, "op_w": 0, "op_rmw": 0, "op_pg": 0, "osdop_stat": 0, "osdop_create": 0, "osdop_read": 0, "osdop_write": 0, "osdop_writefull": 0, "osdop_writesame": 0, "osdop_append": 0, "osdop_zero": 0, "osdop_truncate": 0, "osdop_delete": 0, "osdop_mapext": 0, "osdop_sparse_read": 0, "osdop_clonerange": 0, "osdop_getxattr": 0, "osdop_setxattr": 0, "osdop_cmpxattr": 0, "osdop_rmxattr": 0, "osdop_resetxattrs": 0, "osdop_call": 0, "osdop_watch": 0, "osdop_notify": 0, "osdop_src_cmpxattr": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_other": 0, "linger_active": 0, "linger_send": 0, "linger_resend": 0, "linger_ping": 0, "poolop_active": 0, "poolop_send": 0, "poolop_resend": 0, "poolstat_active": 0, "poolstat_send": 0, "poolstat_resend": 0, "statfs_active": 0, "statfs_send": 0, "statfs_resend": 0, "command_active": 0, "command_send": 0, "command_resend": 0, "map_epoch": 0, "map_full": 0, "map_inc": 0, "osd_sessions": 0, "osd_session_open": 0, "osd_session_close": 0, "osd_laggy": 0, "omap_wr": 0, "omap_rd": 0, "omap_del": 0 } } ], "throttle-msgr_dispatch_throttler-client": [ { "labels": {}, "counters": { "val": 0, "max": 104857600, "get_started": 0, "get": 103, "get_sum": 417212, "get_or_fail_fail": 0, "get_or_fail_success": 103, "take": 0, "take_sum": 0, "put": 103, "put_sum": 417212, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ], "throttle-msgr_dispatch_throttler-radosclient": [ { "labels": {}, "counters": { "val": 0, "max": 104857600, "get_started": 0, "get": 71, "get_sum": 2458130, "get_or_fail_fail": 0, "get_or_fail_success": 71, "take": 0, "take_sum": 0, "put": 71, "put_sum": 2458130, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ], "throttle-objecter_bytes": [ { "labels": {}, "counters": { "val": 0, "max": 104857600, "get_started": 0, "get": 0, "get_sum": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "take": 0, "take_sum": 0, "put": 0, "put_sum": 0, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ], "throttle-objecter_ops": [ { "labels": {}, "counters": { "val": 0, "max": 1024, "get_started": 0, "get": 0, "get_sum": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "take": 0, "take_sum": 0, "put": 0, "put_sum": 0, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ] } 2024-03-16T07:33:07.177 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-03-16T07:33:07.177 DEBUG:teuthology.orchestra.run.smithi049:mirror status for fs: cephfs> ceph --admin-daemon /var/run/ceph/cephfs-mirror.asok fs mirror status cephfs@12 2024-03-16T07:33:07.273 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-03-16T07:33:07.273 INFO:teuthology.orchestra.run.smithi049.stdout: "rados_inst": "172.21.15.49:0/4185192406", 2024-03-16T07:33:07.273 INFO:teuthology.orchestra.run.smithi049.stdout: "peers": { 2024-03-16T07:33:07.273 INFO:teuthology.orchestra.run.smithi049.stdout: "140aa0e6-bddb-4f74-8622-2c5b40796ff5": { 2024-03-16T07:33:07.273 INFO:teuthology.orchestra.run.smithi049.stdout: "remote": { 2024-03-16T07:33:07.274 INFO:teuthology.orchestra.run.smithi049.stdout: "client_name": "client.mirror_remote", 2024-03-16T07:33:07.274 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_name": "ceph", 2024-03-16T07:33:07.274 INFO:teuthology.orchestra.run.smithi049.stdout: "fs_name": "backup_fs" 2024-03-16T07:33:07.274 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:33:07.274 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:33:07.274 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:33:07.274 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_dirs": { 2024-03-16T07:33:07.274 INFO:teuthology.orchestra.run.smithi049.stdout: "dir_count": 0 2024-03-16T07:33:07.274 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:33:07.274 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-03-16T07:33:07.281 DEBUG:tasks.cephfs.test_mirroring:command returned={ "rados_inst": "172.21.15.49:0/4185192406", "peers": { "140aa0e6-bddb-4f74-8622-2c5b40796ff5": { "remote": { "client_name": "client.mirror_remote", "cluster_name": "ceph", "fs_name": "backup_fs" } } }, "snap_dirs": { "dir_count": 0 } } 2024-03-16T07:33:07.281 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-03-16T07:33:07.281 DEBUG:teuthology.orchestra.run.smithi049:mirror status for fs: cephfs> ceph --admin-daemon /var/run/ceph/cephfs-mirror.asok fs mirror status cephfs@12 2024-03-16T07:33:07.376 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-03-16T07:33:07.376 INFO:teuthology.orchestra.run.smithi049.stdout: "rados_inst": "172.21.15.49:0/4185192406", 2024-03-16T07:33:07.376 INFO:teuthology.orchestra.run.smithi049.stdout: "peers": { 2024-03-16T07:33:07.376 INFO:teuthology.orchestra.run.smithi049.stdout: "140aa0e6-bddb-4f74-8622-2c5b40796ff5": { 2024-03-16T07:33:07.376 INFO:teuthology.orchestra.run.smithi049.stdout: "remote": { 2024-03-16T07:33:07.376 INFO:teuthology.orchestra.run.smithi049.stdout: "client_name": "client.mirror_remote", 2024-03-16T07:33:07.376 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_name": "ceph", 2024-03-16T07:33:07.376 INFO:teuthology.orchestra.run.smithi049.stdout: "fs_name": "backup_fs" 2024-03-16T07:33:07.377 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:33:07.377 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:33:07.377 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:33:07.377 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_dirs": { 2024-03-16T07:33:07.377 INFO:teuthology.orchestra.run.smithi049.stdout: "dir_count": 0 2024-03-16T07:33:07.377 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:33:07.377 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-03-16T07:33:07.383 DEBUG:tasks.cephfs.test_mirroring:command returned={ "rados_inst": "172.21.15.49:0/4185192406", "peers": { "140aa0e6-bddb-4f74-8622-2c5b40796ff5": { "remote": { "client_name": "client.mirror_remote", "cluster_name": "ceph", "fs_name": "backup_fs" } } }, "snap_dirs": { "dir_count": 0 } } 2024-03-16T07:33:07.383 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:33:07.383 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec cat /var/run/ceph/cephfs-mirror.pid) 2024-03-16T07:33:07.399 INFO:teuthology.orchestra.run.smithi049.stdout:44767 2024-03-16T07:33:07.399 DEBUG:tasks.cephfs.test_mirroring:SIGSTOP to cephfs-mirror pid 44767 2024-03-16T07:33:07.399 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:33:07.399 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec kill -SIGSTOP 44767) 2024-03-16T07:33:08.977 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T07:33:39.033 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T07:33:47.455 DEBUG:tasks.cephfs.test_mirroring:SIGCONT to cephfs-mirror 2024-03-16T07:33:47.455 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:33:47.456 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec kill -SIGCONT 44767) 2024-03-16T07:33:47.472 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T07:33:47.933 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:33:47.933 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":150,"fsid":"f91af061-9eac-4793-87fa-8d27ae3d242f","created":"2024-03-16T07:24:20.357868+0000","modified":"2024-03-16T07:33:44.534550+0000","last_up_change":"2024-03-16T07:24:27.474980+0000","last_in_change":"2024-03-16T07:24:21.254179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":27,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T07:24:28.947521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_metadata","create_time":"2024-03-16T07:32:15.892059+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"141","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":25,"pool_name":"cephfs_data","create_time":"2024-03-16T07:32:16.561057+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"142","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":26,"pool_name":"backup_fs_metadata","create_time":"2024-03-16T07:32:30.176149+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"145","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"backup_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.309999942779541,"score_stable":1.309999942779541,"optimal_score":1,"raw_score_acting":1.309999942779541,"raw_score_stable":1.309999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":27,"pool_name":"backup_fs_data","create_time":"2024-03-16T07:32:30.596010+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"146","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"backup_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2df14aac-98dc-4e3c-ae7e-9eb677aa30be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6801","nonce":2744935777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6803","nonce":2744935777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6807","nonce":2744935777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6805","nonce":2744935777}]},"public_addr":"172.21.15.49:6801/2744935777","cluster_addr":"172.21.15.49:6803/2744935777","heartbeat_back_addr":"172.21.15.49:6807/2744935777","heartbeat_front_addr":"172.21.15.49:6805/2744935777","state":["exists","up"]},{"osd":1,"uuid":"80461bd9-59ef-46df-9eea-bad92d960c57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6811","nonce":1655120118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6815","nonce":1655120118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6821","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6823","nonce":1655120118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6817","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6819","nonce":1655120118}]},"public_addr":"172.21.15.49:6811/1655120118","cluster_addr":"172.21.15.49:6815/1655120118","heartbeat_back_addr":"172.21.15.49:6823/1655120118","heartbeat_front_addr":"172.21.15.49:6819/1655120118","state":["exists","up"]},{"osd":2,"uuid":"d6bf40eb-6e42-4ec9-8b3d-0b6c5a6def79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6810","nonce":3815472376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6814","nonce":3815472376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6822","nonce":3815472376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6818","nonce":3815472376}]},"public_addr":"172.21.15.49:6810/3815472376","cluster_addr":"172.21.15.49:6814/3815472376","heartbeat_back_addr":"172.21.15.49:6822/3815472376","heartbeat_front_addr":"172.21.15.49:6818/3815472376","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.641492+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.668598+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.614940+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"25.1d","mappings":[{"from":0,"to":2}]},{"pgid":"25.30","mappings":[{"from":0,"to":1}]},{"pgid":"27.35","mappings":[{"from":0,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.49:0/2799967982":"2024-03-17T07:32:43.474587+0000","172.21.15.49:0/4185192406":"2024-03-16T08:33:37.476103+0000","172.21.15.49:0/858221795":"2024-03-17T07:32:43.474587+0000","172.21.15.49:0/2121807561":"2024-03-17T07:32:43.474587+0000","172.21.15.49:0/1336083103":"2024-03-17T07:32:43.474587+0000","172.21.15.49:6825/2955625097":"2024-03-17T07:32:43.474587+0000","172.21.15.49:6824/2955625097":"2024-03-17T07:32:43.474587+0000","172.21.15.49:0/2836520053":"2024-03-17T07:32:43.474587+0000","172.21.15.49:0/417496104":"2024-03-17T07:32:43.474587+0000","172.21.15.49:0/1051974920":"2024-03-17T07:32:43.474587+0000","172.21.15.49:0/1787331336":"2024-03-17T07:32:43.474587+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T07:34:09.096 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T07:34:27.946 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-03-16T07:34:27.947 DEBUG:teuthology.orchestra.run.smithi049:mirror status for fs: cephfs> ceph --admin-daemon /var/run/ceph/cephfs-mirror.asok fs mirror status cephfs@12 2024-03-16T07:34:28.043 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-03-16T07:34:28.043 INFO:teuthology.orchestra.run.smithi049.stdout: "rados_inst": "172.21.15.49:0/4170960283", 2024-03-16T07:34:28.043 INFO:teuthology.orchestra.run.smithi049.stdout: "peers": { 2024-03-16T07:34:28.043 INFO:teuthology.orchestra.run.smithi049.stdout: "140aa0e6-bddb-4f74-8622-2c5b40796ff5": { 2024-03-16T07:34:28.043 INFO:teuthology.orchestra.run.smithi049.stdout: "remote": { 2024-03-16T07:34:28.043 INFO:teuthology.orchestra.run.smithi049.stdout: "client_name": "client.mirror_remote", 2024-03-16T07:34:28.043 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_name": "ceph", 2024-03-16T07:34:28.043 INFO:teuthology.orchestra.run.smithi049.stdout: "fs_name": "backup_fs" 2024-03-16T07:34:28.044 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:34:28.044 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:34:28.044 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:34:28.044 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_dirs": { 2024-03-16T07:34:28.044 INFO:teuthology.orchestra.run.smithi049.stdout: "dir_count": 0 2024-03-16T07:34:28.044 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:34:28.044 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-03-16T07:34:28.050 DEBUG:tasks.cephfs.test_mirroring:command returned={ "rados_inst": "172.21.15.49:0/4170960283", "peers": { "140aa0e6-bddb-4f74-8622-2c5b40796ff5": { "remote": { "client_name": "client.mirror_remote", "cluster_name": "ceph", "fs_name": "backup_fs" } } }, "snap_dirs": { "dir_count": 0 } } 2024-03-16T07:34:28.050 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-03-16T07:34:28.050 DEBUG:teuthology.orchestra.run.smithi049:mirror status for fs: cephfs> ceph --admin-daemon /var/run/ceph/cephfs-mirror.asok fs mirror status cephfs@12 2024-03-16T07:34:28.148 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-03-16T07:34:28.149 INFO:teuthology.orchestra.run.smithi049.stdout: "rados_inst": "172.21.15.49:0/4170960283", 2024-03-16T07:34:28.149 INFO:teuthology.orchestra.run.smithi049.stdout: "peers": { 2024-03-16T07:34:28.149 INFO:teuthology.orchestra.run.smithi049.stdout: "140aa0e6-bddb-4f74-8622-2c5b40796ff5": { 2024-03-16T07:34:28.149 INFO:teuthology.orchestra.run.smithi049.stdout: "remote": { 2024-03-16T07:34:28.149 INFO:teuthology.orchestra.run.smithi049.stdout: "client_name": "client.mirror_remote", 2024-03-16T07:34:28.149 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_name": "ceph", 2024-03-16T07:34:28.149 INFO:teuthology.orchestra.run.smithi049.stdout: "fs_name": "backup_fs" 2024-03-16T07:34:28.149 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:34:28.149 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:34:28.149 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:34:28.149 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_dirs": { 2024-03-16T07:34:28.149 INFO:teuthology.orchestra.run.smithi049.stdout: "dir_count": 0 2024-03-16T07:34:28.150 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:34:28.150 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-03-16T07:34:28.159 DEBUG:tasks.cephfs.test_mirroring:command returned={ "rados_inst": "172.21.15.49:0/4170960283", "peers": { "140aa0e6-bddb-4f74-8622-2c5b40796ff5": { "remote": { "client_name": "client.mirror_remote", "cluster_name": "ceph", "fs_name": "backup_fs" } } }, "snap_dirs": { "dir_count": 0 } } 2024-03-16T07:34:28.159 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-03-16T07:34:28.160 DEBUG:teuthology.orchestra.run.smithi049:counter dump for fs: cephfs> ceph --admin-daemon /var/run/ceph/cephfs-mirror.asok counter dump 2024-03-16T07:34:28.275 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-03-16T07:34:28.275 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker": [ 2024-03-16T07:34:28.275 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:34:28.275 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:34:28.275 INFO:teuthology.orchestra.run.smithi049.stdout: "id": "0" 2024-03-16T07:34:28.275 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:34:28.275 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:34:28.275 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_ready_timeouts": 0, 2024-03-16T07:34:28.276 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_idle_timeouts": 0 2024-03-16T07:34:28.276 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:34:28.276 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:34:28.276 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:34:28.276 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:34:28.276 INFO:teuthology.orchestra.run.smithi049.stdout: "id": "1" 2024-03-16T07:34:28.276 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:34:28.276 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:34:28.276 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_ready_timeouts": 0, 2024-03-16T07:34:28.276 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_idle_timeouts": 0 2024-03-16T07:34:28.276 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:34:28.276 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:34:28.276 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:34:28.276 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:34:28.276 INFO:teuthology.orchestra.run.smithi049.stdout: "id": "2" 2024-03-16T07:34:28.277 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:34:28.277 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:34:28.277 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_ready_timeouts": 0, 2024-03-16T07:34:28.277 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_idle_timeouts": 0 2024-03-16T07:34:28.277 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:34:28.277 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:34:28.277 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:34:28.277 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-0": [ 2024-03-16T07:34:28.277 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:34:28.277 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:34:28.277 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:34:28.277 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 11, 2024-03-16T07:34:28.277 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 118, 2024-03-16T07:34:28.277 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 1584, 2024-03-16T07:34:28.277 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 895616, 2024-03-16T07:34:28.278 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 22, 2024-03-16T07:34:28.278 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 3, 2024-03-16T07:34:28.278 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 0.334729560, 2024-03-16T07:34:28.278 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.125070658, 2024-03-16T07:34:28.278 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 0.162060989, 2024-03-16T07:34:28.278 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-03-16T07:34:28.278 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T07:34:28.278 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 108, 2024-03-16T07:34:28.278 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.197404087, 2024-03-16T07:34:28.278 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.001827815 2024-03-16T07:34:28.278 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:34:28.278 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-03-16T07:34:28.278 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:34:28.278 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:34:28.278 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:34:28.279 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:34:28.279 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 1584, 2024-03-16T07:34:28.279 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 895616 2024-03-16T07:34:28.279 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:34:28.279 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:34:28.279 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:34:28.279 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-1": [ 2024-03-16T07:34:28.279 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:34:28.279 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:34:28.279 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:34:28.279 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 106, 2024-03-16T07:34:28.279 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 9, 2024-03-16T07:34:28.279 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 432016, 2024-03-16T07:34:28.279 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 1776, 2024-03-16T07:34:28.279 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 4, 2024-03-16T07:34:28.280 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 0, 2024-03-16T07:34:28.280 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 0.684565044, 2024-03-16T07:34:28.280 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.048352499, 2024-03-16T07:34:28.280 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 0.442462807, 2024-03-16T07:34:28.280 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.172734448, 2024-03-16T07:34:28.280 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T07:34:28.280 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 8, 2024-03-16T07:34:28.280 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.187770743, 2024-03-16T07:34:28.280 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.023471342 2024-03-16T07:34:28.280 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:34:28.280 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-03-16T07:34:28.280 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:34:28.280 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:34:28.280 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:34:28.280 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:34:28.281 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 432016, 2024-03-16T07:34:28.281 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 1776 2024-03-16T07:34:28.281 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:34:28.281 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:34:28.281 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:34:28.281 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-2": [ 2024-03-16T07:34:28.281 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:34:28.281 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:34:28.281 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:34:28.281 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 68, 2024-03-16T07:34:28.281 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 12, 2024-03-16T07:34:28.281 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 2559744, 2024-03-16T07:34:28.281 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 2240, 2024-03-16T07:34:28.281 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 3, 2024-03-16T07:34:28.281 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 1, 2024-03-16T07:34:28.281 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 1.495163128, 2024-03-16T07:34:28.282 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.013360039, 2024-03-16T07:34:28.282 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 2.683662223, 2024-03-16T07:34:28.282 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-03-16T07:34:28.282 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T07:34:28.282 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 11, 2024-03-16T07:34:28.282 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.346048562, 2024-03-16T07:34:28.282 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.031458960 2024-03-16T07:34:28.282 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:34:28.282 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-03-16T07:34:28.282 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:34:28.282 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:34:28.282 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:34:28.282 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:34:28.282 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 2559744, 2024-03-16T07:34:28.283 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 2240 2024-03-16T07:34:28.283 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:34:28.283 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:34:28.283 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:34:28.283 INFO:teuthology.orchestra.run.smithi049.stdout: "cct": [ 2024-03-16T07:34:28.283 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:34:28.283 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:34:28.283 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:34:28.283 INFO:teuthology.orchestra.run.smithi049.stdout: "total_workers": 0, 2024-03-16T07:34:28.283 INFO:teuthology.orchestra.run.smithi049.stdout: "unhealthy_workers": 0 2024-03-16T07:34:28.283 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:34:28.283 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:34:28.283 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:34:28.283 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs_mirror": [ 2024-03-16T07:34:28.283 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:34:28.283 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:34:28.284 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:34:28.284 INFO:teuthology.orchestra.run.smithi049.stdout: "mirrored_filesystems": 2, 2024-03-16T07:34:28.284 INFO:teuthology.orchestra.run.smithi049.stdout: "mirror_enable_failures": 0 2024-03-16T07:34:28.284 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:34:28.284 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:34:28.284 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:34:28.284 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs_mirror_mirrored_filesystems": [ 2024-03-16T07:34:28.284 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:34:28.284 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:34:28.284 INFO:teuthology.orchestra.run.smithi049.stdout: "filesystem": "cephfs" 2024-03-16T07:34:28.284 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:34:28.284 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:34:28.284 INFO:teuthology.orchestra.run.smithi049.stdout: "mirroring_peers": 1, 2024-03-16T07:34:28.284 INFO:teuthology.orchestra.run.smithi049.stdout: "directory_count": 0 2024-03-16T07:34:28.284 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:34:28.285 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:34:28.285 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:34:28.285 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs_mirror_peers": [ 2024-03-16T07:34:28.285 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:34:28.285 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:34:28.285 INFO:teuthology.orchestra.run.smithi049.stdout: "peer_cluster_filesystem": "backup_fs", 2024-03-16T07:34:28.285 INFO:teuthology.orchestra.run.smithi049.stdout: "peer_cluster_name": "ceph", 2024-03-16T07:34:28.285 INFO:teuthology.orchestra.run.smithi049.stdout: "source_filesystem": "cephfs", 2024-03-16T07:34:28.285 INFO:teuthology.orchestra.run.smithi049.stdout: "source_fscid": "12" 2024-03-16T07:34:28.285 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:34:28.285 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:34:28.285 INFO:teuthology.orchestra.run.smithi049.stdout: "snaps_synced": 0, 2024-03-16T07:34:28.285 INFO:teuthology.orchestra.run.smithi049.stdout: "snaps_deleted": 0, 2024-03-16T07:34:28.285 INFO:teuthology.orchestra.run.smithi049.stdout: "snaps_renamed": 0, 2024-03-16T07:34:28.285 INFO:teuthology.orchestra.run.smithi049.stdout: "sync_failures": 0, 2024-03-16T07:34:28.286 INFO:teuthology.orchestra.run.smithi049.stdout: "avg_sync_time": { 2024-03-16T07:34:28.286 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:34:28.286 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:34:28.286 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:34:28.286 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:34:28.286 INFO:teuthology.orchestra.run.smithi049.stdout: "sync_bytes": 0 2024-03-16T07:34:28.286 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:34:28.286 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:34:28.286 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:34:28.286 INFO:teuthology.orchestra.run.smithi049.stdout: "mempool": [ 2024-03-16T07:34:28.286 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:34:28.286 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:34:28.286 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:34:28.286 INFO:teuthology.orchestra.run.smithi049.stdout: "bloom_filter_bytes": 0, 2024-03-16T07:34:28.287 INFO:teuthology.orchestra.run.smithi049.stdout: "bloom_filter_items": 0, 2024-03-16T07:34:28.287 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_alloc_bytes": 0, 2024-03-16T07:34:28.287 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_alloc_items": 0, 2024-03-16T07:34:28.287 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_data_bytes": 0, 2024-03-16T07:34:28.287 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_data_items": 0, 2024-03-16T07:34:28.287 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_onode_bytes": 0, 2024-03-16T07:34:28.287 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_onode_items": 0, 2024-03-16T07:34:28.287 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_meta_bytes": 0, 2024-03-16T07:34:28.287 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_meta_items": 0, 2024-03-16T07:34:28.287 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_other_bytes": 0, 2024-03-16T07:34:28.287 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_other_items": 0, 2024-03-16T07:34:28.287 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_buffer_bytes": 0, 2024-03-16T07:34:28.287 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_buffer_items": 0, 2024-03-16T07:34:28.287 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_extent_bytes": 0, 2024-03-16T07:34:28.287 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_extent_items": 0, 2024-03-16T07:34:28.287 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_blob_bytes": 0, 2024-03-16T07:34:28.288 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_blob_items": 0, 2024-03-16T07:34:28.288 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_shared_blob_bytes": 0, 2024-03-16T07:34:28.288 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_shared_blob_items": 0, 2024-03-16T07:34:28.288 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_inline_bl_bytes": 0, 2024-03-16T07:34:28.288 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_inline_bl_items": 0, 2024-03-16T07:34:28.288 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_fsck_bytes": 0, 2024-03-16T07:34:28.288 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_fsck_items": 0, 2024-03-16T07:34:28.288 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_txc_bytes": 0, 2024-03-16T07:34:28.288 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_txc_items": 0, 2024-03-16T07:34:28.288 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_deferred_bytes": 0, 2024-03-16T07:34:28.288 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_deferred_items": 0, 2024-03-16T07:34:28.288 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_bytes": 0, 2024-03-16T07:34:28.288 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_items": 0, 2024-03-16T07:34:28.288 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_bytes": 0, 2024-03-16T07:34:28.288 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_items": 0, 2024-03-16T07:34:28.288 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_reader_bytes": 0, 2024-03-16T07:34:28.289 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_reader_items": 0, 2024-03-16T07:34:28.289 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_writer_bytes": 0, 2024-03-16T07:34:28.289 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_writer_items": 0, 2024-03-16T07:34:28.289 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_anon_bytes": 193792, 2024-03-16T07:34:28.289 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_anon_items": 75, 2024-03-16T07:34:28.289 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_meta_bytes": 0, 2024-03-16T07:34:28.289 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_meta_items": 0, 2024-03-16T07:34:28.289 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_bytes": 0, 2024-03-16T07:34:28.289 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_items": 0, 2024-03-16T07:34:28.289 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_mapbl_bytes": 0, 2024-03-16T07:34:28.289 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_mapbl_items": 0, 2024-03-16T07:34:28.289 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pglog_bytes": 0, 2024-03-16T07:34:28.289 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pglog_items": 0, 2024-03-16T07:34:28.289 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_bytes": 34488, 2024-03-16T07:34:28.289 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_items": 344, 2024-03-16T07:34:28.290 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_mapping_bytes": 0, 2024-03-16T07:34:28.290 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_mapping_items": 0, 2024-03-16T07:34:28.290 INFO:teuthology.orchestra.run.smithi049.stdout: "pgmap_bytes": 0, 2024-03-16T07:34:28.290 INFO:teuthology.orchestra.run.smithi049.stdout: "pgmap_items": 0, 2024-03-16T07:34:28.290 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_co_bytes": 0, 2024-03-16T07:34:28.290 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_co_items": 0, 2024-03-16T07:34:28.290 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_1_bytes": 0, 2024-03-16T07:34:28.290 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_1_items": 0, 2024-03-16T07:34:28.290 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_2_bytes": 0, 2024-03-16T07:34:28.290 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_2_items": 0 2024-03-16T07:34:28.290 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:34:28.290 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:34:28.290 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:34:28.290 INFO:teuthology.orchestra.run.smithi049.stdout: "objecter": [ 2024-03-16T07:34:28.291 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:34:28.291 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:34:28.291 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:34:28.291 INFO:teuthology.orchestra.run.smithi049.stdout: "op_active": 0, 2024-03-16T07:34:28.291 INFO:teuthology.orchestra.run.smithi049.stdout: "op_laggy": 0, 2024-03-16T07:34:28.291 INFO:teuthology.orchestra.run.smithi049.stdout: "op_send": 0, 2024-03-16T07:34:28.291 INFO:teuthology.orchestra.run.smithi049.stdout: "op_send_bytes": 0, 2024-03-16T07:34:28.291 INFO:teuthology.orchestra.run.smithi049.stdout: "op_resend": 0, 2024-03-16T07:34:28.291 INFO:teuthology.orchestra.run.smithi049.stdout: "op_reply": 0, 2024-03-16T07:34:28.291 INFO:teuthology.orchestra.run.smithi049.stdout: "op_latency": { 2024-03-16T07:34:28.291 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:34:28.291 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:34:28.291 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:34:28.291 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:34:28.291 INFO:teuthology.orchestra.run.smithi049.stdout: "op_inflight": 0, 2024-03-16T07:34:28.291 INFO:teuthology.orchestra.run.smithi049.stdout: "oplen_avg": { 2024-03-16T07:34:28.292 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:34:28.292 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0 2024-03-16T07:34:28.292 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:34:28.292 INFO:teuthology.orchestra.run.smithi049.stdout: "op": 0, 2024-03-16T07:34:28.292 INFO:teuthology.orchestra.run.smithi049.stdout: "op_r": 0, 2024-03-16T07:34:28.292 INFO:teuthology.orchestra.run.smithi049.stdout: "op_w": 0, 2024-03-16T07:34:28.292 INFO:teuthology.orchestra.run.smithi049.stdout: "op_rmw": 0, 2024-03-16T07:34:28.292 INFO:teuthology.orchestra.run.smithi049.stdout: "op_pg": 0, 2024-03-16T07:34:28.292 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_stat": 0, 2024-03-16T07:34:28.292 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_create": 0, 2024-03-16T07:34:28.292 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_read": 0, 2024-03-16T07:34:28.292 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_write": 0, 2024-03-16T07:34:28.292 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_writefull": 0, 2024-03-16T07:34:28.292 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_writesame": 0, 2024-03-16T07:34:28.292 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_append": 0, 2024-03-16T07:34:28.293 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_zero": 0, 2024-03-16T07:34:28.293 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_truncate": 0, 2024-03-16T07:34:28.293 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_delete": 0, 2024-03-16T07:34:28.293 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_mapext": 0, 2024-03-16T07:34:28.293 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_sparse_read": 0, 2024-03-16T07:34:28.293 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_clonerange": 0, 2024-03-16T07:34:28.293 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_getxattr": 0, 2024-03-16T07:34:28.293 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_setxattr": 0, 2024-03-16T07:34:28.293 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_cmpxattr": 0, 2024-03-16T07:34:28.293 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_rmxattr": 0, 2024-03-16T07:34:28.293 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_resetxattrs": 0, 2024-03-16T07:34:28.293 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_call": 0, 2024-03-16T07:34:28.293 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_watch": 0, 2024-03-16T07:34:28.293 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_notify": 0, 2024-03-16T07:34:28.293 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_src_cmpxattr": 0, 2024-03-16T07:34:28.294 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_pgls": 0, 2024-03-16T07:34:28.294 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_pgls_filter": 0, 2024-03-16T07:34:28.294 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_other": 0, 2024-03-16T07:34:28.294 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_active": 0, 2024-03-16T07:34:28.294 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_send": 0, 2024-03-16T07:34:28.294 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_resend": 0, 2024-03-16T07:34:28.294 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_ping": 0, 2024-03-16T07:34:28.294 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_active": 0, 2024-03-16T07:34:28.294 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_send": 0, 2024-03-16T07:34:28.294 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_resend": 0, 2024-03-16T07:34:28.294 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_active": 0, 2024-03-16T07:34:28.294 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_send": 0, 2024-03-16T07:34:28.294 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_resend": 0, 2024-03-16T07:34:28.294 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_active": 0, 2024-03-16T07:34:28.294 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_send": 0, 2024-03-16T07:34:28.295 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_resend": 0, 2024-03-16T07:34:28.295 INFO:teuthology.orchestra.run.smithi049.stdout: "command_active": 0, 2024-03-16T07:34:28.295 INFO:teuthology.orchestra.run.smithi049.stdout: "command_send": 0, 2024-03-16T07:34:28.295 INFO:teuthology.orchestra.run.smithi049.stdout: "command_resend": 0, 2024-03-16T07:34:28.295 INFO:teuthology.orchestra.run.smithi049.stdout: "map_epoch": 0, 2024-03-16T07:34:28.295 INFO:teuthology.orchestra.run.smithi049.stdout: "map_full": 0, 2024-03-16T07:34:28.295 INFO:teuthology.orchestra.run.smithi049.stdout: "map_inc": 0, 2024-03-16T07:34:28.297 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_sessions": 0, 2024-03-16T07:34:28.297 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_session_open": 0, 2024-03-16T07:34:28.297 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_session_close": 0, 2024-03-16T07:34:28.298 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_laggy": 0, 2024-03-16T07:34:28.298 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_wr": 0, 2024-03-16T07:34:28.298 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_rd": 0, 2024-03-16T07:34:28.298 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_del": 0 2024-03-16T07:34:28.298 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:34:28.298 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:34:28.298 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:34:28.298 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-msgr_dispatch_throttler-client": [ 2024-03-16T07:34:28.298 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:34:28.298 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:34:28.298 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:34:28.298 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:34:28.298 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-03-16T07:34:28.298 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:34:28.299 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 106, 2024-03-16T07:34:28.299 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 417627, 2024-03-16T07:34:28.299 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:34:28.299 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 106, 2024-03-16T07:34:28.299 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:34:28.299 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:34:28.299 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 106, 2024-03-16T07:34:28.299 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 417627, 2024-03-16T07:34:28.299 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:34:28.299 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:34:28.299 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:34:28.299 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:34:28.299 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:34:28.299 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:34:28.300 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:34:28.300 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:34:28.300 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-msgr_dispatch_throttler-radosclient": [ 2024-03-16T07:34:28.300 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:34:28.300 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:34:28.300 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:34:28.300 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:34:28.300 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-03-16T07:34:28.300 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:34:28.300 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 76, 2024-03-16T07:34:28.300 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 2550120, 2024-03-16T07:34:28.301 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:34:28.301 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 76, 2024-03-16T07:34:28.301 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:34:28.301 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:34:28.301 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 76, 2024-03-16T07:34:28.301 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 2550120, 2024-03-16T07:34:28.301 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:34:28.301 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:34:28.301 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:34:28.301 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:34:28.301 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:34:28.301 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:34:28.301 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:34:28.301 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:34:28.301 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-objecter_bytes": [ 2024-03-16T07:34:28.301 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:34:28.302 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:34:28.302 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:34:28.302 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:34:28.302 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-03-16T07:34:28.302 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:34:28.302 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 0, 2024-03-16T07:34:28.302 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 0, 2024-03-16T07:34:28.302 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:34:28.302 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 0, 2024-03-16T07:34:28.302 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:34:28.302 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:34:28.302 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 0, 2024-03-16T07:34:28.302 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 0, 2024-03-16T07:34:28.302 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:34:28.303 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:34:28.303 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:34:28.303 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:34:28.303 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:34:28.303 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:34:28.303 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:34:28.303 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:34:28.303 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-objecter_ops": [ 2024-03-16T07:34:28.303 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:34:28.303 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:34:28.303 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:34:28.303 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:34:28.303 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 1024, 2024-03-16T07:34:28.304 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:34:28.304 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 0, 2024-03-16T07:34:28.304 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 0, 2024-03-16T07:34:28.304 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:34:28.304 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 0, 2024-03-16T07:34:28.304 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:34:28.304 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:34:28.304 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 0, 2024-03-16T07:34:28.304 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 0, 2024-03-16T07:34:28.304 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:34:28.304 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:34:28.304 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:34:28.304 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:34:28.304 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:34:28.305 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:34:28.305 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:34:28.305 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2024-03-16T07:34:28.305 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-03-16T07:34:28.306 DEBUG:tasks.cephfs.test_mirroring:command returned={ "AsyncMessenger::Worker": [ { "labels": { "id": "0" }, "counters": { "msgr_connection_ready_timeouts": 0, "msgr_connection_idle_timeouts": 0 } }, { "labels": { "id": "1" }, "counters": { "msgr_connection_ready_timeouts": 0, "msgr_connection_idle_timeouts": 0 } }, { "labels": { "id": "2" }, "counters": { "msgr_connection_ready_timeouts": 0, "msgr_connection_idle_timeouts": 0 } } ], "AsyncMessenger::Worker-0": [ { "labels": {}, "counters": { "msgr_recv_messages": 11, "msgr_send_messages": 118, "msgr_recv_bytes": 1584, "msgr_send_bytes": 895616, "msgr_created_connections": 22, "msgr_active_connections": 3, "msgr_running_total_time": 0.334729560, "msgr_running_send_time": 0.125070658, "msgr_running_recv_time": 0.162060989, "msgr_running_fast_dispatch_time": 0.000000000, "msgr_send_messages_queue_lat": { "avgcount": 108, "sum": 0.197404087, "avgtime": 0.001827815 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "msgr_recv_encrypted_bytes": 1584, "msgr_send_encrypted_bytes": 895616 } } ], "AsyncMessenger::Worker-1": [ { "labels": {}, "counters": { "msgr_recv_messages": 106, "msgr_send_messages": 9, "msgr_recv_bytes": 432016, "msgr_send_bytes": 1776, "msgr_created_connections": 4, "msgr_active_connections": 0, "msgr_running_total_time": 0.684565044, "msgr_running_send_time": 0.048352499, "msgr_running_recv_time": 0.442462807, "msgr_running_fast_dispatch_time": 0.172734448, "msgr_send_messages_queue_lat": { "avgcount": 8, "sum": 0.187770743, "avgtime": 0.023471342 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "msgr_recv_encrypted_bytes": 432016, "msgr_send_encrypted_bytes": 1776 } } ], "AsyncMessenger::Worker-2": [ { "labels": {}, "counters": { "msgr_recv_messages": 68, "msgr_send_messages": 12, "msgr_recv_bytes": 2559744, "msgr_send_bytes": 2240, "msgr_created_connections": 3, "msgr_active_connections": 1, "msgr_running_total_time": 1.495163128, "msgr_running_send_time": 0.013360039, "msgr_running_recv_time": 2.683662223, "msgr_running_fast_dispatch_time": 0.000000000, "msgr_send_messages_queue_lat": { "avgcount": 11, "sum": 0.346048562, "avgtime": 0.031458960 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "msgr_recv_encrypted_bytes": 2559744, "msgr_send_encrypted_bytes": 2240 } } ], "cct": [ { "labels": {}, "counters": { "total_workers": 0, "unhealthy_workers": 0 } } ], "cephfs_mirror": [ { "labels": {}, "counters": { "mirrored_filesystems": 2, "mirror_enable_failures": 0 } } ], "cephfs_mirror_mirrored_filesystems": [ { "labels": { "filesystem": "cephfs" }, "counters": { "mirroring_peers": 1, "directory_count": 0 } } ], "cephfs_mirror_peers": [ { "labels": { "peer_cluster_filesystem": "backup_fs", "peer_cluster_name": "ceph", "source_filesystem": "cephfs", "source_fscid": "12" }, "counters": { "snaps_synced": 0, "snaps_deleted": 0, "snaps_renamed": 0, "sync_failures": 0, "avg_sync_time": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "sync_bytes": 0 } } ], "mempool": [ { "labels": {}, "counters": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_cache_buffer_bytes": 0, "bluestore_cache_buffer_items": 0, "bluestore_extent_bytes": 0, "bluestore_extent_items": 0, "bluestore_blob_bytes": 0, "bluestore_blob_items": 0, "bluestore_shared_blob_bytes": 0, "bluestore_shared_blob_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_items": 0, "bluefs_bytes": 0, "bluefs_items": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "buffer_anon_bytes": 193792, "buffer_anon_items": 75, "buffer_meta_bytes": 0, "buffer_meta_items": 0, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 34488, "osdmap_items": 344, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "mds_co_bytes": 0, "mds_co_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 } } ], "objecter": [ { "labels": {}, "counters": { "op_active": 0, "op_laggy": 0, "op_send": 0, "op_send_bytes": 0, "op_resend": 0, "op_reply": 0, "op_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "op_inflight": 0, "oplen_avg": { "avgcount": 0, "sum": 0 }, "op": 0, "op_r": 0, "op_w": 0, "op_rmw": 0, "op_pg": 0, "osdop_stat": 0, "osdop_create": 0, "osdop_read": 0, "osdop_write": 0, "osdop_writefull": 0, "osdop_writesame": 0, "osdop_append": 0, "osdop_zero": 0, "osdop_truncate": 0, "osdop_delete": 0, "osdop_mapext": 0, "osdop_sparse_read": 0, "osdop_clonerange": 0, "osdop_getxattr": 0, "osdop_setxattr": 0, "osdop_cmpxattr": 0, "osdop_rmxattr": 0, "osdop_resetxattrs": 0, "osdop_call": 0, "osdop_watch": 0, "osdop_notify": 0, "osdop_src_cmpxattr": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_other": 0, "linger_active": 0, "linger_send": 0, "linger_resend": 0, "linger_ping": 0, "poolop_active": 0, "poolop_send": 0, "poolop_resend": 0, "poolstat_active": 0, "poolstat_send": 0, "poolstat_resend": 0, "statfs_active": 0, "statfs_send": 0, "statfs_resend": 0, "command_active": 0, "command_send": 0, "command_resend": 0, "map_epoch": 0, "map_full": 0, "map_inc": 0, "osd_sessions": 0, "osd_session_open": 0, "osd_session_close": 0, "osd_laggy": 0, "omap_wr": 0, "omap_rd": 0, "omap_del": 0 } } ], "throttle-msgr_dispatch_throttler-client": [ { "labels": {}, "counters": { "val": 0, "max": 104857600, "get_started": 0, "get": 106, "get_sum": 417627, "get_or_fail_fail": 0, "get_or_fail_success": 106, "take": 0, "take_sum": 0, "put": 106, "put_sum": 417627, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ], "throttle-msgr_dispatch_throttler-radosclient": [ { "labels": {}, "counters": { "val": 0, "max": 104857600, "get_started": 0, "get": 76, "get_sum": 2550120, "get_or_fail_fail": 0, "get_or_fail_success": 76, "take": 0, "take_sum": 0, "put": 76, "put_sum": 2550120, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ], "throttle-objecter_bytes": [ { "labels": {}, "counters": { "val": 0, "max": 104857600, "get_started": 0, "get": 0, "get_sum": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "take": 0, "take_sum": 0, "put": 0, "put_sum": 0, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ], "throttle-objecter_ops": [ { "labels": {}, "counters": { "val": 0, "max": 1024, "get_started": 0, "get": 0, "get_sum": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "take": 0, "take_sum": 0, "put": 0, "put_sum": 0, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ] } 2024-03-16T07:34:28.306 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snapshot mirror disable cephfs 2024-03-16T07:34:29.573 INFO:teuthology.orchestra.run.smithi049.stdout:{} 2024-03-16T07:34:39.159 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T07:34:39.587 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-03-16T07:34:39.587 DEBUG:teuthology.orchestra.run.smithi049:mirror status for fs: cephfs> ceph --admin-daemon /var/run/ceph/cephfs-mirror.asok fs mirror status cephfs@12 2024-03-16T07:34:39.693 INFO:teuthology.orchestra.run.smithi049.stderr:no valid command found; 10 closest matches: 2024-03-16T07:34:39.694 INFO:teuthology.orchestra.run.smithi049.stderr:0 2024-03-16T07:34:39.694 INFO:teuthology.orchestra.run.smithi049.stderr:1 2024-03-16T07:34:39.694 INFO:teuthology.orchestra.run.smithi049.stderr:2 2024-03-16T07:34:39.694 INFO:teuthology.orchestra.run.smithi049.stderr:abort 2024-03-16T07:34:39.694 INFO:teuthology.orchestra.run.smithi049.stderr:assert 2024-03-16T07:34:39.694 INFO:teuthology.orchestra.run.smithi049.stderr:config diff 2024-03-16T07:34:39.694 INFO:teuthology.orchestra.run.smithi049.stderr:config diff get 2024-03-16T07:34:39.694 INFO:teuthology.orchestra.run.smithi049.stderr:config get 2024-03-16T07:34:39.694 INFO:teuthology.orchestra.run.smithi049.stderr:config help [] 2024-03-16T07:34:39.694 INFO:teuthology.orchestra.run.smithi049.stderr:config set ... 2024-03-16T07:34:39.694 INFO:teuthology.orchestra.run.smithi049.stderr:admin_socket: invalid command 2024-03-16T07:34:39.696 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-03-16T07:34:39.696 WARNING:tasks.cephfs.test_mirroring:mirror daemon command with label "mirror status for fs: cephfs" failed: Command failed (mirror status for fs: cephfs) on smithi049 with status 22: 'ceph --admin-daemon /var/run/ceph/cephfs-mirror.asok fs mirror status cephfs@12' 2024-03-16T07:34:39.696 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-03-16T07:34:39.696 DEBUG:teuthology.orchestra.run.smithi049:counter dump for fs: cephfs> ceph --admin-daemon /var/run/ceph/cephfs-mirror.asok counter dump 2024-03-16T07:34:39.801 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-03-16T07:34:39.801 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker": [ 2024-03-16T07:34:39.801 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:34:39.801 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:34:39.801 INFO:teuthology.orchestra.run.smithi049.stdout: "id": "0" 2024-03-16T07:34:39.801 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:34:39.801 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:34:39.802 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_ready_timeouts": 0, 2024-03-16T07:34:39.802 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_idle_timeouts": 0 2024-03-16T07:34:39.802 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:34:39.802 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:34:39.802 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:34:39.802 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:34:39.802 INFO:teuthology.orchestra.run.smithi049.stdout: "id": "1" 2024-03-16T07:34:39.802 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:34:39.802 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:34:39.802 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_ready_timeouts": 0, 2024-03-16T07:34:39.802 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_idle_timeouts": 0 2024-03-16T07:34:39.802 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:34:39.802 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:34:39.802 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:34:39.802 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:34:39.803 INFO:teuthology.orchestra.run.smithi049.stdout: "id": "2" 2024-03-16T07:34:39.803 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:34:39.803 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:34:39.803 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_ready_timeouts": 0, 2024-03-16T07:34:39.803 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_idle_timeouts": 0 2024-03-16T07:34:39.803 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:34:39.803 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:34:39.803 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:34:39.803 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-0": [ 2024-03-16T07:34:39.803 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:34:39.803 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:34:39.803 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:34:39.803 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 11, 2024-03-16T07:34:39.803 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 120, 2024-03-16T07:34:39.803 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 1584, 2024-03-16T07:34:39.804 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 896128, 2024-03-16T07:34:39.804 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 22, 2024-03-16T07:34:39.804 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 3, 2024-03-16T07:34:39.804 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 0.336027036, 2024-03-16T07:34:39.804 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.126257089, 2024-03-16T07:34:39.804 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 0.162060989, 2024-03-16T07:34:39.804 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-03-16T07:34:39.804 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T07:34:39.804 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 110, 2024-03-16T07:34:39.804 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.197799022, 2024-03-16T07:34:39.804 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.001798172 2024-03-16T07:34:39.804 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:34:39.804 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-03-16T07:34:39.804 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:34:39.804 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:34:39.804 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:34:39.805 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:34:39.805 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 1584, 2024-03-16T07:34:39.805 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 896128 2024-03-16T07:34:39.805 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:34:39.805 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:34:39.805 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:34:39.805 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-1": [ 2024-03-16T07:34:39.805 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:34:39.805 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:34:39.805 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:34:39.805 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 107, 2024-03-16T07:34:39.805 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 9, 2024-03-16T07:34:39.805 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 436896, 2024-03-16T07:34:39.805 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 1776, 2024-03-16T07:34:39.805 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 4, 2024-03-16T07:34:39.805 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 0, 2024-03-16T07:34:39.805 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 0.691174403, 2024-03-16T07:34:39.806 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.048394994, 2024-03-16T07:34:39.806 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 0.445052923, 2024-03-16T07:34:39.806 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.176550237, 2024-03-16T07:34:39.806 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T07:34:39.806 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 8, 2024-03-16T07:34:39.806 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.187770743, 2024-03-16T07:34:39.806 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.023471342 2024-03-16T07:34:39.806 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:34:39.806 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-03-16T07:34:39.806 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:34:39.806 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:34:39.806 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:34:39.806 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:34:39.806 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 436896, 2024-03-16T07:34:39.806 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 1776 2024-03-16T07:34:39.806 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:34:39.807 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:34:39.807 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:34:39.807 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-2": [ 2024-03-16T07:34:39.807 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:34:39.807 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:34:39.807 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:34:39.807 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 68, 2024-03-16T07:34:39.807 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 12, 2024-03-16T07:34:39.807 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 2559744, 2024-03-16T07:34:39.807 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 2240, 2024-03-16T07:34:39.807 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 3, 2024-03-16T07:34:39.807 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 1, 2024-03-16T07:34:39.807 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 1.495550351, 2024-03-16T07:34:39.807 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.013406431, 2024-03-16T07:34:39.807 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 2.683811456, 2024-03-16T07:34:39.807 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-03-16T07:34:39.808 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T07:34:39.808 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 11, 2024-03-16T07:34:39.808 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.346048562, 2024-03-16T07:34:39.808 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.031458960 2024-03-16T07:34:39.808 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:34:39.808 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-03-16T07:34:39.808 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:34:39.808 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:34:39.808 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:34:39.808 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:34:39.808 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 2559744, 2024-03-16T07:34:39.808 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 2240 2024-03-16T07:34:39.808 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:34:39.808 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:34:39.808 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:34:39.808 INFO:teuthology.orchestra.run.smithi049.stdout: "cct": [ 2024-03-16T07:34:39.809 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:34:39.809 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:34:39.809 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:34:39.809 INFO:teuthology.orchestra.run.smithi049.stdout: "total_workers": 0, 2024-03-16T07:34:39.809 INFO:teuthology.orchestra.run.smithi049.stdout: "unhealthy_workers": 0 2024-03-16T07:34:39.809 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:34:39.809 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:34:39.809 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:34:39.809 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs_mirror": [ 2024-03-16T07:34:39.809 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:34:39.809 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:34:39.809 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:34:39.809 INFO:teuthology.orchestra.run.smithi049.stdout: "mirrored_filesystems": 1, 2024-03-16T07:34:39.809 INFO:teuthology.orchestra.run.smithi049.stdout: "mirror_enable_failures": 0 2024-03-16T07:34:39.809 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:34:39.810 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:34:39.810 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:34:39.810 INFO:teuthology.orchestra.run.smithi049.stdout: "mempool": [ 2024-03-16T07:34:39.810 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:34:39.810 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:34:39.810 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:34:39.810 INFO:teuthology.orchestra.run.smithi049.stdout: "bloom_filter_bytes": 0, 2024-03-16T07:34:39.810 INFO:teuthology.orchestra.run.smithi049.stdout: "bloom_filter_items": 0, 2024-03-16T07:34:39.810 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_alloc_bytes": 0, 2024-03-16T07:34:39.810 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_alloc_items": 0, 2024-03-16T07:34:39.810 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_data_bytes": 0, 2024-03-16T07:34:39.810 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_data_items": 0, 2024-03-16T07:34:39.810 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_onode_bytes": 0, 2024-03-16T07:34:39.810 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_onode_items": 0, 2024-03-16T07:34:39.810 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_meta_bytes": 0, 2024-03-16T07:34:39.811 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_meta_items": 0, 2024-03-16T07:34:39.811 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_other_bytes": 0, 2024-03-16T07:34:39.811 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_other_items": 0, 2024-03-16T07:34:39.811 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_buffer_bytes": 0, 2024-03-16T07:34:39.811 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_buffer_items": 0, 2024-03-16T07:34:39.811 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_extent_bytes": 0, 2024-03-16T07:34:39.811 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_extent_items": 0, 2024-03-16T07:34:39.811 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_blob_bytes": 0, 2024-03-16T07:34:39.811 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_blob_items": 0, 2024-03-16T07:34:39.811 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_shared_blob_bytes": 0, 2024-03-16T07:34:39.811 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_shared_blob_items": 0, 2024-03-16T07:34:39.811 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_inline_bl_bytes": 0, 2024-03-16T07:34:39.811 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_inline_bl_items": 0, 2024-03-16T07:34:39.811 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_fsck_bytes": 0, 2024-03-16T07:34:39.811 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_fsck_items": 0, 2024-03-16T07:34:39.811 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_txc_bytes": 0, 2024-03-16T07:34:39.812 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_txc_items": 0, 2024-03-16T07:34:39.812 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_deferred_bytes": 0, 2024-03-16T07:34:39.812 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_deferred_items": 0, 2024-03-16T07:34:39.812 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_bytes": 0, 2024-03-16T07:34:39.812 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_items": 0, 2024-03-16T07:34:39.812 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_bytes": 0, 2024-03-16T07:34:39.812 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_items": 0, 2024-03-16T07:34:39.812 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_reader_bytes": 0, 2024-03-16T07:34:39.812 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_reader_items": 0, 2024-03-16T07:34:39.812 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_writer_bytes": 0, 2024-03-16T07:34:39.812 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_writer_items": 0, 2024-03-16T07:34:39.812 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_anon_bytes": 148784, 2024-03-16T07:34:39.812 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_anon_items": 28, 2024-03-16T07:34:39.812 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_meta_bytes": 0, 2024-03-16T07:34:39.812 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_meta_items": 0, 2024-03-16T07:34:39.812 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_bytes": 0, 2024-03-16T07:34:39.813 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_items": 0, 2024-03-16T07:34:39.813 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_mapbl_bytes": 0, 2024-03-16T07:34:39.813 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_mapbl_items": 0, 2024-03-16T07:34:39.813 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pglog_bytes": 0, 2024-03-16T07:34:39.813 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pglog_items": 0, 2024-03-16T07:34:39.813 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_bytes": 4824, 2024-03-16T07:34:39.813 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_items": 52, 2024-03-16T07:34:39.813 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_mapping_bytes": 0, 2024-03-16T07:34:39.813 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_mapping_items": 0, 2024-03-16T07:34:39.813 INFO:teuthology.orchestra.run.smithi049.stdout: "pgmap_bytes": 0, 2024-03-16T07:34:39.813 INFO:teuthology.orchestra.run.smithi049.stdout: "pgmap_items": 0, 2024-03-16T07:34:39.813 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_co_bytes": 0, 2024-03-16T07:34:39.813 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_co_items": 0, 2024-03-16T07:34:39.813 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_1_bytes": 0, 2024-03-16T07:34:39.813 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_1_items": 0, 2024-03-16T07:34:39.813 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_2_bytes": 0, 2024-03-16T07:34:39.814 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_2_items": 0 2024-03-16T07:34:39.814 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:34:39.814 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:34:39.814 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:34:39.814 INFO:teuthology.orchestra.run.smithi049.stdout: "objecter": [ 2024-03-16T07:34:39.814 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:34:39.814 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:34:39.814 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:34:39.814 INFO:teuthology.orchestra.run.smithi049.stdout: "op_active": 0, 2024-03-16T07:34:39.814 INFO:teuthology.orchestra.run.smithi049.stdout: "op_laggy": 0, 2024-03-16T07:34:39.814 INFO:teuthology.orchestra.run.smithi049.stdout: "op_send": 0, 2024-03-16T07:34:39.814 INFO:teuthology.orchestra.run.smithi049.stdout: "op_send_bytes": 0, 2024-03-16T07:34:39.814 INFO:teuthology.orchestra.run.smithi049.stdout: "op_resend": 0, 2024-03-16T07:34:39.814 INFO:teuthology.orchestra.run.smithi049.stdout: "op_reply": 0, 2024-03-16T07:34:39.815 INFO:teuthology.orchestra.run.smithi049.stdout: "op_latency": { 2024-03-16T07:34:39.815 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:34:39.815 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:34:39.815 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:34:39.815 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:34:39.815 INFO:teuthology.orchestra.run.smithi049.stdout: "op_inflight": 0, 2024-03-16T07:34:39.815 INFO:teuthology.orchestra.run.smithi049.stdout: "oplen_avg": { 2024-03-16T07:34:39.815 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:34:39.815 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0 2024-03-16T07:34:39.815 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:34:39.815 INFO:teuthology.orchestra.run.smithi049.stdout: "op": 0, 2024-03-16T07:34:39.815 INFO:teuthology.orchestra.run.smithi049.stdout: "op_r": 0, 2024-03-16T07:34:39.815 INFO:teuthology.orchestra.run.smithi049.stdout: "op_w": 0, 2024-03-16T07:34:39.815 INFO:teuthology.orchestra.run.smithi049.stdout: "op_rmw": 0, 2024-03-16T07:34:39.815 INFO:teuthology.orchestra.run.smithi049.stdout: "op_pg": 0, 2024-03-16T07:34:39.815 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_stat": 0, 2024-03-16T07:34:39.815 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_create": 0, 2024-03-16T07:34:39.816 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_read": 0, 2024-03-16T07:34:39.816 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_write": 0, 2024-03-16T07:34:39.816 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_writefull": 0, 2024-03-16T07:34:39.816 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_writesame": 0, 2024-03-16T07:34:39.816 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_append": 0, 2024-03-16T07:34:39.816 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_zero": 0, 2024-03-16T07:34:39.816 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_truncate": 0, 2024-03-16T07:34:39.816 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_delete": 0, 2024-03-16T07:34:39.816 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_mapext": 0, 2024-03-16T07:34:39.816 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_sparse_read": 0, 2024-03-16T07:34:39.816 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_clonerange": 0, 2024-03-16T07:34:39.816 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_getxattr": 0, 2024-03-16T07:34:39.816 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_setxattr": 0, 2024-03-16T07:34:39.816 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_cmpxattr": 0, 2024-03-16T07:34:39.816 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_rmxattr": 0, 2024-03-16T07:34:39.816 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_resetxattrs": 0, 2024-03-16T07:34:39.816 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_call": 0, 2024-03-16T07:34:39.817 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_watch": 0, 2024-03-16T07:34:39.817 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_notify": 0, 2024-03-16T07:34:39.817 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_src_cmpxattr": 0, 2024-03-16T07:34:39.817 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_pgls": 0, 2024-03-16T07:34:39.817 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_pgls_filter": 0, 2024-03-16T07:34:39.817 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_other": 0, 2024-03-16T07:34:39.817 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_active": 0, 2024-03-16T07:34:39.817 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_send": 0, 2024-03-16T07:34:39.817 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_resend": 0, 2024-03-16T07:34:39.817 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_ping": 0, 2024-03-16T07:34:39.817 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_active": 0, 2024-03-16T07:34:39.817 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_send": 0, 2024-03-16T07:34:39.817 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_resend": 0, 2024-03-16T07:34:39.817 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_active": 0, 2024-03-16T07:34:39.817 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_send": 0, 2024-03-16T07:34:39.817 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_resend": 0, 2024-03-16T07:34:39.818 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_active": 0, 2024-03-16T07:34:39.818 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_send": 0, 2024-03-16T07:34:39.818 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_resend": 0, 2024-03-16T07:34:39.818 INFO:teuthology.orchestra.run.smithi049.stdout: "command_active": 0, 2024-03-16T07:34:39.818 INFO:teuthology.orchestra.run.smithi049.stdout: "command_send": 0, 2024-03-16T07:34:39.818 INFO:teuthology.orchestra.run.smithi049.stdout: "command_resend": 0, 2024-03-16T07:34:39.818 INFO:teuthology.orchestra.run.smithi049.stdout: "map_epoch": 0, 2024-03-16T07:34:39.818 INFO:teuthology.orchestra.run.smithi049.stdout: "map_full": 0, 2024-03-16T07:34:39.818 INFO:teuthology.orchestra.run.smithi049.stdout: "map_inc": 0, 2024-03-16T07:34:39.818 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_sessions": 0, 2024-03-16T07:34:39.818 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_session_open": 0, 2024-03-16T07:34:39.818 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_session_close": 0, 2024-03-16T07:34:39.818 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_laggy": 0, 2024-03-16T07:34:39.818 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_wr": 0, 2024-03-16T07:34:39.818 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_rd": 0, 2024-03-16T07:34:39.818 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_del": 0 2024-03-16T07:34:39.818 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:34:39.819 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:34:39.819 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:34:39.819 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-msgr_dispatch_throttler-client": [ 2024-03-16T07:34:39.819 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:34:39.819 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:34:39.819 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:34:39.819 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:34:39.819 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-03-16T07:34:39.819 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:34:39.819 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 107, 2024-03-16T07:34:39.819 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 422373, 2024-03-16T07:34:39.819 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:34:39.819 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 107, 2024-03-16T07:34:39.819 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:34:39.820 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:34:39.820 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 107, 2024-03-16T07:34:39.820 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 422373, 2024-03-16T07:34:39.820 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:34:39.820 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:34:39.820 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:34:39.820 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:34:39.820 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:34:39.820 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:34:39.820 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:34:39.820 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:34:39.820 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-msgr_dispatch_throttler-radosclient": [ 2024-03-16T07:34:39.820 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:34:39.820 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:34:39.820 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:34:39.820 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:34:39.820 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-03-16T07:34:39.821 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:34:39.821 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 76, 2024-03-16T07:34:39.821 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 2550120, 2024-03-16T07:34:39.821 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:34:39.821 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 76, 2024-03-16T07:34:39.821 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:34:39.821 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:34:39.821 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 76, 2024-03-16T07:34:39.821 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 2550120, 2024-03-16T07:34:39.821 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:34:39.821 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:34:39.821 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:34:39.821 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:34:39.821 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:34:39.821 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:34:39.821 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:34:39.821 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:34:39.822 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-objecter_bytes": [ 2024-03-16T07:34:39.822 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:34:39.822 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:34:39.822 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:34:39.822 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:34:39.822 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-03-16T07:34:39.822 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:34:39.822 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 0, 2024-03-16T07:34:39.822 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 0, 2024-03-16T07:34:39.822 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:34:39.822 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 0, 2024-03-16T07:34:39.822 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:34:39.822 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:34:39.822 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 0, 2024-03-16T07:34:39.822 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 0, 2024-03-16T07:34:39.822 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:34:39.823 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:34:39.823 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:34:39.823 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:34:39.823 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:34:39.823 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:34:39.823 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:34:39.823 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:34:39.823 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-objecter_ops": [ 2024-03-16T07:34:39.823 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:34:39.823 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:34:39.823 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:34:39.823 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:34:39.823 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 1024, 2024-03-16T07:34:39.823 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:34:39.823 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 0, 2024-03-16T07:34:39.823 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 0, 2024-03-16T07:34:39.824 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:34:39.824 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 0, 2024-03-16T07:34:39.824 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:34:39.824 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:34:39.824 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 0, 2024-03-16T07:34:39.824 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 0, 2024-03-16T07:34:39.824 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:34:39.824 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:34:39.824 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:34:39.824 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:34:39.824 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:34:39.824 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:34:39.824 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:34:39.824 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2024-03-16T07:34:39.824 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-03-16T07:34:39.825 DEBUG:tasks.cephfs.test_mirroring:command returned={ "AsyncMessenger::Worker": [ { "labels": { "id": "0" }, "counters": { "msgr_connection_ready_timeouts": 0, "msgr_connection_idle_timeouts": 0 } }, { "labels": { "id": "1" }, "counters": { "msgr_connection_ready_timeouts": 0, "msgr_connection_idle_timeouts": 0 } }, { "labels": { "id": "2" }, "counters": { "msgr_connection_ready_timeouts": 0, "msgr_connection_idle_timeouts": 0 } } ], "AsyncMessenger::Worker-0": [ { "labels": {}, "counters": { "msgr_recv_messages": 11, "msgr_send_messages": 120, "msgr_recv_bytes": 1584, "msgr_send_bytes": 896128, "msgr_created_connections": 22, "msgr_active_connections": 3, "msgr_running_total_time": 0.336027036, "msgr_running_send_time": 0.126257089, "msgr_running_recv_time": 0.162060989, "msgr_running_fast_dispatch_time": 0.000000000, "msgr_send_messages_queue_lat": { "avgcount": 110, "sum": 0.197799022, "avgtime": 0.001798172 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "msgr_recv_encrypted_bytes": 1584, "msgr_send_encrypted_bytes": 896128 } } ], "AsyncMessenger::Worker-1": [ { "labels": {}, "counters": { "msgr_recv_messages": 107, "msgr_send_messages": 9, "msgr_recv_bytes": 436896, "msgr_send_bytes": 1776, "msgr_created_connections": 4, "msgr_active_connections": 0, "msgr_running_total_time": 0.691174403, "msgr_running_send_time": 0.048394994, "msgr_running_recv_time": 0.445052923, "msgr_running_fast_dispatch_time": 0.176550237, "msgr_send_messages_queue_lat": { "avgcount": 8, "sum": 0.187770743, "avgtime": 0.023471342 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "msgr_recv_encrypted_bytes": 436896, "msgr_send_encrypted_bytes": 1776 } } ], "AsyncMessenger::Worker-2": [ { "labels": {}, "counters": { "msgr_recv_messages": 68, "msgr_send_messages": 12, "msgr_recv_bytes": 2559744, "msgr_send_bytes": 2240, "msgr_created_connections": 3, "msgr_active_connections": 1, "msgr_running_total_time": 1.495550351, "msgr_running_send_time": 0.013406431, "msgr_running_recv_time": 2.683811456, "msgr_running_fast_dispatch_time": 0.000000000, "msgr_send_messages_queue_lat": { "avgcount": 11, "sum": 0.346048562, "avgtime": 0.031458960 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "msgr_recv_encrypted_bytes": 2559744, "msgr_send_encrypted_bytes": 2240 } } ], "cct": [ { "labels": {}, "counters": { "total_workers": 0, "unhealthy_workers": 0 } } ], "cephfs_mirror": [ { "labels": {}, "counters": { "mirrored_filesystems": 1, "mirror_enable_failures": 0 } } ], "mempool": [ { "labels": {}, "counters": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_cache_buffer_bytes": 0, "bluestore_cache_buffer_items": 0, "bluestore_extent_bytes": 0, "bluestore_extent_items": 0, "bluestore_blob_bytes": 0, "bluestore_blob_items": 0, "bluestore_shared_blob_bytes": 0, "bluestore_shared_blob_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_items": 0, "bluefs_bytes": 0, "bluefs_items": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "buffer_anon_bytes": 148784, "buffer_anon_items": 28, "buffer_meta_bytes": 0, "buffer_meta_items": 0, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 4824, "osdmap_items": 52, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "mds_co_bytes": 0, "mds_co_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 } } ], "objecter": [ { "labels": {}, "counters": { "op_active": 0, "op_laggy": 0, "op_send": 0, "op_send_bytes": 0, "op_resend": 0, "op_reply": 0, "op_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "op_inflight": 0, "oplen_avg": { "avgcount": 0, "sum": 0 }, "op": 0, "op_r": 0, "op_w": 0, "op_rmw": 0, "op_pg": 0, "osdop_stat": 0, "osdop_create": 0, "osdop_read": 0, "osdop_write": 0, "osdop_writefull": 0, "osdop_writesame": 0, "osdop_append": 0, "osdop_zero": 0, "osdop_truncate": 0, "osdop_delete": 0, "osdop_mapext": 0, "osdop_sparse_read": 0, "osdop_clonerange": 0, "osdop_getxattr": 0, "osdop_setxattr": 0, "osdop_cmpxattr": 0, "osdop_rmxattr": 0, "osdop_resetxattrs": 0, "osdop_call": 0, "osdop_watch": 0, "osdop_notify": 0, "osdop_src_cmpxattr": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_other": 0, "linger_active": 0, "linger_send": 0, "linger_resend": 0, "linger_ping": 0, "poolop_active": 0, "poolop_send": 0, "poolop_resend": 0, "poolstat_active": 0, "poolstat_send": 0, "poolstat_resend": 0, "statfs_active": 0, "statfs_send": 0, "statfs_resend": 0, "command_active": 0, "command_send": 0, "command_resend": 0, "map_epoch": 0, "map_full": 0, "map_inc": 0, "osd_sessions": 0, "osd_session_open": 0, "osd_session_close": 0, "osd_laggy": 0, "omap_wr": 0, "omap_rd": 0, "omap_del": 0 } } ], "throttle-msgr_dispatch_throttler-client": [ { "labels": {}, "counters": { "val": 0, "max": 104857600, "get_started": 0, "get": 107, "get_sum": 422373, "get_or_fail_fail": 0, "get_or_fail_success": 107, "take": 0, "take_sum": 0, "put": 107, "put_sum": 422373, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ], "throttle-msgr_dispatch_throttler-radosclient": [ { "labels": {}, "counters": { "val": 0, "max": 104857600, "get_started": 0, "get": 76, "get_sum": 2550120, "get_or_fail_fail": 0, "get_or_fail_success": 76, "take": 0, "take_sum": 0, "put": 76, "put_sum": 2550120, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ], "throttle-objecter_bytes": [ { "labels": {}, "counters": { "val": 0, "max": 104857600, "get_started": 0, "get": 0, "get_sum": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "take": 0, "take_sum": 0, "put": 0, "put_sum": 0, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ], "throttle-objecter_ops": [ { "labels": {}, "counters": { "val": 0, "max": 1024, "get_started": 0, "get": 0, "get_sum": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "take": 0, "take_sum": 0, "put": 0, "put_sum": 0, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ] } 2024-03-16T07:34:39.826 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable mirroring 2024-03-16T07:34:40.598 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-03-16T07:34:40.598 DEBUG:teuthology.orchestra.run.smithi049:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-03-16T07:34:40.648 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-03-16T07:34:40.648 INFO:tasks.cephfs.mount:Terminating background process 2024-03-16T07:34:40.648 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-03-16T07:34:40.648 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-16T07:34:40.665 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T07:34:41.030 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:34:41.030 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":151,"fsid":"f91af061-9eac-4793-87fa-8d27ae3d242f","created":"2024-03-16T07:24:20.357868+0000","modified":"2024-03-16T07:34:30.573275+0000","last_up_change":"2024-03-16T07:24:27.474980+0000","last_in_change":"2024-03-16T07:24:21.254179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":27,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T07:24:28.947521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_metadata","create_time":"2024-03-16T07:32:15.892059+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"141","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":25,"pool_name":"cephfs_data","create_time":"2024-03-16T07:32:16.561057+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"142","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":26,"pool_name":"backup_fs_metadata","create_time":"2024-03-16T07:32:30.176149+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"145","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"backup_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.309999942779541,"score_stable":1.309999942779541,"optimal_score":1,"raw_score_acting":1.309999942779541,"raw_score_stable":1.309999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":27,"pool_name":"backup_fs_data","create_time":"2024-03-16T07:32:30.596010+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"146","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"backup_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2df14aac-98dc-4e3c-ae7e-9eb677aa30be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6801","nonce":2744935777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6803","nonce":2744935777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6807","nonce":2744935777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6805","nonce":2744935777}]},"public_addr":"172.21.15.49:6801/2744935777","cluster_addr":"172.21.15.49:6803/2744935777","heartbeat_back_addr":"172.21.15.49:6807/2744935777","heartbeat_front_addr":"172.21.15.49:6805/2744935777","state":["exists","up"]},{"osd":1,"uuid":"80461bd9-59ef-46df-9eea-bad92d960c57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6811","nonce":1655120118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6815","nonce":1655120118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6821","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6823","nonce":1655120118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6817","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6819","nonce":1655120118}]},"public_addr":"172.21.15.49:6811/1655120118","cluster_addr":"172.21.15.49:6815/1655120118","heartbeat_back_addr":"172.21.15.49:6823/1655120118","heartbeat_front_addr":"172.21.15.49:6819/1655120118","state":["exists","up"]},{"osd":2,"uuid":"d6bf40eb-6e42-4ec9-8b3d-0b6c5a6def79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6810","nonce":3815472376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6814","nonce":3815472376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6822","nonce":3815472376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6818","nonce":3815472376}]},"public_addr":"172.21.15.49:6810/3815472376","cluster_addr":"172.21.15.49:6814/3815472376","heartbeat_back_addr":"172.21.15.49:6822/3815472376","heartbeat_front_addr":"172.21.15.49:6818/3815472376","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.641492+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.668598+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.614940+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"25.1d","mappings":[{"from":0,"to":2}]},{"pgid":"25.30","mappings":[{"from":0,"to":1}]},{"pgid":"27.35","mappings":[{"from":0,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.49:0/4170960283":"2024-03-16T08:34:29.913374+0000","172.21.15.49:0/2799967982":"2024-03-17T07:32:43.474587+0000","172.21.15.49:0/4185192406":"2024-03-16T08:33:37.476103+0000","172.21.15.49:0/858221795":"2024-03-17T07:32:43.474587+0000","172.21.15.49:0/2121807561":"2024-03-17T07:32:43.474587+0000","172.21.15.49:0/1336083103":"2024-03-17T07:32:43.474587+0000","172.21.15.49:6825/2955625097":"2024-03-17T07:32:43.474587+0000","172.21.15.49:6824/2955625097":"2024-03-17T07:32:43.474587+0000","172.21.15.49:0/2836520053":"2024-03-17T07:32:43.474587+0000","172.21.15.49:0/417496104":"2024-03-17T07:32:43.474587+0000","172.21.15.49:0/1051974920":"2024-03-17T07:32:43.474587+0000","172.21.15.49:0/1787331336":"2024-03-17T07:32:43.474587+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T07:34:41.043 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-16T07:24:28.947521+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 24, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-16T07:32:15.892059+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '141', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 25, 'pool_name': 'cephfs_data', 'create_time': '2024-03-16T07:32:16.561057+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '142', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 26, 'pool_name': 'backup_fs_metadata', 'create_time': '2024-03-16T07:32:30.176149+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '145', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'backup_fs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.309999942779541, 'score_stable': 1.309999942779541, 'optimal_score': 1, 'raw_score_acting': 1.309999942779541, 'raw_score_stable': 1.309999942779541, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 27, 'pool_name': 'backup_fs_data', 'create_time': '2024-03-16T07:32:30.596010+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '146', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'backup_fs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-16T07:34:41.044 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-16T07:34:41.119 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:34:41.121+0000 7f1934a2b040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-16T07:34:41.175 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:34:41.177+0000 7f1934a2b040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-16T07:34:41.408 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2024-03-16T07:34:41.426 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-16T07:34:41.710 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:34:41.712+0000 7f1934a2b040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-16T07:34:41.757 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:34:41.759+0000 7f1934a2b040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-16T07:34:41.802 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:34:41.804+0000 7f1934a2b040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-16T07:34:41.831 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2024-03-16T07:34:41.849 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-16T07:34:41.858 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:34:41.860+0000 7f1934a2b040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-16T07:34:41.904 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:34:41.905+0000 7f1934a2b040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-16T07:34:42.081 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:34:42.083+0000 7f1934a2b040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-16T07:34:42.137 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:34:42.139+0000 7f1934a2b040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-16T07:34:42.182 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:34:42.184+0000 7f1934a2b040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-16T07:34:42.202 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2024-03-16T07:34:42.216 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get backup_fs_metadata pg_num 2024-03-16T07:34:42.244 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:34:42.246+0000 7f1934a2b040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-16T07:34:42.293 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:34:42.294+0000 7f1934a2b040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-16T07:34:42.598 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2024-03-16T07:34:42.617 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get backup_fs_data pg_num 2024-03-16T07:34:42.644 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:34:42.646+0000 7f1934a2b040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-16T07:34:42.787 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:34:42.789+0000 7f1934a2b040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-16T07:34:42.884 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:34:42.886+0000 7f1934a2b040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-16T07:34:42.930 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:34:42.932+0000 7f1934a2b040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-16T07:34:43.025 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2024-03-16T07:34:43.039 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-16T07:34:43.048 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:34:43.050+0000 7f1934a2b040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-16T07:34:43.149 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:34:43.151+0000 7f1934a2b040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-16T07:34:43.315 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:34:43.316+0000 7f1934a2b040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-16T07:34:43.359 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:34:43.361+0000 7f1934a2b040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-16T07:34:43.373 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/4170960283 2024-03-16T08:34:29.913374+0000 2024-03-16T07:34:43.373 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/2799967982 2024-03-17T07:32:43.474587+0000 2024-03-16T07:34:43.373 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/4185192406 2024-03-16T08:33:37.476103+0000 2024-03-16T07:34:43.373 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/858221795 2024-03-17T07:32:43.474587+0000 2024-03-16T07:34:43.373 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/2121807561 2024-03-17T07:32:43.474587+0000 2024-03-16T07:34:43.373 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/1336083103 2024-03-17T07:32:43.474587+0000 2024-03-16T07:34:43.373 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:6825/2955625097 2024-03-17T07:32:43.474587+0000 2024-03-16T07:34:43.373 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:6824/2955625097 2024-03-17T07:32:43.474587+0000 2024-03-16T07:34:43.373 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/2836520053 2024-03-17T07:32:43.474587+0000 2024-03-16T07:34:43.373 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/417496104 2024-03-17T07:32:43.474587+0000 2024-03-16T07:34:43.373 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/1051974920 2024-03-17T07:32:43.474587+0000 2024-03-16T07:34:43.373 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/1787331336 2024-03-17T07:32:43.474587+0000 2024-03-16T07:34:43.374 INFO:teuthology.orchestra.run.smithi049.stderr:listed 12 entries 2024-03-16T07:34:43.386 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi049.front.sepia.ceph.com... 2024-03-16T07:34:43.386 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:34:43.386 DEBUG:teuthology.orchestra.run.smithi049:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-03-16T07:34:43.420 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi049.stderr:ceph-fuse[75960]: fuse finished with error 0 and tester_r 0 2024-03-16T07:34:43.423 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi049.front.sepia.ceph.com 2024-03-16T07:34:43.423 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:34:43.423 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-03-16T07:34:43.480 INFO:tasks.cephfs.mount:Terminating background process 2024-03-16T07:34:43.480 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-03-16T07:34:43.480 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-16T07:34:43.514 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:34:43.515+0000 7f1934a2b040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-16T07:34:43.530 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T07:34:43.940 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:34:43.940 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":151,"fsid":"f91af061-9eac-4793-87fa-8d27ae3d242f","created":"2024-03-16T07:24:20.357868+0000","modified":"2024-03-16T07:34:30.573275+0000","last_up_change":"2024-03-16T07:24:27.474980+0000","last_in_change":"2024-03-16T07:24:21.254179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":27,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T07:24:28.947521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_metadata","create_time":"2024-03-16T07:32:15.892059+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"141","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":25,"pool_name":"cephfs_data","create_time":"2024-03-16T07:32:16.561057+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"142","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":26,"pool_name":"backup_fs_metadata","create_time":"2024-03-16T07:32:30.176149+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"145","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"backup_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.309999942779541,"score_stable":1.309999942779541,"optimal_score":1,"raw_score_acting":1.309999942779541,"raw_score_stable":1.309999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":27,"pool_name":"backup_fs_data","create_time":"2024-03-16T07:32:30.596010+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"146","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"backup_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2df14aac-98dc-4e3c-ae7e-9eb677aa30be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6801","nonce":2744935777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6803","nonce":2744935777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6807","nonce":2744935777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6805","nonce":2744935777}]},"public_addr":"172.21.15.49:6801/2744935777","cluster_addr":"172.21.15.49:6803/2744935777","heartbeat_back_addr":"172.21.15.49:6807/2744935777","heartbeat_front_addr":"172.21.15.49:6805/2744935777","state":["exists","up"]},{"osd":1,"uuid":"80461bd9-59ef-46df-9eea-bad92d960c57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6811","nonce":1655120118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6815","nonce":1655120118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6821","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6823","nonce":1655120118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6817","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6819","nonce":1655120118}]},"public_addr":"172.21.15.49:6811/1655120118","cluster_addr":"172.21.15.49:6815/1655120118","heartbeat_back_addr":"172.21.15.49:6823/1655120118","heartbeat_front_addr":"172.21.15.49:6819/1655120118","state":["exists","up"]},{"osd":2,"uuid":"d6bf40eb-6e42-4ec9-8b3d-0b6c5a6def79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6810","nonce":3815472376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6814","nonce":3815472376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6822","nonce":3815472376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6818","nonce":3815472376}]},"public_addr":"172.21.15.49:6810/3815472376","cluster_addr":"172.21.15.49:6814/3815472376","heartbeat_back_addr":"172.21.15.49:6822/3815472376","heartbeat_front_addr":"172.21.15.49:6818/3815472376","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.641492+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.668598+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.614940+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"25.1d","mappings":[{"from":0,"to":2}]},{"pgid":"25.30","mappings":[{"from":0,"to":1}]},{"pgid":"27.35","mappings":[{"from":0,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.49:0/4170960283":"2024-03-16T08:34:29.913374+0000","172.21.15.49:0/2799967982":"2024-03-17T07:32:43.474587+0000","172.21.15.49:0/4185192406":"2024-03-16T08:33:37.476103+0000","172.21.15.49:0/858221795":"2024-03-17T07:32:43.474587+0000","172.21.15.49:0/2121807561":"2024-03-17T07:32:43.474587+0000","172.21.15.49:0/1336083103":"2024-03-17T07:32:43.474587+0000","172.21.15.49:6825/2955625097":"2024-03-17T07:32:43.474587+0000","172.21.15.49:6824/2955625097":"2024-03-17T07:32:43.474587+0000","172.21.15.49:0/2836520053":"2024-03-17T07:32:43.474587+0000","172.21.15.49:0/417496104":"2024-03-17T07:32:43.474587+0000","172.21.15.49:0/1051974920":"2024-03-17T07:32:43.474587+0000","172.21.15.49:0/1787331336":"2024-03-17T07:32:43.474587+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T07:34:43.954 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-16T07:24:28.947521+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 24, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-16T07:32:15.892059+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '141', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 25, 'pool_name': 'cephfs_data', 'create_time': '2024-03-16T07:32:16.561057+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '142', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 26, 'pool_name': 'backup_fs_metadata', 'create_time': '2024-03-16T07:32:30.176149+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '145', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'backup_fs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.309999942779541, 'score_stable': 1.309999942779541, 'optimal_score': 1, 'raw_score_acting': 1.309999942779541, 'raw_score_stable': 1.309999942779541, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 27, 'pool_name': 'backup_fs_data', 'create_time': '2024-03-16T07:32:30.596010+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '146', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'backup_fs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-16T07:34:43.955 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-16T07:34:44.221 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:34:44.223+0000 7f1934a2b040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-16T07:34:44.356 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2024-03-16T07:34:44.374 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-16T07:34:44.508 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:34:44.510+0000 7f1934a2b040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-16T07:34:44.566 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:34:44.568+0000 7f1934a2b040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-16T07:34:44.689 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:34:44.691+0000 7f1934a2b040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-16T07:34:44.784 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:34:44.786+0000 7f18b5ec7640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:34:44.784 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:34:44.786+0000 7f18b5ec7640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:34:44.785 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:34:44.786+0000 7f18b5ec7640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:34:44.785 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:34:44.786+0000 7f18b5ec7640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:34:44.785 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:34:44.786+0000 7f18b5ec7640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:34:44.785 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:34:44.786+0000 7f18b8ecd640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:34:44.785 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:34:44.786+0000 7f18b8ecd640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:34:44.785 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:34:44.786+0000 7f18b8ecd640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:34:44.785 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:34:44.786+0000 7f18b8ecd640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:34:44.785 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:34:44.786+0000 7f18b8ecd640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:34:44.797 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:34:44.798+0000 7f18b8ecd640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:34:44.797 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:34:44.798+0000 7f18b8ecd640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:34:44.797 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:34:44.798+0000 7f18b8ecd640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:34:44.797 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:34:44.798+0000 7f18b8ecd640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:34:44.797 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:34:44.798+0000 7f18b8ecd640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:34:44.804 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:34:44.806+0000 7f18b5ec7640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:34:44.804 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:34:44.806+0000 7f18b5ec7640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:34:44.804 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:34:44.806+0000 7f18b5ec7640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:34:44.805 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:34:44.806+0000 7f18b5ec7640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:34:44.805 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:34:44.806+0000 7f18b5ec7640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:34:44.817 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2024-03-16T07:34:44.836 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-16T07:34:45.187 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2024-03-16T07:34:45.201 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get backup_fs_metadata pg_num 2024-03-16T07:34:45.509 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2024-03-16T07:34:45.526 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get backup_fs_data pg_num 2024-03-16T07:34:45.838 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2024-03-16T07:34:45.857 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-16T07:34:46.311 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/1311079412 2024-03-17T07:34:44.704697+0000 2024-03-16T07:34:46.312 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/1403232186 2024-03-17T07:34:44.704697+0000 2024-03-16T07:34:46.312 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:6825/975765687 2024-03-17T07:34:44.704697+0000 2024-03-16T07:34:46.312 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/1795189171 2024-03-17T07:34:44.704697+0000 2024-03-16T07:34:46.312 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/2265076113 2024-03-17T07:34:44.704697+0000 2024-03-16T07:34:46.312 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/3870882427 2024-03-17T07:34:44.704697+0000 2024-03-16T07:34:46.312 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/4170960283 2024-03-16T08:34:29.913374+0000 2024-03-16T07:34:46.312 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:6824/975765687 2024-03-17T07:34:44.704697+0000 2024-03-16T07:34:46.312 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/2799967982 2024-03-17T07:32:43.474587+0000 2024-03-16T07:34:46.312 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/4185192406 2024-03-16T08:33:37.476103+0000 2024-03-16T07:34:46.312 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/858221795 2024-03-17T07:32:43.474587+0000 2024-03-16T07:34:46.312 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/2121807561 2024-03-17T07:32:43.474587+0000 2024-03-16T07:34:46.312 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/1336083103 2024-03-17T07:32:43.474587+0000 2024-03-16T07:34:46.312 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:6825/2955625097 2024-03-17T07:32:43.474587+0000 2024-03-16T07:34:46.312 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:6824/2955625097 2024-03-17T07:32:43.474587+0000 2024-03-16T07:34:46.312 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/2836520053 2024-03-17T07:32:43.474587+0000 2024-03-16T07:34:46.313 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/417496104 2024-03-17T07:32:43.474587+0000 2024-03-16T07:34:46.313 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/1051974920 2024-03-17T07:32:43.474587+0000 2024-03-16T07:34:46.313 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/1787331336 2024-03-17T07:32:43.474587+0000 2024-03-16T07:34:46.313 INFO:teuthology.orchestra.run.smithi049.stderr:listed 19 entries 2024-03-16T07:34:46.329 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi049.front.sepia.ceph.com... 2024-03-16T07:34:46.330 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:34:46.330 DEBUG:teuthology.orchestra.run.smithi049:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2024-03-16T07:34:46.358 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi049.stderr:ceph-fuse[76378]: fuse finished with error 0 and tester_r 0 2024-03-16T07:34:46.360 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi049.front.sepia.ceph.com 2024-03-16T07:34:46.361 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:34:46.361 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-03-16T07:34:46.487 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T07:34:46.888 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:34:46.888 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":108,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6315,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6828/2438276517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":2438276517},{"type":"v1","addr":"172.21.15.49:6828","nonce":2438276517}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":94},{"gid":6316,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6829/1412184122","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6827","nonce":1412184122},{"type":"v1","addr":"172.21.15.49:6829","nonce":1412184122}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":94},{"gid":6321,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6831/3610285344","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":3610285344},{"type":"v1","addr":"172.21.15.49:6831","nonce":3610285344}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":94}],"filesystems":[{"mdsmap":{"epoch":108,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-16T07:32:17.592092+0000","modified":"2024-03-16T07:34:28.734749+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6325},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6325":{"gid":6325,"name":"a","rank":0,"incarnation":95,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6835/2709512109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":2709512109},{"type":"v1","addr":"172.21.15.49:6835","nonce":2709512109}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6325,"qdb_cluster":[6325]},"id":12},{"mdsmap":{"epoch":105,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-16T07:32:31.616889+0000","modified":"2024-03-16T07:32:34.616124+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6324},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6324":{"gid":6324,"name":"c","rank":0,"incarnation":101,"state":"up:active","state_seq":6,"addr":"172.21.15.49:6833/1457417734","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":1457417734},{"type":"v1","addr":"172.21.15.49:6833","nonce":1457417734}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[27],"metadata_pool":26,"enabled":true,"fs_name":"backup_fs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6324,"qdb_cluster":[6324]},"id":13}]} 2024-03-16T07:34:46.889 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 108 2024-03-16T07:34:46.901 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T07:34:47.300 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:34:47.300 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":152,"fsid":"f91af061-9eac-4793-87fa-8d27ae3d242f","created":"2024-03-16T07:24:20.357868+0000","modified":"2024-03-16T07:34:44.704727+0000","last_up_change":"2024-03-16T07:24:27.474980+0000","last_in_change":"2024-03-16T07:24:21.254179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":27,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T07:24:28.947521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_metadata","create_time":"2024-03-16T07:32:15.892059+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"141","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":25,"pool_name":"cephfs_data","create_time":"2024-03-16T07:32:16.561057+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"142","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":26,"pool_name":"backup_fs_metadata","create_time":"2024-03-16T07:32:30.176149+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"145","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"backup_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.309999942779541,"score_stable":1.309999942779541,"optimal_score":1,"raw_score_acting":1.309999942779541,"raw_score_stable":1.309999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":27,"pool_name":"backup_fs_data","create_time":"2024-03-16T07:32:30.596010+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"146","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"backup_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2df14aac-98dc-4e3c-ae7e-9eb677aa30be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6801","nonce":2744935777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6803","nonce":2744935777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6807","nonce":2744935777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6805","nonce":2744935777}]},"public_addr":"172.21.15.49:6801/2744935777","cluster_addr":"172.21.15.49:6803/2744935777","heartbeat_back_addr":"172.21.15.49:6807/2744935777","heartbeat_front_addr":"172.21.15.49:6805/2744935777","state":["exists","up"]},{"osd":1,"uuid":"80461bd9-59ef-46df-9eea-bad92d960c57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6811","nonce":1655120118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6815","nonce":1655120118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6821","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6823","nonce":1655120118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6817","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6819","nonce":1655120118}]},"public_addr":"172.21.15.49:6811/1655120118","cluster_addr":"172.21.15.49:6815/1655120118","heartbeat_back_addr":"172.21.15.49:6823/1655120118","heartbeat_front_addr":"172.21.15.49:6819/1655120118","state":["exists","up"]},{"osd":2,"uuid":"d6bf40eb-6e42-4ec9-8b3d-0b6c5a6def79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6810","nonce":3815472376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6814","nonce":3815472376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6822","nonce":3815472376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6818","nonce":3815472376}]},"public_addr":"172.21.15.49:6810/3815472376","cluster_addr":"172.21.15.49:6814/3815472376","heartbeat_back_addr":"172.21.15.49:6822/3815472376","heartbeat_front_addr":"172.21.15.49:6818/3815472376","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.641492+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.668598+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.614940+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"25.1d","mappings":[{"from":0,"to":2}]},{"pgid":"25.30","mappings":[{"from":0,"to":1}]},{"pgid":"27.35","mappings":[{"from":0,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.49:0/1311079412":"2024-03-17T07:34:44.704697+0000","172.21.15.49:0/1403232186":"2024-03-17T07:34:44.704697+0000","172.21.15.49:6825/975765687":"2024-03-17T07:34:44.704697+0000","172.21.15.49:0/1795189171":"2024-03-17T07:34:44.704697+0000","172.21.15.49:0/2265076113":"2024-03-17T07:34:44.704697+0000","172.21.15.49:0/3870882427":"2024-03-17T07:34:44.704697+0000","172.21.15.49:0/4170960283":"2024-03-16T08:34:29.913374+0000","172.21.15.49:6824/975765687":"2024-03-17T07:34:44.704697+0000","172.21.15.49:0/2799967982":"2024-03-17T07:32:43.474587+0000","172.21.15.49:0/4185192406":"2024-03-16T08:33:37.476103+0000","172.21.15.49:0/858221795":"2024-03-17T07:32:43.474587+0000","172.21.15.49:0/2121807561":"2024-03-17T07:32:43.474587+0000","172.21.15.49:0/1336083103":"2024-03-17T07:32:43.474587+0000","172.21.15.49:6825/2955625097":"2024-03-17T07:32:43.474587+0000","172.21.15.49:6824/2955625097":"2024-03-17T07:32:43.474587+0000","172.21.15.49:0/2836520053":"2024-03-17T07:32:43.474587+0000","172.21.15.49:0/417496104":"2024-03-17T07:32:43.474587+0000","172.21.15.49:0/1051974920":"2024-03-17T07:32:43.474587+0000","172.21.15.49:0/1787331336":"2024-03-17T07:32:43.474587+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T07:34:47.319 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-16T07:24:28.947521+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 24, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-16T07:32:15.892059+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '141', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 25, 'pool_name': 'cephfs_data', 'create_time': '2024-03-16T07:32:16.561057+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '142', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 26, 'pool_name': 'backup_fs_metadata', 'create_time': '2024-03-16T07:32:30.176149+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '145', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'backup_fs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.309999942779541, 'score_stable': 1.309999942779541, 'optimal_score': 1, 'raw_score_acting': 1.309999942779541, 'raw_score_stable': 1.309999942779541, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 27, 'pool_name': 'backup_fs_data', 'create_time': '2024-03-16T07:32:30.596010+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '146', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'backup_fs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-16T07:34:47.320 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-16T07:34:47.624 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2024-03-16T07:34:47.639 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-16T07:34:48.050 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2024-03-16T07:34:48.063 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-16T07:34:48.379 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2024-03-16T07:34:48.392 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get backup_fs_metadata pg_num 2024-03-16T07:34:48.702 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2024-03-16T07:34:48.719 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get backup_fs_data pg_num 2024-03-16T07:34:49.067 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2024-03-16T07:34:49.080 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T07:34:49.573 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:34:49.573 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":108,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6315,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6828/2438276517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":2438276517},{"type":"v1","addr":"172.21.15.49:6828","nonce":2438276517}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":94},{"gid":6316,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6829/1412184122","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6827","nonce":1412184122},{"type":"v1","addr":"172.21.15.49:6829","nonce":1412184122}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":94},{"gid":6321,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6831/3610285344","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":3610285344},{"type":"v1","addr":"172.21.15.49:6831","nonce":3610285344}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":94}],"filesystems":[{"mdsmap":{"epoch":108,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-16T07:32:17.592092+0000","modified":"2024-03-16T07:34:28.734749+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6325},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6325":{"gid":6325,"name":"a","rank":0,"incarnation":95,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6835/2709512109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":2709512109},{"type":"v1","addr":"172.21.15.49:6835","nonce":2709512109}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6325,"qdb_cluster":[6325]},"id":12},{"mdsmap":{"epoch":105,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-16T07:32:31.616889+0000","modified":"2024-03-16T07:32:34.616124+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6324},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6324":{"gid":6324,"name":"c","rank":0,"incarnation":101,"state":"up:active","state_seq":6,"addr":"172.21.15.49:6833/1457417734","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":1457417734},{"type":"v1","addr":"172.21.15.49:6833","nonce":1457417734}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[27],"metadata_pool":26,"enabled":true,"fs_name":"backup_fs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6324,"qdb_cluster":[6324]},"id":13}]} 2024-03-16T07:34:49.573 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 108 2024-03-16T07:34:49.587 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T07:34:50.012 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:34:50.012 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":152,"fsid":"f91af061-9eac-4793-87fa-8d27ae3d242f","created":"2024-03-16T07:24:20.357868+0000","modified":"2024-03-16T07:34:44.704727+0000","last_up_change":"2024-03-16T07:24:27.474980+0000","last_in_change":"2024-03-16T07:24:21.254179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":27,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T07:24:28.947521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_metadata","create_time":"2024-03-16T07:32:15.892059+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"141","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":25,"pool_name":"cephfs_data","create_time":"2024-03-16T07:32:16.561057+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"142","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":26,"pool_name":"backup_fs_metadata","create_time":"2024-03-16T07:32:30.176149+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"145","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"backup_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.309999942779541,"score_stable":1.309999942779541,"optimal_score":1,"raw_score_acting":1.309999942779541,"raw_score_stable":1.309999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":27,"pool_name":"backup_fs_data","create_time":"2024-03-16T07:32:30.596010+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"146","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"backup_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2df14aac-98dc-4e3c-ae7e-9eb677aa30be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6801","nonce":2744935777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6803","nonce":2744935777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6807","nonce":2744935777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6805","nonce":2744935777}]},"public_addr":"172.21.15.49:6801/2744935777","cluster_addr":"172.21.15.49:6803/2744935777","heartbeat_back_addr":"172.21.15.49:6807/2744935777","heartbeat_front_addr":"172.21.15.49:6805/2744935777","state":["exists","up"]},{"osd":1,"uuid":"80461bd9-59ef-46df-9eea-bad92d960c57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6811","nonce":1655120118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6815","nonce":1655120118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6821","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6823","nonce":1655120118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6817","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6819","nonce":1655120118}]},"public_addr":"172.21.15.49:6811/1655120118","cluster_addr":"172.21.15.49:6815/1655120118","heartbeat_back_addr":"172.21.15.49:6823/1655120118","heartbeat_front_addr":"172.21.15.49:6819/1655120118","state":["exists","up"]},{"osd":2,"uuid":"d6bf40eb-6e42-4ec9-8b3d-0b6c5a6def79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6810","nonce":3815472376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6814","nonce":3815472376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6822","nonce":3815472376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6818","nonce":3815472376}]},"public_addr":"172.21.15.49:6810/3815472376","cluster_addr":"172.21.15.49:6814/3815472376","heartbeat_back_addr":"172.21.15.49:6822/3815472376","heartbeat_front_addr":"172.21.15.49:6818/3815472376","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.641492+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.668598+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.614940+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"25.1d","mappings":[{"from":0,"to":2}]},{"pgid":"25.30","mappings":[{"from":0,"to":1}]},{"pgid":"27.35","mappings":[{"from":0,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.49:0/1311079412":"2024-03-17T07:34:44.704697+0000","172.21.15.49:0/1403232186":"2024-03-17T07:34:44.704697+0000","172.21.15.49:6825/975765687":"2024-03-17T07:34:44.704697+0000","172.21.15.49:0/1795189171":"2024-03-17T07:34:44.704697+0000","172.21.15.49:0/2265076113":"2024-03-17T07:34:44.704697+0000","172.21.15.49:0/3870882427":"2024-03-17T07:34:44.704697+0000","172.21.15.49:0/4170960283":"2024-03-16T08:34:29.913374+0000","172.21.15.49:6824/975765687":"2024-03-17T07:34:44.704697+0000","172.21.15.49:0/2799967982":"2024-03-17T07:32:43.474587+0000","172.21.15.49:0/4185192406":"2024-03-16T08:33:37.476103+0000","172.21.15.49:0/858221795":"2024-03-17T07:32:43.474587+0000","172.21.15.49:0/2121807561":"2024-03-17T07:32:43.474587+0000","172.21.15.49:0/1336083103":"2024-03-17T07:32:43.474587+0000","172.21.15.49:6825/2955625097":"2024-03-17T07:32:43.474587+0000","172.21.15.49:6824/2955625097":"2024-03-17T07:32:43.474587+0000","172.21.15.49:0/2836520053":"2024-03-17T07:32:43.474587+0000","172.21.15.49:0/417496104":"2024-03-17T07:32:43.474587+0000","172.21.15.49:0/1051974920":"2024-03-17T07:32:43.474587+0000","172.21.15.49:0/1787331336":"2024-03-17T07:32:43.474587+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T07:34:50.029 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-03-16T07:34:50.030 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T07:34:50.383 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:34:50.383 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":108,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6315,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6828/2438276517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":2438276517},{"type":"v1","addr":"172.21.15.49:6828","nonce":2438276517}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":94},{"gid":6316,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6829/1412184122","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6827","nonce":1412184122},{"type":"v1","addr":"172.21.15.49:6829","nonce":1412184122}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":94},{"gid":6321,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6831/3610285344","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":3610285344},{"type":"v1","addr":"172.21.15.49:6831","nonce":3610285344}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":94}],"filesystems":[{"mdsmap":{"epoch":108,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-16T07:32:17.592092+0000","modified":"2024-03-16T07:34:28.734749+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6325},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6325":{"gid":6325,"name":"a","rank":0,"incarnation":95,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6835/2709512109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":2709512109},{"type":"v1","addr":"172.21.15.49:6835","nonce":2709512109}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6325,"qdb_cluster":[6325]},"id":12},{"mdsmap":{"epoch":105,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-16T07:32:31.616889+0000","modified":"2024-03-16T07:32:34.616124+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6324},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6324":{"gid":6324,"name":"c","rank":0,"incarnation":101,"state":"up:active","state_seq":6,"addr":"172.21.15.49:6833/1457417734","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":1457417734},{"type":"v1","addr":"172.21.15.49:6833","nonce":1457417734}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[27],"metadata_pool":26,"enabled":true,"fs_name":"backup_fs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6324,"qdb_cluster":[6324]},"id":13}]} 2024-03-16T07:34:50.383 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 108 2024-03-16T07:34:50.396 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T07:34:50.898 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:34:50.898 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":108,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6315,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6828/2438276517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":2438276517},{"type":"v1","addr":"172.21.15.49:6828","nonce":2438276517}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":94},{"gid":6316,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6829/1412184122","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6827","nonce":1412184122},{"type":"v1","addr":"172.21.15.49:6829","nonce":1412184122}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":94},{"gid":6321,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6831/3610285344","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":3610285344},{"type":"v1","addr":"172.21.15.49:6831","nonce":3610285344}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":94}],"filesystems":[{"mdsmap":{"epoch":108,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-16T07:32:17.592092+0000","modified":"2024-03-16T07:34:28.734749+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6325},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6325":{"gid":6325,"name":"a","rank":0,"incarnation":95,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6835/2709512109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":2709512109},{"type":"v1","addr":"172.21.15.49:6835","nonce":2709512109}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6325,"qdb_cluster":[6325]},"id":12},{"mdsmap":{"epoch":105,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-16T07:32:31.616889+0000","modified":"2024-03-16T07:32:34.616124+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6324},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6324":{"gid":6324,"name":"c","rank":0,"incarnation":101,"state":"up:active","state_seq":6,"addr":"172.21.15.49:6833/1457417734","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":1457417734},{"type":"v1","addr":"172.21.15.49:6833","nonce":1457417734}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[27],"metadata_pool":26,"enabled":true,"fs_name":"backup_fs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6324,"qdb_cluster":[6324]},"id":13}]} 2024-03-16T07:34:50.898 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 108 2024-03-16T07:34:50.912 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T07:34:51.259 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:34:51.259 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":152,"fsid":"f91af061-9eac-4793-87fa-8d27ae3d242f","created":"2024-03-16T07:24:20.357868+0000","modified":"2024-03-16T07:34:44.704727+0000","last_up_change":"2024-03-16T07:24:27.474980+0000","last_in_change":"2024-03-16T07:24:21.254179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":27,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T07:24:28.947521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_metadata","create_time":"2024-03-16T07:32:15.892059+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"141","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":25,"pool_name":"cephfs_data","create_time":"2024-03-16T07:32:16.561057+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"142","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":26,"pool_name":"backup_fs_metadata","create_time":"2024-03-16T07:32:30.176149+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"145","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"backup_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.309999942779541,"score_stable":1.309999942779541,"optimal_score":1,"raw_score_acting":1.309999942779541,"raw_score_stable":1.309999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":27,"pool_name":"backup_fs_data","create_time":"2024-03-16T07:32:30.596010+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"146","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"backup_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2df14aac-98dc-4e3c-ae7e-9eb677aa30be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6801","nonce":2744935777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6803","nonce":2744935777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6807","nonce":2744935777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6805","nonce":2744935777}]},"public_addr":"172.21.15.49:6801/2744935777","cluster_addr":"172.21.15.49:6803/2744935777","heartbeat_back_addr":"172.21.15.49:6807/2744935777","heartbeat_front_addr":"172.21.15.49:6805/2744935777","state":["exists","up"]},{"osd":1,"uuid":"80461bd9-59ef-46df-9eea-bad92d960c57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6811","nonce":1655120118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6815","nonce":1655120118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6821","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6823","nonce":1655120118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6817","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6819","nonce":1655120118}]},"public_addr":"172.21.15.49:6811/1655120118","cluster_addr":"172.21.15.49:6815/1655120118","heartbeat_back_addr":"172.21.15.49:6823/1655120118","heartbeat_front_addr":"172.21.15.49:6819/1655120118","state":["exists","up"]},{"osd":2,"uuid":"d6bf40eb-6e42-4ec9-8b3d-0b6c5a6def79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6810","nonce":3815472376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6814","nonce":3815472376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6822","nonce":3815472376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6818","nonce":3815472376}]},"public_addr":"172.21.15.49:6810/3815472376","cluster_addr":"172.21.15.49:6814/3815472376","heartbeat_back_addr":"172.21.15.49:6822/3815472376","heartbeat_front_addr":"172.21.15.49:6818/3815472376","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.641492+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.668598+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.614940+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"25.1d","mappings":[{"from":0,"to":2}]},{"pgid":"25.30","mappings":[{"from":0,"to":1}]},{"pgid":"27.35","mappings":[{"from":0,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.49:0/1311079412":"2024-03-17T07:34:44.704697+0000","172.21.15.49:0/1403232186":"2024-03-17T07:34:44.704697+0000","172.21.15.49:6825/975765687":"2024-03-17T07:34:44.704697+0000","172.21.15.49:0/1795189171":"2024-03-17T07:34:44.704697+0000","172.21.15.49:0/2265076113":"2024-03-17T07:34:44.704697+0000","172.21.15.49:0/3870882427":"2024-03-17T07:34:44.704697+0000","172.21.15.49:0/4170960283":"2024-03-16T08:34:29.913374+0000","172.21.15.49:6824/975765687":"2024-03-17T07:34:44.704697+0000","172.21.15.49:0/2799967982":"2024-03-17T07:32:43.474587+0000","172.21.15.49:0/4185192406":"2024-03-16T08:33:37.476103+0000","172.21.15.49:0/858221795":"2024-03-17T07:32:43.474587+0000","172.21.15.49:0/2121807561":"2024-03-17T07:32:43.474587+0000","172.21.15.49:0/1336083103":"2024-03-17T07:32:43.474587+0000","172.21.15.49:6825/2955625097":"2024-03-17T07:32:43.474587+0000","172.21.15.49:6824/2955625097":"2024-03-17T07:32:43.474587+0000","172.21.15.49:0/2836520053":"2024-03-17T07:32:43.474587+0000","172.21.15.49:0/417496104":"2024-03-17T07:32:43.474587+0000","172.21.15.49:0/1051974920":"2024-03-17T07:32:43.474587+0000","172.21.15.49:0/1787331336":"2024-03-17T07:32:43.474587+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T07:34:51.273 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-03-16T07:34:51.633 INFO:tasks.ceph.mon.a.smithi049.stderr:2024-03-16T07:34:51.633+0000 7feb67011640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-03-16T07:34:51.633 INFO:teuthology.orchestra.run.smithi049.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-03-16T07:34:51.635 INFO:tasks.ceph.mds.a.smithi049.stderr: -916> 2024-03-16T07:32:23.870+0000 7fc8351f2640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-03-16T07:34:51.650 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-03-16T07:34:51.669 INFO:tasks.ceph.mds.a.smithi049.stdout:starting mds.a at 2024-03-16T07:34:52.652 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-03-16T07:34:53.719 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_metadata' removed 2024-03-16T07:34:53.740 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-03-16T07:34:54.721 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_data' removed 2024-03-16T07:34:54.741 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T07:34:55.042 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:34:55.043 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":155,"fsid":"f91af061-9eac-4793-87fa-8d27ae3d242f","created":"2024-03-16T07:24:20.357868+0000","modified":"2024-03-16T07:34:54.722134+0000","last_up_change":"2024-03-16T07:24:27.474980+0000","last_in_change":"2024-03-16T07:24:21.254179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":27,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T07:24:28.947521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":26,"pool_name":"backup_fs_metadata","create_time":"2024-03-16T07:32:30.176149+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"145","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"backup_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.309999942779541,"score_stable":1.309999942779541,"optimal_score":1,"raw_score_acting":1.309999942779541,"raw_score_stable":1.309999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":27,"pool_name":"backup_fs_data","create_time":"2024-03-16T07:32:30.596010+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"146","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"backup_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2df14aac-98dc-4e3c-ae7e-9eb677aa30be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6801","nonce":2744935777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6803","nonce":2744935777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6807","nonce":2744935777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6805","nonce":2744935777}]},"public_addr":"172.21.15.49:6801/2744935777","cluster_addr":"172.21.15.49:6803/2744935777","heartbeat_back_addr":"172.21.15.49:6807/2744935777","heartbeat_front_addr":"172.21.15.49:6805/2744935777","state":["exists","up"]},{"osd":1,"uuid":"80461bd9-59ef-46df-9eea-bad92d960c57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6811","nonce":1655120118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6815","nonce":1655120118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6821","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6823","nonce":1655120118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6817","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6819","nonce":1655120118}]},"public_addr":"172.21.15.49:6811/1655120118","cluster_addr":"172.21.15.49:6815/1655120118","heartbeat_back_addr":"172.21.15.49:6823/1655120118","heartbeat_front_addr":"172.21.15.49:6819/1655120118","state":["exists","up"]},{"osd":2,"uuid":"d6bf40eb-6e42-4ec9-8b3d-0b6c5a6def79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6810","nonce":3815472376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6814","nonce":3815472376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6822","nonce":3815472376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6818","nonce":3815472376}]},"public_addr":"172.21.15.49:6810/3815472376","cluster_addr":"172.21.15.49:6814/3815472376","heartbeat_back_addr":"172.21.15.49:6822/3815472376","heartbeat_front_addr":"172.21.15.49:6818/3815472376","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.641492+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.668598+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.614940+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"27.35","mappings":[{"from":0,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.49:0/1311079412":"2024-03-17T07:34:44.704697+0000","172.21.15.49:0/1403232186":"2024-03-17T07:34:44.704697+0000","172.21.15.49:6825/975765687":"2024-03-17T07:34:44.704697+0000","172.21.15.49:0/1795189171":"2024-03-17T07:34:44.704697+0000","172.21.15.49:0/2265076113":"2024-03-17T07:34:44.704697+0000","172.21.15.49:0/3870882427":"2024-03-17T07:34:44.704697+0000","172.21.15.49:0/4170960283":"2024-03-16T08:34:29.913374+0000","172.21.15.49:6824/975765687":"2024-03-17T07:34:44.704697+0000","172.21.15.49:0/2799967982":"2024-03-17T07:32:43.474587+0000","172.21.15.49:6834/2709512109":"2024-03-17T07:34:51.635036+0000","172.21.15.49:0/4185192406":"2024-03-16T08:33:37.476103+0000","172.21.15.49:0/858221795":"2024-03-17T07:32:43.474587+0000","172.21.15.49:0/2121807561":"2024-03-17T07:32:43.474587+0000","172.21.15.49:0/1336083103":"2024-03-17T07:32:43.474587+0000","172.21.15.49:6825/2955625097":"2024-03-17T07:32:43.474587+0000","172.21.15.49:6835/2709512109":"2024-03-17T07:34:51.635036+0000","172.21.15.49:6824/2955625097":"2024-03-17T07:32:43.474587+0000","172.21.15.49:0/2836520053":"2024-03-17T07:32:43.474587+0000","172.21.15.49:0/417496104":"2024-03-17T07:32:43.474587+0000","172.21.15.49:0/1051974920":"2024-03-17T07:32:43.474587+0000","172.21.15.49:0/1787331336":"2024-03-17T07:32:43.474587+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T07:34:55.055 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-16T07:24:28.947521+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 26, 'pool_name': 'backup_fs_metadata', 'create_time': '2024-03-16T07:32:30.176149+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '145', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'backup_fs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.309999942779541, 'score_stable': 1.309999942779541, 'optimal_score': 1, 'raw_score_acting': 1.309999942779541, 'raw_score_stable': 1.309999942779541, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 27, 'pool_name': 'backup_fs_data', 'create_time': '2024-03-16T07:32:30.596010+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '146', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'backup_fs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-16T07:34:55.056 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-16T07:34:55.399 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2024-03-16T07:34:55.412 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get backup_fs_metadata pg_num 2024-03-16T07:34:55.738 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2024-03-16T07:34:55.751 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get backup_fs_data pg_num 2024-03-16T07:34:56.171 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2024-03-16T07:34:56.189 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T07:34:56.557 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:34:56.558 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":110,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6315,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6828/2438276517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":2438276517},{"type":"v1","addr":"172.21.15.49:6828","nonce":2438276517}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":94},{"gid":6316,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6829/1412184122","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6827","nonce":1412184122},{"type":"v1","addr":"172.21.15.49:6829","nonce":1412184122}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":94},{"gid":6321,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6831/3610285344","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":3610285344},{"type":"v1","addr":"172.21.15.49:6831","nonce":3610285344}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":94},{"gid":6614,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/83540499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":83540499},{"type":"v1","addr":"172.21.15.49:6835","nonce":83540499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":110}],"filesystems":[{"mdsmap":{"epoch":105,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-16T07:32:31.616889+0000","modified":"2024-03-16T07:32:34.616124+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6324},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6324":{"gid":6324,"name":"c","rank":0,"incarnation":101,"state":"up:active","state_seq":6,"addr":"172.21.15.49:6833/1457417734","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":1457417734},{"type":"v1","addr":"172.21.15.49:6833","nonce":1457417734}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[27],"metadata_pool":26,"enabled":true,"fs_name":"backup_fs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6324,"qdb_cluster":[6324]},"id":13}]} 2024-03-16T07:34:56.558 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 110 2024-03-16T07:34:56.570 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T07:34:56.877 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:34:56.877 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":155,"fsid":"f91af061-9eac-4793-87fa-8d27ae3d242f","created":"2024-03-16T07:24:20.357868+0000","modified":"2024-03-16T07:34:54.722134+0000","last_up_change":"2024-03-16T07:24:27.474980+0000","last_in_change":"2024-03-16T07:24:21.254179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":27,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T07:24:28.947521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":26,"pool_name":"backup_fs_metadata","create_time":"2024-03-16T07:32:30.176149+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"145","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"backup_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.309999942779541,"score_stable":1.309999942779541,"optimal_score":1,"raw_score_acting":1.309999942779541,"raw_score_stable":1.309999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":27,"pool_name":"backup_fs_data","create_time":"2024-03-16T07:32:30.596010+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"146","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"backup_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2df14aac-98dc-4e3c-ae7e-9eb677aa30be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6801","nonce":2744935777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6803","nonce":2744935777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6807","nonce":2744935777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6805","nonce":2744935777}]},"public_addr":"172.21.15.49:6801/2744935777","cluster_addr":"172.21.15.49:6803/2744935777","heartbeat_back_addr":"172.21.15.49:6807/2744935777","heartbeat_front_addr":"172.21.15.49:6805/2744935777","state":["exists","up"]},{"osd":1,"uuid":"80461bd9-59ef-46df-9eea-bad92d960c57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6811","nonce":1655120118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6815","nonce":1655120118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6821","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6823","nonce":1655120118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6817","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6819","nonce":1655120118}]},"public_addr":"172.21.15.49:6811/1655120118","cluster_addr":"172.21.15.49:6815/1655120118","heartbeat_back_addr":"172.21.15.49:6823/1655120118","heartbeat_front_addr":"172.21.15.49:6819/1655120118","state":["exists","up"]},{"osd":2,"uuid":"d6bf40eb-6e42-4ec9-8b3d-0b6c5a6def79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6810","nonce":3815472376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6814","nonce":3815472376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6822","nonce":3815472376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6818","nonce":3815472376}]},"public_addr":"172.21.15.49:6810/3815472376","cluster_addr":"172.21.15.49:6814/3815472376","heartbeat_back_addr":"172.21.15.49:6822/3815472376","heartbeat_front_addr":"172.21.15.49:6818/3815472376","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.641492+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.668598+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.614940+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"27.35","mappings":[{"from":0,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.49:0/1311079412":"2024-03-17T07:34:44.704697+0000","172.21.15.49:0/1403232186":"2024-03-17T07:34:44.704697+0000","172.21.15.49:6825/975765687":"2024-03-17T07:34:44.704697+0000","172.21.15.49:0/1795189171":"2024-03-17T07:34:44.704697+0000","172.21.15.49:0/2265076113":"2024-03-17T07:34:44.704697+0000","172.21.15.49:0/3870882427":"2024-03-17T07:34:44.704697+0000","172.21.15.49:0/4170960283":"2024-03-16T08:34:29.913374+0000","172.21.15.49:6824/975765687":"2024-03-17T07:34:44.704697+0000","172.21.15.49:0/2799967982":"2024-03-17T07:32:43.474587+0000","172.21.15.49:6834/2709512109":"2024-03-17T07:34:51.635036+0000","172.21.15.49:0/4185192406":"2024-03-16T08:33:37.476103+0000","172.21.15.49:0/858221795":"2024-03-17T07:32:43.474587+0000","172.21.15.49:0/2121807561":"2024-03-17T07:32:43.474587+0000","172.21.15.49:0/1336083103":"2024-03-17T07:32:43.474587+0000","172.21.15.49:6825/2955625097":"2024-03-17T07:32:43.474587+0000","172.21.15.49:6835/2709512109":"2024-03-17T07:34:51.635036+0000","172.21.15.49:6824/2955625097":"2024-03-17T07:32:43.474587+0000","172.21.15.49:0/2836520053":"2024-03-17T07:32:43.474587+0000","172.21.15.49:0/417496104":"2024-03-17T07:32:43.474587+0000","172.21.15.49:0/1051974920":"2024-03-17T07:32:43.474587+0000","172.21.15.49:0/1787331336":"2024-03-17T07:32:43.474587+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T07:34:56.890 INFO:tasks.cephfs.filesystem:Destroying file system backup_fs and related pools 2024-03-16T07:34:56.891 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T07:34:57.229 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:34:57.229 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":110,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6315,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6828/2438276517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":2438276517},{"type":"v1","addr":"172.21.15.49:6828","nonce":2438276517}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":94},{"gid":6316,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6829/1412184122","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6827","nonce":1412184122},{"type":"v1","addr":"172.21.15.49:6829","nonce":1412184122}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":94},{"gid":6321,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6831/3610285344","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":3610285344},{"type":"v1","addr":"172.21.15.49:6831","nonce":3610285344}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":94},{"gid":6614,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/83540499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":83540499},{"type":"v1","addr":"172.21.15.49:6835","nonce":83540499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":110}],"filesystems":[{"mdsmap":{"epoch":105,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-16T07:32:31.616889+0000","modified":"2024-03-16T07:32:34.616124+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6324},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6324":{"gid":6324,"name":"c","rank":0,"incarnation":101,"state":"up:active","state_seq":6,"addr":"172.21.15.49:6833/1457417734","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":1457417734},{"type":"v1","addr":"172.21.15.49:6833","nonce":1457417734}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[27],"metadata_pool":26,"enabled":true,"fs_name":"backup_fs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6324,"qdb_cluster":[6324]},"id":13}]} 2024-03-16T07:34:57.229 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 110 2024-03-16T07:34:57.243 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T07:34:57.585 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:34:57.585 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":110,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6315,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6828/2438276517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":2438276517},{"type":"v1","addr":"172.21.15.49:6828","nonce":2438276517}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":94},{"gid":6316,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6829/1412184122","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6827","nonce":1412184122},{"type":"v1","addr":"172.21.15.49:6829","nonce":1412184122}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":94},{"gid":6321,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6831/3610285344","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":3610285344},{"type":"v1","addr":"172.21.15.49:6831","nonce":3610285344}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":94},{"gid":6614,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/83540499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":83540499},{"type":"v1","addr":"172.21.15.49:6835","nonce":83540499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":110}],"filesystems":[{"mdsmap":{"epoch":105,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-16T07:32:31.616889+0000","modified":"2024-03-16T07:32:34.616124+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6324},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6324":{"gid":6324,"name":"c","rank":0,"incarnation":101,"state":"up:active","state_seq":6,"addr":"172.21.15.49:6833/1457417734","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":1457417734},{"type":"v1","addr":"172.21.15.49:6833","nonce":1457417734}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[27],"metadata_pool":26,"enabled":true,"fs_name":"backup_fs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6324,"qdb_cluster":[6324]},"id":13}]} 2024-03-16T07:34:57.585 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 110 2024-03-16T07:34:57.598 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T07:34:57.945 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:34:57.946 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":155,"fsid":"f91af061-9eac-4793-87fa-8d27ae3d242f","created":"2024-03-16T07:24:20.357868+0000","modified":"2024-03-16T07:34:54.722134+0000","last_up_change":"2024-03-16T07:24:27.474980+0000","last_in_change":"2024-03-16T07:24:21.254179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":27,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T07:24:28.947521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":26,"pool_name":"backup_fs_metadata","create_time":"2024-03-16T07:32:30.176149+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"145","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"backup_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.309999942779541,"score_stable":1.309999942779541,"optimal_score":1,"raw_score_acting":1.309999942779541,"raw_score_stable":1.309999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":27,"pool_name":"backup_fs_data","create_time":"2024-03-16T07:32:30.596010+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"146","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"backup_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2df14aac-98dc-4e3c-ae7e-9eb677aa30be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6801","nonce":2744935777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6803","nonce":2744935777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6807","nonce":2744935777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6805","nonce":2744935777}]},"public_addr":"172.21.15.49:6801/2744935777","cluster_addr":"172.21.15.49:6803/2744935777","heartbeat_back_addr":"172.21.15.49:6807/2744935777","heartbeat_front_addr":"172.21.15.49:6805/2744935777","state":["exists","up"]},{"osd":1,"uuid":"80461bd9-59ef-46df-9eea-bad92d960c57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6811","nonce":1655120118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6815","nonce":1655120118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6821","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6823","nonce":1655120118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6817","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6819","nonce":1655120118}]},"public_addr":"172.21.15.49:6811/1655120118","cluster_addr":"172.21.15.49:6815/1655120118","heartbeat_back_addr":"172.21.15.49:6823/1655120118","heartbeat_front_addr":"172.21.15.49:6819/1655120118","state":["exists","up"]},{"osd":2,"uuid":"d6bf40eb-6e42-4ec9-8b3d-0b6c5a6def79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6810","nonce":3815472376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6814","nonce":3815472376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6822","nonce":3815472376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6818","nonce":3815472376}]},"public_addr":"172.21.15.49:6810/3815472376","cluster_addr":"172.21.15.49:6814/3815472376","heartbeat_back_addr":"172.21.15.49:6822/3815472376","heartbeat_front_addr":"172.21.15.49:6818/3815472376","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.641492+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.668598+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.614940+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"27.35","mappings":[{"from":0,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.49:0/1311079412":"2024-03-17T07:34:44.704697+0000","172.21.15.49:0/1403232186":"2024-03-17T07:34:44.704697+0000","172.21.15.49:6825/975765687":"2024-03-17T07:34:44.704697+0000","172.21.15.49:0/1795189171":"2024-03-17T07:34:44.704697+0000","172.21.15.49:0/2265076113":"2024-03-17T07:34:44.704697+0000","172.21.15.49:0/3870882427":"2024-03-17T07:34:44.704697+0000","172.21.15.49:0/4170960283":"2024-03-16T08:34:29.913374+0000","172.21.15.49:6824/975765687":"2024-03-17T07:34:44.704697+0000","172.21.15.49:0/2799967982":"2024-03-17T07:32:43.474587+0000","172.21.15.49:6834/2709512109":"2024-03-17T07:34:51.635036+0000","172.21.15.49:0/4185192406":"2024-03-16T08:33:37.476103+0000","172.21.15.49:0/858221795":"2024-03-17T07:32:43.474587+0000","172.21.15.49:0/2121807561":"2024-03-17T07:32:43.474587+0000","172.21.15.49:0/1336083103":"2024-03-17T07:32:43.474587+0000","172.21.15.49:6825/2955625097":"2024-03-17T07:32:43.474587+0000","172.21.15.49:6835/2709512109":"2024-03-17T07:34:51.635036+0000","172.21.15.49:6824/2955625097":"2024-03-17T07:32:43.474587+0000","172.21.15.49:0/2836520053":"2024-03-17T07:32:43.474587+0000","172.21.15.49:0/417496104":"2024-03-17T07:32:43.474587+0000","172.21.15.49:0/1051974920":"2024-03-17T07:32:43.474587+0000","172.21.15.49:0/1787331336":"2024-03-17T07:32:43.474587+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T07:34:57.958 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail backup_fs 2024-03-16T07:34:58.304 INFO:tasks.ceph.mon.a.smithi049.stderr:2024-03-16T07:34:58.305+0000 7feb67011640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-03-16T07:34:58.305 INFO:teuthology.orchestra.run.smithi049.stderr:backup_fs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-03-16T07:34:58.307 INFO:tasks.ceph.mds.c.smithi049.stderr: -859> 2024-03-16T07:32:33.870+0000 7fc3077a7640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-03-16T07:34:58.321 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm backup_fs --yes-i-really-mean-it 2024-03-16T07:34:58.333 INFO:tasks.ceph.mds.c.smithi049.stdout:starting mds.c at 2024-03-16T07:34:59.323 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm backup_fs_metadata backup_fs_metadata --yes-i-really-really-mean-it 2024-03-16T07:35:00.308 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'backup_fs_metadata' removed 2024-03-16T07:35:00.327 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm backup_fs_data backup_fs_data --yes-i-really-really-mean-it 2024-03-16T07:35:01.311 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'backup_fs_data' removed 2024-03-16T07:35:01.336 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-03-16T07:35:01.658 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_mirroring.TestMirroring.test_cephfs_mirror_blocklist' 2024-03-16T07:35:02.326 INFO:tasks.cephfs_test_runner:test_cephfs_mirror_blocklist (tasks.cephfs.test_mirroring.TestMirroring) ... ok 2024-03-16T07:35:02.326 INFO:tasks.cephfs_test_runner:Starting test: test_cephfs_mirror_cancel_mirroring_and_readd (tasks.cephfs.test_mirroring.TestMirroring) Test adding a directory path for synchronization post removal of already added directory paths 2024-03-16T07:35:02.326 INFO:tasks.cephfs_test_runner:test_cephfs_mirror_cancel_mirroring_and_readd (tasks.cephfs.test_mirroring.TestMirroring) 2024-03-16T07:35:02.327 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T07:35:02.642 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:35:02.642 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":158,"fsid":"f91af061-9eac-4793-87fa-8d27ae3d242f","created":"2024-03-16T07:24:20.357868+0000","modified":"2024-03-16T07:35:01.311433+0000","last_up_change":"2024-03-16T07:24:27.474980+0000","last_in_change":"2024-03-16T07:24:21.254179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":27,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T07:24:28.947521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2df14aac-98dc-4e3c-ae7e-9eb677aa30be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6801","nonce":2744935777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6803","nonce":2744935777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6807","nonce":2744935777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6805","nonce":2744935777}]},"public_addr":"172.21.15.49:6801/2744935777","cluster_addr":"172.21.15.49:6803/2744935777","heartbeat_back_addr":"172.21.15.49:6807/2744935777","heartbeat_front_addr":"172.21.15.49:6805/2744935777","state":["exists","up"]},{"osd":1,"uuid":"80461bd9-59ef-46df-9eea-bad92d960c57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6811","nonce":1655120118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6815","nonce":1655120118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6821","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6823","nonce":1655120118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6817","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6819","nonce":1655120118}]},"public_addr":"172.21.15.49:6811/1655120118","cluster_addr":"172.21.15.49:6815/1655120118","heartbeat_back_addr":"172.21.15.49:6823/1655120118","heartbeat_front_addr":"172.21.15.49:6819/1655120118","state":["exists","up"]},{"osd":2,"uuid":"d6bf40eb-6e42-4ec9-8b3d-0b6c5a6def79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6810","nonce":3815472376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6814","nonce":3815472376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6822","nonce":3815472376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6818","nonce":3815472376}]},"public_addr":"172.21.15.49:6810/3815472376","cluster_addr":"172.21.15.49:6814/3815472376","heartbeat_back_addr":"172.21.15.49:6822/3815472376","heartbeat_front_addr":"172.21.15.49:6818/3815472376","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.641492+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.668598+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.614940+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.49:6833/1457417734":"2024-03-17T07:34:58.306875+0000","172.21.15.49:0/1311079412":"2024-03-17T07:34:44.704697+0000","172.21.15.49:0/1403232186":"2024-03-17T07:34:44.704697+0000","172.21.15.49:6825/975765687":"2024-03-17T07:34:44.704697+0000","172.21.15.49:0/1795189171":"2024-03-17T07:34:44.704697+0000","172.21.15.49:0/2265076113":"2024-03-17T07:34:44.704697+0000","172.21.15.49:0/3870882427":"2024-03-17T07:34:44.704697+0000","172.21.15.49:0/4170960283":"2024-03-16T08:34:29.913374+0000","172.21.15.49:6824/975765687":"2024-03-17T07:34:44.704697+0000","172.21.15.49:0/2799967982":"2024-03-17T07:32:43.474587+0000","172.21.15.49:6834/2709512109":"2024-03-17T07:34:51.635036+0000","172.21.15.49:0/4185192406":"2024-03-16T08:33:37.476103+0000","172.21.15.49:0/858221795":"2024-03-17T07:32:43.474587+0000","172.21.15.49:0/2121807561":"2024-03-17T07:32:43.474587+0000","172.21.15.49:0/1336083103":"2024-03-17T07:32:43.474587+0000","172.21.15.49:6832/1457417734":"2024-03-17T07:34:58.306875+0000","172.21.15.49:6825/2955625097":"2024-03-17T07:32:43.474587+0000","172.21.15.49:6835/2709512109":"2024-03-17T07:34:51.635036+0000","172.21.15.49:6824/2955625097":"2024-03-17T07:32:43.474587+0000","172.21.15.49:0/2836520053":"2024-03-17T07:32:43.474587+0000","172.21.15.49:0/417496104":"2024-03-17T07:32:43.474587+0000","172.21.15.49:0/1051974920":"2024-03-17T07:32:43.474587+0000","172.21.15.49:0/1787331336":"2024-03-17T07:32:43.474587+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T07:35:02.655 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-16T07:24:28.947521+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-16T07:35:02.655 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-16T07:35:02.957 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2024-03-16T07:35:02.970 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_mirroring.TestMirroring.test_cephfs_mirror_cancel_mirroring_and_readd' 2024-03-16T07:35:04.332 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-03-16T07:35:04.659 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-03-16T07:35:04.659 DEBUG:teuthology.orchestra.run.smithi049:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-03-16T07:35:04.703 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-03-16T07:35:04.704 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-03-16T07:35:04.704 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-16T07:35:04.719 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056354,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497664k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=13886 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248828k,nr_inodes=812207,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497664k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2024-03-16T07:35:04.719 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-03-16T07:35:04.719 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-16T07:35:04.774 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056354,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497664k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=13886 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248828k,nr_inodes=812207,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497664k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2024-03-16T07:35:04.774 INFO:tasks.cephfs.cephfs_test_case:[, ] 2024-03-16T07:35:04.774 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T07:35:05.153 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:35:05.154 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":112,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6315,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6828/2438276517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":2438276517},{"type":"v1","addr":"172.21.15.49:6828","nonce":2438276517}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":94},{"gid":6316,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6829/1412184122","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6827","nonce":1412184122},{"type":"v1","addr":"172.21.15.49:6829","nonce":1412184122}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":94},{"gid":6321,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6831/3610285344","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":3610285344},{"type":"v1","addr":"172.21.15.49:6831","nonce":3610285344}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":94},{"gid":6614,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/83540499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":83540499},{"type":"v1","addr":"172.21.15.49:6835","nonce":83540499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":110},{"gid":6656,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6833/834875494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":834875494},{"type":"v1","addr":"172.21.15.49:6833","nonce":834875494}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":112}],"filesystems":[]} 2024-03-16T07:35:05.154 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 112 2024-03-16T07:35:05.166 INFO:tasks.ceph.mds.a:Restarting daemon 2024-03-16T07:35:05.166 INFO:tasks.ceph.mds.a:Stopping old one... 2024-03-16T07:35:05.167 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-03-16T07:35:05.167 INFO:teuthology.orchestra.run:waiting for 300 2024-03-16T07:35:05.167 INFO:tasks.ceph.mds.b:Restarting daemon 2024-03-16T07:35:05.167 INFO:tasks.ceph.mds.b:Stopping old one... 2024-03-16T07:35:05.167 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-03-16T07:35:05.167 INFO:teuthology.orchestra.run:waiting for 300 2024-03-16T07:35:05.167 INFO:tasks.ceph.mds.c:Restarting daemon 2024-03-16T07:35:05.168 INFO:tasks.ceph.mds.c:Stopping old one... 2024-03-16T07:35:05.168 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-03-16T07:35:05.168 INFO:teuthology.orchestra.run:waiting for 300 2024-03-16T07:35:05.168 INFO:tasks.ceph.mds.d:Restarting daemon 2024-03-16T07:35:05.168 INFO:tasks.ceph.mds.d:Stopping old one... 2024-03-16T07:35:05.168 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-03-16T07:35:05.168 INFO:teuthology.orchestra.run:waiting for 300 2024-03-16T07:35:05.168 INFO:tasks.ceph.mds.e:Restarting daemon 2024-03-16T07:35:05.168 INFO:tasks.ceph.mds.e:Stopping old one... 2024-03-16T07:35:05.169 DEBUG:tasks.ceph.mds.e:waiting for process to exit 2024-03-16T07:35:05.169 INFO:teuthology.orchestra.run:waiting for 300 2024-03-16T07:35:05.178 INFO:tasks.ceph.mds.c:Stopped 2024-03-16T07:35:05.178 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-03-16T07:35:05.181 INFO:tasks.ceph.mds.b:Stopped 2024-03-16T07:35:05.181 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-03-16T07:35:05.182 INFO:tasks.ceph.mds.a:Stopped 2024-03-16T07:35:05.182 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-03-16T07:35:05.183 INFO:tasks.ceph.mds.d:Stopped 2024-03-16T07:35:05.183 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-03-16T07:35:05.184 INFO:tasks.ceph.mds.e:Stopped 2024-03-16T07:35:05.184 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i e 2024-03-16T07:35:05.224 INFO:tasks.ceph.mds.c:Started 2024-03-16T07:35:05.225 INFO:tasks.ceph.mds.b:Started 2024-03-16T07:35:05.225 DEBUG:teuthology.parallel:result is None 2024-03-16T07:35:05.226 DEBUG:teuthology.parallel:result is None 2024-03-16T07:35:05.226 INFO:tasks.ceph.mds.a:Started 2024-03-16T07:35:05.226 DEBUG:teuthology.parallel:result is None 2024-03-16T07:35:05.227 INFO:tasks.ceph.mds.d:Started 2024-03-16T07:35:05.228 INFO:tasks.ceph.mds.e:Started 2024-03-16T07:35:05.228 DEBUG:teuthology.parallel:result is None 2024-03-16T07:35:05.228 DEBUG:teuthology.parallel:result is None 2024-03-16T07:35:05.228 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-03-16T07:35:05.285 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~0s 2024-03-16T07:35:05.285 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2024-03-16T07:35:05.285 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.e is failed for ~0s 2024-03-16T07:35:05.321 INFO:tasks.ceph.mds.c.smithi049.stdout:starting mds.c at 2024-03-16T07:35:05.323 INFO:tasks.ceph.mds.d.smithi049.stdout:starting mds.d at 2024-03-16T07:35:05.336 INFO:tasks.ceph.mds.b.smithi049.stdout:starting mds.b at 2024-03-16T07:35:05.340 INFO:tasks.ceph.mds.e.smithi049.stdout:starting mds.e at 2024-03-16T07:35:05.340 INFO:tasks.ceph.mds.a.smithi049.stdout:starting mds.a at 2024-03-16T07:35:06.653 INFO:teuthology.orchestra.run.smithi049.stderr: removed all blocklist entries 2024-03-16T07:35:06.670 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-03-16T07:35:07.046 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:35:07.046 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-03-16T07:35:07.046 INFO:teuthology.orchestra.run.smithi049.stdout: "auth_dump": [ 2024-03-16T07:35:07.046 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:35:07.046 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.a", 2024-03-16T07:35:07.046 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAZSfVlKDkWLhAAVo2ZJMZSwTGLhocUPcHaUw==", 2024-03-16T07:35:07.046 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-03-16T07:35:07.046 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2024-03-16T07:35:07.047 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2024-03-16T07:35:07.047 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2024-03-16T07:35:07.047 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-03-16T07:35:07.047 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:35:07.047 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:35:07.047 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:35:07.047 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.b", 2024-03-16T07:35:07.047 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAZSfVl53IaNhAATOLh8Lzad03tyKQph1oowQ==", 2024-03-16T07:35:07.047 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-03-16T07:35:07.047 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2024-03-16T07:35:07.047 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2024-03-16T07:35:07.047 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2024-03-16T07:35:07.047 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-03-16T07:35:07.047 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:35:07.047 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:35:07.048 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:35:07.048 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.c", 2024-03-16T07:35:07.048 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAaSfVlI3p/AhAAZEetRkGlMLMEI7hMN7pS5w==", 2024-03-16T07:35:07.048 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-03-16T07:35:07.048 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2024-03-16T07:35:07.048 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2024-03-16T07:35:07.048 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2024-03-16T07:35:07.048 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-03-16T07:35:07.048 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:35:07.048 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:35:07.048 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:35:07.048 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.d", 2024-03-16T07:35:07.048 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAaSfVl3ueIChAA640lcZj8yUgH9jq7r7B+bA==", 2024-03-16T07:35:07.048 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-03-16T07:35:07.048 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2024-03-16T07:35:07.048 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2024-03-16T07:35:07.049 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2024-03-16T07:35:07.049 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-03-16T07:35:07.049 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:35:07.049 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:35:07.049 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:35:07.049 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mds.e", 2024-03-16T07:35:07.049 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAaSfVl8OySEhAAyF3ScxdSuQ0jhZhRbJ2gEg==", 2024-03-16T07:35:07.049 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-03-16T07:35:07.049 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2024-03-16T07:35:07.049 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2024-03-16T07:35:07.049 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2024-03-16T07:35:07.049 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-03-16T07:35:07.049 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:35:07.049 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:35:07.049 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:35:07.049 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.0", 2024-03-16T07:35:07.050 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAbSfVlNhmeKBAAVnxZbeNKU/kVViG2vb2+tQ==", 2024-03-16T07:35:07.050 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-03-16T07:35:07.050 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2024-03-16T07:35:07.050 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2024-03-16T07:35:07.050 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-03-16T07:35:07.050 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:35:07.050 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:35:07.050 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:35:07.050 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.1", 2024-03-16T07:35:07.050 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAdSfVlNNNkNhAAKhYH9tWxFT8HH6ZLMnaK7A==", 2024-03-16T07:35:07.050 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-03-16T07:35:07.050 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2024-03-16T07:35:07.050 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2024-03-16T07:35:07.051 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-03-16T07:35:07.051 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:35:07.051 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:35:07.051 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:35:07.051 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "osd.2", 2024-03-16T07:35:07.051 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAgSfVlXJh1BxAAEOX+brDLOLTkp0thYQgMrw==", 2024-03-16T07:35:07.051 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-03-16T07:35:07.051 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow profile osd", 2024-03-16T07:35:07.051 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile osd", 2024-03-16T07:35:07.051 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-03-16T07:35:07.051 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:35:07.051 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:35:07.051 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:35:07.051 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.0", 2024-03-16T07:35:07.051 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAaSfVlmBmvGRAAaxdhkajaioVlq23dyv/g4g==", 2024-03-16T07:35:07.051 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-03-16T07:35:07.052 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2024-03-16T07:35:07.052 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow r", 2024-03-16T07:35:07.052 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-03-16T07:35:07.052 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:35:07.052 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:35:07.052 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:35:07.052 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.1", 2024-03-16T07:35:07.052 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAaSfVlCp2DHRAAdVsc+jh/QA74EBwffEqP5g==", 2024-03-16T07:35:07.052 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-03-16T07:35:07.052 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow", 2024-03-16T07:35:07.052 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow r", 2024-03-16T07:35:07.052 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow rw", 2024-03-16T07:35:07.052 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rwx" 2024-03-16T07:35:07.052 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:35:07.052 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:35:07.052 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:35:07.053 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.admin", 2024-03-16T07:35:07.053 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAZSfVl0iRiFxAArXglVmR8MpJZNrXNv5tS7A==", 2024-03-16T07:35:07.053 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-03-16T07:35:07.053 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow *", 2024-03-16T07:35:07.053 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow *", 2024-03-16T07:35:07.053 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow *", 2024-03-16T07:35:07.053 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-03-16T07:35:07.053 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:35:07.053 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:35:07.053 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:35:07.053 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.mirror", 2024-03-16T07:35:07.053 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAaSfVldspUIRAAa1kAy23ZdMBfbhy+7HMVqA==", 2024-03-16T07:35:07.053 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-03-16T07:35:07.053 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow r", 2024-03-16T07:35:07.053 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow r", 2024-03-16T07:35:07.054 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "profile cephfs-mirror", 2024-03-16T07:35:07.054 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rw tag cephfs metadata=*, allow r tag cephfs data=*" 2024-03-16T07:35:07.054 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:35:07.054 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:35:07.054 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:35:07.054 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "client.mirror_remote", 2024-03-16T07:35:07.054 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAaSfVlaygzJRAAJVP9XACdC2Wikb4ZtKci9g==", 2024-03-16T07:35:07.054 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-03-16T07:35:07.054 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow rwps", 2024-03-16T07:35:07.054 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": "allow r", 2024-03-16T07:35:07.054 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow r", 2024-03-16T07:35:07.054 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow rw tag cephfs *=*" 2024-03-16T07:35:07.054 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:35:07.054 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:35:07.054 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:35:07.055 INFO:teuthology.orchestra.run.smithi049.stdout: "entity": "mgr.x", 2024-03-16T07:35:07.055 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "AQAZSfVlX9BEKhAAftDfT7+IPsQFhrTPl2h0SQ==", 2024-03-16T07:35:07.055 INFO:teuthology.orchestra.run.smithi049.stdout: "caps": { 2024-03-16T07:35:07.055 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": "allow *", 2024-03-16T07:35:07.055 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": "allow profile mgr", 2024-03-16T07:35:07.055 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": "allow *" 2024-03-16T07:35:07.055 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:35:07.055 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:35:07.055 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2024-03-16T07:35:07.055 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-03-16T07:35:07.058 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T07:35:07.361 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:35:07.361 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":164,"fsid":"f91af061-9eac-4793-87fa-8d27ae3d242f","created":"2024-03-16T07:24:20.357868+0000","modified":"2024-03-16T07:35:06.654463+0000","last_up_change":"2024-03-16T07:24:27.474980+0000","last_in_change":"2024-03-16T07:24:21.254179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":27,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T07:24:28.947521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2df14aac-98dc-4e3c-ae7e-9eb677aa30be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6801","nonce":2744935777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6803","nonce":2744935777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6807","nonce":2744935777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6805","nonce":2744935777}]},"public_addr":"172.21.15.49:6801/2744935777","cluster_addr":"172.21.15.49:6803/2744935777","heartbeat_back_addr":"172.21.15.49:6807/2744935777","heartbeat_front_addr":"172.21.15.49:6805/2744935777","state":["exists","up"]},{"osd":1,"uuid":"80461bd9-59ef-46df-9eea-bad92d960c57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6811","nonce":1655120118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6815","nonce":1655120118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6821","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6823","nonce":1655120118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6817","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6819","nonce":1655120118}]},"public_addr":"172.21.15.49:6811/1655120118","cluster_addr":"172.21.15.49:6815/1655120118","heartbeat_back_addr":"172.21.15.49:6823/1655120118","heartbeat_front_addr":"172.21.15.49:6819/1655120118","state":["exists","up"]},{"osd":2,"uuid":"d6bf40eb-6e42-4ec9-8b3d-0b6c5a6def79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6810","nonce":3815472376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6814","nonce":3815472376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6822","nonce":3815472376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6818","nonce":3815472376}]},"public_addr":"172.21.15.49:6810/3815472376","cluster_addr":"172.21.15.49:6814/3815472376","heartbeat_back_addr":"172.21.15.49:6822/3815472376","heartbeat_front_addr":"172.21.15.49:6818/3815472376","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.641492+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.668598+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.614940+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T07:35:07.374 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-16T07:24:28.947521+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-16T07:35:07.375 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-16T07:35:07.679 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2024-03-16T07:35:07.692 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-03-16T07:35:07.994 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:35:07.994 INFO:teuthology.orchestra.run.smithi049.stdout:[ 2024-03-16T07:35:07.994 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:35:07.994 INFO:teuthology.orchestra.run.smithi049.stdout: "poolnum": 1, 2024-03-16T07:35:07.994 INFO:teuthology.orchestra.run.smithi049.stdout: "poolname": ".mgr" 2024-03-16T07:35:07.995 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:35:07.995 INFO:teuthology.orchestra.run.smithi049.stdout:] 2024-03-16T07:35:08.007 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-03-16T07:35:08.007 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-03-16T07:35:08.654 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_metadata' created 2024-03-16T07:35:08.673 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-03-16T07:35:09.223 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T07:35:09.656 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_data' created 2024-03-16T07:35:09.691 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-03-16T07:35:10.657 INFO:teuthology.orchestra.run.smithi049.stderr:new fs with metadata pool 28 and data pool 29 2024-03-16T07:35:10.678 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T07:35:10.984 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:35:10.984 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":167,"fsid":"f91af061-9eac-4793-87fa-8d27ae3d242f","created":"2024-03-16T07:24:20.357868+0000","modified":"2024-03-16T07:35:10.038691+0000","last_up_change":"2024-03-16T07:24:27.474980+0000","last_in_change":"2024-03-16T07:24:21.254179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":29,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T07:24:28.947521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":28,"pool_name":"cephfs_metadata","create_time":"2024-03-16T07:35:08.344405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"167","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.309999942779541,"score_stable":1.309999942779541,"optimal_score":1,"raw_score_acting":1.309999942779541,"raw_score_stable":1.309999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":29,"pool_name":"cephfs_data","create_time":"2024-03-16T07:35:09.019172+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"167","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1699999570846558,"score_stable":1.1699999570846558,"optimal_score":1,"raw_score_acting":1.1699999570846558,"raw_score_stable":1.1699999570846558,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2df14aac-98dc-4e3c-ae7e-9eb677aa30be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6801","nonce":2744935777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6803","nonce":2744935777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6807","nonce":2744935777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6805","nonce":2744935777}]},"public_addr":"172.21.15.49:6801/2744935777","cluster_addr":"172.21.15.49:6803/2744935777","heartbeat_back_addr":"172.21.15.49:6807/2744935777","heartbeat_front_addr":"172.21.15.49:6805/2744935777","state":["exists","up"]},{"osd":1,"uuid":"80461bd9-59ef-46df-9eea-bad92d960c57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6811","nonce":1655120118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6815","nonce":1655120118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6821","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6823","nonce":1655120118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6817","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6819","nonce":1655120118}]},"public_addr":"172.21.15.49:6811/1655120118","cluster_addr":"172.21.15.49:6815/1655120118","heartbeat_back_addr":"172.21.15.49:6823/1655120118","heartbeat_front_addr":"172.21.15.49:6819/1655120118","state":["exists","up"]},{"osd":2,"uuid":"d6bf40eb-6e42-4ec9-8b3d-0b6c5a6def79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6810","nonce":3815472376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6814","nonce":3815472376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6822","nonce":3815472376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6818","nonce":3815472376}]},"public_addr":"172.21.15.49:6810/3815472376","cluster_addr":"172.21.15.49:6814/3815472376","heartbeat_back_addr":"172.21.15.49:6822/3815472376","heartbeat_front_addr":"172.21.15.49:6818/3815472376","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.641492+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.668598+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.614940+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T07:35:10.997 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T07:35:11.292 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a has been restored 2024-03-16T07:35:11.292 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d has been restored 2024-03-16T07:35:11.292 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.e has been restored 2024-03-16T07:35:11.299 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:35:11.299 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":167,"fsid":"f91af061-9eac-4793-87fa-8d27ae3d242f","created":"2024-03-16T07:24:20.357868+0000","modified":"2024-03-16T07:35:10.038691+0000","last_up_change":"2024-03-16T07:24:27.474980+0000","last_in_change":"2024-03-16T07:24:21.254179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":29,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T07:24:28.947521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":28,"pool_name":"cephfs_metadata","create_time":"2024-03-16T07:35:08.344405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"167","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.309999942779541,"score_stable":1.309999942779541,"optimal_score":1,"raw_score_acting":1.309999942779541,"raw_score_stable":1.309999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":29,"pool_name":"cephfs_data","create_time":"2024-03-16T07:35:09.019172+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"167","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1699999570846558,"score_stable":1.1699999570846558,"optimal_score":1,"raw_score_acting":1.1699999570846558,"raw_score_stable":1.1699999570846558,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2df14aac-98dc-4e3c-ae7e-9eb677aa30be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6801","nonce":2744935777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6803","nonce":2744935777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6807","nonce":2744935777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6805","nonce":2744935777}]},"public_addr":"172.21.15.49:6801/2744935777","cluster_addr":"172.21.15.49:6803/2744935777","heartbeat_back_addr":"172.21.15.49:6807/2744935777","heartbeat_front_addr":"172.21.15.49:6805/2744935777","state":["exists","up"]},{"osd":1,"uuid":"80461bd9-59ef-46df-9eea-bad92d960c57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6811","nonce":1655120118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6815","nonce":1655120118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6821","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6823","nonce":1655120118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6817","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6819","nonce":1655120118}]},"public_addr":"172.21.15.49:6811/1655120118","cluster_addr":"172.21.15.49:6815/1655120118","heartbeat_back_addr":"172.21.15.49:6823/1655120118","heartbeat_front_addr":"172.21.15.49:6819/1655120118","state":["exists","up"]},{"osd":2,"uuid":"d6bf40eb-6e42-4ec9-8b3d-0b6c5a6def79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6810","nonce":3815472376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6814","nonce":3815472376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6822","nonce":3815472376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6818","nonce":3815472376}]},"public_addr":"172.21.15.49:6810/3815472376","cluster_addr":"172.21.15.49:6814/3815472376","heartbeat_back_addr":"172.21.15.49:6822/3815472376","heartbeat_front_addr":"172.21.15.49:6818/3815472376","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.641492+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.668598+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.614940+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T07:35:11.312 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-03-16T07:35:11.679 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-03-16T07:35:11.679 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-03-16T07:35:12.672 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-03-16T07:35:12.673 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T07:35:13.042 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:35:13.042 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":116,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6690,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6827/875237476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":875237476},{"type":"v1","addr":"172.21.15.49:6827","nonce":875237476}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":113},{"gid":6691,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6829/417322500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":417322500},{"type":"v1","addr":"172.21.15.49:6829","nonce":417322500}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":113},{"gid":6696,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6831/4121914730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":4121914730},{"type":"v1","addr":"172.21.15.49:6831","nonce":4121914730}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":113},{"gid":6697,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6834/1716116460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":1716116460},{"type":"v1","addr":"172.21.15.49:6834","nonce":1716116460}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":113}],"filesystems":[{"mdsmap":{"epoch":116,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-16T07:35:10.038977+0000","modified":"2024-03-16T07:35:12.029087+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6698},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6698":{"gid":6698,"name":"a","rank":0,"incarnation":114,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6835/1838330688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":1838330688},{"type":"v1","addr":"172.21.15.49:6835","nonce":1838330688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[29],"metadata_pool":28,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6698,"qdb_cluster":[6698]},"id":14}]} 2024-03-16T07:35:13.042 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 116 2024-03-16T07:35:13.054 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T07:35:13.364 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:35:13.364 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":168,"fsid":"f91af061-9eac-4793-87fa-8d27ae3d242f","created":"2024-03-16T07:24:20.357868+0000","modified":"2024-03-16T07:35:11.346479+0000","last_up_change":"2024-03-16T07:24:27.474980+0000","last_in_change":"2024-03-16T07:24:21.254179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":29,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T07:24:28.947521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":28,"pool_name":"cephfs_metadata","create_time":"2024-03-16T07:35:08.344405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"167","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.309999942779541,"score_stable":1.309999942779541,"optimal_score":1,"raw_score_acting":1.309999942779541,"raw_score_stable":1.309999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":29,"pool_name":"cephfs_data","create_time":"2024-03-16T07:35:09.019172+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"168","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1699999570846558,"score_stable":1.1699999570846558,"optimal_score":1,"raw_score_acting":1.1699999570846558,"raw_score_stable":1.1699999570846558,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2df14aac-98dc-4e3c-ae7e-9eb677aa30be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6801","nonce":2744935777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6803","nonce":2744935777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6807","nonce":2744935777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6805","nonce":2744935777}]},"public_addr":"172.21.15.49:6801/2744935777","cluster_addr":"172.21.15.49:6803/2744935777","heartbeat_back_addr":"172.21.15.49:6807/2744935777","heartbeat_front_addr":"172.21.15.49:6805/2744935777","state":["exists","up"]},{"osd":1,"uuid":"80461bd9-59ef-46df-9eea-bad92d960c57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6811","nonce":1655120118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6815","nonce":1655120118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6821","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6823","nonce":1655120118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6817","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6819","nonce":1655120118}]},"public_addr":"172.21.15.49:6811/1655120118","cluster_addr":"172.21.15.49:6815/1655120118","heartbeat_back_addr":"172.21.15.49:6823/1655120118","heartbeat_front_addr":"172.21.15.49:6819/1655120118","state":["exists","up"]},{"osd":2,"uuid":"d6bf40eb-6e42-4ec9-8b3d-0b6c5a6def79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6810","nonce":3815472376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6814","nonce":3815472376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6822","nonce":3815472376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6818","nonce":3815472376}]},"public_addr":"172.21.15.49:6810/3815472376","cluster_addr":"172.21.15.49:6814/3815472376","heartbeat_back_addr":"172.21.15.49:6822/3815472376","heartbeat_front_addr":"172.21.15.49:6818/3815472376","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.641492+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.668598+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.614940+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T07:35:13.377 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-03-16T07:35:13.377 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-16T07:35:13.868 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:35:13.869 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2024-03-16T07:35:13.883 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":32,"stamp":"2024-03-16T07:35:12.722048+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":1162,"num_read_kb":2357,"num_write":401,"num_write_kb":1908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":256,"ondisk_log_size":256,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":100,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":314572800,"kb_used":112244,"kb_used_data":6208,"kb_used_omap":4,"kb_used_meta":105979,"kb_avail":314460556,"statfs":{"total":322122547200,"available":322007609344,"internally_reserved":0,"allocated":6356992,"data_stored":3302361,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":108522831},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.065287"},"pg_stats":[{"pgid":"29.3f","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.369655+0000","last_change":"2024-03-16T07:35:10.367781+0000","last_active":"2024-03-16T07:35:10.369655+0000","last_peered":"2024-03-16T07:35:10.369655+0000","last_clean":"2024-03-16T07:35:10.369655+0000","last_became_active":"2024-03-16T07:35:10.367508+0000","last_became_peered":"2024-03-16T07:35:10.367508+0000","last_unstale":"2024-03-16T07:35:10.369655+0000","last_undegraded":"2024-03-16T07:35:10.369655+0000","last_fullsized":"2024-03-16T07:35:10.369655+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:50:44.382790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.3e","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.373508+0000","last_change":"2024-03-16T07:35:10.372544+0000","last_active":"2024-03-16T07:35:10.373508+0000","last_peered":"2024-03-16T07:35:10.373508+0000","last_clean":"2024-03-16T07:35:10.373508+0000","last_became_active":"2024-03-16T07:35:10.368326+0000","last_became_peered":"2024-03-16T07:35:10.368326+0000","last_unstale":"2024-03-16T07:35:10.373508+0000","last_undegraded":"2024-03-16T07:35:10.373508+0000","last_fullsized":"2024-03-16T07:35:10.373508+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:55:15.666047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.3d","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.372387+0000","last_change":"2024-03-16T07:35:10.370295+0000","last_active":"2024-03-16T07:35:10.372387+0000","last_peered":"2024-03-16T07:35:10.372387+0000","last_clean":"2024-03-16T07:35:10.372387+0000","last_became_active":"2024-03-16T07:35:10.367872+0000","last_became_peered":"2024-03-16T07:35:10.367872+0000","last_unstale":"2024-03-16T07:35:10.372387+0000","last_undegraded":"2024-03-16T07:35:10.372387+0000","last_fullsized":"2024-03-16T07:35:10.372387+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:49:00.193261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.3c","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.372862+0000","last_change":"2024-03-16T07:35:10.371287+0000","last_active":"2024-03-16T07:35:10.372862+0000","last_peered":"2024-03-16T07:35:10.372862+0000","last_clean":"2024-03-16T07:35:10.372862+0000","last_became_active":"2024-03-16T07:35:10.370698+0000","last_became_peered":"2024-03-16T07:35:10.370698+0000","last_unstale":"2024-03-16T07:35:10.372862+0000","last_undegraded":"2024-03-16T07:35:10.372862+0000","last_fullsized":"2024-03-16T07:35:10.372862+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:55:44.588538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.3b","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.372998+0000","last_change":"2024-03-16T07:35:10.372081+0000","last_active":"2024-03-16T07:35:10.372998+0000","last_peered":"2024-03-16T07:35:10.372998+0000","last_clean":"2024-03-16T07:35:10.372998+0000","last_became_active":"2024-03-16T07:35:10.371181+0000","last_became_peered":"2024-03-16T07:35:10.371181+0000","last_unstale":"2024-03-16T07:35:10.372998+0000","last_undegraded":"2024-03-16T07:35:10.372998+0000","last_fullsized":"2024-03-16T07:35:10.372998+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:35:11.161085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.3a","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.363731+0000","last_change":"2024-03-16T07:35:10.361524+0000","last_active":"2024-03-16T07:35:10.363731+0000","last_peered":"2024-03-16T07:35:10.363731+0000","last_clean":"2024-03-16T07:35:10.363731+0000","last_became_active":"2024-03-16T07:35:10.361243+0000","last_became_peered":"2024-03-16T07:35:10.361243+0000","last_unstale":"2024-03-16T07:35:10.363731+0000","last_undegraded":"2024-03-16T07:35:10.363731+0000","last_fullsized":"2024-03-16T07:35:10.363731+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:09:56.033035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.39","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.372879+0000","last_change":"2024-03-16T07:35:10.366571+0000","last_active":"2024-03-16T07:35:10.372879+0000","last_peered":"2024-03-16T07:35:10.372879+0000","last_clean":"2024-03-16T07:35:10.372879+0000","last_became_active":"2024-03-16T07:35:10.366265+0000","last_became_peered":"2024-03-16T07:35:10.366265+0000","last_unstale":"2024-03-16T07:35:10.372879+0000","last_undegraded":"2024-03-16T07:35:10.372879+0000","last_fullsized":"2024-03-16T07:35:10.372879+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:08:57.431787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.38","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.366885+0000","last_change":"2024-03-16T07:35:10.364222+0000","last_active":"2024-03-16T07:35:10.366885+0000","last_peered":"2024-03-16T07:35:10.366885+0000","last_clean":"2024-03-16T07:35:10.366885+0000","last_became_active":"2024-03-16T07:35:10.363574+0000","last_became_peered":"2024-03-16T07:35:10.363574+0000","last_unstale":"2024-03-16T07:35:10.366885+0000","last_undegraded":"2024-03-16T07:35:10.366885+0000","last_fullsized":"2024-03-16T07:35:10.366885+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:46:34.710279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.37","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.365167+0000","last_change":"2024-03-16T07:35:10.363569+0000","last_active":"2024-03-16T07:35:10.365167+0000","last_peered":"2024-03-16T07:35:10.365167+0000","last_clean":"2024-03-16T07:35:10.365167+0000","last_became_active":"2024-03-16T07:35:10.362745+0000","last_became_peered":"2024-03-16T07:35:10.362745+0000","last_unstale":"2024-03-16T07:35:10.365167+0000","last_undegraded":"2024-03-16T07:35:10.365167+0000","last_fullsized":"2024-03-16T07:35:10.365167+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:29:39.394755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.36","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.372453+0000","last_change":"2024-03-16T07:35:10.368073+0000","last_active":"2024-03-16T07:35:10.372453+0000","last_peered":"2024-03-16T07:35:10.372453+0000","last_clean":"2024-03-16T07:35:10.372453+0000","last_became_active":"2024-03-16T07:35:10.367391+0000","last_became_peered":"2024-03-16T07:35:10.367391+0000","last_unstale":"2024-03-16T07:35:10.372453+0000","last_undegraded":"2024-03-16T07:35:10.372453+0000","last_fullsized":"2024-03-16T07:35:10.372453+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:28:10.644885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.35","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.370821+0000","last_change":"2024-03-16T07:35:10.368280+0000","last_active":"2024-03-16T07:35:10.370821+0000","last_peered":"2024-03-16T07:35:10.370821+0000","last_clean":"2024-03-16T07:35:10.370821+0000","last_became_active":"2024-03-16T07:35:10.367563+0000","last_became_peered":"2024-03-16T07:35:10.367563+0000","last_unstale":"2024-03-16T07:35:10.370821+0000","last_undegraded":"2024-03-16T07:35:10.370821+0000","last_fullsized":"2024-03-16T07:35:10.370821+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:46:52.855673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.34","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.365104+0000","last_change":"2024-03-16T07:35:10.363259+0000","last_active":"2024-03-16T07:35:10.365104+0000","last_peered":"2024-03-16T07:35:10.365104+0000","last_clean":"2024-03-16T07:35:10.365104+0000","last_became_active":"2024-03-16T07:35:10.363011+0000","last_became_peered":"2024-03-16T07:35:10.363011+0000","last_unstale":"2024-03-16T07:35:10.365104+0000","last_undegraded":"2024-03-16T07:35:10.365104+0000","last_fullsized":"2024-03-16T07:35:10.365104+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:52:19.800718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.33","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.372964+0000","last_change":"2024-03-16T07:35:10.369777+0000","last_active":"2024-03-16T07:35:10.372964+0000","last_peered":"2024-03-16T07:35:10.372964+0000","last_clean":"2024-03-16T07:35:10.372964+0000","last_became_active":"2024-03-16T07:35:10.367275+0000","last_became_peered":"2024-03-16T07:35:10.367275+0000","last_unstale":"2024-03-16T07:35:10.372964+0000","last_undegraded":"2024-03-16T07:35:10.372964+0000","last_fullsized":"2024-03-16T07:35:10.372964+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:06:01.777694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.32","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.373941+0000","last_change":"2024-03-16T07:35:10.373263+0000","last_active":"2024-03-16T07:35:10.373941+0000","last_peered":"2024-03-16T07:35:10.373941+0000","last_clean":"2024-03-16T07:35:10.373941+0000","last_became_active":"2024-03-16T07:35:10.372048+0000","last_became_peered":"2024-03-16T07:35:10.372048+0000","last_unstale":"2024-03-16T07:35:10.373941+0000","last_undegraded":"2024-03-16T07:35:10.373941+0000","last_fullsized":"2024-03-16T07:35:10.373941+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:08:14.317327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.31","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.371355+0000","last_change":"2024-03-16T07:35:10.366534+0000","last_active":"2024-03-16T07:35:10.371355+0000","last_peered":"2024-03-16T07:35:10.371355+0000","last_clean":"2024-03-16T07:35:10.371355+0000","last_became_active":"2024-03-16T07:35:10.365923+0000","last_became_peered":"2024-03-16T07:35:10.365923+0000","last_unstale":"2024-03-16T07:35:10.371355+0000","last_undegraded":"2024-03-16T07:35:10.371355+0000","last_fullsized":"2024-03-16T07:35:10.371355+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:43:08.408954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.30","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.366863+0000","last_change":"2024-03-16T07:35:10.364026+0000","last_active":"2024-03-16T07:35:10.366863+0000","last_peered":"2024-03-16T07:35:10.366863+0000","last_clean":"2024-03-16T07:35:10.366863+0000","last_became_active":"2024-03-16T07:35:10.363364+0000","last_became_peered":"2024-03-16T07:35:10.363364+0000","last_unstale":"2024-03-16T07:35:10.366863+0000","last_undegraded":"2024-03-16T07:35:10.366863+0000","last_fullsized":"2024-03-16T07:35:10.366863+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:44:58.046512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.2f","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.369634+0000","last_change":"2024-03-16T07:35:10.365876+0000","last_active":"2024-03-16T07:35:10.369634+0000","last_peered":"2024-03-16T07:35:10.369634+0000","last_clean":"2024-03-16T07:35:10.369634+0000","last_became_active":"2024-03-16T07:35:10.365174+0000","last_became_peered":"2024-03-16T07:35:10.365174+0000","last_unstale":"2024-03-16T07:35:10.369634+0000","last_undegraded":"2024-03-16T07:35:10.369634+0000","last_fullsized":"2024-03-16T07:35:10.369634+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:09:58.877836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.2e","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.372665+0000","last_change":"2024-03-16T07:35:10.371679+0000","last_active":"2024-03-16T07:35:10.372665+0000","last_peered":"2024-03-16T07:35:10.372665+0000","last_clean":"2024-03-16T07:35:10.372665+0000","last_became_active":"2024-03-16T07:35:10.370469+0000","last_became_peered":"2024-03-16T07:35:10.370469+0000","last_unstale":"2024-03-16T07:35:10.372665+0000","last_undegraded":"2024-03-16T07:35:10.372665+0000","last_fullsized":"2024-03-16T07:35:10.372665+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:33:33.468095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.2d","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.372646+0000","last_change":"2024-03-16T07:35:10.369578+0000","last_active":"2024-03-16T07:35:10.372646+0000","last_peered":"2024-03-16T07:35:10.372646+0000","last_clean":"2024-03-16T07:35:10.372646+0000","last_became_active":"2024-03-16T07:35:10.369324+0000","last_became_peered":"2024-03-16T07:35:10.369324+0000","last_unstale":"2024-03-16T07:35:10.372646+0000","last_undegraded":"2024-03-16T07:35:10.372646+0000","last_fullsized":"2024-03-16T07:35:10.372646+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:44:13.480808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.2c","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.372987+0000","last_change":"2024-03-16T07:35:10.371246+0000","last_active":"2024-03-16T07:35:10.372987+0000","last_peered":"2024-03-16T07:35:10.372987+0000","last_clean":"2024-03-16T07:35:10.372987+0000","last_became_active":"2024-03-16T07:35:10.370745+0000","last_became_peered":"2024-03-16T07:35:10.370745+0000","last_unstale":"2024-03-16T07:35:10.372987+0000","last_undegraded":"2024-03-16T07:35:10.372987+0000","last_fullsized":"2024-03-16T07:35:10.372987+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:51:13.906078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.2b","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.372981+0000","last_change":"2024-03-16T07:35:10.371877+0000","last_active":"2024-03-16T07:35:10.372981+0000","last_peered":"2024-03-16T07:35:10.372981+0000","last_clean":"2024-03-16T07:35:10.372981+0000","last_became_active":"2024-03-16T07:35:10.370864+0000","last_became_peered":"2024-03-16T07:35:10.370864+0000","last_unstale":"2024-03-16T07:35:10.372981+0000","last_undegraded":"2024-03-16T07:35:10.372981+0000","last_fullsized":"2024-03-16T07:35:10.372981+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:58:23.374090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.2a","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.374102+0000","last_change":"2024-03-16T07:35:10.373482+0000","last_active":"2024-03-16T07:35:10.374102+0000","last_peered":"2024-03-16T07:35:10.374102+0000","last_clean":"2024-03-16T07:35:10.374102+0000","last_became_active":"2024-03-16T07:35:10.368788+0000","last_became_peered":"2024-03-16T07:35:10.368788+0000","last_unstale":"2024-03-16T07:35:10.374102+0000","last_undegraded":"2024-03-16T07:35:10.374102+0000","last_fullsized":"2024-03-16T07:35:10.374102+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:10:57.661640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.29","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.369667+0000","last_change":"2024-03-16T07:35:10.367542+0000","last_active":"2024-03-16T07:35:10.369667+0000","last_peered":"2024-03-16T07:35:10.369667+0000","last_clean":"2024-03-16T07:35:10.369667+0000","last_became_active":"2024-03-16T07:35:10.366618+0000","last_became_peered":"2024-03-16T07:35:10.366618+0000","last_unstale":"2024-03-16T07:35:10.369667+0000","last_undegraded":"2024-03-16T07:35:10.369667+0000","last_fullsized":"2024-03-16T07:35:10.369667+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:52:52.660849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.28","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.370843+0000","last_change":"2024-03-16T07:35:10.369012+0000","last_active":"2024-03-16T07:35:10.370843+0000","last_peered":"2024-03-16T07:35:10.370843+0000","last_clean":"2024-03-16T07:35:10.370843+0000","last_became_active":"2024-03-16T07:35:10.368755+0000","last_became_peered":"2024-03-16T07:35:10.368755+0000","last_unstale":"2024-03-16T07:35:10.370843+0000","last_undegraded":"2024-03-16T07:35:10.370843+0000","last_fullsized":"2024-03-16T07:35:10.370843+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:39:54.636478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.27","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.365475+0000","last_change":"2024-03-16T07:35:10.364840+0000","last_active":"2024-03-16T07:35:10.365475+0000","last_peered":"2024-03-16T07:35:10.365475+0000","last_clean":"2024-03-16T07:35:10.365475+0000","last_became_active":"2024-03-16T07:35:10.364570+0000","last_became_peered":"2024-03-16T07:35:10.364570+0000","last_unstale":"2024-03-16T07:35:10.365475+0000","last_undegraded":"2024-03-16T07:35:10.365475+0000","last_fullsized":"2024-03-16T07:35:10.365475+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:17:17.510769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.26","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.361547+0000","last_change":"2024-03-16T07:35:10.359654+0000","last_active":"2024-03-16T07:35:10.361547+0000","last_peered":"2024-03-16T07:35:10.361547+0000","last_clean":"2024-03-16T07:35:10.361547+0000","last_became_active":"2024-03-16T07:35:10.359424+0000","last_became_peered":"2024-03-16T07:35:10.359424+0000","last_unstale":"2024-03-16T07:35:10.361547+0000","last_undegraded":"2024-03-16T07:35:10.361547+0000","last_fullsized":"2024-03-16T07:35:10.361547+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:00:10.806644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.25","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.370802+0000","last_change":"2024-03-16T07:35:10.368078+0000","last_active":"2024-03-16T07:35:10.370802+0000","last_peered":"2024-03-16T07:35:10.370802+0000","last_clean":"2024-03-16T07:35:10.370802+0000","last_became_active":"2024-03-16T07:35:10.367079+0000","last_became_peered":"2024-03-16T07:35:10.367079+0000","last_unstale":"2024-03-16T07:35:10.370802+0000","last_undegraded":"2024-03-16T07:35:10.370802+0000","last_fullsized":"2024-03-16T07:35:10.370802+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:57:44.085561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.24","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.365125+0000","last_change":"2024-03-16T07:35:10.363356+0000","last_active":"2024-03-16T07:35:10.365125+0000","last_peered":"2024-03-16T07:35:10.365125+0000","last_clean":"2024-03-16T07:35:10.365125+0000","last_became_active":"2024-03-16T07:35:10.362988+0000","last_became_peered":"2024-03-16T07:35:10.362988+0000","last_unstale":"2024-03-16T07:35:10.365125+0000","last_undegraded":"2024-03-16T07:35:10.365125+0000","last_fullsized":"2024-03-16T07:35:10.365125+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:37:48.442212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.23","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.363492+0000","last_change":"2024-03-16T07:35:10.359431+0000","last_active":"2024-03-16T07:35:10.363492+0000","last_peered":"2024-03-16T07:35:10.363492+0000","last_clean":"2024-03-16T07:35:10.363492+0000","last_became_active":"2024-03-16T07:35:10.358815+0000","last_became_peered":"2024-03-16T07:35:10.358815+0000","last_unstale":"2024-03-16T07:35:10.363492+0000","last_undegraded":"2024-03-16T07:35:10.363492+0000","last_fullsized":"2024-03-16T07:35:10.363492+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:24:19.910328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.22","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.373924+0000","last_change":"2024-03-16T07:35:10.372992+0000","last_active":"2024-03-16T07:35:10.373924+0000","last_peered":"2024-03-16T07:35:10.373924+0000","last_clean":"2024-03-16T07:35:10.373924+0000","last_became_active":"2024-03-16T07:35:10.371612+0000","last_became_peered":"2024-03-16T07:35:10.371612+0000","last_unstale":"2024-03-16T07:35:10.373924+0000","last_undegraded":"2024-03-16T07:35:10.373924+0000","last_fullsized":"2024-03-16T07:35:10.373924+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:07:45.602788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.21","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.373980+0000","last_change":"2024-03-16T07:35:10.372894+0000","last_active":"2024-03-16T07:35:10.373980+0000","last_peered":"2024-03-16T07:35:10.373980+0000","last_clean":"2024-03-16T07:35:10.373980+0000","last_became_active":"2024-03-16T07:35:10.372610+0000","last_became_peered":"2024-03-16T07:35:10.372610+0000","last_unstale":"2024-03-16T07:35:10.373980+0000","last_undegraded":"2024-03-16T07:35:10.373980+0000","last_fullsized":"2024-03-16T07:35:10.373980+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:44:59.550936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.20","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.372752+0000","last_change":"2024-03-16T07:35:10.366632+0000","last_active":"2024-03-16T07:35:10.372752+0000","last_peered":"2024-03-16T07:35:10.372752+0000","last_clean":"2024-03-16T07:35:10.372752+0000","last_became_active":"2024-03-16T07:35:10.365558+0000","last_became_peered":"2024-03-16T07:35:10.365558+0000","last_unstale":"2024-03-16T07:35:10.372752+0000","last_undegraded":"2024-03-16T07:35:10.372752+0000","last_fullsized":"2024-03-16T07:35:10.372752+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:03:06.737166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.1e","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.372682+0000","last_change":"2024-03-16T07:35:10.371872+0000","last_active":"2024-03-16T07:35:10.372682+0000","last_peered":"2024-03-16T07:35:10.372682+0000","last_clean":"2024-03-16T07:35:10.372682+0000","last_became_active":"2024-03-16T07:35:10.371262+0000","last_became_peered":"2024-03-16T07:35:10.371262+0000","last_unstale":"2024-03-16T07:35:10.372682+0000","last_undegraded":"2024-03-16T07:35:10.372682+0000","last_fullsized":"2024-03-16T07:35:10.372682+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:18:48.673892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.1f","version":"167'4","reported_seq":16,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.670396+0000","last_change":"2024-03-16T07:35:09.679357+0000","last_active":"2024-03-16T07:35:10.670396+0000","last_peered":"2024-03-16T07:35:10.670396+0000","last_clean":"2024-03-16T07:35:10.670396+0000","last_became_active":"2024-03-16T07:35:09.679104+0000","last_became_peered":"2024-03-16T07:35:09.679104+0000","last_unstale":"2024-03-16T07:35:10.670396+0000","last_undegraded":"2024-03-16T07:35:10.670396+0000","last_fullsized":"2024-03-16T07:35:10.670396+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_clean_scrub_stamp":"2024-03-16T07:35:08.655627+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:44:40.502257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.1f","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.365150+0000","last_change":"2024-03-16T07:35:10.362327+0000","last_active":"2024-03-16T07:35:10.365150+0000","last_peered":"2024-03-16T07:35:10.365150+0000","last_clean":"2024-03-16T07:35:10.365150+0000","last_became_active":"2024-03-16T07:35:10.361296+0000","last_became_peered":"2024-03-16T07:35:10.361296+0000","last_unstale":"2024-03-16T07:35:10.365150+0000","last_undegraded":"2024-03-16T07:35:10.365150+0000","last_fullsized":"2024-03-16T07:35:10.365150+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:19:05.261800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.1e","version":"167'1","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.668890+0000","last_change":"2024-03-16T07:35:09.675846+0000","last_active":"2024-03-16T07:35:10.668890+0000","last_peered":"2024-03-16T07:35:10.668890+0000","last_clean":"2024-03-16T07:35:10.668890+0000","last_became_active":"2024-03-16T07:35:09.675457+0000","last_became_peered":"2024-03-16T07:35:09.675457+0000","last_unstale":"2024-03-16T07:35:10.668890+0000","last_undegraded":"2024-03-16T07:35:10.668890+0000","last_fullsized":"2024-03-16T07:35:10.668890+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_clean_scrub_stamp":"2024-03-16T07:35:08.655627+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:52:18.799704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.1d","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.364258+0000","last_change":"2024-03-16T07:35:10.361899+0000","last_active":"2024-03-16T07:35:10.364258+0000","last_peered":"2024-03-16T07:35:10.364258+0000","last_clean":"2024-03-16T07:35:10.364258+0000","last_became_active":"2024-03-16T07:35:10.361003+0000","last_became_peered":"2024-03-16T07:35:10.361003+0000","last_unstale":"2024-03-16T07:35:10.364258+0000","last_undegraded":"2024-03-16T07:35:10.364258+0000","last_fullsized":"2024-03-16T07:35:10.364258+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:01:31.614335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.1c","version":"167'2","reported_seq":14,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.670036+0000","last_change":"2024-03-16T07:35:09.683142+0000","last_active":"2024-03-16T07:35:10.670036+0000","last_peered":"2024-03-16T07:35:10.670036+0000","last_clean":"2024-03-16T07:35:10.670036+0000","last_became_active":"2024-03-16T07:35:09.682887+0000","last_became_peered":"2024-03-16T07:35:09.682887+0000","last_unstale":"2024-03-16T07:35:10.670036+0000","last_undegraded":"2024-03-16T07:35:10.670036+0000","last_fullsized":"2024-03-16T07:35:10.670036+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_clean_scrub_stamp":"2024-03-16T07:35:08.655627+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:07:12.557490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.1a","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.373486+0000","last_change":"2024-03-16T07:35:10.372758+0000","last_active":"2024-03-16T07:35:10.373486+0000","last_peered":"2024-03-16T07:35:10.373486+0000","last_clean":"2024-03-16T07:35:10.373486+0000","last_became_active":"2024-03-16T07:35:10.370443+0000","last_became_peered":"2024-03-16T07:35:10.370443+0000","last_unstale":"2024-03-16T07:35:10.373486+0000","last_undegraded":"2024-03-16T07:35:10.373486+0000","last_fullsized":"2024-03-16T07:35:10.373486+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:32:16.079048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.1b","version":"167'1","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.670126+0000","last_change":"2024-03-16T07:35:09.686706+0000","last_active":"2024-03-16T07:35:10.670126+0000","last_peered":"2024-03-16T07:35:10.670126+0000","last_clean":"2024-03-16T07:35:10.670126+0000","last_became_active":"2024-03-16T07:35:09.686429+0000","last_became_peered":"2024-03-16T07:35:09.686429+0000","last_unstale":"2024-03-16T07:35:10.670126+0000","last_undegraded":"2024-03-16T07:35:10.670126+0000","last_fullsized":"2024-03-16T07:35:10.670126+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_clean_scrub_stamp":"2024-03-16T07:35:08.655627+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:52:03.120308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.1b","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.373015+0000","last_change":"2024-03-16T07:35:10.372111+0000","last_active":"2024-03-16T07:35:10.373015+0000","last_peered":"2024-03-16T07:35:10.373015+0000","last_clean":"2024-03-16T07:35:10.373015+0000","last_became_active":"2024-03-16T07:35:10.370526+0000","last_became_peered":"2024-03-16T07:35:10.370526+0000","last_unstale":"2024-03-16T07:35:10.373015+0000","last_undegraded":"2024-03-16T07:35:10.373015+0000","last_fullsized":"2024-03-16T07:35:10.373015+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:00:31.515809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.1a","version":"167'1","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.670626+0000","last_change":"2024-03-16T07:35:09.674506+0000","last_active":"2024-03-16T07:35:10.670626+0000","last_peered":"2024-03-16T07:35:10.670626+0000","last_clean":"2024-03-16T07:35:10.670626+0000","last_became_active":"2024-03-16T07:35:09.674254+0000","last_became_peered":"2024-03-16T07:35:09.674254+0000","last_unstale":"2024-03-16T07:35:10.670626+0000","last_undegraded":"2024-03-16T07:35:10.670626+0000","last_fullsized":"2024-03-16T07:35:10.670626+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_clean_scrub_stamp":"2024-03-16T07:35:08.655627+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:19:04.260787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.18","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.366901+0000","last_change":"2024-03-16T07:35:10.363833+0000","last_active":"2024-03-16T07:35:10.366901+0000","last_peered":"2024-03-16T07:35:10.366901+0000","last_clean":"2024-03-16T07:35:10.366901+0000","last_became_active":"2024-03-16T07:35:10.363037+0000","last_became_peered":"2024-03-16T07:35:10.363037+0000","last_unstale":"2024-03-16T07:35:10.366901+0000","last_undegraded":"2024-03-16T07:35:10.366901+0000","last_fullsized":"2024-03-16T07:35:10.366901+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:01:23.258987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.19","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.349681+0000","last_change":"2024-03-16T07:35:09.684877+0000","last_active":"2024-03-16T07:35:10.349681+0000","last_peered":"2024-03-16T07:35:10.349681+0000","last_clean":"2024-03-16T07:35:10.349681+0000","last_became_active":"2024-03-16T07:35:09.684558+0000","last_became_peered":"2024-03-16T07:35:09.684558+0000","last_unstale":"2024-03-16T07:35:10.349681+0000","last_undegraded":"2024-03-16T07:35:10.349681+0000","last_fullsized":"2024-03-16T07:35:10.349681+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_clean_scrub_stamp":"2024-03-16T07:35:08.655627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:18:02.438640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.19","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.369648+0000","last_change":"2024-03-16T07:35:10.367160+0000","last_active":"2024-03-16T07:35:10.369648+0000","last_peered":"2024-03-16T07:35:10.369648+0000","last_clean":"2024-03-16T07:35:10.369648+0000","last_became_active":"2024-03-16T07:35:10.365971+0000","last_became_peered":"2024-03-16T07:35:10.365971+0000","last_unstale":"2024-03-16T07:35:10.369648+0000","last_undegraded":"2024-03-16T07:35:10.369648+0000","last_fullsized":"2024-03-16T07:35:10.369648+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:26:42.036511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.18","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.349842+0000","last_change":"2024-03-16T07:35:09.684870+0000","last_active":"2024-03-16T07:35:10.349842+0000","last_peered":"2024-03-16T07:35:10.349842+0000","last_clean":"2024-03-16T07:35:10.349842+0000","last_became_active":"2024-03-16T07:35:09.684583+0000","last_became_peered":"2024-03-16T07:35:09.684583+0000","last_unstale":"2024-03-16T07:35:10.349842+0000","last_undegraded":"2024-03-16T07:35:10.349842+0000","last_fullsized":"2024-03-16T07:35:10.349842+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_clean_scrub_stamp":"2024-03-16T07:35:08.655627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:36:37.264021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.16","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.373941+0000","last_change":"2024-03-16T07:35:10.372562+0000","last_active":"2024-03-16T07:35:10.373941+0000","last_peered":"2024-03-16T07:35:10.373941+0000","last_clean":"2024-03-16T07:35:10.373941+0000","last_became_active":"2024-03-16T07:35:10.372187+0000","last_became_peered":"2024-03-16T07:35:10.372187+0000","last_unstale":"2024-03-16T07:35:10.373941+0000","last_undegraded":"2024-03-16T07:35:10.373941+0000","last_fullsized":"2024-03-16T07:35:10.373941+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:24:30.491794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.17","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.356228+0000","last_change":"2024-03-16T07:35:09.680665+0000","last_active":"2024-03-16T07:35:10.356228+0000","last_peered":"2024-03-16T07:35:10.356228+0000","last_clean":"2024-03-16T07:35:10.356228+0000","last_became_active":"2024-03-16T07:35:09.680284+0000","last_became_peered":"2024-03-16T07:35:09.680284+0000","last_unstale":"2024-03-16T07:35:10.356228+0000","last_undegraded":"2024-03-16T07:35:10.356228+0000","last_fullsized":"2024-03-16T07:35:10.356228+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_clean_scrub_stamp":"2024-03-16T07:35:08.655627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:44:57.045499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.17","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.360829+0000","last_change":"2024-03-16T07:35:10.359658+0000","last_active":"2024-03-16T07:35:10.360829+0000","last_peered":"2024-03-16T07:35:10.360829+0000","last_clean":"2024-03-16T07:35:10.360829+0000","last_became_active":"2024-03-16T07:35:10.359392+0000","last_became_peered":"2024-03-16T07:35:10.359392+0000","last_unstale":"2024-03-16T07:35:10.360829+0000","last_undegraded":"2024-03-16T07:35:10.360829+0000","last_fullsized":"2024-03-16T07:35:10.360829+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:07:30.797294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.16","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.355912+0000","last_change":"2024-03-16T07:35:09.683330+0000","last_active":"2024-03-16T07:35:10.355912+0000","last_peered":"2024-03-16T07:35:10.355912+0000","last_clean":"2024-03-16T07:35:10.355912+0000","last_became_active":"2024-03-16T07:35:09.682629+0000","last_became_peered":"2024-03-16T07:35:09.682629+0000","last_unstale":"2024-03-16T07:35:10.355912+0000","last_undegraded":"2024-03-16T07:35:10.355912+0000","last_fullsized":"2024-03-16T07:35:10.355912+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_clean_scrub_stamp":"2024-03-16T07:35:08.655627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:20:13.455330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.14","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.361631+0000","last_change":"2024-03-16T07:35:10.359135+0000","last_active":"2024-03-16T07:35:10.361631+0000","last_peered":"2024-03-16T07:35:10.361631+0000","last_clean":"2024-03-16T07:35:10.361631+0000","last_became_active":"2024-03-16T07:35:10.358882+0000","last_became_peered":"2024-03-16T07:35:10.358882+0000","last_unstale":"2024-03-16T07:35:10.361631+0000","last_undegraded":"2024-03-16T07:35:10.361631+0000","last_fullsized":"2024-03-16T07:35:10.361631+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:01:29.326615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.15","version":"167'3","reported_seq":15,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.670806+0000","last_change":"2024-03-16T07:35:09.670265+0000","last_active":"2024-03-16T07:35:10.670806+0000","last_peered":"2024-03-16T07:35:10.670806+0000","last_clean":"2024-03-16T07:35:10.670806+0000","last_became_active":"2024-03-16T07:35:09.670015+0000","last_became_peered":"2024-03-16T07:35:09.670015+0000","last_unstale":"2024-03-16T07:35:10.670806+0000","last_undegraded":"2024-03-16T07:35:10.670806+0000","last_fullsized":"2024-03-16T07:35:10.670806+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_clean_scrub_stamp":"2024-03-16T07:35:08.655627+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:00:24.230346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.15","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.372406+0000","last_change":"2024-03-16T07:35:10.368083+0000","last_active":"2024-03-16T07:35:10.372406+0000","last_peered":"2024-03-16T07:35:10.372406+0000","last_clean":"2024-03-16T07:35:10.372406+0000","last_became_active":"2024-03-16T07:35:10.365110+0000","last_became_peered":"2024-03-16T07:35:10.365110+0000","last_unstale":"2024-03-16T07:35:10.372406+0000","last_undegraded":"2024-03-16T07:35:10.372406+0000","last_fullsized":"2024-03-16T07:35:10.372406+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:00:12.716312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.14","version":"167'6","reported_seq":18,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.672721+0000","last_change":"2024-03-16T07:35:09.682373+0000","last_active":"2024-03-16T07:35:10.672721+0000","last_peered":"2024-03-16T07:35:10.672721+0000","last_clean":"2024-03-16T07:35:10.672721+0000","last_became_active":"2024-03-16T07:35:09.681726+0000","last_became_peered":"2024-03-16T07:35:09.681726+0000","last_unstale":"2024-03-16T07:35:10.672721+0000","last_undegraded":"2024-03-16T07:35:10.672721+0000","last_fullsized":"2024-03-16T07:35:10.672721+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_clean_scrub_stamp":"2024-03-16T07:35:08.655627+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:30:16.270717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.12","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.373903+0000","last_change":"2024-03-16T07:35:10.372982+0000","last_active":"2024-03-16T07:35:10.373903+0000","last_peered":"2024-03-16T07:35:10.373903+0000","last_clean":"2024-03-16T07:35:10.373903+0000","last_became_active":"2024-03-16T07:35:10.371039+0000","last_became_peered":"2024-03-16T07:35:10.371039+0000","last_unstale":"2024-03-16T07:35:10.373903+0000","last_undegraded":"2024-03-16T07:35:10.373903+0000","last_fullsized":"2024-03-16T07:35:10.373903+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:38:14.048948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.13","version":"167'2","reported_seq":14,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.670044+0000","last_change":"2024-03-16T07:35:09.685238+0000","last_active":"2024-03-16T07:35:10.670044+0000","last_peered":"2024-03-16T07:35:10.670044+0000","last_clean":"2024-03-16T07:35:10.670044+0000","last_became_active":"2024-03-16T07:35:09.684483+0000","last_became_peered":"2024-03-16T07:35:09.684483+0000","last_unstale":"2024-03-16T07:35:10.670044+0000","last_undegraded":"2024-03-16T07:35:10.670044+0000","last_fullsized":"2024-03-16T07:35:10.670044+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_clean_scrub_stamp":"2024-03-16T07:35:08.655627+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:38:00.899911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.13","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.371971+0000","last_change":"2024-03-16T07:35:10.368332+0000","last_active":"2024-03-16T07:35:10.371971+0000","last_peered":"2024-03-16T07:35:10.371971+0000","last_clean":"2024-03-16T07:35:10.371971+0000","last_became_active":"2024-03-16T07:35:10.366791+0000","last_became_peered":"2024-03-16T07:35:10.366791+0000","last_unstale":"2024-03-16T07:35:10.371971+0000","last_undegraded":"2024-03-16T07:35:10.371971+0000","last_fullsized":"2024-03-16T07:35:10.371971+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:19:12.330824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.12","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.355574+0000","last_change":"2024-03-16T07:35:09.682025+0000","last_active":"2024-03-16T07:35:10.355574+0000","last_peered":"2024-03-16T07:35:10.355574+0000","last_clean":"2024-03-16T07:35:10.355574+0000","last_became_active":"2024-03-16T07:35:09.681598+0000","last_became_peered":"2024-03-16T07:35:09.681598+0000","last_unstale":"2024-03-16T07:35:10.355574+0000","last_undegraded":"2024-03-16T07:35:10.355574+0000","last_fullsized":"2024-03-16T07:35:10.355574+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_clean_scrub_stamp":"2024-03-16T07:35:08.655627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:11:43.037273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.10","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.366019+0000","last_change":"2024-03-16T07:35:10.363831+0000","last_active":"2024-03-16T07:35:10.366019+0000","last_peered":"2024-03-16T07:35:10.366019+0000","last_clean":"2024-03-16T07:35:10.366019+0000","last_became_active":"2024-03-16T07:35:10.363235+0000","last_became_peered":"2024-03-16T07:35:10.363235+0000","last_unstale":"2024-03-16T07:35:10.366019+0000","last_undegraded":"2024-03-16T07:35:10.366019+0000","last_fullsized":"2024-03-16T07:35:10.366019+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:01:16.774365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.11","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.357568+0000","last_change":"2024-03-16T07:35:09.676637+0000","last_active":"2024-03-16T07:35:10.357568+0000","last_peered":"2024-03-16T07:35:10.357568+0000","last_clean":"2024-03-16T07:35:10.357568+0000","last_became_active":"2024-03-16T07:35:09.676175+0000","last_became_peered":"2024-03-16T07:35:09.676175+0000","last_unstale":"2024-03-16T07:35:10.357568+0000","last_undegraded":"2024-03-16T07:35:10.357568+0000","last_fullsized":"2024-03-16T07:35:10.357568+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_clean_scrub_stamp":"2024-03-16T07:35:08.655627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:15:03.991142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.11","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.372912+0000","last_change":"2024-03-16T07:35:10.371588+0000","last_active":"2024-03-16T07:35:10.372912+0000","last_peered":"2024-03-16T07:35:10.372912+0000","last_clean":"2024-03-16T07:35:10.372912+0000","last_became_active":"2024-03-16T07:35:10.368385+0000","last_became_peered":"2024-03-16T07:35:10.368385+0000","last_unstale":"2024-03-16T07:35:10.372912+0000","last_undegraded":"2024-03-16T07:35:10.372912+0000","last_fullsized":"2024-03-16T07:35:10.372912+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:22:07.177422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.10","version":"167'8","reported_seq":20,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.671653+0000","last_change":"2024-03-16T07:35:09.678042+0000","last_active":"2024-03-16T07:35:10.671653+0000","last_peered":"2024-03-16T07:35:10.671653+0000","last_clean":"2024-03-16T07:35:10.671653+0000","last_became_active":"2024-03-16T07:35:09.677738+0000","last_became_peered":"2024-03-16T07:35:09.677738+0000","last_unstale":"2024-03-16T07:35:10.671653+0000","last_undegraded":"2024-03-16T07:35:10.671653+0000","last_fullsized":"2024-03-16T07:35:10.671653+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_clean_scrub_stamp":"2024-03-16T07:35:08.655627+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:07:38.696095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.e","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.362250+0000","last_change":"2024-03-16T07:35:10.360336+0000","last_active":"2024-03-16T07:35:10.362250+0000","last_peered":"2024-03-16T07:35:10.362250+0000","last_clean":"2024-03-16T07:35:10.362250+0000","last_became_active":"2024-03-16T07:35:10.360103+0000","last_became_peered":"2024-03-16T07:35:10.360103+0000","last_unstale":"2024-03-16T07:35:10.362250+0000","last_undegraded":"2024-03-16T07:35:10.362250+0000","last_fullsized":"2024-03-16T07:35:10.362250+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:18:49.792627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.f","version":"167'1","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.669125+0000","last_change":"2024-03-16T07:35:09.680840+0000","last_active":"2024-03-16T07:35:10.669125+0000","last_peered":"2024-03-16T07:35:10.669125+0000","last_clean":"2024-03-16T07:35:10.669125+0000","last_became_active":"2024-03-16T07:35:09.679859+0000","last_became_peered":"2024-03-16T07:35:09.679859+0000","last_unstale":"2024-03-16T07:35:10.669125+0000","last_undegraded":"2024-03-16T07:35:10.669125+0000","last_fullsized":"2024-03-16T07:35:10.669125+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_clean_scrub_stamp":"2024-03-16T07:35:08.655627+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:46:33.709266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.f","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.373040+0000","last_change":"2024-03-16T07:35:10.370056+0000","last_active":"2024-03-16T07:35:10.373040+0000","last_peered":"2024-03-16T07:35:10.373040+0000","last_clean":"2024-03-16T07:35:10.373040+0000","last_became_active":"2024-03-16T07:35:10.369815+0000","last_became_peered":"2024-03-16T07:35:10.369815+0000","last_unstale":"2024-03-16T07:35:10.373040+0000","last_undegraded":"2024-03-16T07:35:10.373040+0000","last_fullsized":"2024-03-16T07:35:10.373040+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:33:06.548770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.e","version":"167'2","reported_seq":14,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.669563+0000","last_change":"2024-03-16T07:35:09.683036+0000","last_active":"2024-03-16T07:35:10.669563+0000","last_peered":"2024-03-16T07:35:10.669563+0000","last_clean":"2024-03-16T07:35:10.669563+0000","last_became_active":"2024-03-16T07:35:09.682652+0000","last_became_peered":"2024-03-16T07:35:09.682652+0000","last_unstale":"2024-03-16T07:35:10.669563+0000","last_undegraded":"2024-03-16T07:35:10.669563+0000","last_fullsized":"2024-03-16T07:35:10.669563+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_clean_scrub_stamp":"2024-03-16T07:35:08.655627+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:29:41.213080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.c","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.373473+0000","last_change":"2024-03-16T07:35:10.372880+0000","last_active":"2024-03-16T07:35:10.373473+0000","last_peered":"2024-03-16T07:35:10.373473+0000","last_clean":"2024-03-16T07:35:10.373473+0000","last_became_active":"2024-03-16T07:35:10.368709+0000","last_became_peered":"2024-03-16T07:35:10.368709+0000","last_unstale":"2024-03-16T07:35:10.373473+0000","last_undegraded":"2024-03-16T07:35:10.373473+0000","last_fullsized":"2024-03-16T07:35:10.373473+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:35:44.276859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.d","version":"167'1","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.671266+0000","last_change":"2024-03-16T07:35:09.674601+0000","last_active":"2024-03-16T07:35:10.671266+0000","last_peered":"2024-03-16T07:35:10.671266+0000","last_clean":"2024-03-16T07:35:10.671266+0000","last_became_active":"2024-03-16T07:35:09.674335+0000","last_became_peered":"2024-03-16T07:35:09.674335+0000","last_unstale":"2024-03-16T07:35:10.671266+0000","last_undegraded":"2024-03-16T07:35:10.671266+0000","last_fullsized":"2024-03-16T07:35:10.671266+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_clean_scrub_stamp":"2024-03-16T07:35:08.655627+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:01:15.773351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.d","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.362449+0000","last_change":"2024-03-16T07:35:10.361177+0000","last_active":"2024-03-16T07:35:10.362449+0000","last_peered":"2024-03-16T07:35:10.362449+0000","last_clean":"2024-03-16T07:35:10.362449+0000","last_became_active":"2024-03-16T07:35:10.360525+0000","last_became_peered":"2024-03-16T07:35:10.360525+0000","last_unstale":"2024-03-16T07:35:10.362449+0000","last_undegraded":"2024-03-16T07:35:10.362449+0000","last_fullsized":"2024-03-16T07:35:10.362449+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:16:56.157037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.c","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.358001+0000","last_change":"2024-03-16T07:35:09.675575+0000","last_active":"2024-03-16T07:35:10.358001+0000","last_peered":"2024-03-16T07:35:10.358001+0000","last_clean":"2024-03-16T07:35:10.358001+0000","last_became_active":"2024-03-16T07:35:09.675269+0000","last_became_peered":"2024-03-16T07:35:09.675269+0000","last_unstale":"2024-03-16T07:35:10.358001+0000","last_undegraded":"2024-03-16T07:35:10.358001+0000","last_fullsized":"2024-03-16T07:35:10.358001+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_clean_scrub_stamp":"2024-03-16T07:35:08.655627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:57:44.612807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.a","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.375244+0000","last_change":"2024-03-16T07:35:10.374978+0000","last_active":"2024-03-16T07:35:10.375244+0000","last_peered":"2024-03-16T07:35:10.375244+0000","last_clean":"2024-03-16T07:35:10.375244+0000","last_became_active":"2024-03-16T07:35:10.374760+0000","last_became_peered":"2024-03-16T07:35:10.374760+0000","last_unstale":"2024-03-16T07:35:10.375244+0000","last_undegraded":"2024-03-16T07:35:10.375244+0000","last_fullsized":"2024-03-16T07:35:10.375244+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:11:56.569448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.b","version":"167'2","reported_seq":14,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.671515+0000","last_change":"2024-03-16T07:35:09.676930+0000","last_active":"2024-03-16T07:35:10.671515+0000","last_peered":"2024-03-16T07:35:10.671515+0000","last_clean":"2024-03-16T07:35:10.671515+0000","last_became_active":"2024-03-16T07:35:09.676583+0000","last_became_peered":"2024-03-16T07:35:09.676583+0000","last_unstale":"2024-03-16T07:35:10.671515+0000","last_undegraded":"2024-03-16T07:35:10.671515+0000","last_fullsized":"2024-03-16T07:35:10.671515+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_clean_scrub_stamp":"2024-03-16T07:35:08.655627+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:37:47.441198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.b","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.363519+0000","last_change":"2024-03-16T07:35:10.359641+0000","last_active":"2024-03-16T07:35:10.363519+0000","last_peered":"2024-03-16T07:35:10.363519+0000","last_clean":"2024-03-16T07:35:10.363519+0000","last_became_active":"2024-03-16T07:35:10.359195+0000","last_became_peered":"2024-03-16T07:35:10.359195+0000","last_unstale":"2024-03-16T07:35:10.363519+0000","last_undegraded":"2024-03-16T07:35:10.363519+0000","last_fullsized":"2024-03-16T07:35:10.363519+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:56:25.424558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.a","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.348258+0000","last_change":"2024-03-16T07:35:09.684320+0000","last_active":"2024-03-16T07:35:10.348258+0000","last_peered":"2024-03-16T07:35:10.348258+0000","last_clean":"2024-03-16T07:35:10.348258+0000","last_became_active":"2024-03-16T07:35:09.683895+0000","last_became_peered":"2024-03-16T07:35:09.683895+0000","last_unstale":"2024-03-16T07:35:10.348258+0000","last_undegraded":"2024-03-16T07:35:10.348258+0000","last_fullsized":"2024-03-16T07:35:10.348258+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_clean_scrub_stamp":"2024-03-16T07:35:08.655627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:49:10.728594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.8","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.365999+0000","last_change":"2024-03-16T07:35:10.363635+0000","last_active":"2024-03-16T07:35:10.365999+0000","last_peered":"2024-03-16T07:35:10.365999+0000","last_clean":"2024-03-16T07:35:10.365999+0000","last_became_active":"2024-03-16T07:35:10.362705+0000","last_became_peered":"2024-03-16T07:35:10.362705+0000","last_unstale":"2024-03-16T07:35:10.365999+0000","last_undegraded":"2024-03-16T07:35:10.365999+0000","last_fullsized":"2024-03-16T07:35:10.365999+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:00:25.231360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.9","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.358315+0000","last_change":"2024-03-16T07:35:09.682153+0000","last_active":"2024-03-16T07:35:10.358315+0000","last_peered":"2024-03-16T07:35:10.358315+0000","last_clean":"2024-03-16T07:35:10.358315+0000","last_became_active":"2024-03-16T07:35:09.681886+0000","last_became_peered":"2024-03-16T07:35:09.681886+0000","last_unstale":"2024-03-16T07:35:10.358315+0000","last_undegraded":"2024-03-16T07:35:10.358315+0000","last_fullsized":"2024-03-16T07:35:10.358315+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_clean_scrub_stamp":"2024-03-16T07:35:08.655627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:45:44.039500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.9","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.369626+0000","last_change":"2024-03-16T07:35:10.366866+0000","last_active":"2024-03-16T07:35:10.369626+0000","last_peered":"2024-03-16T07:35:10.369626+0000","last_clean":"2024-03-16T07:35:10.369626+0000","last_became_active":"2024-03-16T07:35:10.365511+0000","last_became_peered":"2024-03-16T07:35:10.365511+0000","last_unstale":"2024-03-16T07:35:10.369626+0000","last_undegraded":"2024-03-16T07:35:10.369626+0000","last_fullsized":"2024-03-16T07:35:10.369626+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:47:52.138505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.8","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.355003+0000","last_change":"2024-03-16T07:35:09.678924+0000","last_active":"2024-03-16T07:35:10.355003+0000","last_peered":"2024-03-16T07:35:10.355003+0000","last_clean":"2024-03-16T07:35:10.355003+0000","last_became_active":"2024-03-16T07:35:09.678666+0000","last_became_peered":"2024-03-16T07:35:09.678666+0000","last_unstale":"2024-03-16T07:35:10.355003+0000","last_undegraded":"2024-03-16T07:35:10.355003+0000","last_fullsized":"2024-03-16T07:35:10.355003+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_clean_scrub_stamp":"2024-03-16T07:35:08.655627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:07:52.268339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.6","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.373369+0000","last_change":"2024-03-16T07:35:10.371595+0000","last_active":"2024-03-16T07:35:10.373369+0000","last_peered":"2024-03-16T07:35:10.373369+0000","last_clean":"2024-03-16T07:35:10.373369+0000","last_became_active":"2024-03-16T07:35:10.369883+0000","last_became_peered":"2024-03-16T07:35:10.369883+0000","last_unstale":"2024-03-16T07:35:10.373369+0000","last_undegraded":"2024-03-16T07:35:10.373369+0000","last_fullsized":"2024-03-16T07:35:10.373369+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:09:55.586365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.7","version":"167'2","reported_seq":14,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.671573+0000","last_change":"2024-03-16T07:35:09.675559+0000","last_active":"2024-03-16T07:35:10.671573+0000","last_peered":"2024-03-16T07:35:10.671573+0000","last_clean":"2024-03-16T07:35:10.671573+0000","last_became_active":"2024-03-16T07:35:09.675177+0000","last_became_peered":"2024-03-16T07:35:09.675177+0000","last_unstale":"2024-03-16T07:35:10.671573+0000","last_undegraded":"2024-03-16T07:35:10.671573+0000","last_fullsized":"2024-03-16T07:35:10.671573+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_clean_scrub_stamp":"2024-03-16T07:35:08.655627+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:01:22.257974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.7","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.369542+0000","last_change":"2024-03-16T07:35:10.365677+0000","last_active":"2024-03-16T07:35:10.369542+0000","last_peered":"2024-03-16T07:35:10.369542+0000","last_clean":"2024-03-16T07:35:10.369542+0000","last_became_active":"2024-03-16T07:35:10.364776+0000","last_became_peered":"2024-03-16T07:35:10.364776+0000","last_unstale":"2024-03-16T07:35:10.369542+0000","last_undegraded":"2024-03-16T07:35:10.369542+0000","last_fullsized":"2024-03-16T07:35:10.369542+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:09:47.571809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.6","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.357971+0000","last_change":"2024-03-16T07:35:09.675754+0000","last_active":"2024-03-16T07:35:10.357971+0000","last_peered":"2024-03-16T07:35:10.357971+0000","last_clean":"2024-03-16T07:35:10.357971+0000","last_became_active":"2024-03-16T07:35:09.675073+0000","last_became_peered":"2024-03-16T07:35:09.675073+0000","last_unstale":"2024-03-16T07:35:10.357971+0000","last_undegraded":"2024-03-16T07:35:10.357971+0000","last_fullsized":"2024-03-16T07:35:10.357971+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_clean_scrub_stamp":"2024-03-16T07:35:08.655627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:13:12.288432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.4","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.372845+0000","last_change":"2024-03-16T07:35:10.371080+0000","last_active":"2024-03-16T07:35:10.372845+0000","last_peered":"2024-03-16T07:35:10.372845+0000","last_clean":"2024-03-16T07:35:10.372845+0000","last_became_active":"2024-03-16T07:35:10.370374+0000","last_became_peered":"2024-03-16T07:35:10.370374+0000","last_unstale":"2024-03-16T07:35:10.372845+0000","last_undegraded":"2024-03-16T07:35:10.372845+0000","last_fullsized":"2024-03-16T07:35:10.372845+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:48:51.633616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.5","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.349177+0000","last_change":"2024-03-16T07:35:09.685196+0000","last_active":"2024-03-16T07:35:10.349177+0000","last_peered":"2024-03-16T07:35:10.349177+0000","last_clean":"2024-03-16T07:35:10.349177+0000","last_became_active":"2024-03-16T07:35:09.684449+0000","last_became_peered":"2024-03-16T07:35:09.684449+0000","last_unstale":"2024-03-16T07:35:10.349177+0000","last_undegraded":"2024-03-16T07:35:10.349177+0000","last_fullsized":"2024-03-16T07:35:10.349177+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_clean_scrub_stamp":"2024-03-16T07:35:08.655627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:13:04.761117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.5","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.370860+0000","last_change":"2024-03-16T07:35:10.369204+0000","last_active":"2024-03-16T07:35:10.370860+0000","last_peered":"2024-03-16T07:35:10.370860+0000","last_clean":"2024-03-16T07:35:10.370860+0000","last_became_active":"2024-03-16T07:35:10.368924+0000","last_became_peered":"2024-03-16T07:35:10.368924+0000","last_unstale":"2024-03-16T07:35:10.370860+0000","last_undegraded":"2024-03-16T07:35:10.370860+0000","last_fullsized":"2024-03-16T07:35:10.370860+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:49:26.412783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.4","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.356505+0000","last_change":"2024-03-16T07:35:09.677063+0000","last_active":"2024-03-16T07:35:10.356505+0000","last_peered":"2024-03-16T07:35:10.356505+0000","last_clean":"2024-03-16T07:35:10.356505+0000","last_became_active":"2024-03-16T07:35:09.676808+0000","last_became_peered":"2024-03-16T07:35:09.676808+0000","last_unstale":"2024-03-16T07:35:10.356505+0000","last_undegraded":"2024-03-16T07:35:10.356505+0000","last_fullsized":"2024-03-16T07:35:10.356505+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_clean_scrub_stamp":"2024-03-16T07:35:08.655627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:10:48.141606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.2","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.373621+0000","last_change":"2024-03-16T07:35:10.369686+0000","last_active":"2024-03-16T07:35:10.373621+0000","last_peered":"2024-03-16T07:35:10.373621+0000","last_clean":"2024-03-16T07:35:10.373621+0000","last_became_active":"2024-03-16T07:35:10.369421+0000","last_became_peered":"2024-03-16T07:35:10.369421+0000","last_unstale":"2024-03-16T07:35:10.373621+0000","last_undegraded":"2024-03-16T07:35:10.373621+0000","last_fullsized":"2024-03-16T07:35:10.373621+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:22:29.675922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.3","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.356006+0000","last_change":"2024-03-16T07:35:09.681585+0000","last_active":"2024-03-16T07:35:10.356006+0000","last_peered":"2024-03-16T07:35:10.356006+0000","last_clean":"2024-03-16T07:35:10.356006+0000","last_became_active":"2024-03-16T07:35:09.681312+0000","last_became_peered":"2024-03-16T07:35:09.681312+0000","last_unstale":"2024-03-16T07:35:10.356006+0000","last_undegraded":"2024-03-16T07:35:10.356006+0000","last_fullsized":"2024-03-16T07:35:10.356006+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_clean_scrub_stamp":"2024-03-16T07:35:08.655627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:33:35.043407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.3","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.372945+0000","last_change":"2024-03-16T07:35:10.369293+0000","last_active":"2024-03-16T07:35:10.372945+0000","last_peered":"2024-03-16T07:35:10.372945+0000","last_clean":"2024-03-16T07:35:10.372945+0000","last_became_active":"2024-03-16T07:35:10.368043+0000","last_became_peered":"2024-03-16T07:35:10.368043+0000","last_unstale":"2024-03-16T07:35:10.372945+0000","last_undegraded":"2024-03-16T07:35:10.372945+0000","last_fullsized":"2024-03-16T07:35:10.372945+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:25:59.981225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.2","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.355716+0000","last_change":"2024-03-16T07:35:09.681598+0000","last_active":"2024-03-16T07:35:10.355716+0000","last_peered":"2024-03-16T07:35:10.355716+0000","last_clean":"2024-03-16T07:35:10.355716+0000","last_became_active":"2024-03-16T07:35:09.681337+0000","last_became_peered":"2024-03-16T07:35:09.681337+0000","last_unstale":"2024-03-16T07:35:10.355716+0000","last_undegraded":"2024-03-16T07:35:10.355716+0000","last_fullsized":"2024-03-16T07:35:10.355716+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_clean_scrub_stamp":"2024-03-16T07:35:08.655627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:01:16.766400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.0","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.372778+0000","last_change":"2024-03-16T07:35:10.367769+0000","last_active":"2024-03-16T07:35:10.372778+0000","last_peered":"2024-03-16T07:35:10.372778+0000","last_clean":"2024-03-16T07:35:10.372778+0000","last_became_active":"2024-03-16T07:35:10.367452+0000","last_became_peered":"2024-03-16T07:35:10.367452+0000","last_unstale":"2024-03-16T07:35:10.372778+0000","last_undegraded":"2024-03-16T07:35:10.372778+0000","last_fullsized":"2024-03-16T07:35:10.372778+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:50:39.138805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.1","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.357711+0000","last_change":"2024-03-16T07:35:09.676420+0000","last_active":"2024-03-16T07:35:10.357711+0000","last_peered":"2024-03-16T07:35:10.357711+0000","last_clean":"2024-03-16T07:35:10.357711+0000","last_became_active":"2024-03-16T07:35:09.675843+0000","last_became_peered":"2024-03-16T07:35:09.675843+0000","last_unstale":"2024-03-16T07:35:10.357711+0000","last_undegraded":"2024-03-16T07:35:10.357711+0000","last_fullsized":"2024-03-16T07:35:10.357711+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_clean_scrub_stamp":"2024-03-16T07:35:08.655627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:59:26.600725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.1","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.364228+0000","last_change":"2024-03-16T07:35:10.361913+0000","last_active":"2024-03-16T07:35:10.364228+0000","last_peered":"2024-03-16T07:35:10.364228+0000","last_clean":"2024-03-16T07:35:10.364228+0000","last_became_active":"2024-03-16T07:35:10.361684+0000","last_became_peered":"2024-03-16T07:35:10.361684+0000","last_unstale":"2024-03-16T07:35:10.364228+0000","last_undegraded":"2024-03-16T07:35:10.364228+0000","last_fullsized":"2024-03-16T07:35:10.364228+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:57:47.696388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.0","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.354870+0000","last_change":"2024-03-16T07:35:09.680845+0000","last_active":"2024-03-16T07:35:10.354870+0000","last_peered":"2024-03-16T07:35:10.354870+0000","last_clean":"2024-03-16T07:35:10.354870+0000","last_became_active":"2024-03-16T07:35:09.680308+0000","last_became_peered":"2024-03-16T07:35:09.680308+0000","last_unstale":"2024-03-16T07:35:10.354870+0000","last_undegraded":"2024-03-16T07:35:10.354870+0000","last_fullsized":"2024-03-16T07:35:10.354870+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_clean_scrub_stamp":"2024-03-16T07:35:08.655627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:29:38.393742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.1c","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.361649+0000","last_change":"2024-03-16T07:35:10.360240+0000","last_active":"2024-03-16T07:35:10.361649+0000","last_peered":"2024-03-16T07:35:10.361649+0000","last_clean":"2024-03-16T07:35:10.361649+0000","last_became_active":"2024-03-16T07:35:10.360005+0000","last_became_peered":"2024-03-16T07:35:10.360005+0000","last_unstale":"2024-03-16T07:35:10.361649+0000","last_undegraded":"2024-03-16T07:35:10.361649+0000","last_fullsized":"2024-03-16T07:35:10.361649+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:17:44.696104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.1d","version":"167'2","reported_seq":14,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.671427+0000","last_change":"2024-03-16T07:35:09.673087+0000","last_active":"2024-03-16T07:35:10.671427+0000","last_peered":"2024-03-16T07:35:10.671427+0000","last_clean":"2024-03-16T07:35:10.671427+0000","last_became_active":"2024-03-16T07:35:09.672831+0000","last_became_peered":"2024-03-16T07:35:09.672831+0000","last_unstale":"2024-03-16T07:35:10.671427+0000","last_undegraded":"2024-03-16T07:35:10.671427+0000","last_fullsized":"2024-03-16T07:35:10.671427+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_clean_scrub_stamp":"2024-03-16T07:35:08.655627+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:55:55.803855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"152'218","reported_seq":857,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.354925+0000","last_change":"2024-03-16T07:24:31.650537+0000","last_active":"2024-03-16T07:35:10.354925+0000","last_peered":"2024-03-16T07:35:10.354925+0000","last_clean":"2024-03-16T07:35:10.354925+0000","last_became_active":"2024-03-16T07:24:31.649574+0000","last_became_peered":"2024-03-16T07:24:31.649574+0000","last_unstale":"2024-03-16T07:35:10.354925+0000","last_undegraded":"2024-03-16T07:35:10.354925+0000","last_fullsized":"2024-03-16T07:35:10.354925+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:29.719970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:29.719970+0000","last_clean_scrub_stamp":"2024-03-16T07:24:29.719970+0000","objects_scrubbed":0,"log_size":218,"log_dups_size":0,"ondisk_log_size":218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:31:35.774554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1162,"num_read_kb":2357,"num_write":357,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":29,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":28,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1162,"num_read_kb":2357,"num_write":357,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":218,"ondisk_log_size":218,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738493,"num_pgs":60,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":37028,"kb_used_data":1688,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":104820572,"statfs":{"total":107374182400,"available":107336265728,"internally_reserved":0,"allocated":1728512,"data_stored":710185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738493,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":37608,"kb_used_data":2260,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":104819992,"statfs":{"total":107374182400,"available":107335671808,"internally_reserved":0,"allocated":2314240,"data_stored":1296088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738493,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":37608,"kb_used_data":2260,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":104819992,"statfs":{"total":107374182400,"available":107335671808,"internally_reserved":0,"allocated":2314240,"data_stored":1296088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-16T07:35:13.918 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-16T07:35:14.226 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:35:14.228 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2024-03-16T07:35:14.238 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":32,"stamp":"2024-03-16T07:35:12.722048+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":1162,"num_read_kb":2357,"num_write":401,"num_write_kb":1908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":256,"ondisk_log_size":256,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":100,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":314572800,"kb_used":112244,"kb_used_data":6208,"kb_used_omap":4,"kb_used_meta":105979,"kb_avail":314460556,"statfs":{"total":322122547200,"available":322007609344,"internally_reserved":0,"allocated":6356992,"data_stored":3302361,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":108522831},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.065287"},"pg_stats":[{"pgid":"29.3f","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.369655+0000","last_change":"2024-03-16T07:35:10.367781+0000","last_active":"2024-03-16T07:35:10.369655+0000","last_peered":"2024-03-16T07:35:10.369655+0000","last_clean":"2024-03-16T07:35:10.369655+0000","last_became_active":"2024-03-16T07:35:10.367508+0000","last_became_peered":"2024-03-16T07:35:10.367508+0000","last_unstale":"2024-03-16T07:35:10.369655+0000","last_undegraded":"2024-03-16T07:35:10.369655+0000","last_fullsized":"2024-03-16T07:35:10.369655+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:50:44.382790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.3e","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.373508+0000","last_change":"2024-03-16T07:35:10.372544+0000","last_active":"2024-03-16T07:35:10.373508+0000","last_peered":"2024-03-16T07:35:10.373508+0000","last_clean":"2024-03-16T07:35:10.373508+0000","last_became_active":"2024-03-16T07:35:10.368326+0000","last_became_peered":"2024-03-16T07:35:10.368326+0000","last_unstale":"2024-03-16T07:35:10.373508+0000","last_undegraded":"2024-03-16T07:35:10.373508+0000","last_fullsized":"2024-03-16T07:35:10.373508+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:55:15.666047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.3d","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.372387+0000","last_change":"2024-03-16T07:35:10.370295+0000","last_active":"2024-03-16T07:35:10.372387+0000","last_peered":"2024-03-16T07:35:10.372387+0000","last_clean":"2024-03-16T07:35:10.372387+0000","last_became_active":"2024-03-16T07:35:10.367872+0000","last_became_peered":"2024-03-16T07:35:10.367872+0000","last_unstale":"2024-03-16T07:35:10.372387+0000","last_undegraded":"2024-03-16T07:35:10.372387+0000","last_fullsized":"2024-03-16T07:35:10.372387+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:49:00.193261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.3c","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.372862+0000","last_change":"2024-03-16T07:35:10.371287+0000","last_active":"2024-03-16T07:35:10.372862+0000","last_peered":"2024-03-16T07:35:10.372862+0000","last_clean":"2024-03-16T07:35:10.372862+0000","last_became_active":"2024-03-16T07:35:10.370698+0000","last_became_peered":"2024-03-16T07:35:10.370698+0000","last_unstale":"2024-03-16T07:35:10.372862+0000","last_undegraded":"2024-03-16T07:35:10.372862+0000","last_fullsized":"2024-03-16T07:35:10.372862+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:55:44.588538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.3b","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.372998+0000","last_change":"2024-03-16T07:35:10.372081+0000","last_active":"2024-03-16T07:35:10.372998+0000","last_peered":"2024-03-16T07:35:10.372998+0000","last_clean":"2024-03-16T07:35:10.372998+0000","last_became_active":"2024-03-16T07:35:10.371181+0000","last_became_peered":"2024-03-16T07:35:10.371181+0000","last_unstale":"2024-03-16T07:35:10.372998+0000","last_undegraded":"2024-03-16T07:35:10.372998+0000","last_fullsized":"2024-03-16T07:35:10.372998+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:35:11.161085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.3a","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.363731+0000","last_change":"2024-03-16T07:35:10.361524+0000","last_active":"2024-03-16T07:35:10.363731+0000","last_peered":"2024-03-16T07:35:10.363731+0000","last_clean":"2024-03-16T07:35:10.363731+0000","last_became_active":"2024-03-16T07:35:10.361243+0000","last_became_peered":"2024-03-16T07:35:10.361243+0000","last_unstale":"2024-03-16T07:35:10.363731+0000","last_undegraded":"2024-03-16T07:35:10.363731+0000","last_fullsized":"2024-03-16T07:35:10.363731+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:09:56.033035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.39","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.372879+0000","last_change":"2024-03-16T07:35:10.366571+0000","last_active":"2024-03-16T07:35:10.372879+0000","last_peered":"2024-03-16T07:35:10.372879+0000","last_clean":"2024-03-16T07:35:10.372879+0000","last_became_active":"2024-03-16T07:35:10.366265+0000","last_became_peered":"2024-03-16T07:35:10.366265+0000","last_unstale":"2024-03-16T07:35:10.372879+0000","last_undegraded":"2024-03-16T07:35:10.372879+0000","last_fullsized":"2024-03-16T07:35:10.372879+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:08:57.431787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.38","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.366885+0000","last_change":"2024-03-16T07:35:10.364222+0000","last_active":"2024-03-16T07:35:10.366885+0000","last_peered":"2024-03-16T07:35:10.366885+0000","last_clean":"2024-03-16T07:35:10.366885+0000","last_became_active":"2024-03-16T07:35:10.363574+0000","last_became_peered":"2024-03-16T07:35:10.363574+0000","last_unstale":"2024-03-16T07:35:10.366885+0000","last_undegraded":"2024-03-16T07:35:10.366885+0000","last_fullsized":"2024-03-16T07:35:10.366885+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:46:34.710279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.37","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.365167+0000","last_change":"2024-03-16T07:35:10.363569+0000","last_active":"2024-03-16T07:35:10.365167+0000","last_peered":"2024-03-16T07:35:10.365167+0000","last_clean":"2024-03-16T07:35:10.365167+0000","last_became_active":"2024-03-16T07:35:10.362745+0000","last_became_peered":"2024-03-16T07:35:10.362745+0000","last_unstale":"2024-03-16T07:35:10.365167+0000","last_undegraded":"2024-03-16T07:35:10.365167+0000","last_fullsized":"2024-03-16T07:35:10.365167+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:29:39.394755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.36","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.372453+0000","last_change":"2024-03-16T07:35:10.368073+0000","last_active":"2024-03-16T07:35:10.372453+0000","last_peered":"2024-03-16T07:35:10.372453+0000","last_clean":"2024-03-16T07:35:10.372453+0000","last_became_active":"2024-03-16T07:35:10.367391+0000","last_became_peered":"2024-03-16T07:35:10.367391+0000","last_unstale":"2024-03-16T07:35:10.372453+0000","last_undegraded":"2024-03-16T07:35:10.372453+0000","last_fullsized":"2024-03-16T07:35:10.372453+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:28:10.644885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.35","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.370821+0000","last_change":"2024-03-16T07:35:10.368280+0000","last_active":"2024-03-16T07:35:10.370821+0000","last_peered":"2024-03-16T07:35:10.370821+0000","last_clean":"2024-03-16T07:35:10.370821+0000","last_became_active":"2024-03-16T07:35:10.367563+0000","last_became_peered":"2024-03-16T07:35:10.367563+0000","last_unstale":"2024-03-16T07:35:10.370821+0000","last_undegraded":"2024-03-16T07:35:10.370821+0000","last_fullsized":"2024-03-16T07:35:10.370821+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:46:52.855673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.34","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.365104+0000","last_change":"2024-03-16T07:35:10.363259+0000","last_active":"2024-03-16T07:35:10.365104+0000","last_peered":"2024-03-16T07:35:10.365104+0000","last_clean":"2024-03-16T07:35:10.365104+0000","last_became_active":"2024-03-16T07:35:10.363011+0000","last_became_peered":"2024-03-16T07:35:10.363011+0000","last_unstale":"2024-03-16T07:35:10.365104+0000","last_undegraded":"2024-03-16T07:35:10.365104+0000","last_fullsized":"2024-03-16T07:35:10.365104+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:52:19.800718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.33","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.372964+0000","last_change":"2024-03-16T07:35:10.369777+0000","last_active":"2024-03-16T07:35:10.372964+0000","last_peered":"2024-03-16T07:35:10.372964+0000","last_clean":"2024-03-16T07:35:10.372964+0000","last_became_active":"2024-03-16T07:35:10.367275+0000","last_became_peered":"2024-03-16T07:35:10.367275+0000","last_unstale":"2024-03-16T07:35:10.372964+0000","last_undegraded":"2024-03-16T07:35:10.372964+0000","last_fullsized":"2024-03-16T07:35:10.372964+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:06:01.777694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.32","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.373941+0000","last_change":"2024-03-16T07:35:10.373263+0000","last_active":"2024-03-16T07:35:10.373941+0000","last_peered":"2024-03-16T07:35:10.373941+0000","last_clean":"2024-03-16T07:35:10.373941+0000","last_became_active":"2024-03-16T07:35:10.372048+0000","last_became_peered":"2024-03-16T07:35:10.372048+0000","last_unstale":"2024-03-16T07:35:10.373941+0000","last_undegraded":"2024-03-16T07:35:10.373941+0000","last_fullsized":"2024-03-16T07:35:10.373941+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:08:14.317327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.31","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.371355+0000","last_change":"2024-03-16T07:35:10.366534+0000","last_active":"2024-03-16T07:35:10.371355+0000","last_peered":"2024-03-16T07:35:10.371355+0000","last_clean":"2024-03-16T07:35:10.371355+0000","last_became_active":"2024-03-16T07:35:10.365923+0000","last_became_peered":"2024-03-16T07:35:10.365923+0000","last_unstale":"2024-03-16T07:35:10.371355+0000","last_undegraded":"2024-03-16T07:35:10.371355+0000","last_fullsized":"2024-03-16T07:35:10.371355+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:43:08.408954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.30","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.366863+0000","last_change":"2024-03-16T07:35:10.364026+0000","last_active":"2024-03-16T07:35:10.366863+0000","last_peered":"2024-03-16T07:35:10.366863+0000","last_clean":"2024-03-16T07:35:10.366863+0000","last_became_active":"2024-03-16T07:35:10.363364+0000","last_became_peered":"2024-03-16T07:35:10.363364+0000","last_unstale":"2024-03-16T07:35:10.366863+0000","last_undegraded":"2024-03-16T07:35:10.366863+0000","last_fullsized":"2024-03-16T07:35:10.366863+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:44:58.046512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.2f","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.369634+0000","last_change":"2024-03-16T07:35:10.365876+0000","last_active":"2024-03-16T07:35:10.369634+0000","last_peered":"2024-03-16T07:35:10.369634+0000","last_clean":"2024-03-16T07:35:10.369634+0000","last_became_active":"2024-03-16T07:35:10.365174+0000","last_became_peered":"2024-03-16T07:35:10.365174+0000","last_unstale":"2024-03-16T07:35:10.369634+0000","last_undegraded":"2024-03-16T07:35:10.369634+0000","last_fullsized":"2024-03-16T07:35:10.369634+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:09:58.877836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.2e","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.372665+0000","last_change":"2024-03-16T07:35:10.371679+0000","last_active":"2024-03-16T07:35:10.372665+0000","last_peered":"2024-03-16T07:35:10.372665+0000","last_clean":"2024-03-16T07:35:10.372665+0000","last_became_active":"2024-03-16T07:35:10.370469+0000","last_became_peered":"2024-03-16T07:35:10.370469+0000","last_unstale":"2024-03-16T07:35:10.372665+0000","last_undegraded":"2024-03-16T07:35:10.372665+0000","last_fullsized":"2024-03-16T07:35:10.372665+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:33:33.468095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.2d","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.372646+0000","last_change":"2024-03-16T07:35:10.369578+0000","last_active":"2024-03-16T07:35:10.372646+0000","last_peered":"2024-03-16T07:35:10.372646+0000","last_clean":"2024-03-16T07:35:10.372646+0000","last_became_active":"2024-03-16T07:35:10.369324+0000","last_became_peered":"2024-03-16T07:35:10.369324+0000","last_unstale":"2024-03-16T07:35:10.372646+0000","last_undegraded":"2024-03-16T07:35:10.372646+0000","last_fullsized":"2024-03-16T07:35:10.372646+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:44:13.480808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.2c","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.372987+0000","last_change":"2024-03-16T07:35:10.371246+0000","last_active":"2024-03-16T07:35:10.372987+0000","last_peered":"2024-03-16T07:35:10.372987+0000","last_clean":"2024-03-16T07:35:10.372987+0000","last_became_active":"2024-03-16T07:35:10.370745+0000","last_became_peered":"2024-03-16T07:35:10.370745+0000","last_unstale":"2024-03-16T07:35:10.372987+0000","last_undegraded":"2024-03-16T07:35:10.372987+0000","last_fullsized":"2024-03-16T07:35:10.372987+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:51:13.906078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.2b","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.372981+0000","last_change":"2024-03-16T07:35:10.371877+0000","last_active":"2024-03-16T07:35:10.372981+0000","last_peered":"2024-03-16T07:35:10.372981+0000","last_clean":"2024-03-16T07:35:10.372981+0000","last_became_active":"2024-03-16T07:35:10.370864+0000","last_became_peered":"2024-03-16T07:35:10.370864+0000","last_unstale":"2024-03-16T07:35:10.372981+0000","last_undegraded":"2024-03-16T07:35:10.372981+0000","last_fullsized":"2024-03-16T07:35:10.372981+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:58:23.374090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.2a","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.374102+0000","last_change":"2024-03-16T07:35:10.373482+0000","last_active":"2024-03-16T07:35:10.374102+0000","last_peered":"2024-03-16T07:35:10.374102+0000","last_clean":"2024-03-16T07:35:10.374102+0000","last_became_active":"2024-03-16T07:35:10.368788+0000","last_became_peered":"2024-03-16T07:35:10.368788+0000","last_unstale":"2024-03-16T07:35:10.374102+0000","last_undegraded":"2024-03-16T07:35:10.374102+0000","last_fullsized":"2024-03-16T07:35:10.374102+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:10:57.661640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.29","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.369667+0000","last_change":"2024-03-16T07:35:10.367542+0000","last_active":"2024-03-16T07:35:10.369667+0000","last_peered":"2024-03-16T07:35:10.369667+0000","last_clean":"2024-03-16T07:35:10.369667+0000","last_became_active":"2024-03-16T07:35:10.366618+0000","last_became_peered":"2024-03-16T07:35:10.366618+0000","last_unstale":"2024-03-16T07:35:10.369667+0000","last_undegraded":"2024-03-16T07:35:10.369667+0000","last_fullsized":"2024-03-16T07:35:10.369667+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:52:52.660849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.28","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.370843+0000","last_change":"2024-03-16T07:35:10.369012+0000","last_active":"2024-03-16T07:35:10.370843+0000","last_peered":"2024-03-16T07:35:10.370843+0000","last_clean":"2024-03-16T07:35:10.370843+0000","last_became_active":"2024-03-16T07:35:10.368755+0000","last_became_peered":"2024-03-16T07:35:10.368755+0000","last_unstale":"2024-03-16T07:35:10.370843+0000","last_undegraded":"2024-03-16T07:35:10.370843+0000","last_fullsized":"2024-03-16T07:35:10.370843+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:39:54.636478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.27","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.365475+0000","last_change":"2024-03-16T07:35:10.364840+0000","last_active":"2024-03-16T07:35:10.365475+0000","last_peered":"2024-03-16T07:35:10.365475+0000","last_clean":"2024-03-16T07:35:10.365475+0000","last_became_active":"2024-03-16T07:35:10.364570+0000","last_became_peered":"2024-03-16T07:35:10.364570+0000","last_unstale":"2024-03-16T07:35:10.365475+0000","last_undegraded":"2024-03-16T07:35:10.365475+0000","last_fullsized":"2024-03-16T07:35:10.365475+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:17:17.510769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.26","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.361547+0000","last_change":"2024-03-16T07:35:10.359654+0000","last_active":"2024-03-16T07:35:10.361547+0000","last_peered":"2024-03-16T07:35:10.361547+0000","last_clean":"2024-03-16T07:35:10.361547+0000","last_became_active":"2024-03-16T07:35:10.359424+0000","last_became_peered":"2024-03-16T07:35:10.359424+0000","last_unstale":"2024-03-16T07:35:10.361547+0000","last_undegraded":"2024-03-16T07:35:10.361547+0000","last_fullsized":"2024-03-16T07:35:10.361547+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:00:10.806644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.25","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.370802+0000","last_change":"2024-03-16T07:35:10.368078+0000","last_active":"2024-03-16T07:35:10.370802+0000","last_peered":"2024-03-16T07:35:10.370802+0000","last_clean":"2024-03-16T07:35:10.370802+0000","last_became_active":"2024-03-16T07:35:10.367079+0000","last_became_peered":"2024-03-16T07:35:10.367079+0000","last_unstale":"2024-03-16T07:35:10.370802+0000","last_undegraded":"2024-03-16T07:35:10.370802+0000","last_fullsized":"2024-03-16T07:35:10.370802+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:57:44.085561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.24","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.365125+0000","last_change":"2024-03-16T07:35:10.363356+0000","last_active":"2024-03-16T07:35:10.365125+0000","last_peered":"2024-03-16T07:35:10.365125+0000","last_clean":"2024-03-16T07:35:10.365125+0000","last_became_active":"2024-03-16T07:35:10.362988+0000","last_became_peered":"2024-03-16T07:35:10.362988+0000","last_unstale":"2024-03-16T07:35:10.365125+0000","last_undegraded":"2024-03-16T07:35:10.365125+0000","last_fullsized":"2024-03-16T07:35:10.365125+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:37:48.442212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.23","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.363492+0000","last_change":"2024-03-16T07:35:10.359431+0000","last_active":"2024-03-16T07:35:10.363492+0000","last_peered":"2024-03-16T07:35:10.363492+0000","last_clean":"2024-03-16T07:35:10.363492+0000","last_became_active":"2024-03-16T07:35:10.358815+0000","last_became_peered":"2024-03-16T07:35:10.358815+0000","last_unstale":"2024-03-16T07:35:10.363492+0000","last_undegraded":"2024-03-16T07:35:10.363492+0000","last_fullsized":"2024-03-16T07:35:10.363492+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:24:19.910328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.22","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.373924+0000","last_change":"2024-03-16T07:35:10.372992+0000","last_active":"2024-03-16T07:35:10.373924+0000","last_peered":"2024-03-16T07:35:10.373924+0000","last_clean":"2024-03-16T07:35:10.373924+0000","last_became_active":"2024-03-16T07:35:10.371612+0000","last_became_peered":"2024-03-16T07:35:10.371612+0000","last_unstale":"2024-03-16T07:35:10.373924+0000","last_undegraded":"2024-03-16T07:35:10.373924+0000","last_fullsized":"2024-03-16T07:35:10.373924+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:07:45.602788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.21","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.373980+0000","last_change":"2024-03-16T07:35:10.372894+0000","last_active":"2024-03-16T07:35:10.373980+0000","last_peered":"2024-03-16T07:35:10.373980+0000","last_clean":"2024-03-16T07:35:10.373980+0000","last_became_active":"2024-03-16T07:35:10.372610+0000","last_became_peered":"2024-03-16T07:35:10.372610+0000","last_unstale":"2024-03-16T07:35:10.373980+0000","last_undegraded":"2024-03-16T07:35:10.373980+0000","last_fullsized":"2024-03-16T07:35:10.373980+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:44:59.550936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.20","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.372752+0000","last_change":"2024-03-16T07:35:10.366632+0000","last_active":"2024-03-16T07:35:10.372752+0000","last_peered":"2024-03-16T07:35:10.372752+0000","last_clean":"2024-03-16T07:35:10.372752+0000","last_became_active":"2024-03-16T07:35:10.365558+0000","last_became_peered":"2024-03-16T07:35:10.365558+0000","last_unstale":"2024-03-16T07:35:10.372752+0000","last_undegraded":"2024-03-16T07:35:10.372752+0000","last_fullsized":"2024-03-16T07:35:10.372752+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:03:06.737166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.1e","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.372682+0000","last_change":"2024-03-16T07:35:10.371872+0000","last_active":"2024-03-16T07:35:10.372682+0000","last_peered":"2024-03-16T07:35:10.372682+0000","last_clean":"2024-03-16T07:35:10.372682+0000","last_became_active":"2024-03-16T07:35:10.371262+0000","last_became_peered":"2024-03-16T07:35:10.371262+0000","last_unstale":"2024-03-16T07:35:10.372682+0000","last_undegraded":"2024-03-16T07:35:10.372682+0000","last_fullsized":"2024-03-16T07:35:10.372682+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:18:48.673892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.1f","version":"167'4","reported_seq":16,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.670396+0000","last_change":"2024-03-16T07:35:09.679357+0000","last_active":"2024-03-16T07:35:10.670396+0000","last_peered":"2024-03-16T07:35:10.670396+0000","last_clean":"2024-03-16T07:35:10.670396+0000","last_became_active":"2024-03-16T07:35:09.679104+0000","last_became_peered":"2024-03-16T07:35:09.679104+0000","last_unstale":"2024-03-16T07:35:10.670396+0000","last_undegraded":"2024-03-16T07:35:10.670396+0000","last_fullsized":"2024-03-16T07:35:10.670396+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_clean_scrub_stamp":"2024-03-16T07:35:08.655627+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:44:40.502257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.1f","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.365150+0000","last_change":"2024-03-16T07:35:10.362327+0000","last_active":"2024-03-16T07:35:10.365150+0000","last_peered":"2024-03-16T07:35:10.365150+0000","last_clean":"2024-03-16T07:35:10.365150+0000","last_became_active":"2024-03-16T07:35:10.361296+0000","last_became_peered":"2024-03-16T07:35:10.361296+0000","last_unstale":"2024-03-16T07:35:10.365150+0000","last_undegraded":"2024-03-16T07:35:10.365150+0000","last_fullsized":"2024-03-16T07:35:10.365150+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:19:05.261800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.1e","version":"167'1","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.668890+0000","last_change":"2024-03-16T07:35:09.675846+0000","last_active":"2024-03-16T07:35:10.668890+0000","last_peered":"2024-03-16T07:35:10.668890+0000","last_clean":"2024-03-16T07:35:10.668890+0000","last_became_active":"2024-03-16T07:35:09.675457+0000","last_became_peered":"2024-03-16T07:35:09.675457+0000","last_unstale":"2024-03-16T07:35:10.668890+0000","last_undegraded":"2024-03-16T07:35:10.668890+0000","last_fullsized":"2024-03-16T07:35:10.668890+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_clean_scrub_stamp":"2024-03-16T07:35:08.655627+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:52:18.799704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.1d","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.364258+0000","last_change":"2024-03-16T07:35:10.361899+0000","last_active":"2024-03-16T07:35:10.364258+0000","last_peered":"2024-03-16T07:35:10.364258+0000","last_clean":"2024-03-16T07:35:10.364258+0000","last_became_active":"2024-03-16T07:35:10.361003+0000","last_became_peered":"2024-03-16T07:35:10.361003+0000","last_unstale":"2024-03-16T07:35:10.364258+0000","last_undegraded":"2024-03-16T07:35:10.364258+0000","last_fullsized":"2024-03-16T07:35:10.364258+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:01:31.614335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.1c","version":"167'2","reported_seq":14,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.670036+0000","last_change":"2024-03-16T07:35:09.683142+0000","last_active":"2024-03-16T07:35:10.670036+0000","last_peered":"2024-03-16T07:35:10.670036+0000","last_clean":"2024-03-16T07:35:10.670036+0000","last_became_active":"2024-03-16T07:35:09.682887+0000","last_became_peered":"2024-03-16T07:35:09.682887+0000","last_unstale":"2024-03-16T07:35:10.670036+0000","last_undegraded":"2024-03-16T07:35:10.670036+0000","last_fullsized":"2024-03-16T07:35:10.670036+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_clean_scrub_stamp":"2024-03-16T07:35:08.655627+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:07:12.557490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.1a","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.373486+0000","last_change":"2024-03-16T07:35:10.372758+0000","last_active":"2024-03-16T07:35:10.373486+0000","last_peered":"2024-03-16T07:35:10.373486+0000","last_clean":"2024-03-16T07:35:10.373486+0000","last_became_active":"2024-03-16T07:35:10.370443+0000","last_became_peered":"2024-03-16T07:35:10.370443+0000","last_unstale":"2024-03-16T07:35:10.373486+0000","last_undegraded":"2024-03-16T07:35:10.373486+0000","last_fullsized":"2024-03-16T07:35:10.373486+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:32:16.079048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.1b","version":"167'1","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.670126+0000","last_change":"2024-03-16T07:35:09.686706+0000","last_active":"2024-03-16T07:35:10.670126+0000","last_peered":"2024-03-16T07:35:10.670126+0000","last_clean":"2024-03-16T07:35:10.670126+0000","last_became_active":"2024-03-16T07:35:09.686429+0000","last_became_peered":"2024-03-16T07:35:09.686429+0000","last_unstale":"2024-03-16T07:35:10.670126+0000","last_undegraded":"2024-03-16T07:35:10.670126+0000","last_fullsized":"2024-03-16T07:35:10.670126+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_clean_scrub_stamp":"2024-03-16T07:35:08.655627+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:52:03.120308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.1b","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.373015+0000","last_change":"2024-03-16T07:35:10.372111+0000","last_active":"2024-03-16T07:35:10.373015+0000","last_peered":"2024-03-16T07:35:10.373015+0000","last_clean":"2024-03-16T07:35:10.373015+0000","last_became_active":"2024-03-16T07:35:10.370526+0000","last_became_peered":"2024-03-16T07:35:10.370526+0000","last_unstale":"2024-03-16T07:35:10.373015+0000","last_undegraded":"2024-03-16T07:35:10.373015+0000","last_fullsized":"2024-03-16T07:35:10.373015+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:00:31.515809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.1a","version":"167'1","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.670626+0000","last_change":"2024-03-16T07:35:09.674506+0000","last_active":"2024-03-16T07:35:10.670626+0000","last_peered":"2024-03-16T07:35:10.670626+0000","last_clean":"2024-03-16T07:35:10.670626+0000","last_became_active":"2024-03-16T07:35:09.674254+0000","last_became_peered":"2024-03-16T07:35:09.674254+0000","last_unstale":"2024-03-16T07:35:10.670626+0000","last_undegraded":"2024-03-16T07:35:10.670626+0000","last_fullsized":"2024-03-16T07:35:10.670626+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_clean_scrub_stamp":"2024-03-16T07:35:08.655627+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:19:04.260787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.18","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.366901+0000","last_change":"2024-03-16T07:35:10.363833+0000","last_active":"2024-03-16T07:35:10.366901+0000","last_peered":"2024-03-16T07:35:10.366901+0000","last_clean":"2024-03-16T07:35:10.366901+0000","last_became_active":"2024-03-16T07:35:10.363037+0000","last_became_peered":"2024-03-16T07:35:10.363037+0000","last_unstale":"2024-03-16T07:35:10.366901+0000","last_undegraded":"2024-03-16T07:35:10.366901+0000","last_fullsized":"2024-03-16T07:35:10.366901+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:01:23.258987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.19","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.349681+0000","last_change":"2024-03-16T07:35:09.684877+0000","last_active":"2024-03-16T07:35:10.349681+0000","last_peered":"2024-03-16T07:35:10.349681+0000","last_clean":"2024-03-16T07:35:10.349681+0000","last_became_active":"2024-03-16T07:35:09.684558+0000","last_became_peered":"2024-03-16T07:35:09.684558+0000","last_unstale":"2024-03-16T07:35:10.349681+0000","last_undegraded":"2024-03-16T07:35:10.349681+0000","last_fullsized":"2024-03-16T07:35:10.349681+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_clean_scrub_stamp":"2024-03-16T07:35:08.655627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:18:02.438640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.19","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.369648+0000","last_change":"2024-03-16T07:35:10.367160+0000","last_active":"2024-03-16T07:35:10.369648+0000","last_peered":"2024-03-16T07:35:10.369648+0000","last_clean":"2024-03-16T07:35:10.369648+0000","last_became_active":"2024-03-16T07:35:10.365971+0000","last_became_peered":"2024-03-16T07:35:10.365971+0000","last_unstale":"2024-03-16T07:35:10.369648+0000","last_undegraded":"2024-03-16T07:35:10.369648+0000","last_fullsized":"2024-03-16T07:35:10.369648+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:26:42.036511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.18","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.349842+0000","last_change":"2024-03-16T07:35:09.684870+0000","last_active":"2024-03-16T07:35:10.349842+0000","last_peered":"2024-03-16T07:35:10.349842+0000","last_clean":"2024-03-16T07:35:10.349842+0000","last_became_active":"2024-03-16T07:35:09.684583+0000","last_became_peered":"2024-03-16T07:35:09.684583+0000","last_unstale":"2024-03-16T07:35:10.349842+0000","last_undegraded":"2024-03-16T07:35:10.349842+0000","last_fullsized":"2024-03-16T07:35:10.349842+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_clean_scrub_stamp":"2024-03-16T07:35:08.655627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:36:37.264021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.16","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.373941+0000","last_change":"2024-03-16T07:35:10.372562+0000","last_active":"2024-03-16T07:35:10.373941+0000","last_peered":"2024-03-16T07:35:10.373941+0000","last_clean":"2024-03-16T07:35:10.373941+0000","last_became_active":"2024-03-16T07:35:10.372187+0000","last_became_peered":"2024-03-16T07:35:10.372187+0000","last_unstale":"2024-03-16T07:35:10.373941+0000","last_undegraded":"2024-03-16T07:35:10.373941+0000","last_fullsized":"2024-03-16T07:35:10.373941+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:24:30.491794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.17","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.356228+0000","last_change":"2024-03-16T07:35:09.680665+0000","last_active":"2024-03-16T07:35:10.356228+0000","last_peered":"2024-03-16T07:35:10.356228+0000","last_clean":"2024-03-16T07:35:10.356228+0000","last_became_active":"2024-03-16T07:35:09.680284+0000","last_became_peered":"2024-03-16T07:35:09.680284+0000","last_unstale":"2024-03-16T07:35:10.356228+0000","last_undegraded":"2024-03-16T07:35:10.356228+0000","last_fullsized":"2024-03-16T07:35:10.356228+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_clean_scrub_stamp":"2024-03-16T07:35:08.655627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:44:57.045499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.17","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.360829+0000","last_change":"2024-03-16T07:35:10.359658+0000","last_active":"2024-03-16T07:35:10.360829+0000","last_peered":"2024-03-16T07:35:10.360829+0000","last_clean":"2024-03-16T07:35:10.360829+0000","last_became_active":"2024-03-16T07:35:10.359392+0000","last_became_peered":"2024-03-16T07:35:10.359392+0000","last_unstale":"2024-03-16T07:35:10.360829+0000","last_undegraded":"2024-03-16T07:35:10.360829+0000","last_fullsized":"2024-03-16T07:35:10.360829+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:07:30.797294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.16","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.355912+0000","last_change":"2024-03-16T07:35:09.683330+0000","last_active":"2024-03-16T07:35:10.355912+0000","last_peered":"2024-03-16T07:35:10.355912+0000","last_clean":"2024-03-16T07:35:10.355912+0000","last_became_active":"2024-03-16T07:35:09.682629+0000","last_became_peered":"2024-03-16T07:35:09.682629+0000","last_unstale":"2024-03-16T07:35:10.355912+0000","last_undegraded":"2024-03-16T07:35:10.355912+0000","last_fullsized":"2024-03-16T07:35:10.355912+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_clean_scrub_stamp":"2024-03-16T07:35:08.655627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:20:13.455330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.14","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.361631+0000","last_change":"2024-03-16T07:35:10.359135+0000","last_active":"2024-03-16T07:35:10.361631+0000","last_peered":"2024-03-16T07:35:10.361631+0000","last_clean":"2024-03-16T07:35:10.361631+0000","last_became_active":"2024-03-16T07:35:10.358882+0000","last_became_peered":"2024-03-16T07:35:10.358882+0000","last_unstale":"2024-03-16T07:35:10.361631+0000","last_undegraded":"2024-03-16T07:35:10.361631+0000","last_fullsized":"2024-03-16T07:35:10.361631+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:01:29.326615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.15","version":"167'3","reported_seq":15,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.670806+0000","last_change":"2024-03-16T07:35:09.670265+0000","last_active":"2024-03-16T07:35:10.670806+0000","last_peered":"2024-03-16T07:35:10.670806+0000","last_clean":"2024-03-16T07:35:10.670806+0000","last_became_active":"2024-03-16T07:35:09.670015+0000","last_became_peered":"2024-03-16T07:35:09.670015+0000","last_unstale":"2024-03-16T07:35:10.670806+0000","last_undegraded":"2024-03-16T07:35:10.670806+0000","last_fullsized":"2024-03-16T07:35:10.670806+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_clean_scrub_stamp":"2024-03-16T07:35:08.655627+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:00:24.230346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.15","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.372406+0000","last_change":"2024-03-16T07:35:10.368083+0000","last_active":"2024-03-16T07:35:10.372406+0000","last_peered":"2024-03-16T07:35:10.372406+0000","last_clean":"2024-03-16T07:35:10.372406+0000","last_became_active":"2024-03-16T07:35:10.365110+0000","last_became_peered":"2024-03-16T07:35:10.365110+0000","last_unstale":"2024-03-16T07:35:10.372406+0000","last_undegraded":"2024-03-16T07:35:10.372406+0000","last_fullsized":"2024-03-16T07:35:10.372406+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:00:12.716312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.14","version":"167'6","reported_seq":18,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.672721+0000","last_change":"2024-03-16T07:35:09.682373+0000","last_active":"2024-03-16T07:35:10.672721+0000","last_peered":"2024-03-16T07:35:10.672721+0000","last_clean":"2024-03-16T07:35:10.672721+0000","last_became_active":"2024-03-16T07:35:09.681726+0000","last_became_peered":"2024-03-16T07:35:09.681726+0000","last_unstale":"2024-03-16T07:35:10.672721+0000","last_undegraded":"2024-03-16T07:35:10.672721+0000","last_fullsized":"2024-03-16T07:35:10.672721+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_clean_scrub_stamp":"2024-03-16T07:35:08.655627+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:30:16.270717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.12","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.373903+0000","last_change":"2024-03-16T07:35:10.372982+0000","last_active":"2024-03-16T07:35:10.373903+0000","last_peered":"2024-03-16T07:35:10.373903+0000","last_clean":"2024-03-16T07:35:10.373903+0000","last_became_active":"2024-03-16T07:35:10.371039+0000","last_became_peered":"2024-03-16T07:35:10.371039+0000","last_unstale":"2024-03-16T07:35:10.373903+0000","last_undegraded":"2024-03-16T07:35:10.373903+0000","last_fullsized":"2024-03-16T07:35:10.373903+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:38:14.048948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.13","version":"167'2","reported_seq":14,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.670044+0000","last_change":"2024-03-16T07:35:09.685238+0000","last_active":"2024-03-16T07:35:10.670044+0000","last_peered":"2024-03-16T07:35:10.670044+0000","last_clean":"2024-03-16T07:35:10.670044+0000","last_became_active":"2024-03-16T07:35:09.684483+0000","last_became_peered":"2024-03-16T07:35:09.684483+0000","last_unstale":"2024-03-16T07:35:10.670044+0000","last_undegraded":"2024-03-16T07:35:10.670044+0000","last_fullsized":"2024-03-16T07:35:10.670044+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_clean_scrub_stamp":"2024-03-16T07:35:08.655627+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:38:00.899911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.13","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.371971+0000","last_change":"2024-03-16T07:35:10.368332+0000","last_active":"2024-03-16T07:35:10.371971+0000","last_peered":"2024-03-16T07:35:10.371971+0000","last_clean":"2024-03-16T07:35:10.371971+0000","last_became_active":"2024-03-16T07:35:10.366791+0000","last_became_peered":"2024-03-16T07:35:10.366791+0000","last_unstale":"2024-03-16T07:35:10.371971+0000","last_undegraded":"2024-03-16T07:35:10.371971+0000","last_fullsized":"2024-03-16T07:35:10.371971+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:19:12.330824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.12","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.355574+0000","last_change":"2024-03-16T07:35:09.682025+0000","last_active":"2024-03-16T07:35:10.355574+0000","last_peered":"2024-03-16T07:35:10.355574+0000","last_clean":"2024-03-16T07:35:10.355574+0000","last_became_active":"2024-03-16T07:35:09.681598+0000","last_became_peered":"2024-03-16T07:35:09.681598+0000","last_unstale":"2024-03-16T07:35:10.355574+0000","last_undegraded":"2024-03-16T07:35:10.355574+0000","last_fullsized":"2024-03-16T07:35:10.355574+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_clean_scrub_stamp":"2024-03-16T07:35:08.655627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:11:43.037273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.10","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.366019+0000","last_change":"2024-03-16T07:35:10.363831+0000","last_active":"2024-03-16T07:35:10.366019+0000","last_peered":"2024-03-16T07:35:10.366019+0000","last_clean":"2024-03-16T07:35:10.366019+0000","last_became_active":"2024-03-16T07:35:10.363235+0000","last_became_peered":"2024-03-16T07:35:10.363235+0000","last_unstale":"2024-03-16T07:35:10.366019+0000","last_undegraded":"2024-03-16T07:35:10.366019+0000","last_fullsized":"2024-03-16T07:35:10.366019+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:01:16.774365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.11","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.357568+0000","last_change":"2024-03-16T07:35:09.676637+0000","last_active":"2024-03-16T07:35:10.357568+0000","last_peered":"2024-03-16T07:35:10.357568+0000","last_clean":"2024-03-16T07:35:10.357568+0000","last_became_active":"2024-03-16T07:35:09.676175+0000","last_became_peered":"2024-03-16T07:35:09.676175+0000","last_unstale":"2024-03-16T07:35:10.357568+0000","last_undegraded":"2024-03-16T07:35:10.357568+0000","last_fullsized":"2024-03-16T07:35:10.357568+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_clean_scrub_stamp":"2024-03-16T07:35:08.655627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:15:03.991142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.11","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.372912+0000","last_change":"2024-03-16T07:35:10.371588+0000","last_active":"2024-03-16T07:35:10.372912+0000","last_peered":"2024-03-16T07:35:10.372912+0000","last_clean":"2024-03-16T07:35:10.372912+0000","last_became_active":"2024-03-16T07:35:10.368385+0000","last_became_peered":"2024-03-16T07:35:10.368385+0000","last_unstale":"2024-03-16T07:35:10.372912+0000","last_undegraded":"2024-03-16T07:35:10.372912+0000","last_fullsized":"2024-03-16T07:35:10.372912+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:22:07.177422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.10","version":"167'8","reported_seq":20,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.671653+0000","last_change":"2024-03-16T07:35:09.678042+0000","last_active":"2024-03-16T07:35:10.671653+0000","last_peered":"2024-03-16T07:35:10.671653+0000","last_clean":"2024-03-16T07:35:10.671653+0000","last_became_active":"2024-03-16T07:35:09.677738+0000","last_became_peered":"2024-03-16T07:35:09.677738+0000","last_unstale":"2024-03-16T07:35:10.671653+0000","last_undegraded":"2024-03-16T07:35:10.671653+0000","last_fullsized":"2024-03-16T07:35:10.671653+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_clean_scrub_stamp":"2024-03-16T07:35:08.655627+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:07:38.696095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.e","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.362250+0000","last_change":"2024-03-16T07:35:10.360336+0000","last_active":"2024-03-16T07:35:10.362250+0000","last_peered":"2024-03-16T07:35:10.362250+0000","last_clean":"2024-03-16T07:35:10.362250+0000","last_became_active":"2024-03-16T07:35:10.360103+0000","last_became_peered":"2024-03-16T07:35:10.360103+0000","last_unstale":"2024-03-16T07:35:10.362250+0000","last_undegraded":"2024-03-16T07:35:10.362250+0000","last_fullsized":"2024-03-16T07:35:10.362250+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:18:49.792627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.f","version":"167'1","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.669125+0000","last_change":"2024-03-16T07:35:09.680840+0000","last_active":"2024-03-16T07:35:10.669125+0000","last_peered":"2024-03-16T07:35:10.669125+0000","last_clean":"2024-03-16T07:35:10.669125+0000","last_became_active":"2024-03-16T07:35:09.679859+0000","last_became_peered":"2024-03-16T07:35:09.679859+0000","last_unstale":"2024-03-16T07:35:10.669125+0000","last_undegraded":"2024-03-16T07:35:10.669125+0000","last_fullsized":"2024-03-16T07:35:10.669125+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_clean_scrub_stamp":"2024-03-16T07:35:08.655627+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:46:33.709266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.f","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.373040+0000","last_change":"2024-03-16T07:35:10.370056+0000","last_active":"2024-03-16T07:35:10.373040+0000","last_peered":"2024-03-16T07:35:10.373040+0000","last_clean":"2024-03-16T07:35:10.373040+0000","last_became_active":"2024-03-16T07:35:10.369815+0000","last_became_peered":"2024-03-16T07:35:10.369815+0000","last_unstale":"2024-03-16T07:35:10.373040+0000","last_undegraded":"2024-03-16T07:35:10.373040+0000","last_fullsized":"2024-03-16T07:35:10.373040+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:33:06.548770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.e","version":"167'2","reported_seq":14,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.669563+0000","last_change":"2024-03-16T07:35:09.683036+0000","last_active":"2024-03-16T07:35:10.669563+0000","last_peered":"2024-03-16T07:35:10.669563+0000","last_clean":"2024-03-16T07:35:10.669563+0000","last_became_active":"2024-03-16T07:35:09.682652+0000","last_became_peered":"2024-03-16T07:35:09.682652+0000","last_unstale":"2024-03-16T07:35:10.669563+0000","last_undegraded":"2024-03-16T07:35:10.669563+0000","last_fullsized":"2024-03-16T07:35:10.669563+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_clean_scrub_stamp":"2024-03-16T07:35:08.655627+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:29:41.213080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.c","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.373473+0000","last_change":"2024-03-16T07:35:10.372880+0000","last_active":"2024-03-16T07:35:10.373473+0000","last_peered":"2024-03-16T07:35:10.373473+0000","last_clean":"2024-03-16T07:35:10.373473+0000","last_became_active":"2024-03-16T07:35:10.368709+0000","last_became_peered":"2024-03-16T07:35:10.368709+0000","last_unstale":"2024-03-16T07:35:10.373473+0000","last_undegraded":"2024-03-16T07:35:10.373473+0000","last_fullsized":"2024-03-16T07:35:10.373473+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:35:44.276859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.d","version":"167'1","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.671266+0000","last_change":"2024-03-16T07:35:09.674601+0000","last_active":"2024-03-16T07:35:10.671266+0000","last_peered":"2024-03-16T07:35:10.671266+0000","last_clean":"2024-03-16T07:35:10.671266+0000","last_became_active":"2024-03-16T07:35:09.674335+0000","last_became_peered":"2024-03-16T07:35:09.674335+0000","last_unstale":"2024-03-16T07:35:10.671266+0000","last_undegraded":"2024-03-16T07:35:10.671266+0000","last_fullsized":"2024-03-16T07:35:10.671266+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_clean_scrub_stamp":"2024-03-16T07:35:08.655627+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:01:15.773351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.d","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.362449+0000","last_change":"2024-03-16T07:35:10.361177+0000","last_active":"2024-03-16T07:35:10.362449+0000","last_peered":"2024-03-16T07:35:10.362449+0000","last_clean":"2024-03-16T07:35:10.362449+0000","last_became_active":"2024-03-16T07:35:10.360525+0000","last_became_peered":"2024-03-16T07:35:10.360525+0000","last_unstale":"2024-03-16T07:35:10.362449+0000","last_undegraded":"2024-03-16T07:35:10.362449+0000","last_fullsized":"2024-03-16T07:35:10.362449+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:16:56.157037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.c","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.358001+0000","last_change":"2024-03-16T07:35:09.675575+0000","last_active":"2024-03-16T07:35:10.358001+0000","last_peered":"2024-03-16T07:35:10.358001+0000","last_clean":"2024-03-16T07:35:10.358001+0000","last_became_active":"2024-03-16T07:35:09.675269+0000","last_became_peered":"2024-03-16T07:35:09.675269+0000","last_unstale":"2024-03-16T07:35:10.358001+0000","last_undegraded":"2024-03-16T07:35:10.358001+0000","last_fullsized":"2024-03-16T07:35:10.358001+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_clean_scrub_stamp":"2024-03-16T07:35:08.655627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:57:44.612807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.a","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.375244+0000","last_change":"2024-03-16T07:35:10.374978+0000","last_active":"2024-03-16T07:35:10.375244+0000","last_peered":"2024-03-16T07:35:10.375244+0000","last_clean":"2024-03-16T07:35:10.375244+0000","last_became_active":"2024-03-16T07:35:10.374760+0000","last_became_peered":"2024-03-16T07:35:10.374760+0000","last_unstale":"2024-03-16T07:35:10.375244+0000","last_undegraded":"2024-03-16T07:35:10.375244+0000","last_fullsized":"2024-03-16T07:35:10.375244+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:11:56.569448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.b","version":"167'2","reported_seq":14,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.671515+0000","last_change":"2024-03-16T07:35:09.676930+0000","last_active":"2024-03-16T07:35:10.671515+0000","last_peered":"2024-03-16T07:35:10.671515+0000","last_clean":"2024-03-16T07:35:10.671515+0000","last_became_active":"2024-03-16T07:35:09.676583+0000","last_became_peered":"2024-03-16T07:35:09.676583+0000","last_unstale":"2024-03-16T07:35:10.671515+0000","last_undegraded":"2024-03-16T07:35:10.671515+0000","last_fullsized":"2024-03-16T07:35:10.671515+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_clean_scrub_stamp":"2024-03-16T07:35:08.655627+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:37:47.441198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.b","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.363519+0000","last_change":"2024-03-16T07:35:10.359641+0000","last_active":"2024-03-16T07:35:10.363519+0000","last_peered":"2024-03-16T07:35:10.363519+0000","last_clean":"2024-03-16T07:35:10.363519+0000","last_became_active":"2024-03-16T07:35:10.359195+0000","last_became_peered":"2024-03-16T07:35:10.359195+0000","last_unstale":"2024-03-16T07:35:10.363519+0000","last_undegraded":"2024-03-16T07:35:10.363519+0000","last_fullsized":"2024-03-16T07:35:10.363519+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:56:25.424558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.a","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.348258+0000","last_change":"2024-03-16T07:35:09.684320+0000","last_active":"2024-03-16T07:35:10.348258+0000","last_peered":"2024-03-16T07:35:10.348258+0000","last_clean":"2024-03-16T07:35:10.348258+0000","last_became_active":"2024-03-16T07:35:09.683895+0000","last_became_peered":"2024-03-16T07:35:09.683895+0000","last_unstale":"2024-03-16T07:35:10.348258+0000","last_undegraded":"2024-03-16T07:35:10.348258+0000","last_fullsized":"2024-03-16T07:35:10.348258+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_clean_scrub_stamp":"2024-03-16T07:35:08.655627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:49:10.728594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.8","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.365999+0000","last_change":"2024-03-16T07:35:10.363635+0000","last_active":"2024-03-16T07:35:10.365999+0000","last_peered":"2024-03-16T07:35:10.365999+0000","last_clean":"2024-03-16T07:35:10.365999+0000","last_became_active":"2024-03-16T07:35:10.362705+0000","last_became_peered":"2024-03-16T07:35:10.362705+0000","last_unstale":"2024-03-16T07:35:10.365999+0000","last_undegraded":"2024-03-16T07:35:10.365999+0000","last_fullsized":"2024-03-16T07:35:10.365999+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:00:25.231360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.9","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.358315+0000","last_change":"2024-03-16T07:35:09.682153+0000","last_active":"2024-03-16T07:35:10.358315+0000","last_peered":"2024-03-16T07:35:10.358315+0000","last_clean":"2024-03-16T07:35:10.358315+0000","last_became_active":"2024-03-16T07:35:09.681886+0000","last_became_peered":"2024-03-16T07:35:09.681886+0000","last_unstale":"2024-03-16T07:35:10.358315+0000","last_undegraded":"2024-03-16T07:35:10.358315+0000","last_fullsized":"2024-03-16T07:35:10.358315+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_clean_scrub_stamp":"2024-03-16T07:35:08.655627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:45:44.039500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.9","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.369626+0000","last_change":"2024-03-16T07:35:10.366866+0000","last_active":"2024-03-16T07:35:10.369626+0000","last_peered":"2024-03-16T07:35:10.369626+0000","last_clean":"2024-03-16T07:35:10.369626+0000","last_became_active":"2024-03-16T07:35:10.365511+0000","last_became_peered":"2024-03-16T07:35:10.365511+0000","last_unstale":"2024-03-16T07:35:10.369626+0000","last_undegraded":"2024-03-16T07:35:10.369626+0000","last_fullsized":"2024-03-16T07:35:10.369626+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:47:52.138505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.8","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.355003+0000","last_change":"2024-03-16T07:35:09.678924+0000","last_active":"2024-03-16T07:35:10.355003+0000","last_peered":"2024-03-16T07:35:10.355003+0000","last_clean":"2024-03-16T07:35:10.355003+0000","last_became_active":"2024-03-16T07:35:09.678666+0000","last_became_peered":"2024-03-16T07:35:09.678666+0000","last_unstale":"2024-03-16T07:35:10.355003+0000","last_undegraded":"2024-03-16T07:35:10.355003+0000","last_fullsized":"2024-03-16T07:35:10.355003+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_clean_scrub_stamp":"2024-03-16T07:35:08.655627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:07:52.268339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.6","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.373369+0000","last_change":"2024-03-16T07:35:10.371595+0000","last_active":"2024-03-16T07:35:10.373369+0000","last_peered":"2024-03-16T07:35:10.373369+0000","last_clean":"2024-03-16T07:35:10.373369+0000","last_became_active":"2024-03-16T07:35:10.369883+0000","last_became_peered":"2024-03-16T07:35:10.369883+0000","last_unstale":"2024-03-16T07:35:10.373369+0000","last_undegraded":"2024-03-16T07:35:10.373369+0000","last_fullsized":"2024-03-16T07:35:10.373369+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:09:55.586365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.7","version":"167'2","reported_seq":14,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.671573+0000","last_change":"2024-03-16T07:35:09.675559+0000","last_active":"2024-03-16T07:35:10.671573+0000","last_peered":"2024-03-16T07:35:10.671573+0000","last_clean":"2024-03-16T07:35:10.671573+0000","last_became_active":"2024-03-16T07:35:09.675177+0000","last_became_peered":"2024-03-16T07:35:09.675177+0000","last_unstale":"2024-03-16T07:35:10.671573+0000","last_undegraded":"2024-03-16T07:35:10.671573+0000","last_fullsized":"2024-03-16T07:35:10.671573+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_clean_scrub_stamp":"2024-03-16T07:35:08.655627+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:01:22.257974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.7","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.369542+0000","last_change":"2024-03-16T07:35:10.365677+0000","last_active":"2024-03-16T07:35:10.369542+0000","last_peered":"2024-03-16T07:35:10.369542+0000","last_clean":"2024-03-16T07:35:10.369542+0000","last_became_active":"2024-03-16T07:35:10.364776+0000","last_became_peered":"2024-03-16T07:35:10.364776+0000","last_unstale":"2024-03-16T07:35:10.369542+0000","last_undegraded":"2024-03-16T07:35:10.369542+0000","last_fullsized":"2024-03-16T07:35:10.369542+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:09:47.571809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.6","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.357971+0000","last_change":"2024-03-16T07:35:09.675754+0000","last_active":"2024-03-16T07:35:10.357971+0000","last_peered":"2024-03-16T07:35:10.357971+0000","last_clean":"2024-03-16T07:35:10.357971+0000","last_became_active":"2024-03-16T07:35:09.675073+0000","last_became_peered":"2024-03-16T07:35:09.675073+0000","last_unstale":"2024-03-16T07:35:10.357971+0000","last_undegraded":"2024-03-16T07:35:10.357971+0000","last_fullsized":"2024-03-16T07:35:10.357971+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_clean_scrub_stamp":"2024-03-16T07:35:08.655627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:13:12.288432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.4","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.372845+0000","last_change":"2024-03-16T07:35:10.371080+0000","last_active":"2024-03-16T07:35:10.372845+0000","last_peered":"2024-03-16T07:35:10.372845+0000","last_clean":"2024-03-16T07:35:10.372845+0000","last_became_active":"2024-03-16T07:35:10.370374+0000","last_became_peered":"2024-03-16T07:35:10.370374+0000","last_unstale":"2024-03-16T07:35:10.372845+0000","last_undegraded":"2024-03-16T07:35:10.372845+0000","last_fullsized":"2024-03-16T07:35:10.372845+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:48:51.633616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.5","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.349177+0000","last_change":"2024-03-16T07:35:09.685196+0000","last_active":"2024-03-16T07:35:10.349177+0000","last_peered":"2024-03-16T07:35:10.349177+0000","last_clean":"2024-03-16T07:35:10.349177+0000","last_became_active":"2024-03-16T07:35:09.684449+0000","last_became_peered":"2024-03-16T07:35:09.684449+0000","last_unstale":"2024-03-16T07:35:10.349177+0000","last_undegraded":"2024-03-16T07:35:10.349177+0000","last_fullsized":"2024-03-16T07:35:10.349177+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_clean_scrub_stamp":"2024-03-16T07:35:08.655627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:13:04.761117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.5","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.370860+0000","last_change":"2024-03-16T07:35:10.369204+0000","last_active":"2024-03-16T07:35:10.370860+0000","last_peered":"2024-03-16T07:35:10.370860+0000","last_clean":"2024-03-16T07:35:10.370860+0000","last_became_active":"2024-03-16T07:35:10.368924+0000","last_became_peered":"2024-03-16T07:35:10.368924+0000","last_unstale":"2024-03-16T07:35:10.370860+0000","last_undegraded":"2024-03-16T07:35:10.370860+0000","last_fullsized":"2024-03-16T07:35:10.370860+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:49:26.412783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.4","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.356505+0000","last_change":"2024-03-16T07:35:09.677063+0000","last_active":"2024-03-16T07:35:10.356505+0000","last_peered":"2024-03-16T07:35:10.356505+0000","last_clean":"2024-03-16T07:35:10.356505+0000","last_became_active":"2024-03-16T07:35:09.676808+0000","last_became_peered":"2024-03-16T07:35:09.676808+0000","last_unstale":"2024-03-16T07:35:10.356505+0000","last_undegraded":"2024-03-16T07:35:10.356505+0000","last_fullsized":"2024-03-16T07:35:10.356505+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_clean_scrub_stamp":"2024-03-16T07:35:08.655627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:10:48.141606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.2","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.373621+0000","last_change":"2024-03-16T07:35:10.369686+0000","last_active":"2024-03-16T07:35:10.373621+0000","last_peered":"2024-03-16T07:35:10.373621+0000","last_clean":"2024-03-16T07:35:10.373621+0000","last_became_active":"2024-03-16T07:35:10.369421+0000","last_became_peered":"2024-03-16T07:35:10.369421+0000","last_unstale":"2024-03-16T07:35:10.373621+0000","last_undegraded":"2024-03-16T07:35:10.373621+0000","last_fullsized":"2024-03-16T07:35:10.373621+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:22:29.675922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.3","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.356006+0000","last_change":"2024-03-16T07:35:09.681585+0000","last_active":"2024-03-16T07:35:10.356006+0000","last_peered":"2024-03-16T07:35:10.356006+0000","last_clean":"2024-03-16T07:35:10.356006+0000","last_became_active":"2024-03-16T07:35:09.681312+0000","last_became_peered":"2024-03-16T07:35:09.681312+0000","last_unstale":"2024-03-16T07:35:10.356006+0000","last_undegraded":"2024-03-16T07:35:10.356006+0000","last_fullsized":"2024-03-16T07:35:10.356006+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_clean_scrub_stamp":"2024-03-16T07:35:08.655627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:33:35.043407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.3","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.372945+0000","last_change":"2024-03-16T07:35:10.369293+0000","last_active":"2024-03-16T07:35:10.372945+0000","last_peered":"2024-03-16T07:35:10.372945+0000","last_clean":"2024-03-16T07:35:10.372945+0000","last_became_active":"2024-03-16T07:35:10.368043+0000","last_became_peered":"2024-03-16T07:35:10.368043+0000","last_unstale":"2024-03-16T07:35:10.372945+0000","last_undegraded":"2024-03-16T07:35:10.372945+0000","last_fullsized":"2024-03-16T07:35:10.372945+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:25:59.981225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.2","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.355716+0000","last_change":"2024-03-16T07:35:09.681598+0000","last_active":"2024-03-16T07:35:10.355716+0000","last_peered":"2024-03-16T07:35:10.355716+0000","last_clean":"2024-03-16T07:35:10.355716+0000","last_became_active":"2024-03-16T07:35:09.681337+0000","last_became_peered":"2024-03-16T07:35:09.681337+0000","last_unstale":"2024-03-16T07:35:10.355716+0000","last_undegraded":"2024-03-16T07:35:10.355716+0000","last_fullsized":"2024-03-16T07:35:10.355716+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_clean_scrub_stamp":"2024-03-16T07:35:08.655627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:01:16.766400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.0","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.372778+0000","last_change":"2024-03-16T07:35:10.367769+0000","last_active":"2024-03-16T07:35:10.372778+0000","last_peered":"2024-03-16T07:35:10.372778+0000","last_clean":"2024-03-16T07:35:10.372778+0000","last_became_active":"2024-03-16T07:35:10.367452+0000","last_became_peered":"2024-03-16T07:35:10.367452+0000","last_unstale":"2024-03-16T07:35:10.372778+0000","last_undegraded":"2024-03-16T07:35:10.372778+0000","last_fullsized":"2024-03-16T07:35:10.372778+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:50:39.138805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.1","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.357711+0000","last_change":"2024-03-16T07:35:09.676420+0000","last_active":"2024-03-16T07:35:10.357711+0000","last_peered":"2024-03-16T07:35:10.357711+0000","last_clean":"2024-03-16T07:35:10.357711+0000","last_became_active":"2024-03-16T07:35:09.675843+0000","last_became_peered":"2024-03-16T07:35:09.675843+0000","last_unstale":"2024-03-16T07:35:10.357711+0000","last_undegraded":"2024-03-16T07:35:10.357711+0000","last_fullsized":"2024-03-16T07:35:10.357711+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_clean_scrub_stamp":"2024-03-16T07:35:08.655627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:59:26.600725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.1","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.364228+0000","last_change":"2024-03-16T07:35:10.361913+0000","last_active":"2024-03-16T07:35:10.364228+0000","last_peered":"2024-03-16T07:35:10.364228+0000","last_clean":"2024-03-16T07:35:10.364228+0000","last_became_active":"2024-03-16T07:35:10.361684+0000","last_became_peered":"2024-03-16T07:35:10.361684+0000","last_unstale":"2024-03-16T07:35:10.364228+0000","last_undegraded":"2024-03-16T07:35:10.364228+0000","last_fullsized":"2024-03-16T07:35:10.364228+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:57:47.696388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.0","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.354870+0000","last_change":"2024-03-16T07:35:09.680845+0000","last_active":"2024-03-16T07:35:10.354870+0000","last_peered":"2024-03-16T07:35:10.354870+0000","last_clean":"2024-03-16T07:35:10.354870+0000","last_became_active":"2024-03-16T07:35:09.680308+0000","last_became_peered":"2024-03-16T07:35:09.680308+0000","last_unstale":"2024-03-16T07:35:10.354870+0000","last_undegraded":"2024-03-16T07:35:10.354870+0000","last_fullsized":"2024-03-16T07:35:10.354870+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_clean_scrub_stamp":"2024-03-16T07:35:08.655627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:29:38.393742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.1c","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.361649+0000","last_change":"2024-03-16T07:35:10.360240+0000","last_active":"2024-03-16T07:35:10.361649+0000","last_peered":"2024-03-16T07:35:10.361649+0000","last_clean":"2024-03-16T07:35:10.361649+0000","last_became_active":"2024-03-16T07:35:10.360005+0000","last_became_peered":"2024-03-16T07:35:10.360005+0000","last_unstale":"2024-03-16T07:35:10.361649+0000","last_undegraded":"2024-03-16T07:35:10.361649+0000","last_fullsized":"2024-03-16T07:35:10.361649+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:17:44.696104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.1d","version":"167'2","reported_seq":14,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.671427+0000","last_change":"2024-03-16T07:35:09.673087+0000","last_active":"2024-03-16T07:35:10.671427+0000","last_peered":"2024-03-16T07:35:10.671427+0000","last_clean":"2024-03-16T07:35:10.671427+0000","last_became_active":"2024-03-16T07:35:09.672831+0000","last_became_peered":"2024-03-16T07:35:09.672831+0000","last_unstale":"2024-03-16T07:35:10.671427+0000","last_undegraded":"2024-03-16T07:35:10.671427+0000","last_fullsized":"2024-03-16T07:35:10.671427+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_clean_scrub_stamp":"2024-03-16T07:35:08.655627+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:55:55.803855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"152'218","reported_seq":857,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-03-16T07:35:10.354925+0000","last_change":"2024-03-16T07:24:31.650537+0000","last_active":"2024-03-16T07:35:10.354925+0000","last_peered":"2024-03-16T07:35:10.354925+0000","last_clean":"2024-03-16T07:35:10.354925+0000","last_became_active":"2024-03-16T07:24:31.649574+0000","last_became_peered":"2024-03-16T07:24:31.649574+0000","last_unstale":"2024-03-16T07:35:10.354925+0000","last_undegraded":"2024-03-16T07:35:10.354925+0000","last_fullsized":"2024-03-16T07:35:10.354925+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:29.719970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:29.719970+0000","last_clean_scrub_stamp":"2024-03-16T07:24:29.719970+0000","objects_scrubbed":0,"log_size":218,"log_dups_size":0,"ondisk_log_size":218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:31:35.774554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1162,"num_read_kb":2357,"num_write":357,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":29,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":28,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1162,"num_read_kb":2357,"num_write":357,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":218,"ondisk_log_size":218,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738493,"num_pgs":60,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":37028,"kb_used_data":1688,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":104820572,"statfs":{"total":107374182400,"available":107336265728,"internally_reserved":0,"allocated":1728512,"data_stored":710185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738493,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":37608,"kb_used_data":2260,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":104819992,"statfs":{"total":107374182400,"available":107335671808,"internally_reserved":0,"allocated":2314240,"data_stored":1296088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738493,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":37608,"kb_used_data":2260,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":104819992,"statfs":{"total":107374182400,"available":107335671808,"internally_reserved":0,"allocated":2314240,"data_stored":1296088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-16T07:35:14.242 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-03-16T07:35:14.242 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-03-16T07:35:14.679 INFO:teuthology.orchestra.run.smithi049.stdout:[client.0] 2024-03-16T07:35:14.679 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQAaSfVlmBmvGRAAaxdhkajaioVlq23dyv/g4g== 2024-03-16T07:35:14.680 INFO:teuthology.orchestra.run.smithi049.stdout: caps mds = "allow" 2024-03-16T07:35:14.680 INFO:teuthology.orchestra.run.smithi049.stdout: caps mon = "allow r" 2024-03-16T07:35:14.680 INFO:teuthology.orchestra.run.smithi049.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-03-16T07:35:14.680 INFO:teuthology.orchestra.run.smithi049.stderr:updated caps for client.0 2024-03-16T07:35:14.697 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T07:35:15.077 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:35:15.077 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":116,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6690,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6827/875237476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":875237476},{"type":"v1","addr":"172.21.15.49:6827","nonce":875237476}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":113},{"gid":6691,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6829/417322500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":417322500},{"type":"v1","addr":"172.21.15.49:6829","nonce":417322500}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":113},{"gid":6696,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6831/4121914730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":4121914730},{"type":"v1","addr":"172.21.15.49:6831","nonce":4121914730}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":113},{"gid":6697,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6834/1716116460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":1716116460},{"type":"v1","addr":"172.21.15.49:6834","nonce":1716116460}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":113}],"filesystems":[{"mdsmap":{"epoch":116,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-16T07:35:10.038977+0000","modified":"2024-03-16T07:35:12.029087+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6698},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6698":{"gid":6698,"name":"a","rank":0,"incarnation":114,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6835/1838330688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":1838330688},{"type":"v1","addr":"172.21.15.49:6835","nonce":1838330688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[29],"metadata_pool":28,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6698,"qdb_cluster":[6698]},"id":14}]} 2024-03-16T07:35:15.077 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 116 2024-03-16T07:35:15.592 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 116, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-03-16T07:35:10.038977+0000', 'modified': '2024-03-16T07:35:12.029087+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6698}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6698': {'gid': 6698, 'name': 'a', 'rank': 0, 'incarnation': 114, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.49:6835/1838330688', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.49:6833', 'nonce': 1838330688}, {'type': 'v1', 'addr': '172.21.15.49:6835', 'nonce': 1838330688}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [29], 'metadata_pool': 28, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 6698, 'qdb_cluster': [6698]} 2024-03-16T07:35:15.592 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-03-16T07:35:15.592 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-03-16T07:35:15.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-16T07:35:15.717+0000 7f32e27fc640 0 client.6757 ms_handle_reset on v2:172.21.15.49:6833/1838330688 2024-03-16T07:35:15.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-16T07:35:15.742+0000 7f32e27fc640 0 client.6759 ms_handle_reset on v2:172.21.15.49:6833/1838330688 2024-03-16T07:35:15.741 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-03-16T07:35:15.741 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_fsid": "f91af061-9eac-4793-87fa-8d27ae3d242f", 2024-03-16T07:35:15.741 INFO:teuthology.orchestra.run.smithi049.stdout: "whoami": 0, 2024-03-16T07:35:15.741 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 6698, 2024-03-16T07:35:15.741 INFO:teuthology.orchestra.run.smithi049.stdout: "want_state": "up:active", 2024-03-16T07:35:15.741 INFO:teuthology.orchestra.run.smithi049.stdout: "state": "up:active", 2024-03-16T07:35:15.741 INFO:teuthology.orchestra.run.smithi049.stdout: "fs_name": "cephfs", 2024-03-16T07:35:15.741 INFO:teuthology.orchestra.run.smithi049.stdout: "rank_uptime": 5.0824906360000002, 2024-03-16T07:35:15.741 INFO:teuthology.orchestra.run.smithi049.stdout: "mdsmap_epoch": 116, 2024-03-16T07:35:15.741 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch": 168, 2024-03-16T07:35:15.741 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch_barrier": 168, 2024-03-16T07:35:15.741 INFO:teuthology.orchestra.run.smithi049.stdout: "uptime": 10.397937306999999 2024-03-16T07:35:15.741 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-03-16T07:35:15.752 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-03-16T07:35:16.095 INFO:teuthology.orchestra.run.smithi049.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-03-16T07:35:16.107 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-03-16T07:35:16.107 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-03-16T07:35:16.107 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi049.front.sepia.ceph.com 2024-03-16T07:35:16.108 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-03-16T07:35:16.108 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-03-16T07:35:16.108 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-03-16T07:35:16.108 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-03-16T07:35:16.108 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-03-16T07:35:16.108 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-03-16T07:35:16.108 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:35:16.108 DEBUG:teuthology.orchestra.run.smithi049:> ip addr 2024-03-16T07:35:16.123 INFO:teuthology.orchestra.run.smithi049.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-16T07:35:16.124 INFO:teuthology.orchestra.run.smithi049.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-16T07:35:16.124 INFO:teuthology.orchestra.run.smithi049.stdout: inet 127.0.0.1/8 scope host lo 2024-03-16T07:35:16.124 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-03-16T07:35:16.124 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 ::1/128 scope host 2024-03-16T07:35:16.124 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-03-16T07:35:16.124 INFO:teuthology.orchestra.run.smithi049.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-16T07:35:16.124 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:6b:ff:84 brd ff:ff:ff:ff:ff:ff 2024-03-16T07:35:16.124 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp7s0f0 2024-03-16T07:35:16.124 INFO:teuthology.orchestra.run.smithi049.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-16T07:35:16.124 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:6b:ff:85 brd ff:ff:ff:ff:ff:ff 2024-03-16T07:35:16.124 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp7s0f1 2024-03-16T07:35:16.124 INFO:teuthology.orchestra.run.smithi049.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-03-16T07:35:16.125 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:bd:15:66 brd ff:ff:ff:ff:ff:ff 2024-03-16T07:35:16.125 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp1s0f0 2024-03-16T07:35:16.125 INFO:teuthology.orchestra.run.smithi049.stdout: inet 172.21.15.49/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-03-16T07:35:16.125 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft 41791sec preferred_lft 41791sec 2024-03-16T07:35:16.125 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::ec4:7aff:febd:1566/64 scope link noprefixroute 2024-03-16T07:35:16.125 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-03-16T07:35:16.125 INFO:teuthology.orchestra.run.smithi049.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-16T07:35:16.125 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:bd:15:67 brd ff:ff:ff:ff:ff:ff 2024-03-16T07:35:16.125 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp1s0f1 2024-03-16T07:35:16.125 INFO:teuthology.orchestra.run.smithi049.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-03-16T07:35:16.125 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether a2:f1:88:c1:22:e7 brd ff:ff:ff:ff:ff:ff 2024-03-16T07:35:16.125 INFO:teuthology.orchestra.run.smithi049.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-03-16T07:35:16.125 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-03-16T07:35:16.126 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::e0e6:55ff:fe4d:1d68/64 scope link 2024-03-16T07:35:16.126 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-03-16T07:35:16.126 INFO:teuthology.orchestra.run.smithi049.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-03-16T07:35:16.126 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether ee:10:71:d7:68:c4 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-16T07:35:16.126 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::ec10:71ff:fed7:68c4/64 scope link 2024-03-16T07:35:16.126 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-03-16T07:35:16.126 INFO:teuthology.orchestra.run.smithi049.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-03-16T07:35:16.126 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether a2:f1:88:c1:22:e7 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-16T07:35:16.126 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::a0f1:88ff:fec1:22e7/64 scope link 2024-03-16T07:35:16.126 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-03-16T07:35:16.126 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:35:16.126 DEBUG:teuthology.orchestra.run.smithi049:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-03-16T07:35:16.193 INFO:teuthology.orchestra.run.smithi049.stdout:1 2024-03-16T07:35:16.195 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:35:16.195 DEBUG:teuthology.orchestra.run.smithi049:> route 2024-03-16T07:35:16.250 INFO:teuthology.orchestra.run.smithi049.stdout:Kernel IP routing table 2024-03-16T07:35:16.251 INFO:teuthology.orchestra.run.smithi049.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-03-16T07:35:16.251 INFO:teuthology.orchestra.run.smithi049.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-03-16T07:35:16.251 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-03-16T07:35:16.251 INFO:teuthology.orchestra.run.smithi049.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-03-16T07:35:16.251 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-16T07:35:16.251 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-03-16T07:35:16.251 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-03-16T07:35:16.251 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-03-16T07:35:16.251 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-03-16T07:35:16.251 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-03-16T07:35:16.326 INFO:tasks.ceph.mds.a.smithi049.stderr:2024-03-16T07:35:16.328+0000 7fb96d2d3640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-03-16T07:35:16.340 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-16T07:35:16 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-16T07:35:16.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-16T07:35:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-16T07:35:16.398 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:35:16.398 DEBUG:teuthology.orchestra.run.smithi049:> ip netns list 2024-03-16T07:35:16.454 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 1) 2024-03-16T07:35:16.454 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-03-16T07:35:16.454 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-03-16T07:35:16.454 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:35:16.454 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link set brx.0 up 2024-03-16T07:35:16.529 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-03-16T07:35:16.529 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-16T07:35:16.529 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-03-16T07:35:16.584 INFO:teuthology.orchestra.run.smithi049.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-03-16T07:35:16.584 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-16T07:35:16.584 DEBUG:teuthology.orchestra.run.smithi049:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-03-16T07:35:16.638 DEBUG:teuthology.orchestra.run.smithi049:> sudo modprobe fuse 2024-03-16T07:35:16.715 DEBUG:teuthology.orchestra.run.smithi049:> cat /proc/self/mounts | awk '{print $2}' 2024-03-16T07:35:16.771 INFO:teuthology.orchestra.run.smithi049.stdout:/proc 2024-03-16T07:35:16.771 INFO:teuthology.orchestra.run.smithi049.stdout:/sys 2024-03-16T07:35:16.771 INFO:teuthology.orchestra.run.smithi049.stdout:/dev 2024-03-16T07:35:16.771 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/security 2024-03-16T07:35:16.771 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/shm 2024-03-16T07:35:16.771 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/pts 2024-03-16T07:35:16.771 INFO:teuthology.orchestra.run.smithi049.stdout:/run 2024-03-16T07:35:16.771 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/cgroup 2024-03-16T07:35:16.771 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/pstore 2024-03-16T07:35:16.771 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/bpf 2024-03-16T07:35:16.771 INFO:teuthology.orchestra.run.smithi049.stdout:/ 2024-03-16T07:35:16.771 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/selinux 2024-03-16T07:35:16.772 INFO:teuthology.orchestra.run.smithi049.stdout:/proc/sys/fs/binfmt_misc 2024-03-16T07:35:16.772 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/mqueue 2024-03-16T07:35:16.772 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/hugepages 2024-03-16T07:35:16.772 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/debug 2024-03-16T07:35:16.772 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/tracing 2024-03-16T07:35:16.772 INFO:teuthology.orchestra.run.smithi049.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-03-16T07:35:16.772 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/fuse/connections 2024-03-16T07:35:16.772 INFO:teuthology.orchestra.run.smithi049.stdout:/run/credentials/systemd-sysctl.service 2024-03-16T07:35:16.772 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/config 2024-03-16T07:35:16.772 INFO:teuthology.orchestra.run.smithi049.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-03-16T07:35:16.772 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/nfs/rpc_pipefs 2024-03-16T07:35:16.772 INFO:teuthology.orchestra.run.smithi049.stdout:/run/user/1000 2024-03-16T07:35:16.772 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph 2024-03-16T07:35:16.772 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-0 2024-03-16T07:35:16.772 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-1 2024-03-16T07:35:16.772 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-2 2024-03-16T07:35:16.773 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns 2024-03-16T07:35:16.773 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-16T07:35:16.773 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-16T07:35:16.773 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-16T07:35:16.773 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-16T07:35:16.773 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:35:16.773 DEBUG:teuthology.orchestra.run.smithi049:> ls /sys/fs/fuse/connections 2024-03-16T07:35:16.825 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-03-16T07:35:16.826 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-03-16T07:35:16.868 DEBUG:teuthology.orchestra.run.smithi049:> sudo modprobe fuse 2024-03-16T07:35:16.899 DEBUG:teuthology.orchestra.run.smithi049:> cat /proc/self/mounts | awk '{print $2}' 2024-03-16T07:35:16.956 INFO:teuthology.orchestra.run.smithi049.stdout:/proc 2024-03-16T07:35:16.956 INFO:teuthology.orchestra.run.smithi049.stdout:/sys 2024-03-16T07:35:16.956 INFO:teuthology.orchestra.run.smithi049.stdout:/dev 2024-03-16T07:35:16.957 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/security 2024-03-16T07:35:16.957 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/shm 2024-03-16T07:35:16.957 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/pts 2024-03-16T07:35:16.957 INFO:teuthology.orchestra.run.smithi049.stdout:/run 2024-03-16T07:35:16.957 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/cgroup 2024-03-16T07:35:16.957 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/pstore 2024-03-16T07:35:16.957 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/bpf 2024-03-16T07:35:16.957 INFO:teuthology.orchestra.run.smithi049.stdout:/ 2024-03-16T07:35:16.957 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/selinux 2024-03-16T07:35:16.957 INFO:teuthology.orchestra.run.smithi049.stdout:/proc/sys/fs/binfmt_misc 2024-03-16T07:35:16.957 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/mqueue 2024-03-16T07:35:16.957 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/hugepages 2024-03-16T07:35:16.957 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/debug 2024-03-16T07:35:16.957 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/tracing 2024-03-16T07:35:16.957 INFO:teuthology.orchestra.run.smithi049.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-03-16T07:35:16.958 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/fuse/connections 2024-03-16T07:35:16.958 INFO:teuthology.orchestra.run.smithi049.stdout:/run/credentials/systemd-sysctl.service 2024-03-16T07:35:16.958 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/config 2024-03-16T07:35:16.958 INFO:teuthology.orchestra.run.smithi049.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-03-16T07:35:16.958 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/nfs/rpc_pipefs 2024-03-16T07:35:16.958 INFO:teuthology.orchestra.run.smithi049.stdout:/run/user/1000 2024-03-16T07:35:16.958 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph 2024-03-16T07:35:16.958 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-0 2024-03-16T07:35:16.958 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-1 2024-03-16T07:35:16.958 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-2 2024-03-16T07:35:16.958 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns 2024-03-16T07:35:16.958 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-16T07:35:16.959 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-16T07:35:16.959 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-16T07:35:16.959 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-16T07:35:16.959 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:35:16.959 DEBUG:teuthology.orchestra.run.smithi049:> ls /sys/fs/fuse/connections 2024-03-16T07:35:16.962 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi049.stderr:2024-03-16T07:35:16.964+0000 7f912f250480 -1 init, newargv = 0x5645708be390 newargc=15 2024-03-16T07:35:16.962 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi049.stderr:ceph-fuse[82245]: starting ceph client 2024-03-16T07:35:16.965 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi049.stderr:ceph-fuse[82245]: starting fuse 2024-03-16T07:35:16.978 INFO:teuthology.orchestra.run.smithi049.stdout:41 2024-03-16T07:35:16.979 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2024-03-16T07:35:16.979 DEBUG:teuthology.orchestra.run.smithi049:> sudo stdin-killer -- python3 -c ' 2024-03-16T07:35:16.979 DEBUG:teuthology.orchestra.run.smithi049:> import glob 2024-03-16T07:35:16.979 DEBUG:teuthology.orchestra.run.smithi049:> import re 2024-03-16T07:35:16.979 DEBUG:teuthology.orchestra.run.smithi049:> import os 2024-03-16T07:35:16.979 DEBUG:teuthology.orchestra.run.smithi049:> import subprocess 2024-03-16T07:35:16.979 DEBUG:teuthology.orchestra.run.smithi049:> 2024-03-16T07:35:16.979 DEBUG:teuthology.orchestra.run.smithi049:> def _find_admin_socket(client_name): 2024-03-16T07:35:16.979 DEBUG:teuthology.orchestra.run.smithi049:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-03-16T07:35:16.979 DEBUG:teuthology.orchestra.run.smithi049:> files = glob.glob(asok_path) 2024-03-16T07:35:16.980 DEBUG:teuthology.orchestra.run.smithi049:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-03-16T07:35:16.980 DEBUG:teuthology.orchestra.run.smithi049:> 2024-03-16T07:35:16.980 DEBUG:teuthology.orchestra.run.smithi049:> # Given a non-glob path, it better be there 2024-03-16T07:35:16.980 DEBUG:teuthology.orchestra.run.smithi049:> if "*" not in asok_path: 2024-03-16T07:35:16.980 DEBUG:teuthology.orchestra.run.smithi049:> assert(len(files) == 1) 2024-03-16T07:35:16.980 DEBUG:teuthology.orchestra.run.smithi049:> return files[0] 2024-03-16T07:35:16.980 DEBUG:teuthology.orchestra.run.smithi049:> 2024-03-16T07:35:16.980 DEBUG:teuthology.orchestra.run.smithi049:> for f in files: 2024-03-16T07:35:16.980 DEBUG:teuthology.orchestra.run.smithi049:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-03-16T07:35:16.980 DEBUG:teuthology.orchestra.run.smithi049:> if os.path.exists("/proc/{0}".format(pid)): 2024-03-16T07:35:16.980 DEBUG:teuthology.orchestra.run.smithi049:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-03-16T07:35:16.980 DEBUG:teuthology.orchestra.run.smithi049:> contents = proc_f.read() 2024-03-16T07:35:16.980 DEBUG:teuthology.orchestra.run.smithi049:> if mountpoint in contents: 2024-03-16T07:35:16.980 DEBUG:teuthology.orchestra.run.smithi049:> return f 2024-03-16T07:35:16.980 DEBUG:teuthology.orchestra.run.smithi049:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-03-16T07:35:16.980 DEBUG:teuthology.orchestra.run.smithi049:> 2024-03-16T07:35:16.981 DEBUG:teuthology.orchestra.run.smithi049:> print(_find_admin_socket("client.0")) 2024-03-16T07:35:16.981 DEBUG:teuthology.orchestra.run.smithi049:> ' 2024-03-16T07:35:17.105 INFO:teuthology.orchestra.run.smithi049.stdout:/var/run/ceph/ceph-client.0.82245.asok 2024-03-16T07:35:17.108 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-16T07:35:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-16T07:35:17.116 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.82245.asok 2024-03-16T07:35:17.116 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:35:17.116 DEBUG:teuthology.orchestra.run.smithi049:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.82245.asok status 2024-03-16T07:35:17.258 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-03-16T07:35:17.258 INFO:teuthology.orchestra.run.smithi049.stdout: "metadata": { 2024-03-16T07:35:17.258 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph_sha1": "3d78f5ba07bf18880172c07d4d7b4ac00c9d30af", 2024-03-16T07:35:17.258 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph_version": "ceph version 19.0.0-2162-g3d78f5ba (3d78f5ba07bf18880172c07d4d7b4ac00c9d30af) squid (dev)", 2024-03-16T07:35:17.258 INFO:teuthology.orchestra.run.smithi049.stdout: "entity_id": "0", 2024-03-16T07:35:17.258 INFO:teuthology.orchestra.run.smithi049.stdout: "hostname": "smithi049", 2024-03-16T07:35:17.258 INFO:teuthology.orchestra.run.smithi049.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-03-16T07:35:17.258 INFO:teuthology.orchestra.run.smithi049.stdout: "pid": "82245", 2024-03-16T07:35:17.258 INFO:teuthology.orchestra.run.smithi049.stdout: "root": "/" 2024-03-16T07:35:17.258 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:35:17.259 INFO:teuthology.orchestra.run.smithi049.stdout: "dentry_count": 0, 2024-03-16T07:35:17.259 INFO:teuthology.orchestra.run.smithi049.stdout: "dentry_pinned_count": 0, 2024-03-16T07:35:17.259 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 6765, 2024-03-16T07:35:17.259 INFO:teuthology.orchestra.run.smithi049.stdout: "inst": { 2024-03-16T07:35:17.259 INFO:teuthology.orchestra.run.smithi049.stdout: "name": { 2024-03-16T07:35:17.259 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "client", 2024-03-16T07:35:17.259 INFO:teuthology.orchestra.run.smithi049.stdout: "num": 6765 2024-03-16T07:35:17.259 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:35:17.259 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": { 2024-03-16T07:35:17.259 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2024-03-16T07:35:17.259 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "192.168.0.1:0", 2024-03-16T07:35:17.259 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 2540551795 2024-03-16T07:35:17.259 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:35:17.259 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:35:17.259 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": { 2024-03-16T07:35:17.259 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2024-03-16T07:35:17.260 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "192.168.0.1:0", 2024-03-16T07:35:17.260 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 2540551795 2024-03-16T07:35:17.260 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:35:17.260 INFO:teuthology.orchestra.run.smithi049.stdout: "inst_str": "client.6765 192.168.0.1:0/2540551795", 2024-03-16T07:35:17.260 INFO:teuthology.orchestra.run.smithi049.stdout: "addr_str": "192.168.0.1:0/2540551795", 2024-03-16T07:35:17.260 INFO:teuthology.orchestra.run.smithi049.stdout: "inode_count": 1, 2024-03-16T07:35:17.260 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_epoch": 116, 2024-03-16T07:35:17.260 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_epoch": 168, 2024-03-16T07:35:17.260 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_epoch_barrier": 0, 2024-03-16T07:35:17.260 INFO:teuthology.orchestra.run.smithi049.stdout: "blocklisted": false, 2024-03-16T07:35:17.260 INFO:teuthology.orchestra.run.smithi049.stdout: "fs_name": "cephfs" 2024-03-16T07:35:17.260 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-03-16T07:35:17.266 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:35:17.266 DEBUG:teuthology.orchestra.run.smithi049:> stat --file-system '--printf=%T 2024-03-16T07:35:17.266 DEBUG:teuthology.orchestra.run.smithi049:> ' -- /home/ubuntu/cephtest/mnt.0 2024-03-16T07:35:17.281 INFO:teuthology.orchestra.run.smithi049.stdout:fuseblk 2024-03-16T07:35:17.282 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-03-16T07:35:17.282 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:35:17.282 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-03-16T07:35:17.352 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-03-16T07:35:17.734 INFO:teuthology.orchestra.run.smithi049.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-03-16T07:35:17.747 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-03-16T07:35:17.747 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-03-16T07:35:17.747 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi049.front.sepia.ceph.com 2024-03-16T07:35:17.747 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-03-16T07:35:17.747 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-03-16T07:35:17.747 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-03-16T07:35:17.748 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-03-16T07:35:17.748 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-03-16T07:35:17.748 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-03-16T07:35:17.748 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:35:17.748 DEBUG:teuthology.orchestra.run.smithi049:> ip addr 2024-03-16T07:35:17.763 INFO:teuthology.orchestra.run.smithi049.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-16T07:35:17.763 INFO:teuthology.orchestra.run.smithi049.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-16T07:35:17.763 INFO:teuthology.orchestra.run.smithi049.stdout: inet 127.0.0.1/8 scope host lo 2024-03-16T07:35:17.763 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-03-16T07:35:17.763 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 ::1/128 scope host 2024-03-16T07:35:17.764 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-03-16T07:35:17.764 INFO:teuthology.orchestra.run.smithi049.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-16T07:35:17.764 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:6b:ff:84 brd ff:ff:ff:ff:ff:ff 2024-03-16T07:35:17.764 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp7s0f0 2024-03-16T07:35:17.764 INFO:teuthology.orchestra.run.smithi049.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-16T07:35:17.764 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:6b:ff:85 brd ff:ff:ff:ff:ff:ff 2024-03-16T07:35:17.764 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp7s0f1 2024-03-16T07:35:17.764 INFO:teuthology.orchestra.run.smithi049.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-03-16T07:35:17.764 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:bd:15:66 brd ff:ff:ff:ff:ff:ff 2024-03-16T07:35:17.764 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp1s0f0 2024-03-16T07:35:17.764 INFO:teuthology.orchestra.run.smithi049.stdout: inet 172.21.15.49/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-03-16T07:35:17.764 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft 41790sec preferred_lft 41790sec 2024-03-16T07:35:17.764 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::ec4:7aff:febd:1566/64 scope link noprefixroute 2024-03-16T07:35:17.764 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-03-16T07:35:17.765 INFO:teuthology.orchestra.run.smithi049.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-16T07:35:17.765 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:bd:15:67 brd ff:ff:ff:ff:ff:ff 2024-03-16T07:35:17.765 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp1s0f1 2024-03-16T07:35:17.765 INFO:teuthology.orchestra.run.smithi049.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-03-16T07:35:17.765 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether a2:f1:88:c1:22:e7 brd ff:ff:ff:ff:ff:ff 2024-03-16T07:35:17.765 INFO:teuthology.orchestra.run.smithi049.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-03-16T07:35:17.765 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-03-16T07:35:17.765 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::e0e6:55ff:fe4d:1d68/64 scope link 2024-03-16T07:35:17.765 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-03-16T07:35:17.765 INFO:teuthology.orchestra.run.smithi049.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-03-16T07:35:17.765 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether ee:10:71:d7:68:c4 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-16T07:35:17.765 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::ec10:71ff:fed7:68c4/64 scope link 2024-03-16T07:35:17.765 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-03-16T07:35:17.765 INFO:teuthology.orchestra.run.smithi049.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-03-16T07:35:17.765 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether a2:f1:88:c1:22:e7 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-16T07:35:17.766 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::a0f1:88ff:fec1:22e7/64 scope link 2024-03-16T07:35:17.766 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-03-16T07:35:17.766 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:35:17.766 DEBUG:teuthology.orchestra.run.smithi049:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-03-16T07:35:17.832 INFO:teuthology.orchestra.run.smithi049.stdout:1 2024-03-16T07:35:17.834 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:35:17.834 DEBUG:teuthology.orchestra.run.smithi049:> route 2024-03-16T07:35:17.889 INFO:teuthology.orchestra.run.smithi049.stdout:Kernel IP routing table 2024-03-16T07:35:17.890 INFO:teuthology.orchestra.run.smithi049.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-03-16T07:35:17.890 INFO:teuthology.orchestra.run.smithi049.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-03-16T07:35:17.890 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-03-16T07:35:17.890 INFO:teuthology.orchestra.run.smithi049.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-03-16T07:35:17.890 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-16T07:35:17.890 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-03-16T07:35:17.890 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-03-16T07:35:17.890 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-03-16T07:35:17.890 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-03-16T07:35:17.890 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-03-16T07:35:17.978 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-16T07:35:17 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-16T07:35:18.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-16T07:35:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-16T07:35:18.038 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:35:18.038 DEBUG:teuthology.orchestra.run.smithi049:> ip netns list 2024-03-16T07:35:18.052 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 1) 2024-03-16T07:35:18.053 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-03-16T07:35:18.053 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-03-16T07:35:18.053 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:35:18.053 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link set brx.1 up 2024-03-16T07:35:18.125 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-03-16T07:35:18.125 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-16T07:35:18.125 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-03-16T07:35:18.180 INFO:teuthology.orchestra.run.smithi049.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-03-16T07:35:18.180 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-16T07:35:18.180 DEBUG:teuthology.orchestra.run.smithi049:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-03-16T07:35:18.234 DEBUG:teuthology.orchestra.run.smithi049:> sudo modprobe fuse 2024-03-16T07:35:18.304 DEBUG:teuthology.orchestra.run.smithi049:> cat /proc/self/mounts | awk '{print $2}' 2024-03-16T07:35:18.362 INFO:teuthology.orchestra.run.smithi049.stdout:/proc 2024-03-16T07:35:18.362 INFO:teuthology.orchestra.run.smithi049.stdout:/sys 2024-03-16T07:35:18.362 INFO:teuthology.orchestra.run.smithi049.stdout:/dev 2024-03-16T07:35:18.362 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/security 2024-03-16T07:35:18.362 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/shm 2024-03-16T07:35:18.362 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/pts 2024-03-16T07:35:18.362 INFO:teuthology.orchestra.run.smithi049.stdout:/run 2024-03-16T07:35:18.362 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/cgroup 2024-03-16T07:35:18.362 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/pstore 2024-03-16T07:35:18.362 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/bpf 2024-03-16T07:35:18.362 INFO:teuthology.orchestra.run.smithi049.stdout:/ 2024-03-16T07:35:18.362 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/selinux 2024-03-16T07:35:18.363 INFO:teuthology.orchestra.run.smithi049.stdout:/proc/sys/fs/binfmt_misc 2024-03-16T07:35:18.363 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/mqueue 2024-03-16T07:35:18.363 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/hugepages 2024-03-16T07:35:18.363 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/debug 2024-03-16T07:35:18.363 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/tracing 2024-03-16T07:35:18.363 INFO:teuthology.orchestra.run.smithi049.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-03-16T07:35:18.363 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/fuse/connections 2024-03-16T07:35:18.363 INFO:teuthology.orchestra.run.smithi049.stdout:/run/credentials/systemd-sysctl.service 2024-03-16T07:35:18.363 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/config 2024-03-16T07:35:18.363 INFO:teuthology.orchestra.run.smithi049.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-03-16T07:35:18.363 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/nfs/rpc_pipefs 2024-03-16T07:35:18.363 INFO:teuthology.orchestra.run.smithi049.stdout:/run/user/1000 2024-03-16T07:35:18.363 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph 2024-03-16T07:35:18.363 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-0 2024-03-16T07:35:18.364 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-1 2024-03-16T07:35:18.364 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-2 2024-03-16T07:35:18.364 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns 2024-03-16T07:35:18.364 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-16T07:35:18.364 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-16T07:35:18.364 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-16T07:35:18.364 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-16T07:35:18.364 INFO:teuthology.orchestra.run.smithi049.stdout:/home/ubuntu/cephtest/mnt.0 2024-03-16T07:35:18.364 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:35:18.364 DEBUG:teuthology.orchestra.run.smithi049:> ls /sys/fs/fuse/connections 2024-03-16T07:35:18.417 INFO:teuthology.orchestra.run.smithi049.stdout:41 2024-03-16T07:35:18.417 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [41] 2024-03-16T07:35:18.417 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-03-16T07:35:18.459 DEBUG:teuthology.orchestra.run.smithi049:> sudo modprobe fuse 2024-03-16T07:35:18.491 DEBUG:teuthology.orchestra.run.smithi049:> cat /proc/self/mounts | awk '{print $2}' 2024-03-16T07:35:18.548 INFO:teuthology.orchestra.run.smithi049.stdout:/proc 2024-03-16T07:35:18.548 INFO:teuthology.orchestra.run.smithi049.stdout:/sys 2024-03-16T07:35:18.548 INFO:teuthology.orchestra.run.smithi049.stdout:/dev 2024-03-16T07:35:18.549 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/security 2024-03-16T07:35:18.549 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/shm 2024-03-16T07:35:18.549 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/pts 2024-03-16T07:35:18.549 INFO:teuthology.orchestra.run.smithi049.stdout:/run 2024-03-16T07:35:18.549 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/cgroup 2024-03-16T07:35:18.549 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/pstore 2024-03-16T07:35:18.549 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/bpf 2024-03-16T07:35:18.549 INFO:teuthology.orchestra.run.smithi049.stdout:/ 2024-03-16T07:35:18.549 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/selinux 2024-03-16T07:35:18.549 INFO:teuthology.orchestra.run.smithi049.stdout:/proc/sys/fs/binfmt_misc 2024-03-16T07:35:18.549 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/mqueue 2024-03-16T07:35:18.549 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/hugepages 2024-03-16T07:35:18.549 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/debug 2024-03-16T07:35:18.549 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/tracing 2024-03-16T07:35:18.550 INFO:teuthology.orchestra.run.smithi049.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-03-16T07:35:18.550 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/fuse/connections 2024-03-16T07:35:18.550 INFO:teuthology.orchestra.run.smithi049.stdout:/run/credentials/systemd-sysctl.service 2024-03-16T07:35:18.550 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/config 2024-03-16T07:35:18.550 INFO:teuthology.orchestra.run.smithi049.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-03-16T07:35:18.550 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/nfs/rpc_pipefs 2024-03-16T07:35:18.550 INFO:teuthology.orchestra.run.smithi049.stdout:/run/user/1000 2024-03-16T07:35:18.550 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph 2024-03-16T07:35:18.550 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-0 2024-03-16T07:35:18.550 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-1 2024-03-16T07:35:18.550 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-2 2024-03-16T07:35:18.550 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns 2024-03-16T07:35:18.550 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-16T07:35:18.551 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-16T07:35:18.551 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-16T07:35:18.551 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-16T07:35:18.551 INFO:teuthology.orchestra.run.smithi049.stdout:/home/ubuntu/cephtest/mnt.0 2024-03-16T07:35:18.551 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:35:18.551 DEBUG:teuthology.orchestra.run.smithi049:> ls /sys/fs/fuse/connections 2024-03-16T07:35:18.553 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi049.stderr:2024-03-16T07:35:18.555+0000 7f10ee73d480 -1 init, newargv = 0x555b2228ede0 newargc=15 2024-03-16T07:35:18.554 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi049.stderr:ceph-fuse[82662]: starting ceph client 2024-03-16T07:35:18.557 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi049.stderr:ceph-fuse[82662]: starting fuse 2024-03-16T07:35:18.570 INFO:teuthology.orchestra.run.smithi049.stdout:41 2024-03-16T07:35:18.570 INFO:teuthology.orchestra.run.smithi049.stdout:44 2024-03-16T07:35:18.571 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41, 44] 2024-03-16T07:35:18.571 DEBUG:teuthology.orchestra.run.smithi049:> sudo stdin-killer -- python3 -c ' 2024-03-16T07:35:18.571 DEBUG:teuthology.orchestra.run.smithi049:> import glob 2024-03-16T07:35:18.571 DEBUG:teuthology.orchestra.run.smithi049:> import re 2024-03-16T07:35:18.571 DEBUG:teuthology.orchestra.run.smithi049:> import os 2024-03-16T07:35:18.571 DEBUG:teuthology.orchestra.run.smithi049:> import subprocess 2024-03-16T07:35:18.571 DEBUG:teuthology.orchestra.run.smithi049:> 2024-03-16T07:35:18.571 DEBUG:teuthology.orchestra.run.smithi049:> def _find_admin_socket(client_name): 2024-03-16T07:35:18.571 DEBUG:teuthology.orchestra.run.smithi049:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-03-16T07:35:18.571 DEBUG:teuthology.orchestra.run.smithi049:> files = glob.glob(asok_path) 2024-03-16T07:35:18.571 DEBUG:teuthology.orchestra.run.smithi049:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-03-16T07:35:18.572 DEBUG:teuthology.orchestra.run.smithi049:> 2024-03-16T07:35:18.572 DEBUG:teuthology.orchestra.run.smithi049:> # Given a non-glob path, it better be there 2024-03-16T07:35:18.572 DEBUG:teuthology.orchestra.run.smithi049:> if "*" not in asok_path: 2024-03-16T07:35:18.572 DEBUG:teuthology.orchestra.run.smithi049:> assert(len(files) == 1) 2024-03-16T07:35:18.572 DEBUG:teuthology.orchestra.run.smithi049:> return files[0] 2024-03-16T07:35:18.572 DEBUG:teuthology.orchestra.run.smithi049:> 2024-03-16T07:35:18.572 DEBUG:teuthology.orchestra.run.smithi049:> for f in files: 2024-03-16T07:35:18.572 DEBUG:teuthology.orchestra.run.smithi049:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-03-16T07:35:18.572 DEBUG:teuthology.orchestra.run.smithi049:> if os.path.exists("/proc/{0}".format(pid)): 2024-03-16T07:35:18.572 DEBUG:teuthology.orchestra.run.smithi049:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-03-16T07:35:18.572 DEBUG:teuthology.orchestra.run.smithi049:> contents = proc_f.read() 2024-03-16T07:35:18.572 DEBUG:teuthology.orchestra.run.smithi049:> if mountpoint in contents: 2024-03-16T07:35:18.572 DEBUG:teuthology.orchestra.run.smithi049:> return f 2024-03-16T07:35:18.572 DEBUG:teuthology.orchestra.run.smithi049:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-03-16T07:35:18.572 DEBUG:teuthology.orchestra.run.smithi049:> 2024-03-16T07:35:18.572 DEBUG:teuthology.orchestra.run.smithi049:> print(_find_admin_socket("client.1")) 2024-03-16T07:35:18.572 DEBUG:teuthology.orchestra.run.smithi049:> ' 2024-03-16T07:35:18.696 INFO:teuthology.orchestra.run.smithi049.stdout:/var/run/ceph/ceph-client.1.82662.asok 2024-03-16T07:35:18.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-16T07:35:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-16T07:35:18.707 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.82662.asok 2024-03-16T07:35:18.707 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:35:18.707 DEBUG:teuthology.orchestra.run.smithi049:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.82662.asok status 2024-03-16T07:35:18.849 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-03-16T07:35:18.849 INFO:teuthology.orchestra.run.smithi049.stdout: "metadata": { 2024-03-16T07:35:18.849 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph_sha1": "3d78f5ba07bf18880172c07d4d7b4ac00c9d30af", 2024-03-16T07:35:18.849 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph_version": "ceph version 19.0.0-2162-g3d78f5ba (3d78f5ba07bf18880172c07d4d7b4ac00c9d30af) squid (dev)", 2024-03-16T07:35:18.849 INFO:teuthology.orchestra.run.smithi049.stdout: "entity_id": "1", 2024-03-16T07:35:18.849 INFO:teuthology.orchestra.run.smithi049.stdout: "hostname": "smithi049", 2024-03-16T07:35:18.850 INFO:teuthology.orchestra.run.smithi049.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-03-16T07:35:18.850 INFO:teuthology.orchestra.run.smithi049.stdout: "pid": "82662", 2024-03-16T07:35:18.850 INFO:teuthology.orchestra.run.smithi049.stdout: "root": "/" 2024-03-16T07:35:18.850 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:35:18.850 INFO:teuthology.orchestra.run.smithi049.stdout: "dentry_count": 0, 2024-03-16T07:35:18.850 INFO:teuthology.orchestra.run.smithi049.stdout: "dentry_pinned_count": 0, 2024-03-16T07:35:18.850 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 6771, 2024-03-16T07:35:18.850 INFO:teuthology.orchestra.run.smithi049.stdout: "inst": { 2024-03-16T07:35:18.850 INFO:teuthology.orchestra.run.smithi049.stdout: "name": { 2024-03-16T07:35:18.850 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "client", 2024-03-16T07:35:18.850 INFO:teuthology.orchestra.run.smithi049.stdout: "num": 6771 2024-03-16T07:35:18.850 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:35:18.850 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": { 2024-03-16T07:35:18.850 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2024-03-16T07:35:18.851 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "192.168.0.2:0", 2024-03-16T07:35:18.851 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 554259712 2024-03-16T07:35:18.851 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:35:18.851 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:35:18.851 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": { 2024-03-16T07:35:18.851 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2024-03-16T07:35:18.851 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "192.168.0.2:0", 2024-03-16T07:35:18.851 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 554259712 2024-03-16T07:35:18.851 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:35:18.851 INFO:teuthology.orchestra.run.smithi049.stdout: "inst_str": "client.6771 192.168.0.2:0/554259712", 2024-03-16T07:35:18.851 INFO:teuthology.orchestra.run.smithi049.stdout: "addr_str": "192.168.0.2:0/554259712", 2024-03-16T07:35:18.851 INFO:teuthology.orchestra.run.smithi049.stdout: "inode_count": 1, 2024-03-16T07:35:18.851 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_epoch": 116, 2024-03-16T07:35:18.851 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_epoch": 168, 2024-03-16T07:35:18.851 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_epoch_barrier": 0, 2024-03-16T07:35:18.852 INFO:teuthology.orchestra.run.smithi049.stdout: "blocklisted": false, 2024-03-16T07:35:18.852 INFO:teuthology.orchestra.run.smithi049.stdout: "fs_name": "cephfs" 2024-03-16T07:35:18.852 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-03-16T07:35:18.860 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:35:18.860 DEBUG:teuthology.orchestra.run.smithi049:> stat --file-system '--printf=%T 2024-03-16T07:35:18.860 DEBUG:teuthology.orchestra.run.smithi049:> ' -- /home/ubuntu/cephtest/mnt.1 2024-03-16T07:35:18.875 INFO:teuthology.orchestra.run.smithi049.stdout:fuseblk 2024-03-16T07:35:18.876 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-03-16T07:35:18.876 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:35:18.876 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-03-16T07:35:18.946 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2024-03-16T07:35:19.699 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T07:35:20.019 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:35:20.019 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":168,"fsid":"f91af061-9eac-4793-87fa-8d27ae3d242f","created":"2024-03-16T07:24:20.357868+0000","modified":"2024-03-16T07:35:11.346479+0000","last_up_change":"2024-03-16T07:24:27.474980+0000","last_in_change":"2024-03-16T07:24:21.254179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":29,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T07:24:28.947521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":28,"pool_name":"cephfs_metadata","create_time":"2024-03-16T07:35:08.344405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"167","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.309999942779541,"score_stable":1.309999942779541,"optimal_score":1,"raw_score_acting":1.309999942779541,"raw_score_stable":1.309999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":29,"pool_name":"cephfs_data","create_time":"2024-03-16T07:35:09.019172+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"168","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1699999570846558,"score_stable":1.1699999570846558,"optimal_score":1,"raw_score_acting":1.1699999570846558,"raw_score_stable":1.1699999570846558,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2df14aac-98dc-4e3c-ae7e-9eb677aa30be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6801","nonce":2744935777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6803","nonce":2744935777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6807","nonce":2744935777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6805","nonce":2744935777}]},"public_addr":"172.21.15.49:6801/2744935777","cluster_addr":"172.21.15.49:6803/2744935777","heartbeat_back_addr":"172.21.15.49:6807/2744935777","heartbeat_front_addr":"172.21.15.49:6805/2744935777","state":["exists","up"]},{"osd":1,"uuid":"80461bd9-59ef-46df-9eea-bad92d960c57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6811","nonce":1655120118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6815","nonce":1655120118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6821","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6823","nonce":1655120118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6817","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6819","nonce":1655120118}]},"public_addr":"172.21.15.49:6811/1655120118","cluster_addr":"172.21.15.49:6815/1655120118","heartbeat_back_addr":"172.21.15.49:6823/1655120118","heartbeat_front_addr":"172.21.15.49:6819/1655120118","state":["exists","up"]},{"osd":2,"uuid":"d6bf40eb-6e42-4ec9-8b3d-0b6c5a6def79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6810","nonce":3815472376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6814","nonce":3815472376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6822","nonce":3815472376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6818","nonce":3815472376}]},"public_addr":"172.21.15.49:6810/3815472376","cluster_addr":"172.21.15.49:6814/3815472376","heartbeat_back_addr":"172.21.15.49:6822/3815472376","heartbeat_front_addr":"172.21.15.49:6818/3815472376","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.641492+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.668598+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.614940+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T07:35:20.032 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-16T07:24:28.947521+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 28, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-16T07:35:08.344405+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '167', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.309999942779541, 'score_stable': 1.309999942779541, 'optimal_score': 1, 'raw_score_acting': 1.309999942779541, 'raw_score_stable': 1.309999942779541, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 29, 'pool_name': 'cephfs_data', 'create_time': '2024-03-16T07:35:09.019172+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '168', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1699999570846558, 'score_stable': 1.1699999570846558, 'optimal_score': 1, 'raw_score_acting': 1.1699999570846558, 'raw_score_stable': 1.1699999570846558, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-16T07:35:20.032 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-16T07:35:20.334 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2024-03-16T07:35:20.348 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-16T07:35:20.651 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2024-03-16T07:35:20.664 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-16T07:35:20.968 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2024-03-16T07:35:20.985 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-03-16T07:35:21.287 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:35:21.288 INFO:teuthology.orchestra.run.smithi049.stdout:[ 2024-03-16T07:35:21.288 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:35:21.288 INFO:teuthology.orchestra.run.smithi049.stdout: "poolnum": 1, 2024-03-16T07:35:21.288 INFO:teuthology.orchestra.run.smithi049.stdout: "poolname": ".mgr" 2024-03-16T07:35:21.288 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:35:21.288 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:35:21.288 INFO:teuthology.orchestra.run.smithi049.stdout: "poolnum": 28, 2024-03-16T07:35:21.288 INFO:teuthology.orchestra.run.smithi049.stdout: "poolname": "cephfs_metadata" 2024-03-16T07:35:21.288 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:35:21.288 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:35:21.288 INFO:teuthology.orchestra.run.smithi049.stdout: "poolnum": 29, 2024-03-16T07:35:21.288 INFO:teuthology.orchestra.run.smithi049.stdout: "poolname": "cephfs_data" 2024-03-16T07:35:21.288 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:35:21.289 INFO:teuthology.orchestra.run.smithi049.stdout:] 2024-03-16T07:35:21.304 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'backup_fs' 2024-03-16T07:35:21.304 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create backup_fs_metadata --pg_num_min 64 2024-03-16T07:35:21.689 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'backup_fs_metadata' created 2024-03-16T07:35:21.708 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create backup_fs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-03-16T07:35:22.691 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'backup_fs_data' created 2024-03-16T07:35:22.723 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new backup_fs backup_fs_metadata backup_fs_data 2024-03-16T07:35:23.703 INFO:teuthology.orchestra.run.smithi049.stderr:new fs with metadata pool 30 and data pool 31 2024-03-16T07:35:23.736 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T07:35:24.048 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:35:24.049 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":171,"fsid":"f91af061-9eac-4793-87fa-8d27ae3d242f","created":"2024-03-16T07:24:20.357868+0000","modified":"2024-03-16T07:35:23.123878+0000","last_up_change":"2024-03-16T07:24:27.474980+0000","last_in_change":"2024-03-16T07:24:21.254179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":31,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T07:24:28.947521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":28,"pool_name":"cephfs_metadata","create_time":"2024-03-16T07:35:08.344405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"167","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.309999942779541,"score_stable":1.309999942779541,"optimal_score":1,"raw_score_acting":1.309999942779541,"raw_score_stable":1.309999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":29,"pool_name":"cephfs_data","create_time":"2024-03-16T07:35:09.019172+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"168","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1699999570846558,"score_stable":1.1699999570846558,"optimal_score":1,"raw_score_acting":1.1699999570846558,"raw_score_stable":1.1699999570846558,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":30,"pool_name":"backup_fs_metadata","create_time":"2024-03-16T07:35:21.682702+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"171","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"backup_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.309999942779541,"score_stable":1.309999942779541,"optimal_score":1,"raw_score_acting":1.309999942779541,"raw_score_stable":1.309999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":31,"pool_name":"backup_fs_data","create_time":"2024-03-16T07:35:22.052108+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"171","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"backup_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.0299999713897705,"score_stable":1.0299999713897705,"optimal_score":1,"raw_score_acting":1.0299999713897705,"raw_score_stable":1.0299999713897705,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2df14aac-98dc-4e3c-ae7e-9eb677aa30be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6801","nonce":2744935777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6803","nonce":2744935777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6807","nonce":2744935777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6805","nonce":2744935777}]},"public_addr":"172.21.15.49:6801/2744935777","cluster_addr":"172.21.15.49:6803/2744935777","heartbeat_back_addr":"172.21.15.49:6807/2744935777","heartbeat_front_addr":"172.21.15.49:6805/2744935777","state":["exists","up"]},{"osd":1,"uuid":"80461bd9-59ef-46df-9eea-bad92d960c57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6811","nonce":1655120118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6815","nonce":1655120118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6821","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6823","nonce":1655120118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6817","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6819","nonce":1655120118}]},"public_addr":"172.21.15.49:6811/1655120118","cluster_addr":"172.21.15.49:6815/1655120118","heartbeat_back_addr":"172.21.15.49:6823/1655120118","heartbeat_front_addr":"172.21.15.49:6819/1655120118","state":["exists","up"]},{"osd":2,"uuid":"d6bf40eb-6e42-4ec9-8b3d-0b6c5a6def79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6810","nonce":3815472376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6814","nonce":3815472376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6822","nonce":3815472376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6818","nonce":3815472376}]},"public_addr":"172.21.15.49:6810/3815472376","cluster_addr":"172.21.15.49:6814/3815472376","heartbeat_back_addr":"172.21.15.49:6822/3815472376","heartbeat_front_addr":"172.21.15.49:6818/3815472376","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.641492+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.668598+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.614940+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T07:35:24.061 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T07:35:24.368 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:35:24.368 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":171,"fsid":"f91af061-9eac-4793-87fa-8d27ae3d242f","created":"2024-03-16T07:24:20.357868+0000","modified":"2024-03-16T07:35:23.123878+0000","last_up_change":"2024-03-16T07:24:27.474980+0000","last_in_change":"2024-03-16T07:24:21.254179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":31,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T07:24:28.947521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":28,"pool_name":"cephfs_metadata","create_time":"2024-03-16T07:35:08.344405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"167","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.309999942779541,"score_stable":1.309999942779541,"optimal_score":1,"raw_score_acting":1.309999942779541,"raw_score_stable":1.309999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":29,"pool_name":"cephfs_data","create_time":"2024-03-16T07:35:09.019172+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"168","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1699999570846558,"score_stable":1.1699999570846558,"optimal_score":1,"raw_score_acting":1.1699999570846558,"raw_score_stable":1.1699999570846558,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":30,"pool_name":"backup_fs_metadata","create_time":"2024-03-16T07:35:21.682702+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"171","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"backup_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.309999942779541,"score_stable":1.309999942779541,"optimal_score":1,"raw_score_acting":1.309999942779541,"raw_score_stable":1.309999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":31,"pool_name":"backup_fs_data","create_time":"2024-03-16T07:35:22.052108+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"171","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"backup_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.0299999713897705,"score_stable":1.0299999713897705,"optimal_score":1,"raw_score_acting":1.0299999713897705,"raw_score_stable":1.0299999713897705,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2df14aac-98dc-4e3c-ae7e-9eb677aa30be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6801","nonce":2744935777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6803","nonce":2744935777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6807","nonce":2744935777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6805","nonce":2744935777}]},"public_addr":"172.21.15.49:6801/2744935777","cluster_addr":"172.21.15.49:6803/2744935777","heartbeat_back_addr":"172.21.15.49:6807/2744935777","heartbeat_front_addr":"172.21.15.49:6805/2744935777","state":["exists","up"]},{"osd":1,"uuid":"80461bd9-59ef-46df-9eea-bad92d960c57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6811","nonce":1655120118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6815","nonce":1655120118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6821","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6823","nonce":1655120118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6817","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6819","nonce":1655120118}]},"public_addr":"172.21.15.49:6811/1655120118","cluster_addr":"172.21.15.49:6815/1655120118","heartbeat_back_addr":"172.21.15.49:6823/1655120118","heartbeat_front_addr":"172.21.15.49:6819/1655120118","state":["exists","up"]},{"osd":2,"uuid":"d6bf40eb-6e42-4ec9-8b3d-0b6c5a6def79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6810","nonce":3815472376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6814","nonce":3815472376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6822","nonce":3815472376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6818","nonce":3815472376}]},"public_addr":"172.21.15.49:6810/3815472376","cluster_addr":"172.21.15.49:6814/3815472376","heartbeat_back_addr":"172.21.15.49:6822/3815472376","heartbeat_front_addr":"172.21.15.49:6818/3815472376","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.641492+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.668598+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.614940+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T07:35:24.381 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set backup_fs standby_count_wanted 0 2024-03-16T07:35:25.724 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-03-16T07:35:25.725 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set backup_fs allow_standby_replay false 2024-03-16T07:35:26.726 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'backup_fs' 2024-03-16T07:35:26.727 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T07:35:27.168 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:35:27.168 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":122,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6690,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6827/875237476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":875237476},{"type":"v1","addr":"172.21.15.49:6827","nonce":875237476}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":113},{"gid":6691,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6829/417322500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":417322500},{"type":"v1","addr":"172.21.15.49:6829","nonce":417322500}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":113},{"gid":6696,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6831/4121914730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":4121914730},{"type":"v1","addr":"172.21.15.49:6831","nonce":4121914730}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":113}],"filesystems":[{"mdsmap":{"epoch":116,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-16T07:35:10.038977+0000","modified":"2024-03-16T07:35:12.029087+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6698},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6698":{"gid":6698,"name":"a","rank":0,"incarnation":114,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6835/1838330688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":1838330688},{"type":"v1","addr":"172.21.15.49:6835","nonce":1838330688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[29],"metadata_pool":28,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6698,"qdb_cluster":[6698]},"id":14},{"mdsmap":{"epoch":122,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-16T07:35:23.124362+0000","modified":"2024-03-16T07:35:26.073338+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6697},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6697":{"gid":6697,"name":"e","rank":0,"incarnation":118,"state":"up:active","state_seq":6,"addr":"172.21.15.49:6834/1716116460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":1716116460},{"type":"v1","addr":"172.21.15.49:6834","nonce":1716116460}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[31],"metadata_pool":30,"enabled":true,"fs_name":"backup_fs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6697,"qdb_cluster":[6697]},"id":15}]} 2024-03-16T07:35:27.169 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 122 2024-03-16T07:35:27.181 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T07:35:27.490 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:35:27.490 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":172,"fsid":"f91af061-9eac-4793-87fa-8d27ae3d242f","created":"2024-03-16T07:24:20.357868+0000","modified":"2024-03-16T07:35:24.702383+0000","last_up_change":"2024-03-16T07:24:27.474980+0000","last_in_change":"2024-03-16T07:24:21.254179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":31,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T07:24:28.947521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":28,"pool_name":"cephfs_metadata","create_time":"2024-03-16T07:35:08.344405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"167","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.309999942779541,"score_stable":1.309999942779541,"optimal_score":1,"raw_score_acting":1.309999942779541,"raw_score_stable":1.309999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":29,"pool_name":"cephfs_data","create_time":"2024-03-16T07:35:09.019172+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"168","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1699999570846558,"score_stable":1.1699999570846558,"optimal_score":1,"raw_score_acting":1.1699999570846558,"raw_score_stable":1.1699999570846558,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":30,"pool_name":"backup_fs_metadata","create_time":"2024-03-16T07:35:21.682702+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"171","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"backup_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.309999942779541,"score_stable":1.309999942779541,"optimal_score":1,"raw_score_acting":1.309999942779541,"raw_score_stable":1.309999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":31,"pool_name":"backup_fs_data","create_time":"2024-03-16T07:35:22.052108+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"172","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"backup_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.0299999713897705,"score_stable":1.0299999713897705,"optimal_score":1,"raw_score_acting":1.0299999713897705,"raw_score_stable":1.0299999713897705,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2df14aac-98dc-4e3c-ae7e-9eb677aa30be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6801","nonce":2744935777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6803","nonce":2744935777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6807","nonce":2744935777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6805","nonce":2744935777}]},"public_addr":"172.21.15.49:6801/2744935777","cluster_addr":"172.21.15.49:6803/2744935777","heartbeat_back_addr":"172.21.15.49:6807/2744935777","heartbeat_front_addr":"172.21.15.49:6805/2744935777","state":["exists","up"]},{"osd":1,"uuid":"80461bd9-59ef-46df-9eea-bad92d960c57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6811","nonce":1655120118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6815","nonce":1655120118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6821","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6823","nonce":1655120118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6817","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6819","nonce":1655120118}]},"public_addr":"172.21.15.49:6811/1655120118","cluster_addr":"172.21.15.49:6815/1655120118","heartbeat_back_addr":"172.21.15.49:6823/1655120118","heartbeat_front_addr":"172.21.15.49:6819/1655120118","state":["exists","up"]},{"osd":2,"uuid":"d6bf40eb-6e42-4ec9-8b3d-0b6c5a6def79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6810","nonce":3815472376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6814","nonce":3815472376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6822","nonce":3815472376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6818","nonce":3815472376}]},"public_addr":"172.21.15.49:6810/3815472376","cluster_addr":"172.21.15.49:6814/3815472376","heartbeat_back_addr":"172.21.15.49:6822/3815472376","heartbeat_front_addr":"172.21.15.49:6818/3815472376","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.641492+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.668598+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.614940+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T07:35:27.503 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-03-16T07:35:27.503 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-16T07:35:27.825 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:35:27.828 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2024-03-16T07:35:27.835 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":43,"stamp":"2024-03-16T07:35:26.724687+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596885,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":1162,"num_read_kb":2357,"num_write":449,"num_write_kb":1925,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":298,"ondisk_log_size":298,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":386,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":314572800,"kb_used":120872,"kb_used_data":6508,"kb_used_omap":4,"kb_used_meta":114299,"kb_avail":314451928,"statfs":{"total":322122547200,"available":321998774272,"internally_reserved":0,"allocated":6664192,"data_stored":3394804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":117042511},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.032686"},"pg_stats":[{"pgid":"31.3d","version":"0'0","reported_seq":12,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.718636+0000","last_change":"2024-03-16T07:35:23.741100+0000","last_active":"2024-03-16T07:35:24.718636+0000","last_peered":"2024-03-16T07:35:24.718636+0000","last_clean":"2024-03-16T07:35:24.718636+0000","last_became_active":"2024-03-16T07:35:23.740319+0000","last_became_peered":"2024-03-16T07:35:23.740319+0000","last_unstale":"2024-03-16T07:35:24.718636+0000","last_undegraded":"2024-03-16T07:35:24.718636+0000","last_fullsized":"2024-03-16T07:35:24.718636+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_clean_scrub_stamp":"2024-03-16T07:35:22.691587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:20:00.755718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.3f","version":"0'0","reported_seq":20,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.707042+0000","last_change":"2024-03-16T07:35:10.367781+0000","last_active":"2024-03-16T07:35:24.707042+0000","last_peered":"2024-03-16T07:35:24.707042+0000","last_clean":"2024-03-16T07:35:24.707042+0000","last_became_active":"2024-03-16T07:35:10.367508+0000","last_became_peered":"2024-03-16T07:35:10.367508+0000","last_unstale":"2024-03-16T07:35:24.707042+0000","last_undegraded":"2024-03-16T07:35:24.707042+0000","last_fullsized":"2024-03-16T07:35:24.707042+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:33:36.562323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.3c","version":"0'0","reported_seq":12,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.712639+0000","last_change":"2024-03-16T07:35:23.743204+0000","last_active":"2024-03-16T07:35:24.712639+0000","last_peered":"2024-03-16T07:35:24.712639+0000","last_clean":"2024-03-16T07:35:24.712639+0000","last_became_active":"2024-03-16T07:35:23.742962+0000","last_became_peered":"2024-03-16T07:35:23.742962+0000","last_unstale":"2024-03-16T07:35:24.712639+0000","last_undegraded":"2024-03-16T07:35:24.712639+0000","last_fullsized":"2024-03-16T07:35:24.712639+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_clean_scrub_stamp":"2024-03-16T07:35:22.691587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:08:06.304299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.3e","version":"0'0","reported_seq":20,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.720379+0000","last_change":"2024-03-16T07:35:10.372544+0000","last_active":"2024-03-16T07:35:24.720379+0000","last_peered":"2024-03-16T07:35:24.720379+0000","last_clean":"2024-03-16T07:35:24.720379+0000","last_became_active":"2024-03-16T07:35:10.368326+0000","last_became_peered":"2024-03-16T07:35:10.368326+0000","last_unstale":"2024-03-16T07:35:24.720379+0000","last_undegraded":"2024-03-16T07:35:24.720379+0000","last_fullsized":"2024-03-16T07:35:24.720379+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:24:44.604994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.3f","version":"0'0","reported_seq":12,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.706931+0000","last_change":"2024-03-16T07:35:23.740174+0000","last_active":"2024-03-16T07:35:24.706931+0000","last_peered":"2024-03-16T07:35:24.706931+0000","last_clean":"2024-03-16T07:35:24.706931+0000","last_became_active":"2024-03-16T07:35:23.739928+0000","last_became_peered":"2024-03-16T07:35:23.739928+0000","last_unstale":"2024-03-16T07:35:24.706931+0000","last_undegraded":"2024-03-16T07:35:24.706931+0000","last_fullsized":"2024-03-16T07:35:24.706931+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_clean_scrub_stamp":"2024-03-16T07:35:22.691587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:00:26.182343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.3d","version":"0'0","reported_seq":20,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.720370+0000","last_change":"2024-03-16T07:35:10.370295+0000","last_active":"2024-03-16T07:35:24.720370+0000","last_peered":"2024-03-16T07:35:24.720370+0000","last_clean":"2024-03-16T07:35:24.720370+0000","last_became_active":"2024-03-16T07:35:10.367872+0000","last_became_peered":"2024-03-16T07:35:10.367872+0000","last_unstale":"2024-03-16T07:35:24.720370+0000","last_undegraded":"2024-03-16T07:35:24.720370+0000","last_fullsized":"2024-03-16T07:35:24.720370+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:04:34.471514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.3e","version":"0'0","reported_seq":12,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.708146+0000","last_change":"2024-03-16T07:35:23.735333+0000","last_active":"2024-03-16T07:35:24.708146+0000","last_peered":"2024-03-16T07:35:24.708146+0000","last_clean":"2024-03-16T07:35:24.708146+0000","last_became_active":"2024-03-16T07:35:23.735100+0000","last_became_peered":"2024-03-16T07:35:23.735100+0000","last_unstale":"2024-03-16T07:35:24.708146+0000","last_undegraded":"2024-03-16T07:35:24.708146+0000","last_fullsized":"2024-03-16T07:35:24.708146+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_clean_scrub_stamp":"2024-03-16T07:35:22.691587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:26:40.090864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.3c","version":"0'0","reported_seq":20,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.706547+0000","last_change":"2024-03-16T07:35:10.371287+0000","last_active":"2024-03-16T07:35:24.706547+0000","last_peered":"2024-03-16T07:35:24.706547+0000","last_clean":"2024-03-16T07:35:24.706547+0000","last_became_active":"2024-03-16T07:35:10.370698+0000","last_became_peered":"2024-03-16T07:35:10.370698+0000","last_unstale":"2024-03-16T07:35:24.706547+0000","last_undegraded":"2024-03-16T07:35:24.706547+0000","last_fullsized":"2024-03-16T07:35:24.706547+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:31:50.883971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.39","version":"0'0","reported_seq":12,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.704781+0000","last_change":"2024-03-16T07:35:23.740099+0000","last_active":"2024-03-16T07:35:24.704781+0000","last_peered":"2024-03-16T07:35:24.704781+0000","last_clean":"2024-03-16T07:35:24.704781+0000","last_became_active":"2024-03-16T07:35:23.739527+0000","last_became_peered":"2024-03-16T07:35:23.739527+0000","last_unstale":"2024-03-16T07:35:24.704781+0000","last_undegraded":"2024-03-16T07:35:24.704781+0000","last_fullsized":"2024-03-16T07:35:24.704781+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_clean_scrub_stamp":"2024-03-16T07:35:22.691587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:10:56.422261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.3b","version":"0'0","reported_seq":20,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.707278+0000","last_change":"2024-03-16T07:35:10.372081+0000","last_active":"2024-03-16T07:35:24.707278+0000","last_peered":"2024-03-16T07:35:24.707278+0000","last_clean":"2024-03-16T07:35:24.707278+0000","last_became_active":"2024-03-16T07:35:10.371181+0000","last_became_peered":"2024-03-16T07:35:10.371181+0000","last_unstale":"2024-03-16T07:35:24.707278+0000","last_undegraded":"2024-03-16T07:35:24.707278+0000","last_fullsized":"2024-03-16T07:35:24.707278+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:13:41.138671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.38","version":"0'0","reported_seq":12,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.704579+0000","last_change":"2024-03-16T07:35:23.746155+0000","last_active":"2024-03-16T07:35:24.704579+0000","last_peered":"2024-03-16T07:35:24.704579+0000","last_clean":"2024-03-16T07:35:24.704579+0000","last_became_active":"2024-03-16T07:35:23.745850+0000","last_became_peered":"2024-03-16T07:35:23.745850+0000","last_unstale":"2024-03-16T07:35:24.704579+0000","last_undegraded":"2024-03-16T07:35:24.704579+0000","last_fullsized":"2024-03-16T07:35:24.704579+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_clean_scrub_stamp":"2024-03-16T07:35:22.691587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:37:08.647094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.3a","version":"0'0","reported_seq":20,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.706132+0000","last_change":"2024-03-16T07:35:10.361524+0000","last_active":"2024-03-16T07:35:24.706132+0000","last_peered":"2024-03-16T07:35:24.706132+0000","last_clean":"2024-03-16T07:35:24.706132+0000","last_became_active":"2024-03-16T07:35:10.361243+0000","last_became_peered":"2024-03-16T07:35:10.361243+0000","last_unstale":"2024-03-16T07:35:24.706132+0000","last_undegraded":"2024-03-16T07:35:24.706132+0000","last_fullsized":"2024-03-16T07:35:24.706132+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:47:30.843632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.3b","version":"0'0","reported_seq":12,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.706674+0000","last_change":"2024-03-16T07:35:23.731282+0000","last_active":"2024-03-16T07:35:24.706674+0000","last_peered":"2024-03-16T07:35:24.706674+0000","last_clean":"2024-03-16T07:35:24.706674+0000","last_became_active":"2024-03-16T07:35:23.730874+0000","last_became_peered":"2024-03-16T07:35:23.730874+0000","last_unstale":"2024-03-16T07:35:24.706674+0000","last_undegraded":"2024-03-16T07:35:24.706674+0000","last_fullsized":"2024-03-16T07:35:24.706674+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_clean_scrub_stamp":"2024-03-16T07:35:22.691587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:16:47.165112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.39","version":"0'0","reported_seq":20,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.717444+0000","last_change":"2024-03-16T07:35:10.366571+0000","last_active":"2024-03-16T07:35:24.717444+0000","last_peered":"2024-03-16T07:35:24.717444+0000","last_clean":"2024-03-16T07:35:24.717444+0000","last_became_active":"2024-03-16T07:35:10.366265+0000","last_became_peered":"2024-03-16T07:35:10.366265+0000","last_unstale":"2024-03-16T07:35:24.717444+0000","last_undegraded":"2024-03-16T07:35:24.717444+0000","last_fullsized":"2024-03-16T07:35:24.717444+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:42:46.372194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.3a","version":"0'0","reported_seq":12,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.712146+0000","last_change":"2024-03-16T07:35:23.742331+0000","last_active":"2024-03-16T07:35:24.712146+0000","last_peered":"2024-03-16T07:35:24.712146+0000","last_clean":"2024-03-16T07:35:24.712146+0000","last_became_active":"2024-03-16T07:35:23.741557+0000","last_became_peered":"2024-03-16T07:35:23.741557+0000","last_unstale":"2024-03-16T07:35:24.712146+0000","last_undegraded":"2024-03-16T07:35:24.712146+0000","last_fullsized":"2024-03-16T07:35:24.712146+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_clean_scrub_stamp":"2024-03-16T07:35:22.691587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:52:18.294575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.38","version":"0'0","reported_seq":20,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.711891+0000","last_change":"2024-03-16T07:35:10.364222+0000","last_active":"2024-03-16T07:35:24.711891+0000","last_peered":"2024-03-16T07:35:24.711891+0000","last_clean":"2024-03-16T07:35:24.711891+0000","last_became_active":"2024-03-16T07:35:10.363574+0000","last_became_peered":"2024-03-16T07:35:10.363574+0000","last_unstale":"2024-03-16T07:35:24.711891+0000","last_undegraded":"2024-03-16T07:35:24.711891+0000","last_fullsized":"2024-03-16T07:35:24.711891+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:59:27.601739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.35","version":"0'0","reported_seq":12,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.719941+0000","last_change":"2024-03-16T07:35:23.740911+0000","last_active":"2024-03-16T07:35:24.719941+0000","last_peered":"2024-03-16T07:35:24.719941+0000","last_clean":"2024-03-16T07:35:24.719941+0000","last_became_active":"2024-03-16T07:35:23.739990+0000","last_became_peered":"2024-03-16T07:35:23.739990+0000","last_unstale":"2024-03-16T07:35:24.719941+0000","last_undegraded":"2024-03-16T07:35:24.719941+0000","last_fullsized":"2024-03-16T07:35:24.719941+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_clean_scrub_stamp":"2024-03-16T07:35:22.691587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:44:09.750183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.37","version":"0'0","reported_seq":20,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.713195+0000","last_change":"2024-03-16T07:35:10.363569+0000","last_active":"2024-03-16T07:35:24.713195+0000","last_peered":"2024-03-16T07:35:24.713195+0000","last_clean":"2024-03-16T07:35:24.713195+0000","last_became_active":"2024-03-16T07:35:10.362745+0000","last_became_peered":"2024-03-16T07:35:10.362745+0000","last_unstale":"2024-03-16T07:35:24.713195+0000","last_undegraded":"2024-03-16T07:35:24.713195+0000","last_fullsized":"2024-03-16T07:35:24.713195+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:49:26.412783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.34","version":"0'0","reported_seq":12,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.717950+0000","last_change":"2024-03-16T07:35:23.747295+0000","last_active":"2024-03-16T07:35:24.717950+0000","last_peered":"2024-03-16T07:35:24.717950+0000","last_clean":"2024-03-16T07:35:24.717950+0000","last_became_active":"2024-03-16T07:35:23.747050+0000","last_became_peered":"2024-03-16T07:35:23.747050+0000","last_unstale":"2024-03-16T07:35:24.717950+0000","last_undegraded":"2024-03-16T07:35:24.717950+0000","last_fullsized":"2024-03-16T07:35:24.717950+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_clean_scrub_stamp":"2024-03-16T07:35:22.691587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:42:06.491279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.36","version":"0'0","reported_seq":20,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.708736+0000","last_change":"2024-03-16T07:35:10.368073+0000","last_active":"2024-03-16T07:35:24.708736+0000","last_peered":"2024-03-16T07:35:24.708736+0000","last_clean":"2024-03-16T07:35:24.708736+0000","last_became_active":"2024-03-16T07:35:10.367391+0000","last_became_peered":"2024-03-16T07:35:10.367391+0000","last_unstale":"2024-03-16T07:35:24.708736+0000","last_undegraded":"2024-03-16T07:35:24.708736+0000","last_fullsized":"2024-03-16T07:35:24.708736+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:23:56.310435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.37","version":"0'0","reported_seq":12,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.713482+0000","last_change":"2024-03-16T07:35:23.728634+0000","last_active":"2024-03-16T07:35:24.713482+0000","last_peered":"2024-03-16T07:35:24.713482+0000","last_clean":"2024-03-16T07:35:24.713482+0000","last_became_active":"2024-03-16T07:35:23.728390+0000","last_became_peered":"2024-03-16T07:35:23.728390+0000","last_unstale":"2024-03-16T07:35:24.713482+0000","last_undegraded":"2024-03-16T07:35:24.713482+0000","last_fullsized":"2024-03-16T07:35:24.713482+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_clean_scrub_stamp":"2024-03-16T07:35:22.691587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:07:26.593450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.35","version":"0'0","reported_seq":20,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.720352+0000","last_change":"2024-03-16T07:35:10.368280+0000","last_active":"2024-03-16T07:35:24.720352+0000","last_peered":"2024-03-16T07:35:24.720352+0000","last_clean":"2024-03-16T07:35:24.720352+0000","last_became_active":"2024-03-16T07:35:10.367563+0000","last_became_peered":"2024-03-16T07:35:10.367563+0000","last_unstale":"2024-03-16T07:35:24.720352+0000","last_undegraded":"2024-03-16T07:35:24.720352+0000","last_fullsized":"2024-03-16T07:35:24.720352+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:47:25.833895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.36","version":"0'0","reported_seq":12,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.713567+0000","last_change":"2024-03-16T07:35:23.740227+0000","last_active":"2024-03-16T07:35:24.713567+0000","last_peered":"2024-03-16T07:35:24.713567+0000","last_clean":"2024-03-16T07:35:24.713567+0000","last_became_active":"2024-03-16T07:35:23.739523+0000","last_became_peered":"2024-03-16T07:35:23.739523+0000","last_unstale":"2024-03-16T07:35:24.713567+0000","last_undegraded":"2024-03-16T07:35:24.713567+0000","last_fullsized":"2024-03-16T07:35:24.713567+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_clean_scrub_stamp":"2024-03-16T07:35:22.691587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:30:30.306678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.34","version":"0'0","reported_seq":20,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.713036+0000","last_change":"2024-03-16T07:35:10.363259+0000","last_active":"2024-03-16T07:35:24.713036+0000","last_peered":"2024-03-16T07:35:24.713036+0000","last_clean":"2024-03-16T07:35:24.713036+0000","last_became_active":"2024-03-16T07:35:10.363011+0000","last_became_peered":"2024-03-16T07:35:10.363011+0000","last_unstale":"2024-03-16T07:35:24.713036+0000","last_undegraded":"2024-03-16T07:35:24.713036+0000","last_fullsized":"2024-03-16T07:35:24.713036+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:09:56.033035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.31","version":"0'0","reported_seq":12,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.717125+0000","last_change":"2024-03-16T07:35:23.741863+0000","last_active":"2024-03-16T07:35:24.717125+0000","last_peered":"2024-03-16T07:35:24.717125+0000","last_clean":"2024-03-16T07:35:24.717125+0000","last_became_active":"2024-03-16T07:35:23.741382+0000","last_became_peered":"2024-03-16T07:35:23.741382+0000","last_unstale":"2024-03-16T07:35:24.717125+0000","last_undegraded":"2024-03-16T07:35:24.717125+0000","last_fullsized":"2024-03-16T07:35:24.717125+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_clean_scrub_stamp":"2024-03-16T07:35:22.691587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:11:58.611782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.33","version":"0'0","reported_seq":20,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.707375+0000","last_change":"2024-03-16T07:35:10.369777+0000","last_active":"2024-03-16T07:35:24.707375+0000","last_peered":"2024-03-16T07:35:24.707375+0000","last_clean":"2024-03-16T07:35:24.707375+0000","last_became_active":"2024-03-16T07:35:10.367275+0000","last_became_peered":"2024-03-16T07:35:10.367275+0000","last_unstale":"2024-03-16T07:35:24.707375+0000","last_undegraded":"2024-03-16T07:35:24.707375+0000","last_fullsized":"2024-03-16T07:35:24.707375+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:49:33.888160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.30","version":"0'0","reported_seq":12,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.716747+0000","last_change":"2024-03-16T07:35:23.734039+0000","last_active":"2024-03-16T07:35:24.716747+0000","last_peered":"2024-03-16T07:35:24.716747+0000","last_clean":"2024-03-16T07:35:24.716747+0000","last_became_active":"2024-03-16T07:35:23.733493+0000","last_became_peered":"2024-03-16T07:35:23.733493+0000","last_unstale":"2024-03-16T07:35:24.716747+0000","last_undegraded":"2024-03-16T07:35:24.716747+0000","last_fullsized":"2024-03-16T07:35:24.716747+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_clean_scrub_stamp":"2024-03-16T07:35:22.691587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:52:13.859847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.32","version":"0'0","reported_seq":20,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.718063+0000","last_change":"2024-03-16T07:35:10.373263+0000","last_active":"2024-03-16T07:35:24.718063+0000","last_peered":"2024-03-16T07:35:24.718063+0000","last_clean":"2024-03-16T07:35:24.718063+0000","last_became_active":"2024-03-16T07:35:10.372048+0000","last_became_peered":"2024-03-16T07:35:10.372048+0000","last_unstale":"2024-03-16T07:35:24.718063+0000","last_undegraded":"2024-03-16T07:35:24.718063+0000","last_fullsized":"2024-03-16T07:35:24.718063+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:38:41.747041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.33","version":"0'0","reported_seq":12,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.714959+0000","last_change":"2024-03-16T07:35:23.722966+0000","last_active":"2024-03-16T07:35:24.714959+0000","last_peered":"2024-03-16T07:35:24.714959+0000","last_clean":"2024-03-16T07:35:24.714959+0000","last_became_active":"2024-03-16T07:35:23.722534+0000","last_became_peered":"2024-03-16T07:35:23.722534+0000","last_unstale":"2024-03-16T07:35:24.714959+0000","last_undegraded":"2024-03-16T07:35:24.714959+0000","last_fullsized":"2024-03-16T07:35:24.714959+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_clean_scrub_stamp":"2024-03-16T07:35:22.691587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:09:10.466734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.31","version":"0'0","reported_seq":20,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.717572+0000","last_change":"2024-03-16T07:35:10.366534+0000","last_active":"2024-03-16T07:35:24.717572+0000","last_peered":"2024-03-16T07:35:24.717572+0000","last_clean":"2024-03-16T07:35:24.717572+0000","last_became_active":"2024-03-16T07:35:10.365923+0000","last_became_peered":"2024-03-16T07:35:10.365923+0000","last_unstale":"2024-03-16T07:35:24.717572+0000","last_undegraded":"2024-03-16T07:35:24.717572+0000","last_fullsized":"2024-03-16T07:35:24.717572+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:28:54.985535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.32","version":"0'0","reported_seq":12,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.705858+0000","last_change":"2024-03-16T07:35:23.744004+0000","last_active":"2024-03-16T07:35:24.705858+0000","last_peered":"2024-03-16T07:35:24.705858+0000","last_clean":"2024-03-16T07:35:24.705858+0000","last_became_active":"2024-03-16T07:35:23.743786+0000","last_became_peered":"2024-03-16T07:35:23.743786+0000","last_unstale":"2024-03-16T07:35:24.705858+0000","last_undegraded":"2024-03-16T07:35:24.705858+0000","last_fullsized":"2024-03-16T07:35:24.705858+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_clean_scrub_stamp":"2024-03-16T07:35:22.691587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:24:57.639941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.30","version":"0'0","reported_seq":20,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.712001+0000","last_change":"2024-03-16T07:35:10.364026+0000","last_active":"2024-03-16T07:35:24.712001+0000","last_peered":"2024-03-16T07:35:24.712001+0000","last_clean":"2024-03-16T07:35:24.712001+0000","last_became_active":"2024-03-16T07:35:10.363364+0000","last_became_peered":"2024-03-16T07:35:10.363364+0000","last_unstale":"2024-03-16T07:35:24.712001+0000","last_undegraded":"2024-03-16T07:35:24.712001+0000","last_fullsized":"2024-03-16T07:35:24.712001+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:13:13.289445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.2d","version":"0'0","reported_seq":12,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.713195+0000","last_change":"2024-03-16T07:35:23.742512+0000","last_active":"2024-03-16T07:35:24.713195+0000","last_peered":"2024-03-16T07:35:24.713195+0000","last_clean":"2024-03-16T07:35:24.713195+0000","last_became_active":"2024-03-16T07:35:23.742222+0000","last_became_peered":"2024-03-16T07:35:23.742222+0000","last_unstale":"2024-03-16T07:35:24.713195+0000","last_undegraded":"2024-03-16T07:35:24.713195+0000","last_fullsized":"2024-03-16T07:35:24.713195+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_clean_scrub_stamp":"2024-03-16T07:35:22.691587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:33:49.079367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.2f","version":"0'0","reported_seq":20,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.707130+0000","last_change":"2024-03-16T07:35:10.365876+0000","last_active":"2024-03-16T07:35:24.707130+0000","last_peered":"2024-03-16T07:35:24.707130+0000","last_clean":"2024-03-16T07:35:24.707130+0000","last_became_active":"2024-03-16T07:35:10.365174+0000","last_became_peered":"2024-03-16T07:35:10.365174+0000","last_unstale":"2024-03-16T07:35:24.707130+0000","last_undegraded":"2024-03-16T07:35:24.707130+0000","last_fullsized":"2024-03-16T07:35:24.707130+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:20:58.883037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.2c","version":"0'0","reported_seq":12,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.712810+0000","last_change":"2024-03-16T07:35:23.729156+0000","last_active":"2024-03-16T07:35:24.712810+0000","last_peered":"2024-03-16T07:35:24.712810+0000","last_clean":"2024-03-16T07:35:24.712810+0000","last_became_active":"2024-03-16T07:35:23.728848+0000","last_became_peered":"2024-03-16T07:35:23.728848+0000","last_unstale":"2024-03-16T07:35:24.712810+0000","last_undegraded":"2024-03-16T07:35:24.712810+0000","last_fullsized":"2024-03-16T07:35:24.712810+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_clean_scrub_stamp":"2024-03-16T07:35:22.691587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:20:27.491291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.2e","version":"0'0","reported_seq":20,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.720478+0000","last_change":"2024-03-16T07:35:10.371679+0000","last_active":"2024-03-16T07:35:24.720478+0000","last_peered":"2024-03-16T07:35:24.720478+0000","last_clean":"2024-03-16T07:35:24.720478+0000","last_became_active":"2024-03-16T07:35:10.370469+0000","last_became_peered":"2024-03-16T07:35:10.370469+0000","last_unstale":"2024-03-16T07:35:24.720478+0000","last_undegraded":"2024-03-16T07:35:24.720478+0000","last_fullsized":"2024-03-16T07:35:24.720478+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:16:34.130165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.2f","version":"0'0","reported_seq":12,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.718694+0000","last_change":"2024-03-16T07:35:23.731351+0000","last_active":"2024-03-16T07:35:24.718694+0000","last_peered":"2024-03-16T07:35:24.718694+0000","last_clean":"2024-03-16T07:35:24.718694+0000","last_became_active":"2024-03-16T07:35:23.730887+0000","last_became_peered":"2024-03-16T07:35:23.730887+0000","last_unstale":"2024-03-16T07:35:24.718694+0000","last_undegraded":"2024-03-16T07:35:24.718694+0000","last_fullsized":"2024-03-16T07:35:24.718694+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_clean_scrub_stamp":"2024-03-16T07:35:22.691587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:45:49.521925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.2d","version":"0'0","reported_seq":20,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.708842+0000","last_change":"2024-03-16T07:35:10.369578+0000","last_active":"2024-03-16T07:35:24.708842+0000","last_peered":"2024-03-16T07:35:24.708842+0000","last_clean":"2024-03-16T07:35:24.708842+0000","last_became_active":"2024-03-16T07:35:10.369324+0000","last_became_peered":"2024-03-16T07:35:10.369324+0000","last_unstale":"2024-03-16T07:35:24.708842+0000","last_undegraded":"2024-03-16T07:35:24.708842+0000","last_fullsized":"2024-03-16T07:35:24.708842+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:36:36.291133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.2e","version":"0'0","reported_seq":12,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.709191+0000","last_change":"2024-03-16T07:35:23.734849+0000","last_active":"2024-03-16T07:35:24.709191+0000","last_peered":"2024-03-16T07:35:24.709191+0000","last_clean":"2024-03-16T07:35:24.709191+0000","last_became_active":"2024-03-16T07:35:23.731290+0000","last_became_peered":"2024-03-16T07:35:23.731290+0000","last_unstale":"2024-03-16T07:35:24.709191+0000","last_undegraded":"2024-03-16T07:35:24.709191+0000","last_fullsized":"2024-03-16T07:35:24.709191+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_clean_scrub_stamp":"2024-03-16T07:35:22.691587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:35:50.418638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.2c","version":"0'0","reported_seq":20,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.719989+0000","last_change":"2024-03-16T07:35:10.371246+0000","last_active":"2024-03-16T07:35:24.719989+0000","last_peered":"2024-03-16T07:35:24.719989+0000","last_clean":"2024-03-16T07:35:24.719989+0000","last_became_active":"2024-03-16T07:35:10.370745+0000","last_became_peered":"2024-03-16T07:35:10.370745+0000","last_unstale":"2024-03-16T07:35:24.719989+0000","last_undegraded":"2024-03-16T07:35:24.719989+0000","last_fullsized":"2024-03-16T07:35:24.719989+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:28:06.363187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.29","version":"0'0","reported_seq":12,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.713767+0000","last_change":"2024-03-16T07:35:23.724277+0000","last_active":"2024-03-16T07:35:24.713767+0000","last_peered":"2024-03-16T07:35:24.713767+0000","last_clean":"2024-03-16T07:35:24.713767+0000","last_became_active":"2024-03-16T07:35:23.724091+0000","last_became_peered":"2024-03-16T07:35:23.724091+0000","last_unstale":"2024-03-16T07:35:24.713767+0000","last_undegraded":"2024-03-16T07:35:24.713767+0000","last_fullsized":"2024-03-16T07:35:24.713767+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_clean_scrub_stamp":"2024-03-16T07:35:22.691587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:45:58.075461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.2b","version":"0'0","reported_seq":20,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.707461+0000","last_change":"2024-03-16T07:35:10.371877+0000","last_active":"2024-03-16T07:35:24.707461+0000","last_peered":"2024-03-16T07:35:24.707461+0000","last_clean":"2024-03-16T07:35:24.707461+0000","last_became_active":"2024-03-16T07:35:10.370864+0000","last_became_peered":"2024-03-16T07:35:10.370864+0000","last_unstale":"2024-03-16T07:35:24.707461+0000","last_undegraded":"2024-03-16T07:35:24.707461+0000","last_fullsized":"2024-03-16T07:35:24.707461+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:06:42.126915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.28","version":"0'0","reported_seq":12,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.704613+0000","last_change":"2024-03-16T07:35:23.746169+0000","last_active":"2024-03-16T07:35:24.704613+0000","last_peered":"2024-03-16T07:35:24.704613+0000","last_clean":"2024-03-16T07:35:24.704613+0000","last_became_active":"2024-03-16T07:35:23.745811+0000","last_became_peered":"2024-03-16T07:35:23.745811+0000","last_unstale":"2024-03-16T07:35:24.704613+0000","last_undegraded":"2024-03-16T07:35:24.704613+0000","last_fullsized":"2024-03-16T07:35:24.704613+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_clean_scrub_stamp":"2024-03-16T07:35:22.691587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:21:02.636116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.2a","version":"0'0","reported_seq":20,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.718066+0000","last_change":"2024-03-16T07:35:10.373482+0000","last_active":"2024-03-16T07:35:24.718066+0000","last_peered":"2024-03-16T07:35:24.718066+0000","last_clean":"2024-03-16T07:35:24.718066+0000","last_became_active":"2024-03-16T07:35:10.368788+0000","last_became_peered":"2024-03-16T07:35:10.368788+0000","last_unstale":"2024-03-16T07:35:24.718066+0000","last_undegraded":"2024-03-16T07:35:24.718066+0000","last_fullsized":"2024-03-16T07:35:24.718066+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:48:46.681695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.2b","version":"0'0","reported_seq":12,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.707882+0000","last_change":"2024-03-16T07:35:23.739092+0000","last_active":"2024-03-16T07:35:24.707882+0000","last_peered":"2024-03-16T07:35:24.707882+0000","last_clean":"2024-03-16T07:35:24.707882+0000","last_became_active":"2024-03-16T07:35:23.738866+0000","last_became_peered":"2024-03-16T07:35:23.738866+0000","last_unstale":"2024-03-16T07:35:24.707882+0000","last_undegraded":"2024-03-16T07:35:24.707882+0000","last_fullsized":"2024-03-16T07:35:24.707882+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_clean_scrub_stamp":"2024-03-16T07:35:22.691587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:35:05.562417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.29","version":"0'0","reported_seq":20,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.705186+0000","last_change":"2024-03-16T07:35:10.367542+0000","last_active":"2024-03-16T07:35:24.705186+0000","last_peered":"2024-03-16T07:35:24.705186+0000","last_clean":"2024-03-16T07:35:24.705186+0000","last_became_active":"2024-03-16T07:35:10.366618+0000","last_became_peered":"2024-03-16T07:35:10.366618+0000","last_unstale":"2024-03-16T07:35:24.705186+0000","last_undegraded":"2024-03-16T07:35:24.705186+0000","last_fullsized":"2024-03-16T07:35:24.705186+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:50:44.094141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.2a","version":"0'0","reported_seq":12,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.712291+0000","last_change":"2024-03-16T07:35:23.711399+0000","last_active":"2024-03-16T07:35:24.712291+0000","last_peered":"2024-03-16T07:35:24.712291+0000","last_clean":"2024-03-16T07:35:24.712291+0000","last_became_active":"2024-03-16T07:35:23.711169+0000","last_became_peered":"2024-03-16T07:35:23.711169+0000","last_unstale":"2024-03-16T07:35:24.712291+0000","last_undegraded":"2024-03-16T07:35:24.712291+0000","last_fullsized":"2024-03-16T07:35:24.712291+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_clean_scrub_stamp":"2024-03-16T07:35:22.691587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:18:21.074508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.28","version":"0'0","reported_seq":20,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.705020+0000","last_change":"2024-03-16T07:35:10.369012+0000","last_active":"2024-03-16T07:35:24.705020+0000","last_peered":"2024-03-16T07:35:24.705020+0000","last_clean":"2024-03-16T07:35:24.705020+0000","last_became_active":"2024-03-16T07:35:10.368755+0000","last_became_peered":"2024-03-16T07:35:10.368755+0000","last_unstale":"2024-03-16T07:35:24.705020+0000","last_undegraded":"2024-03-16T07:35:24.705020+0000","last_fullsized":"2024-03-16T07:35:24.705020+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:22:08.758800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.25","version":"0'0","reported_seq":12,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.718795+0000","last_change":"2024-03-16T07:35:23.740716+0000","last_active":"2024-03-16T07:35:24.718795+0000","last_peered":"2024-03-16T07:35:24.718795+0000","last_clean":"2024-03-16T07:35:24.718795+0000","last_became_active":"2024-03-16T07:35:23.739660+0000","last_became_peered":"2024-03-16T07:35:23.739660+0000","last_unstale":"2024-03-16T07:35:24.718795+0000","last_undegraded":"2024-03-16T07:35:24.718795+0000","last_fullsized":"2024-03-16T07:35:24.718795+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_clean_scrub_stamp":"2024-03-16T07:35:22.691587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:06:14.816932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.27","version":"0'0","reported_seq":20,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.720251+0000","last_change":"2024-03-16T07:35:10.364840+0000","last_active":"2024-03-16T07:35:24.720251+0000","last_peered":"2024-03-16T07:35:24.720251+0000","last_clean":"2024-03-16T07:35:24.720251+0000","last_became_active":"2024-03-16T07:35:10.364570+0000","last_became_peered":"2024-03-16T07:35:10.364570+0000","last_unstale":"2024-03-16T07:35:24.720251+0000","last_undegraded":"2024-03-16T07:35:24.720251+0000","last_fullsized":"2024-03-16T07:35:24.720251+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:55:24.586189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.24","version":"0'0","reported_seq":12,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.706315+0000","last_change":"2024-03-16T07:35:23.728317+0000","last_active":"2024-03-16T07:35:24.706315+0000","last_peered":"2024-03-16T07:35:24.706315+0000","last_clean":"2024-03-16T07:35:24.706315+0000","last_became_active":"2024-03-16T07:35:23.728092+0000","last_became_peered":"2024-03-16T07:35:23.728092+0000","last_unstale":"2024-03-16T07:35:24.706315+0000","last_undegraded":"2024-03-16T07:35:24.706315+0000","last_fullsized":"2024-03-16T07:35:24.706315+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_clean_scrub_stamp":"2024-03-16T07:35:22.691587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:58:33.910854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.26","version":"0'0","reported_seq":20,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.714399+0000","last_change":"2024-03-16T07:35:10.359654+0000","last_active":"2024-03-16T07:35:24.714399+0000","last_peered":"2024-03-16T07:35:24.714399+0000","last_clean":"2024-03-16T07:35:24.714399+0000","last_became_active":"2024-03-16T07:35:10.359424+0000","last_became_peered":"2024-03-16T07:35:10.359424+0000","last_unstale":"2024-03-16T07:35:24.714399+0000","last_undegraded":"2024-03-16T07:35:24.714399+0000","last_fullsized":"2024-03-16T07:35:24.714399+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:09:58.877836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.27","version":"0'0","reported_seq":12,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.713866+0000","last_change":"2024-03-16T07:35:23.733322+0000","last_active":"2024-03-16T07:35:24.713866+0000","last_peered":"2024-03-16T07:35:24.713866+0000","last_clean":"2024-03-16T07:35:24.713866+0000","last_became_active":"2024-03-16T07:35:23.732783+0000","last_became_peered":"2024-03-16T07:35:23.732783+0000","last_unstale":"2024-03-16T07:35:24.713866+0000","last_undegraded":"2024-03-16T07:35:24.713866+0000","last_fullsized":"2024-03-16T07:35:24.713866+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_clean_scrub_stamp":"2024-03-16T07:35:22.691587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:44:54.538217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.25","version":"0'0","reported_seq":20,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.720509+0000","last_change":"2024-03-16T07:35:10.368078+0000","last_active":"2024-03-16T07:35:24.720509+0000","last_peered":"2024-03-16T07:35:24.720509+0000","last_clean":"2024-03-16T07:35:24.720509+0000","last_became_active":"2024-03-16T07:35:10.367079+0000","last_became_peered":"2024-03-16T07:35:10.367079+0000","last_unstale":"2024-03-16T07:35:24.720509+0000","last_undegraded":"2024-03-16T07:35:24.720509+0000","last_fullsized":"2024-03-16T07:35:24.720509+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:36:55.612147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.26","version":"0'0","reported_seq":12,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.708284+0000","last_change":"2024-03-16T07:35:23.743473+0000","last_active":"2024-03-16T07:35:24.708284+0000","last_peered":"2024-03-16T07:35:24.708284+0000","last_clean":"2024-03-16T07:35:24.708284+0000","last_became_active":"2024-03-16T07:35:23.741697+0000","last_became_peered":"2024-03-16T07:35:23.741697+0000","last_unstale":"2024-03-16T07:35:24.708284+0000","last_undegraded":"2024-03-16T07:35:24.708284+0000","last_fullsized":"2024-03-16T07:35:24.708284+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_clean_scrub_stamp":"2024-03-16T07:35:22.691587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:34:05.463269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.24","version":"0'0","reported_seq":20,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.713120+0000","last_change":"2024-03-16T07:35:10.363356+0000","last_active":"2024-03-16T07:35:24.713120+0000","last_peered":"2024-03-16T07:35:24.713120+0000","last_clean":"2024-03-16T07:35:24.713120+0000","last_became_active":"2024-03-16T07:35:10.362988+0000","last_became_peered":"2024-03-16T07:35:10.362988+0000","last_unstale":"2024-03-16T07:35:24.713120+0000","last_undegraded":"2024-03-16T07:35:24.713120+0000","last_fullsized":"2024-03-16T07:35:24.713120+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:55:56.804868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.21","version":"0'0","reported_seq":12,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.714235+0000","last_change":"2024-03-16T07:35:23.719499+0000","last_active":"2024-03-16T07:35:24.714235+0000","last_peered":"2024-03-16T07:35:24.714235+0000","last_clean":"2024-03-16T07:35:24.714235+0000","last_became_active":"2024-03-16T07:35:23.719234+0000","last_became_peered":"2024-03-16T07:35:23.719234+0000","last_unstale":"2024-03-16T07:35:24.714235+0000","last_undegraded":"2024-03-16T07:35:24.714235+0000","last_fullsized":"2024-03-16T07:35:24.714235+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_clean_scrub_stamp":"2024-03-16T07:35:22.691587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:07:43.832241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.23","version":"0'0","reported_seq":20,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.714633+0000","last_change":"2024-03-16T07:35:10.359431+0000","last_active":"2024-03-16T07:35:24.714633+0000","last_peered":"2024-03-16T07:35:24.714633+0000","last_clean":"2024-03-16T07:35:24.714633+0000","last_became_active":"2024-03-16T07:35:10.358815+0000","last_became_peered":"2024-03-16T07:35:10.358815+0000","last_unstale":"2024-03-16T07:35:24.714633+0000","last_undegraded":"2024-03-16T07:35:24.714633+0000","last_fullsized":"2024-03-16T07:35:24.714633+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:33:06.548770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.20","version":"0'0","reported_seq":12,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.705027+0000","last_change":"2024-03-16T07:35:23.726921+0000","last_active":"2024-03-16T07:35:24.705027+0000","last_peered":"2024-03-16T07:35:24.705027+0000","last_clean":"2024-03-16T07:35:24.705027+0000","last_became_active":"2024-03-16T07:35:23.717436+0000","last_became_peered":"2024-03-16T07:35:23.717436+0000","last_unstale":"2024-03-16T07:35:24.705027+0000","last_undegraded":"2024-03-16T07:35:24.705027+0000","last_fullsized":"2024-03-16T07:35:24.705027+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_clean_scrub_stamp":"2024-03-16T07:35:22.691587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:00:42.915674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.22","version":"0'0","reported_seq":20,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.718172+0000","last_change":"2024-03-16T07:35:10.372992+0000","last_active":"2024-03-16T07:35:24.718172+0000","last_peered":"2024-03-16T07:35:24.718172+0000","last_clean":"2024-03-16T07:35:24.718172+0000","last_became_active":"2024-03-16T07:35:10.371612+0000","last_became_peered":"2024-03-16T07:35:10.371612+0000","last_unstale":"2024-03-16T07:35:24.718172+0000","last_undegraded":"2024-03-16T07:35:24.718172+0000","last_fullsized":"2024-03-16T07:35:24.718172+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:33:17.816236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.23","version":"0'0","reported_seq":12,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.718085+0000","last_change":"2024-03-16T07:35:23.737713+0000","last_active":"2024-03-16T07:35:24.718085+0000","last_peered":"2024-03-16T07:35:24.718085+0000","last_clean":"2024-03-16T07:35:24.718085+0000","last_became_active":"2024-03-16T07:35:23.736602+0000","last_became_peered":"2024-03-16T07:35:23.736602+0000","last_unstale":"2024-03-16T07:35:24.718085+0000","last_undegraded":"2024-03-16T07:35:24.718085+0000","last_fullsized":"2024-03-16T07:35:24.718085+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_clean_scrub_stamp":"2024-03-16T07:35:22.691587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:47:12.528918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.21","version":"0'0","reported_seq":20,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.705279+0000","last_change":"2024-03-16T07:35:10.372894+0000","last_active":"2024-03-16T07:35:24.705279+0000","last_peered":"2024-03-16T07:35:24.705279+0000","last_clean":"2024-03-16T07:35:24.705279+0000","last_became_active":"2024-03-16T07:35:10.372610+0000","last_became_peered":"2024-03-16T07:35:10.372610+0000","last_unstale":"2024-03-16T07:35:24.705279+0000","last_undegraded":"2024-03-16T07:35:24.705279+0000","last_fullsized":"2024-03-16T07:35:24.705279+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:24:54.886451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.22","version":"0'0","reported_seq":12,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.712434+0000","last_change":"2024-03-16T07:35:23.711031+0000","last_active":"2024-03-16T07:35:24.712434+0000","last_peered":"2024-03-16T07:35:24.712434+0000","last_clean":"2024-03-16T07:35:24.712434+0000","last_became_active":"2024-03-16T07:35:23.710804+0000","last_became_peered":"2024-03-16T07:35:23.710804+0000","last_unstale":"2024-03-16T07:35:24.712434+0000","last_undegraded":"2024-03-16T07:35:24.712434+0000","last_fullsized":"2024-03-16T07:35:24.712434+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_clean_scrub_stamp":"2024-03-16T07:35:22.691587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:10:52.215327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.20","version":"0'0","reported_seq":20,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.717147+0000","last_change":"2024-03-16T07:35:10.366632+0000","last_active":"2024-03-16T07:35:24.717147+0000","last_peered":"2024-03-16T07:35:24.717147+0000","last_clean":"2024-03-16T07:35:24.717147+0000","last_became_active":"2024-03-16T07:35:10.365558+0000","last_became_peered":"2024-03-16T07:35:10.365558+0000","last_unstale":"2024-03-16T07:35:24.717147+0000","last_undegraded":"2024-03-16T07:35:24.717147+0000","last_fullsized":"2024-03-16T07:35:24.717147+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:56:02.461344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.1c","version":"0'0","reported_seq":12,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.718119+0000","last_change":"2024-03-16T07:35:23.738368+0000","last_active":"2024-03-16T07:35:24.718119+0000","last_peered":"2024-03-16T07:35:24.718119+0000","last_clean":"2024-03-16T07:35:24.718119+0000","last_became_active":"2024-03-16T07:35:23.736767+0000","last_became_peered":"2024-03-16T07:35:23.736767+0000","last_unstale":"2024-03-16T07:35:24.718119+0000","last_undegraded":"2024-03-16T07:35:24.718119+0000","last_fullsized":"2024-03-16T07:35:24.718119+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_clean_scrub_stamp":"2024-03-16T07:35:22.691587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:53:19.630184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"30.1d","version":"171'2","reported_seq":16,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.708196+0000","last_change":"2024-03-16T07:35:22.722657+0000","last_active":"2024-03-16T07:35:24.708196+0000","last_peered":"2024-03-16T07:35:24.708196+0000","last_clean":"2024-03-16T07:35:24.708196+0000","last_became_active":"2024-03-16T07:35:22.722285+0000","last_became_peered":"2024-03-16T07:35:22.722285+0000","last_unstale":"2024-03-16T07:35:24.708196+0000","last_undegraded":"2024-03-16T07:35:24.708196+0000","last_fullsized":"2024-03-16T07:35:24.708196+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:21.688749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:21.688749+0000","last_clean_scrub_stamp":"2024-03-16T07:35:21.688749+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:09:09.463896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.1e","version":"0'0","reported_seq":20,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.720540+0000","last_change":"2024-03-16T07:35:10.371872+0000","last_active":"2024-03-16T07:35:24.720540+0000","last_peered":"2024-03-16T07:35:24.720540+0000","last_clean":"2024-03-16T07:35:24.720540+0000","last_became_active":"2024-03-16T07:35:10.371262+0000","last_became_peered":"2024-03-16T07:35:10.371262+0000","last_unstale":"2024-03-16T07:35:24.720540+0000","last_undegraded":"2024-03-16T07:35:24.720540+0000","last_fullsized":"2024-03-16T07:35:24.720540+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:11:42.125776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.1f","version":"167'4","reported_seq":26,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.720367+0000","last_change":"2024-03-16T07:35:09.679357+0000","last_active":"2024-03-16T07:35:24.720367+0000","last_peered":"2024-03-16T07:35:24.720367+0000","last_clean":"2024-03-16T07:35:24.720367+0000","last_became_active":"2024-03-16T07:35:09.679104+0000","last_became_peered":"2024-03-16T07:35:09.679104+0000","last_unstale":"2024-03-16T07:35:24.720367+0000","last_undegraded":"2024-03-16T07:35:24.720367+0000","last_fullsized":"2024-03-16T07:35:24.720367+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_clean_scrub_stamp":"2024-03-16T07:35:08.655627+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:44:40.502257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.1d","version":"0'0","reported_seq":12,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.713346+0000","last_change":"2024-03-16T07:35:23.735426+0000","last_active":"2024-03-16T07:35:24.713346+0000","last_peered":"2024-03-16T07:35:24.713346+0000","last_clean":"2024-03-16T07:35:24.713346+0000","last_became_active":"2024-03-16T07:35:23.735181+0000","last_became_peered":"2024-03-16T07:35:23.735181+0000","last_unstale":"2024-03-16T07:35:24.713346+0000","last_undegraded":"2024-03-16T07:35:24.713346+0000","last_fullsized":"2024-03-16T07:35:24.713346+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_clean_scrub_stamp":"2024-03-16T07:35:22.691587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:29:55.249041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"30.1c","version":"171'2","reported_seq":16,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.718549+0000","last_change":"2024-03-16T07:35:22.712815+0000","last_active":"2024-03-16T07:35:24.718549+0000","last_peered":"2024-03-16T07:35:24.718549+0000","last_clean":"2024-03-16T07:35:24.718549+0000","last_became_active":"2024-03-16T07:35:22.712239+0000","last_became_peered":"2024-03-16T07:35:22.712239+0000","last_unstale":"2024-03-16T07:35:24.718549+0000","last_undegraded":"2024-03-16T07:35:24.718549+0000","last_fullsized":"2024-03-16T07:35:24.718549+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:21.688749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:21.688749+0000","last_clean_scrub_stamp":"2024-03-16T07:35:21.688749+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:59:19.324143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.1f","version":"0'0","reported_seq":20,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.713295+0000","last_change":"2024-03-16T07:35:10.362327+0000","last_active":"2024-03-16T07:35:24.713295+0000","last_peered":"2024-03-16T07:35:24.713295+0000","last_clean":"2024-03-16T07:35:24.713295+0000","last_became_active":"2024-03-16T07:35:10.361296+0000","last_became_peered":"2024-03-16T07:35:10.361296+0000","last_unstale":"2024-03-16T07:35:24.713295+0000","last_undegraded":"2024-03-16T07:35:24.713295+0000","last_fullsized":"2024-03-16T07:35:24.713295+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:22:29.675922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.1e","version":"167'1","reported_seq":23,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.708986+0000","last_change":"2024-03-16T07:35:09.675846+0000","last_active":"2024-03-16T07:35:24.708986+0000","last_peered":"2024-03-16T07:35:24.708986+0000","last_clean":"2024-03-16T07:35:24.708986+0000","last_became_active":"2024-03-16T07:35:09.675457+0000","last_became_peered":"2024-03-16T07:35:09.675457+0000","last_unstale":"2024-03-16T07:35:24.708986+0000","last_undegraded":"2024-03-16T07:35:24.708986+0000","last_fullsized":"2024-03-16T07:35:24.708986+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_clean_scrub_stamp":"2024-03-16T07:35:08.655627+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:52:18.799704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.1f","version":"0'0","reported_seq":12,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.712799+0000","last_change":"2024-03-16T07:35:23.733516+0000","last_active":"2024-03-16T07:35:24.712799+0000","last_peered":"2024-03-16T07:35:24.712799+0000","last_clean":"2024-03-16T07:35:24.712799+0000","last_became_active":"2024-03-16T07:35:23.733101+0000","last_became_peered":"2024-03-16T07:35:23.733101+0000","last_unstale":"2024-03-16T07:35:24.712799+0000","last_undegraded":"2024-03-16T07:35:24.712799+0000","last_fullsized":"2024-03-16T07:35:24.712799+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_clean_scrub_stamp":"2024-03-16T07:35:22.691587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:01:30.802361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"30.1e","version":"171'1","reported_seq":15,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.720489+0000","last_change":"2024-03-16T07:35:22.721855+0000","last_active":"2024-03-16T07:35:24.720489+0000","last_peered":"2024-03-16T07:35:24.720489+0000","last_clean":"2024-03-16T07:35:24.720489+0000","last_became_active":"2024-03-16T07:35:22.721625+0000","last_became_peered":"2024-03-16T07:35:22.721625+0000","last_unstale":"2024-03-16T07:35:24.720489+0000","last_undegraded":"2024-03-16T07:35:24.720489+0000","last_fullsized":"2024-03-16T07:35:24.720489+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:21.688749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:21.688749+0000","last_clean_scrub_stamp":"2024-03-16T07:35:21.688749+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:31:55.221417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.1d","version":"0'0","reported_seq":20,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.713463+0000","last_change":"2024-03-16T07:35:10.361899+0000","last_active":"2024-03-16T07:35:24.713463+0000","last_peered":"2024-03-16T07:35:24.713463+0000","last_clean":"2024-03-16T07:35:24.713463+0000","last_became_active":"2024-03-16T07:35:10.361003+0000","last_became_peered":"2024-03-16T07:35:10.361003+0000","last_unstale":"2024-03-16T07:35:24.713463+0000","last_undegraded":"2024-03-16T07:35:24.713463+0000","last_fullsized":"2024-03-16T07:35:24.713463+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:39:54.636478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.1c","version":"167'2","reported_seq":24,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.720090+0000","last_change":"2024-03-16T07:35:09.683142+0000","last_active":"2024-03-16T07:35:24.720090+0000","last_peered":"2024-03-16T07:35:24.720090+0000","last_clean":"2024-03-16T07:35:24.720090+0000","last_became_active":"2024-03-16T07:35:09.682887+0000","last_became_peered":"2024-03-16T07:35:09.682887+0000","last_unstale":"2024-03-16T07:35:24.720090+0000","last_undegraded":"2024-03-16T07:35:24.720090+0000","last_fullsized":"2024-03-16T07:35:24.720090+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_clean_scrub_stamp":"2024-03-16T07:35:08.655627+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:07:12.557490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.18","version":"0'0","reported_seq":12,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.704735+0000","last_change":"2024-03-16T07:35:23.727106+0000","last_active":"2024-03-16T07:35:24.704735+0000","last_peered":"2024-03-16T07:35:24.704735+0000","last_clean":"2024-03-16T07:35:24.704735+0000","last_became_active":"2024-03-16T07:35:23.726687+0000","last_became_peered":"2024-03-16T07:35:23.726687+0000","last_unstale":"2024-03-16T07:35:24.704735+0000","last_undegraded":"2024-03-16T07:35:24.704735+0000","last_fullsized":"2024-03-16T07:35:24.704735+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_clean_scrub_stamp":"2024-03-16T07:35:22.691587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:55:37.621136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.19","version":"0'0","reported_seq":14,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.705016+0000","last_change":"2024-03-16T07:35:22.719239+0000","last_active":"2024-03-16T07:35:24.705016+0000","last_peered":"2024-03-16T07:35:24.705016+0000","last_clean":"2024-03-16T07:35:24.705016+0000","last_became_active":"2024-03-16T07:35:22.719022+0000","last_became_peered":"2024-03-16T07:35:22.719022+0000","last_unstale":"2024-03-16T07:35:24.705016+0000","last_undegraded":"2024-03-16T07:35:24.705016+0000","last_fullsized":"2024-03-16T07:35:24.705016+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:21.688749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:21.688749+0000","last_clean_scrub_stamp":"2024-03-16T07:35:21.688749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:43:20.441063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.1a","version":"0'0","reported_seq":20,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.718278+0000","last_change":"2024-03-16T07:35:10.372758+0000","last_active":"2024-03-16T07:35:24.718278+0000","last_peered":"2024-03-16T07:35:24.718278+0000","last_clean":"2024-03-16T07:35:24.718278+0000","last_became_active":"2024-03-16T07:35:10.370443+0000","last_became_peered":"2024-03-16T07:35:10.370443+0000","last_unstale":"2024-03-16T07:35:24.718278+0000","last_undegraded":"2024-03-16T07:35:24.718278+0000","last_fullsized":"2024-03-16T07:35:24.718278+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:00:29.880728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.1b","version":"167'1","reported_seq":23,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.714859+0000","last_change":"2024-03-16T07:35:09.686706+0000","last_active":"2024-03-16T07:35:24.714859+0000","last_peered":"2024-03-16T07:35:24.714859+0000","last_clean":"2024-03-16T07:35:24.714859+0000","last_became_active":"2024-03-16T07:35:09.686429+0000","last_became_peered":"2024-03-16T07:35:09.686429+0000","last_unstale":"2024-03-16T07:35:24.714859+0000","last_undegraded":"2024-03-16T07:35:24.714859+0000","last_fullsized":"2024-03-16T07:35:24.714859+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_clean_scrub_stamp":"2024-03-16T07:35:08.655627+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:52:03.120308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.19","version":"0'0","reported_seq":12,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.704816+0000","last_change":"2024-03-16T07:35:23.739914+0000","last_active":"2024-03-16T07:35:24.704816+0000","last_peered":"2024-03-16T07:35:24.704816+0000","last_clean":"2024-03-16T07:35:24.704816+0000","last_became_active":"2024-03-16T07:35:23.739448+0000","last_became_peered":"2024-03-16T07:35:23.739448+0000","last_unstale":"2024-03-16T07:35:24.704816+0000","last_undegraded":"2024-03-16T07:35:24.704816+0000","last_fullsized":"2024-03-16T07:35:24.704816+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_clean_scrub_stamp":"2024-03-16T07:35:22.691587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:48:59.716642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.18","version":"0'0","reported_seq":14,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.704715+0000","last_change":"2024-03-16T07:35:22.722949+0000","last_active":"2024-03-16T07:35:24.704715+0000","last_peered":"2024-03-16T07:35:24.704715+0000","last_clean":"2024-03-16T07:35:24.704715+0000","last_became_active":"2024-03-16T07:35:22.722705+0000","last_became_peered":"2024-03-16T07:35:22.722705+0000","last_unstale":"2024-03-16T07:35:24.704715+0000","last_undegraded":"2024-03-16T07:35:24.704715+0000","last_fullsized":"2024-03-16T07:35:24.704715+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:21.688749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:21.688749+0000","last_clean_scrub_stamp":"2024-03-16T07:35:21.688749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:11:01.174728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.1b","version":"0'0","reported_seq":20,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.707548+0000","last_change":"2024-03-16T07:35:10.372111+0000","last_active":"2024-03-16T07:35:24.707548+0000","last_peered":"2024-03-16T07:35:24.707548+0000","last_clean":"2024-03-16T07:35:24.707548+0000","last_became_active":"2024-03-16T07:35:10.370526+0000","last_became_peered":"2024-03-16T07:35:10.370526+0000","last_unstale":"2024-03-16T07:35:24.707548+0000","last_undegraded":"2024-03-16T07:35:24.707548+0000","last_fullsized":"2024-03-16T07:35:24.707548+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:31:51.311315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.1a","version":"167'1","reported_seq":23,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.706250+0000","last_change":"2024-03-16T07:35:09.674506+0000","last_active":"2024-03-16T07:35:24.706250+0000","last_peered":"2024-03-16T07:35:24.706250+0000","last_clean":"2024-03-16T07:35:24.706250+0000","last_became_active":"2024-03-16T07:35:09.674254+0000","last_became_peered":"2024-03-16T07:35:09.674254+0000","last_unstale":"2024-03-16T07:35:24.706250+0000","last_undegraded":"2024-03-16T07:35:24.706250+0000","last_fullsized":"2024-03-16T07:35:24.706250+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_clean_scrub_stamp":"2024-03-16T07:35:08.655627+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:19:04.260787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.1a","version":"0'0","reported_seq":12,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.718274+0000","last_change":"2024-03-16T07:35:23.738302+0000","last_active":"2024-03-16T07:35:24.718274+0000","last_peered":"2024-03-16T07:35:24.718274+0000","last_clean":"2024-03-16T07:35:24.718274+0000","last_became_active":"2024-03-16T07:35:23.737974+0000","last_became_peered":"2024-03-16T07:35:23.737974+0000","last_unstale":"2024-03-16T07:35:24.718274+0000","last_undegraded":"2024-03-16T07:35:24.718274+0000","last_fullsized":"2024-03-16T07:35:24.718274+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_clean_scrub_stamp":"2024-03-16T07:35:22.691587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:31:42.237648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"30.1b","version":"171'1","reported_seq":15,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.714336+0000","last_change":"2024-03-16T07:35:22.715727+0000","last_active":"2024-03-16T07:35:24.714336+0000","last_peered":"2024-03-16T07:35:24.714336+0000","last_clean":"2024-03-16T07:35:24.714336+0000","last_became_active":"2024-03-16T07:35:22.715208+0000","last_became_peered":"2024-03-16T07:35:22.715208+0000","last_unstale":"2024-03-16T07:35:24.714336+0000","last_undegraded":"2024-03-16T07:35:24.714336+0000","last_fullsized":"2024-03-16T07:35:24.714336+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:21.688749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:21.688749+0000","last_clean_scrub_stamp":"2024-03-16T07:35:21.688749+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:28:59.759055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.18","version":"0'0","reported_seq":20,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.712083+0000","last_change":"2024-03-16T07:35:10.363833+0000","last_active":"2024-03-16T07:35:24.712083+0000","last_peered":"2024-03-16T07:35:24.712083+0000","last_clean":"2024-03-16T07:35:24.712083+0000","last_became_active":"2024-03-16T07:35:10.363037+0000","last_became_peered":"2024-03-16T07:35:10.363037+0000","last_unstale":"2024-03-16T07:35:24.712083+0000","last_undegraded":"2024-03-16T07:35:24.712083+0000","last_fullsized":"2024-03-16T07:35:24.712083+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:50:44.382790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.19","version":"0'0","reported_seq":22,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.714593+0000","last_change":"2024-03-16T07:35:09.684877+0000","last_active":"2024-03-16T07:35:24.714593+0000","last_peered":"2024-03-16T07:35:24.714593+0000","last_clean":"2024-03-16T07:35:24.714593+0000","last_became_active":"2024-03-16T07:35:09.684558+0000","last_became_peered":"2024-03-16T07:35:09.684558+0000","last_unstale":"2024-03-16T07:35:24.714593+0000","last_undegraded":"2024-03-16T07:35:24.714593+0000","last_fullsized":"2024-03-16T07:35:24.714593+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_clean_scrub_stamp":"2024-03-16T07:35:08.655627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:18:02.438640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.1b","version":"0'0","reported_seq":12,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.717666+0000","last_change":"2024-03-16T07:35:23.737895+0000","last_active":"2024-03-16T07:35:24.717666+0000","last_peered":"2024-03-16T07:35:24.717666+0000","last_clean":"2024-03-16T07:35:24.717666+0000","last_became_active":"2024-03-16T07:35:23.736542+0000","last_became_peered":"2024-03-16T07:35:23.736542+0000","last_unstale":"2024-03-16T07:35:24.717666+0000","last_undegraded":"2024-03-16T07:35:24.717666+0000","last_fullsized":"2024-03-16T07:35:24.717666+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_clean_scrub_stamp":"2024-03-16T07:35:22.691587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:53:18.394438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"30.1a","version":"171'1","reported_seq":15,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.705955+0000","last_change":"2024-03-16T07:35:22.712120+0000","last_active":"2024-03-16T07:35:24.705955+0000","last_peered":"2024-03-16T07:35:24.705955+0000","last_clean":"2024-03-16T07:35:24.705955+0000","last_became_active":"2024-03-16T07:35:22.711882+0000","last_became_peered":"2024-03-16T07:35:22.711882+0000","last_unstale":"2024-03-16T07:35:24.705955+0000","last_undegraded":"2024-03-16T07:35:24.705955+0000","last_fullsized":"2024-03-16T07:35:24.705955+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:21.688749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:21.688749+0000","last_clean_scrub_stamp":"2024-03-16T07:35:21.688749+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:44:53.535380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.19","version":"0'0","reported_seq":20,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.705378+0000","last_change":"2024-03-16T07:35:10.367160+0000","last_active":"2024-03-16T07:35:24.705378+0000","last_peered":"2024-03-16T07:35:24.705378+0000","last_clean":"2024-03-16T07:35:24.705378+0000","last_became_active":"2024-03-16T07:35:10.365971+0000","last_became_peered":"2024-03-16T07:35:10.365971+0000","last_unstale":"2024-03-16T07:35:24.705378+0000","last_undegraded":"2024-03-16T07:35:24.705378+0000","last_fullsized":"2024-03-16T07:35:24.705378+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:36:14.514526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.18","version":"0'0","reported_seq":22,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.712260+0000","last_change":"2024-03-16T07:35:09.684870+0000","last_active":"2024-03-16T07:35:24.712260+0000","last_peered":"2024-03-16T07:35:24.712260+0000","last_clean":"2024-03-16T07:35:24.712260+0000","last_became_active":"2024-03-16T07:35:09.684583+0000","last_became_peered":"2024-03-16T07:35:09.684583+0000","last_unstale":"2024-03-16T07:35:24.712260+0000","last_undegraded":"2024-03-16T07:35:24.712260+0000","last_fullsized":"2024-03-16T07:35:24.712260+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_clean_scrub_stamp":"2024-03-16T07:35:08.655627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:36:37.264021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.14","version":"0'0","reported_seq":12,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.718722+0000","last_change":"2024-03-16T07:35:23.739172+0000","last_active":"2024-03-16T07:35:24.718722+0000","last_peered":"2024-03-16T07:35:24.718722+0000","last_clean":"2024-03-16T07:35:24.718722+0000","last_became_active":"2024-03-16T07:35:23.738478+0000","last_became_peered":"2024-03-16T07:35:23.738478+0000","last_unstale":"2024-03-16T07:35:24.718722+0000","last_undegraded":"2024-03-16T07:35:24.718722+0000","last_fullsized":"2024-03-16T07:35:24.718722+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_clean_scrub_stamp":"2024-03-16T07:35:22.691587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:36:24.627260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"30.15","version":"171'3","reported_seq":17,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.708348+0000","last_change":"2024-03-16T07:35:22.719882+0000","last_active":"2024-03-16T07:35:24.708348+0000","last_peered":"2024-03-16T07:35:24.708348+0000","last_clean":"2024-03-16T07:35:24.708348+0000","last_became_active":"2024-03-16T07:35:22.719648+0000","last_became_peered":"2024-03-16T07:35:22.719648+0000","last_unstale":"2024-03-16T07:35:24.708348+0000","last_undegraded":"2024-03-16T07:35:24.708348+0000","last_fullsized":"2024-03-16T07:35:24.708348+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:21.688749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:21.688749+0000","last_clean_scrub_stamp":"2024-03-16T07:35:21.688749+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:03:18.769275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.16","version":"0'0","reported_seq":20,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.708817+0000","last_change":"2024-03-16T07:35:10.372562+0000","last_active":"2024-03-16T07:35:24.708817+0000","last_peered":"2024-03-16T07:35:24.708817+0000","last_clean":"2024-03-16T07:35:24.708817+0000","last_became_active":"2024-03-16T07:35:10.372187+0000","last_became_peered":"2024-03-16T07:35:10.372187+0000","last_unstale":"2024-03-16T07:35:24.708817+0000","last_undegraded":"2024-03-16T07:35:24.708817+0000","last_fullsized":"2024-03-16T07:35:24.708817+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:39:30.707025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.17","version":"0'0","reported_seq":22,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.707393+0000","last_change":"2024-03-16T07:35:09.680665+0000","last_active":"2024-03-16T07:35:24.707393+0000","last_peered":"2024-03-16T07:35:24.707393+0000","last_clean":"2024-03-16T07:35:24.707393+0000","last_became_active":"2024-03-16T07:35:09.680284+0000","last_became_peered":"2024-03-16T07:35:09.680284+0000","last_unstale":"2024-03-16T07:35:24.707393+0000","last_undegraded":"2024-03-16T07:35:24.707393+0000","last_fullsized":"2024-03-16T07:35:24.707393+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_clean_scrub_stamp":"2024-03-16T07:35:08.655627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:44:57.045499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.15","version":"0'0","reported_seq":12,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.707068+0000","last_change":"2024-03-16T07:35:23.742074+0000","last_active":"2024-03-16T07:35:24.707068+0000","last_peered":"2024-03-16T07:35:24.707068+0000","last_clean":"2024-03-16T07:35:24.707068+0000","last_became_active":"2024-03-16T07:35:23.738214+0000","last_became_peered":"2024-03-16T07:35:23.738214+0000","last_unstale":"2024-03-16T07:35:24.707068+0000","last_undegraded":"2024-03-16T07:35:24.707068+0000","last_fullsized":"2024-03-16T07:35:24.707068+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_clean_scrub_stamp":"2024-03-16T07:35:22.691587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:54:04.144696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.14","version":"171'6","reported_seq":20,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.706375+0000","last_change":"2024-03-16T07:35:22.713183+0000","last_active":"2024-03-16T07:35:24.706375+0000","last_peered":"2024-03-16T07:35:24.706375+0000","last_clean":"2024-03-16T07:35:24.706375+0000","last_became_active":"2024-03-16T07:35:22.712947+0000","last_became_peered":"2024-03-16T07:35:22.712947+0000","last_unstale":"2024-03-16T07:35:24.706375+0000","last_undegraded":"2024-03-16T07:35:24.706375+0000","last_fullsized":"2024-03-16T07:35:24.706375+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:21.688749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:21.688749+0000","last_clean_scrub_stamp":"2024-03-16T07:35:21.688749+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:47:04.887782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.17","version":"0'0","reported_seq":20,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.720278+0000","last_change":"2024-03-16T07:35:10.359658+0000","last_active":"2024-03-16T07:35:24.720278+0000","last_peered":"2024-03-16T07:35:24.720278+0000","last_clean":"2024-03-16T07:35:24.720278+0000","last_became_active":"2024-03-16T07:35:10.359392+0000","last_became_peered":"2024-03-16T07:35:10.359392+0000","last_unstale":"2024-03-16T07:35:24.720278+0000","last_undegraded":"2024-03-16T07:35:24.720278+0000","last_fullsized":"2024-03-16T07:35:24.720278+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:37:53.987285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.16","version":"0'0","reported_seq":22,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.720587+0000","last_change":"2024-03-16T07:35:09.683330+0000","last_active":"2024-03-16T07:35:24.720587+0000","last_peered":"2024-03-16T07:35:24.720587+0000","last_clean":"2024-03-16T07:35:24.720587+0000","last_became_active":"2024-03-16T07:35:09.682629+0000","last_became_peered":"2024-03-16T07:35:09.682629+0000","last_unstale":"2024-03-16T07:35:24.720587+0000","last_undegraded":"2024-03-16T07:35:24.720587+0000","last_fullsized":"2024-03-16T07:35:24.720587+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_clean_scrub_stamp":"2024-03-16T07:35:08.655627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:20:13.455330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.16","version":"0'0","reported_seq":12,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.708411+0000","last_change":"2024-03-16T07:35:23.731515+0000","last_active":"2024-03-16T07:35:24.708411+0000","last_peered":"2024-03-16T07:35:24.708411+0000","last_clean":"2024-03-16T07:35:24.708411+0000","last_became_active":"2024-03-16T07:35:23.730472+0000","last_became_peered":"2024-03-16T07:35:23.730472+0000","last_unstale":"2024-03-16T07:35:24.708411+0000","last_undegraded":"2024-03-16T07:35:24.708411+0000","last_fullsized":"2024-03-16T07:35:24.708411+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_clean_scrub_stamp":"2024-03-16T07:35:22.691587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:10:53.567397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.17","version":"0'0","reported_seq":14,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.720080+0000","last_change":"2024-03-16T07:35:22.721705+0000","last_active":"2024-03-16T07:35:24.720080+0000","last_peered":"2024-03-16T07:35:24.720080+0000","last_clean":"2024-03-16T07:35:24.720080+0000","last_became_active":"2024-03-16T07:35:22.721460+0000","last_became_peered":"2024-03-16T07:35:22.721460+0000","last_unstale":"2024-03-16T07:35:24.720080+0000","last_undegraded":"2024-03-16T07:35:24.720080+0000","last_fullsized":"2024-03-16T07:35:24.720080+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:21.688749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:21.688749+0000","last_clean_scrub_stamp":"2024-03-16T07:35:21.688749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:13:54.110760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.14","version":"0'0","reported_seq":20,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.713381+0000","last_change":"2024-03-16T07:35:10.359135+0000","last_active":"2024-03-16T07:35:24.713381+0000","last_peered":"2024-03-16T07:35:24.713381+0000","last_clean":"2024-03-16T07:35:24.713381+0000","last_became_active":"2024-03-16T07:35:10.358882+0000","last_became_peered":"2024-03-16T07:35:10.358882+0000","last_unstale":"2024-03-16T07:35:24.713381+0000","last_undegraded":"2024-03-16T07:35:24.713381+0000","last_fullsized":"2024-03-16T07:35:24.713381+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:47:52.138505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.15","version":"167'3","reported_seq":25,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.709096+0000","last_change":"2024-03-16T07:35:09.670265+0000","last_active":"2024-03-16T07:35:24.709096+0000","last_peered":"2024-03-16T07:35:24.709096+0000","last_clean":"2024-03-16T07:35:24.709096+0000","last_became_active":"2024-03-16T07:35:09.670015+0000","last_became_peered":"2024-03-16T07:35:09.670015+0000","last_unstale":"2024-03-16T07:35:24.709096+0000","last_undegraded":"2024-03-16T07:35:24.709096+0000","last_fullsized":"2024-03-16T07:35:24.709096+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_clean_scrub_stamp":"2024-03-16T07:35:08.655627+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:00:24.230346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.17","version":"0'0","reported_seq":12,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.718796+0000","last_change":"2024-03-16T07:35:23.731169+0000","last_active":"2024-03-16T07:35:24.718796+0000","last_peered":"2024-03-16T07:35:24.718796+0000","last_clean":"2024-03-16T07:35:24.718796+0000","last_became_active":"2024-03-16T07:35:23.730567+0000","last_became_peered":"2024-03-16T07:35:23.730567+0000","last_unstale":"2024-03-16T07:35:24.718796+0000","last_undegraded":"2024-03-16T07:35:24.718796+0000","last_fullsized":"2024-03-16T07:35:24.718796+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_clean_scrub_stamp":"2024-03-16T07:35:22.691587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:59:17.136836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"30.16","version":"0'0","reported_seq":14,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.713826+0000","last_change":"2024-03-16T07:35:22.711367+0000","last_active":"2024-03-16T07:35:24.713826+0000","last_peered":"2024-03-16T07:35:24.713826+0000","last_clean":"2024-03-16T07:35:24.713826+0000","last_became_active":"2024-03-16T07:35:22.711110+0000","last_became_peered":"2024-03-16T07:35:22.711110+0000","last_unstale":"2024-03-16T07:35:24.713826+0000","last_undegraded":"2024-03-16T07:35:24.713826+0000","last_fullsized":"2024-03-16T07:35:24.713826+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:21.688749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:21.688749+0000","last_clean_scrub_stamp":"2024-03-16T07:35:21.688749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:03:46.135429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.15","version":"0'0","reported_seq":20,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.720528+0000","last_change":"2024-03-16T07:35:10.368083+0000","last_active":"2024-03-16T07:35:24.720528+0000","last_peered":"2024-03-16T07:35:24.720528+0000","last_clean":"2024-03-16T07:35:24.720528+0000","last_became_active":"2024-03-16T07:35:10.365110+0000","last_became_peered":"2024-03-16T07:35:10.365110+0000","last_unstale":"2024-03-16T07:35:24.720528+0000","last_undegraded":"2024-03-16T07:35:24.720528+0000","last_fullsized":"2024-03-16T07:35:24.720528+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:10:43.387314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.14","version":"168'8","reported_seq":30,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.720211+0000","last_change":"2024-03-16T07:35:09.682373+0000","last_active":"2024-03-16T07:35:24.720211+0000","last_peered":"2024-03-16T07:35:24.720211+0000","last_clean":"2024-03-16T07:35:24.720211+0000","last_became_active":"2024-03-16T07:35:09.681726+0000","last_became_peered":"2024-03-16T07:35:09.681726+0000","last_unstale":"2024-03-16T07:35:24.720211+0000","last_undegraded":"2024-03-16T07:35:24.720211+0000","last_fullsized":"2024-03-16T07:35:24.720211+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_clean_scrub_stamp":"2024-03-16T07:35:08.655627+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:30:16.270717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3309,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.10","version":"0'0","reported_seq":12,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.711954+0000","last_change":"2024-03-16T07:35:23.712905+0000","last_active":"2024-03-16T07:35:24.711954+0000","last_peered":"2024-03-16T07:35:24.711954+0000","last_clean":"2024-03-16T07:35:24.711954+0000","last_became_active":"2024-03-16T07:35:23.712666+0000","last_became_peered":"2024-03-16T07:35:23.712666+0000","last_unstale":"2024-03-16T07:35:24.711954+0000","last_undegraded":"2024-03-16T07:35:24.711954+0000","last_fullsized":"2024-03-16T07:35:24.711954+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_clean_scrub_stamp":"2024-03-16T07:35:22.691587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:34:05.302539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"30.11","version":"0'0","reported_seq":14,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.705121+0000","last_change":"2024-03-16T07:35:22.718692+0000","last_active":"2024-03-16T07:35:24.705121+0000","last_peered":"2024-03-16T07:35:24.705121+0000","last_clean":"2024-03-16T07:35:24.705121+0000","last_became_active":"2024-03-16T07:35:22.718451+0000","last_became_peered":"2024-03-16T07:35:22.718451+0000","last_unstale":"2024-03-16T07:35:24.705121+0000","last_undegraded":"2024-03-16T07:35:24.705121+0000","last_fullsized":"2024-03-16T07:35:24.705121+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:21.688749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:21.688749+0000","last_clean_scrub_stamp":"2024-03-16T07:35:21.688749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:07:42.829403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.12","version":"0'0","reported_seq":20,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.718330+0000","last_change":"2024-03-16T07:35:10.372982+0000","last_active":"2024-03-16T07:35:24.718330+0000","last_peered":"2024-03-16T07:35:24.718330+0000","last_clean":"2024-03-16T07:35:24.718330+0000","last_became_active":"2024-03-16T07:35:10.371039+0000","last_became_peered":"2024-03-16T07:35:10.371039+0000","last_unstale":"2024-03-16T07:35:24.718330+0000","last_undegraded":"2024-03-16T07:35:24.718330+0000","last_fullsized":"2024-03-16T07:35:24.718330+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:58:20.875907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.13","version":"167'2","reported_seq":24,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.714986+0000","last_change":"2024-03-16T07:35:09.685238+0000","last_active":"2024-03-16T07:35:24.714986+0000","last_peered":"2024-03-16T07:35:24.714986+0000","last_clean":"2024-03-16T07:35:24.714986+0000","last_became_active":"2024-03-16T07:35:09.684483+0000","last_became_peered":"2024-03-16T07:35:09.684483+0000","last_unstale":"2024-03-16T07:35:24.714986+0000","last_undegraded":"2024-03-16T07:35:24.714986+0000","last_fullsized":"2024-03-16T07:35:24.714986+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_clean_scrub_stamp":"2024-03-16T07:35:08.655627+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:38:00.899911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.11","version":"0'0","reported_seq":12,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.717489+0000","last_change":"2024-03-16T07:35:23.730236+0000","last_active":"2024-03-16T07:35:24.717489+0000","last_peered":"2024-03-16T07:35:24.717489+0000","last_clean":"2024-03-16T07:35:24.717489+0000","last_became_active":"2024-03-16T07:35:23.730000+0000","last_became_peered":"2024-03-16T07:35:23.730000+0000","last_unstale":"2024-03-16T07:35:24.717489+0000","last_undegraded":"2024-03-16T07:35:24.717489+0000","last_fullsized":"2024-03-16T07:35:24.717489+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_clean_scrub_stamp":"2024-03-16T07:35:22.691587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:05:22.341139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"30.10","version":"171'8","reported_seq":22,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.716911+0000","last_change":"2024-03-16T07:35:22.714389+0000","last_active":"2024-03-16T07:35:24.716911+0000","last_peered":"2024-03-16T07:35:24.716911+0000","last_clean":"2024-03-16T07:35:24.716911+0000","last_became_active":"2024-03-16T07:35:22.713189+0000","last_became_peered":"2024-03-16T07:35:22.713189+0000","last_unstale":"2024-03-16T07:35:24.716911+0000","last_undegraded":"2024-03-16T07:35:24.716911+0000","last_fullsized":"2024-03-16T07:35:24.716911+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:21.688749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:21.688749+0000","last_clean_scrub_stamp":"2024-03-16T07:35:21.688749+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:54:25.980516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.13","version":"0'0","reported_seq":20,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.707638+0000","last_change":"2024-03-16T07:35:10.368332+0000","last_active":"2024-03-16T07:35:24.707638+0000","last_peered":"2024-03-16T07:35:24.707638+0000","last_clean":"2024-03-16T07:35:24.707638+0000","last_became_active":"2024-03-16T07:35:10.366791+0000","last_became_peered":"2024-03-16T07:35:10.366791+0000","last_unstale":"2024-03-16T07:35:24.707638+0000","last_undegraded":"2024-03-16T07:35:24.707638+0000","last_fullsized":"2024-03-16T07:35:24.707638+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:42:40.386511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.12","version":"0'0","reported_seq":22,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.718557+0000","last_change":"2024-03-16T07:35:09.682025+0000","last_active":"2024-03-16T07:35:24.718557+0000","last_peered":"2024-03-16T07:35:24.718557+0000","last_clean":"2024-03-16T07:35:24.718557+0000","last_became_active":"2024-03-16T07:35:09.681598+0000","last_became_peered":"2024-03-16T07:35:09.681598+0000","last_unstale":"2024-03-16T07:35:24.718557+0000","last_undegraded":"2024-03-16T07:35:24.718557+0000","last_fullsized":"2024-03-16T07:35:24.718557+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_clean_scrub_stamp":"2024-03-16T07:35:08.655627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:11:43.037273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.12","version":"0'0","reported_seq":12,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.717172+0000","last_change":"2024-03-16T07:35:23.737245+0000","last_active":"2024-03-16T07:35:24.717172+0000","last_peered":"2024-03-16T07:35:24.717172+0000","last_clean":"2024-03-16T07:35:24.717172+0000","last_became_active":"2024-03-16T07:35:23.736919+0000","last_became_peered":"2024-03-16T07:35:23.736919+0000","last_unstale":"2024-03-16T07:35:24.717172+0000","last_undegraded":"2024-03-16T07:35:24.717172+0000","last_fullsized":"2024-03-16T07:35:24.717172+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_clean_scrub_stamp":"2024-03-16T07:35:22.691587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:18:08.855866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"30.13","version":"171'2","reported_seq":16,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.707165+0000","last_change":"2024-03-16T07:35:22.717494+0000","last_active":"2024-03-16T07:35:24.707165+0000","last_peered":"2024-03-16T07:35:24.707165+0000","last_clean":"2024-03-16T07:35:24.707165+0000","last_became_active":"2024-03-16T07:35:22.717251+0000","last_became_peered":"2024-03-16T07:35:22.717251+0000","last_unstale":"2024-03-16T07:35:24.707165+0000","last_undegraded":"2024-03-16T07:35:24.707165+0000","last_fullsized":"2024-03-16T07:35:24.707165+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:21.688749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:21.688749+0000","last_clean_scrub_stamp":"2024-03-16T07:35:21.688749+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:57:56.117670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.10","version":"0'0","reported_seq":20,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.712098+0000","last_change":"2024-03-16T07:35:10.363831+0000","last_active":"2024-03-16T07:35:24.712098+0000","last_peered":"2024-03-16T07:35:24.712098+0000","last_clean":"2024-03-16T07:35:24.712098+0000","last_became_active":"2024-03-16T07:35:10.363235+0000","last_became_peered":"2024-03-16T07:35:10.363235+0000","last_unstale":"2024-03-16T07:35:24.712098+0000","last_undegraded":"2024-03-16T07:35:24.712098+0000","last_fullsized":"2024-03-16T07:35:24.712098+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:28:10.644885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.11","version":"0'0","reported_seq":22,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.705497+0000","last_change":"2024-03-16T07:35:09.676637+0000","last_active":"2024-03-16T07:35:24.705497+0000","last_peered":"2024-03-16T07:35:24.705497+0000","last_clean":"2024-03-16T07:35:24.705497+0000","last_became_active":"2024-03-16T07:35:09.676175+0000","last_became_peered":"2024-03-16T07:35:09.676175+0000","last_unstale":"2024-03-16T07:35:24.705497+0000","last_undegraded":"2024-03-16T07:35:24.705497+0000","last_fullsized":"2024-03-16T07:35:24.705497+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_clean_scrub_stamp":"2024-03-16T07:35:08.655627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:15:03.991142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.13","version":"0'0","reported_seq":12,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.714260+0000","last_change":"2024-03-16T07:35:23.722776+0000","last_active":"2024-03-16T07:35:24.714260+0000","last_peered":"2024-03-16T07:35:24.714260+0000","last_clean":"2024-03-16T07:35:24.714260+0000","last_became_active":"2024-03-16T07:35:23.721513+0000","last_became_peered":"2024-03-16T07:35:23.721513+0000","last_unstale":"2024-03-16T07:35:24.714260+0000","last_undegraded":"2024-03-16T07:35:24.714260+0000","last_fullsized":"2024-03-16T07:35:24.714260+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_clean_scrub_stamp":"2024-03-16T07:35:22.691587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:17:30.545715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"30.12","version":"0'0","reported_seq":14,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.717341+0000","last_change":"2024-03-16T07:35:22.715887+0000","last_active":"2024-03-16T07:35:24.717341+0000","last_peered":"2024-03-16T07:35:24.717341+0000","last_clean":"2024-03-16T07:35:24.717341+0000","last_became_active":"2024-03-16T07:35:22.715061+0000","last_became_peered":"2024-03-16T07:35:22.715061+0000","last_unstale":"2024-03-16T07:35:24.717341+0000","last_undegraded":"2024-03-16T07:35:24.717341+0000","last_fullsized":"2024-03-16T07:35:24.717341+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:21.688749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:21.688749+0000","last_clean_scrub_stamp":"2024-03-16T07:35:21.688749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:20:33.398006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.11","version":"0'0","reported_seq":20,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.717950+0000","last_change":"2024-03-16T07:35:10.371588+0000","last_active":"2024-03-16T07:35:24.717950+0000","last_peered":"2024-03-16T07:35:24.717950+0000","last_clean":"2024-03-16T07:35:24.717950+0000","last_became_active":"2024-03-16T07:35:10.368385+0000","last_became_peered":"2024-03-16T07:35:10.368385+0000","last_unstale":"2024-03-16T07:35:24.717950+0000","last_undegraded":"2024-03-16T07:35:24.717950+0000","last_fullsized":"2024-03-16T07:35:24.717950+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:10:54.068374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.10","version":"167'8","reported_seq":30,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.717257+0000","last_change":"2024-03-16T07:35:09.678042+0000","last_active":"2024-03-16T07:35:24.717257+0000","last_peered":"2024-03-16T07:35:24.717257+0000","last_clean":"2024-03-16T07:35:24.717257+0000","last_became_active":"2024-03-16T07:35:09.677738+0000","last_became_peered":"2024-03-16T07:35:09.677738+0000","last_unstale":"2024-03-16T07:35:24.717257+0000","last_undegraded":"2024-03-16T07:35:24.717257+0000","last_fullsized":"2024-03-16T07:35:24.717257+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_clean_scrub_stamp":"2024-03-16T07:35:08.655627+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:07:38.696095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.c","version":"0'0","reported_seq":12,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.718286+0000","last_change":"2024-03-16T07:35:23.738971+0000","last_active":"2024-03-16T07:35:24.718286+0000","last_peered":"2024-03-16T07:35:24.718286+0000","last_clean":"2024-03-16T07:35:24.718286+0000","last_became_active":"2024-03-16T07:35:23.737944+0000","last_became_peered":"2024-03-16T07:35:23.737944+0000","last_unstale":"2024-03-16T07:35:24.718286+0000","last_undegraded":"2024-03-16T07:35:24.718286+0000","last_fullsized":"2024-03-16T07:35:24.718286+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_clean_scrub_stamp":"2024-03-16T07:35:22.691587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:28:45.587506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"30.d","version":"171'1","reported_seq":15,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.720162+0000","last_change":"2024-03-16T07:35:22.714476+0000","last_active":"2024-03-16T07:35:24.720162+0000","last_peered":"2024-03-16T07:35:24.720162+0000","last_clean":"2024-03-16T07:35:24.720162+0000","last_became_active":"2024-03-16T07:35:22.714046+0000","last_became_peered":"2024-03-16T07:35:22.714046+0000","last_unstale":"2024-03-16T07:35:24.720162+0000","last_undegraded":"2024-03-16T07:35:24.720162+0000","last_fullsized":"2024-03-16T07:35:24.720162+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:21.688749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:21.688749+0000","last_clean_scrub_stamp":"2024-03-16T07:35:21.688749+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:44:00.928871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.e","version":"0'0","reported_seq":20,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.714494+0000","last_change":"2024-03-16T07:35:10.360336+0000","last_active":"2024-03-16T07:35:24.714494+0000","last_peered":"2024-03-16T07:35:24.714494+0000","last_clean":"2024-03-16T07:35:24.714494+0000","last_became_active":"2024-03-16T07:35:10.360103+0000","last_became_peered":"2024-03-16T07:35:10.360103+0000","last_unstale":"2024-03-16T07:35:24.714494+0000","last_undegraded":"2024-03-16T07:35:24.714494+0000","last_fullsized":"2024-03-16T07:35:24.714494+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:26:42.036511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.f","version":"167'1","reported_seq":23,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.707478+0000","last_change":"2024-03-16T07:35:09.680840+0000","last_active":"2024-03-16T07:35:24.707478+0000","last_peered":"2024-03-16T07:35:24.707478+0000","last_clean":"2024-03-16T07:35:24.707478+0000","last_became_active":"2024-03-16T07:35:09.679859+0000","last_became_peered":"2024-03-16T07:35:09.679859+0000","last_unstale":"2024-03-16T07:35:24.707478+0000","last_undegraded":"2024-03-16T07:35:24.707478+0000","last_fullsized":"2024-03-16T07:35:24.707478+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_clean_scrub_stamp":"2024-03-16T07:35:08.655627+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:46:33.709266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.d","version":"0'0","reported_seq":12,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.707217+0000","last_change":"2024-03-16T07:35:23.736078+0000","last_active":"2024-03-16T07:35:24.707217+0000","last_peered":"2024-03-16T07:35:24.707217+0000","last_clean":"2024-03-16T07:35:24.707217+0000","last_became_active":"2024-03-16T07:35:23.735854+0000","last_became_peered":"2024-03-16T07:35:23.735854+0000","last_unstale":"2024-03-16T07:35:24.707217+0000","last_undegraded":"2024-03-16T07:35:24.707217+0000","last_fullsized":"2024-03-16T07:35:24.707217+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_clean_scrub_stamp":"2024-03-16T07:35:22.691587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:01:00.802582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.c","version":"0'0","reported_seq":14,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.718658+0000","last_change":"2024-03-16T07:35:22.713718+0000","last_active":"2024-03-16T07:35:24.718658+0000","last_peered":"2024-03-16T07:35:24.718658+0000","last_clean":"2024-03-16T07:35:24.718658+0000","last_became_active":"2024-03-16T07:35:22.712577+0000","last_became_peered":"2024-03-16T07:35:22.712577+0000","last_unstale":"2024-03-16T07:35:24.718658+0000","last_undegraded":"2024-03-16T07:35:24.718658+0000","last_fullsized":"2024-03-16T07:35:24.718658+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:21.688749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:21.688749+0000","last_clean_scrub_stamp":"2024-03-16T07:35:21.688749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:17:11.876528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.f","version":"0'0","reported_seq":20,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.707218+0000","last_change":"2024-03-16T07:35:10.370056+0000","last_active":"2024-03-16T07:35:24.707218+0000","last_peered":"2024-03-16T07:35:24.707218+0000","last_clean":"2024-03-16T07:35:24.707218+0000","last_became_active":"2024-03-16T07:35:10.369815+0000","last_became_peered":"2024-03-16T07:35:10.369815+0000","last_unstale":"2024-03-16T07:35:24.707218+0000","last_undegraded":"2024-03-16T07:35:24.707218+0000","last_fullsized":"2024-03-16T07:35:24.707218+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:33:30.711096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.e","version":"167'2","reported_seq":24,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.720642+0000","last_change":"2024-03-16T07:35:09.683036+0000","last_active":"2024-03-16T07:35:24.720642+0000","last_peered":"2024-03-16T07:35:24.720642+0000","last_clean":"2024-03-16T07:35:24.720642+0000","last_became_active":"2024-03-16T07:35:09.682652+0000","last_became_peered":"2024-03-16T07:35:09.682652+0000","last_unstale":"2024-03-16T07:35:24.720642+0000","last_undegraded":"2024-03-16T07:35:24.720642+0000","last_fullsized":"2024-03-16T07:35:24.720642+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_clean_scrub_stamp":"2024-03-16T07:35:08.655627+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:29:41.213080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.e","version":"0'0","reported_seq":12,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.713731+0000","last_change":"2024-03-16T07:35:23.740039+0000","last_active":"2024-03-16T07:35:24.713731+0000","last_peered":"2024-03-16T07:35:24.713731+0000","last_clean":"2024-03-16T07:35:24.713731+0000","last_became_active":"2024-03-16T07:35:23.739228+0000","last_became_peered":"2024-03-16T07:35:23.739228+0000","last_unstale":"2024-03-16T07:35:24.713731+0000","last_undegraded":"2024-03-16T07:35:24.713731+0000","last_fullsized":"2024-03-16T07:35:24.713731+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_clean_scrub_stamp":"2024-03-16T07:35:22.691587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:11:02.177566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"30.f","version":"171'1","reported_seq":15,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.720185+0000","last_change":"2024-03-16T07:35:22.722948+0000","last_active":"2024-03-16T07:35:24.720185+0000","last_peered":"2024-03-16T07:35:24.720185+0000","last_clean":"2024-03-16T07:35:24.720185+0000","last_became_active":"2024-03-16T07:35:22.722571+0000","last_became_peered":"2024-03-16T07:35:22.722571+0000","last_unstale":"2024-03-16T07:35:24.720185+0000","last_undegraded":"2024-03-16T07:35:24.720185+0000","last_fullsized":"2024-03-16T07:35:24.720185+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:21.688749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:21.688749+0000","last_clean_scrub_stamp":"2024-03-16T07:35:21.688749+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:18:41.568783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.c","version":"0'0","reported_seq":20,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.720040+0000","last_change":"2024-03-16T07:35:10.372880+0000","last_active":"2024-03-16T07:35:24.720040+0000","last_peered":"2024-03-16T07:35:24.720040+0000","last_clean":"2024-03-16T07:35:24.720040+0000","last_became_active":"2024-03-16T07:35:10.368709+0000","last_became_peered":"2024-03-16T07:35:10.368709+0000","last_unstale":"2024-03-16T07:35:24.720040+0000","last_undegraded":"2024-03-16T07:35:24.720040+0000","last_fullsized":"2024-03-16T07:35:24.720040+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:20:49.601169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.d","version":"167'1","reported_seq":23,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.709188+0000","last_change":"2024-03-16T07:35:09.674601+0000","last_active":"2024-03-16T07:35:24.709188+0000","last_peered":"2024-03-16T07:35:24.709188+0000","last_clean":"2024-03-16T07:35:24.709188+0000","last_became_active":"2024-03-16T07:35:09.674335+0000","last_became_peered":"2024-03-16T07:35:09.674335+0000","last_unstale":"2024-03-16T07:35:24.709188+0000","last_undegraded":"2024-03-16T07:35:24.709188+0000","last_fullsized":"2024-03-16T07:35:24.709188+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_clean_scrub_stamp":"2024-03-16T07:35:08.655627+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:01:15.773351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.f","version":"0'0","reported_seq":12,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.719916+0000","last_change":"2024-03-16T07:35:23.720163+0000","last_active":"2024-03-16T07:35:24.719916+0000","last_peered":"2024-03-16T07:35:24.719916+0000","last_clean":"2024-03-16T07:35:24.719916+0000","last_became_active":"2024-03-16T07:35:23.719876+0000","last_became_peered":"2024-03-16T07:35:23.719876+0000","last_unstale":"2024-03-16T07:35:24.719916+0000","last_undegraded":"2024-03-16T07:35:24.719916+0000","last_fullsized":"2024-03-16T07:35:24.719916+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_clean_scrub_stamp":"2024-03-16T07:35:22.691587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:36:15.431938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"30.e","version":"171'2","reported_seq":16,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.714235+0000","last_change":"2024-03-16T07:35:22.717638+0000","last_active":"2024-03-16T07:35:24.714235+0000","last_peered":"2024-03-16T07:35:24.714235+0000","last_clean":"2024-03-16T07:35:24.714235+0000","last_became_active":"2024-03-16T07:35:22.717385+0000","last_became_peered":"2024-03-16T07:35:22.717385+0000","last_unstale":"2024-03-16T07:35:24.714235+0000","last_undegraded":"2024-03-16T07:35:24.714235+0000","last_fullsized":"2024-03-16T07:35:24.714235+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:21.688749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:21.688749+0000","last_clean_scrub_stamp":"2024-03-16T07:35:21.688749+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:47:42.875741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.d","version":"0'0","reported_seq":20,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.713547+0000","last_change":"2024-03-16T07:35:10.361177+0000","last_active":"2024-03-16T07:35:24.713547+0000","last_peered":"2024-03-16T07:35:24.713547+0000","last_clean":"2024-03-16T07:35:24.713547+0000","last_became_active":"2024-03-16T07:35:10.360525+0000","last_became_peered":"2024-03-16T07:35:10.360525+0000","last_unstale":"2024-03-16T07:35:24.713547+0000","last_undegraded":"2024-03-16T07:35:24.713547+0000","last_fullsized":"2024-03-16T07:35:24.713547+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:44:13.480808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.c","version":"0'0","reported_seq":22,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.706739+0000","last_change":"2024-03-16T07:35:09.675575+0000","last_active":"2024-03-16T07:35:24.706739+0000","last_peered":"2024-03-16T07:35:24.706739+0000","last_clean":"2024-03-16T07:35:24.706739+0000","last_became_active":"2024-03-16T07:35:09.675269+0000","last_became_peered":"2024-03-16T07:35:09.675269+0000","last_unstale":"2024-03-16T07:35:24.706739+0000","last_undegraded":"2024-03-16T07:35:24.706739+0000","last_fullsized":"2024-03-16T07:35:24.706739+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_clean_scrub_stamp":"2024-03-16T07:35:08.655627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:57:44.612807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.8","version":"0'0","reported_seq":12,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.716796+0000","last_change":"2024-03-16T07:35:23.739470+0000","last_active":"2024-03-16T07:35:24.716796+0000","last_peered":"2024-03-16T07:35:24.716796+0000","last_clean":"2024-03-16T07:35:24.716796+0000","last_became_active":"2024-03-16T07:35:23.735868+0000","last_became_peered":"2024-03-16T07:35:23.735868+0000","last_unstale":"2024-03-16T07:35:24.716796+0000","last_undegraded":"2024-03-16T07:35:24.716796+0000","last_fullsized":"2024-03-16T07:35:24.716796+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_clean_scrub_stamp":"2024-03-16T07:35:22.691587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:19:14.711209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"30.9","version":"0'0","reported_seq":14,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.705208+0000","last_change":"2024-03-16T07:35:22.716087+0000","last_active":"2024-03-16T07:35:24.705208+0000","last_peered":"2024-03-16T07:35:24.705208+0000","last_clean":"2024-03-16T07:35:24.705208+0000","last_became_active":"2024-03-16T07:35:22.715843+0000","last_became_peered":"2024-03-16T07:35:22.715843+0000","last_unstale":"2024-03-16T07:35:24.705208+0000","last_undegraded":"2024-03-16T07:35:24.705208+0000","last_fullsized":"2024-03-16T07:35:24.705208+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:21.688749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:21.688749+0000","last_clean_scrub_stamp":"2024-03-16T07:35:21.688749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:17:29.542878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.a","version":"0'0","reported_seq":20,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.706164+0000","last_change":"2024-03-16T07:35:10.374978+0000","last_active":"2024-03-16T07:35:24.706164+0000","last_peered":"2024-03-16T07:35:24.706164+0000","last_clean":"2024-03-16T07:35:24.706164+0000","last_became_active":"2024-03-16T07:35:10.374760+0000","last_became_peered":"2024-03-16T07:35:10.374760+0000","last_unstale":"2024-03-16T07:35:24.706164+0000","last_undegraded":"2024-03-16T07:35:24.706164+0000","last_fullsized":"2024-03-16T07:35:24.706164+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:57:01.662775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.b","version":"167'2","reported_seq":24,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.707934+0000","last_change":"2024-03-16T07:35:09.676930+0000","last_active":"2024-03-16T07:35:24.707934+0000","last_peered":"2024-03-16T07:35:24.707934+0000","last_clean":"2024-03-16T07:35:24.707934+0000","last_became_active":"2024-03-16T07:35:09.676583+0000","last_became_peered":"2024-03-16T07:35:09.676583+0000","last_unstale":"2024-03-16T07:35:24.707934+0000","last_undegraded":"2024-03-16T07:35:24.707934+0000","last_fullsized":"2024-03-16T07:35:24.707934+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_clean_scrub_stamp":"2024-03-16T07:35:08.655627+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:37:47.441198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.9","version":"0'0","reported_seq":12,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.704923+0000","last_change":"2024-03-16T07:35:23.722245+0000","last_active":"2024-03-16T07:35:24.704923+0000","last_peered":"2024-03-16T07:35:24.704923+0000","last_clean":"2024-03-16T07:35:24.704923+0000","last_became_active":"2024-03-16T07:35:23.721751+0000","last_became_peered":"2024-03-16T07:35:23.721751+0000","last_unstale":"2024-03-16T07:35:24.704923+0000","last_undegraded":"2024-03-16T07:35:24.704923+0000","last_fullsized":"2024-03-16T07:35:24.704923+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_clean_scrub_stamp":"2024-03-16T07:35:22.691587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:11:07.103320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.8","version":"0'0","reported_seq":14,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.704813+0000","last_change":"2024-03-16T07:35:22.716725+0000","last_active":"2024-03-16T07:35:24.704813+0000","last_peered":"2024-03-16T07:35:24.704813+0000","last_clean":"2024-03-16T07:35:24.704813+0000","last_became_active":"2024-03-16T07:35:22.716480+0000","last_became_peered":"2024-03-16T07:35:22.716480+0000","last_unstale":"2024-03-16T07:35:24.704813+0000","last_undegraded":"2024-03-16T07:35:24.704813+0000","last_fullsized":"2024-03-16T07:35:24.704813+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:21.688749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:21.688749+0000","last_clean_scrub_stamp":"2024-03-16T07:35:21.688749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:45:57.072623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.b","version":"0'0","reported_seq":20,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.714715+0000","last_change":"2024-03-16T07:35:10.359641+0000","last_active":"2024-03-16T07:35:24.714715+0000","last_peered":"2024-03-16T07:35:24.714715+0000","last_clean":"2024-03-16T07:35:24.714715+0000","last_became_active":"2024-03-16T07:35:10.359195+0000","last_became_peered":"2024-03-16T07:35:10.359195+0000","last_unstale":"2024-03-16T07:35:24.714715+0000","last_undegraded":"2024-03-16T07:35:24.714715+0000","last_fullsized":"2024-03-16T07:35:24.714715+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:52:52.660849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.a","version":"0'0","reported_seq":22,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.713159+0000","last_change":"2024-03-16T07:35:09.684320+0000","last_active":"2024-03-16T07:35:24.713159+0000","last_peered":"2024-03-16T07:35:24.713159+0000","last_clean":"2024-03-16T07:35:24.713159+0000","last_became_active":"2024-03-16T07:35:09.683895+0000","last_became_peered":"2024-03-16T07:35:09.683895+0000","last_unstale":"2024-03-16T07:35:24.713159+0000","last_undegraded":"2024-03-16T07:35:24.713159+0000","last_fullsized":"2024-03-16T07:35:24.713159+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_clean_scrub_stamp":"2024-03-16T07:35:08.655627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:49:10.728594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.a","version":"0'0","reported_seq":12,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.712631+0000","last_change":"2024-03-16T07:35:23.710306+0000","last_active":"2024-03-16T07:35:24.712631+0000","last_peered":"2024-03-16T07:35:24.712631+0000","last_clean":"2024-03-16T07:35:24.712631+0000","last_became_active":"2024-03-16T07:35:23.710066+0000","last_became_peered":"2024-03-16T07:35:23.710066+0000","last_unstale":"2024-03-16T07:35:24.712631+0000","last_undegraded":"2024-03-16T07:35:24.712631+0000","last_fullsized":"2024-03-16T07:35:24.712631+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_clean_scrub_stamp":"2024-03-16T07:35:22.691587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:07:52.732055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"30.b","version":"171'2","reported_seq":16,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.714458+0000","last_change":"2024-03-16T07:35:22.715953+0000","last_active":"2024-03-16T07:35:24.714458+0000","last_peered":"2024-03-16T07:35:24.714458+0000","last_clean":"2024-03-16T07:35:24.714458+0000","last_became_active":"2024-03-16T07:35:22.715504+0000","last_became_peered":"2024-03-16T07:35:22.715504+0000","last_unstale":"2024-03-16T07:35:24.714458+0000","last_undegraded":"2024-03-16T07:35:24.714458+0000","last_fullsized":"2024-03-16T07:35:24.714458+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:21.688749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:21.688749+0000","last_clean_scrub_stamp":"2024-03-16T07:35:21.688749+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:25:06.918560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.8","version":"0'0","reported_seq":20,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.712173+0000","last_change":"2024-03-16T07:35:10.363635+0000","last_active":"2024-03-16T07:35:24.712173+0000","last_peered":"2024-03-16T07:35:24.712173+0000","last_clean":"2024-03-16T07:35:24.712173+0000","last_became_active":"2024-03-16T07:35:10.362705+0000","last_became_peered":"2024-03-16T07:35:10.362705+0000","last_unstale":"2024-03-16T07:35:24.712173+0000","last_undegraded":"2024-03-16T07:35:24.712173+0000","last_fullsized":"2024-03-16T07:35:24.712173+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:19:12.330824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.9","version":"0'0","reported_seq":22,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.718139+0000","last_change":"2024-03-16T07:35:09.682153+0000","last_active":"2024-03-16T07:35:24.718139+0000","last_peered":"2024-03-16T07:35:24.718139+0000","last_clean":"2024-03-16T07:35:24.718139+0000","last_became_active":"2024-03-16T07:35:09.681886+0000","last_became_peered":"2024-03-16T07:35:09.681886+0000","last_unstale":"2024-03-16T07:35:24.718139+0000","last_undegraded":"2024-03-16T07:35:24.718139+0000","last_fullsized":"2024-03-16T07:35:24.718139+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_clean_scrub_stamp":"2024-03-16T07:35:08.655627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:45:44.039500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.b","version":"0'0","reported_seq":12,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.706815+0000","last_change":"2024-03-16T07:35:23.731097+0000","last_active":"2024-03-16T07:35:24.706815+0000","last_peered":"2024-03-16T07:35:24.706815+0000","last_clean":"2024-03-16T07:35:24.706815+0000","last_became_active":"2024-03-16T07:35:23.730415+0000","last_became_peered":"2024-03-16T07:35:23.730415+0000","last_unstale":"2024-03-16T07:35:24.706815+0000","last_undegraded":"2024-03-16T07:35:24.706815+0000","last_fullsized":"2024-03-16T07:35:24.706815+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_clean_scrub_stamp":"2024-03-16T07:35:22.691587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:56:57.722309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.a","version":"0'0","reported_seq":14,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.717450+0000","last_change":"2024-03-16T07:35:22.715592+0000","last_active":"2024-03-16T07:35:24.717450+0000","last_peered":"2024-03-16T07:35:24.717450+0000","last_clean":"2024-03-16T07:35:24.717450+0000","last_became_active":"2024-03-16T07:35:22.714811+0000","last_became_peered":"2024-03-16T07:35:22.714811+0000","last_unstale":"2024-03-16T07:35:24.717450+0000","last_undegraded":"2024-03-16T07:35:24.717450+0000","last_fullsized":"2024-03-16T07:35:24.717450+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:21.688749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:21.688749+0000","last_clean_scrub_stamp":"2024-03-16T07:35:21.688749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:16:41.471386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.9","version":"0'0","reported_seq":20,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.705410+0000","last_change":"2024-03-16T07:35:10.366866+0000","last_active":"2024-03-16T07:35:24.705410+0000","last_peered":"2024-03-16T07:35:24.705410+0000","last_clean":"2024-03-16T07:35:24.705410+0000","last_became_active":"2024-03-16T07:35:10.365511+0000","last_became_peered":"2024-03-16T07:35:10.365511+0000","last_unstale":"2024-03-16T07:35:24.705410+0000","last_undegraded":"2024-03-16T07:35:24.705410+0000","last_fullsized":"2024-03-16T07:35:24.705410+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:28:47.726946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.8","version":"0'0","reported_seq":22,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.717339+0000","last_change":"2024-03-16T07:35:09.678924+0000","last_active":"2024-03-16T07:35:24.717339+0000","last_peered":"2024-03-16T07:35:24.717339+0000","last_clean":"2024-03-16T07:35:24.717339+0000","last_became_active":"2024-03-16T07:35:09.678666+0000","last_became_peered":"2024-03-16T07:35:09.678666+0000","last_unstale":"2024-03-16T07:35:24.717339+0000","last_undegraded":"2024-03-16T07:35:24.717339+0000","last_fullsized":"2024-03-16T07:35:24.717339+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_clean_scrub_stamp":"2024-03-16T07:35:08.655627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:07:52.268339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.4","version":"0'0","reported_seq":12,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.718438+0000","last_change":"2024-03-16T07:35:23.737667+0000","last_active":"2024-03-16T07:35:24.718438+0000","last_peered":"2024-03-16T07:35:24.718438+0000","last_clean":"2024-03-16T07:35:24.718438+0000","last_became_active":"2024-03-16T07:35:23.736180+0000","last_became_peered":"2024-03-16T07:35:23.736180+0000","last_unstale":"2024-03-16T07:35:24.718438+0000","last_undegraded":"2024-03-16T07:35:24.718438+0000","last_fullsized":"2024-03-16T07:35:24.718438+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_clean_scrub_stamp":"2024-03-16T07:35:22.691587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:44:38.265207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"30.5","version":"0'0","reported_seq":14,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.708484+0000","last_change":"2024-03-16T07:35:22.717121+0000","last_active":"2024-03-16T07:35:24.708484+0000","last_peered":"2024-03-16T07:35:24.708484+0000","last_clean":"2024-03-16T07:35:24.708484+0000","last_became_active":"2024-03-16T07:35:22.716876+0000","last_became_peered":"2024-03-16T07:35:22.716876+0000","last_unstale":"2024-03-16T07:35:24.708484+0000","last_undegraded":"2024-03-16T07:35:24.708484+0000","last_fullsized":"2024-03-16T07:35:24.708484+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:21.688749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:21.688749+0000","last_clean_scrub_stamp":"2024-03-16T07:35:21.688749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:50:51.170914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.6","version":"0'0","reported_seq":20,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.708900+0000","last_change":"2024-03-16T07:35:10.371595+0000","last_active":"2024-03-16T07:35:24.708900+0000","last_peered":"2024-03-16T07:35:24.708900+0000","last_clean":"2024-03-16T07:35:24.708900+0000","last_became_active":"2024-03-16T07:35:10.369883+0000","last_became_peered":"2024-03-16T07:35:10.369883+0000","last_unstale":"2024-03-16T07:35:24.708900+0000","last_undegraded":"2024-03-16T07:35:24.708900+0000","last_fullsized":"2024-03-16T07:35:24.708900+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:08:16.640821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.7","version":"167'2","reported_seq":24,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.707639+0000","last_change":"2024-03-16T07:35:09.675559+0000","last_active":"2024-03-16T07:35:24.707639+0000","last_peered":"2024-03-16T07:35:24.707639+0000","last_clean":"2024-03-16T07:35:24.707639+0000","last_became_active":"2024-03-16T07:35:09.675177+0000","last_became_peered":"2024-03-16T07:35:09.675177+0000","last_unstale":"2024-03-16T07:35:24.707639+0000","last_undegraded":"2024-03-16T07:35:24.707639+0000","last_fullsized":"2024-03-16T07:35:24.707639+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_clean_scrub_stamp":"2024-03-16T07:35:08.655627+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:01:22.257974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.5","version":"0'0","reported_seq":12,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.720087+0000","last_change":"2024-03-16T07:35:23.734113+0000","last_active":"2024-03-16T07:35:24.720087+0000","last_peered":"2024-03-16T07:35:24.720087+0000","last_clean":"2024-03-16T07:35:24.720087+0000","last_became_active":"2024-03-16T07:35:23.732909+0000","last_became_peered":"2024-03-16T07:35:23.732909+0000","last_unstale":"2024-03-16T07:35:24.720087+0000","last_undegraded":"2024-03-16T07:35:24.720087+0000","last_fullsized":"2024-03-16T07:35:24.720087+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_clean_scrub_stamp":"2024-03-16T07:35:22.691587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:02:05.138809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"30.4","version":"0'0","reported_seq":14,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.719865+0000","last_change":"2024-03-16T07:35:22.714417+0000","last_active":"2024-03-16T07:35:24.719865+0000","last_peered":"2024-03-16T07:35:24.719865+0000","last_clean":"2024-03-16T07:35:24.719865+0000","last_became_active":"2024-03-16T07:35:22.714174+0000","last_became_peered":"2024-03-16T07:35:22.714174+0000","last_unstale":"2024-03-16T07:35:24.719865+0000","last_undegraded":"2024-03-16T07:35:24.719865+0000","last_fullsized":"2024-03-16T07:35:24.719865+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:21.688749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:21.688749+0000","last_clean_scrub_stamp":"2024-03-16T07:35:21.688749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:35:22.924515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.7","version":"0'0","reported_seq":20,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.707310+0000","last_change":"2024-03-16T07:35:10.365677+0000","last_active":"2024-03-16T07:35:24.707310+0000","last_peered":"2024-03-16T07:35:24.707310+0000","last_clean":"2024-03-16T07:35:24.707310+0000","last_became_active":"2024-03-16T07:35:10.364776+0000","last_became_peered":"2024-03-16T07:35:10.364776+0000","last_unstale":"2024-03-16T07:35:24.707310+0000","last_undegraded":"2024-03-16T07:35:24.707310+0000","last_fullsized":"2024-03-16T07:35:24.707310+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:08:30.408444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.6","version":"168'1","reported_seq":23,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.709078+0000","last_change":"2024-03-16T07:35:09.675754+0000","last_active":"2024-03-16T07:35:24.709078+0000","last_peered":"2024-03-16T07:35:24.709078+0000","last_clean":"2024-03-16T07:35:24.709078+0000","last_became_active":"2024-03-16T07:35:09.675073+0000","last_became_peered":"2024-03-16T07:35:09.675073+0000","last_unstale":"2024-03-16T07:35:24.709078+0000","last_undegraded":"2024-03-16T07:35:24.709078+0000","last_fullsized":"2024-03-16T07:35:24.709078+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_clean_scrub_stamp":"2024-03-16T07:35:08.655627+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:13:12.288432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.6","version":"0'0","reported_seq":12,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.720127+0000","last_change":"2024-03-16T07:35:23.737263+0000","last_active":"2024-03-16T07:35:24.720127+0000","last_peered":"2024-03-16T07:35:24.720127+0000","last_clean":"2024-03-16T07:35:24.720127+0000","last_became_active":"2024-03-16T07:35:23.736974+0000","last_became_peered":"2024-03-16T07:35:23.736974+0000","last_unstale":"2024-03-16T07:35:24.720127+0000","last_undegraded":"2024-03-16T07:35:24.720127+0000","last_fullsized":"2024-03-16T07:35:24.720127+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_clean_scrub_stamp":"2024-03-16T07:35:22.691587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:46:55.009826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"30.7","version":"171'2","reported_seq":16,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.712907+0000","last_change":"2024-03-16T07:35:22.710689+0000","last_active":"2024-03-16T07:35:24.712907+0000","last_peered":"2024-03-16T07:35:24.712907+0000","last_clean":"2024-03-16T07:35:24.712907+0000","last_became_active":"2024-03-16T07:35:22.710441+0000","last_became_peered":"2024-03-16T07:35:22.710441+0000","last_unstale":"2024-03-16T07:35:24.712907+0000","last_undegraded":"2024-03-16T07:35:24.712907+0000","last_fullsized":"2024-03-16T07:35:24.712907+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:21.688749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:21.688749+0000","last_clean_scrub_stamp":"2024-03-16T07:35:21.688749+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:50:56.126250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.4","version":"0'0","reported_seq":20,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.706648+0000","last_change":"2024-03-16T07:35:10.371080+0000","last_active":"2024-03-16T07:35:24.706648+0000","last_peered":"2024-03-16T07:35:24.706648+0000","last_clean":"2024-03-16T07:35:24.706648+0000","last_became_active":"2024-03-16T07:35:10.370374+0000","last_became_peered":"2024-03-16T07:35:10.370374+0000","last_unstale":"2024-03-16T07:35:24.706648+0000","last_undegraded":"2024-03-16T07:35:24.706648+0000","last_fullsized":"2024-03-16T07:35:24.706648+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:16:16.585185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.5","version":"0'0","reported_seq":22,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.713732+0000","last_change":"2024-03-16T07:35:09.685196+0000","last_active":"2024-03-16T07:35:24.713732+0000","last_peered":"2024-03-16T07:35:24.713732+0000","last_clean":"2024-03-16T07:35:24.713732+0000","last_became_active":"2024-03-16T07:35:09.684449+0000","last_became_peered":"2024-03-16T07:35:09.684449+0000","last_unstale":"2024-03-16T07:35:24.713732+0000","last_undegraded":"2024-03-16T07:35:24.713732+0000","last_fullsized":"2024-03-16T07:35:24.713732+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_clean_scrub_stamp":"2024-03-16T07:35:08.655627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:13:04.761117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.7","version":"0'0","reported_seq":12,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.706678+0000","last_change":"2024-03-16T07:35:23.740753+0000","last_active":"2024-03-16T07:35:24.706678+0000","last_peered":"2024-03-16T07:35:24.706678+0000","last_clean":"2024-03-16T07:35:24.706678+0000","last_became_active":"2024-03-16T07:35:23.740447+0000","last_became_peered":"2024-03-16T07:35:23.740447+0000","last_unstale":"2024-03-16T07:35:24.706678+0000","last_undegraded":"2024-03-16T07:35:24.706678+0000","last_fullsized":"2024-03-16T07:35:24.706678+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_clean_scrub_stamp":"2024-03-16T07:35:22.691587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:11:55.160722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.6","version":"172'1","reported_seq":15,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.715917+0000","last_change":"2024-03-16T07:35:22.710720+0000","last_active":"2024-03-16T07:35:24.715917+0000","last_peered":"2024-03-16T07:35:24.715917+0000","last_clean":"2024-03-16T07:35:24.715917+0000","last_became_active":"2024-03-16T07:35:22.710496+0000","last_became_peered":"2024-03-16T07:35:22.710496+0000","last_unstale":"2024-03-16T07:35:24.715917+0000","last_undegraded":"2024-03-16T07:35:24.715917+0000","last_fullsized":"2024-03-16T07:35:24.715917+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:21.688749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:21.688749+0000","last_clean_scrub_stamp":"2024-03-16T07:35:21.688749+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:57:13.694884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.5","version":"0'0","reported_seq":20,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.708925+0000","last_change":"2024-03-16T07:35:10.369204+0000","last_active":"2024-03-16T07:35:24.708925+0000","last_peered":"2024-03-16T07:35:24.708925+0000","last_clean":"2024-03-16T07:35:24.708925+0000","last_became_active":"2024-03-16T07:35:10.368924+0000","last_became_peered":"2024-03-16T07:35:10.368924+0000","last_unstale":"2024-03-16T07:35:24.708925+0000","last_undegraded":"2024-03-16T07:35:24.708925+0000","last_fullsized":"2024-03-16T07:35:24.708925+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:37:38.287390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.4","version":"0'0","reported_seq":22,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.720239+0000","last_change":"2024-03-16T07:35:09.677063+0000","last_active":"2024-03-16T07:35:24.720239+0000","last_peered":"2024-03-16T07:35:24.720239+0000","last_clean":"2024-03-16T07:35:24.720239+0000","last_became_active":"2024-03-16T07:35:09.676808+0000","last_became_peered":"2024-03-16T07:35:09.676808+0000","last_unstale":"2024-03-16T07:35:24.720239+0000","last_undegraded":"2024-03-16T07:35:24.720239+0000","last_fullsized":"2024-03-16T07:35:24.720239+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_clean_scrub_stamp":"2024-03-16T07:35:08.655627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:10:48.141606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.0","version":"0'0","reported_seq":12,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.716914+0000","last_change":"2024-03-16T07:35:23.721421+0000","last_active":"2024-03-16T07:35:24.716914+0000","last_peered":"2024-03-16T07:35:24.716914+0000","last_clean":"2024-03-16T07:35:24.716914+0000","last_became_active":"2024-03-16T07:35:23.718322+0000","last_became_peered":"2024-03-16T07:35:23.718322+0000","last_unstale":"2024-03-16T07:35:24.716914+0000","last_undegraded":"2024-03-16T07:35:24.716914+0000","last_fullsized":"2024-03-16T07:35:24.716914+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_clean_scrub_stamp":"2024-03-16T07:35:22.691587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:20:10.631902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"30.1","version":"0'0","reported_seq":14,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.717242+0000","last_change":"2024-03-16T07:35:22.721589+0000","last_active":"2024-03-16T07:35:24.717242+0000","last_peered":"2024-03-16T07:35:24.717242+0000","last_clean":"2024-03-16T07:35:24.717242+0000","last_became_active":"2024-03-16T07:35:22.721291+0000","last_became_peered":"2024-03-16T07:35:22.721291+0000","last_unstale":"2024-03-16T07:35:24.717242+0000","last_undegraded":"2024-03-16T07:35:24.717242+0000","last_fullsized":"2024-03-16T07:35:24.717242+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:21.688749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:21.688749+0000","last_clean_scrub_stamp":"2024-03-16T07:35:21.688749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:52:51.359882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.2","version":"0'0","reported_seq":20,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.706222+0000","last_change":"2024-03-16T07:35:10.369686+0000","last_active":"2024-03-16T07:35:24.706222+0000","last_peered":"2024-03-16T07:35:24.706222+0000","last_clean":"2024-03-16T07:35:24.706222+0000","last_became_active":"2024-03-16T07:35:10.369421+0000","last_became_peered":"2024-03-16T07:35:10.369421+0000","last_unstale":"2024-03-16T07:35:24.706222+0000","last_undegraded":"2024-03-16T07:35:24.706222+0000","last_fullsized":"2024-03-16T07:35:24.706222+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:03:34.103320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.3","version":"0'0","reported_seq":22,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.718020+0000","last_change":"2024-03-16T07:35:09.681585+0000","last_active":"2024-03-16T07:35:24.718020+0000","last_peered":"2024-03-16T07:35:24.718020+0000","last_clean":"2024-03-16T07:35:24.718020+0000","last_became_active":"2024-03-16T07:35:09.681312+0000","last_became_peered":"2024-03-16T07:35:09.681312+0000","last_unstale":"2024-03-16T07:35:24.718020+0000","last_undegraded":"2024-03-16T07:35:24.718020+0000","last_fullsized":"2024-03-16T07:35:24.718020+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_clean_scrub_stamp":"2024-03-16T07:35:08.655627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:33:35.043407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.1","version":"0'0","reported_seq":12,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.704964+0000","last_change":"2024-03-16T07:35:23.739682+0000","last_active":"2024-03-16T07:35:24.704964+0000","last_peered":"2024-03-16T07:35:24.704964+0000","last_clean":"2024-03-16T07:35:24.704964+0000","last_became_active":"2024-03-16T07:35:23.739232+0000","last_became_peered":"2024-03-16T07:35:23.739232+0000","last_unstale":"2024-03-16T07:35:24.704964+0000","last_undegraded":"2024-03-16T07:35:24.704964+0000","last_fullsized":"2024-03-16T07:35:24.704964+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_clean_scrub_stamp":"2024-03-16T07:35:22.691587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:33:30.851182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.0","version":"0'0","reported_seq":14,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.717421+0000","last_change":"2024-03-16T07:35:22.714224+0000","last_active":"2024-03-16T07:35:24.717421+0000","last_peered":"2024-03-16T07:35:24.717421+0000","last_clean":"2024-03-16T07:35:24.717421+0000","last_became_active":"2024-03-16T07:35:22.713932+0000","last_became_peered":"2024-03-16T07:35:22.713932+0000","last_unstale":"2024-03-16T07:35:24.717421+0000","last_undegraded":"2024-03-16T07:35:24.717421+0000","last_fullsized":"2024-03-16T07:35:24.717421+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:21.688749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:21.688749+0000","last_clean_scrub_stamp":"2024-03-16T07:35:21.688749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:33:47.061822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.3","version":"0'0","reported_seq":20,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.707723+0000","last_change":"2024-03-16T07:35:10.369293+0000","last_active":"2024-03-16T07:35:24.707723+0000","last_peered":"2024-03-16T07:35:24.707723+0000","last_clean":"2024-03-16T07:35:24.707723+0000","last_became_active":"2024-03-16T07:35:10.368043+0000","last_became_peered":"2024-03-16T07:35:10.368043+0000","last_unstale":"2024-03-16T07:35:24.707723+0000","last_undegraded":"2024-03-16T07:35:24.707723+0000","last_fullsized":"2024-03-16T07:35:24.707723+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:18:55.775147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.2","version":"0'0","reported_seq":22,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.718455+0000","last_change":"2024-03-16T07:35:09.681598+0000","last_active":"2024-03-16T07:35:24.718455+0000","last_peered":"2024-03-16T07:35:24.718455+0000","last_clean":"2024-03-16T07:35:24.718455+0000","last_became_active":"2024-03-16T07:35:09.681337+0000","last_became_peered":"2024-03-16T07:35:09.681337+0000","last_unstale":"2024-03-16T07:35:24.718455+0000","last_undegraded":"2024-03-16T07:35:24.718455+0000","last_fullsized":"2024-03-16T07:35:24.718455+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_clean_scrub_stamp":"2024-03-16T07:35:08.655627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:01:16.766400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.2","version":"0'0","reported_seq":12,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.712717+0000","last_change":"2024-03-16T07:35:23.742096+0000","last_active":"2024-03-16T07:35:24.712717+0000","last_peered":"2024-03-16T07:35:24.712717+0000","last_clean":"2024-03-16T07:35:24.712717+0000","last_became_active":"2024-03-16T07:35:23.740797+0000","last_became_peered":"2024-03-16T07:35:23.740797+0000","last_unstale":"2024-03-16T07:35:24.712717+0000","last_undegraded":"2024-03-16T07:35:24.712717+0000","last_fullsized":"2024-03-16T07:35:24.712717+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_clean_scrub_stamp":"2024-03-16T07:35:22.691587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:11:57.073233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"30.3","version":"0'0","reported_seq":14,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.717475+0000","last_change":"2024-03-16T07:35:22.714140+0000","last_active":"2024-03-16T07:35:24.717475+0000","last_peered":"2024-03-16T07:35:24.717475+0000","last_clean":"2024-03-16T07:35:24.717475+0000","last_became_active":"2024-03-16T07:35:22.713806+0000","last_became_peered":"2024-03-16T07:35:22.713806+0000","last_unstale":"2024-03-16T07:35:24.717475+0000","last_undegraded":"2024-03-16T07:35:24.717475+0000","last_fullsized":"2024-03-16T07:35:24.717475+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:21.688749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:21.688749+0000","last_clean_scrub_stamp":"2024-03-16T07:35:21.688749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:27:31.135815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.0","version":"0'0","reported_seq":20,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.717221+0000","last_change":"2024-03-16T07:35:10.367769+0000","last_active":"2024-03-16T07:35:24.717221+0000","last_peered":"2024-03-16T07:35:24.717221+0000","last_clean":"2024-03-16T07:35:24.717221+0000","last_became_active":"2024-03-16T07:35:10.367452+0000","last_became_peered":"2024-03-16T07:35:10.367452+0000","last_unstale":"2024-03-16T07:35:24.717221+0000","last_undegraded":"2024-03-16T07:35:24.717221+0000","last_fullsized":"2024-03-16T07:35:24.717221+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:34:22.428101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.1","version":"0'0","reported_seq":22,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.705555+0000","last_change":"2024-03-16T07:35:09.676420+0000","last_active":"2024-03-16T07:35:24.705555+0000","last_peered":"2024-03-16T07:35:24.705555+0000","last_clean":"2024-03-16T07:35:24.705555+0000","last_became_active":"2024-03-16T07:35:09.675843+0000","last_became_peered":"2024-03-16T07:35:09.675843+0000","last_unstale":"2024-03-16T07:35:24.705555+0000","last_undegraded":"2024-03-16T07:35:24.705555+0000","last_fullsized":"2024-03-16T07:35:24.705555+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_clean_scrub_stamp":"2024-03-16T07:35:08.655627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:59:26.600725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.3","version":"0'0","reported_seq":12,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.706947+0000","last_change":"2024-03-16T07:35:23.742427+0000","last_active":"2024-03-16T07:35:24.706947+0000","last_peered":"2024-03-16T07:35:24.706947+0000","last_clean":"2024-03-16T07:35:24.706947+0000","last_became_active":"2024-03-16T07:35:23.742161+0000","last_became_peered":"2024-03-16T07:35:23.742161+0000","last_unstale":"2024-03-16T07:35:24.706947+0000","last_undegraded":"2024-03-16T07:35:24.706947+0000","last_fullsized":"2024-03-16T07:35:24.706947+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_clean_scrub_stamp":"2024-03-16T07:35:22.691587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:32:01.170129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.2","version":"0'0","reported_seq":14,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.714284+0000","last_change":"2024-03-16T07:35:22.711439+0000","last_active":"2024-03-16T07:35:24.714284+0000","last_peered":"2024-03-16T07:35:24.714284+0000","last_clean":"2024-03-16T07:35:24.714284+0000","last_became_active":"2024-03-16T07:35:22.711201+0000","last_became_peered":"2024-03-16T07:35:22.711201+0000","last_unstale":"2024-03-16T07:35:24.714284+0000","last_undegraded":"2024-03-16T07:35:24.714284+0000","last_fullsized":"2024-03-16T07:35:24.714284+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:21.688749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:21.688749+0000","last_clean_scrub_stamp":"2024-03-16T07:35:21.688749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:36:26.546635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.1","version":"0'0","reported_seq":20,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.714423+0000","last_change":"2024-03-16T07:35:10.361913+0000","last_active":"2024-03-16T07:35:24.714423+0000","last_peered":"2024-03-16T07:35:24.714423+0000","last_clean":"2024-03-16T07:35:24.714423+0000","last_became_active":"2024-03-16T07:35:10.361684+0000","last_became_peered":"2024-03-16T07:35:10.361684+0000","last_unstale":"2024-03-16T07:35:24.714423+0000","last_undegraded":"2024-03-16T07:35:24.714423+0000","last_fullsized":"2024-03-16T07:35:24.714423+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:57:45.613820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.0","version":"0'0","reported_seq":22,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.705137+0000","last_change":"2024-03-16T07:35:09.680845+0000","last_active":"2024-03-16T07:35:24.705137+0000","last_peered":"2024-03-16T07:35:24.705137+0000","last_clean":"2024-03-16T07:35:24.705137+0000","last_became_active":"2024-03-16T07:35:09.680308+0000","last_became_peered":"2024-03-16T07:35:09.680308+0000","last_unstale":"2024-03-16T07:35:24.705137+0000","last_undegraded":"2024-03-16T07:35:24.705137+0000","last_fullsized":"2024-03-16T07:35:24.705137+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_clean_scrub_stamp":"2024-03-16T07:35:08.655627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:29:38.393742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.1e","version":"0'0","reported_seq":12,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.714625+0000","last_change":"2024-03-16T07:35:23.740403+0000","last_active":"2024-03-16T07:35:24.714625+0000","last_peered":"2024-03-16T07:35:24.714625+0000","last_clean":"2024-03-16T07:35:24.714625+0000","last_became_active":"2024-03-16T07:35:23.739819+0000","last_became_peered":"2024-03-16T07:35:23.739819+0000","last_unstale":"2024-03-16T07:35:24.714625+0000","last_undegraded":"2024-03-16T07:35:24.714625+0000","last_fullsized":"2024-03-16T07:35:24.714625+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_clean_scrub_stamp":"2024-03-16T07:35:22.691587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:43:21.443900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"30.1f","version":"171'4","reported_seq":18,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.720101+0000","last_change":"2024-03-16T07:35:22.721126+0000","last_active":"2024-03-16T07:35:24.720101+0000","last_peered":"2024-03-16T07:35:24.720101+0000","last_clean":"2024-03-16T07:35:24.720101+0000","last_became_active":"2024-03-16T07:35:22.720885+0000","last_became_peered":"2024-03-16T07:35:22.720885+0000","last_unstale":"2024-03-16T07:35:24.720101+0000","last_undegraded":"2024-03-16T07:35:24.720101+0000","last_fullsized":"2024-03-16T07:35:24.720101+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:21.688749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:21.688749+0000","last_clean_scrub_stamp":"2024-03-16T07:35:21.688749+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:58:13.331147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.1c","version":"0'0","reported_seq":20,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.713285+0000","last_change":"2024-03-16T07:35:10.360240+0000","last_active":"2024-03-16T07:35:24.713285+0000","last_peered":"2024-03-16T07:35:24.713285+0000","last_clean":"2024-03-16T07:35:24.713285+0000","last_became_active":"2024-03-16T07:35:10.360005+0000","last_became_peered":"2024-03-16T07:35:10.360005+0000","last_unstale":"2024-03-16T07:35:24.713285+0000","last_undegraded":"2024-03-16T07:35:24.713285+0000","last_fullsized":"2024-03-16T07:35:24.713285+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:09:47.571809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.1d","version":"167'2","reported_seq":24,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.709006+0000","last_change":"2024-03-16T07:35:09.673087+0000","last_active":"2024-03-16T07:35:24.709006+0000","last_peered":"2024-03-16T07:35:24.709006+0000","last_clean":"2024-03-16T07:35:24.709006+0000","last_became_active":"2024-03-16T07:35:09.672831+0000","last_became_peered":"2024-03-16T07:35:09.672831+0000","last_unstale":"2024-03-16T07:35:24.709006+0000","last_undegraded":"2024-03-16T07:35:24.709006+0000","last_fullsized":"2024-03-16T07:35:24.709006+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_clean_scrub_stamp":"2024-03-16T07:35:08.655627+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:55:55.803855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"152'218","reported_seq":867,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.705184+0000","last_change":"2024-03-16T07:24:31.650537+0000","last_active":"2024-03-16T07:35:24.705184+0000","last_peered":"2024-03-16T07:35:24.705184+0000","last_clean":"2024-03-16T07:35:24.705184+0000","last_became_active":"2024-03-16T07:24:31.649574+0000","last_became_peered":"2024-03-16T07:24:31.649574+0000","last_unstale":"2024-03-16T07:35:24.705184+0000","last_undegraded":"2024-03-16T07:35:24.705184+0000","last_fullsized":"2024-03-16T07:35:24.705184+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:29.719970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:29.719970+0000","last_clean_scrub_stamp":"2024-03-16T07:24:29.719970+0000","objects_scrubbed":0,"log_size":218,"log_dups_size":0,"ondisk_log_size":218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:31:35.774554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1162,"num_read_kb":2357,"num_write":357,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":31,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":30,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":29,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":28,"num_pg":32,"stat_sum":{"num_bytes":4107,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":8214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1162,"num_read_kb":2357,"num_write":357,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":218,"ondisk_log_size":218,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738496,"num_pgs":126,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":37120,"kb_used_data":1772,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":104820480,"statfs":{"total":107374182400,"available":107336171520,"internally_reserved":0,"allocated":1814528,"data_stored":737273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738496,"num_pgs":131,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":41876,"kb_used_data":2368,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":104815724,"statfs":{"total":107374182400,"available":107331301376,"internally_reserved":0,"allocated":2424832,"data_stored":1327184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738496,"num_pgs":129,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":41876,"kb_used_data":2368,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":104815724,"statfs":{"total":107374182400,"available":107331301376,"internally_reserved":0,"allocated":2424832,"data_stored":1330347,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3981,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":3435,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-16T07:35:27.843 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-16T07:35:28.233 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:35:28.236 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2024-03-16T07:35:28.245 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":43,"stamp":"2024-03-16T07:35:26.724687+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596885,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":1162,"num_read_kb":2357,"num_write":449,"num_write_kb":1925,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":298,"ondisk_log_size":298,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":386,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":314572800,"kb_used":120872,"kb_used_data":6508,"kb_used_omap":4,"kb_used_meta":114299,"kb_avail":314451928,"statfs":{"total":322122547200,"available":321998774272,"internally_reserved":0,"allocated":6664192,"data_stored":3394804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":117042511},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.032686"},"pg_stats":[{"pgid":"31.3d","version":"0'0","reported_seq":12,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.718636+0000","last_change":"2024-03-16T07:35:23.741100+0000","last_active":"2024-03-16T07:35:24.718636+0000","last_peered":"2024-03-16T07:35:24.718636+0000","last_clean":"2024-03-16T07:35:24.718636+0000","last_became_active":"2024-03-16T07:35:23.740319+0000","last_became_peered":"2024-03-16T07:35:23.740319+0000","last_unstale":"2024-03-16T07:35:24.718636+0000","last_undegraded":"2024-03-16T07:35:24.718636+0000","last_fullsized":"2024-03-16T07:35:24.718636+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_clean_scrub_stamp":"2024-03-16T07:35:22.691587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:20:00.755718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.3f","version":"0'0","reported_seq":20,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.707042+0000","last_change":"2024-03-16T07:35:10.367781+0000","last_active":"2024-03-16T07:35:24.707042+0000","last_peered":"2024-03-16T07:35:24.707042+0000","last_clean":"2024-03-16T07:35:24.707042+0000","last_became_active":"2024-03-16T07:35:10.367508+0000","last_became_peered":"2024-03-16T07:35:10.367508+0000","last_unstale":"2024-03-16T07:35:24.707042+0000","last_undegraded":"2024-03-16T07:35:24.707042+0000","last_fullsized":"2024-03-16T07:35:24.707042+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:33:36.562323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.3c","version":"0'0","reported_seq":12,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.712639+0000","last_change":"2024-03-16T07:35:23.743204+0000","last_active":"2024-03-16T07:35:24.712639+0000","last_peered":"2024-03-16T07:35:24.712639+0000","last_clean":"2024-03-16T07:35:24.712639+0000","last_became_active":"2024-03-16T07:35:23.742962+0000","last_became_peered":"2024-03-16T07:35:23.742962+0000","last_unstale":"2024-03-16T07:35:24.712639+0000","last_undegraded":"2024-03-16T07:35:24.712639+0000","last_fullsized":"2024-03-16T07:35:24.712639+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_clean_scrub_stamp":"2024-03-16T07:35:22.691587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:08:06.304299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.3e","version":"0'0","reported_seq":20,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.720379+0000","last_change":"2024-03-16T07:35:10.372544+0000","last_active":"2024-03-16T07:35:24.720379+0000","last_peered":"2024-03-16T07:35:24.720379+0000","last_clean":"2024-03-16T07:35:24.720379+0000","last_became_active":"2024-03-16T07:35:10.368326+0000","last_became_peered":"2024-03-16T07:35:10.368326+0000","last_unstale":"2024-03-16T07:35:24.720379+0000","last_undegraded":"2024-03-16T07:35:24.720379+0000","last_fullsized":"2024-03-16T07:35:24.720379+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:24:44.604994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.3f","version":"0'0","reported_seq":12,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.706931+0000","last_change":"2024-03-16T07:35:23.740174+0000","last_active":"2024-03-16T07:35:24.706931+0000","last_peered":"2024-03-16T07:35:24.706931+0000","last_clean":"2024-03-16T07:35:24.706931+0000","last_became_active":"2024-03-16T07:35:23.739928+0000","last_became_peered":"2024-03-16T07:35:23.739928+0000","last_unstale":"2024-03-16T07:35:24.706931+0000","last_undegraded":"2024-03-16T07:35:24.706931+0000","last_fullsized":"2024-03-16T07:35:24.706931+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_clean_scrub_stamp":"2024-03-16T07:35:22.691587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:00:26.182343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.3d","version":"0'0","reported_seq":20,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.720370+0000","last_change":"2024-03-16T07:35:10.370295+0000","last_active":"2024-03-16T07:35:24.720370+0000","last_peered":"2024-03-16T07:35:24.720370+0000","last_clean":"2024-03-16T07:35:24.720370+0000","last_became_active":"2024-03-16T07:35:10.367872+0000","last_became_peered":"2024-03-16T07:35:10.367872+0000","last_unstale":"2024-03-16T07:35:24.720370+0000","last_undegraded":"2024-03-16T07:35:24.720370+0000","last_fullsized":"2024-03-16T07:35:24.720370+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:04:34.471514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.3e","version":"0'0","reported_seq":12,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.708146+0000","last_change":"2024-03-16T07:35:23.735333+0000","last_active":"2024-03-16T07:35:24.708146+0000","last_peered":"2024-03-16T07:35:24.708146+0000","last_clean":"2024-03-16T07:35:24.708146+0000","last_became_active":"2024-03-16T07:35:23.735100+0000","last_became_peered":"2024-03-16T07:35:23.735100+0000","last_unstale":"2024-03-16T07:35:24.708146+0000","last_undegraded":"2024-03-16T07:35:24.708146+0000","last_fullsized":"2024-03-16T07:35:24.708146+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_clean_scrub_stamp":"2024-03-16T07:35:22.691587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:26:40.090864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.3c","version":"0'0","reported_seq":20,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.706547+0000","last_change":"2024-03-16T07:35:10.371287+0000","last_active":"2024-03-16T07:35:24.706547+0000","last_peered":"2024-03-16T07:35:24.706547+0000","last_clean":"2024-03-16T07:35:24.706547+0000","last_became_active":"2024-03-16T07:35:10.370698+0000","last_became_peered":"2024-03-16T07:35:10.370698+0000","last_unstale":"2024-03-16T07:35:24.706547+0000","last_undegraded":"2024-03-16T07:35:24.706547+0000","last_fullsized":"2024-03-16T07:35:24.706547+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:31:50.883971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.39","version":"0'0","reported_seq":12,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.704781+0000","last_change":"2024-03-16T07:35:23.740099+0000","last_active":"2024-03-16T07:35:24.704781+0000","last_peered":"2024-03-16T07:35:24.704781+0000","last_clean":"2024-03-16T07:35:24.704781+0000","last_became_active":"2024-03-16T07:35:23.739527+0000","last_became_peered":"2024-03-16T07:35:23.739527+0000","last_unstale":"2024-03-16T07:35:24.704781+0000","last_undegraded":"2024-03-16T07:35:24.704781+0000","last_fullsized":"2024-03-16T07:35:24.704781+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_clean_scrub_stamp":"2024-03-16T07:35:22.691587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:10:56.422261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.3b","version":"0'0","reported_seq":20,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.707278+0000","last_change":"2024-03-16T07:35:10.372081+0000","last_active":"2024-03-16T07:35:24.707278+0000","last_peered":"2024-03-16T07:35:24.707278+0000","last_clean":"2024-03-16T07:35:24.707278+0000","last_became_active":"2024-03-16T07:35:10.371181+0000","last_became_peered":"2024-03-16T07:35:10.371181+0000","last_unstale":"2024-03-16T07:35:24.707278+0000","last_undegraded":"2024-03-16T07:35:24.707278+0000","last_fullsized":"2024-03-16T07:35:24.707278+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:13:41.138671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.38","version":"0'0","reported_seq":12,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.704579+0000","last_change":"2024-03-16T07:35:23.746155+0000","last_active":"2024-03-16T07:35:24.704579+0000","last_peered":"2024-03-16T07:35:24.704579+0000","last_clean":"2024-03-16T07:35:24.704579+0000","last_became_active":"2024-03-16T07:35:23.745850+0000","last_became_peered":"2024-03-16T07:35:23.745850+0000","last_unstale":"2024-03-16T07:35:24.704579+0000","last_undegraded":"2024-03-16T07:35:24.704579+0000","last_fullsized":"2024-03-16T07:35:24.704579+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_clean_scrub_stamp":"2024-03-16T07:35:22.691587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:37:08.647094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.3a","version":"0'0","reported_seq":20,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.706132+0000","last_change":"2024-03-16T07:35:10.361524+0000","last_active":"2024-03-16T07:35:24.706132+0000","last_peered":"2024-03-16T07:35:24.706132+0000","last_clean":"2024-03-16T07:35:24.706132+0000","last_became_active":"2024-03-16T07:35:10.361243+0000","last_became_peered":"2024-03-16T07:35:10.361243+0000","last_unstale":"2024-03-16T07:35:24.706132+0000","last_undegraded":"2024-03-16T07:35:24.706132+0000","last_fullsized":"2024-03-16T07:35:24.706132+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:47:30.843632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.3b","version":"0'0","reported_seq":12,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.706674+0000","last_change":"2024-03-16T07:35:23.731282+0000","last_active":"2024-03-16T07:35:24.706674+0000","last_peered":"2024-03-16T07:35:24.706674+0000","last_clean":"2024-03-16T07:35:24.706674+0000","last_became_active":"2024-03-16T07:35:23.730874+0000","last_became_peered":"2024-03-16T07:35:23.730874+0000","last_unstale":"2024-03-16T07:35:24.706674+0000","last_undegraded":"2024-03-16T07:35:24.706674+0000","last_fullsized":"2024-03-16T07:35:24.706674+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_clean_scrub_stamp":"2024-03-16T07:35:22.691587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:16:47.165112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.39","version":"0'0","reported_seq":20,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.717444+0000","last_change":"2024-03-16T07:35:10.366571+0000","last_active":"2024-03-16T07:35:24.717444+0000","last_peered":"2024-03-16T07:35:24.717444+0000","last_clean":"2024-03-16T07:35:24.717444+0000","last_became_active":"2024-03-16T07:35:10.366265+0000","last_became_peered":"2024-03-16T07:35:10.366265+0000","last_unstale":"2024-03-16T07:35:24.717444+0000","last_undegraded":"2024-03-16T07:35:24.717444+0000","last_fullsized":"2024-03-16T07:35:24.717444+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:42:46.372194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.3a","version":"0'0","reported_seq":12,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.712146+0000","last_change":"2024-03-16T07:35:23.742331+0000","last_active":"2024-03-16T07:35:24.712146+0000","last_peered":"2024-03-16T07:35:24.712146+0000","last_clean":"2024-03-16T07:35:24.712146+0000","last_became_active":"2024-03-16T07:35:23.741557+0000","last_became_peered":"2024-03-16T07:35:23.741557+0000","last_unstale":"2024-03-16T07:35:24.712146+0000","last_undegraded":"2024-03-16T07:35:24.712146+0000","last_fullsized":"2024-03-16T07:35:24.712146+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_clean_scrub_stamp":"2024-03-16T07:35:22.691587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:52:18.294575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.38","version":"0'0","reported_seq":20,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.711891+0000","last_change":"2024-03-16T07:35:10.364222+0000","last_active":"2024-03-16T07:35:24.711891+0000","last_peered":"2024-03-16T07:35:24.711891+0000","last_clean":"2024-03-16T07:35:24.711891+0000","last_became_active":"2024-03-16T07:35:10.363574+0000","last_became_peered":"2024-03-16T07:35:10.363574+0000","last_unstale":"2024-03-16T07:35:24.711891+0000","last_undegraded":"2024-03-16T07:35:24.711891+0000","last_fullsized":"2024-03-16T07:35:24.711891+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:59:27.601739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.35","version":"0'0","reported_seq":12,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.719941+0000","last_change":"2024-03-16T07:35:23.740911+0000","last_active":"2024-03-16T07:35:24.719941+0000","last_peered":"2024-03-16T07:35:24.719941+0000","last_clean":"2024-03-16T07:35:24.719941+0000","last_became_active":"2024-03-16T07:35:23.739990+0000","last_became_peered":"2024-03-16T07:35:23.739990+0000","last_unstale":"2024-03-16T07:35:24.719941+0000","last_undegraded":"2024-03-16T07:35:24.719941+0000","last_fullsized":"2024-03-16T07:35:24.719941+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_clean_scrub_stamp":"2024-03-16T07:35:22.691587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:44:09.750183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.37","version":"0'0","reported_seq":20,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.713195+0000","last_change":"2024-03-16T07:35:10.363569+0000","last_active":"2024-03-16T07:35:24.713195+0000","last_peered":"2024-03-16T07:35:24.713195+0000","last_clean":"2024-03-16T07:35:24.713195+0000","last_became_active":"2024-03-16T07:35:10.362745+0000","last_became_peered":"2024-03-16T07:35:10.362745+0000","last_unstale":"2024-03-16T07:35:24.713195+0000","last_undegraded":"2024-03-16T07:35:24.713195+0000","last_fullsized":"2024-03-16T07:35:24.713195+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:49:26.412783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.34","version":"0'0","reported_seq":12,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.717950+0000","last_change":"2024-03-16T07:35:23.747295+0000","last_active":"2024-03-16T07:35:24.717950+0000","last_peered":"2024-03-16T07:35:24.717950+0000","last_clean":"2024-03-16T07:35:24.717950+0000","last_became_active":"2024-03-16T07:35:23.747050+0000","last_became_peered":"2024-03-16T07:35:23.747050+0000","last_unstale":"2024-03-16T07:35:24.717950+0000","last_undegraded":"2024-03-16T07:35:24.717950+0000","last_fullsized":"2024-03-16T07:35:24.717950+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_clean_scrub_stamp":"2024-03-16T07:35:22.691587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:42:06.491279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.36","version":"0'0","reported_seq":20,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.708736+0000","last_change":"2024-03-16T07:35:10.368073+0000","last_active":"2024-03-16T07:35:24.708736+0000","last_peered":"2024-03-16T07:35:24.708736+0000","last_clean":"2024-03-16T07:35:24.708736+0000","last_became_active":"2024-03-16T07:35:10.367391+0000","last_became_peered":"2024-03-16T07:35:10.367391+0000","last_unstale":"2024-03-16T07:35:24.708736+0000","last_undegraded":"2024-03-16T07:35:24.708736+0000","last_fullsized":"2024-03-16T07:35:24.708736+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:23:56.310435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.37","version":"0'0","reported_seq":12,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.713482+0000","last_change":"2024-03-16T07:35:23.728634+0000","last_active":"2024-03-16T07:35:24.713482+0000","last_peered":"2024-03-16T07:35:24.713482+0000","last_clean":"2024-03-16T07:35:24.713482+0000","last_became_active":"2024-03-16T07:35:23.728390+0000","last_became_peered":"2024-03-16T07:35:23.728390+0000","last_unstale":"2024-03-16T07:35:24.713482+0000","last_undegraded":"2024-03-16T07:35:24.713482+0000","last_fullsized":"2024-03-16T07:35:24.713482+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_clean_scrub_stamp":"2024-03-16T07:35:22.691587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:07:26.593450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.35","version":"0'0","reported_seq":20,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.720352+0000","last_change":"2024-03-16T07:35:10.368280+0000","last_active":"2024-03-16T07:35:24.720352+0000","last_peered":"2024-03-16T07:35:24.720352+0000","last_clean":"2024-03-16T07:35:24.720352+0000","last_became_active":"2024-03-16T07:35:10.367563+0000","last_became_peered":"2024-03-16T07:35:10.367563+0000","last_unstale":"2024-03-16T07:35:24.720352+0000","last_undegraded":"2024-03-16T07:35:24.720352+0000","last_fullsized":"2024-03-16T07:35:24.720352+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:47:25.833895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.36","version":"0'0","reported_seq":12,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.713567+0000","last_change":"2024-03-16T07:35:23.740227+0000","last_active":"2024-03-16T07:35:24.713567+0000","last_peered":"2024-03-16T07:35:24.713567+0000","last_clean":"2024-03-16T07:35:24.713567+0000","last_became_active":"2024-03-16T07:35:23.739523+0000","last_became_peered":"2024-03-16T07:35:23.739523+0000","last_unstale":"2024-03-16T07:35:24.713567+0000","last_undegraded":"2024-03-16T07:35:24.713567+0000","last_fullsized":"2024-03-16T07:35:24.713567+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_clean_scrub_stamp":"2024-03-16T07:35:22.691587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:30:30.306678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.34","version":"0'0","reported_seq":20,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.713036+0000","last_change":"2024-03-16T07:35:10.363259+0000","last_active":"2024-03-16T07:35:24.713036+0000","last_peered":"2024-03-16T07:35:24.713036+0000","last_clean":"2024-03-16T07:35:24.713036+0000","last_became_active":"2024-03-16T07:35:10.363011+0000","last_became_peered":"2024-03-16T07:35:10.363011+0000","last_unstale":"2024-03-16T07:35:24.713036+0000","last_undegraded":"2024-03-16T07:35:24.713036+0000","last_fullsized":"2024-03-16T07:35:24.713036+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:09:56.033035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.31","version":"0'0","reported_seq":12,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.717125+0000","last_change":"2024-03-16T07:35:23.741863+0000","last_active":"2024-03-16T07:35:24.717125+0000","last_peered":"2024-03-16T07:35:24.717125+0000","last_clean":"2024-03-16T07:35:24.717125+0000","last_became_active":"2024-03-16T07:35:23.741382+0000","last_became_peered":"2024-03-16T07:35:23.741382+0000","last_unstale":"2024-03-16T07:35:24.717125+0000","last_undegraded":"2024-03-16T07:35:24.717125+0000","last_fullsized":"2024-03-16T07:35:24.717125+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_clean_scrub_stamp":"2024-03-16T07:35:22.691587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:11:58.611782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.33","version":"0'0","reported_seq":20,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.707375+0000","last_change":"2024-03-16T07:35:10.369777+0000","last_active":"2024-03-16T07:35:24.707375+0000","last_peered":"2024-03-16T07:35:24.707375+0000","last_clean":"2024-03-16T07:35:24.707375+0000","last_became_active":"2024-03-16T07:35:10.367275+0000","last_became_peered":"2024-03-16T07:35:10.367275+0000","last_unstale":"2024-03-16T07:35:24.707375+0000","last_undegraded":"2024-03-16T07:35:24.707375+0000","last_fullsized":"2024-03-16T07:35:24.707375+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:49:33.888160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.30","version":"0'0","reported_seq":12,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.716747+0000","last_change":"2024-03-16T07:35:23.734039+0000","last_active":"2024-03-16T07:35:24.716747+0000","last_peered":"2024-03-16T07:35:24.716747+0000","last_clean":"2024-03-16T07:35:24.716747+0000","last_became_active":"2024-03-16T07:35:23.733493+0000","last_became_peered":"2024-03-16T07:35:23.733493+0000","last_unstale":"2024-03-16T07:35:24.716747+0000","last_undegraded":"2024-03-16T07:35:24.716747+0000","last_fullsized":"2024-03-16T07:35:24.716747+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_clean_scrub_stamp":"2024-03-16T07:35:22.691587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:52:13.859847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.32","version":"0'0","reported_seq":20,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.718063+0000","last_change":"2024-03-16T07:35:10.373263+0000","last_active":"2024-03-16T07:35:24.718063+0000","last_peered":"2024-03-16T07:35:24.718063+0000","last_clean":"2024-03-16T07:35:24.718063+0000","last_became_active":"2024-03-16T07:35:10.372048+0000","last_became_peered":"2024-03-16T07:35:10.372048+0000","last_unstale":"2024-03-16T07:35:24.718063+0000","last_undegraded":"2024-03-16T07:35:24.718063+0000","last_fullsized":"2024-03-16T07:35:24.718063+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:38:41.747041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.33","version":"0'0","reported_seq":12,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.714959+0000","last_change":"2024-03-16T07:35:23.722966+0000","last_active":"2024-03-16T07:35:24.714959+0000","last_peered":"2024-03-16T07:35:24.714959+0000","last_clean":"2024-03-16T07:35:24.714959+0000","last_became_active":"2024-03-16T07:35:23.722534+0000","last_became_peered":"2024-03-16T07:35:23.722534+0000","last_unstale":"2024-03-16T07:35:24.714959+0000","last_undegraded":"2024-03-16T07:35:24.714959+0000","last_fullsized":"2024-03-16T07:35:24.714959+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_clean_scrub_stamp":"2024-03-16T07:35:22.691587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:09:10.466734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.31","version":"0'0","reported_seq":20,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.717572+0000","last_change":"2024-03-16T07:35:10.366534+0000","last_active":"2024-03-16T07:35:24.717572+0000","last_peered":"2024-03-16T07:35:24.717572+0000","last_clean":"2024-03-16T07:35:24.717572+0000","last_became_active":"2024-03-16T07:35:10.365923+0000","last_became_peered":"2024-03-16T07:35:10.365923+0000","last_unstale":"2024-03-16T07:35:24.717572+0000","last_undegraded":"2024-03-16T07:35:24.717572+0000","last_fullsized":"2024-03-16T07:35:24.717572+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:28:54.985535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.32","version":"0'0","reported_seq":12,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.705858+0000","last_change":"2024-03-16T07:35:23.744004+0000","last_active":"2024-03-16T07:35:24.705858+0000","last_peered":"2024-03-16T07:35:24.705858+0000","last_clean":"2024-03-16T07:35:24.705858+0000","last_became_active":"2024-03-16T07:35:23.743786+0000","last_became_peered":"2024-03-16T07:35:23.743786+0000","last_unstale":"2024-03-16T07:35:24.705858+0000","last_undegraded":"2024-03-16T07:35:24.705858+0000","last_fullsized":"2024-03-16T07:35:24.705858+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_clean_scrub_stamp":"2024-03-16T07:35:22.691587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:24:57.639941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.30","version":"0'0","reported_seq":20,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.712001+0000","last_change":"2024-03-16T07:35:10.364026+0000","last_active":"2024-03-16T07:35:24.712001+0000","last_peered":"2024-03-16T07:35:24.712001+0000","last_clean":"2024-03-16T07:35:24.712001+0000","last_became_active":"2024-03-16T07:35:10.363364+0000","last_became_peered":"2024-03-16T07:35:10.363364+0000","last_unstale":"2024-03-16T07:35:24.712001+0000","last_undegraded":"2024-03-16T07:35:24.712001+0000","last_fullsized":"2024-03-16T07:35:24.712001+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:13:13.289445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.2d","version":"0'0","reported_seq":12,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.713195+0000","last_change":"2024-03-16T07:35:23.742512+0000","last_active":"2024-03-16T07:35:24.713195+0000","last_peered":"2024-03-16T07:35:24.713195+0000","last_clean":"2024-03-16T07:35:24.713195+0000","last_became_active":"2024-03-16T07:35:23.742222+0000","last_became_peered":"2024-03-16T07:35:23.742222+0000","last_unstale":"2024-03-16T07:35:24.713195+0000","last_undegraded":"2024-03-16T07:35:24.713195+0000","last_fullsized":"2024-03-16T07:35:24.713195+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_clean_scrub_stamp":"2024-03-16T07:35:22.691587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:33:49.079367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.2f","version":"0'0","reported_seq":20,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.707130+0000","last_change":"2024-03-16T07:35:10.365876+0000","last_active":"2024-03-16T07:35:24.707130+0000","last_peered":"2024-03-16T07:35:24.707130+0000","last_clean":"2024-03-16T07:35:24.707130+0000","last_became_active":"2024-03-16T07:35:10.365174+0000","last_became_peered":"2024-03-16T07:35:10.365174+0000","last_unstale":"2024-03-16T07:35:24.707130+0000","last_undegraded":"2024-03-16T07:35:24.707130+0000","last_fullsized":"2024-03-16T07:35:24.707130+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:20:58.883037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.2c","version":"0'0","reported_seq":12,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.712810+0000","last_change":"2024-03-16T07:35:23.729156+0000","last_active":"2024-03-16T07:35:24.712810+0000","last_peered":"2024-03-16T07:35:24.712810+0000","last_clean":"2024-03-16T07:35:24.712810+0000","last_became_active":"2024-03-16T07:35:23.728848+0000","last_became_peered":"2024-03-16T07:35:23.728848+0000","last_unstale":"2024-03-16T07:35:24.712810+0000","last_undegraded":"2024-03-16T07:35:24.712810+0000","last_fullsized":"2024-03-16T07:35:24.712810+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_clean_scrub_stamp":"2024-03-16T07:35:22.691587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:20:27.491291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.2e","version":"0'0","reported_seq":20,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.720478+0000","last_change":"2024-03-16T07:35:10.371679+0000","last_active":"2024-03-16T07:35:24.720478+0000","last_peered":"2024-03-16T07:35:24.720478+0000","last_clean":"2024-03-16T07:35:24.720478+0000","last_became_active":"2024-03-16T07:35:10.370469+0000","last_became_peered":"2024-03-16T07:35:10.370469+0000","last_unstale":"2024-03-16T07:35:24.720478+0000","last_undegraded":"2024-03-16T07:35:24.720478+0000","last_fullsized":"2024-03-16T07:35:24.720478+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:16:34.130165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.2f","version":"0'0","reported_seq":12,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.718694+0000","last_change":"2024-03-16T07:35:23.731351+0000","last_active":"2024-03-16T07:35:24.718694+0000","last_peered":"2024-03-16T07:35:24.718694+0000","last_clean":"2024-03-16T07:35:24.718694+0000","last_became_active":"2024-03-16T07:35:23.730887+0000","last_became_peered":"2024-03-16T07:35:23.730887+0000","last_unstale":"2024-03-16T07:35:24.718694+0000","last_undegraded":"2024-03-16T07:35:24.718694+0000","last_fullsized":"2024-03-16T07:35:24.718694+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_clean_scrub_stamp":"2024-03-16T07:35:22.691587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:45:49.521925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.2d","version":"0'0","reported_seq":20,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.708842+0000","last_change":"2024-03-16T07:35:10.369578+0000","last_active":"2024-03-16T07:35:24.708842+0000","last_peered":"2024-03-16T07:35:24.708842+0000","last_clean":"2024-03-16T07:35:24.708842+0000","last_became_active":"2024-03-16T07:35:10.369324+0000","last_became_peered":"2024-03-16T07:35:10.369324+0000","last_unstale":"2024-03-16T07:35:24.708842+0000","last_undegraded":"2024-03-16T07:35:24.708842+0000","last_fullsized":"2024-03-16T07:35:24.708842+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:36:36.291133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.2e","version":"0'0","reported_seq":12,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.709191+0000","last_change":"2024-03-16T07:35:23.734849+0000","last_active":"2024-03-16T07:35:24.709191+0000","last_peered":"2024-03-16T07:35:24.709191+0000","last_clean":"2024-03-16T07:35:24.709191+0000","last_became_active":"2024-03-16T07:35:23.731290+0000","last_became_peered":"2024-03-16T07:35:23.731290+0000","last_unstale":"2024-03-16T07:35:24.709191+0000","last_undegraded":"2024-03-16T07:35:24.709191+0000","last_fullsized":"2024-03-16T07:35:24.709191+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_clean_scrub_stamp":"2024-03-16T07:35:22.691587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:35:50.418638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.2c","version":"0'0","reported_seq":20,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.719989+0000","last_change":"2024-03-16T07:35:10.371246+0000","last_active":"2024-03-16T07:35:24.719989+0000","last_peered":"2024-03-16T07:35:24.719989+0000","last_clean":"2024-03-16T07:35:24.719989+0000","last_became_active":"2024-03-16T07:35:10.370745+0000","last_became_peered":"2024-03-16T07:35:10.370745+0000","last_unstale":"2024-03-16T07:35:24.719989+0000","last_undegraded":"2024-03-16T07:35:24.719989+0000","last_fullsized":"2024-03-16T07:35:24.719989+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:28:06.363187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.29","version":"0'0","reported_seq":12,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.713767+0000","last_change":"2024-03-16T07:35:23.724277+0000","last_active":"2024-03-16T07:35:24.713767+0000","last_peered":"2024-03-16T07:35:24.713767+0000","last_clean":"2024-03-16T07:35:24.713767+0000","last_became_active":"2024-03-16T07:35:23.724091+0000","last_became_peered":"2024-03-16T07:35:23.724091+0000","last_unstale":"2024-03-16T07:35:24.713767+0000","last_undegraded":"2024-03-16T07:35:24.713767+0000","last_fullsized":"2024-03-16T07:35:24.713767+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_clean_scrub_stamp":"2024-03-16T07:35:22.691587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:45:58.075461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.2b","version":"0'0","reported_seq":20,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.707461+0000","last_change":"2024-03-16T07:35:10.371877+0000","last_active":"2024-03-16T07:35:24.707461+0000","last_peered":"2024-03-16T07:35:24.707461+0000","last_clean":"2024-03-16T07:35:24.707461+0000","last_became_active":"2024-03-16T07:35:10.370864+0000","last_became_peered":"2024-03-16T07:35:10.370864+0000","last_unstale":"2024-03-16T07:35:24.707461+0000","last_undegraded":"2024-03-16T07:35:24.707461+0000","last_fullsized":"2024-03-16T07:35:24.707461+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:06:42.126915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.28","version":"0'0","reported_seq":12,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.704613+0000","last_change":"2024-03-16T07:35:23.746169+0000","last_active":"2024-03-16T07:35:24.704613+0000","last_peered":"2024-03-16T07:35:24.704613+0000","last_clean":"2024-03-16T07:35:24.704613+0000","last_became_active":"2024-03-16T07:35:23.745811+0000","last_became_peered":"2024-03-16T07:35:23.745811+0000","last_unstale":"2024-03-16T07:35:24.704613+0000","last_undegraded":"2024-03-16T07:35:24.704613+0000","last_fullsized":"2024-03-16T07:35:24.704613+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_clean_scrub_stamp":"2024-03-16T07:35:22.691587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:21:02.636116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.2a","version":"0'0","reported_seq":20,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.718066+0000","last_change":"2024-03-16T07:35:10.373482+0000","last_active":"2024-03-16T07:35:24.718066+0000","last_peered":"2024-03-16T07:35:24.718066+0000","last_clean":"2024-03-16T07:35:24.718066+0000","last_became_active":"2024-03-16T07:35:10.368788+0000","last_became_peered":"2024-03-16T07:35:10.368788+0000","last_unstale":"2024-03-16T07:35:24.718066+0000","last_undegraded":"2024-03-16T07:35:24.718066+0000","last_fullsized":"2024-03-16T07:35:24.718066+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:48:46.681695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.2b","version":"0'0","reported_seq":12,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.707882+0000","last_change":"2024-03-16T07:35:23.739092+0000","last_active":"2024-03-16T07:35:24.707882+0000","last_peered":"2024-03-16T07:35:24.707882+0000","last_clean":"2024-03-16T07:35:24.707882+0000","last_became_active":"2024-03-16T07:35:23.738866+0000","last_became_peered":"2024-03-16T07:35:23.738866+0000","last_unstale":"2024-03-16T07:35:24.707882+0000","last_undegraded":"2024-03-16T07:35:24.707882+0000","last_fullsized":"2024-03-16T07:35:24.707882+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_clean_scrub_stamp":"2024-03-16T07:35:22.691587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:35:05.562417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.29","version":"0'0","reported_seq":20,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.705186+0000","last_change":"2024-03-16T07:35:10.367542+0000","last_active":"2024-03-16T07:35:24.705186+0000","last_peered":"2024-03-16T07:35:24.705186+0000","last_clean":"2024-03-16T07:35:24.705186+0000","last_became_active":"2024-03-16T07:35:10.366618+0000","last_became_peered":"2024-03-16T07:35:10.366618+0000","last_unstale":"2024-03-16T07:35:24.705186+0000","last_undegraded":"2024-03-16T07:35:24.705186+0000","last_fullsized":"2024-03-16T07:35:24.705186+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:50:44.094141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.2a","version":"0'0","reported_seq":12,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.712291+0000","last_change":"2024-03-16T07:35:23.711399+0000","last_active":"2024-03-16T07:35:24.712291+0000","last_peered":"2024-03-16T07:35:24.712291+0000","last_clean":"2024-03-16T07:35:24.712291+0000","last_became_active":"2024-03-16T07:35:23.711169+0000","last_became_peered":"2024-03-16T07:35:23.711169+0000","last_unstale":"2024-03-16T07:35:24.712291+0000","last_undegraded":"2024-03-16T07:35:24.712291+0000","last_fullsized":"2024-03-16T07:35:24.712291+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_clean_scrub_stamp":"2024-03-16T07:35:22.691587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:18:21.074508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.28","version":"0'0","reported_seq":20,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.705020+0000","last_change":"2024-03-16T07:35:10.369012+0000","last_active":"2024-03-16T07:35:24.705020+0000","last_peered":"2024-03-16T07:35:24.705020+0000","last_clean":"2024-03-16T07:35:24.705020+0000","last_became_active":"2024-03-16T07:35:10.368755+0000","last_became_peered":"2024-03-16T07:35:10.368755+0000","last_unstale":"2024-03-16T07:35:24.705020+0000","last_undegraded":"2024-03-16T07:35:24.705020+0000","last_fullsized":"2024-03-16T07:35:24.705020+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:22:08.758800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.25","version":"0'0","reported_seq":12,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.718795+0000","last_change":"2024-03-16T07:35:23.740716+0000","last_active":"2024-03-16T07:35:24.718795+0000","last_peered":"2024-03-16T07:35:24.718795+0000","last_clean":"2024-03-16T07:35:24.718795+0000","last_became_active":"2024-03-16T07:35:23.739660+0000","last_became_peered":"2024-03-16T07:35:23.739660+0000","last_unstale":"2024-03-16T07:35:24.718795+0000","last_undegraded":"2024-03-16T07:35:24.718795+0000","last_fullsized":"2024-03-16T07:35:24.718795+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_clean_scrub_stamp":"2024-03-16T07:35:22.691587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:06:14.816932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.27","version":"0'0","reported_seq":20,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.720251+0000","last_change":"2024-03-16T07:35:10.364840+0000","last_active":"2024-03-16T07:35:24.720251+0000","last_peered":"2024-03-16T07:35:24.720251+0000","last_clean":"2024-03-16T07:35:24.720251+0000","last_became_active":"2024-03-16T07:35:10.364570+0000","last_became_peered":"2024-03-16T07:35:10.364570+0000","last_unstale":"2024-03-16T07:35:24.720251+0000","last_undegraded":"2024-03-16T07:35:24.720251+0000","last_fullsized":"2024-03-16T07:35:24.720251+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:55:24.586189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.24","version":"0'0","reported_seq":12,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.706315+0000","last_change":"2024-03-16T07:35:23.728317+0000","last_active":"2024-03-16T07:35:24.706315+0000","last_peered":"2024-03-16T07:35:24.706315+0000","last_clean":"2024-03-16T07:35:24.706315+0000","last_became_active":"2024-03-16T07:35:23.728092+0000","last_became_peered":"2024-03-16T07:35:23.728092+0000","last_unstale":"2024-03-16T07:35:24.706315+0000","last_undegraded":"2024-03-16T07:35:24.706315+0000","last_fullsized":"2024-03-16T07:35:24.706315+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_clean_scrub_stamp":"2024-03-16T07:35:22.691587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:58:33.910854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.26","version":"0'0","reported_seq":20,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.714399+0000","last_change":"2024-03-16T07:35:10.359654+0000","last_active":"2024-03-16T07:35:24.714399+0000","last_peered":"2024-03-16T07:35:24.714399+0000","last_clean":"2024-03-16T07:35:24.714399+0000","last_became_active":"2024-03-16T07:35:10.359424+0000","last_became_peered":"2024-03-16T07:35:10.359424+0000","last_unstale":"2024-03-16T07:35:24.714399+0000","last_undegraded":"2024-03-16T07:35:24.714399+0000","last_fullsized":"2024-03-16T07:35:24.714399+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:09:58.877836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.27","version":"0'0","reported_seq":12,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.713866+0000","last_change":"2024-03-16T07:35:23.733322+0000","last_active":"2024-03-16T07:35:24.713866+0000","last_peered":"2024-03-16T07:35:24.713866+0000","last_clean":"2024-03-16T07:35:24.713866+0000","last_became_active":"2024-03-16T07:35:23.732783+0000","last_became_peered":"2024-03-16T07:35:23.732783+0000","last_unstale":"2024-03-16T07:35:24.713866+0000","last_undegraded":"2024-03-16T07:35:24.713866+0000","last_fullsized":"2024-03-16T07:35:24.713866+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_clean_scrub_stamp":"2024-03-16T07:35:22.691587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:44:54.538217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.25","version":"0'0","reported_seq":20,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.720509+0000","last_change":"2024-03-16T07:35:10.368078+0000","last_active":"2024-03-16T07:35:24.720509+0000","last_peered":"2024-03-16T07:35:24.720509+0000","last_clean":"2024-03-16T07:35:24.720509+0000","last_became_active":"2024-03-16T07:35:10.367079+0000","last_became_peered":"2024-03-16T07:35:10.367079+0000","last_unstale":"2024-03-16T07:35:24.720509+0000","last_undegraded":"2024-03-16T07:35:24.720509+0000","last_fullsized":"2024-03-16T07:35:24.720509+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:36:55.612147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.26","version":"0'0","reported_seq":12,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.708284+0000","last_change":"2024-03-16T07:35:23.743473+0000","last_active":"2024-03-16T07:35:24.708284+0000","last_peered":"2024-03-16T07:35:24.708284+0000","last_clean":"2024-03-16T07:35:24.708284+0000","last_became_active":"2024-03-16T07:35:23.741697+0000","last_became_peered":"2024-03-16T07:35:23.741697+0000","last_unstale":"2024-03-16T07:35:24.708284+0000","last_undegraded":"2024-03-16T07:35:24.708284+0000","last_fullsized":"2024-03-16T07:35:24.708284+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_clean_scrub_stamp":"2024-03-16T07:35:22.691587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:34:05.463269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.24","version":"0'0","reported_seq":20,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.713120+0000","last_change":"2024-03-16T07:35:10.363356+0000","last_active":"2024-03-16T07:35:24.713120+0000","last_peered":"2024-03-16T07:35:24.713120+0000","last_clean":"2024-03-16T07:35:24.713120+0000","last_became_active":"2024-03-16T07:35:10.362988+0000","last_became_peered":"2024-03-16T07:35:10.362988+0000","last_unstale":"2024-03-16T07:35:24.713120+0000","last_undegraded":"2024-03-16T07:35:24.713120+0000","last_fullsized":"2024-03-16T07:35:24.713120+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:55:56.804868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.21","version":"0'0","reported_seq":12,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.714235+0000","last_change":"2024-03-16T07:35:23.719499+0000","last_active":"2024-03-16T07:35:24.714235+0000","last_peered":"2024-03-16T07:35:24.714235+0000","last_clean":"2024-03-16T07:35:24.714235+0000","last_became_active":"2024-03-16T07:35:23.719234+0000","last_became_peered":"2024-03-16T07:35:23.719234+0000","last_unstale":"2024-03-16T07:35:24.714235+0000","last_undegraded":"2024-03-16T07:35:24.714235+0000","last_fullsized":"2024-03-16T07:35:24.714235+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_clean_scrub_stamp":"2024-03-16T07:35:22.691587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:07:43.832241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.23","version":"0'0","reported_seq":20,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.714633+0000","last_change":"2024-03-16T07:35:10.359431+0000","last_active":"2024-03-16T07:35:24.714633+0000","last_peered":"2024-03-16T07:35:24.714633+0000","last_clean":"2024-03-16T07:35:24.714633+0000","last_became_active":"2024-03-16T07:35:10.358815+0000","last_became_peered":"2024-03-16T07:35:10.358815+0000","last_unstale":"2024-03-16T07:35:24.714633+0000","last_undegraded":"2024-03-16T07:35:24.714633+0000","last_fullsized":"2024-03-16T07:35:24.714633+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:33:06.548770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.20","version":"0'0","reported_seq":12,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.705027+0000","last_change":"2024-03-16T07:35:23.726921+0000","last_active":"2024-03-16T07:35:24.705027+0000","last_peered":"2024-03-16T07:35:24.705027+0000","last_clean":"2024-03-16T07:35:24.705027+0000","last_became_active":"2024-03-16T07:35:23.717436+0000","last_became_peered":"2024-03-16T07:35:23.717436+0000","last_unstale":"2024-03-16T07:35:24.705027+0000","last_undegraded":"2024-03-16T07:35:24.705027+0000","last_fullsized":"2024-03-16T07:35:24.705027+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_clean_scrub_stamp":"2024-03-16T07:35:22.691587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:00:42.915674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.22","version":"0'0","reported_seq":20,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.718172+0000","last_change":"2024-03-16T07:35:10.372992+0000","last_active":"2024-03-16T07:35:24.718172+0000","last_peered":"2024-03-16T07:35:24.718172+0000","last_clean":"2024-03-16T07:35:24.718172+0000","last_became_active":"2024-03-16T07:35:10.371612+0000","last_became_peered":"2024-03-16T07:35:10.371612+0000","last_unstale":"2024-03-16T07:35:24.718172+0000","last_undegraded":"2024-03-16T07:35:24.718172+0000","last_fullsized":"2024-03-16T07:35:24.718172+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:33:17.816236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.23","version":"0'0","reported_seq":12,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.718085+0000","last_change":"2024-03-16T07:35:23.737713+0000","last_active":"2024-03-16T07:35:24.718085+0000","last_peered":"2024-03-16T07:35:24.718085+0000","last_clean":"2024-03-16T07:35:24.718085+0000","last_became_active":"2024-03-16T07:35:23.736602+0000","last_became_peered":"2024-03-16T07:35:23.736602+0000","last_unstale":"2024-03-16T07:35:24.718085+0000","last_undegraded":"2024-03-16T07:35:24.718085+0000","last_fullsized":"2024-03-16T07:35:24.718085+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_clean_scrub_stamp":"2024-03-16T07:35:22.691587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:47:12.528918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.21","version":"0'0","reported_seq":20,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.705279+0000","last_change":"2024-03-16T07:35:10.372894+0000","last_active":"2024-03-16T07:35:24.705279+0000","last_peered":"2024-03-16T07:35:24.705279+0000","last_clean":"2024-03-16T07:35:24.705279+0000","last_became_active":"2024-03-16T07:35:10.372610+0000","last_became_peered":"2024-03-16T07:35:10.372610+0000","last_unstale":"2024-03-16T07:35:24.705279+0000","last_undegraded":"2024-03-16T07:35:24.705279+0000","last_fullsized":"2024-03-16T07:35:24.705279+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:24:54.886451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.22","version":"0'0","reported_seq":12,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.712434+0000","last_change":"2024-03-16T07:35:23.711031+0000","last_active":"2024-03-16T07:35:24.712434+0000","last_peered":"2024-03-16T07:35:24.712434+0000","last_clean":"2024-03-16T07:35:24.712434+0000","last_became_active":"2024-03-16T07:35:23.710804+0000","last_became_peered":"2024-03-16T07:35:23.710804+0000","last_unstale":"2024-03-16T07:35:24.712434+0000","last_undegraded":"2024-03-16T07:35:24.712434+0000","last_fullsized":"2024-03-16T07:35:24.712434+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_clean_scrub_stamp":"2024-03-16T07:35:22.691587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:10:52.215327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.20","version":"0'0","reported_seq":20,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.717147+0000","last_change":"2024-03-16T07:35:10.366632+0000","last_active":"2024-03-16T07:35:24.717147+0000","last_peered":"2024-03-16T07:35:24.717147+0000","last_clean":"2024-03-16T07:35:24.717147+0000","last_became_active":"2024-03-16T07:35:10.365558+0000","last_became_peered":"2024-03-16T07:35:10.365558+0000","last_unstale":"2024-03-16T07:35:24.717147+0000","last_undegraded":"2024-03-16T07:35:24.717147+0000","last_fullsized":"2024-03-16T07:35:24.717147+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:56:02.461344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.1c","version":"0'0","reported_seq":12,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.718119+0000","last_change":"2024-03-16T07:35:23.738368+0000","last_active":"2024-03-16T07:35:24.718119+0000","last_peered":"2024-03-16T07:35:24.718119+0000","last_clean":"2024-03-16T07:35:24.718119+0000","last_became_active":"2024-03-16T07:35:23.736767+0000","last_became_peered":"2024-03-16T07:35:23.736767+0000","last_unstale":"2024-03-16T07:35:24.718119+0000","last_undegraded":"2024-03-16T07:35:24.718119+0000","last_fullsized":"2024-03-16T07:35:24.718119+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_clean_scrub_stamp":"2024-03-16T07:35:22.691587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:53:19.630184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"30.1d","version":"171'2","reported_seq":16,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.708196+0000","last_change":"2024-03-16T07:35:22.722657+0000","last_active":"2024-03-16T07:35:24.708196+0000","last_peered":"2024-03-16T07:35:24.708196+0000","last_clean":"2024-03-16T07:35:24.708196+0000","last_became_active":"2024-03-16T07:35:22.722285+0000","last_became_peered":"2024-03-16T07:35:22.722285+0000","last_unstale":"2024-03-16T07:35:24.708196+0000","last_undegraded":"2024-03-16T07:35:24.708196+0000","last_fullsized":"2024-03-16T07:35:24.708196+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:21.688749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:21.688749+0000","last_clean_scrub_stamp":"2024-03-16T07:35:21.688749+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:09:09.463896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.1e","version":"0'0","reported_seq":20,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.720540+0000","last_change":"2024-03-16T07:35:10.371872+0000","last_active":"2024-03-16T07:35:24.720540+0000","last_peered":"2024-03-16T07:35:24.720540+0000","last_clean":"2024-03-16T07:35:24.720540+0000","last_became_active":"2024-03-16T07:35:10.371262+0000","last_became_peered":"2024-03-16T07:35:10.371262+0000","last_unstale":"2024-03-16T07:35:24.720540+0000","last_undegraded":"2024-03-16T07:35:24.720540+0000","last_fullsized":"2024-03-16T07:35:24.720540+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:11:42.125776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.1f","version":"167'4","reported_seq":26,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.720367+0000","last_change":"2024-03-16T07:35:09.679357+0000","last_active":"2024-03-16T07:35:24.720367+0000","last_peered":"2024-03-16T07:35:24.720367+0000","last_clean":"2024-03-16T07:35:24.720367+0000","last_became_active":"2024-03-16T07:35:09.679104+0000","last_became_peered":"2024-03-16T07:35:09.679104+0000","last_unstale":"2024-03-16T07:35:24.720367+0000","last_undegraded":"2024-03-16T07:35:24.720367+0000","last_fullsized":"2024-03-16T07:35:24.720367+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_clean_scrub_stamp":"2024-03-16T07:35:08.655627+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:44:40.502257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.1d","version":"0'0","reported_seq":12,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.713346+0000","last_change":"2024-03-16T07:35:23.735426+0000","last_active":"2024-03-16T07:35:24.713346+0000","last_peered":"2024-03-16T07:35:24.713346+0000","last_clean":"2024-03-16T07:35:24.713346+0000","last_became_active":"2024-03-16T07:35:23.735181+0000","last_became_peered":"2024-03-16T07:35:23.735181+0000","last_unstale":"2024-03-16T07:35:24.713346+0000","last_undegraded":"2024-03-16T07:35:24.713346+0000","last_fullsized":"2024-03-16T07:35:24.713346+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_clean_scrub_stamp":"2024-03-16T07:35:22.691587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:29:55.249041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"30.1c","version":"171'2","reported_seq":16,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.718549+0000","last_change":"2024-03-16T07:35:22.712815+0000","last_active":"2024-03-16T07:35:24.718549+0000","last_peered":"2024-03-16T07:35:24.718549+0000","last_clean":"2024-03-16T07:35:24.718549+0000","last_became_active":"2024-03-16T07:35:22.712239+0000","last_became_peered":"2024-03-16T07:35:22.712239+0000","last_unstale":"2024-03-16T07:35:24.718549+0000","last_undegraded":"2024-03-16T07:35:24.718549+0000","last_fullsized":"2024-03-16T07:35:24.718549+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:21.688749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:21.688749+0000","last_clean_scrub_stamp":"2024-03-16T07:35:21.688749+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:59:19.324143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.1f","version":"0'0","reported_seq":20,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.713295+0000","last_change":"2024-03-16T07:35:10.362327+0000","last_active":"2024-03-16T07:35:24.713295+0000","last_peered":"2024-03-16T07:35:24.713295+0000","last_clean":"2024-03-16T07:35:24.713295+0000","last_became_active":"2024-03-16T07:35:10.361296+0000","last_became_peered":"2024-03-16T07:35:10.361296+0000","last_unstale":"2024-03-16T07:35:24.713295+0000","last_undegraded":"2024-03-16T07:35:24.713295+0000","last_fullsized":"2024-03-16T07:35:24.713295+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:22:29.675922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.1e","version":"167'1","reported_seq":23,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.708986+0000","last_change":"2024-03-16T07:35:09.675846+0000","last_active":"2024-03-16T07:35:24.708986+0000","last_peered":"2024-03-16T07:35:24.708986+0000","last_clean":"2024-03-16T07:35:24.708986+0000","last_became_active":"2024-03-16T07:35:09.675457+0000","last_became_peered":"2024-03-16T07:35:09.675457+0000","last_unstale":"2024-03-16T07:35:24.708986+0000","last_undegraded":"2024-03-16T07:35:24.708986+0000","last_fullsized":"2024-03-16T07:35:24.708986+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_clean_scrub_stamp":"2024-03-16T07:35:08.655627+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:52:18.799704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.1f","version":"0'0","reported_seq":12,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.712799+0000","last_change":"2024-03-16T07:35:23.733516+0000","last_active":"2024-03-16T07:35:24.712799+0000","last_peered":"2024-03-16T07:35:24.712799+0000","last_clean":"2024-03-16T07:35:24.712799+0000","last_became_active":"2024-03-16T07:35:23.733101+0000","last_became_peered":"2024-03-16T07:35:23.733101+0000","last_unstale":"2024-03-16T07:35:24.712799+0000","last_undegraded":"2024-03-16T07:35:24.712799+0000","last_fullsized":"2024-03-16T07:35:24.712799+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_clean_scrub_stamp":"2024-03-16T07:35:22.691587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:01:30.802361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"30.1e","version":"171'1","reported_seq":15,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.720489+0000","last_change":"2024-03-16T07:35:22.721855+0000","last_active":"2024-03-16T07:35:24.720489+0000","last_peered":"2024-03-16T07:35:24.720489+0000","last_clean":"2024-03-16T07:35:24.720489+0000","last_became_active":"2024-03-16T07:35:22.721625+0000","last_became_peered":"2024-03-16T07:35:22.721625+0000","last_unstale":"2024-03-16T07:35:24.720489+0000","last_undegraded":"2024-03-16T07:35:24.720489+0000","last_fullsized":"2024-03-16T07:35:24.720489+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:21.688749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:21.688749+0000","last_clean_scrub_stamp":"2024-03-16T07:35:21.688749+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:31:55.221417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.1d","version":"0'0","reported_seq":20,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.713463+0000","last_change":"2024-03-16T07:35:10.361899+0000","last_active":"2024-03-16T07:35:24.713463+0000","last_peered":"2024-03-16T07:35:24.713463+0000","last_clean":"2024-03-16T07:35:24.713463+0000","last_became_active":"2024-03-16T07:35:10.361003+0000","last_became_peered":"2024-03-16T07:35:10.361003+0000","last_unstale":"2024-03-16T07:35:24.713463+0000","last_undegraded":"2024-03-16T07:35:24.713463+0000","last_fullsized":"2024-03-16T07:35:24.713463+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:39:54.636478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.1c","version":"167'2","reported_seq":24,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.720090+0000","last_change":"2024-03-16T07:35:09.683142+0000","last_active":"2024-03-16T07:35:24.720090+0000","last_peered":"2024-03-16T07:35:24.720090+0000","last_clean":"2024-03-16T07:35:24.720090+0000","last_became_active":"2024-03-16T07:35:09.682887+0000","last_became_peered":"2024-03-16T07:35:09.682887+0000","last_unstale":"2024-03-16T07:35:24.720090+0000","last_undegraded":"2024-03-16T07:35:24.720090+0000","last_fullsized":"2024-03-16T07:35:24.720090+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_clean_scrub_stamp":"2024-03-16T07:35:08.655627+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:07:12.557490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.18","version":"0'0","reported_seq":12,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.704735+0000","last_change":"2024-03-16T07:35:23.727106+0000","last_active":"2024-03-16T07:35:24.704735+0000","last_peered":"2024-03-16T07:35:24.704735+0000","last_clean":"2024-03-16T07:35:24.704735+0000","last_became_active":"2024-03-16T07:35:23.726687+0000","last_became_peered":"2024-03-16T07:35:23.726687+0000","last_unstale":"2024-03-16T07:35:24.704735+0000","last_undegraded":"2024-03-16T07:35:24.704735+0000","last_fullsized":"2024-03-16T07:35:24.704735+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_clean_scrub_stamp":"2024-03-16T07:35:22.691587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:55:37.621136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.19","version":"0'0","reported_seq":14,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.705016+0000","last_change":"2024-03-16T07:35:22.719239+0000","last_active":"2024-03-16T07:35:24.705016+0000","last_peered":"2024-03-16T07:35:24.705016+0000","last_clean":"2024-03-16T07:35:24.705016+0000","last_became_active":"2024-03-16T07:35:22.719022+0000","last_became_peered":"2024-03-16T07:35:22.719022+0000","last_unstale":"2024-03-16T07:35:24.705016+0000","last_undegraded":"2024-03-16T07:35:24.705016+0000","last_fullsized":"2024-03-16T07:35:24.705016+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:21.688749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:21.688749+0000","last_clean_scrub_stamp":"2024-03-16T07:35:21.688749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:43:20.441063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.1a","version":"0'0","reported_seq":20,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.718278+0000","last_change":"2024-03-16T07:35:10.372758+0000","last_active":"2024-03-16T07:35:24.718278+0000","last_peered":"2024-03-16T07:35:24.718278+0000","last_clean":"2024-03-16T07:35:24.718278+0000","last_became_active":"2024-03-16T07:35:10.370443+0000","last_became_peered":"2024-03-16T07:35:10.370443+0000","last_unstale":"2024-03-16T07:35:24.718278+0000","last_undegraded":"2024-03-16T07:35:24.718278+0000","last_fullsized":"2024-03-16T07:35:24.718278+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:00:29.880728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.1b","version":"167'1","reported_seq":23,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.714859+0000","last_change":"2024-03-16T07:35:09.686706+0000","last_active":"2024-03-16T07:35:24.714859+0000","last_peered":"2024-03-16T07:35:24.714859+0000","last_clean":"2024-03-16T07:35:24.714859+0000","last_became_active":"2024-03-16T07:35:09.686429+0000","last_became_peered":"2024-03-16T07:35:09.686429+0000","last_unstale":"2024-03-16T07:35:24.714859+0000","last_undegraded":"2024-03-16T07:35:24.714859+0000","last_fullsized":"2024-03-16T07:35:24.714859+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_clean_scrub_stamp":"2024-03-16T07:35:08.655627+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:52:03.120308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.19","version":"0'0","reported_seq":12,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.704816+0000","last_change":"2024-03-16T07:35:23.739914+0000","last_active":"2024-03-16T07:35:24.704816+0000","last_peered":"2024-03-16T07:35:24.704816+0000","last_clean":"2024-03-16T07:35:24.704816+0000","last_became_active":"2024-03-16T07:35:23.739448+0000","last_became_peered":"2024-03-16T07:35:23.739448+0000","last_unstale":"2024-03-16T07:35:24.704816+0000","last_undegraded":"2024-03-16T07:35:24.704816+0000","last_fullsized":"2024-03-16T07:35:24.704816+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_clean_scrub_stamp":"2024-03-16T07:35:22.691587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:48:59.716642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.18","version":"0'0","reported_seq":14,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.704715+0000","last_change":"2024-03-16T07:35:22.722949+0000","last_active":"2024-03-16T07:35:24.704715+0000","last_peered":"2024-03-16T07:35:24.704715+0000","last_clean":"2024-03-16T07:35:24.704715+0000","last_became_active":"2024-03-16T07:35:22.722705+0000","last_became_peered":"2024-03-16T07:35:22.722705+0000","last_unstale":"2024-03-16T07:35:24.704715+0000","last_undegraded":"2024-03-16T07:35:24.704715+0000","last_fullsized":"2024-03-16T07:35:24.704715+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:21.688749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:21.688749+0000","last_clean_scrub_stamp":"2024-03-16T07:35:21.688749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:11:01.174728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.1b","version":"0'0","reported_seq":20,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.707548+0000","last_change":"2024-03-16T07:35:10.372111+0000","last_active":"2024-03-16T07:35:24.707548+0000","last_peered":"2024-03-16T07:35:24.707548+0000","last_clean":"2024-03-16T07:35:24.707548+0000","last_became_active":"2024-03-16T07:35:10.370526+0000","last_became_peered":"2024-03-16T07:35:10.370526+0000","last_unstale":"2024-03-16T07:35:24.707548+0000","last_undegraded":"2024-03-16T07:35:24.707548+0000","last_fullsized":"2024-03-16T07:35:24.707548+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:31:51.311315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.1a","version":"167'1","reported_seq":23,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.706250+0000","last_change":"2024-03-16T07:35:09.674506+0000","last_active":"2024-03-16T07:35:24.706250+0000","last_peered":"2024-03-16T07:35:24.706250+0000","last_clean":"2024-03-16T07:35:24.706250+0000","last_became_active":"2024-03-16T07:35:09.674254+0000","last_became_peered":"2024-03-16T07:35:09.674254+0000","last_unstale":"2024-03-16T07:35:24.706250+0000","last_undegraded":"2024-03-16T07:35:24.706250+0000","last_fullsized":"2024-03-16T07:35:24.706250+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_clean_scrub_stamp":"2024-03-16T07:35:08.655627+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:19:04.260787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.1a","version":"0'0","reported_seq":12,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.718274+0000","last_change":"2024-03-16T07:35:23.738302+0000","last_active":"2024-03-16T07:35:24.718274+0000","last_peered":"2024-03-16T07:35:24.718274+0000","last_clean":"2024-03-16T07:35:24.718274+0000","last_became_active":"2024-03-16T07:35:23.737974+0000","last_became_peered":"2024-03-16T07:35:23.737974+0000","last_unstale":"2024-03-16T07:35:24.718274+0000","last_undegraded":"2024-03-16T07:35:24.718274+0000","last_fullsized":"2024-03-16T07:35:24.718274+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_clean_scrub_stamp":"2024-03-16T07:35:22.691587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:31:42.237648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"30.1b","version":"171'1","reported_seq":15,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.714336+0000","last_change":"2024-03-16T07:35:22.715727+0000","last_active":"2024-03-16T07:35:24.714336+0000","last_peered":"2024-03-16T07:35:24.714336+0000","last_clean":"2024-03-16T07:35:24.714336+0000","last_became_active":"2024-03-16T07:35:22.715208+0000","last_became_peered":"2024-03-16T07:35:22.715208+0000","last_unstale":"2024-03-16T07:35:24.714336+0000","last_undegraded":"2024-03-16T07:35:24.714336+0000","last_fullsized":"2024-03-16T07:35:24.714336+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:21.688749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:21.688749+0000","last_clean_scrub_stamp":"2024-03-16T07:35:21.688749+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:28:59.759055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.18","version":"0'0","reported_seq":20,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.712083+0000","last_change":"2024-03-16T07:35:10.363833+0000","last_active":"2024-03-16T07:35:24.712083+0000","last_peered":"2024-03-16T07:35:24.712083+0000","last_clean":"2024-03-16T07:35:24.712083+0000","last_became_active":"2024-03-16T07:35:10.363037+0000","last_became_peered":"2024-03-16T07:35:10.363037+0000","last_unstale":"2024-03-16T07:35:24.712083+0000","last_undegraded":"2024-03-16T07:35:24.712083+0000","last_fullsized":"2024-03-16T07:35:24.712083+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:50:44.382790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.19","version":"0'0","reported_seq":22,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.714593+0000","last_change":"2024-03-16T07:35:09.684877+0000","last_active":"2024-03-16T07:35:24.714593+0000","last_peered":"2024-03-16T07:35:24.714593+0000","last_clean":"2024-03-16T07:35:24.714593+0000","last_became_active":"2024-03-16T07:35:09.684558+0000","last_became_peered":"2024-03-16T07:35:09.684558+0000","last_unstale":"2024-03-16T07:35:24.714593+0000","last_undegraded":"2024-03-16T07:35:24.714593+0000","last_fullsized":"2024-03-16T07:35:24.714593+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_clean_scrub_stamp":"2024-03-16T07:35:08.655627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:18:02.438640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.1b","version":"0'0","reported_seq":12,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.717666+0000","last_change":"2024-03-16T07:35:23.737895+0000","last_active":"2024-03-16T07:35:24.717666+0000","last_peered":"2024-03-16T07:35:24.717666+0000","last_clean":"2024-03-16T07:35:24.717666+0000","last_became_active":"2024-03-16T07:35:23.736542+0000","last_became_peered":"2024-03-16T07:35:23.736542+0000","last_unstale":"2024-03-16T07:35:24.717666+0000","last_undegraded":"2024-03-16T07:35:24.717666+0000","last_fullsized":"2024-03-16T07:35:24.717666+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_clean_scrub_stamp":"2024-03-16T07:35:22.691587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:53:18.394438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"30.1a","version":"171'1","reported_seq":15,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.705955+0000","last_change":"2024-03-16T07:35:22.712120+0000","last_active":"2024-03-16T07:35:24.705955+0000","last_peered":"2024-03-16T07:35:24.705955+0000","last_clean":"2024-03-16T07:35:24.705955+0000","last_became_active":"2024-03-16T07:35:22.711882+0000","last_became_peered":"2024-03-16T07:35:22.711882+0000","last_unstale":"2024-03-16T07:35:24.705955+0000","last_undegraded":"2024-03-16T07:35:24.705955+0000","last_fullsized":"2024-03-16T07:35:24.705955+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:21.688749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:21.688749+0000","last_clean_scrub_stamp":"2024-03-16T07:35:21.688749+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:44:53.535380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.19","version":"0'0","reported_seq":20,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.705378+0000","last_change":"2024-03-16T07:35:10.367160+0000","last_active":"2024-03-16T07:35:24.705378+0000","last_peered":"2024-03-16T07:35:24.705378+0000","last_clean":"2024-03-16T07:35:24.705378+0000","last_became_active":"2024-03-16T07:35:10.365971+0000","last_became_peered":"2024-03-16T07:35:10.365971+0000","last_unstale":"2024-03-16T07:35:24.705378+0000","last_undegraded":"2024-03-16T07:35:24.705378+0000","last_fullsized":"2024-03-16T07:35:24.705378+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:36:14.514526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.18","version":"0'0","reported_seq":22,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.712260+0000","last_change":"2024-03-16T07:35:09.684870+0000","last_active":"2024-03-16T07:35:24.712260+0000","last_peered":"2024-03-16T07:35:24.712260+0000","last_clean":"2024-03-16T07:35:24.712260+0000","last_became_active":"2024-03-16T07:35:09.684583+0000","last_became_peered":"2024-03-16T07:35:09.684583+0000","last_unstale":"2024-03-16T07:35:24.712260+0000","last_undegraded":"2024-03-16T07:35:24.712260+0000","last_fullsized":"2024-03-16T07:35:24.712260+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_clean_scrub_stamp":"2024-03-16T07:35:08.655627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:36:37.264021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.14","version":"0'0","reported_seq":12,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.718722+0000","last_change":"2024-03-16T07:35:23.739172+0000","last_active":"2024-03-16T07:35:24.718722+0000","last_peered":"2024-03-16T07:35:24.718722+0000","last_clean":"2024-03-16T07:35:24.718722+0000","last_became_active":"2024-03-16T07:35:23.738478+0000","last_became_peered":"2024-03-16T07:35:23.738478+0000","last_unstale":"2024-03-16T07:35:24.718722+0000","last_undegraded":"2024-03-16T07:35:24.718722+0000","last_fullsized":"2024-03-16T07:35:24.718722+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_clean_scrub_stamp":"2024-03-16T07:35:22.691587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:36:24.627260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"30.15","version":"171'3","reported_seq":17,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.708348+0000","last_change":"2024-03-16T07:35:22.719882+0000","last_active":"2024-03-16T07:35:24.708348+0000","last_peered":"2024-03-16T07:35:24.708348+0000","last_clean":"2024-03-16T07:35:24.708348+0000","last_became_active":"2024-03-16T07:35:22.719648+0000","last_became_peered":"2024-03-16T07:35:22.719648+0000","last_unstale":"2024-03-16T07:35:24.708348+0000","last_undegraded":"2024-03-16T07:35:24.708348+0000","last_fullsized":"2024-03-16T07:35:24.708348+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:21.688749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:21.688749+0000","last_clean_scrub_stamp":"2024-03-16T07:35:21.688749+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:03:18.769275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.16","version":"0'0","reported_seq":20,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.708817+0000","last_change":"2024-03-16T07:35:10.372562+0000","last_active":"2024-03-16T07:35:24.708817+0000","last_peered":"2024-03-16T07:35:24.708817+0000","last_clean":"2024-03-16T07:35:24.708817+0000","last_became_active":"2024-03-16T07:35:10.372187+0000","last_became_peered":"2024-03-16T07:35:10.372187+0000","last_unstale":"2024-03-16T07:35:24.708817+0000","last_undegraded":"2024-03-16T07:35:24.708817+0000","last_fullsized":"2024-03-16T07:35:24.708817+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:39:30.707025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.17","version":"0'0","reported_seq":22,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.707393+0000","last_change":"2024-03-16T07:35:09.680665+0000","last_active":"2024-03-16T07:35:24.707393+0000","last_peered":"2024-03-16T07:35:24.707393+0000","last_clean":"2024-03-16T07:35:24.707393+0000","last_became_active":"2024-03-16T07:35:09.680284+0000","last_became_peered":"2024-03-16T07:35:09.680284+0000","last_unstale":"2024-03-16T07:35:24.707393+0000","last_undegraded":"2024-03-16T07:35:24.707393+0000","last_fullsized":"2024-03-16T07:35:24.707393+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_clean_scrub_stamp":"2024-03-16T07:35:08.655627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:44:57.045499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.15","version":"0'0","reported_seq":12,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.707068+0000","last_change":"2024-03-16T07:35:23.742074+0000","last_active":"2024-03-16T07:35:24.707068+0000","last_peered":"2024-03-16T07:35:24.707068+0000","last_clean":"2024-03-16T07:35:24.707068+0000","last_became_active":"2024-03-16T07:35:23.738214+0000","last_became_peered":"2024-03-16T07:35:23.738214+0000","last_unstale":"2024-03-16T07:35:24.707068+0000","last_undegraded":"2024-03-16T07:35:24.707068+0000","last_fullsized":"2024-03-16T07:35:24.707068+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_clean_scrub_stamp":"2024-03-16T07:35:22.691587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:54:04.144696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.14","version":"171'6","reported_seq":20,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.706375+0000","last_change":"2024-03-16T07:35:22.713183+0000","last_active":"2024-03-16T07:35:24.706375+0000","last_peered":"2024-03-16T07:35:24.706375+0000","last_clean":"2024-03-16T07:35:24.706375+0000","last_became_active":"2024-03-16T07:35:22.712947+0000","last_became_peered":"2024-03-16T07:35:22.712947+0000","last_unstale":"2024-03-16T07:35:24.706375+0000","last_undegraded":"2024-03-16T07:35:24.706375+0000","last_fullsized":"2024-03-16T07:35:24.706375+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:21.688749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:21.688749+0000","last_clean_scrub_stamp":"2024-03-16T07:35:21.688749+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:47:04.887782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.17","version":"0'0","reported_seq":20,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.720278+0000","last_change":"2024-03-16T07:35:10.359658+0000","last_active":"2024-03-16T07:35:24.720278+0000","last_peered":"2024-03-16T07:35:24.720278+0000","last_clean":"2024-03-16T07:35:24.720278+0000","last_became_active":"2024-03-16T07:35:10.359392+0000","last_became_peered":"2024-03-16T07:35:10.359392+0000","last_unstale":"2024-03-16T07:35:24.720278+0000","last_undegraded":"2024-03-16T07:35:24.720278+0000","last_fullsized":"2024-03-16T07:35:24.720278+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:37:53.987285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.16","version":"0'0","reported_seq":22,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.720587+0000","last_change":"2024-03-16T07:35:09.683330+0000","last_active":"2024-03-16T07:35:24.720587+0000","last_peered":"2024-03-16T07:35:24.720587+0000","last_clean":"2024-03-16T07:35:24.720587+0000","last_became_active":"2024-03-16T07:35:09.682629+0000","last_became_peered":"2024-03-16T07:35:09.682629+0000","last_unstale":"2024-03-16T07:35:24.720587+0000","last_undegraded":"2024-03-16T07:35:24.720587+0000","last_fullsized":"2024-03-16T07:35:24.720587+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_clean_scrub_stamp":"2024-03-16T07:35:08.655627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:20:13.455330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.16","version":"0'0","reported_seq":12,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.708411+0000","last_change":"2024-03-16T07:35:23.731515+0000","last_active":"2024-03-16T07:35:24.708411+0000","last_peered":"2024-03-16T07:35:24.708411+0000","last_clean":"2024-03-16T07:35:24.708411+0000","last_became_active":"2024-03-16T07:35:23.730472+0000","last_became_peered":"2024-03-16T07:35:23.730472+0000","last_unstale":"2024-03-16T07:35:24.708411+0000","last_undegraded":"2024-03-16T07:35:24.708411+0000","last_fullsized":"2024-03-16T07:35:24.708411+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_clean_scrub_stamp":"2024-03-16T07:35:22.691587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:10:53.567397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.17","version":"0'0","reported_seq":14,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.720080+0000","last_change":"2024-03-16T07:35:22.721705+0000","last_active":"2024-03-16T07:35:24.720080+0000","last_peered":"2024-03-16T07:35:24.720080+0000","last_clean":"2024-03-16T07:35:24.720080+0000","last_became_active":"2024-03-16T07:35:22.721460+0000","last_became_peered":"2024-03-16T07:35:22.721460+0000","last_unstale":"2024-03-16T07:35:24.720080+0000","last_undegraded":"2024-03-16T07:35:24.720080+0000","last_fullsized":"2024-03-16T07:35:24.720080+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:21.688749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:21.688749+0000","last_clean_scrub_stamp":"2024-03-16T07:35:21.688749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:13:54.110760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.14","version":"0'0","reported_seq":20,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.713381+0000","last_change":"2024-03-16T07:35:10.359135+0000","last_active":"2024-03-16T07:35:24.713381+0000","last_peered":"2024-03-16T07:35:24.713381+0000","last_clean":"2024-03-16T07:35:24.713381+0000","last_became_active":"2024-03-16T07:35:10.358882+0000","last_became_peered":"2024-03-16T07:35:10.358882+0000","last_unstale":"2024-03-16T07:35:24.713381+0000","last_undegraded":"2024-03-16T07:35:24.713381+0000","last_fullsized":"2024-03-16T07:35:24.713381+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:47:52.138505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.15","version":"167'3","reported_seq":25,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.709096+0000","last_change":"2024-03-16T07:35:09.670265+0000","last_active":"2024-03-16T07:35:24.709096+0000","last_peered":"2024-03-16T07:35:24.709096+0000","last_clean":"2024-03-16T07:35:24.709096+0000","last_became_active":"2024-03-16T07:35:09.670015+0000","last_became_peered":"2024-03-16T07:35:09.670015+0000","last_unstale":"2024-03-16T07:35:24.709096+0000","last_undegraded":"2024-03-16T07:35:24.709096+0000","last_fullsized":"2024-03-16T07:35:24.709096+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_clean_scrub_stamp":"2024-03-16T07:35:08.655627+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:00:24.230346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.17","version":"0'0","reported_seq":12,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.718796+0000","last_change":"2024-03-16T07:35:23.731169+0000","last_active":"2024-03-16T07:35:24.718796+0000","last_peered":"2024-03-16T07:35:24.718796+0000","last_clean":"2024-03-16T07:35:24.718796+0000","last_became_active":"2024-03-16T07:35:23.730567+0000","last_became_peered":"2024-03-16T07:35:23.730567+0000","last_unstale":"2024-03-16T07:35:24.718796+0000","last_undegraded":"2024-03-16T07:35:24.718796+0000","last_fullsized":"2024-03-16T07:35:24.718796+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_clean_scrub_stamp":"2024-03-16T07:35:22.691587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:59:17.136836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"30.16","version":"0'0","reported_seq":14,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.713826+0000","last_change":"2024-03-16T07:35:22.711367+0000","last_active":"2024-03-16T07:35:24.713826+0000","last_peered":"2024-03-16T07:35:24.713826+0000","last_clean":"2024-03-16T07:35:24.713826+0000","last_became_active":"2024-03-16T07:35:22.711110+0000","last_became_peered":"2024-03-16T07:35:22.711110+0000","last_unstale":"2024-03-16T07:35:24.713826+0000","last_undegraded":"2024-03-16T07:35:24.713826+0000","last_fullsized":"2024-03-16T07:35:24.713826+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:21.688749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:21.688749+0000","last_clean_scrub_stamp":"2024-03-16T07:35:21.688749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:03:46.135429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.15","version":"0'0","reported_seq":20,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.720528+0000","last_change":"2024-03-16T07:35:10.368083+0000","last_active":"2024-03-16T07:35:24.720528+0000","last_peered":"2024-03-16T07:35:24.720528+0000","last_clean":"2024-03-16T07:35:24.720528+0000","last_became_active":"2024-03-16T07:35:10.365110+0000","last_became_peered":"2024-03-16T07:35:10.365110+0000","last_unstale":"2024-03-16T07:35:24.720528+0000","last_undegraded":"2024-03-16T07:35:24.720528+0000","last_fullsized":"2024-03-16T07:35:24.720528+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:10:43.387314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.14","version":"168'8","reported_seq":30,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.720211+0000","last_change":"2024-03-16T07:35:09.682373+0000","last_active":"2024-03-16T07:35:24.720211+0000","last_peered":"2024-03-16T07:35:24.720211+0000","last_clean":"2024-03-16T07:35:24.720211+0000","last_became_active":"2024-03-16T07:35:09.681726+0000","last_became_peered":"2024-03-16T07:35:09.681726+0000","last_unstale":"2024-03-16T07:35:24.720211+0000","last_undegraded":"2024-03-16T07:35:24.720211+0000","last_fullsized":"2024-03-16T07:35:24.720211+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_clean_scrub_stamp":"2024-03-16T07:35:08.655627+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:30:16.270717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3309,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.10","version":"0'0","reported_seq":12,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.711954+0000","last_change":"2024-03-16T07:35:23.712905+0000","last_active":"2024-03-16T07:35:24.711954+0000","last_peered":"2024-03-16T07:35:24.711954+0000","last_clean":"2024-03-16T07:35:24.711954+0000","last_became_active":"2024-03-16T07:35:23.712666+0000","last_became_peered":"2024-03-16T07:35:23.712666+0000","last_unstale":"2024-03-16T07:35:24.711954+0000","last_undegraded":"2024-03-16T07:35:24.711954+0000","last_fullsized":"2024-03-16T07:35:24.711954+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_clean_scrub_stamp":"2024-03-16T07:35:22.691587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:34:05.302539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"30.11","version":"0'0","reported_seq":14,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.705121+0000","last_change":"2024-03-16T07:35:22.718692+0000","last_active":"2024-03-16T07:35:24.705121+0000","last_peered":"2024-03-16T07:35:24.705121+0000","last_clean":"2024-03-16T07:35:24.705121+0000","last_became_active":"2024-03-16T07:35:22.718451+0000","last_became_peered":"2024-03-16T07:35:22.718451+0000","last_unstale":"2024-03-16T07:35:24.705121+0000","last_undegraded":"2024-03-16T07:35:24.705121+0000","last_fullsized":"2024-03-16T07:35:24.705121+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:21.688749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:21.688749+0000","last_clean_scrub_stamp":"2024-03-16T07:35:21.688749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:07:42.829403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.12","version":"0'0","reported_seq":20,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.718330+0000","last_change":"2024-03-16T07:35:10.372982+0000","last_active":"2024-03-16T07:35:24.718330+0000","last_peered":"2024-03-16T07:35:24.718330+0000","last_clean":"2024-03-16T07:35:24.718330+0000","last_became_active":"2024-03-16T07:35:10.371039+0000","last_became_peered":"2024-03-16T07:35:10.371039+0000","last_unstale":"2024-03-16T07:35:24.718330+0000","last_undegraded":"2024-03-16T07:35:24.718330+0000","last_fullsized":"2024-03-16T07:35:24.718330+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:58:20.875907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.13","version":"167'2","reported_seq":24,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.714986+0000","last_change":"2024-03-16T07:35:09.685238+0000","last_active":"2024-03-16T07:35:24.714986+0000","last_peered":"2024-03-16T07:35:24.714986+0000","last_clean":"2024-03-16T07:35:24.714986+0000","last_became_active":"2024-03-16T07:35:09.684483+0000","last_became_peered":"2024-03-16T07:35:09.684483+0000","last_unstale":"2024-03-16T07:35:24.714986+0000","last_undegraded":"2024-03-16T07:35:24.714986+0000","last_fullsized":"2024-03-16T07:35:24.714986+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_clean_scrub_stamp":"2024-03-16T07:35:08.655627+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:38:00.899911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.11","version":"0'0","reported_seq":12,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.717489+0000","last_change":"2024-03-16T07:35:23.730236+0000","last_active":"2024-03-16T07:35:24.717489+0000","last_peered":"2024-03-16T07:35:24.717489+0000","last_clean":"2024-03-16T07:35:24.717489+0000","last_became_active":"2024-03-16T07:35:23.730000+0000","last_became_peered":"2024-03-16T07:35:23.730000+0000","last_unstale":"2024-03-16T07:35:24.717489+0000","last_undegraded":"2024-03-16T07:35:24.717489+0000","last_fullsized":"2024-03-16T07:35:24.717489+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_clean_scrub_stamp":"2024-03-16T07:35:22.691587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:05:22.341139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"30.10","version":"171'8","reported_seq":22,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.716911+0000","last_change":"2024-03-16T07:35:22.714389+0000","last_active":"2024-03-16T07:35:24.716911+0000","last_peered":"2024-03-16T07:35:24.716911+0000","last_clean":"2024-03-16T07:35:24.716911+0000","last_became_active":"2024-03-16T07:35:22.713189+0000","last_became_peered":"2024-03-16T07:35:22.713189+0000","last_unstale":"2024-03-16T07:35:24.716911+0000","last_undegraded":"2024-03-16T07:35:24.716911+0000","last_fullsized":"2024-03-16T07:35:24.716911+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:21.688749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:21.688749+0000","last_clean_scrub_stamp":"2024-03-16T07:35:21.688749+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:54:25.980516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.13","version":"0'0","reported_seq":20,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.707638+0000","last_change":"2024-03-16T07:35:10.368332+0000","last_active":"2024-03-16T07:35:24.707638+0000","last_peered":"2024-03-16T07:35:24.707638+0000","last_clean":"2024-03-16T07:35:24.707638+0000","last_became_active":"2024-03-16T07:35:10.366791+0000","last_became_peered":"2024-03-16T07:35:10.366791+0000","last_unstale":"2024-03-16T07:35:24.707638+0000","last_undegraded":"2024-03-16T07:35:24.707638+0000","last_fullsized":"2024-03-16T07:35:24.707638+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:42:40.386511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.12","version":"0'0","reported_seq":22,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.718557+0000","last_change":"2024-03-16T07:35:09.682025+0000","last_active":"2024-03-16T07:35:24.718557+0000","last_peered":"2024-03-16T07:35:24.718557+0000","last_clean":"2024-03-16T07:35:24.718557+0000","last_became_active":"2024-03-16T07:35:09.681598+0000","last_became_peered":"2024-03-16T07:35:09.681598+0000","last_unstale":"2024-03-16T07:35:24.718557+0000","last_undegraded":"2024-03-16T07:35:24.718557+0000","last_fullsized":"2024-03-16T07:35:24.718557+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_clean_scrub_stamp":"2024-03-16T07:35:08.655627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:11:43.037273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.12","version":"0'0","reported_seq":12,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.717172+0000","last_change":"2024-03-16T07:35:23.737245+0000","last_active":"2024-03-16T07:35:24.717172+0000","last_peered":"2024-03-16T07:35:24.717172+0000","last_clean":"2024-03-16T07:35:24.717172+0000","last_became_active":"2024-03-16T07:35:23.736919+0000","last_became_peered":"2024-03-16T07:35:23.736919+0000","last_unstale":"2024-03-16T07:35:24.717172+0000","last_undegraded":"2024-03-16T07:35:24.717172+0000","last_fullsized":"2024-03-16T07:35:24.717172+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_clean_scrub_stamp":"2024-03-16T07:35:22.691587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:18:08.855866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"30.13","version":"171'2","reported_seq":16,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.707165+0000","last_change":"2024-03-16T07:35:22.717494+0000","last_active":"2024-03-16T07:35:24.707165+0000","last_peered":"2024-03-16T07:35:24.707165+0000","last_clean":"2024-03-16T07:35:24.707165+0000","last_became_active":"2024-03-16T07:35:22.717251+0000","last_became_peered":"2024-03-16T07:35:22.717251+0000","last_unstale":"2024-03-16T07:35:24.707165+0000","last_undegraded":"2024-03-16T07:35:24.707165+0000","last_fullsized":"2024-03-16T07:35:24.707165+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:21.688749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:21.688749+0000","last_clean_scrub_stamp":"2024-03-16T07:35:21.688749+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:57:56.117670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.10","version":"0'0","reported_seq":20,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.712098+0000","last_change":"2024-03-16T07:35:10.363831+0000","last_active":"2024-03-16T07:35:24.712098+0000","last_peered":"2024-03-16T07:35:24.712098+0000","last_clean":"2024-03-16T07:35:24.712098+0000","last_became_active":"2024-03-16T07:35:10.363235+0000","last_became_peered":"2024-03-16T07:35:10.363235+0000","last_unstale":"2024-03-16T07:35:24.712098+0000","last_undegraded":"2024-03-16T07:35:24.712098+0000","last_fullsized":"2024-03-16T07:35:24.712098+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:28:10.644885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.11","version":"0'0","reported_seq":22,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.705497+0000","last_change":"2024-03-16T07:35:09.676637+0000","last_active":"2024-03-16T07:35:24.705497+0000","last_peered":"2024-03-16T07:35:24.705497+0000","last_clean":"2024-03-16T07:35:24.705497+0000","last_became_active":"2024-03-16T07:35:09.676175+0000","last_became_peered":"2024-03-16T07:35:09.676175+0000","last_unstale":"2024-03-16T07:35:24.705497+0000","last_undegraded":"2024-03-16T07:35:24.705497+0000","last_fullsized":"2024-03-16T07:35:24.705497+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_clean_scrub_stamp":"2024-03-16T07:35:08.655627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:15:03.991142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.13","version":"0'0","reported_seq":12,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.714260+0000","last_change":"2024-03-16T07:35:23.722776+0000","last_active":"2024-03-16T07:35:24.714260+0000","last_peered":"2024-03-16T07:35:24.714260+0000","last_clean":"2024-03-16T07:35:24.714260+0000","last_became_active":"2024-03-16T07:35:23.721513+0000","last_became_peered":"2024-03-16T07:35:23.721513+0000","last_unstale":"2024-03-16T07:35:24.714260+0000","last_undegraded":"2024-03-16T07:35:24.714260+0000","last_fullsized":"2024-03-16T07:35:24.714260+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_clean_scrub_stamp":"2024-03-16T07:35:22.691587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:17:30.545715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"30.12","version":"0'0","reported_seq":14,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.717341+0000","last_change":"2024-03-16T07:35:22.715887+0000","last_active":"2024-03-16T07:35:24.717341+0000","last_peered":"2024-03-16T07:35:24.717341+0000","last_clean":"2024-03-16T07:35:24.717341+0000","last_became_active":"2024-03-16T07:35:22.715061+0000","last_became_peered":"2024-03-16T07:35:22.715061+0000","last_unstale":"2024-03-16T07:35:24.717341+0000","last_undegraded":"2024-03-16T07:35:24.717341+0000","last_fullsized":"2024-03-16T07:35:24.717341+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:21.688749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:21.688749+0000","last_clean_scrub_stamp":"2024-03-16T07:35:21.688749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:20:33.398006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.11","version":"0'0","reported_seq":20,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.717950+0000","last_change":"2024-03-16T07:35:10.371588+0000","last_active":"2024-03-16T07:35:24.717950+0000","last_peered":"2024-03-16T07:35:24.717950+0000","last_clean":"2024-03-16T07:35:24.717950+0000","last_became_active":"2024-03-16T07:35:10.368385+0000","last_became_peered":"2024-03-16T07:35:10.368385+0000","last_unstale":"2024-03-16T07:35:24.717950+0000","last_undegraded":"2024-03-16T07:35:24.717950+0000","last_fullsized":"2024-03-16T07:35:24.717950+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:10:54.068374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.10","version":"167'8","reported_seq":30,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.717257+0000","last_change":"2024-03-16T07:35:09.678042+0000","last_active":"2024-03-16T07:35:24.717257+0000","last_peered":"2024-03-16T07:35:24.717257+0000","last_clean":"2024-03-16T07:35:24.717257+0000","last_became_active":"2024-03-16T07:35:09.677738+0000","last_became_peered":"2024-03-16T07:35:09.677738+0000","last_unstale":"2024-03-16T07:35:24.717257+0000","last_undegraded":"2024-03-16T07:35:24.717257+0000","last_fullsized":"2024-03-16T07:35:24.717257+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_clean_scrub_stamp":"2024-03-16T07:35:08.655627+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:07:38.696095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.c","version":"0'0","reported_seq":12,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.718286+0000","last_change":"2024-03-16T07:35:23.738971+0000","last_active":"2024-03-16T07:35:24.718286+0000","last_peered":"2024-03-16T07:35:24.718286+0000","last_clean":"2024-03-16T07:35:24.718286+0000","last_became_active":"2024-03-16T07:35:23.737944+0000","last_became_peered":"2024-03-16T07:35:23.737944+0000","last_unstale":"2024-03-16T07:35:24.718286+0000","last_undegraded":"2024-03-16T07:35:24.718286+0000","last_fullsized":"2024-03-16T07:35:24.718286+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_clean_scrub_stamp":"2024-03-16T07:35:22.691587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:28:45.587506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"30.d","version":"171'1","reported_seq":15,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.720162+0000","last_change":"2024-03-16T07:35:22.714476+0000","last_active":"2024-03-16T07:35:24.720162+0000","last_peered":"2024-03-16T07:35:24.720162+0000","last_clean":"2024-03-16T07:35:24.720162+0000","last_became_active":"2024-03-16T07:35:22.714046+0000","last_became_peered":"2024-03-16T07:35:22.714046+0000","last_unstale":"2024-03-16T07:35:24.720162+0000","last_undegraded":"2024-03-16T07:35:24.720162+0000","last_fullsized":"2024-03-16T07:35:24.720162+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:21.688749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:21.688749+0000","last_clean_scrub_stamp":"2024-03-16T07:35:21.688749+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:44:00.928871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.e","version":"0'0","reported_seq":20,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.714494+0000","last_change":"2024-03-16T07:35:10.360336+0000","last_active":"2024-03-16T07:35:24.714494+0000","last_peered":"2024-03-16T07:35:24.714494+0000","last_clean":"2024-03-16T07:35:24.714494+0000","last_became_active":"2024-03-16T07:35:10.360103+0000","last_became_peered":"2024-03-16T07:35:10.360103+0000","last_unstale":"2024-03-16T07:35:24.714494+0000","last_undegraded":"2024-03-16T07:35:24.714494+0000","last_fullsized":"2024-03-16T07:35:24.714494+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:26:42.036511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.f","version":"167'1","reported_seq":23,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.707478+0000","last_change":"2024-03-16T07:35:09.680840+0000","last_active":"2024-03-16T07:35:24.707478+0000","last_peered":"2024-03-16T07:35:24.707478+0000","last_clean":"2024-03-16T07:35:24.707478+0000","last_became_active":"2024-03-16T07:35:09.679859+0000","last_became_peered":"2024-03-16T07:35:09.679859+0000","last_unstale":"2024-03-16T07:35:24.707478+0000","last_undegraded":"2024-03-16T07:35:24.707478+0000","last_fullsized":"2024-03-16T07:35:24.707478+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_clean_scrub_stamp":"2024-03-16T07:35:08.655627+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:46:33.709266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.d","version":"0'0","reported_seq":12,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.707217+0000","last_change":"2024-03-16T07:35:23.736078+0000","last_active":"2024-03-16T07:35:24.707217+0000","last_peered":"2024-03-16T07:35:24.707217+0000","last_clean":"2024-03-16T07:35:24.707217+0000","last_became_active":"2024-03-16T07:35:23.735854+0000","last_became_peered":"2024-03-16T07:35:23.735854+0000","last_unstale":"2024-03-16T07:35:24.707217+0000","last_undegraded":"2024-03-16T07:35:24.707217+0000","last_fullsized":"2024-03-16T07:35:24.707217+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_clean_scrub_stamp":"2024-03-16T07:35:22.691587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:01:00.802582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.c","version":"0'0","reported_seq":14,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.718658+0000","last_change":"2024-03-16T07:35:22.713718+0000","last_active":"2024-03-16T07:35:24.718658+0000","last_peered":"2024-03-16T07:35:24.718658+0000","last_clean":"2024-03-16T07:35:24.718658+0000","last_became_active":"2024-03-16T07:35:22.712577+0000","last_became_peered":"2024-03-16T07:35:22.712577+0000","last_unstale":"2024-03-16T07:35:24.718658+0000","last_undegraded":"2024-03-16T07:35:24.718658+0000","last_fullsized":"2024-03-16T07:35:24.718658+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:21.688749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:21.688749+0000","last_clean_scrub_stamp":"2024-03-16T07:35:21.688749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:17:11.876528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.f","version":"0'0","reported_seq":20,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.707218+0000","last_change":"2024-03-16T07:35:10.370056+0000","last_active":"2024-03-16T07:35:24.707218+0000","last_peered":"2024-03-16T07:35:24.707218+0000","last_clean":"2024-03-16T07:35:24.707218+0000","last_became_active":"2024-03-16T07:35:10.369815+0000","last_became_peered":"2024-03-16T07:35:10.369815+0000","last_unstale":"2024-03-16T07:35:24.707218+0000","last_undegraded":"2024-03-16T07:35:24.707218+0000","last_fullsized":"2024-03-16T07:35:24.707218+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:33:30.711096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.e","version":"167'2","reported_seq":24,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.720642+0000","last_change":"2024-03-16T07:35:09.683036+0000","last_active":"2024-03-16T07:35:24.720642+0000","last_peered":"2024-03-16T07:35:24.720642+0000","last_clean":"2024-03-16T07:35:24.720642+0000","last_became_active":"2024-03-16T07:35:09.682652+0000","last_became_peered":"2024-03-16T07:35:09.682652+0000","last_unstale":"2024-03-16T07:35:24.720642+0000","last_undegraded":"2024-03-16T07:35:24.720642+0000","last_fullsized":"2024-03-16T07:35:24.720642+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_clean_scrub_stamp":"2024-03-16T07:35:08.655627+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:29:41.213080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.e","version":"0'0","reported_seq":12,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.713731+0000","last_change":"2024-03-16T07:35:23.740039+0000","last_active":"2024-03-16T07:35:24.713731+0000","last_peered":"2024-03-16T07:35:24.713731+0000","last_clean":"2024-03-16T07:35:24.713731+0000","last_became_active":"2024-03-16T07:35:23.739228+0000","last_became_peered":"2024-03-16T07:35:23.739228+0000","last_unstale":"2024-03-16T07:35:24.713731+0000","last_undegraded":"2024-03-16T07:35:24.713731+0000","last_fullsized":"2024-03-16T07:35:24.713731+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_clean_scrub_stamp":"2024-03-16T07:35:22.691587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:11:02.177566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"30.f","version":"171'1","reported_seq":15,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.720185+0000","last_change":"2024-03-16T07:35:22.722948+0000","last_active":"2024-03-16T07:35:24.720185+0000","last_peered":"2024-03-16T07:35:24.720185+0000","last_clean":"2024-03-16T07:35:24.720185+0000","last_became_active":"2024-03-16T07:35:22.722571+0000","last_became_peered":"2024-03-16T07:35:22.722571+0000","last_unstale":"2024-03-16T07:35:24.720185+0000","last_undegraded":"2024-03-16T07:35:24.720185+0000","last_fullsized":"2024-03-16T07:35:24.720185+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:21.688749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:21.688749+0000","last_clean_scrub_stamp":"2024-03-16T07:35:21.688749+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:18:41.568783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.c","version":"0'0","reported_seq":20,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.720040+0000","last_change":"2024-03-16T07:35:10.372880+0000","last_active":"2024-03-16T07:35:24.720040+0000","last_peered":"2024-03-16T07:35:24.720040+0000","last_clean":"2024-03-16T07:35:24.720040+0000","last_became_active":"2024-03-16T07:35:10.368709+0000","last_became_peered":"2024-03-16T07:35:10.368709+0000","last_unstale":"2024-03-16T07:35:24.720040+0000","last_undegraded":"2024-03-16T07:35:24.720040+0000","last_fullsized":"2024-03-16T07:35:24.720040+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:20:49.601169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.d","version":"167'1","reported_seq":23,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.709188+0000","last_change":"2024-03-16T07:35:09.674601+0000","last_active":"2024-03-16T07:35:24.709188+0000","last_peered":"2024-03-16T07:35:24.709188+0000","last_clean":"2024-03-16T07:35:24.709188+0000","last_became_active":"2024-03-16T07:35:09.674335+0000","last_became_peered":"2024-03-16T07:35:09.674335+0000","last_unstale":"2024-03-16T07:35:24.709188+0000","last_undegraded":"2024-03-16T07:35:24.709188+0000","last_fullsized":"2024-03-16T07:35:24.709188+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_clean_scrub_stamp":"2024-03-16T07:35:08.655627+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:01:15.773351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.f","version":"0'0","reported_seq":12,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.719916+0000","last_change":"2024-03-16T07:35:23.720163+0000","last_active":"2024-03-16T07:35:24.719916+0000","last_peered":"2024-03-16T07:35:24.719916+0000","last_clean":"2024-03-16T07:35:24.719916+0000","last_became_active":"2024-03-16T07:35:23.719876+0000","last_became_peered":"2024-03-16T07:35:23.719876+0000","last_unstale":"2024-03-16T07:35:24.719916+0000","last_undegraded":"2024-03-16T07:35:24.719916+0000","last_fullsized":"2024-03-16T07:35:24.719916+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_clean_scrub_stamp":"2024-03-16T07:35:22.691587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:36:15.431938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"30.e","version":"171'2","reported_seq":16,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.714235+0000","last_change":"2024-03-16T07:35:22.717638+0000","last_active":"2024-03-16T07:35:24.714235+0000","last_peered":"2024-03-16T07:35:24.714235+0000","last_clean":"2024-03-16T07:35:24.714235+0000","last_became_active":"2024-03-16T07:35:22.717385+0000","last_became_peered":"2024-03-16T07:35:22.717385+0000","last_unstale":"2024-03-16T07:35:24.714235+0000","last_undegraded":"2024-03-16T07:35:24.714235+0000","last_fullsized":"2024-03-16T07:35:24.714235+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:21.688749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:21.688749+0000","last_clean_scrub_stamp":"2024-03-16T07:35:21.688749+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:47:42.875741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.d","version":"0'0","reported_seq":20,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.713547+0000","last_change":"2024-03-16T07:35:10.361177+0000","last_active":"2024-03-16T07:35:24.713547+0000","last_peered":"2024-03-16T07:35:24.713547+0000","last_clean":"2024-03-16T07:35:24.713547+0000","last_became_active":"2024-03-16T07:35:10.360525+0000","last_became_peered":"2024-03-16T07:35:10.360525+0000","last_unstale":"2024-03-16T07:35:24.713547+0000","last_undegraded":"2024-03-16T07:35:24.713547+0000","last_fullsized":"2024-03-16T07:35:24.713547+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:44:13.480808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.c","version":"0'0","reported_seq":22,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.706739+0000","last_change":"2024-03-16T07:35:09.675575+0000","last_active":"2024-03-16T07:35:24.706739+0000","last_peered":"2024-03-16T07:35:24.706739+0000","last_clean":"2024-03-16T07:35:24.706739+0000","last_became_active":"2024-03-16T07:35:09.675269+0000","last_became_peered":"2024-03-16T07:35:09.675269+0000","last_unstale":"2024-03-16T07:35:24.706739+0000","last_undegraded":"2024-03-16T07:35:24.706739+0000","last_fullsized":"2024-03-16T07:35:24.706739+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_clean_scrub_stamp":"2024-03-16T07:35:08.655627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:57:44.612807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.8","version":"0'0","reported_seq":12,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.716796+0000","last_change":"2024-03-16T07:35:23.739470+0000","last_active":"2024-03-16T07:35:24.716796+0000","last_peered":"2024-03-16T07:35:24.716796+0000","last_clean":"2024-03-16T07:35:24.716796+0000","last_became_active":"2024-03-16T07:35:23.735868+0000","last_became_peered":"2024-03-16T07:35:23.735868+0000","last_unstale":"2024-03-16T07:35:24.716796+0000","last_undegraded":"2024-03-16T07:35:24.716796+0000","last_fullsized":"2024-03-16T07:35:24.716796+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_clean_scrub_stamp":"2024-03-16T07:35:22.691587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:19:14.711209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"30.9","version":"0'0","reported_seq":14,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.705208+0000","last_change":"2024-03-16T07:35:22.716087+0000","last_active":"2024-03-16T07:35:24.705208+0000","last_peered":"2024-03-16T07:35:24.705208+0000","last_clean":"2024-03-16T07:35:24.705208+0000","last_became_active":"2024-03-16T07:35:22.715843+0000","last_became_peered":"2024-03-16T07:35:22.715843+0000","last_unstale":"2024-03-16T07:35:24.705208+0000","last_undegraded":"2024-03-16T07:35:24.705208+0000","last_fullsized":"2024-03-16T07:35:24.705208+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:21.688749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:21.688749+0000","last_clean_scrub_stamp":"2024-03-16T07:35:21.688749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:17:29.542878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.a","version":"0'0","reported_seq":20,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.706164+0000","last_change":"2024-03-16T07:35:10.374978+0000","last_active":"2024-03-16T07:35:24.706164+0000","last_peered":"2024-03-16T07:35:24.706164+0000","last_clean":"2024-03-16T07:35:24.706164+0000","last_became_active":"2024-03-16T07:35:10.374760+0000","last_became_peered":"2024-03-16T07:35:10.374760+0000","last_unstale":"2024-03-16T07:35:24.706164+0000","last_undegraded":"2024-03-16T07:35:24.706164+0000","last_fullsized":"2024-03-16T07:35:24.706164+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:57:01.662775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.b","version":"167'2","reported_seq":24,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.707934+0000","last_change":"2024-03-16T07:35:09.676930+0000","last_active":"2024-03-16T07:35:24.707934+0000","last_peered":"2024-03-16T07:35:24.707934+0000","last_clean":"2024-03-16T07:35:24.707934+0000","last_became_active":"2024-03-16T07:35:09.676583+0000","last_became_peered":"2024-03-16T07:35:09.676583+0000","last_unstale":"2024-03-16T07:35:24.707934+0000","last_undegraded":"2024-03-16T07:35:24.707934+0000","last_fullsized":"2024-03-16T07:35:24.707934+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_clean_scrub_stamp":"2024-03-16T07:35:08.655627+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:37:47.441198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.9","version":"0'0","reported_seq":12,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.704923+0000","last_change":"2024-03-16T07:35:23.722245+0000","last_active":"2024-03-16T07:35:24.704923+0000","last_peered":"2024-03-16T07:35:24.704923+0000","last_clean":"2024-03-16T07:35:24.704923+0000","last_became_active":"2024-03-16T07:35:23.721751+0000","last_became_peered":"2024-03-16T07:35:23.721751+0000","last_unstale":"2024-03-16T07:35:24.704923+0000","last_undegraded":"2024-03-16T07:35:24.704923+0000","last_fullsized":"2024-03-16T07:35:24.704923+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_clean_scrub_stamp":"2024-03-16T07:35:22.691587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:11:07.103320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.8","version":"0'0","reported_seq":14,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.704813+0000","last_change":"2024-03-16T07:35:22.716725+0000","last_active":"2024-03-16T07:35:24.704813+0000","last_peered":"2024-03-16T07:35:24.704813+0000","last_clean":"2024-03-16T07:35:24.704813+0000","last_became_active":"2024-03-16T07:35:22.716480+0000","last_became_peered":"2024-03-16T07:35:22.716480+0000","last_unstale":"2024-03-16T07:35:24.704813+0000","last_undegraded":"2024-03-16T07:35:24.704813+0000","last_fullsized":"2024-03-16T07:35:24.704813+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:21.688749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:21.688749+0000","last_clean_scrub_stamp":"2024-03-16T07:35:21.688749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:45:57.072623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.b","version":"0'0","reported_seq":20,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.714715+0000","last_change":"2024-03-16T07:35:10.359641+0000","last_active":"2024-03-16T07:35:24.714715+0000","last_peered":"2024-03-16T07:35:24.714715+0000","last_clean":"2024-03-16T07:35:24.714715+0000","last_became_active":"2024-03-16T07:35:10.359195+0000","last_became_peered":"2024-03-16T07:35:10.359195+0000","last_unstale":"2024-03-16T07:35:24.714715+0000","last_undegraded":"2024-03-16T07:35:24.714715+0000","last_fullsized":"2024-03-16T07:35:24.714715+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:52:52.660849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.a","version":"0'0","reported_seq":22,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.713159+0000","last_change":"2024-03-16T07:35:09.684320+0000","last_active":"2024-03-16T07:35:24.713159+0000","last_peered":"2024-03-16T07:35:24.713159+0000","last_clean":"2024-03-16T07:35:24.713159+0000","last_became_active":"2024-03-16T07:35:09.683895+0000","last_became_peered":"2024-03-16T07:35:09.683895+0000","last_unstale":"2024-03-16T07:35:24.713159+0000","last_undegraded":"2024-03-16T07:35:24.713159+0000","last_fullsized":"2024-03-16T07:35:24.713159+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_clean_scrub_stamp":"2024-03-16T07:35:08.655627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:49:10.728594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.a","version":"0'0","reported_seq":12,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.712631+0000","last_change":"2024-03-16T07:35:23.710306+0000","last_active":"2024-03-16T07:35:24.712631+0000","last_peered":"2024-03-16T07:35:24.712631+0000","last_clean":"2024-03-16T07:35:24.712631+0000","last_became_active":"2024-03-16T07:35:23.710066+0000","last_became_peered":"2024-03-16T07:35:23.710066+0000","last_unstale":"2024-03-16T07:35:24.712631+0000","last_undegraded":"2024-03-16T07:35:24.712631+0000","last_fullsized":"2024-03-16T07:35:24.712631+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_clean_scrub_stamp":"2024-03-16T07:35:22.691587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:07:52.732055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"30.b","version":"171'2","reported_seq":16,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.714458+0000","last_change":"2024-03-16T07:35:22.715953+0000","last_active":"2024-03-16T07:35:24.714458+0000","last_peered":"2024-03-16T07:35:24.714458+0000","last_clean":"2024-03-16T07:35:24.714458+0000","last_became_active":"2024-03-16T07:35:22.715504+0000","last_became_peered":"2024-03-16T07:35:22.715504+0000","last_unstale":"2024-03-16T07:35:24.714458+0000","last_undegraded":"2024-03-16T07:35:24.714458+0000","last_fullsized":"2024-03-16T07:35:24.714458+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:21.688749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:21.688749+0000","last_clean_scrub_stamp":"2024-03-16T07:35:21.688749+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:25:06.918560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.8","version":"0'0","reported_seq":20,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.712173+0000","last_change":"2024-03-16T07:35:10.363635+0000","last_active":"2024-03-16T07:35:24.712173+0000","last_peered":"2024-03-16T07:35:24.712173+0000","last_clean":"2024-03-16T07:35:24.712173+0000","last_became_active":"2024-03-16T07:35:10.362705+0000","last_became_peered":"2024-03-16T07:35:10.362705+0000","last_unstale":"2024-03-16T07:35:24.712173+0000","last_undegraded":"2024-03-16T07:35:24.712173+0000","last_fullsized":"2024-03-16T07:35:24.712173+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:19:12.330824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.9","version":"0'0","reported_seq":22,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.718139+0000","last_change":"2024-03-16T07:35:09.682153+0000","last_active":"2024-03-16T07:35:24.718139+0000","last_peered":"2024-03-16T07:35:24.718139+0000","last_clean":"2024-03-16T07:35:24.718139+0000","last_became_active":"2024-03-16T07:35:09.681886+0000","last_became_peered":"2024-03-16T07:35:09.681886+0000","last_unstale":"2024-03-16T07:35:24.718139+0000","last_undegraded":"2024-03-16T07:35:24.718139+0000","last_fullsized":"2024-03-16T07:35:24.718139+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_clean_scrub_stamp":"2024-03-16T07:35:08.655627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:45:44.039500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.b","version":"0'0","reported_seq":12,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.706815+0000","last_change":"2024-03-16T07:35:23.731097+0000","last_active":"2024-03-16T07:35:24.706815+0000","last_peered":"2024-03-16T07:35:24.706815+0000","last_clean":"2024-03-16T07:35:24.706815+0000","last_became_active":"2024-03-16T07:35:23.730415+0000","last_became_peered":"2024-03-16T07:35:23.730415+0000","last_unstale":"2024-03-16T07:35:24.706815+0000","last_undegraded":"2024-03-16T07:35:24.706815+0000","last_fullsized":"2024-03-16T07:35:24.706815+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_clean_scrub_stamp":"2024-03-16T07:35:22.691587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:56:57.722309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.a","version":"0'0","reported_seq":14,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.717450+0000","last_change":"2024-03-16T07:35:22.715592+0000","last_active":"2024-03-16T07:35:24.717450+0000","last_peered":"2024-03-16T07:35:24.717450+0000","last_clean":"2024-03-16T07:35:24.717450+0000","last_became_active":"2024-03-16T07:35:22.714811+0000","last_became_peered":"2024-03-16T07:35:22.714811+0000","last_unstale":"2024-03-16T07:35:24.717450+0000","last_undegraded":"2024-03-16T07:35:24.717450+0000","last_fullsized":"2024-03-16T07:35:24.717450+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:21.688749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:21.688749+0000","last_clean_scrub_stamp":"2024-03-16T07:35:21.688749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:16:41.471386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.9","version":"0'0","reported_seq":20,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.705410+0000","last_change":"2024-03-16T07:35:10.366866+0000","last_active":"2024-03-16T07:35:24.705410+0000","last_peered":"2024-03-16T07:35:24.705410+0000","last_clean":"2024-03-16T07:35:24.705410+0000","last_became_active":"2024-03-16T07:35:10.365511+0000","last_became_peered":"2024-03-16T07:35:10.365511+0000","last_unstale":"2024-03-16T07:35:24.705410+0000","last_undegraded":"2024-03-16T07:35:24.705410+0000","last_fullsized":"2024-03-16T07:35:24.705410+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:28:47.726946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.8","version":"0'0","reported_seq":22,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.717339+0000","last_change":"2024-03-16T07:35:09.678924+0000","last_active":"2024-03-16T07:35:24.717339+0000","last_peered":"2024-03-16T07:35:24.717339+0000","last_clean":"2024-03-16T07:35:24.717339+0000","last_became_active":"2024-03-16T07:35:09.678666+0000","last_became_peered":"2024-03-16T07:35:09.678666+0000","last_unstale":"2024-03-16T07:35:24.717339+0000","last_undegraded":"2024-03-16T07:35:24.717339+0000","last_fullsized":"2024-03-16T07:35:24.717339+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_clean_scrub_stamp":"2024-03-16T07:35:08.655627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:07:52.268339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.4","version":"0'0","reported_seq":12,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.718438+0000","last_change":"2024-03-16T07:35:23.737667+0000","last_active":"2024-03-16T07:35:24.718438+0000","last_peered":"2024-03-16T07:35:24.718438+0000","last_clean":"2024-03-16T07:35:24.718438+0000","last_became_active":"2024-03-16T07:35:23.736180+0000","last_became_peered":"2024-03-16T07:35:23.736180+0000","last_unstale":"2024-03-16T07:35:24.718438+0000","last_undegraded":"2024-03-16T07:35:24.718438+0000","last_fullsized":"2024-03-16T07:35:24.718438+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_clean_scrub_stamp":"2024-03-16T07:35:22.691587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:44:38.265207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"30.5","version":"0'0","reported_seq":14,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.708484+0000","last_change":"2024-03-16T07:35:22.717121+0000","last_active":"2024-03-16T07:35:24.708484+0000","last_peered":"2024-03-16T07:35:24.708484+0000","last_clean":"2024-03-16T07:35:24.708484+0000","last_became_active":"2024-03-16T07:35:22.716876+0000","last_became_peered":"2024-03-16T07:35:22.716876+0000","last_unstale":"2024-03-16T07:35:24.708484+0000","last_undegraded":"2024-03-16T07:35:24.708484+0000","last_fullsized":"2024-03-16T07:35:24.708484+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:21.688749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:21.688749+0000","last_clean_scrub_stamp":"2024-03-16T07:35:21.688749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:50:51.170914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.6","version":"0'0","reported_seq":20,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.708900+0000","last_change":"2024-03-16T07:35:10.371595+0000","last_active":"2024-03-16T07:35:24.708900+0000","last_peered":"2024-03-16T07:35:24.708900+0000","last_clean":"2024-03-16T07:35:24.708900+0000","last_became_active":"2024-03-16T07:35:10.369883+0000","last_became_peered":"2024-03-16T07:35:10.369883+0000","last_unstale":"2024-03-16T07:35:24.708900+0000","last_undegraded":"2024-03-16T07:35:24.708900+0000","last_fullsized":"2024-03-16T07:35:24.708900+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:08:16.640821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.7","version":"167'2","reported_seq":24,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.707639+0000","last_change":"2024-03-16T07:35:09.675559+0000","last_active":"2024-03-16T07:35:24.707639+0000","last_peered":"2024-03-16T07:35:24.707639+0000","last_clean":"2024-03-16T07:35:24.707639+0000","last_became_active":"2024-03-16T07:35:09.675177+0000","last_became_peered":"2024-03-16T07:35:09.675177+0000","last_unstale":"2024-03-16T07:35:24.707639+0000","last_undegraded":"2024-03-16T07:35:24.707639+0000","last_fullsized":"2024-03-16T07:35:24.707639+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_clean_scrub_stamp":"2024-03-16T07:35:08.655627+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:01:22.257974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.5","version":"0'0","reported_seq":12,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.720087+0000","last_change":"2024-03-16T07:35:23.734113+0000","last_active":"2024-03-16T07:35:24.720087+0000","last_peered":"2024-03-16T07:35:24.720087+0000","last_clean":"2024-03-16T07:35:24.720087+0000","last_became_active":"2024-03-16T07:35:23.732909+0000","last_became_peered":"2024-03-16T07:35:23.732909+0000","last_unstale":"2024-03-16T07:35:24.720087+0000","last_undegraded":"2024-03-16T07:35:24.720087+0000","last_fullsized":"2024-03-16T07:35:24.720087+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_clean_scrub_stamp":"2024-03-16T07:35:22.691587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:02:05.138809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"30.4","version":"0'0","reported_seq":14,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.719865+0000","last_change":"2024-03-16T07:35:22.714417+0000","last_active":"2024-03-16T07:35:24.719865+0000","last_peered":"2024-03-16T07:35:24.719865+0000","last_clean":"2024-03-16T07:35:24.719865+0000","last_became_active":"2024-03-16T07:35:22.714174+0000","last_became_peered":"2024-03-16T07:35:22.714174+0000","last_unstale":"2024-03-16T07:35:24.719865+0000","last_undegraded":"2024-03-16T07:35:24.719865+0000","last_fullsized":"2024-03-16T07:35:24.719865+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:21.688749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:21.688749+0000","last_clean_scrub_stamp":"2024-03-16T07:35:21.688749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:35:22.924515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.7","version":"0'0","reported_seq":20,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.707310+0000","last_change":"2024-03-16T07:35:10.365677+0000","last_active":"2024-03-16T07:35:24.707310+0000","last_peered":"2024-03-16T07:35:24.707310+0000","last_clean":"2024-03-16T07:35:24.707310+0000","last_became_active":"2024-03-16T07:35:10.364776+0000","last_became_peered":"2024-03-16T07:35:10.364776+0000","last_unstale":"2024-03-16T07:35:24.707310+0000","last_undegraded":"2024-03-16T07:35:24.707310+0000","last_fullsized":"2024-03-16T07:35:24.707310+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:08:30.408444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.6","version":"168'1","reported_seq":23,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.709078+0000","last_change":"2024-03-16T07:35:09.675754+0000","last_active":"2024-03-16T07:35:24.709078+0000","last_peered":"2024-03-16T07:35:24.709078+0000","last_clean":"2024-03-16T07:35:24.709078+0000","last_became_active":"2024-03-16T07:35:09.675073+0000","last_became_peered":"2024-03-16T07:35:09.675073+0000","last_unstale":"2024-03-16T07:35:24.709078+0000","last_undegraded":"2024-03-16T07:35:24.709078+0000","last_fullsized":"2024-03-16T07:35:24.709078+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_clean_scrub_stamp":"2024-03-16T07:35:08.655627+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T09:13:12.288432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.6","version":"0'0","reported_seq":12,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.720127+0000","last_change":"2024-03-16T07:35:23.737263+0000","last_active":"2024-03-16T07:35:24.720127+0000","last_peered":"2024-03-16T07:35:24.720127+0000","last_clean":"2024-03-16T07:35:24.720127+0000","last_became_active":"2024-03-16T07:35:23.736974+0000","last_became_peered":"2024-03-16T07:35:23.736974+0000","last_unstale":"2024-03-16T07:35:24.720127+0000","last_undegraded":"2024-03-16T07:35:24.720127+0000","last_fullsized":"2024-03-16T07:35:24.720127+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_clean_scrub_stamp":"2024-03-16T07:35:22.691587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:46:55.009826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"30.7","version":"171'2","reported_seq":16,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.712907+0000","last_change":"2024-03-16T07:35:22.710689+0000","last_active":"2024-03-16T07:35:24.712907+0000","last_peered":"2024-03-16T07:35:24.712907+0000","last_clean":"2024-03-16T07:35:24.712907+0000","last_became_active":"2024-03-16T07:35:22.710441+0000","last_became_peered":"2024-03-16T07:35:22.710441+0000","last_unstale":"2024-03-16T07:35:24.712907+0000","last_undegraded":"2024-03-16T07:35:24.712907+0000","last_fullsized":"2024-03-16T07:35:24.712907+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:21.688749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:21.688749+0000","last_clean_scrub_stamp":"2024-03-16T07:35:21.688749+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T12:50:56.126250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.4","version":"0'0","reported_seq":20,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.706648+0000","last_change":"2024-03-16T07:35:10.371080+0000","last_active":"2024-03-16T07:35:24.706648+0000","last_peered":"2024-03-16T07:35:24.706648+0000","last_clean":"2024-03-16T07:35:24.706648+0000","last_became_active":"2024-03-16T07:35:10.370374+0000","last_became_peered":"2024-03-16T07:35:10.370374+0000","last_unstale":"2024-03-16T07:35:24.706648+0000","last_undegraded":"2024-03-16T07:35:24.706648+0000","last_fullsized":"2024-03-16T07:35:24.706648+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T13:16:16.585185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.5","version":"0'0","reported_seq":22,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.713732+0000","last_change":"2024-03-16T07:35:09.685196+0000","last_active":"2024-03-16T07:35:24.713732+0000","last_peered":"2024-03-16T07:35:24.713732+0000","last_clean":"2024-03-16T07:35:24.713732+0000","last_became_active":"2024-03-16T07:35:09.684449+0000","last_became_peered":"2024-03-16T07:35:09.684449+0000","last_unstale":"2024-03-16T07:35:24.713732+0000","last_undegraded":"2024-03-16T07:35:24.713732+0000","last_fullsized":"2024-03-16T07:35:24.713732+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_clean_scrub_stamp":"2024-03-16T07:35:08.655627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:13:04.761117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.7","version":"0'0","reported_seq":12,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.706678+0000","last_change":"2024-03-16T07:35:23.740753+0000","last_active":"2024-03-16T07:35:24.706678+0000","last_peered":"2024-03-16T07:35:24.706678+0000","last_clean":"2024-03-16T07:35:24.706678+0000","last_became_active":"2024-03-16T07:35:23.740447+0000","last_became_peered":"2024-03-16T07:35:23.740447+0000","last_unstale":"2024-03-16T07:35:24.706678+0000","last_undegraded":"2024-03-16T07:35:24.706678+0000","last_fullsized":"2024-03-16T07:35:24.706678+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_clean_scrub_stamp":"2024-03-16T07:35:22.691587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:11:55.160722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.6","version":"172'1","reported_seq":15,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.715917+0000","last_change":"2024-03-16T07:35:22.710720+0000","last_active":"2024-03-16T07:35:24.715917+0000","last_peered":"2024-03-16T07:35:24.715917+0000","last_clean":"2024-03-16T07:35:24.715917+0000","last_became_active":"2024-03-16T07:35:22.710496+0000","last_became_peered":"2024-03-16T07:35:22.710496+0000","last_unstale":"2024-03-16T07:35:24.715917+0000","last_undegraded":"2024-03-16T07:35:24.715917+0000","last_fullsized":"2024-03-16T07:35:24.715917+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:21.688749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:21.688749+0000","last_clean_scrub_stamp":"2024-03-16T07:35:21.688749+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:57:13.694884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.5","version":"0'0","reported_seq":20,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.708925+0000","last_change":"2024-03-16T07:35:10.369204+0000","last_active":"2024-03-16T07:35:24.708925+0000","last_peered":"2024-03-16T07:35:24.708925+0000","last_clean":"2024-03-16T07:35:24.708925+0000","last_became_active":"2024-03-16T07:35:10.368924+0000","last_became_peered":"2024-03-16T07:35:10.368924+0000","last_unstale":"2024-03-16T07:35:24.708925+0000","last_undegraded":"2024-03-16T07:35:24.708925+0000","last_fullsized":"2024-03-16T07:35:24.708925+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:37:38.287390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.4","version":"0'0","reported_seq":22,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.720239+0000","last_change":"2024-03-16T07:35:09.677063+0000","last_active":"2024-03-16T07:35:24.720239+0000","last_peered":"2024-03-16T07:35:24.720239+0000","last_clean":"2024-03-16T07:35:24.720239+0000","last_became_active":"2024-03-16T07:35:09.676808+0000","last_became_peered":"2024-03-16T07:35:09.676808+0000","last_unstale":"2024-03-16T07:35:24.720239+0000","last_undegraded":"2024-03-16T07:35:24.720239+0000","last_fullsized":"2024-03-16T07:35:24.720239+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_clean_scrub_stamp":"2024-03-16T07:35:08.655627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:10:48.141606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.0","version":"0'0","reported_seq":12,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.716914+0000","last_change":"2024-03-16T07:35:23.721421+0000","last_active":"2024-03-16T07:35:24.716914+0000","last_peered":"2024-03-16T07:35:24.716914+0000","last_clean":"2024-03-16T07:35:24.716914+0000","last_became_active":"2024-03-16T07:35:23.718322+0000","last_became_peered":"2024-03-16T07:35:23.718322+0000","last_unstale":"2024-03-16T07:35:24.716914+0000","last_undegraded":"2024-03-16T07:35:24.716914+0000","last_fullsized":"2024-03-16T07:35:24.716914+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_clean_scrub_stamp":"2024-03-16T07:35:22.691587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:20:10.631902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"30.1","version":"0'0","reported_seq":14,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.717242+0000","last_change":"2024-03-16T07:35:22.721589+0000","last_active":"2024-03-16T07:35:24.717242+0000","last_peered":"2024-03-16T07:35:24.717242+0000","last_clean":"2024-03-16T07:35:24.717242+0000","last_became_active":"2024-03-16T07:35:22.721291+0000","last_became_peered":"2024-03-16T07:35:22.721291+0000","last_unstale":"2024-03-16T07:35:24.717242+0000","last_undegraded":"2024-03-16T07:35:24.717242+0000","last_fullsized":"2024-03-16T07:35:24.717242+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:21.688749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:21.688749+0000","last_clean_scrub_stamp":"2024-03-16T07:35:21.688749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:52:51.359882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.2","version":"0'0","reported_seq":20,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.706222+0000","last_change":"2024-03-16T07:35:10.369686+0000","last_active":"2024-03-16T07:35:24.706222+0000","last_peered":"2024-03-16T07:35:24.706222+0000","last_clean":"2024-03-16T07:35:24.706222+0000","last_became_active":"2024-03-16T07:35:10.369421+0000","last_became_peered":"2024-03-16T07:35:10.369421+0000","last_unstale":"2024-03-16T07:35:24.706222+0000","last_undegraded":"2024-03-16T07:35:24.706222+0000","last_fullsized":"2024-03-16T07:35:24.706222+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:03:34.103320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.3","version":"0'0","reported_seq":22,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.718020+0000","last_change":"2024-03-16T07:35:09.681585+0000","last_active":"2024-03-16T07:35:24.718020+0000","last_peered":"2024-03-16T07:35:24.718020+0000","last_clean":"2024-03-16T07:35:24.718020+0000","last_became_active":"2024-03-16T07:35:09.681312+0000","last_became_peered":"2024-03-16T07:35:09.681312+0000","last_unstale":"2024-03-16T07:35:24.718020+0000","last_undegraded":"2024-03-16T07:35:24.718020+0000","last_fullsized":"2024-03-16T07:35:24.718020+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_clean_scrub_stamp":"2024-03-16T07:35:08.655627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:33:35.043407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.1","version":"0'0","reported_seq":12,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.704964+0000","last_change":"2024-03-16T07:35:23.739682+0000","last_active":"2024-03-16T07:35:24.704964+0000","last_peered":"2024-03-16T07:35:24.704964+0000","last_clean":"2024-03-16T07:35:24.704964+0000","last_became_active":"2024-03-16T07:35:23.739232+0000","last_became_peered":"2024-03-16T07:35:23.739232+0000","last_unstale":"2024-03-16T07:35:24.704964+0000","last_undegraded":"2024-03-16T07:35:24.704964+0000","last_fullsized":"2024-03-16T07:35:24.704964+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_clean_scrub_stamp":"2024-03-16T07:35:22.691587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T15:33:30.851182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.0","version":"0'0","reported_seq":14,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.717421+0000","last_change":"2024-03-16T07:35:22.714224+0000","last_active":"2024-03-16T07:35:24.717421+0000","last_peered":"2024-03-16T07:35:24.717421+0000","last_clean":"2024-03-16T07:35:24.717421+0000","last_became_active":"2024-03-16T07:35:22.713932+0000","last_became_peered":"2024-03-16T07:35:22.713932+0000","last_unstale":"2024-03-16T07:35:24.717421+0000","last_undegraded":"2024-03-16T07:35:24.717421+0000","last_fullsized":"2024-03-16T07:35:24.717421+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:21.688749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:21.688749+0000","last_clean_scrub_stamp":"2024-03-16T07:35:21.688749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:33:47.061822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.3","version":"0'0","reported_seq":20,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.707723+0000","last_change":"2024-03-16T07:35:10.369293+0000","last_active":"2024-03-16T07:35:24.707723+0000","last_peered":"2024-03-16T07:35:24.707723+0000","last_clean":"2024-03-16T07:35:24.707723+0000","last_became_active":"2024-03-16T07:35:10.368043+0000","last_became_peered":"2024-03-16T07:35:10.368043+0000","last_unstale":"2024-03-16T07:35:24.707723+0000","last_undegraded":"2024-03-16T07:35:24.707723+0000","last_fullsized":"2024-03-16T07:35:24.707723+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:18:55.775147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.2","version":"0'0","reported_seq":22,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.718455+0000","last_change":"2024-03-16T07:35:09.681598+0000","last_active":"2024-03-16T07:35:24.718455+0000","last_peered":"2024-03-16T07:35:24.718455+0000","last_clean":"2024-03-16T07:35:24.718455+0000","last_became_active":"2024-03-16T07:35:09.681337+0000","last_became_peered":"2024-03-16T07:35:09.681337+0000","last_unstale":"2024-03-16T07:35:24.718455+0000","last_undegraded":"2024-03-16T07:35:24.718455+0000","last_fullsized":"2024-03-16T07:35:24.718455+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_clean_scrub_stamp":"2024-03-16T07:35:08.655627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:01:16.766400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.2","version":"0'0","reported_seq":12,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.712717+0000","last_change":"2024-03-16T07:35:23.742096+0000","last_active":"2024-03-16T07:35:24.712717+0000","last_peered":"2024-03-16T07:35:24.712717+0000","last_clean":"2024-03-16T07:35:24.712717+0000","last_became_active":"2024-03-16T07:35:23.740797+0000","last_became_peered":"2024-03-16T07:35:23.740797+0000","last_unstale":"2024-03-16T07:35:24.712717+0000","last_undegraded":"2024-03-16T07:35:24.712717+0000","last_fullsized":"2024-03-16T07:35:24.712717+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_clean_scrub_stamp":"2024-03-16T07:35:22.691587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:11:57.073233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"30.3","version":"0'0","reported_seq":14,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.717475+0000","last_change":"2024-03-16T07:35:22.714140+0000","last_active":"2024-03-16T07:35:24.717475+0000","last_peered":"2024-03-16T07:35:24.717475+0000","last_clean":"2024-03-16T07:35:24.717475+0000","last_became_active":"2024-03-16T07:35:22.713806+0000","last_became_peered":"2024-03-16T07:35:22.713806+0000","last_unstale":"2024-03-16T07:35:24.717475+0000","last_undegraded":"2024-03-16T07:35:24.717475+0000","last_fullsized":"2024-03-16T07:35:24.717475+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:21.688749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:21.688749+0000","last_clean_scrub_stamp":"2024-03-16T07:35:21.688749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T16:27:31.135815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.0","version":"0'0","reported_seq":20,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.717221+0000","last_change":"2024-03-16T07:35:10.367769+0000","last_active":"2024-03-16T07:35:24.717221+0000","last_peered":"2024-03-16T07:35:24.717221+0000","last_clean":"2024-03-16T07:35:24.717221+0000","last_became_active":"2024-03-16T07:35:10.367452+0000","last_became_peered":"2024-03-16T07:35:10.367452+0000","last_unstale":"2024-03-16T07:35:24.717221+0000","last_undegraded":"2024-03-16T07:35:24.717221+0000","last_fullsized":"2024-03-16T07:35:24.717221+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:34:22.428101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.1","version":"0'0","reported_seq":22,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.705555+0000","last_change":"2024-03-16T07:35:09.676420+0000","last_active":"2024-03-16T07:35:24.705555+0000","last_peered":"2024-03-16T07:35:24.705555+0000","last_clean":"2024-03-16T07:35:24.705555+0000","last_became_active":"2024-03-16T07:35:09.675843+0000","last_became_peered":"2024-03-16T07:35:09.675843+0000","last_unstale":"2024-03-16T07:35:24.705555+0000","last_undegraded":"2024-03-16T07:35:24.705555+0000","last_fullsized":"2024-03-16T07:35:24.705555+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_clean_scrub_stamp":"2024-03-16T07:35:08.655627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T14:59:26.600725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.3","version":"0'0","reported_seq":12,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.706947+0000","last_change":"2024-03-16T07:35:23.742427+0000","last_active":"2024-03-16T07:35:24.706947+0000","last_peered":"2024-03-16T07:35:24.706947+0000","last_clean":"2024-03-16T07:35:24.706947+0000","last_became_active":"2024-03-16T07:35:23.742161+0000","last_became_peered":"2024-03-16T07:35:23.742161+0000","last_unstale":"2024-03-16T07:35:24.706947+0000","last_undegraded":"2024-03-16T07:35:24.706947+0000","last_fullsized":"2024-03-16T07:35:24.706947+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_clean_scrub_stamp":"2024-03-16T07:35:22.691587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:32:01.170129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.2","version":"0'0","reported_seq":14,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.714284+0000","last_change":"2024-03-16T07:35:22.711439+0000","last_active":"2024-03-16T07:35:24.714284+0000","last_peered":"2024-03-16T07:35:24.714284+0000","last_clean":"2024-03-16T07:35:24.714284+0000","last_became_active":"2024-03-16T07:35:22.711201+0000","last_became_peered":"2024-03-16T07:35:22.711201+0000","last_unstale":"2024-03-16T07:35:24.714284+0000","last_undegraded":"2024-03-16T07:35:24.714284+0000","last_fullsized":"2024-03-16T07:35:24.714284+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:21.688749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:21.688749+0000","last_clean_scrub_stamp":"2024-03-16T07:35:21.688749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:36:26.546635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.1","version":"0'0","reported_seq":20,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.714423+0000","last_change":"2024-03-16T07:35:10.361913+0000","last_active":"2024-03-16T07:35:24.714423+0000","last_peered":"2024-03-16T07:35:24.714423+0000","last_clean":"2024-03-16T07:35:24.714423+0000","last_became_active":"2024-03-16T07:35:10.361684+0000","last_became_peered":"2024-03-16T07:35:10.361684+0000","last_unstale":"2024-03-16T07:35:24.714423+0000","last_undegraded":"2024-03-16T07:35:24.714423+0000","last_fullsized":"2024-03-16T07:35:24.714423+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T07:57:45.613820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.0","version":"0'0","reported_seq":22,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.705137+0000","last_change":"2024-03-16T07:35:09.680845+0000","last_active":"2024-03-16T07:35:24.705137+0000","last_peered":"2024-03-16T07:35:24.705137+0000","last_clean":"2024-03-16T07:35:24.705137+0000","last_became_active":"2024-03-16T07:35:09.680308+0000","last_became_peered":"2024-03-16T07:35:09.680308+0000","last_unstale":"2024-03-16T07:35:24.705137+0000","last_undegraded":"2024-03-16T07:35:24.705137+0000","last_fullsized":"2024-03-16T07:35:24.705137+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_clean_scrub_stamp":"2024-03-16T07:35:08.655627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:29:38.393742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.1e","version":"0'0","reported_seq":12,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.714625+0000","last_change":"2024-03-16T07:35:23.740403+0000","last_active":"2024-03-16T07:35:24.714625+0000","last_peered":"2024-03-16T07:35:24.714625+0000","last_clean":"2024-03-16T07:35:24.714625+0000","last_became_active":"2024-03-16T07:35:23.739819+0000","last_became_peered":"2024-03-16T07:35:23.739819+0000","last_unstale":"2024-03-16T07:35:24.714625+0000","last_undegraded":"2024-03-16T07:35:24.714625+0000","last_fullsized":"2024-03-16T07:35:24.714625+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:22.691587+0000","last_clean_scrub_stamp":"2024-03-16T07:35:22.691587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:43:21.443900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"30.1f","version":"171'4","reported_seq":18,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.720101+0000","last_change":"2024-03-16T07:35:22.721126+0000","last_active":"2024-03-16T07:35:24.720101+0000","last_peered":"2024-03-16T07:35:24.720101+0000","last_clean":"2024-03-16T07:35:24.720101+0000","last_became_active":"2024-03-16T07:35:22.720885+0000","last_became_peered":"2024-03-16T07:35:22.720885+0000","last_unstale":"2024-03-16T07:35:24.720101+0000","last_undegraded":"2024-03-16T07:35:24.720101+0000","last_fullsized":"2024-03-16T07:35:24.720101+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:21.688749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:21.688749+0000","last_clean_scrub_stamp":"2024-03-16T07:35:21.688749+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:58:13.331147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.1c","version":"0'0","reported_seq":20,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.713285+0000","last_change":"2024-03-16T07:35:10.360240+0000","last_active":"2024-03-16T07:35:24.713285+0000","last_peered":"2024-03-16T07:35:24.713285+0000","last_clean":"2024-03-16T07:35:24.713285+0000","last_became_active":"2024-03-16T07:35:10.360005+0000","last_became_peered":"2024-03-16T07:35:10.360005+0000","last_unstale":"2024-03-16T07:35:24.713285+0000","last_undegraded":"2024-03-16T07:35:24.713285+0000","last_fullsized":"2024-03-16T07:35:24.713285+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:09.656640+0000","last_clean_scrub_stamp":"2024-03-16T07:35:09.656640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:09:47.571809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.1d","version":"167'2","reported_seq":24,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.709006+0000","last_change":"2024-03-16T07:35:09.673087+0000","last_active":"2024-03-16T07:35:24.709006+0000","last_peered":"2024-03-16T07:35:24.709006+0000","last_clean":"2024-03-16T07:35:24.709006+0000","last_became_active":"2024-03-16T07:35:09.672831+0000","last_became_peered":"2024-03-16T07:35:09.672831+0000","last_unstale":"2024-03-16T07:35:24.709006+0000","last_undegraded":"2024-03-16T07:35:24.709006+0000","last_fullsized":"2024-03-16T07:35:24.709006+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:35:08.655627+0000","last_clean_scrub_stamp":"2024-03-16T07:35:08.655627+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T11:55:55.803855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"152'218","reported_seq":867,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-03-16T07:35:24.705184+0000","last_change":"2024-03-16T07:24:31.650537+0000","last_active":"2024-03-16T07:35:24.705184+0000","last_peered":"2024-03-16T07:35:24.705184+0000","last_clean":"2024-03-16T07:35:24.705184+0000","last_became_active":"2024-03-16T07:24:31.649574+0000","last_became_peered":"2024-03-16T07:24:31.649574+0000","last_unstale":"2024-03-16T07:35:24.705184+0000","last_undegraded":"2024-03-16T07:35:24.705184+0000","last_fullsized":"2024-03-16T07:35:24.705184+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:29.719970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:29.719970+0000","last_clean_scrub_stamp":"2024-03-16T07:24:29.719970+0000","objects_scrubbed":0,"log_size":218,"log_dups_size":0,"ondisk_log_size":218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:31:35.774554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1162,"num_read_kb":2357,"num_write":357,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":31,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":30,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":29,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":28,"num_pg":32,"stat_sum":{"num_bytes":4107,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":8214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1162,"num_read_kb":2357,"num_write":357,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":218,"ondisk_log_size":218,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738496,"num_pgs":126,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":37120,"kb_used_data":1772,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":104820480,"statfs":{"total":107374182400,"available":107336171520,"internally_reserved":0,"allocated":1814528,"data_stored":737273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738496,"num_pgs":131,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":41876,"kb_used_data":2368,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":104815724,"statfs":{"total":107374182400,"available":107331301376,"internally_reserved":0,"allocated":2424832,"data_stored":1327184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738496,"num_pgs":129,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":41876,"kb_used_data":2368,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":104815724,"statfs":{"total":107374182400,"available":107331301376,"internally_reserved":0,"allocated":2424832,"data_stored":1330347,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3981,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":3435,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-16T07:35:28.252 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-03-16T07:35:28.252 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T07:35:28.644 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:35:28.644 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":122,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6690,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6827/875237476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":875237476},{"type":"v1","addr":"172.21.15.49:6827","nonce":875237476}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":113},{"gid":6691,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6829/417322500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":417322500},{"type":"v1","addr":"172.21.15.49:6829","nonce":417322500}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":113},{"gid":6696,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6831/4121914730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":4121914730},{"type":"v1","addr":"172.21.15.49:6831","nonce":4121914730}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":113}],"filesystems":[{"mdsmap":{"epoch":116,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-16T07:35:10.038977+0000","modified":"2024-03-16T07:35:12.029087+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6698},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6698":{"gid":6698,"name":"a","rank":0,"incarnation":114,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6835/1838330688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":1838330688},{"type":"v1","addr":"172.21.15.49:6835","nonce":1838330688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[29],"metadata_pool":28,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6698,"qdb_cluster":[6698]},"id":14},{"mdsmap":{"epoch":122,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-16T07:35:23.124362+0000","modified":"2024-03-16T07:35:26.073338+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6697},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6697":{"gid":6697,"name":"e","rank":0,"incarnation":118,"state":"up:active","state_seq":6,"addr":"172.21.15.49:6834/1716116460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":1716116460},{"type":"v1","addr":"172.21.15.49:6834","nonce":1716116460}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[31],"metadata_pool":30,"enabled":true,"fs_name":"backup_fs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6697,"qdb_cluster":[6697]},"id":15}]} 2024-03-16T07:35:28.644 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 122 2024-03-16T07:35:29.160 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 122, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-03-16T07:35:23.124362+0000', 'modified': '2024-03-16T07:35:26.073338+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6697}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6697': {'gid': 6697, 'name': 'e', 'rank': 0, 'incarnation': 118, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.49:6834/1716116460', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.49:6832', 'nonce': 1716116460}, {'type': 'v1', 'addr': '172.21.15.49:6834', 'nonce': 1716116460}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [31], 'metadata_pool': 30, 'enabled': True, 'fs_name': 'backup_fs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 6697, 'qdb_cluster': [6697]} 2024-03-16T07:35:29.160 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-03-16T07:35:29.160 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.e status 2024-03-16T07:35:29.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-16T07:35:29.287+0000 7f144d7fa640 0 client.6830 ms_handle_reset on v2:172.21.15.49:6832/1716116460 2024-03-16T07:35:29.309 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-16T07:35:29.310+0000 7f144d7fa640 0 client.6832 ms_handle_reset on v2:172.21.15.49:6832/1716116460 2024-03-16T07:35:29.309 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-03-16T07:35:29.310 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_fsid": "f91af061-9eac-4793-87fa-8d27ae3d242f", 2024-03-16T07:35:29.310 INFO:teuthology.orchestra.run.smithi049.stdout: "whoami": 0, 2024-03-16T07:35:29.310 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 6697, 2024-03-16T07:35:29.310 INFO:teuthology.orchestra.run.smithi049.stdout: "want_state": "up:active", 2024-03-16T07:35:29.310 INFO:teuthology.orchestra.run.smithi049.stdout: "state": "up:active", 2024-03-16T07:35:29.310 INFO:teuthology.orchestra.run.smithi049.stdout: "fs_name": "backup_fs", 2024-03-16T07:35:29.310 INFO:teuthology.orchestra.run.smithi049.stdout: "rank_uptime": 5.6062839369999997, 2024-03-16T07:35:29.310 INFO:teuthology.orchestra.run.smithi049.stdout: "mdsmap_epoch": 122, 2024-03-16T07:35:29.310 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch": 172, 2024-03-16T07:35:29.310 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch_barrier": 172, 2024-03-16T07:35:29.310 INFO:teuthology.orchestra.run.smithi049.stdout: "uptime": 23.966925587999999 2024-03-16T07:35:29.310 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-03-16T07:35:29.325 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable mirroring 2024-03-16T07:35:29.735 DEBUG:tasks.cephfs.test_mirroring:reconfigure client auth caps 2024-03-16T07:35:29.735 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds 'allow rw' mon 'allow r' osd 'allow rw pool=backup_fs_data, allow rw pool=backup_fs_data' 2024-03-16T07:35:30.160 INFO:teuthology.orchestra.run.smithi049.stdout:[client.1] 2024-03-16T07:35:30.160 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQAaSfVlCp2DHRAAdVsc+jh/QA74EBwffEqP5g== 2024-03-16T07:35:30.160 INFO:teuthology.orchestra.run.smithi049.stdout: caps mds = "allow rw" 2024-03-16T07:35:30.160 INFO:teuthology.orchestra.run.smithi049.stdout: caps mon = "allow r" 2024-03-16T07:35:30.160 INFO:teuthology.orchestra.run.smithi049.stdout: caps osd = "allow rw pool=backup_fs_data, allow rw pool=backup_fs_data" 2024-03-16T07:35:30.160 INFO:teuthology.orchestra.run.smithi049.stderr:updated caps for client.1 2024-03-16T07:35:30.179 DEBUG:tasks.cephfs.test_mirroring:mounting filesystem backup_fs 2024-03-16T07:35:30.179 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-03-16T07:35:30.179 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-16T07:35:30.194 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T07:35:30.212 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:35:30.212+0000 7efd59c3a040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-16T07:35:30.281 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:35:30.282+0000 7efd59c3a040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-16T07:35:30.630 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:35:30.630 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":172,"fsid":"f91af061-9eac-4793-87fa-8d27ae3d242f","created":"2024-03-16T07:24:20.357868+0000","modified":"2024-03-16T07:35:24.702383+0000","last_up_change":"2024-03-16T07:24:27.474980+0000","last_in_change":"2024-03-16T07:24:21.254179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":31,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T07:24:28.947521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":28,"pool_name":"cephfs_metadata","create_time":"2024-03-16T07:35:08.344405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"167","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.309999942779541,"score_stable":1.309999942779541,"optimal_score":1,"raw_score_acting":1.309999942779541,"raw_score_stable":1.309999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":29,"pool_name":"cephfs_data","create_time":"2024-03-16T07:35:09.019172+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"168","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1699999570846558,"score_stable":1.1699999570846558,"optimal_score":1,"raw_score_acting":1.1699999570846558,"raw_score_stable":1.1699999570846558,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":30,"pool_name":"backup_fs_metadata","create_time":"2024-03-16T07:35:21.682702+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"171","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"backup_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.309999942779541,"score_stable":1.309999942779541,"optimal_score":1,"raw_score_acting":1.309999942779541,"raw_score_stable":1.309999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":31,"pool_name":"backup_fs_data","create_time":"2024-03-16T07:35:22.052108+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"172","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"backup_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.0299999713897705,"score_stable":1.0299999713897705,"optimal_score":1,"raw_score_acting":1.0299999713897705,"raw_score_stable":1.0299999713897705,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2df14aac-98dc-4e3c-ae7e-9eb677aa30be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6801","nonce":2744935777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6803","nonce":2744935777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6807","nonce":2744935777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6805","nonce":2744935777}]},"public_addr":"172.21.15.49:6801/2744935777","cluster_addr":"172.21.15.49:6803/2744935777","heartbeat_back_addr":"172.21.15.49:6807/2744935777","heartbeat_front_addr":"172.21.15.49:6805/2744935777","state":["exists","up"]},{"osd":1,"uuid":"80461bd9-59ef-46df-9eea-bad92d960c57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6811","nonce":1655120118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6815","nonce":1655120118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6821","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6823","nonce":1655120118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6817","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6819","nonce":1655120118}]},"public_addr":"172.21.15.49:6811/1655120118","cluster_addr":"172.21.15.49:6815/1655120118","heartbeat_back_addr":"172.21.15.49:6823/1655120118","heartbeat_front_addr":"172.21.15.49:6819/1655120118","state":["exists","up"]},{"osd":2,"uuid":"d6bf40eb-6e42-4ec9-8b3d-0b6c5a6def79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6810","nonce":3815472376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6814","nonce":3815472376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6822","nonce":3815472376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6818","nonce":3815472376}]},"public_addr":"172.21.15.49:6810/3815472376","cluster_addr":"172.21.15.49:6814/3815472376","heartbeat_back_addr":"172.21.15.49:6822/3815472376","heartbeat_front_addr":"172.21.15.49:6818/3815472376","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.641492+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.668598+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.614940+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T07:35:30.644 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-16T07:24:28.947521+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 28, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-16T07:35:08.344405+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '167', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.309999942779541, 'score_stable': 1.309999942779541, 'optimal_score': 1, 'raw_score_acting': 1.309999942779541, 'raw_score_stable': 1.309999942779541, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 29, 'pool_name': 'cephfs_data', 'create_time': '2024-03-16T07:35:09.019172+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '168', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1699999570846558, 'score_stable': 1.1699999570846558, 'optimal_score': 1, 'raw_score_acting': 1.1699999570846558, 'raw_score_stable': 1.1699999570846558, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 30, 'pool_name': 'backup_fs_metadata', 'create_time': '2024-03-16T07:35:21.682702+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '171', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'backup_fs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.309999942779541, 'score_stable': 1.309999942779541, 'optimal_score': 1, 'raw_score_acting': 1.309999942779541, 'raw_score_stable': 1.309999942779541, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 31, 'pool_name': 'backup_fs_data', 'create_time': '2024-03-16T07:35:22.052108+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '172', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'backup_fs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.0299999713897705, 'score_stable': 1.0299999713897705, 'optimal_score': 1, 'raw_score_acting': 1.0299999713897705, 'raw_score_stable': 1.0299999713897705, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-16T07:35:30.644 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-16T07:35:30.811 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:35:30.812+0000 7efd59c3a040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-16T07:35:30.858 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:35:30.859+0000 7efd59c3a040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-16T07:35:30.904 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:35:30.905+0000 7efd59c3a040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-16T07:35:30.958 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2024-03-16T07:35:30.959 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:35:30.960+0000 7efd59c3a040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-16T07:35:30.972 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-16T07:35:31.008 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:35:31.008+0000 7efd59c3a040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-16T07:35:31.171 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:35:31.172+0000 7efd59c3a040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-16T07:35:31.228 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:35:31.228+0000 7efd59c3a040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-16T07:35:31.272 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:35:31.273+0000 7efd59c3a040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-16T07:35:31.296 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2024-03-16T07:35:31.314 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-16T07:35:31.331 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:35:31.332+0000 7efd59c3a040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-16T07:35:31.377 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:35:31.378+0000 7efd59c3a040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-16T07:35:31.731 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:35:31.732+0000 7efd59c3a040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-16T07:35:31.789 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2024-03-16T07:35:31.803 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get backup_fs_metadata pg_num 2024-03-16T07:35:31.939 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:35:31.939+0000 7efd59c3a040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-16T07:35:32.090 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:35:32.091+0000 7efd59c3a040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-16T07:35:32.141 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:35:32.141+0000 7efd59c3a040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-16T07:35:32.192 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2024-03-16T07:35:32.211 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get backup_fs_data pg_num 2024-03-16T07:35:32.260 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:35:32.260+0000 7efd59c3a040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-16T07:35:32.361 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:35:32.361+0000 7efd59c3a040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-16T07:35:32.522 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:35:32.523+0000 7efd59c3a040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-16T07:35:32.549 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2024-03-16T07:35:32.564 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-16T07:35:32.568 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:35:32.569+0000 7efd59c3a040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-16T07:35:32.728 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:35:32.729+0000 7efd59c3a040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-16T07:35:33.128 INFO:teuthology.orchestra.run.smithi049.stderr:listed 0 entries 2024-03-16T07:35:33.142 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-03-16T07:35:33.142 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-16T07:35:33.201 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T07:35:33.560 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:35:33.561+0000 7efd59c3a040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-16T07:35:33.587 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:35:33.587 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":172,"fsid":"f91af061-9eac-4793-87fa-8d27ae3d242f","created":"2024-03-16T07:24:20.357868+0000","modified":"2024-03-16T07:35:24.702383+0000","last_up_change":"2024-03-16T07:24:27.474980+0000","last_in_change":"2024-03-16T07:24:21.254179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":31,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T07:24:28.947521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":28,"pool_name":"cephfs_metadata","create_time":"2024-03-16T07:35:08.344405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"167","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.309999942779541,"score_stable":1.309999942779541,"optimal_score":1,"raw_score_acting":1.309999942779541,"raw_score_stable":1.309999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":29,"pool_name":"cephfs_data","create_time":"2024-03-16T07:35:09.019172+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"168","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1699999570846558,"score_stable":1.1699999570846558,"optimal_score":1,"raw_score_acting":1.1699999570846558,"raw_score_stable":1.1699999570846558,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":30,"pool_name":"backup_fs_metadata","create_time":"2024-03-16T07:35:21.682702+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"171","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"backup_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.309999942779541,"score_stable":1.309999942779541,"optimal_score":1,"raw_score_acting":1.309999942779541,"raw_score_stable":1.309999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":31,"pool_name":"backup_fs_data","create_time":"2024-03-16T07:35:22.052108+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"172","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"backup_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.0299999713897705,"score_stable":1.0299999713897705,"optimal_score":1,"raw_score_acting":1.0299999713897705,"raw_score_stable":1.0299999713897705,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2df14aac-98dc-4e3c-ae7e-9eb677aa30be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6801","nonce":2744935777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6803","nonce":2744935777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6807","nonce":2744935777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6805","nonce":2744935777}]},"public_addr":"172.21.15.49:6801/2744935777","cluster_addr":"172.21.15.49:6803/2744935777","heartbeat_back_addr":"172.21.15.49:6807/2744935777","heartbeat_front_addr":"172.21.15.49:6805/2744935777","state":["exists","up"]},{"osd":1,"uuid":"80461bd9-59ef-46df-9eea-bad92d960c57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6811","nonce":1655120118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6815","nonce":1655120118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6821","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6823","nonce":1655120118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6817","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6819","nonce":1655120118}]},"public_addr":"172.21.15.49:6811/1655120118","cluster_addr":"172.21.15.49:6815/1655120118","heartbeat_back_addr":"172.21.15.49:6823/1655120118","heartbeat_front_addr":"172.21.15.49:6819/1655120118","state":["exists","up"]},{"osd":2,"uuid":"d6bf40eb-6e42-4ec9-8b3d-0b6c5a6def79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6810","nonce":3815472376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6814","nonce":3815472376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6822","nonce":3815472376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6818","nonce":3815472376}]},"public_addr":"172.21.15.49:6810/3815472376","cluster_addr":"172.21.15.49:6814/3815472376","heartbeat_back_addr":"172.21.15.49:6822/3815472376","heartbeat_front_addr":"172.21.15.49:6818/3815472376","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.641492+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.668598+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.614940+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T07:35:33.600 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-16T07:24:28.947521+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 28, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-16T07:35:08.344405+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '167', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.309999942779541, 'score_stable': 1.309999942779541, 'optimal_score': 1, 'raw_score_acting': 1.309999942779541, 'raw_score_stable': 1.309999942779541, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 29, 'pool_name': 'cephfs_data', 'create_time': '2024-03-16T07:35:09.019172+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '168', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1699999570846558, 'score_stable': 1.1699999570846558, 'optimal_score': 1, 'raw_score_acting': 1.1699999570846558, 'raw_score_stable': 1.1699999570846558, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 30, 'pool_name': 'backup_fs_metadata', 'create_time': '2024-03-16T07:35:21.682702+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '171', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'backup_fs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.309999942779541, 'score_stable': 1.309999942779541, 'optimal_score': 1, 'raw_score_acting': 1.309999942779541, 'raw_score_stable': 1.309999942779541, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 31, 'pool_name': 'backup_fs_data', 'create_time': '2024-03-16T07:35:22.052108+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '172', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'backup_fs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.0299999713897705, 'score_stable': 1.0299999713897705, 'optimal_score': 1, 'raw_score_acting': 1.0299999713897705, 'raw_score_stable': 1.0299999713897705, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-16T07:35:33.600 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-16T07:35:33.906 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:35:33.906+0000 7efd59c3a040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-16T07:35:33.913 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2024-03-16T07:35:33.928 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-16T07:35:33.963 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:35:33.964+0000 7efd59c3a040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-16T07:35:34.173 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:35:34.173+0000 7efd59c3a040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-16T07:35:34.266 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:35:34.266+0000 7efcd5fbf640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:35:34.266 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:35:34.266+0000 7efcd5fbf640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:35:34.266 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:35:34.266+0000 7efcd5fbf640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:35:34.266 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:35:34.266+0000 7efcd5fbf640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:35:34.266 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:35:34.266+0000 7efcd5fbf640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:35:34.266 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:35:34.266+0000 7efcd97c6640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:35:34.266 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:35:34.266+0000 7efcd97c6640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:35:34.266 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:35:34.266+0000 7efcd97c6640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:35:34.267 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:35:34.266+0000 7efcd97c6640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:35:34.267 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:35:34.266+0000 7efcd97c6640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:35:34.280 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:35:34.281+0000 7efcd5fbf640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:35:34.281 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:35:34.281+0000 7efcd5fbf640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:35:34.281 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:35:34.281+0000 7efcd5fbf640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:35:34.281 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:35:34.281+0000 7efcd5fbf640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:35:34.281 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:35:34.281+0000 7efcd5fbf640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:35:34.282 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:35:34.282+0000 7efcd97c6640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:35:34.282 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:35:34.282+0000 7efcd97c6640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:35:34.282 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:35:34.282+0000 7efcd97c6640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:35:34.282 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:35:34.282+0000 7efcd97c6640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:35:34.282 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:35:34.282+0000 7efcd97c6640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:35:34.295 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2024-03-16T07:35:34.314 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-16T07:35:34.695 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2024-03-16T07:35:34.713 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get backup_fs_metadata pg_num 2024-03-16T07:35:35.031 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2024-03-16T07:35:35.043 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get backup_fs_data pg_num 2024-03-16T07:35:35.505 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2024-03-16T07:35:35.518 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-16T07:35:35.966 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:6825/3151425488 2024-03-17T07:35:34.187396+0000 2024-03-16T07:35:35.967 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:6824/3151425488 2024-03-17T07:35:34.187396+0000 2024-03-16T07:35:35.967 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/549066423 2024-03-17T07:35:34.187396+0000 2024-03-16T07:35:35.967 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/3515296168 2024-03-17T07:35:34.187396+0000 2024-03-16T07:35:35.967 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/2374823119 2024-03-17T07:35:34.187396+0000 2024-03-16T07:35:35.967 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/467150732 2024-03-17T07:35:34.187396+0000 2024-03-16T07:35:35.967 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/2082959977 2024-03-17T07:35:34.187396+0000 2024-03-16T07:35:35.967 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/3804079701 2024-03-17T07:35:34.187396+0000 2024-03-16T07:35:35.967 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/1510403812 2024-03-17T07:35:34.187396+0000 2024-03-16T07:35:35.967 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/2539031077 2024-03-17T07:35:34.187396+0000 2024-03-16T07:35:35.967 INFO:teuthology.orchestra.run.smithi049.stderr:listed 10 entries 2024-03-16T07:35:35.985 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi049.front.sepia.ceph.com... 2024-03-16T07:35:35.985 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:35:35.985 DEBUG:teuthology.orchestra.run.smithi049:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2024-03-16T07:35:36.014 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi049.stderr:ceph-fuse[82662]: fuse finished with error 0 and tester_r 0 2024-03-16T07:35:36.016 INFO:teuthology.orchestra.run:waiting for 300 2024-03-16T07:35:39.307 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T07:35:42.117 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi049.front.sepia.ceph.com 2024-03-16T07:35:42.118 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:35:42.118 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-03-16T07:35:42.134 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-03-16T07:35:42.766 INFO:teuthology.orchestra.run.smithi049.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-03-16T07:35:42.767 INFO:teuthology.orchestra.run.smithi049.stdout:name: backup_fs, metadata pool: backup_fs_metadata, data pools: [backup_fs_data ] 2024-03-16T07:35:42.781 INFO:tasks.cephfs.mount:Mounting Ceph FS backup_fs; just confirmed its presence on cluster 2024-03-16T07:35:42.781 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-03-16T07:35:42.781 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi049.front.sepia.ceph.com 2024-03-16T07:35:42.781 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-03-16T07:35:42.781 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-03-16T07:35:42.781 INFO:tasks.cephfs.mount:self.cephfs_name = backup_fs 2024-03-16T07:35:42.781 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-03-16T07:35:42.781 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-03-16T07:35:42.781 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-03-16T07:35:42.782 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:35:42.782 DEBUG:teuthology.orchestra.run.smithi049:> ip addr 2024-03-16T07:35:42.797 INFO:teuthology.orchestra.run.smithi049.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-16T07:35:42.797 INFO:teuthology.orchestra.run.smithi049.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-16T07:35:42.797 INFO:teuthology.orchestra.run.smithi049.stdout: inet 127.0.0.1/8 scope host lo 2024-03-16T07:35:42.797 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-03-16T07:35:42.798 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 ::1/128 scope host 2024-03-16T07:35:42.798 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-03-16T07:35:42.798 INFO:teuthology.orchestra.run.smithi049.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-16T07:35:42.798 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:6b:ff:84 brd ff:ff:ff:ff:ff:ff 2024-03-16T07:35:42.798 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp7s0f0 2024-03-16T07:35:42.798 INFO:teuthology.orchestra.run.smithi049.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-16T07:35:42.798 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:6b:ff:85 brd ff:ff:ff:ff:ff:ff 2024-03-16T07:35:42.798 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp7s0f1 2024-03-16T07:35:42.798 INFO:teuthology.orchestra.run.smithi049.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-03-16T07:35:42.798 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:bd:15:66 brd ff:ff:ff:ff:ff:ff 2024-03-16T07:35:42.798 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp1s0f0 2024-03-16T07:35:42.798 INFO:teuthology.orchestra.run.smithi049.stdout: inet 172.21.15.49/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-03-16T07:35:42.798 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft 41765sec preferred_lft 41765sec 2024-03-16T07:35:42.798 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::ec4:7aff:febd:1566/64 scope link noprefixroute 2024-03-16T07:35:42.798 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-03-16T07:35:42.799 INFO:teuthology.orchestra.run.smithi049.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-16T07:35:42.799 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:bd:15:67 brd ff:ff:ff:ff:ff:ff 2024-03-16T07:35:42.799 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp1s0f1 2024-03-16T07:35:42.799 INFO:teuthology.orchestra.run.smithi049.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-03-16T07:35:42.799 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether a2:f1:88:c1:22:e7 brd ff:ff:ff:ff:ff:ff 2024-03-16T07:35:42.799 INFO:teuthology.orchestra.run.smithi049.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-03-16T07:35:42.799 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-03-16T07:35:42.799 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::e0e6:55ff:fe4d:1d68/64 scope link 2024-03-16T07:35:42.799 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-03-16T07:35:42.799 INFO:teuthology.orchestra.run.smithi049.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-03-16T07:35:42.799 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether ee:10:71:d7:68:c4 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-16T07:35:42.799 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::ec10:71ff:fed7:68c4/64 scope link 2024-03-16T07:35:42.799 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-03-16T07:35:42.799 INFO:teuthology.orchestra.run.smithi049.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-03-16T07:35:42.800 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether a2:f1:88:c1:22:e7 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-16T07:35:42.800 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::a0f1:88ff:fec1:22e7/64 scope link 2024-03-16T07:35:42.800 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-03-16T07:35:42.800 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:35:42.800 DEBUG:teuthology.orchestra.run.smithi049:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-03-16T07:35:42.867 INFO:teuthology.orchestra.run.smithi049.stdout:1 2024-03-16T07:35:42.868 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:35:42.869 DEBUG:teuthology.orchestra.run.smithi049:> route 2024-03-16T07:35:42.925 INFO:teuthology.orchestra.run.smithi049.stdout:Kernel IP routing table 2024-03-16T07:35:42.925 INFO:teuthology.orchestra.run.smithi049.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-03-16T07:35:42.925 INFO:teuthology.orchestra.run.smithi049.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-03-16T07:35:42.925 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-03-16T07:35:42.926 INFO:teuthology.orchestra.run.smithi049.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-03-16T07:35:42.926 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-16T07:35:42.926 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-03-16T07:35:42.926 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-03-16T07:35:42.926 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-03-16T07:35:42.926 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-03-16T07:35:42.926 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-03-16T07:35:43.016 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-16T07:35:43 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-16T07:35:43.068 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-16T07:35:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-16T07:35:43.074 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:35:43.074 DEBUG:teuthology.orchestra.run.smithi049:> ip netns list 2024-03-16T07:35:43.091 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 1) 2024-03-16T07:35:43.091 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-03-16T07:35:43.091 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-03-16T07:35:43.091 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:35:43.091 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link set brx.1 up 2024-03-16T07:35:43.161 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-03-16T07:35:43.161 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-16T07:35:43.162 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-03-16T07:35:43.217 INFO:teuthology.orchestra.run.smithi049.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-03-16T07:35:43.217 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-16T07:35:43.217 DEBUG:teuthology.orchestra.run.smithi049:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-03-16T07:35:43.271 DEBUG:teuthology.orchestra.run.smithi049:> sudo modprobe fuse 2024-03-16T07:35:43.342 DEBUG:teuthology.orchestra.run.smithi049:> cat /proc/self/mounts | awk '{print $2}' 2024-03-16T07:35:43.399 INFO:teuthology.orchestra.run.smithi049.stdout:/proc 2024-03-16T07:35:43.399 INFO:teuthology.orchestra.run.smithi049.stdout:/sys 2024-03-16T07:35:43.399 INFO:teuthology.orchestra.run.smithi049.stdout:/dev 2024-03-16T07:35:43.400 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/security 2024-03-16T07:35:43.400 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/shm 2024-03-16T07:35:43.400 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/pts 2024-03-16T07:35:43.400 INFO:teuthology.orchestra.run.smithi049.stdout:/run 2024-03-16T07:35:43.400 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/cgroup 2024-03-16T07:35:43.400 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/pstore 2024-03-16T07:35:43.400 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/bpf 2024-03-16T07:35:43.400 INFO:teuthology.orchestra.run.smithi049.stdout:/ 2024-03-16T07:35:43.400 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/selinux 2024-03-16T07:35:43.400 INFO:teuthology.orchestra.run.smithi049.stdout:/proc/sys/fs/binfmt_misc 2024-03-16T07:35:43.400 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/mqueue 2024-03-16T07:35:43.400 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/hugepages 2024-03-16T07:35:43.400 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/debug 2024-03-16T07:35:43.400 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/tracing 2024-03-16T07:35:43.401 INFO:teuthology.orchestra.run.smithi049.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-03-16T07:35:43.401 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/fuse/connections 2024-03-16T07:35:43.401 INFO:teuthology.orchestra.run.smithi049.stdout:/run/credentials/systemd-sysctl.service 2024-03-16T07:35:43.401 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/config 2024-03-16T07:35:43.401 INFO:teuthology.orchestra.run.smithi049.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-03-16T07:35:43.401 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/nfs/rpc_pipefs 2024-03-16T07:35:43.401 INFO:teuthology.orchestra.run.smithi049.stdout:/run/user/1000 2024-03-16T07:35:43.401 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph 2024-03-16T07:35:43.401 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-0 2024-03-16T07:35:43.401 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-1 2024-03-16T07:35:43.401 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-2 2024-03-16T07:35:43.401 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns 2024-03-16T07:35:43.401 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-16T07:35:43.401 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-16T07:35:43.401 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-16T07:35:43.401 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-16T07:35:43.402 INFO:teuthology.orchestra.run.smithi049.stdout:/home/ubuntu/cephtest/mnt.0 2024-03-16T07:35:43.402 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:35:43.402 DEBUG:teuthology.orchestra.run.smithi049:> ls /sys/fs/fuse/connections 2024-03-16T07:35:43.454 INFO:teuthology.orchestra.run.smithi049.stdout:41 2024-03-16T07:35:43.455 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [41] 2024-03-16T07:35:43.455 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1 --client_fs=backup_fs) 2024-03-16T07:35:43.497 DEBUG:teuthology.orchestra.run.smithi049:> sudo modprobe fuse 2024-03-16T07:35:43.528 DEBUG:teuthology.orchestra.run.smithi049:> cat /proc/self/mounts | awk '{print $2}' 2024-03-16T07:35:43.586 INFO:teuthology.orchestra.run.smithi049.stdout:/proc 2024-03-16T07:35:43.586 INFO:teuthology.orchestra.run.smithi049.stdout:/sys 2024-03-16T07:35:43.586 INFO:teuthology.orchestra.run.smithi049.stdout:/dev 2024-03-16T07:35:43.586 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/security 2024-03-16T07:35:43.586 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/shm 2024-03-16T07:35:43.586 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/pts 2024-03-16T07:35:43.586 INFO:teuthology.orchestra.run.smithi049.stdout:/run 2024-03-16T07:35:43.586 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/cgroup 2024-03-16T07:35:43.586 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/pstore 2024-03-16T07:35:43.586 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/bpf 2024-03-16T07:35:43.586 INFO:teuthology.orchestra.run.smithi049.stdout:/ 2024-03-16T07:35:43.586 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/selinux 2024-03-16T07:35:43.586 INFO:teuthology.orchestra.run.smithi049.stdout:/proc/sys/fs/binfmt_misc 2024-03-16T07:35:43.586 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/mqueue 2024-03-16T07:35:43.587 INFO:teuthology.orchestra.run.smithi049.stdout:/dev/hugepages 2024-03-16T07:35:43.587 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/debug 2024-03-16T07:35:43.587 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/tracing 2024-03-16T07:35:43.587 INFO:teuthology.orchestra.run.smithi049.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-03-16T07:35:43.587 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/fs/fuse/connections 2024-03-16T07:35:43.587 INFO:teuthology.orchestra.run.smithi049.stdout:/run/credentials/systemd-sysctl.service 2024-03-16T07:35:43.587 INFO:teuthology.orchestra.run.smithi049.stdout:/sys/kernel/config 2024-03-16T07:35:43.587 INFO:teuthology.orchestra.run.smithi049.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-03-16T07:35:43.587 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/nfs/rpc_pipefs 2024-03-16T07:35:43.587 INFO:teuthology.orchestra.run.smithi049.stdout:/run/user/1000 2024-03-16T07:35:43.587 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph 2024-03-16T07:35:43.587 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-0 2024-03-16T07:35:43.587 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-1 2024-03-16T07:35:43.587 INFO:teuthology.orchestra.run.smithi049.stdout:/var/lib/ceph/osd/ceph-2 2024-03-16T07:35:43.587 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns 2024-03-16T07:35:43.587 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-16T07:35:43.587 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-16T07:35:43.588 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-16T07:35:43.588 INFO:teuthology.orchestra.run.smithi049.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-16T07:35:43.588 INFO:teuthology.orchestra.run.smithi049.stdout:/home/ubuntu/cephtest/mnt.0 2024-03-16T07:35:43.588 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:35:43.588 DEBUG:teuthology.orchestra.run.smithi049:> ls /sys/fs/fuse/connections 2024-03-16T07:35:43.605 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi049.stderr:2024-03-16T07:35:43.606+0000 7fcf8ae3c480 -1 init, newargv = 0x564aa39280e0 newargc=15 2024-03-16T07:35:43.605 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi049.stderr:ceph-fuse[84869]: starting ceph client 2024-03-16T07:35:43.610 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi049.stderr:ceph-fuse[84869]: starting fuse 2024-03-16T07:35:43.621 INFO:teuthology.orchestra.run.smithi049.stdout:41 2024-03-16T07:35:43.621 INFO:teuthology.orchestra.run.smithi049.stdout:44 2024-03-16T07:35:43.621 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41, 44] 2024-03-16T07:35:43.622 DEBUG:teuthology.orchestra.run.smithi049:> sudo stdin-killer -- python3 -c ' 2024-03-16T07:35:43.622 DEBUG:teuthology.orchestra.run.smithi049:> import glob 2024-03-16T07:35:43.622 DEBUG:teuthology.orchestra.run.smithi049:> import re 2024-03-16T07:35:43.622 DEBUG:teuthology.orchestra.run.smithi049:> import os 2024-03-16T07:35:43.622 DEBUG:teuthology.orchestra.run.smithi049:> import subprocess 2024-03-16T07:35:43.622 DEBUG:teuthology.orchestra.run.smithi049:> 2024-03-16T07:35:43.622 DEBUG:teuthology.orchestra.run.smithi049:> def _find_admin_socket(client_name): 2024-03-16T07:35:43.622 DEBUG:teuthology.orchestra.run.smithi049:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-03-16T07:35:43.622 DEBUG:teuthology.orchestra.run.smithi049:> files = glob.glob(asok_path) 2024-03-16T07:35:43.622 DEBUG:teuthology.orchestra.run.smithi049:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-03-16T07:35:43.622 DEBUG:teuthology.orchestra.run.smithi049:> 2024-03-16T07:35:43.622 DEBUG:teuthology.orchestra.run.smithi049:> # Given a non-glob path, it better be there 2024-03-16T07:35:43.622 DEBUG:teuthology.orchestra.run.smithi049:> if "*" not in asok_path: 2024-03-16T07:35:43.623 DEBUG:teuthology.orchestra.run.smithi049:> assert(len(files) == 1) 2024-03-16T07:35:43.623 DEBUG:teuthology.orchestra.run.smithi049:> return files[0] 2024-03-16T07:35:43.623 DEBUG:teuthology.orchestra.run.smithi049:> 2024-03-16T07:35:43.623 DEBUG:teuthology.orchestra.run.smithi049:> for f in files: 2024-03-16T07:35:43.623 DEBUG:teuthology.orchestra.run.smithi049:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-03-16T07:35:43.623 DEBUG:teuthology.orchestra.run.smithi049:> if os.path.exists("/proc/{0}".format(pid)): 2024-03-16T07:35:43.623 DEBUG:teuthology.orchestra.run.smithi049:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-03-16T07:35:43.623 DEBUG:teuthology.orchestra.run.smithi049:> contents = proc_f.read() 2024-03-16T07:35:43.623 DEBUG:teuthology.orchestra.run.smithi049:> if mountpoint in contents: 2024-03-16T07:35:43.623 DEBUG:teuthology.orchestra.run.smithi049:> return f 2024-03-16T07:35:43.623 DEBUG:teuthology.orchestra.run.smithi049:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-03-16T07:35:43.623 DEBUG:teuthology.orchestra.run.smithi049:> 2024-03-16T07:35:43.623 DEBUG:teuthology.orchestra.run.smithi049:> print(_find_admin_socket("client.1")) 2024-03-16T07:35:43.623 DEBUG:teuthology.orchestra.run.smithi049:> ' 2024-03-16T07:35:43.748 INFO:teuthology.orchestra.run.smithi049.stdout:/var/run/ceph/ceph-client.1.84869.asok 2024-03-16T07:35:43.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-16T07:35:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-16T07:35:43.759 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.84869.asok 2024-03-16T07:35:43.759 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:35:43.759 DEBUG:teuthology.orchestra.run.smithi049:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.84869.asok status 2024-03-16T07:35:43.902 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-03-16T07:35:43.903 INFO:teuthology.orchestra.run.smithi049.stdout: "metadata": { 2024-03-16T07:35:43.903 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph_sha1": "3d78f5ba07bf18880172c07d4d7b4ac00c9d30af", 2024-03-16T07:35:43.903 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph_version": "ceph version 19.0.0-2162-g3d78f5ba (3d78f5ba07bf18880172c07d4d7b4ac00c9d30af) squid (dev)", 2024-03-16T07:35:43.903 INFO:teuthology.orchestra.run.smithi049.stdout: "entity_id": "1", 2024-03-16T07:35:43.903 INFO:teuthology.orchestra.run.smithi049.stdout: "hostname": "smithi049", 2024-03-16T07:35:43.903 INFO:teuthology.orchestra.run.smithi049.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-03-16T07:35:43.904 INFO:teuthology.orchestra.run.smithi049.stdout: "pid": "84869", 2024-03-16T07:35:43.904 INFO:teuthology.orchestra.run.smithi049.stdout: "root": "/" 2024-03-16T07:35:43.904 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:35:43.904 INFO:teuthology.orchestra.run.smithi049.stdout: "dentry_count": 0, 2024-03-16T07:35:43.904 INFO:teuthology.orchestra.run.smithi049.stdout: "dentry_pinned_count": 0, 2024-03-16T07:35:43.904 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 6906, 2024-03-16T07:35:43.904 INFO:teuthology.orchestra.run.smithi049.stdout: "inst": { 2024-03-16T07:35:43.904 INFO:teuthology.orchestra.run.smithi049.stdout: "name": { 2024-03-16T07:35:43.904 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "client", 2024-03-16T07:35:43.905 INFO:teuthology.orchestra.run.smithi049.stdout: "num": 6906 2024-03-16T07:35:43.905 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:35:43.905 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": { 2024-03-16T07:35:43.905 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2024-03-16T07:35:43.905 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "192.168.0.2:0", 2024-03-16T07:35:43.905 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 2657990565 2024-03-16T07:35:43.905 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:35:43.905 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:35:43.905 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": { 2024-03-16T07:35:43.906 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2024-03-16T07:35:43.906 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "192.168.0.2:0", 2024-03-16T07:35:43.906 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 2657990565 2024-03-16T07:35:43.906 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:35:43.906 INFO:teuthology.orchestra.run.smithi049.stdout: "inst_str": "client.6906 192.168.0.2:0/2657990565", 2024-03-16T07:35:43.906 INFO:teuthology.orchestra.run.smithi049.stdout: "addr_str": "192.168.0.2:0/2657990565", 2024-03-16T07:35:43.906 INFO:teuthology.orchestra.run.smithi049.stdout: "inode_count": 1, 2024-03-16T07:35:43.906 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_epoch": 122, 2024-03-16T07:35:43.907 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_epoch": 173, 2024-03-16T07:35:43.907 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_epoch_barrier": 0, 2024-03-16T07:35:43.907 INFO:teuthology.orchestra.run.smithi049.stdout: "blocklisted": false, 2024-03-16T07:35:43.907 INFO:teuthology.orchestra.run.smithi049.stdout: "fs_name": "backup_fs" 2024-03-16T07:35:43.907 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-03-16T07:35:43.911 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:35:43.911 DEBUG:teuthology.orchestra.run.smithi049:> stat --file-system '--printf=%T 2024-03-16T07:35:43.911 DEBUG:teuthology.orchestra.run.smithi049:> ' -- /home/ubuntu/cephtest/mnt.1 2024-03-16T07:35:43.926 INFO:teuthology.orchestra.run.smithi049.stdout:fuseblk 2024-03-16T07:35:43.926 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-03-16T07:35:43.927 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:35:43.927 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-03-16T07:35:43.999 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:35:43.999 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir d0) 2024-03-16T07:35:44.056 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:35:44.057 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir d1) 2024-03-16T07:35:44.113 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:35:44.113 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir d2) 2024-03-16T07:35:44.172 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-03-16T07:35:44.173 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-16T07:35:44.229 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:35:44.229 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=d0/file.0 bs=1M conv=fdatasync count=1024 seek=0) 2024-03-16T07:35:48.503 INFO:teuthology.orchestra.run.smithi049.stderr:1024+0 records in 2024-03-16T07:35:48.504 INFO:teuthology.orchestra.run.smithi049.stderr:1024+0 records out 2024-03-16T07:35:48.504 INFO:teuthology.orchestra.run.smithi049.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 4.21562 s, 255 MB/s 2024-03-16T07:35:48.504 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-03-16T07:35:48.504 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-16T07:35:48.519 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:35:48.519 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=d1/file.0 bs=1M conv=fdatasync count=1024 seek=0) 2024-03-16T07:35:52.691 INFO:teuthology.orchestra.run.smithi049.stderr:1024+0 records in 2024-03-16T07:35:52.691 INFO:teuthology.orchestra.run.smithi049.stderr:1024+0 records out 2024-03-16T07:35:52.691 INFO:teuthology.orchestra.run.smithi049.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 4.11616 s, 261 MB/s 2024-03-16T07:35:52.692 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-03-16T07:35:52.692 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-16T07:35:52.707 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:35:52.708 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=d2/file.0 bs=1M conv=fdatasync count=1024 seek=0) 2024-03-16T07:35:56.800 INFO:teuthology.orchestra.run.smithi049.stderr:1024+0 records in 2024-03-16T07:35:56.800 INFO:teuthology.orchestra.run.smithi049.stderr:1024+0 records out 2024-03-16T07:35:56.800 INFO:teuthology.orchestra.run.smithi049.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 4.03565 s, 266 MB/s 2024-03-16T07:35:56.801 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-03-16T07:35:56.801 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-16T07:35:56.816 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:35:56.817 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=d0/file.1 bs=1M conv=fdatasync count=1024 seek=0) 2024-03-16T07:36:01.074 INFO:teuthology.orchestra.run.smithi049.stderr:1024+0 records in 2024-03-16T07:36:01.075 INFO:teuthology.orchestra.run.smithi049.stderr:1024+0 records out 2024-03-16T07:36:01.075 INFO:teuthology.orchestra.run.smithi049.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 4.20049 s, 256 MB/s 2024-03-16T07:36:01.075 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-03-16T07:36:01.075 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-16T07:36:01.090 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:36:01.090 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=d1/file.1 bs=1M conv=fdatasync count=1024 seek=0) 2024-03-16T07:36:05.134 INFO:teuthology.orchestra.run.smithi049.stderr:1024+0 records in 2024-03-16T07:36:05.134 INFO:teuthology.orchestra.run.smithi049.stderr:1024+0 records out 2024-03-16T07:36:05.134 INFO:teuthology.orchestra.run.smithi049.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 3.98712 s, 269 MB/s 2024-03-16T07:36:05.134 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-03-16T07:36:05.134 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-16T07:36:05.150 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:36:05.150 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=d2/file.1 bs=1M conv=fdatasync count=1024 seek=0) 2024-03-16T07:36:09.361 INFO:teuthology.orchestra.run.smithi049.stderr:1024+0 records in 2024-03-16T07:36:09.361 INFO:teuthology.orchestra.run.smithi049.stderr:1024+0 records out 2024-03-16T07:36:09.361 INFO:teuthology.orchestra.run.smithi049.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 4.15426 s, 258 MB/s 2024-03-16T07:36:09.361 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-03-16T07:36:09.362 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-16T07:36:09.377 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:36:09.377 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=d0/file.2 bs=1M conv=fdatasync count=1024 seek=0) 2024-03-16T07:36:09.377 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T07:36:13.539 INFO:teuthology.orchestra.run.smithi049.stderr:1024+0 records in 2024-03-16T07:36:13.539 INFO:teuthology.orchestra.run.smithi049.stderr:1024+0 records out 2024-03-16T07:36:13.539 INFO:teuthology.orchestra.run.smithi049.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 4.10598 s, 262 MB/s 2024-03-16T07:36:13.540 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-03-16T07:36:13.540 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-16T07:36:13.555 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:36:13.555 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=d1/file.2 bs=1M conv=fdatasync count=1024 seek=0) 2024-03-16T07:36:17.689 INFO:teuthology.orchestra.run.smithi049.stderr:1024+0 records in 2024-03-16T07:36:17.689 INFO:teuthology.orchestra.run.smithi049.stderr:1024+0 records out 2024-03-16T07:36:17.690 INFO:teuthology.orchestra.run.smithi049.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 4.07738 s, 263 MB/s 2024-03-16T07:36:17.690 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-03-16T07:36:17.690 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-16T07:36:17.705 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:36:17.705 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=d2/file.2 bs=1M conv=fdatasync count=1024 seek=0) 2024-03-16T07:36:21.803 INFO:teuthology.orchestra.run.smithi049.stderr:1024+0 records in 2024-03-16T07:36:21.803 INFO:teuthology.orchestra.run.smithi049.stderr:1024+0 records out 2024-03-16T07:36:21.803 INFO:teuthology.orchestra.run.smithi049.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 4.03904 s, 266 MB/s 2024-03-16T07:36:21.803 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-03-16T07:36:21.804 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-16T07:36:21.819 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:36:21.819 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=d0/file.3 bs=1M conv=fdatasync count=1024 seek=0) 2024-03-16T07:36:26.042 INFO:teuthology.orchestra.run.smithi049.stderr:1024+0 records in 2024-03-16T07:36:26.043 INFO:teuthology.orchestra.run.smithi049.stderr:1024+0 records out 2024-03-16T07:36:26.043 INFO:teuthology.orchestra.run.smithi049.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 4.16582 s, 258 MB/s 2024-03-16T07:36:26.043 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-03-16T07:36:26.043 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-16T07:36:26.059 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:36:26.060 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=d1/file.3 bs=1M conv=fdatasync count=1024 seek=0) 2024-03-16T07:36:30.138 INFO:teuthology.orchestra.run.smithi049.stderr:1024+0 records in 2024-03-16T07:36:30.139 INFO:teuthology.orchestra.run.smithi049.stderr:1024+0 records out 2024-03-16T07:36:30.139 INFO:teuthology.orchestra.run.smithi049.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 4.02191 s, 267 MB/s 2024-03-16T07:36:30.139 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-03-16T07:36:30.139 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-16T07:36:30.155 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:36:30.155 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=d2/file.3 bs=1M conv=fdatasync count=1024 seek=0) 2024-03-16T07:36:34.251 INFO:teuthology.orchestra.run.smithi049.stderr:1024+0 records in 2024-03-16T07:36:34.251 INFO:teuthology.orchestra.run.smithi049.stderr:1024+0 records out 2024-03-16T07:36:34.251 INFO:teuthology.orchestra.run.smithi049.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 4.03918 s, 266 MB/s 2024-03-16T07:36:34.251 DEBUG:tasks.cephfs.test_mirroring:enabling mirroring 2024-03-16T07:36:34.252 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-03-16T07:36:34.252 DEBUG:teuthology.orchestra.run.smithi049:counter dump for fs: cephfs> ceph --admin-daemon /var/run/ceph/cephfs-mirror.asok counter dump 2024-03-16T07:36:34.392 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-03-16T07:36:34.392 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker": [ 2024-03-16T07:36:34.392 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:36:34.392 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:36:34.393 INFO:teuthology.orchestra.run.smithi049.stdout: "id": "0" 2024-03-16T07:36:34.393 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:36:34.393 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:36:34.393 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_ready_timeouts": 0, 2024-03-16T07:36:34.393 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_idle_timeouts": 0 2024-03-16T07:36:34.393 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:36:34.393 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:36:34.393 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:36:34.393 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:36:34.393 INFO:teuthology.orchestra.run.smithi049.stdout: "id": "1" 2024-03-16T07:36:34.393 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:36:34.393 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:36:34.393 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_ready_timeouts": 0, 2024-03-16T07:36:34.393 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_idle_timeouts": 0 2024-03-16T07:36:34.393 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:36:34.394 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:36:34.394 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:36:34.394 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:36:34.394 INFO:teuthology.orchestra.run.smithi049.stdout: "id": "2" 2024-03-16T07:36:34.394 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:36:34.394 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:36:34.394 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_ready_timeouts": 0, 2024-03-16T07:36:34.394 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_idle_timeouts": 0 2024-03-16T07:36:34.394 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:36:34.394 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:36:34.394 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:36:34.394 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-0": [ 2024-03-16T07:36:34.394 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:36:34.394 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:36:34.394 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:36:34.395 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 13, 2024-03-16T07:36:34.395 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 145, 2024-03-16T07:36:34.395 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 1872, 2024-03-16T07:36:34.395 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 1058928, 2024-03-16T07:36:34.395 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 26, 2024-03-16T07:36:34.395 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 5, 2024-03-16T07:36:34.395 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 0.376495028, 2024-03-16T07:36:34.395 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.150068395, 2024-03-16T07:36:34.395 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 0.173849705, 2024-03-16T07:36:34.395 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-03-16T07:36:34.395 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T07:36:34.395 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 133, 2024-03-16T07:36:34.395 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.214143680, 2024-03-16T07:36:34.395 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.001610102 2024-03-16T07:36:34.395 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:36:34.395 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-03-16T07:36:34.396 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:36:34.396 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:36:34.396 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:36:34.396 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:36:34.396 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 1872, 2024-03-16T07:36:34.396 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 1058928 2024-03-16T07:36:34.396 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:36:34.396 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:36:34.396 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:36:34.396 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-1": [ 2024-03-16T07:36:34.396 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:36:34.396 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:36:34.396 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:36:34.396 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 121, 2024-03-16T07:36:34.396 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 9, 2024-03-16T07:36:34.397 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 497552, 2024-03-16T07:36:34.397 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 1776, 2024-03-16T07:36:34.397 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 4, 2024-03-16T07:36:34.397 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 0, 2024-03-16T07:36:34.397 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 0.742215075, 2024-03-16T07:36:34.397 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.050285268, 2024-03-16T07:36:34.397 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 0.476064777, 2024-03-16T07:36:34.397 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.189868244, 2024-03-16T07:36:34.397 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T07:36:34.397 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 8, 2024-03-16T07:36:34.397 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.187770743, 2024-03-16T07:36:34.397 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.023471342 2024-03-16T07:36:34.397 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:36:34.397 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-03-16T07:36:34.397 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:36:34.397 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:36:34.398 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:36:34.398 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:36:34.398 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 497552, 2024-03-16T07:36:34.398 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 1776 2024-03-16T07:36:34.398 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:36:34.398 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:36:34.398 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:36:34.398 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-2": [ 2024-03-16T07:36:34.398 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:36:34.398 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:36:34.398 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:36:34.398 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 78, 2024-03-16T07:36:34.398 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 12, 2024-03-16T07:36:34.398 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 3015168, 2024-03-16T07:36:34.398 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 2240, 2024-03-16T07:36:34.399 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 3, 2024-03-16T07:36:34.399 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 1, 2024-03-16T07:36:34.399 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 1.705184740, 2024-03-16T07:36:34.399 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.015014366, 2024-03-16T07:36:34.399 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 3.070311691, 2024-03-16T07:36:34.399 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-03-16T07:36:34.399 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T07:36:34.399 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 11, 2024-03-16T07:36:34.399 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.346048562, 2024-03-16T07:36:34.399 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.031458960 2024-03-16T07:36:34.399 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:36:34.399 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-03-16T07:36:34.399 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:36:34.399 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:36:34.399 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:36:34.400 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:36:34.400 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 3015168, 2024-03-16T07:36:34.400 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 2240 2024-03-16T07:36:34.400 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:36:34.400 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:36:34.400 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:36:34.400 INFO:teuthology.orchestra.run.smithi049.stdout: "cct": [ 2024-03-16T07:36:34.400 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:36:34.400 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:36:34.400 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:36:34.400 INFO:teuthology.orchestra.run.smithi049.stdout: "total_workers": 0, 2024-03-16T07:36:34.400 INFO:teuthology.orchestra.run.smithi049.stdout: "unhealthy_workers": 0 2024-03-16T07:36:34.400 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:36:34.400 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:36:34.400 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:36:34.400 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs_mirror": [ 2024-03-16T07:36:34.401 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:36:34.401 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:36:34.401 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:36:34.401 INFO:teuthology.orchestra.run.smithi049.stdout: "mirrored_filesystems": 1, 2024-03-16T07:36:34.401 INFO:teuthology.orchestra.run.smithi049.stdout: "mirror_enable_failures": 0 2024-03-16T07:36:34.401 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:36:34.401 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:36:34.401 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:36:34.401 INFO:teuthology.orchestra.run.smithi049.stdout: "mempool": [ 2024-03-16T07:36:34.401 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:36:34.401 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:36:34.401 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:36:34.401 INFO:teuthology.orchestra.run.smithi049.stdout: "bloom_filter_bytes": 0, 2024-03-16T07:36:34.401 INFO:teuthology.orchestra.run.smithi049.stdout: "bloom_filter_items": 0, 2024-03-16T07:36:34.401 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_alloc_bytes": 0, 2024-03-16T07:36:34.401 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_alloc_items": 0, 2024-03-16T07:36:34.401 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_data_bytes": 0, 2024-03-16T07:36:34.402 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_data_items": 0, 2024-03-16T07:36:34.402 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_onode_bytes": 0, 2024-03-16T07:36:34.402 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_onode_items": 0, 2024-03-16T07:36:34.402 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_meta_bytes": 0, 2024-03-16T07:36:34.402 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_meta_items": 0, 2024-03-16T07:36:34.402 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_other_bytes": 0, 2024-03-16T07:36:34.402 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_other_items": 0, 2024-03-16T07:36:34.402 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_buffer_bytes": 0, 2024-03-16T07:36:34.402 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_buffer_items": 0, 2024-03-16T07:36:34.402 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_extent_bytes": 0, 2024-03-16T07:36:34.402 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_extent_items": 0, 2024-03-16T07:36:34.402 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_blob_bytes": 0, 2024-03-16T07:36:34.402 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_blob_items": 0, 2024-03-16T07:36:34.403 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_shared_blob_bytes": 0, 2024-03-16T07:36:34.403 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_shared_blob_items": 0, 2024-03-16T07:36:34.403 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_inline_bl_bytes": 0, 2024-03-16T07:36:34.403 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_inline_bl_items": 0, 2024-03-16T07:36:34.403 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_fsck_bytes": 0, 2024-03-16T07:36:34.403 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_fsck_items": 0, 2024-03-16T07:36:34.403 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_txc_bytes": 0, 2024-03-16T07:36:34.403 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_txc_items": 0, 2024-03-16T07:36:34.403 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_deferred_bytes": 0, 2024-03-16T07:36:34.403 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_deferred_items": 0, 2024-03-16T07:36:34.403 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_bytes": 0, 2024-03-16T07:36:34.403 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_items": 0, 2024-03-16T07:36:34.403 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_bytes": 0, 2024-03-16T07:36:34.404 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_items": 0, 2024-03-16T07:36:34.404 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_reader_bytes": 0, 2024-03-16T07:36:34.404 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_reader_items": 0, 2024-03-16T07:36:34.404 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_writer_bytes": 0, 2024-03-16T07:36:34.404 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_writer_items": 0, 2024-03-16T07:36:34.404 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_anon_bytes": 148128, 2024-03-16T07:36:34.404 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_anon_items": 26, 2024-03-16T07:36:34.404 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_meta_bytes": 0, 2024-03-16T07:36:34.404 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_meta_items": 0, 2024-03-16T07:36:34.404 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_bytes": 0, 2024-03-16T07:36:34.404 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_items": 0, 2024-03-16T07:36:34.404 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_mapbl_bytes": 0, 2024-03-16T07:36:34.404 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_mapbl_items": 0, 2024-03-16T07:36:34.404 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pglog_bytes": 0, 2024-03-16T07:36:34.404 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pglog_items": 0, 2024-03-16T07:36:34.405 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_bytes": 4824, 2024-03-16T07:36:34.405 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_items": 52, 2024-03-16T07:36:34.405 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_mapping_bytes": 0, 2024-03-16T07:36:34.405 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_mapping_items": 0, 2024-03-16T07:36:34.405 INFO:teuthology.orchestra.run.smithi049.stdout: "pgmap_bytes": 0, 2024-03-16T07:36:34.405 INFO:teuthology.orchestra.run.smithi049.stdout: "pgmap_items": 0, 2024-03-16T07:36:34.405 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_co_bytes": 0, 2024-03-16T07:36:34.405 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_co_items": 0, 2024-03-16T07:36:34.405 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_1_bytes": 0, 2024-03-16T07:36:34.405 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_1_items": 0, 2024-03-16T07:36:34.405 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_2_bytes": 0, 2024-03-16T07:36:34.405 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_2_items": 0 2024-03-16T07:36:34.405 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:36:34.405 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:36:34.406 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:36:34.406 INFO:teuthology.orchestra.run.smithi049.stdout: "objecter": [ 2024-03-16T07:36:34.406 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:36:34.406 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:36:34.406 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:36:34.406 INFO:teuthology.orchestra.run.smithi049.stdout: "op_active": 0, 2024-03-16T07:36:34.406 INFO:teuthology.orchestra.run.smithi049.stdout: "op_laggy": 0, 2024-03-16T07:36:34.406 INFO:teuthology.orchestra.run.smithi049.stdout: "op_send": 0, 2024-03-16T07:36:34.406 INFO:teuthology.orchestra.run.smithi049.stdout: "op_send_bytes": 0, 2024-03-16T07:36:34.406 INFO:teuthology.orchestra.run.smithi049.stdout: "op_resend": 0, 2024-03-16T07:36:34.406 INFO:teuthology.orchestra.run.smithi049.stdout: "op_reply": 0, 2024-03-16T07:36:34.406 INFO:teuthology.orchestra.run.smithi049.stdout: "op_latency": { 2024-03-16T07:36:34.406 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:36:34.406 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:36:34.406 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:36:34.406 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:36:34.407 INFO:teuthology.orchestra.run.smithi049.stdout: "op_inflight": 0, 2024-03-16T07:36:34.407 INFO:teuthology.orchestra.run.smithi049.stdout: "oplen_avg": { 2024-03-16T07:36:34.407 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:36:34.407 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0 2024-03-16T07:36:34.407 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:36:34.407 INFO:teuthology.orchestra.run.smithi049.stdout: "op": 0, 2024-03-16T07:36:34.407 INFO:teuthology.orchestra.run.smithi049.stdout: "op_r": 0, 2024-03-16T07:36:34.407 INFO:teuthology.orchestra.run.smithi049.stdout: "op_w": 0, 2024-03-16T07:36:34.407 INFO:teuthology.orchestra.run.smithi049.stdout: "op_rmw": 0, 2024-03-16T07:36:34.407 INFO:teuthology.orchestra.run.smithi049.stdout: "op_pg": 0, 2024-03-16T07:36:34.407 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_stat": 0, 2024-03-16T07:36:34.407 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_create": 0, 2024-03-16T07:36:34.407 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_read": 0, 2024-03-16T07:36:34.407 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_write": 0, 2024-03-16T07:36:34.407 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_writefull": 0, 2024-03-16T07:36:34.408 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_writesame": 0, 2024-03-16T07:36:34.408 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_append": 0, 2024-03-16T07:36:34.408 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_zero": 0, 2024-03-16T07:36:34.408 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_truncate": 0, 2024-03-16T07:36:34.408 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_delete": 0, 2024-03-16T07:36:34.408 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_mapext": 0, 2024-03-16T07:36:34.408 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_sparse_read": 0, 2024-03-16T07:36:34.408 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_clonerange": 0, 2024-03-16T07:36:34.408 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_getxattr": 0, 2024-03-16T07:36:34.408 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_setxattr": 0, 2024-03-16T07:36:34.408 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_cmpxattr": 0, 2024-03-16T07:36:34.408 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_rmxattr": 0, 2024-03-16T07:36:34.408 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_resetxattrs": 0, 2024-03-16T07:36:34.408 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_call": 0, 2024-03-16T07:36:34.409 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_watch": 0, 2024-03-16T07:36:34.409 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_notify": 0, 2024-03-16T07:36:34.409 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_src_cmpxattr": 0, 2024-03-16T07:36:34.409 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_pgls": 0, 2024-03-16T07:36:34.409 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_pgls_filter": 0, 2024-03-16T07:36:34.409 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_other": 0, 2024-03-16T07:36:34.409 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_active": 0, 2024-03-16T07:36:34.409 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_send": 0, 2024-03-16T07:36:34.409 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_resend": 0, 2024-03-16T07:36:34.409 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_ping": 0, 2024-03-16T07:36:34.409 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_active": 0, 2024-03-16T07:36:34.409 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_send": 0, 2024-03-16T07:36:34.409 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_resend": 0, 2024-03-16T07:36:34.409 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_active": 0, 2024-03-16T07:36:34.409 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_send": 0, 2024-03-16T07:36:34.409 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_resend": 0, 2024-03-16T07:36:34.410 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_active": 0, 2024-03-16T07:36:34.410 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_send": 0, 2024-03-16T07:36:34.410 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_resend": 0, 2024-03-16T07:36:34.410 INFO:teuthology.orchestra.run.smithi049.stdout: "command_active": 0, 2024-03-16T07:36:34.410 INFO:teuthology.orchestra.run.smithi049.stdout: "command_send": 0, 2024-03-16T07:36:34.410 INFO:teuthology.orchestra.run.smithi049.stdout: "command_resend": 0, 2024-03-16T07:36:34.410 INFO:teuthology.orchestra.run.smithi049.stdout: "map_epoch": 0, 2024-03-16T07:36:34.410 INFO:teuthology.orchestra.run.smithi049.stdout: "map_full": 0, 2024-03-16T07:36:34.410 INFO:teuthology.orchestra.run.smithi049.stdout: "map_inc": 0, 2024-03-16T07:36:34.410 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_sessions": 0, 2024-03-16T07:36:34.410 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_session_open": 0, 2024-03-16T07:36:34.410 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_session_close": 0, 2024-03-16T07:36:34.410 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_laggy": 0, 2024-03-16T07:36:34.410 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_wr": 0, 2024-03-16T07:36:34.411 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_rd": 0, 2024-03-16T07:36:34.411 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_del": 0 2024-03-16T07:36:34.411 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:36:34.411 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:36:34.411 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:36:34.411 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-msgr_dispatch_throttler-client": [ 2024-03-16T07:36:34.411 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:36:34.411 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:36:34.411 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:36:34.411 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:36:34.411 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-03-16T07:36:34.411 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:36:34.411 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 121, 2024-03-16T07:36:34.411 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 481125, 2024-03-16T07:36:34.411 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:36:34.412 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 121, 2024-03-16T07:36:34.412 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:36:34.412 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:36:34.412 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 121, 2024-03-16T07:36:34.412 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 481125, 2024-03-16T07:36:34.412 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:36:34.412 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:36:34.412 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:36:34.412 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:36:34.412 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:36:34.412 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:36:34.412 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:36:34.412 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:36:34.412 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-msgr_dispatch_throttler-radosclient": [ 2024-03-16T07:36:34.412 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:36:34.412 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:36:34.413 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:36:34.413 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:36:34.413 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-03-16T07:36:34.413 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:36:34.413 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 88, 2024-03-16T07:36:34.413 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 3004196, 2024-03-16T07:36:34.413 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:36:34.413 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 88, 2024-03-16T07:36:34.413 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:36:34.413 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:36:34.413 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 88, 2024-03-16T07:36:34.413 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 3004196, 2024-03-16T07:36:34.413 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:36:34.413 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:36:34.413 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:36:34.414 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:36:34.414 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:36:34.414 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:36:34.414 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:36:34.414 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:36:34.414 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-objecter_bytes": [ 2024-03-16T07:36:34.414 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:36:34.414 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:36:34.414 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:36:34.414 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:36:34.414 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-03-16T07:36:34.414 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:36:34.414 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 0, 2024-03-16T07:36:34.415 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 0, 2024-03-16T07:36:34.415 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:36:34.415 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 0, 2024-03-16T07:36:34.415 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:36:34.415 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:36:34.415 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 0, 2024-03-16T07:36:34.415 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 0, 2024-03-16T07:36:34.415 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:36:34.415 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:36:34.415 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:36:34.415 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:36:34.415 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:36:34.415 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:36:34.416 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:36:34.416 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:36:34.416 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-objecter_ops": [ 2024-03-16T07:36:34.416 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:36:34.416 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:36:34.416 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:36:34.416 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:36:34.416 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 1024, 2024-03-16T07:36:34.416 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:36:34.416 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 0, 2024-03-16T07:36:34.416 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 0, 2024-03-16T07:36:34.416 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:36:34.416 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 0, 2024-03-16T07:36:34.416 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:36:34.416 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:36:34.417 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 0, 2024-03-16T07:36:34.417 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 0, 2024-03-16T07:36:34.417 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:36:34.417 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:36:34.417 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:36:34.417 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:36:34.417 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:36:34.417 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:36:34.417 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:36:34.417 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2024-03-16T07:36:34.417 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-03-16T07:36:34.418 DEBUG:tasks.cephfs.test_mirroring:command returned={ "AsyncMessenger::Worker": [ { "labels": { "id": "0" }, "counters": { "msgr_connection_ready_timeouts": 0, "msgr_connection_idle_timeouts": 0 } }, { "labels": { "id": "1" }, "counters": { "msgr_connection_ready_timeouts": 0, "msgr_connection_idle_timeouts": 0 } }, { "labels": { "id": "2" }, "counters": { "msgr_connection_ready_timeouts": 0, "msgr_connection_idle_timeouts": 0 } } ], "AsyncMessenger::Worker-0": [ { "labels": {}, "counters": { "msgr_recv_messages": 13, "msgr_send_messages": 145, "msgr_recv_bytes": 1872, "msgr_send_bytes": 1058928, "msgr_created_connections": 26, "msgr_active_connections": 5, "msgr_running_total_time": 0.376495028, "msgr_running_send_time": 0.150068395, "msgr_running_recv_time": 0.173849705, "msgr_running_fast_dispatch_time": 0.000000000, "msgr_send_messages_queue_lat": { "avgcount": 133, "sum": 0.214143680, "avgtime": 0.001610102 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "msgr_recv_encrypted_bytes": 1872, "msgr_send_encrypted_bytes": 1058928 } } ], "AsyncMessenger::Worker-1": [ { "labels": {}, "counters": { "msgr_recv_messages": 121, "msgr_send_messages": 9, "msgr_recv_bytes": 497552, "msgr_send_bytes": 1776, "msgr_created_connections": 4, "msgr_active_connections": 0, "msgr_running_total_time": 0.742215075, "msgr_running_send_time": 0.050285268, "msgr_running_recv_time": 0.476064777, "msgr_running_fast_dispatch_time": 0.189868244, "msgr_send_messages_queue_lat": { "avgcount": 8, "sum": 0.187770743, "avgtime": 0.023471342 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "msgr_recv_encrypted_bytes": 497552, "msgr_send_encrypted_bytes": 1776 } } ], "AsyncMessenger::Worker-2": [ { "labels": {}, "counters": { "msgr_recv_messages": 78, "msgr_send_messages": 12, "msgr_recv_bytes": 3015168, "msgr_send_bytes": 2240, "msgr_created_connections": 3, "msgr_active_connections": 1, "msgr_running_total_time": 1.705184740, "msgr_running_send_time": 0.015014366, "msgr_running_recv_time": 3.070311691, "msgr_running_fast_dispatch_time": 0.000000000, "msgr_send_messages_queue_lat": { "avgcount": 11, "sum": 0.346048562, "avgtime": 0.031458960 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "msgr_recv_encrypted_bytes": 3015168, "msgr_send_encrypted_bytes": 2240 } } ], "cct": [ { "labels": {}, "counters": { "total_workers": 0, "unhealthy_workers": 0 } } ], "cephfs_mirror": [ { "labels": {}, "counters": { "mirrored_filesystems": 1, "mirror_enable_failures": 0 } } ], "mempool": [ { "labels": {}, "counters": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_cache_buffer_bytes": 0, "bluestore_cache_buffer_items": 0, "bluestore_extent_bytes": 0, "bluestore_extent_items": 0, "bluestore_blob_bytes": 0, "bluestore_blob_items": 0, "bluestore_shared_blob_bytes": 0, "bluestore_shared_blob_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_items": 0, "bluefs_bytes": 0, "bluefs_items": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "buffer_anon_bytes": 148128, "buffer_anon_items": 26, "buffer_meta_bytes": 0, "buffer_meta_items": 0, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 4824, "osdmap_items": 52, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "mds_co_bytes": 0, "mds_co_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 } } ], "objecter": [ { "labels": {}, "counters": { "op_active": 0, "op_laggy": 0, "op_send": 0, "op_send_bytes": 0, "op_resend": 0, "op_reply": 0, "op_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "op_inflight": 0, "oplen_avg": { "avgcount": 0, "sum": 0 }, "op": 0, "op_r": 0, "op_w": 0, "op_rmw": 0, "op_pg": 0, "osdop_stat": 0, "osdop_create": 0, "osdop_read": 0, "osdop_write": 0, "osdop_writefull": 0, "osdop_writesame": 0, "osdop_append": 0, "osdop_zero": 0, "osdop_truncate": 0, "osdop_delete": 0, "osdop_mapext": 0, "osdop_sparse_read": 0, "osdop_clonerange": 0, "osdop_getxattr": 0, "osdop_setxattr": 0, "osdop_cmpxattr": 0, "osdop_rmxattr": 0, "osdop_resetxattrs": 0, "osdop_call": 0, "osdop_watch": 0, "osdop_notify": 0, "osdop_src_cmpxattr": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_other": 0, "linger_active": 0, "linger_send": 0, "linger_resend": 0, "linger_ping": 0, "poolop_active": 0, "poolop_send": 0, "poolop_resend": 0, "poolstat_active": 0, "poolstat_send": 0, "poolstat_resend": 0, "statfs_active": 0, "statfs_send": 0, "statfs_resend": 0, "command_active": 0, "command_send": 0, "command_resend": 0, "map_epoch": 0, "map_full": 0, "map_inc": 0, "osd_sessions": 0, "osd_session_open": 0, "osd_session_close": 0, "osd_laggy": 0, "omap_wr": 0, "omap_rd": 0, "omap_del": 0 } } ], "throttle-msgr_dispatch_throttler-client": [ { "labels": {}, "counters": { "val": 0, "max": 104857600, "get_started": 0, "get": 121, "get_sum": 481125, "get_or_fail_fail": 0, "get_or_fail_success": 121, "take": 0, "take_sum": 0, "put": 121, "put_sum": 481125, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ], "throttle-msgr_dispatch_throttler-radosclient": [ { "labels": {}, "counters": { "val": 0, "max": 104857600, "get_started": 0, "get": 88, "get_sum": 3004196, "get_or_fail_fail": 0, "get_or_fail_success": 88, "take": 0, "take_sum": 0, "put": 88, "put_sum": 3004196, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ], "throttle-objecter_bytes": [ { "labels": {}, "counters": { "val": 0, "max": 104857600, "get_started": 0, "get": 0, "get_sum": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "take": 0, "take_sum": 0, "put": 0, "put_sum": 0, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ], "throttle-objecter_ops": [ { "labels": {}, "counters": { "val": 0, "max": 1024, "get_started": 0, "get": 0, "get_sum": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "take": 0, "take_sum": 0, "put": 0, "put_sum": 0, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ] } 2024-03-16T07:36:34.419 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snapshot mirror enable cephfs 2024-03-16T07:36:35.769 INFO:teuthology.orchestra.run.smithi049.stdout:{} 2024-03-16T07:36:39.484 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T07:36:45.795 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-03-16T07:36:45.795 DEBUG:teuthology.orchestra.run.smithi049:mirror status for fs: cephfs> ceph --admin-daemon /var/run/ceph/cephfs-mirror.asok fs mirror status cephfs@14 2024-03-16T07:36:45.891 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-03-16T07:36:45.891 INFO:teuthology.orchestra.run.smithi049.stdout: "rados_inst": "172.21.15.49:0/1186634239", 2024-03-16T07:36:45.891 INFO:teuthology.orchestra.run.smithi049.stdout: "peers": {}, 2024-03-16T07:36:45.891 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_dirs": { 2024-03-16T07:36:45.891 INFO:teuthology.orchestra.run.smithi049.stdout: "dir_count": 0 2024-03-16T07:36:45.891 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:36:45.891 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-03-16T07:36:45.899 DEBUG:tasks.cephfs.test_mirroring:command returned={ "rados_inst": "172.21.15.49:0/1186634239", "peers": {}, "snap_dirs": { "dir_count": 0 } } 2024-03-16T07:36:45.899 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-03-16T07:36:45.899 DEBUG:teuthology.orchestra.run.smithi049:counter dump for fs: cephfs> ceph --admin-daemon /var/run/ceph/cephfs-mirror.asok counter dump 2024-03-16T07:36:46.004 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-03-16T07:36:46.004 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker": [ 2024-03-16T07:36:46.004 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:36:46.004 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:36:46.004 INFO:teuthology.orchestra.run.smithi049.stdout: "id": "0" 2024-03-16T07:36:46.004 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:36:46.004 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:36:46.004 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_ready_timeouts": 0, 2024-03-16T07:36:46.005 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_idle_timeouts": 0 2024-03-16T07:36:46.005 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:36:46.005 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:36:46.005 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:36:46.005 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:36:46.005 INFO:teuthology.orchestra.run.smithi049.stdout: "id": "1" 2024-03-16T07:36:46.005 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:36:46.005 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:36:46.005 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_ready_timeouts": 0, 2024-03-16T07:36:46.005 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_idle_timeouts": 0 2024-03-16T07:36:46.005 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:36:46.005 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:36:46.005 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:36:46.005 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:36:46.005 INFO:teuthology.orchestra.run.smithi049.stdout: "id": "2" 2024-03-16T07:36:46.006 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:36:46.006 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:36:46.006 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_ready_timeouts": 0, 2024-03-16T07:36:46.006 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_idle_timeouts": 0 2024-03-16T07:36:46.006 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:36:46.006 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:36:46.006 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:36:46.006 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-0": [ 2024-03-16T07:36:46.006 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:36:46.006 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:36:46.006 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:36:46.006 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 13, 2024-03-16T07:36:46.006 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 148, 2024-03-16T07:36:46.007 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 1872, 2024-03-16T07:36:46.007 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 1059728, 2024-03-16T07:36:46.007 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 26, 2024-03-16T07:36:46.007 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 5, 2024-03-16T07:36:46.007 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 0.378049609, 2024-03-16T07:36:46.007 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.151486313, 2024-03-16T07:36:46.007 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 0.173849705, 2024-03-16T07:36:46.007 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-03-16T07:36:46.007 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T07:36:46.007 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 136, 2024-03-16T07:36:46.007 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.214657175, 2024-03-16T07:36:46.007 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.001578361 2024-03-16T07:36:46.007 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:36:46.007 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-03-16T07:36:46.007 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:36:46.007 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:36:46.008 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:36:46.008 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:36:46.008 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 1872, 2024-03-16T07:36:46.008 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 1059728 2024-03-16T07:36:46.008 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:36:46.008 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:36:46.008 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:36:46.008 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-1": [ 2024-03-16T07:36:46.008 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:36:46.008 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:36:46.008 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:36:46.008 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 122, 2024-03-16T07:36:46.008 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 9, 2024-03-16T07:36:46.008 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 502432, 2024-03-16T07:36:46.008 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 1776, 2024-03-16T07:36:46.008 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 4, 2024-03-16T07:36:46.009 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 0, 2024-03-16T07:36:46.009 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 0.746561940, 2024-03-16T07:36:46.009 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.050489909, 2024-03-16T07:36:46.009 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 0.478247304, 2024-03-16T07:36:46.009 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.191550009, 2024-03-16T07:36:46.009 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T07:36:46.009 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 8, 2024-03-16T07:36:46.009 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.187770743, 2024-03-16T07:36:46.009 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.023471342 2024-03-16T07:36:46.009 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:36:46.009 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-03-16T07:36:46.009 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:36:46.009 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:36:46.009 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:36:46.009 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:36:46.009 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 502432, 2024-03-16T07:36:46.010 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 1776 2024-03-16T07:36:46.010 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:36:46.010 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:36:46.010 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:36:46.010 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-2": [ 2024-03-16T07:36:46.010 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:36:46.010 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:36:46.010 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:36:46.010 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 78, 2024-03-16T07:36:46.010 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 12, 2024-03-16T07:36:46.010 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 3015168, 2024-03-16T07:36:46.010 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 2240, 2024-03-16T07:36:46.010 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 3, 2024-03-16T07:36:46.011 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 1, 2024-03-16T07:36:46.011 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 1.705736594, 2024-03-16T07:36:46.011 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.015157158, 2024-03-16T07:36:46.011 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 3.070442058, 2024-03-16T07:36:46.011 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-03-16T07:36:46.011 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T07:36:46.011 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 11, 2024-03-16T07:36:46.011 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.346048562, 2024-03-16T07:36:46.011 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.031458960 2024-03-16T07:36:46.011 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:36:46.011 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-03-16T07:36:46.011 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:36:46.011 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:36:46.011 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:36:46.012 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:36:46.012 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 3015168, 2024-03-16T07:36:46.012 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 2240 2024-03-16T07:36:46.012 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:36:46.012 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:36:46.012 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:36:46.012 INFO:teuthology.orchestra.run.smithi049.stdout: "cct": [ 2024-03-16T07:36:46.012 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:36:46.012 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:36:46.012 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:36:46.012 INFO:teuthology.orchestra.run.smithi049.stdout: "total_workers": 0, 2024-03-16T07:36:46.012 INFO:teuthology.orchestra.run.smithi049.stdout: "unhealthy_workers": 0 2024-03-16T07:36:46.012 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:36:46.012 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:36:46.012 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:36:46.013 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs_mirror": [ 2024-03-16T07:36:46.013 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:36:46.013 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:36:46.013 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:36:46.013 INFO:teuthology.orchestra.run.smithi049.stdout: "mirrored_filesystems": 2, 2024-03-16T07:36:46.013 INFO:teuthology.orchestra.run.smithi049.stdout: "mirror_enable_failures": 0 2024-03-16T07:36:46.013 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:36:46.013 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:36:46.013 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:36:46.013 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs_mirror_mirrored_filesystems": [ 2024-03-16T07:36:46.013 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:36:46.013 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:36:46.013 INFO:teuthology.orchestra.run.smithi049.stdout: "filesystem": "cephfs" 2024-03-16T07:36:46.013 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:36:46.013 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:36:46.013 INFO:teuthology.orchestra.run.smithi049.stdout: "mirroring_peers": 0, 2024-03-16T07:36:46.014 INFO:teuthology.orchestra.run.smithi049.stdout: "directory_count": 0 2024-03-16T07:36:46.014 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:36:46.014 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:36:46.014 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:36:46.014 INFO:teuthology.orchestra.run.smithi049.stdout: "mempool": [ 2024-03-16T07:36:46.014 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:36:46.014 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:36:46.014 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:36:46.014 INFO:teuthology.orchestra.run.smithi049.stdout: "bloom_filter_bytes": 0, 2024-03-16T07:36:46.014 INFO:teuthology.orchestra.run.smithi049.stdout: "bloom_filter_items": 0, 2024-03-16T07:36:46.014 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_alloc_bytes": 0, 2024-03-16T07:36:46.014 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_alloc_items": 0, 2024-03-16T07:36:46.014 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_data_bytes": 0, 2024-03-16T07:36:46.015 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_data_items": 0, 2024-03-16T07:36:46.015 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_onode_bytes": 0, 2024-03-16T07:36:46.015 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_onode_items": 0, 2024-03-16T07:36:46.015 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_meta_bytes": 0, 2024-03-16T07:36:46.015 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_meta_items": 0, 2024-03-16T07:36:46.015 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_other_bytes": 0, 2024-03-16T07:36:46.015 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_other_items": 0, 2024-03-16T07:36:46.015 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_buffer_bytes": 0, 2024-03-16T07:36:46.015 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_buffer_items": 0, 2024-03-16T07:36:46.015 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_extent_bytes": 0, 2024-03-16T07:36:46.015 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_extent_items": 0, 2024-03-16T07:36:46.015 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_blob_bytes": 0, 2024-03-16T07:36:46.015 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_blob_items": 0, 2024-03-16T07:36:46.015 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_shared_blob_bytes": 0, 2024-03-16T07:36:46.016 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_shared_blob_items": 0, 2024-03-16T07:36:46.016 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_inline_bl_bytes": 0, 2024-03-16T07:36:46.016 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_inline_bl_items": 0, 2024-03-16T07:36:46.016 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_fsck_bytes": 0, 2024-03-16T07:36:46.016 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_fsck_items": 0, 2024-03-16T07:36:46.016 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_txc_bytes": 0, 2024-03-16T07:36:46.016 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_txc_items": 0, 2024-03-16T07:36:46.016 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_deferred_bytes": 0, 2024-03-16T07:36:46.016 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_deferred_items": 0, 2024-03-16T07:36:46.016 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_bytes": 0, 2024-03-16T07:36:46.016 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_items": 0, 2024-03-16T07:36:46.016 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_bytes": 0, 2024-03-16T07:36:46.016 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_items": 0, 2024-03-16T07:36:46.016 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_reader_bytes": 0, 2024-03-16T07:36:46.016 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_reader_items": 0, 2024-03-16T07:36:46.016 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_writer_bytes": 0, 2024-03-16T07:36:46.016 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_writer_items": 0, 2024-03-16T07:36:46.017 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_anon_bytes": 182461, 2024-03-16T07:36:46.017 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_anon_items": 55, 2024-03-16T07:36:46.017 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_meta_bytes": 0, 2024-03-16T07:36:46.017 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_meta_items": 0, 2024-03-16T07:36:46.017 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_bytes": 0, 2024-03-16T07:36:46.017 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_items": 0, 2024-03-16T07:36:46.017 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_mapbl_bytes": 0, 2024-03-16T07:36:46.017 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_mapbl_items": 0, 2024-03-16T07:36:46.017 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pglog_bytes": 0, 2024-03-16T07:36:46.017 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pglog_items": 0, 2024-03-16T07:36:46.017 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_bytes": 19336, 2024-03-16T07:36:46.017 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_items": 192, 2024-03-16T07:36:46.017 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_mapping_bytes": 0, 2024-03-16T07:36:46.017 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_mapping_items": 0, 2024-03-16T07:36:46.017 INFO:teuthology.orchestra.run.smithi049.stdout: "pgmap_bytes": 0, 2024-03-16T07:36:46.017 INFO:teuthology.orchestra.run.smithi049.stdout: "pgmap_items": 0, 2024-03-16T07:36:46.017 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_co_bytes": 0, 2024-03-16T07:36:46.018 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_co_items": 0, 2024-03-16T07:36:46.018 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_1_bytes": 0, 2024-03-16T07:36:46.018 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_1_items": 0, 2024-03-16T07:36:46.018 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_2_bytes": 0, 2024-03-16T07:36:46.018 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_2_items": 0 2024-03-16T07:36:46.018 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:36:46.018 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:36:46.018 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:36:46.018 INFO:teuthology.orchestra.run.smithi049.stdout: "objecter": [ 2024-03-16T07:36:46.018 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:36:46.018 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:36:46.018 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:36:46.018 INFO:teuthology.orchestra.run.smithi049.stdout: "op_active": 0, 2024-03-16T07:36:46.018 INFO:teuthology.orchestra.run.smithi049.stdout: "op_laggy": 0, 2024-03-16T07:36:46.018 INFO:teuthology.orchestra.run.smithi049.stdout: "op_send": 0, 2024-03-16T07:36:46.019 INFO:teuthology.orchestra.run.smithi049.stdout: "op_send_bytes": 0, 2024-03-16T07:36:46.019 INFO:teuthology.orchestra.run.smithi049.stdout: "op_resend": 0, 2024-03-16T07:36:46.019 INFO:teuthology.orchestra.run.smithi049.stdout: "op_reply": 0, 2024-03-16T07:36:46.019 INFO:teuthology.orchestra.run.smithi049.stdout: "op_latency": { 2024-03-16T07:36:46.019 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:36:46.019 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:36:46.019 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:36:46.019 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:36:46.019 INFO:teuthology.orchestra.run.smithi049.stdout: "op_inflight": 0, 2024-03-16T07:36:46.019 INFO:teuthology.orchestra.run.smithi049.stdout: "oplen_avg": { 2024-03-16T07:36:46.019 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:36:46.019 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0 2024-03-16T07:36:46.019 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:36:46.019 INFO:teuthology.orchestra.run.smithi049.stdout: "op": 0, 2024-03-16T07:36:46.019 INFO:teuthology.orchestra.run.smithi049.stdout: "op_r": 0, 2024-03-16T07:36:46.020 INFO:teuthology.orchestra.run.smithi049.stdout: "op_w": 0, 2024-03-16T07:36:46.020 INFO:teuthology.orchestra.run.smithi049.stdout: "op_rmw": 0, 2024-03-16T07:36:46.020 INFO:teuthology.orchestra.run.smithi049.stdout: "op_pg": 0, 2024-03-16T07:36:46.020 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_stat": 0, 2024-03-16T07:36:46.020 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_create": 0, 2024-03-16T07:36:46.020 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_read": 0, 2024-03-16T07:36:46.020 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_write": 0, 2024-03-16T07:36:46.020 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_writefull": 0, 2024-03-16T07:36:46.020 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_writesame": 0, 2024-03-16T07:36:46.020 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_append": 0, 2024-03-16T07:36:46.020 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_zero": 0, 2024-03-16T07:36:46.020 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_truncate": 0, 2024-03-16T07:36:46.020 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_delete": 0, 2024-03-16T07:36:46.020 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_mapext": 0, 2024-03-16T07:36:46.020 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_sparse_read": 0, 2024-03-16T07:36:46.020 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_clonerange": 0, 2024-03-16T07:36:46.020 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_getxattr": 0, 2024-03-16T07:36:46.021 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_setxattr": 0, 2024-03-16T07:36:46.021 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_cmpxattr": 0, 2024-03-16T07:36:46.021 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_rmxattr": 0, 2024-03-16T07:36:46.021 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_resetxattrs": 0, 2024-03-16T07:36:46.021 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_call": 0, 2024-03-16T07:36:46.021 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_watch": 0, 2024-03-16T07:36:46.021 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_notify": 0, 2024-03-16T07:36:46.021 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_src_cmpxattr": 0, 2024-03-16T07:36:46.021 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_pgls": 0, 2024-03-16T07:36:46.021 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_pgls_filter": 0, 2024-03-16T07:36:46.021 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_other": 0, 2024-03-16T07:36:46.021 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_active": 0, 2024-03-16T07:36:46.021 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_send": 0, 2024-03-16T07:36:46.021 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_resend": 0, 2024-03-16T07:36:46.022 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_ping": 0, 2024-03-16T07:36:46.022 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_active": 0, 2024-03-16T07:36:46.022 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_send": 0, 2024-03-16T07:36:46.022 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_resend": 0, 2024-03-16T07:36:46.022 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_active": 0, 2024-03-16T07:36:46.022 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_send": 0, 2024-03-16T07:36:46.022 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_resend": 0, 2024-03-16T07:36:46.022 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_active": 0, 2024-03-16T07:36:46.022 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_send": 0, 2024-03-16T07:36:46.022 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_resend": 0, 2024-03-16T07:36:46.022 INFO:teuthology.orchestra.run.smithi049.stdout: "command_active": 0, 2024-03-16T07:36:46.022 INFO:teuthology.orchestra.run.smithi049.stdout: "command_send": 0, 2024-03-16T07:36:46.022 INFO:teuthology.orchestra.run.smithi049.stdout: "command_resend": 0, 2024-03-16T07:36:46.022 INFO:teuthology.orchestra.run.smithi049.stdout: "map_epoch": 0, 2024-03-16T07:36:46.022 INFO:teuthology.orchestra.run.smithi049.stdout: "map_full": 0, 2024-03-16T07:36:46.023 INFO:teuthology.orchestra.run.smithi049.stdout: "map_inc": 0, 2024-03-16T07:36:46.023 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_sessions": 0, 2024-03-16T07:36:46.023 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_session_open": 0, 2024-03-16T07:36:46.023 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_session_close": 0, 2024-03-16T07:36:46.023 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_laggy": 0, 2024-03-16T07:36:46.023 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_wr": 0, 2024-03-16T07:36:46.023 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_rd": 0, 2024-03-16T07:36:46.023 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_del": 0 2024-03-16T07:36:46.023 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:36:46.023 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:36:46.023 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:36:46.023 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-msgr_dispatch_throttler-client": [ 2024-03-16T07:36:46.023 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:36:46.023 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:36:46.023 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:36:46.024 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:36:46.024 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-03-16T07:36:46.024 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:36:46.024 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 122, 2024-03-16T07:36:46.024 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 485871, 2024-03-16T07:36:46.024 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:36:46.024 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 122, 2024-03-16T07:36:46.024 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:36:46.024 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:36:46.024 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 122, 2024-03-16T07:36:46.024 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 485871, 2024-03-16T07:36:46.024 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:36:46.024 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:36:46.024 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:36:46.025 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:36:46.025 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:36:46.025 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:36:46.025 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:36:46.025 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:36:46.025 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-msgr_dispatch_throttler-radosclient": [ 2024-03-16T07:36:46.025 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:36:46.025 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:36:46.025 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:36:46.025 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:36:46.025 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-03-16T07:36:46.025 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:36:46.025 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 88, 2024-03-16T07:36:46.025 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 3004196, 2024-03-16T07:36:46.025 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:36:46.025 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 88, 2024-03-16T07:36:46.026 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:36:46.026 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:36:46.026 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 88, 2024-03-16T07:36:46.026 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 3004196, 2024-03-16T07:36:46.026 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:36:46.026 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:36:46.026 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:36:46.026 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:36:46.026 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:36:46.026 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:36:46.026 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:36:46.026 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:36:46.026 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-objecter_bytes": [ 2024-03-16T07:36:46.026 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:36:46.027 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:36:46.027 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:36:46.027 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:36:46.027 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-03-16T07:36:46.027 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:36:46.027 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 0, 2024-03-16T07:36:46.027 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 0, 2024-03-16T07:36:46.027 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:36:46.027 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 0, 2024-03-16T07:36:46.027 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:36:46.027 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:36:46.027 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 0, 2024-03-16T07:36:46.027 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 0, 2024-03-16T07:36:46.027 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:36:46.027 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:36:46.027 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:36:46.028 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:36:46.028 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:36:46.028 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:36:46.028 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:36:46.028 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:36:46.028 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-objecter_ops": [ 2024-03-16T07:36:46.028 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:36:46.028 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:36:46.028 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:36:46.028 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:36:46.028 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 1024, 2024-03-16T07:36:46.028 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:36:46.028 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 0, 2024-03-16T07:36:46.028 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 0, 2024-03-16T07:36:46.029 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:36:46.029 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 0, 2024-03-16T07:36:46.029 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:36:46.029 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:36:46.029 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 0, 2024-03-16T07:36:46.029 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 0, 2024-03-16T07:36:46.029 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:36:46.029 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:36:46.029 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:36:46.029 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:36:46.029 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:36:46.029 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:36:46.029 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:36:46.029 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2024-03-16T07:36:46.029 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-03-16T07:36:46.030 DEBUG:tasks.cephfs.test_mirroring:command returned={ "AsyncMessenger::Worker": [ { "labels": { "id": "0" }, "counters": { "msgr_connection_ready_timeouts": 0, "msgr_connection_idle_timeouts": 0 } }, { "labels": { "id": "1" }, "counters": { "msgr_connection_ready_timeouts": 0, "msgr_connection_idle_timeouts": 0 } }, { "labels": { "id": "2" }, "counters": { "msgr_connection_ready_timeouts": 0, "msgr_connection_idle_timeouts": 0 } } ], "AsyncMessenger::Worker-0": [ { "labels": {}, "counters": { "msgr_recv_messages": 13, "msgr_send_messages": 148, "msgr_recv_bytes": 1872, "msgr_send_bytes": 1059728, "msgr_created_connections": 26, "msgr_active_connections": 5, "msgr_running_total_time": 0.378049609, "msgr_running_send_time": 0.151486313, "msgr_running_recv_time": 0.173849705, "msgr_running_fast_dispatch_time": 0.000000000, "msgr_send_messages_queue_lat": { "avgcount": 136, "sum": 0.214657175, "avgtime": 0.001578361 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "msgr_recv_encrypted_bytes": 1872, "msgr_send_encrypted_bytes": 1059728 } } ], "AsyncMessenger::Worker-1": [ { "labels": {}, "counters": { "msgr_recv_messages": 122, "msgr_send_messages": 9, "msgr_recv_bytes": 502432, "msgr_send_bytes": 1776, "msgr_created_connections": 4, "msgr_active_connections": 0, "msgr_running_total_time": 0.746561940, "msgr_running_send_time": 0.050489909, "msgr_running_recv_time": 0.478247304, "msgr_running_fast_dispatch_time": 0.191550009, "msgr_send_messages_queue_lat": { "avgcount": 8, "sum": 0.187770743, "avgtime": 0.023471342 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "msgr_recv_encrypted_bytes": 502432, "msgr_send_encrypted_bytes": 1776 } } ], "AsyncMessenger::Worker-2": [ { "labels": {}, "counters": { "msgr_recv_messages": 78, "msgr_send_messages": 12, "msgr_recv_bytes": 3015168, "msgr_send_bytes": 2240, "msgr_created_connections": 3, "msgr_active_connections": 1, "msgr_running_total_time": 1.705736594, "msgr_running_send_time": 0.015157158, "msgr_running_recv_time": 3.070442058, "msgr_running_fast_dispatch_time": 0.000000000, "msgr_send_messages_queue_lat": { "avgcount": 11, "sum": 0.346048562, "avgtime": 0.031458960 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "msgr_recv_encrypted_bytes": 3015168, "msgr_send_encrypted_bytes": 2240 } } ], "cct": [ { "labels": {}, "counters": { "total_workers": 0, "unhealthy_workers": 0 } } ], "cephfs_mirror": [ { "labels": {}, "counters": { "mirrored_filesystems": 2, "mirror_enable_failures": 0 } } ], "cephfs_mirror_mirrored_filesystems": [ { "labels": { "filesystem": "cephfs" }, "counters": { "mirroring_peers": 0, "directory_count": 0 } } ], "mempool": [ { "labels": {}, "counters": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_cache_buffer_bytes": 0, "bluestore_cache_buffer_items": 0, "bluestore_extent_bytes": 0, "bluestore_extent_items": 0, "bluestore_blob_bytes": 0, "bluestore_blob_items": 0, "bluestore_shared_blob_bytes": 0, "bluestore_shared_blob_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_items": 0, "bluefs_bytes": 0, "bluefs_items": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "buffer_anon_bytes": 182461, "buffer_anon_items": 55, "buffer_meta_bytes": 0, "buffer_meta_items": 0, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 19336, "osdmap_items": 192, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "mds_co_bytes": 0, "mds_co_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 } } ], "objecter": [ { "labels": {}, "counters": { "op_active": 0, "op_laggy": 0, "op_send": 0, "op_send_bytes": 0, "op_resend": 0, "op_reply": 0, "op_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "op_inflight": 0, "oplen_avg": { "avgcount": 0, "sum": 0 }, "op": 0, "op_r": 0, "op_w": 0, "op_rmw": 0, "op_pg": 0, "osdop_stat": 0, "osdop_create": 0, "osdop_read": 0, "osdop_write": 0, "osdop_writefull": 0, "osdop_writesame": 0, "osdop_append": 0, "osdop_zero": 0, "osdop_truncate": 0, "osdop_delete": 0, "osdop_mapext": 0, "osdop_sparse_read": 0, "osdop_clonerange": 0, "osdop_getxattr": 0, "osdop_setxattr": 0, "osdop_cmpxattr": 0, "osdop_rmxattr": 0, "osdop_resetxattrs": 0, "osdop_call": 0, "osdop_watch": 0, "osdop_notify": 0, "osdop_src_cmpxattr": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_other": 0, "linger_active": 0, "linger_send": 0, "linger_resend": 0, "linger_ping": 0, "poolop_active": 0, "poolop_send": 0, "poolop_resend": 0, "poolstat_active": 0, "poolstat_send": 0, "poolstat_resend": 0, "statfs_active": 0, "statfs_send": 0, "statfs_resend": 0, "command_active": 0, "command_send": 0, "command_resend": 0, "map_epoch": 0, "map_full": 0, "map_inc": 0, "osd_sessions": 0, "osd_session_open": 0, "osd_session_close": 0, "osd_laggy": 0, "omap_wr": 0, "omap_rd": 0, "omap_del": 0 } } ], "throttle-msgr_dispatch_throttler-client": [ { "labels": {}, "counters": { "val": 0, "max": 104857600, "get_started": 0, "get": 122, "get_sum": 485871, "get_or_fail_fail": 0, "get_or_fail_success": 122, "take": 0, "take_sum": 0, "put": 122, "put_sum": 485871, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ], "throttle-msgr_dispatch_throttler-radosclient": [ { "labels": {}, "counters": { "val": 0, "max": 104857600, "get_started": 0, "get": 88, "get_sum": 3004196, "get_or_fail_fail": 0, "get_or_fail_success": 88, "take": 0, "take_sum": 0, "put": 88, "put_sum": 3004196, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ], "throttle-objecter_bytes": [ { "labels": {}, "counters": { "val": 0, "max": 104857600, "get_started": 0, "get": 0, "get_sum": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "take": 0, "take_sum": 0, "put": 0, "put_sum": 0, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ], "throttle-objecter_ops": [ { "labels": {}, "counters": { "val": 0, "max": 1024, "get_started": 0, "get": 0, "get_sum": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "take": 0, "take_sum": 0, "put": 0, "put_sum": 0, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ] } 2024-03-16T07:36:46.031 DEBUG:tasks.cephfs.test_mirroring:adding directory paths 2024-03-16T07:36:46.031 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-03-16T07:36:46.031 DEBUG:teuthology.orchestra.run.smithi049:counter dump for fs: cephfs> ceph --admin-daemon /var/run/ceph/cephfs-mirror.asok counter dump 2024-03-16T07:36:46.137 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-03-16T07:36:46.137 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker": [ 2024-03-16T07:36:46.137 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:36:46.137 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:36:46.137 INFO:teuthology.orchestra.run.smithi049.stdout: "id": "0" 2024-03-16T07:36:46.137 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:36:46.137 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:36:46.138 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_ready_timeouts": 0, 2024-03-16T07:36:46.138 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_idle_timeouts": 0 2024-03-16T07:36:46.138 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:36:46.138 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:36:46.138 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:36:46.138 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:36:46.138 INFO:teuthology.orchestra.run.smithi049.stdout: "id": "1" 2024-03-16T07:36:46.138 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:36:46.138 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:36:46.138 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_ready_timeouts": 0, 2024-03-16T07:36:46.138 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_idle_timeouts": 0 2024-03-16T07:36:46.138 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:36:46.138 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:36:46.138 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:36:46.139 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:36:46.139 INFO:teuthology.orchestra.run.smithi049.stdout: "id": "2" 2024-03-16T07:36:46.139 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:36:46.139 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:36:46.139 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_ready_timeouts": 0, 2024-03-16T07:36:46.139 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_idle_timeouts": 0 2024-03-16T07:36:46.139 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:36:46.139 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:36:46.139 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:36:46.139 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-0": [ 2024-03-16T07:36:46.139 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:36:46.139 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:36:46.139 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:36:46.139 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 13, 2024-03-16T07:36:46.139 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 148, 2024-03-16T07:36:46.139 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 1872, 2024-03-16T07:36:46.139 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 1059728, 2024-03-16T07:36:46.140 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 26, 2024-03-16T07:36:46.140 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 5, 2024-03-16T07:36:46.140 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 0.378049609, 2024-03-16T07:36:46.140 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.151486313, 2024-03-16T07:36:46.140 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 0.173849705, 2024-03-16T07:36:46.140 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-03-16T07:36:46.140 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T07:36:46.140 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 136, 2024-03-16T07:36:46.140 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.214657175, 2024-03-16T07:36:46.140 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.001578361 2024-03-16T07:36:46.140 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:36:46.140 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-03-16T07:36:46.140 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:36:46.140 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:36:46.140 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:36:46.141 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:36:46.141 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 1872, 2024-03-16T07:36:46.141 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 1059728 2024-03-16T07:36:46.141 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:36:46.141 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:36:46.141 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:36:46.141 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-1": [ 2024-03-16T07:36:46.141 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:36:46.141 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:36:46.141 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:36:46.141 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 122, 2024-03-16T07:36:46.141 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 9, 2024-03-16T07:36:46.141 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 502432, 2024-03-16T07:36:46.141 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 1776, 2024-03-16T07:36:46.141 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 4, 2024-03-16T07:36:46.141 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 0, 2024-03-16T07:36:46.141 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 0.746561940, 2024-03-16T07:36:46.142 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.050489909, 2024-03-16T07:36:46.142 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 0.478247304, 2024-03-16T07:36:46.142 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.191550009, 2024-03-16T07:36:46.142 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T07:36:46.142 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 8, 2024-03-16T07:36:46.142 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.187770743, 2024-03-16T07:36:46.142 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.023471342 2024-03-16T07:36:46.142 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:36:46.142 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-03-16T07:36:46.142 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:36:46.142 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:36:46.142 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:36:46.142 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:36:46.143 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 502432, 2024-03-16T07:36:46.143 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 1776 2024-03-16T07:36:46.143 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:36:46.143 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:36:46.143 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:36:46.143 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-2": [ 2024-03-16T07:36:46.143 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:36:46.143 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:36:46.143 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:36:46.143 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 78, 2024-03-16T07:36:46.143 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 12, 2024-03-16T07:36:46.143 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 3015168, 2024-03-16T07:36:46.143 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 2240, 2024-03-16T07:36:46.143 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 3, 2024-03-16T07:36:46.143 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 1, 2024-03-16T07:36:46.144 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 1.705736594, 2024-03-16T07:36:46.144 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.015157158, 2024-03-16T07:36:46.144 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 3.070442058, 2024-03-16T07:36:46.144 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-03-16T07:36:46.144 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T07:36:46.144 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 11, 2024-03-16T07:36:46.144 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.346048562, 2024-03-16T07:36:46.144 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.031458960 2024-03-16T07:36:46.144 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:36:46.144 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-03-16T07:36:46.144 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:36:46.144 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:36:46.144 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:36:46.144 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:36:46.144 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 3015168, 2024-03-16T07:36:46.145 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 2240 2024-03-16T07:36:46.145 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:36:46.145 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:36:46.145 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:36:46.145 INFO:teuthology.orchestra.run.smithi049.stdout: "cct": [ 2024-03-16T07:36:46.145 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:36:46.145 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:36:46.145 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:36:46.145 INFO:teuthology.orchestra.run.smithi049.stdout: "total_workers": 0, 2024-03-16T07:36:46.145 INFO:teuthology.orchestra.run.smithi049.stdout: "unhealthy_workers": 0 2024-03-16T07:36:46.145 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:36:46.145 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:36:46.145 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:36:46.145 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs_mirror": [ 2024-03-16T07:36:46.145 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:36:46.145 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:36:46.146 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:36:46.146 INFO:teuthology.orchestra.run.smithi049.stdout: "mirrored_filesystems": 2, 2024-03-16T07:36:46.146 INFO:teuthology.orchestra.run.smithi049.stdout: "mirror_enable_failures": 0 2024-03-16T07:36:46.146 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:36:46.146 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:36:46.146 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:36:46.146 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs_mirror_mirrored_filesystems": [ 2024-03-16T07:36:46.146 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:36:46.146 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:36:46.146 INFO:teuthology.orchestra.run.smithi049.stdout: "filesystem": "cephfs" 2024-03-16T07:36:46.146 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:36:46.146 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:36:46.146 INFO:teuthology.orchestra.run.smithi049.stdout: "mirroring_peers": 0, 2024-03-16T07:36:46.147 INFO:teuthology.orchestra.run.smithi049.stdout: "directory_count": 0 2024-03-16T07:36:46.147 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:36:46.147 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:36:46.147 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:36:46.147 INFO:teuthology.orchestra.run.smithi049.stdout: "mempool": [ 2024-03-16T07:36:46.147 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:36:46.147 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:36:46.147 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:36:46.147 INFO:teuthology.orchestra.run.smithi049.stdout: "bloom_filter_bytes": 0, 2024-03-16T07:36:46.147 INFO:teuthology.orchestra.run.smithi049.stdout: "bloom_filter_items": 0, 2024-03-16T07:36:46.147 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_alloc_bytes": 0, 2024-03-16T07:36:46.147 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_alloc_items": 0, 2024-03-16T07:36:46.147 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_data_bytes": 0, 2024-03-16T07:36:46.148 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_data_items": 0, 2024-03-16T07:36:46.148 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_onode_bytes": 0, 2024-03-16T07:36:46.148 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_onode_items": 0, 2024-03-16T07:36:46.148 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_meta_bytes": 0, 2024-03-16T07:36:46.148 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_meta_items": 0, 2024-03-16T07:36:46.148 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_other_bytes": 0, 2024-03-16T07:36:46.148 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_other_items": 0, 2024-03-16T07:36:46.148 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_buffer_bytes": 0, 2024-03-16T07:36:46.148 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_buffer_items": 0, 2024-03-16T07:36:46.148 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_extent_bytes": 0, 2024-03-16T07:36:46.148 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_extent_items": 0, 2024-03-16T07:36:46.148 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_blob_bytes": 0, 2024-03-16T07:36:46.148 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_blob_items": 0, 2024-03-16T07:36:46.148 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_shared_blob_bytes": 0, 2024-03-16T07:36:46.149 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_shared_blob_items": 0, 2024-03-16T07:36:46.149 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_inline_bl_bytes": 0, 2024-03-16T07:36:46.149 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_inline_bl_items": 0, 2024-03-16T07:36:46.149 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_fsck_bytes": 0, 2024-03-16T07:36:46.149 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_fsck_items": 0, 2024-03-16T07:36:46.149 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_txc_bytes": 0, 2024-03-16T07:36:46.149 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_txc_items": 0, 2024-03-16T07:36:46.149 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_deferred_bytes": 0, 2024-03-16T07:36:46.149 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_deferred_items": 0, 2024-03-16T07:36:46.149 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_bytes": 0, 2024-03-16T07:36:46.149 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_items": 0, 2024-03-16T07:36:46.149 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_bytes": 0, 2024-03-16T07:36:46.149 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_items": 0, 2024-03-16T07:36:46.149 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_reader_bytes": 0, 2024-03-16T07:36:46.149 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_reader_items": 0, 2024-03-16T07:36:46.149 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_writer_bytes": 0, 2024-03-16T07:36:46.150 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_writer_items": 0, 2024-03-16T07:36:46.150 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_anon_bytes": 182461, 2024-03-16T07:36:46.150 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_anon_items": 55, 2024-03-16T07:36:46.150 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_meta_bytes": 0, 2024-03-16T07:36:46.150 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_meta_items": 0, 2024-03-16T07:36:46.150 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_bytes": 0, 2024-03-16T07:36:46.150 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_items": 0, 2024-03-16T07:36:46.150 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_mapbl_bytes": 0, 2024-03-16T07:36:46.150 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_mapbl_items": 0, 2024-03-16T07:36:46.150 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pglog_bytes": 0, 2024-03-16T07:36:46.150 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pglog_items": 0, 2024-03-16T07:36:46.150 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_bytes": 19336, 2024-03-16T07:36:46.150 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_items": 192, 2024-03-16T07:36:46.150 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_mapping_bytes": 0, 2024-03-16T07:36:46.151 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_mapping_items": 0, 2024-03-16T07:36:46.151 INFO:teuthology.orchestra.run.smithi049.stdout: "pgmap_bytes": 0, 2024-03-16T07:36:46.151 INFO:teuthology.orchestra.run.smithi049.stdout: "pgmap_items": 0, 2024-03-16T07:36:46.151 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_co_bytes": 0, 2024-03-16T07:36:46.151 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_co_items": 0, 2024-03-16T07:36:46.151 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_1_bytes": 0, 2024-03-16T07:36:46.151 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_1_items": 0, 2024-03-16T07:36:46.151 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_2_bytes": 0, 2024-03-16T07:36:46.151 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_2_items": 0 2024-03-16T07:36:46.151 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:36:46.151 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:36:46.151 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:36:46.151 INFO:teuthology.orchestra.run.smithi049.stdout: "objecter": [ 2024-03-16T07:36:46.151 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:36:46.151 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:36:46.151 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:36:46.152 INFO:teuthology.orchestra.run.smithi049.stdout: "op_active": 0, 2024-03-16T07:36:46.152 INFO:teuthology.orchestra.run.smithi049.stdout: "op_laggy": 0, 2024-03-16T07:36:46.152 INFO:teuthology.orchestra.run.smithi049.stdout: "op_send": 0, 2024-03-16T07:36:46.152 INFO:teuthology.orchestra.run.smithi049.stdout: "op_send_bytes": 0, 2024-03-16T07:36:46.152 INFO:teuthology.orchestra.run.smithi049.stdout: "op_resend": 0, 2024-03-16T07:36:46.152 INFO:teuthology.orchestra.run.smithi049.stdout: "op_reply": 0, 2024-03-16T07:36:46.152 INFO:teuthology.orchestra.run.smithi049.stdout: "op_latency": { 2024-03-16T07:36:46.152 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:36:46.152 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:36:46.152 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:36:46.152 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:36:46.152 INFO:teuthology.orchestra.run.smithi049.stdout: "op_inflight": 0, 2024-03-16T07:36:46.152 INFO:teuthology.orchestra.run.smithi049.stdout: "oplen_avg": { 2024-03-16T07:36:46.152 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:36:46.153 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0 2024-03-16T07:36:46.153 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:36:46.153 INFO:teuthology.orchestra.run.smithi049.stdout: "op": 0, 2024-03-16T07:36:46.153 INFO:teuthology.orchestra.run.smithi049.stdout: "op_r": 0, 2024-03-16T07:36:46.153 INFO:teuthology.orchestra.run.smithi049.stdout: "op_w": 0, 2024-03-16T07:36:46.153 INFO:teuthology.orchestra.run.smithi049.stdout: "op_rmw": 0, 2024-03-16T07:36:46.153 INFO:teuthology.orchestra.run.smithi049.stdout: "op_pg": 0, 2024-03-16T07:36:46.153 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_stat": 0, 2024-03-16T07:36:46.153 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_create": 0, 2024-03-16T07:36:46.153 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_read": 0, 2024-03-16T07:36:46.153 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_write": 0, 2024-03-16T07:36:46.153 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_writefull": 0, 2024-03-16T07:36:46.153 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_writesame": 0, 2024-03-16T07:36:46.154 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_append": 0, 2024-03-16T07:36:46.154 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_zero": 0, 2024-03-16T07:36:46.154 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_truncate": 0, 2024-03-16T07:36:46.154 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_delete": 0, 2024-03-16T07:36:46.154 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_mapext": 0, 2024-03-16T07:36:46.154 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_sparse_read": 0, 2024-03-16T07:36:46.154 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_clonerange": 0, 2024-03-16T07:36:46.154 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_getxattr": 0, 2024-03-16T07:36:46.154 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_setxattr": 0, 2024-03-16T07:36:46.154 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_cmpxattr": 0, 2024-03-16T07:36:46.154 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_rmxattr": 0, 2024-03-16T07:36:46.154 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_resetxattrs": 0, 2024-03-16T07:36:46.154 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_call": 0, 2024-03-16T07:36:46.154 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_watch": 0, 2024-03-16T07:36:46.155 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_notify": 0, 2024-03-16T07:36:46.155 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_src_cmpxattr": 0, 2024-03-16T07:36:46.155 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_pgls": 0, 2024-03-16T07:36:46.155 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_pgls_filter": 0, 2024-03-16T07:36:46.155 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_other": 0, 2024-03-16T07:36:46.155 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_active": 0, 2024-03-16T07:36:46.155 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_send": 0, 2024-03-16T07:36:46.155 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_resend": 0, 2024-03-16T07:36:46.155 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_ping": 0, 2024-03-16T07:36:46.155 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_active": 0, 2024-03-16T07:36:46.155 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_send": 0, 2024-03-16T07:36:46.155 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_resend": 0, 2024-03-16T07:36:46.155 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_active": 0, 2024-03-16T07:36:46.155 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_send": 0, 2024-03-16T07:36:46.156 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_resend": 0, 2024-03-16T07:36:46.156 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_active": 0, 2024-03-16T07:36:46.156 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_send": 0, 2024-03-16T07:36:46.156 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_resend": 0, 2024-03-16T07:36:46.156 INFO:teuthology.orchestra.run.smithi049.stdout: "command_active": 0, 2024-03-16T07:36:46.156 INFO:teuthology.orchestra.run.smithi049.stdout: "command_send": 0, 2024-03-16T07:36:46.156 INFO:teuthology.orchestra.run.smithi049.stdout: "command_resend": 0, 2024-03-16T07:36:46.156 INFO:teuthology.orchestra.run.smithi049.stdout: "map_epoch": 0, 2024-03-16T07:36:46.156 INFO:teuthology.orchestra.run.smithi049.stdout: "map_full": 0, 2024-03-16T07:36:46.156 INFO:teuthology.orchestra.run.smithi049.stdout: "map_inc": 0, 2024-03-16T07:36:46.156 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_sessions": 0, 2024-03-16T07:36:46.156 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_session_open": 0, 2024-03-16T07:36:46.156 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_session_close": 0, 2024-03-16T07:36:46.156 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_laggy": 0, 2024-03-16T07:36:46.157 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_wr": 0, 2024-03-16T07:36:46.157 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_rd": 0, 2024-03-16T07:36:46.157 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_del": 0 2024-03-16T07:36:46.157 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:36:46.157 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:36:46.157 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:36:46.157 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-msgr_dispatch_throttler-client": [ 2024-03-16T07:36:46.157 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:36:46.157 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:36:46.157 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:36:46.157 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:36:46.157 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-03-16T07:36:46.157 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:36:46.157 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 122, 2024-03-16T07:36:46.158 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 485871, 2024-03-16T07:36:46.158 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:36:46.158 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 122, 2024-03-16T07:36:46.158 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:36:46.158 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:36:46.158 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 122, 2024-03-16T07:36:46.158 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 485871, 2024-03-16T07:36:46.158 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:36:46.158 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:36:46.158 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:36:46.158 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:36:46.158 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:36:46.158 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:36:46.158 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:36:46.159 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:36:46.159 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-msgr_dispatch_throttler-radosclient": [ 2024-03-16T07:36:46.159 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:36:46.159 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:36:46.159 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:36:46.159 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:36:46.159 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-03-16T07:36:46.159 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:36:46.159 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 88, 2024-03-16T07:36:46.159 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 3004196, 2024-03-16T07:36:46.159 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:36:46.159 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 88, 2024-03-16T07:36:46.159 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:36:46.159 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:36:46.159 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 88, 2024-03-16T07:36:46.160 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 3004196, 2024-03-16T07:36:46.160 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:36:46.160 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:36:46.160 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:36:46.160 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:36:46.160 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:36:46.160 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:36:46.160 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:36:46.160 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:36:46.160 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-objecter_bytes": [ 2024-03-16T07:36:46.160 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:36:46.160 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:36:46.160 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:36:46.160 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:36:46.160 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-03-16T07:36:46.160 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:36:46.161 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 0, 2024-03-16T07:36:46.161 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 0, 2024-03-16T07:36:46.161 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:36:46.161 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 0, 2024-03-16T07:36:46.161 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:36:46.161 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:36:46.161 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 0, 2024-03-16T07:36:46.161 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 0, 2024-03-16T07:36:46.161 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:36:46.161 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:36:46.161 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:36:46.161 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:36:46.161 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:36:46.161 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:36:46.161 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:36:46.161 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:36:46.162 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-objecter_ops": [ 2024-03-16T07:36:46.162 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:36:46.162 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:36:46.162 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:36:46.162 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:36:46.162 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 1024, 2024-03-16T07:36:46.162 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:36:46.162 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 0, 2024-03-16T07:36:46.162 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 0, 2024-03-16T07:36:46.162 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:36:46.162 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 0, 2024-03-16T07:36:46.162 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:36:46.162 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:36:46.162 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 0, 2024-03-16T07:36:46.162 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 0, 2024-03-16T07:36:46.162 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:36:46.163 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:36:46.163 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:36:46.163 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:36:46.163 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:36:46.163 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:36:46.163 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:36:46.163 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2024-03-16T07:36:46.163 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-03-16T07:36:46.164 DEBUG:tasks.cephfs.test_mirroring:command returned={ "AsyncMessenger::Worker": [ { "labels": { "id": "0" }, "counters": { "msgr_connection_ready_timeouts": 0, "msgr_connection_idle_timeouts": 0 } }, { "labels": { "id": "1" }, "counters": { "msgr_connection_ready_timeouts": 0, "msgr_connection_idle_timeouts": 0 } }, { "labels": { "id": "2" }, "counters": { "msgr_connection_ready_timeouts": 0, "msgr_connection_idle_timeouts": 0 } } ], "AsyncMessenger::Worker-0": [ { "labels": {}, "counters": { "msgr_recv_messages": 13, "msgr_send_messages": 148, "msgr_recv_bytes": 1872, "msgr_send_bytes": 1059728, "msgr_created_connections": 26, "msgr_active_connections": 5, "msgr_running_total_time": 0.378049609, "msgr_running_send_time": 0.151486313, "msgr_running_recv_time": 0.173849705, "msgr_running_fast_dispatch_time": 0.000000000, "msgr_send_messages_queue_lat": { "avgcount": 136, "sum": 0.214657175, "avgtime": 0.001578361 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "msgr_recv_encrypted_bytes": 1872, "msgr_send_encrypted_bytes": 1059728 } } ], "AsyncMessenger::Worker-1": [ { "labels": {}, "counters": { "msgr_recv_messages": 122, "msgr_send_messages": 9, "msgr_recv_bytes": 502432, "msgr_send_bytes": 1776, "msgr_created_connections": 4, "msgr_active_connections": 0, "msgr_running_total_time": 0.746561940, "msgr_running_send_time": 0.050489909, "msgr_running_recv_time": 0.478247304, "msgr_running_fast_dispatch_time": 0.191550009, "msgr_send_messages_queue_lat": { "avgcount": 8, "sum": 0.187770743, "avgtime": 0.023471342 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "msgr_recv_encrypted_bytes": 502432, "msgr_send_encrypted_bytes": 1776 } } ], "AsyncMessenger::Worker-2": [ { "labels": {}, "counters": { "msgr_recv_messages": 78, "msgr_send_messages": 12, "msgr_recv_bytes": 3015168, "msgr_send_bytes": 2240, "msgr_created_connections": 3, "msgr_active_connections": 1, "msgr_running_total_time": 1.705736594, "msgr_running_send_time": 0.015157158, "msgr_running_recv_time": 3.070442058, "msgr_running_fast_dispatch_time": 0.000000000, "msgr_send_messages_queue_lat": { "avgcount": 11, "sum": 0.346048562, "avgtime": 0.031458960 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "msgr_recv_encrypted_bytes": 3015168, "msgr_send_encrypted_bytes": 2240 } } ], "cct": [ { "labels": {}, "counters": { "total_workers": 0, "unhealthy_workers": 0 } } ], "cephfs_mirror": [ { "labels": {}, "counters": { "mirrored_filesystems": 2, "mirror_enable_failures": 0 } } ], "cephfs_mirror_mirrored_filesystems": [ { "labels": { "filesystem": "cephfs" }, "counters": { "mirroring_peers": 0, "directory_count": 0 } } ], "mempool": [ { "labels": {}, "counters": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_cache_buffer_bytes": 0, "bluestore_cache_buffer_items": 0, "bluestore_extent_bytes": 0, "bluestore_extent_items": 0, "bluestore_blob_bytes": 0, "bluestore_blob_items": 0, "bluestore_shared_blob_bytes": 0, "bluestore_shared_blob_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_items": 0, "bluefs_bytes": 0, "bluefs_items": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "buffer_anon_bytes": 182461, "buffer_anon_items": 55, "buffer_meta_bytes": 0, "buffer_meta_items": 0, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 19336, "osdmap_items": 192, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "mds_co_bytes": 0, "mds_co_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 } } ], "objecter": [ { "labels": {}, "counters": { "op_active": 0, "op_laggy": 0, "op_send": 0, "op_send_bytes": 0, "op_resend": 0, "op_reply": 0, "op_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "op_inflight": 0, "oplen_avg": { "avgcount": 0, "sum": 0 }, "op": 0, "op_r": 0, "op_w": 0, "op_rmw": 0, "op_pg": 0, "osdop_stat": 0, "osdop_create": 0, "osdop_read": 0, "osdop_write": 0, "osdop_writefull": 0, "osdop_writesame": 0, "osdop_append": 0, "osdop_zero": 0, "osdop_truncate": 0, "osdop_delete": 0, "osdop_mapext": 0, "osdop_sparse_read": 0, "osdop_clonerange": 0, "osdop_getxattr": 0, "osdop_setxattr": 0, "osdop_cmpxattr": 0, "osdop_rmxattr": 0, "osdop_resetxattrs": 0, "osdop_call": 0, "osdop_watch": 0, "osdop_notify": 0, "osdop_src_cmpxattr": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_other": 0, "linger_active": 0, "linger_send": 0, "linger_resend": 0, "linger_ping": 0, "poolop_active": 0, "poolop_send": 0, "poolop_resend": 0, "poolstat_active": 0, "poolstat_send": 0, "poolstat_resend": 0, "statfs_active": 0, "statfs_send": 0, "statfs_resend": 0, "command_active": 0, "command_send": 0, "command_resend": 0, "map_epoch": 0, "map_full": 0, "map_inc": 0, "osd_sessions": 0, "osd_session_open": 0, "osd_session_close": 0, "osd_laggy": 0, "omap_wr": 0, "omap_rd": 0, "omap_del": 0 } } ], "throttle-msgr_dispatch_throttler-client": [ { "labels": {}, "counters": { "val": 0, "max": 104857600, "get_started": 0, "get": 122, "get_sum": 485871, "get_or_fail_fail": 0, "get_or_fail_success": 122, "take": 0, "take_sum": 0, "put": 122, "put_sum": 485871, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ], "throttle-msgr_dispatch_throttler-radosclient": [ { "labels": {}, "counters": { "val": 0, "max": 104857600, "get_started": 0, "get": 88, "get_sum": 3004196, "get_or_fail_fail": 0, "get_or_fail_success": 88, "take": 0, "take_sum": 0, "put": 88, "put_sum": 3004196, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ], "throttle-objecter_bytes": [ { "labels": {}, "counters": { "val": 0, "max": 104857600, "get_started": 0, "get": 0, "get_sum": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "take": 0, "take_sum": 0, "put": 0, "put_sum": 0, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ], "throttle-objecter_ops": [ { "labels": {}, "counters": { "val": 0, "max": 1024, "get_started": 0, "get": 0, "get_sum": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "take": 0, "take_sum": 0, "put": 0, "put_sum": 0, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ] } 2024-03-16T07:36:46.164 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-03-16T07:36:46.164 DEBUG:teuthology.orchestra.run.smithi049:mirror status for fs: cephfs> ceph --admin-daemon /var/run/ceph/cephfs-mirror.asok fs mirror status cephfs@14 2024-03-16T07:36:46.302 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-03-16T07:36:46.303 INFO:teuthology.orchestra.run.smithi049.stdout: "rados_inst": "172.21.15.49:0/1186634239", 2024-03-16T07:36:46.303 INFO:teuthology.orchestra.run.smithi049.stdout: "peers": {}, 2024-03-16T07:36:46.303 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_dirs": { 2024-03-16T07:36:46.303 INFO:teuthology.orchestra.run.smithi049.stdout: "dir_count": 0 2024-03-16T07:36:46.303 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:36:46.303 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-03-16T07:36:46.310 DEBUG:tasks.cephfs.test_mirroring:command returned={ "rados_inst": "172.21.15.49:0/1186634239", "peers": {}, "snap_dirs": { "dir_count": 0 } } 2024-03-16T07:36:46.310 DEBUG:tasks.cephfs.test_mirroring:initial dir_count=0 2024-03-16T07:36:46.311 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snapshot mirror add cephfs /d0 2024-03-16T07:36:46.690 INFO:teuthology.orchestra.run.smithi049.stdout:{} 2024-03-16T07:36:56.708 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-03-16T07:36:56.708 DEBUG:teuthology.orchestra.run.smithi049:mirror status for fs: cephfs> ceph --admin-daemon /var/run/ceph/cephfs-mirror.asok fs mirror status cephfs@14 2024-03-16T07:36:56.822 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-03-16T07:36:56.822 INFO:teuthology.orchestra.run.smithi049.stdout: "rados_inst": "172.21.15.49:0/1186634239", 2024-03-16T07:36:56.822 INFO:teuthology.orchestra.run.smithi049.stdout: "peers": {}, 2024-03-16T07:36:56.822 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_dirs": { 2024-03-16T07:36:56.822 INFO:teuthology.orchestra.run.smithi049.stdout: "dir_count": 1 2024-03-16T07:36:56.822 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:36:56.822 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-03-16T07:36:56.829 DEBUG:tasks.cephfs.test_mirroring:command returned={ "rados_inst": "172.21.15.49:0/1186634239", "peers": {}, "snap_dirs": { "dir_count": 1 } } 2024-03-16T07:36:56.830 DEBUG:tasks.cephfs.test_mirroring:new dir_count=1 2024-03-16T07:36:56.830 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-03-16T07:36:56.830 DEBUG:teuthology.orchestra.run.smithi049:counter dump for fs: cephfs> ceph --admin-daemon /var/run/ceph/cephfs-mirror.asok counter dump 2024-03-16T07:36:56.935 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-03-16T07:36:56.935 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker": [ 2024-03-16T07:36:56.935 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:36:56.936 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:36:56.936 INFO:teuthology.orchestra.run.smithi049.stdout: "id": "0" 2024-03-16T07:36:56.936 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:36:56.936 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:36:56.936 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_ready_timeouts": 0, 2024-03-16T07:36:56.936 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_idle_timeouts": 0 2024-03-16T07:36:56.936 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:36:56.936 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:36:56.936 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:36:56.936 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:36:56.936 INFO:teuthology.orchestra.run.smithi049.stdout: "id": "1" 2024-03-16T07:36:56.936 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:36:56.936 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:36:56.936 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_ready_timeouts": 0, 2024-03-16T07:36:56.936 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_idle_timeouts": 0 2024-03-16T07:36:56.936 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:36:56.937 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:36:56.937 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:36:56.937 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:36:56.937 INFO:teuthology.orchestra.run.smithi049.stdout: "id": "2" 2024-03-16T07:36:56.937 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:36:56.937 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:36:56.937 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_ready_timeouts": 0, 2024-03-16T07:36:56.937 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_idle_timeouts": 0 2024-03-16T07:36:56.937 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:36:56.937 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:36:56.937 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:36:56.937 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-0": [ 2024-03-16T07:36:56.937 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:36:56.937 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:36:56.937 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:36:56.937 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 13, 2024-03-16T07:36:56.937 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 150, 2024-03-16T07:36:56.938 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 1872, 2024-03-16T07:36:56.938 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 1060288, 2024-03-16T07:36:56.938 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 26, 2024-03-16T07:36:56.938 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 5, 2024-03-16T07:36:56.938 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 0.379028571, 2024-03-16T07:36:56.938 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.152386882, 2024-03-16T07:36:56.938 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 0.173849705, 2024-03-16T07:36:56.938 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-03-16T07:36:56.938 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T07:36:56.938 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 138, 2024-03-16T07:36:56.938 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.215024751, 2024-03-16T07:36:56.938 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.001558150 2024-03-16T07:36:56.938 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:36:56.938 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-03-16T07:36:56.939 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:36:56.939 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:36:56.939 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:36:56.939 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:36:56.939 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 1872, 2024-03-16T07:36:56.939 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 1060288 2024-03-16T07:36:56.939 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:36:56.939 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:36:56.939 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:36:56.939 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-1": [ 2024-03-16T07:36:56.939 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:36:56.939 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:36:56.939 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:36:56.939 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 122, 2024-03-16T07:36:56.939 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 9, 2024-03-16T07:36:56.940 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 502432, 2024-03-16T07:36:56.940 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 1776, 2024-03-16T07:36:56.940 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 4, 2024-03-16T07:36:56.940 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 0, 2024-03-16T07:36:56.940 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 0.747249292, 2024-03-16T07:36:56.940 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.050702703, 2024-03-16T07:36:56.940 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 0.478504399, 2024-03-16T07:36:56.940 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.191550009, 2024-03-16T07:36:56.940 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T07:36:56.940 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 8, 2024-03-16T07:36:56.940 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.187770743, 2024-03-16T07:36:56.940 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.023471342 2024-03-16T07:36:56.940 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:36:56.940 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-03-16T07:36:56.940 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:36:56.940 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:36:56.941 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:36:56.941 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:36:56.941 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 502432, 2024-03-16T07:36:56.941 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 1776 2024-03-16T07:36:56.941 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:36:56.941 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:36:56.941 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:36:56.941 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-2": [ 2024-03-16T07:36:56.941 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:36:56.941 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:36:56.941 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:36:56.941 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 78, 2024-03-16T07:36:56.941 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 12, 2024-03-16T07:36:56.941 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 3015168, 2024-03-16T07:36:56.941 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 2240, 2024-03-16T07:36:56.941 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 3, 2024-03-16T07:36:56.941 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 1, 2024-03-16T07:36:56.942 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 1.706300595, 2024-03-16T07:36:56.942 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.015250978, 2024-03-16T07:36:56.942 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 3.070570176, 2024-03-16T07:36:56.942 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-03-16T07:36:56.942 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T07:36:56.942 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 11, 2024-03-16T07:36:56.942 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.346048562, 2024-03-16T07:36:56.942 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.031458960 2024-03-16T07:36:56.942 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:36:56.942 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-03-16T07:36:56.942 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:36:56.942 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:36:56.942 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:36:56.942 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:36:56.942 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 3015168, 2024-03-16T07:36:56.943 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 2240 2024-03-16T07:36:56.943 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:36:56.943 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:36:56.943 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:36:56.943 INFO:teuthology.orchestra.run.smithi049.stdout: "cct": [ 2024-03-16T07:36:56.943 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:36:56.943 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:36:56.943 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:36:56.943 INFO:teuthology.orchestra.run.smithi049.stdout: "total_workers": 0, 2024-03-16T07:36:56.943 INFO:teuthology.orchestra.run.smithi049.stdout: "unhealthy_workers": 0 2024-03-16T07:36:56.943 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:36:56.943 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:36:56.943 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:36:56.943 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs_mirror": [ 2024-03-16T07:36:56.943 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:36:56.943 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:36:56.944 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:36:56.944 INFO:teuthology.orchestra.run.smithi049.stdout: "mirrored_filesystems": 2, 2024-03-16T07:36:56.944 INFO:teuthology.orchestra.run.smithi049.stdout: "mirror_enable_failures": 0 2024-03-16T07:36:56.944 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:36:56.944 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:36:56.944 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:36:56.944 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs_mirror_mirrored_filesystems": [ 2024-03-16T07:36:56.944 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:36:56.944 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:36:56.944 INFO:teuthology.orchestra.run.smithi049.stdout: "filesystem": "cephfs" 2024-03-16T07:36:56.944 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:36:56.944 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:36:56.944 INFO:teuthology.orchestra.run.smithi049.stdout: "mirroring_peers": 0, 2024-03-16T07:36:56.944 INFO:teuthology.orchestra.run.smithi049.stdout: "directory_count": 1 2024-03-16T07:36:56.944 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:36:56.944 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:36:56.945 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:36:56.945 INFO:teuthology.orchestra.run.smithi049.stdout: "mempool": [ 2024-03-16T07:36:56.945 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:36:56.945 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:36:56.945 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:36:56.945 INFO:teuthology.orchestra.run.smithi049.stdout: "bloom_filter_bytes": 0, 2024-03-16T07:36:56.945 INFO:teuthology.orchestra.run.smithi049.stdout: "bloom_filter_items": 0, 2024-03-16T07:36:56.945 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_alloc_bytes": 0, 2024-03-16T07:36:56.945 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_alloc_items": 0, 2024-03-16T07:36:56.945 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_data_bytes": 0, 2024-03-16T07:36:56.945 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_data_items": 0, 2024-03-16T07:36:56.945 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_onode_bytes": 0, 2024-03-16T07:36:56.945 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_onode_items": 0, 2024-03-16T07:36:56.945 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_meta_bytes": 0, 2024-03-16T07:36:56.945 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_meta_items": 0, 2024-03-16T07:36:56.945 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_other_bytes": 0, 2024-03-16T07:36:56.945 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_other_items": 0, 2024-03-16T07:36:56.946 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_buffer_bytes": 0, 2024-03-16T07:36:56.946 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_buffer_items": 0, 2024-03-16T07:36:56.946 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_extent_bytes": 0, 2024-03-16T07:36:56.946 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_extent_items": 0, 2024-03-16T07:36:56.946 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_blob_bytes": 0, 2024-03-16T07:36:56.946 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_blob_items": 0, 2024-03-16T07:36:56.946 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_shared_blob_bytes": 0, 2024-03-16T07:36:56.946 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_shared_blob_items": 0, 2024-03-16T07:36:56.946 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_inline_bl_bytes": 0, 2024-03-16T07:36:56.946 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_inline_bl_items": 0, 2024-03-16T07:36:56.946 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_fsck_bytes": 0, 2024-03-16T07:36:56.946 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_fsck_items": 0, 2024-03-16T07:36:56.946 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_txc_bytes": 0, 2024-03-16T07:36:56.946 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_txc_items": 0, 2024-03-16T07:36:56.946 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_deferred_bytes": 0, 2024-03-16T07:36:56.947 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_deferred_items": 0, 2024-03-16T07:36:56.947 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_bytes": 0, 2024-03-16T07:36:56.947 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_items": 0, 2024-03-16T07:36:56.947 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_bytes": 0, 2024-03-16T07:36:56.947 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_items": 0, 2024-03-16T07:36:56.947 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_reader_bytes": 0, 2024-03-16T07:36:56.947 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_reader_items": 0, 2024-03-16T07:36:56.947 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_writer_bytes": 0, 2024-03-16T07:36:56.947 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_writer_items": 0, 2024-03-16T07:36:56.947 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_anon_bytes": 182461, 2024-03-16T07:36:56.947 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_anon_items": 55, 2024-03-16T07:36:56.947 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_meta_bytes": 0, 2024-03-16T07:36:56.947 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_meta_items": 0, 2024-03-16T07:36:56.947 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_bytes": 0, 2024-03-16T07:36:56.947 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_items": 0, 2024-03-16T07:36:56.947 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_mapbl_bytes": 0, 2024-03-16T07:36:56.948 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_mapbl_items": 0, 2024-03-16T07:36:56.948 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pglog_bytes": 0, 2024-03-16T07:36:56.948 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pglog_items": 0, 2024-03-16T07:36:56.948 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_bytes": 19336, 2024-03-16T07:36:56.948 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_items": 192, 2024-03-16T07:36:56.948 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_mapping_bytes": 0, 2024-03-16T07:36:56.948 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_mapping_items": 0, 2024-03-16T07:36:56.948 INFO:teuthology.orchestra.run.smithi049.stdout: "pgmap_bytes": 0, 2024-03-16T07:36:56.948 INFO:teuthology.orchestra.run.smithi049.stdout: "pgmap_items": 0, 2024-03-16T07:36:56.948 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_co_bytes": 0, 2024-03-16T07:36:56.948 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_co_items": 0, 2024-03-16T07:36:56.948 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_1_bytes": 0, 2024-03-16T07:36:56.948 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_1_items": 0, 2024-03-16T07:36:56.948 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_2_bytes": 0, 2024-03-16T07:36:56.948 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_2_items": 0 2024-03-16T07:36:56.948 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:36:56.949 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:36:56.949 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:36:56.949 INFO:teuthology.orchestra.run.smithi049.stdout: "objecter": [ 2024-03-16T07:36:56.949 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:36:56.949 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:36:56.949 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:36:56.949 INFO:teuthology.orchestra.run.smithi049.stdout: "op_active": 0, 2024-03-16T07:36:56.949 INFO:teuthology.orchestra.run.smithi049.stdout: "op_laggy": 0, 2024-03-16T07:36:56.949 INFO:teuthology.orchestra.run.smithi049.stdout: "op_send": 0, 2024-03-16T07:36:56.949 INFO:teuthology.orchestra.run.smithi049.stdout: "op_send_bytes": 0, 2024-03-16T07:36:56.949 INFO:teuthology.orchestra.run.smithi049.stdout: "op_resend": 0, 2024-03-16T07:36:56.949 INFO:teuthology.orchestra.run.smithi049.stdout: "op_reply": 0, 2024-03-16T07:36:56.949 INFO:teuthology.orchestra.run.smithi049.stdout: "op_latency": { 2024-03-16T07:36:56.949 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:36:56.949 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:36:56.950 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:36:56.950 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:36:56.950 INFO:teuthology.orchestra.run.smithi049.stdout: "op_inflight": 0, 2024-03-16T07:36:56.950 INFO:teuthology.orchestra.run.smithi049.stdout: "oplen_avg": { 2024-03-16T07:36:56.950 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:36:56.950 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0 2024-03-16T07:36:56.950 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:36:56.950 INFO:teuthology.orchestra.run.smithi049.stdout: "op": 0, 2024-03-16T07:36:56.950 INFO:teuthology.orchestra.run.smithi049.stdout: "op_r": 0, 2024-03-16T07:36:56.950 INFO:teuthology.orchestra.run.smithi049.stdout: "op_w": 0, 2024-03-16T07:36:56.950 INFO:teuthology.orchestra.run.smithi049.stdout: "op_rmw": 0, 2024-03-16T07:36:56.950 INFO:teuthology.orchestra.run.smithi049.stdout: "op_pg": 0, 2024-03-16T07:36:56.950 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_stat": 0, 2024-03-16T07:36:56.950 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_create": 0, 2024-03-16T07:36:56.950 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_read": 0, 2024-03-16T07:36:56.951 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_write": 0, 2024-03-16T07:36:56.951 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_writefull": 0, 2024-03-16T07:36:56.951 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_writesame": 0, 2024-03-16T07:36:56.951 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_append": 0, 2024-03-16T07:36:56.951 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_zero": 0, 2024-03-16T07:36:56.951 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_truncate": 0, 2024-03-16T07:36:56.951 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_delete": 0, 2024-03-16T07:36:56.951 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_mapext": 0, 2024-03-16T07:36:56.951 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_sparse_read": 0, 2024-03-16T07:36:56.951 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_clonerange": 0, 2024-03-16T07:36:56.951 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_getxattr": 0, 2024-03-16T07:36:56.951 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_setxattr": 0, 2024-03-16T07:36:56.951 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_cmpxattr": 0, 2024-03-16T07:36:56.951 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_rmxattr": 0, 2024-03-16T07:36:56.951 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_resetxattrs": 0, 2024-03-16T07:36:56.951 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_call": 0, 2024-03-16T07:36:56.951 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_watch": 0, 2024-03-16T07:36:56.952 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_notify": 0, 2024-03-16T07:36:56.952 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_src_cmpxattr": 0, 2024-03-16T07:36:56.952 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_pgls": 0, 2024-03-16T07:36:56.952 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_pgls_filter": 0, 2024-03-16T07:36:56.952 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_other": 0, 2024-03-16T07:36:56.952 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_active": 0, 2024-03-16T07:36:56.952 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_send": 0, 2024-03-16T07:36:56.952 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_resend": 0, 2024-03-16T07:36:56.952 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_ping": 0, 2024-03-16T07:36:56.952 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_active": 0, 2024-03-16T07:36:56.952 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_send": 0, 2024-03-16T07:36:56.952 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_resend": 0, 2024-03-16T07:36:56.952 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_active": 0, 2024-03-16T07:36:56.952 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_send": 0, 2024-03-16T07:36:56.952 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_resend": 0, 2024-03-16T07:36:56.952 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_active": 0, 2024-03-16T07:36:56.953 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_send": 0, 2024-03-16T07:36:56.953 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_resend": 0, 2024-03-16T07:36:56.953 INFO:teuthology.orchestra.run.smithi049.stdout: "command_active": 0, 2024-03-16T07:36:56.953 INFO:teuthology.orchestra.run.smithi049.stdout: "command_send": 0, 2024-03-16T07:36:56.953 INFO:teuthology.orchestra.run.smithi049.stdout: "command_resend": 0, 2024-03-16T07:36:56.953 INFO:teuthology.orchestra.run.smithi049.stdout: "map_epoch": 0, 2024-03-16T07:36:56.953 INFO:teuthology.orchestra.run.smithi049.stdout: "map_full": 0, 2024-03-16T07:36:56.953 INFO:teuthology.orchestra.run.smithi049.stdout: "map_inc": 0, 2024-03-16T07:36:56.953 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_sessions": 0, 2024-03-16T07:36:56.953 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_session_open": 0, 2024-03-16T07:36:56.953 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_session_close": 0, 2024-03-16T07:36:56.953 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_laggy": 0, 2024-03-16T07:36:56.953 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_wr": 0, 2024-03-16T07:36:56.953 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_rd": 0, 2024-03-16T07:36:56.953 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_del": 0 2024-03-16T07:36:56.953 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:36:56.953 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:36:56.954 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:36:56.954 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-msgr_dispatch_throttler-client": [ 2024-03-16T07:36:56.954 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:36:56.954 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:36:56.954 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:36:56.954 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:36:56.954 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-03-16T07:36:56.954 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:36:56.954 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 122, 2024-03-16T07:36:56.954 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 485871, 2024-03-16T07:36:56.954 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:36:56.954 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 122, 2024-03-16T07:36:56.954 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:36:56.954 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:36:56.954 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 122, 2024-03-16T07:36:56.955 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 485871, 2024-03-16T07:36:56.955 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:36:56.955 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:36:56.955 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:36:56.955 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:36:56.955 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:36:56.955 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:36:56.955 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:36:56.955 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:36:56.955 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-msgr_dispatch_throttler-radosclient": [ 2024-03-16T07:36:56.955 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:36:56.955 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:36:56.955 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:36:56.955 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:36:56.955 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-03-16T07:36:56.955 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:36:56.955 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 88, 2024-03-16T07:36:56.956 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 3004196, 2024-03-16T07:36:56.956 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:36:56.956 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 88, 2024-03-16T07:36:56.956 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:36:56.956 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:36:56.956 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 88, 2024-03-16T07:36:56.956 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 3004196, 2024-03-16T07:36:56.956 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:36:56.956 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:36:56.956 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:36:56.956 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:36:56.956 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:36:56.956 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:36:56.956 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:36:56.956 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:36:56.956 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-objecter_bytes": [ 2024-03-16T07:36:56.956 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:36:56.956 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:36:56.957 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:36:56.957 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:36:56.957 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-03-16T07:36:56.957 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:36:56.957 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 0, 2024-03-16T07:36:56.957 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 0, 2024-03-16T07:36:56.957 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:36:56.957 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 0, 2024-03-16T07:36:56.957 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:36:56.957 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:36:56.957 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 0, 2024-03-16T07:36:56.957 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 0, 2024-03-16T07:36:56.957 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:36:56.957 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:36:56.957 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:36:56.958 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:36:56.958 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:36:56.958 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:36:56.958 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:36:56.958 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:36:56.958 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-objecter_ops": [ 2024-03-16T07:36:56.958 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:36:56.958 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:36:56.958 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:36:56.958 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:36:56.958 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 1024, 2024-03-16T07:36:56.958 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:36:56.958 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 0, 2024-03-16T07:36:56.958 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 0, 2024-03-16T07:36:56.958 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:36:56.959 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 0, 2024-03-16T07:36:56.959 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:36:56.959 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:36:56.959 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 0, 2024-03-16T07:36:56.959 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 0, 2024-03-16T07:36:56.959 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:36:56.959 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:36:56.959 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:36:56.959 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:36:56.959 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:36:56.959 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:36:56.959 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:36:56.959 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2024-03-16T07:36:56.959 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-03-16T07:36:56.960 DEBUG:tasks.cephfs.test_mirroring:command returned={ "AsyncMessenger::Worker": [ { "labels": { "id": "0" }, "counters": { "msgr_connection_ready_timeouts": 0, "msgr_connection_idle_timeouts": 0 } }, { "labels": { "id": "1" }, "counters": { "msgr_connection_ready_timeouts": 0, "msgr_connection_idle_timeouts": 0 } }, { "labels": { "id": "2" }, "counters": { "msgr_connection_ready_timeouts": 0, "msgr_connection_idle_timeouts": 0 } } ], "AsyncMessenger::Worker-0": [ { "labels": {}, "counters": { "msgr_recv_messages": 13, "msgr_send_messages": 150, "msgr_recv_bytes": 1872, "msgr_send_bytes": 1060288, "msgr_created_connections": 26, "msgr_active_connections": 5, "msgr_running_total_time": 0.379028571, "msgr_running_send_time": 0.152386882, "msgr_running_recv_time": 0.173849705, "msgr_running_fast_dispatch_time": 0.000000000, "msgr_send_messages_queue_lat": { "avgcount": 138, "sum": 0.215024751, "avgtime": 0.001558150 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "msgr_recv_encrypted_bytes": 1872, "msgr_send_encrypted_bytes": 1060288 } } ], "AsyncMessenger::Worker-1": [ { "labels": {}, "counters": { "msgr_recv_messages": 122, "msgr_send_messages": 9, "msgr_recv_bytes": 502432, "msgr_send_bytes": 1776, "msgr_created_connections": 4, "msgr_active_connections": 0, "msgr_running_total_time": 0.747249292, "msgr_running_send_time": 0.050702703, "msgr_running_recv_time": 0.478504399, "msgr_running_fast_dispatch_time": 0.191550009, "msgr_send_messages_queue_lat": { "avgcount": 8, "sum": 0.187770743, "avgtime": 0.023471342 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "msgr_recv_encrypted_bytes": 502432, "msgr_send_encrypted_bytes": 1776 } } ], "AsyncMessenger::Worker-2": [ { "labels": {}, "counters": { "msgr_recv_messages": 78, "msgr_send_messages": 12, "msgr_recv_bytes": 3015168, "msgr_send_bytes": 2240, "msgr_created_connections": 3, "msgr_active_connections": 1, "msgr_running_total_time": 1.706300595, "msgr_running_send_time": 0.015250978, "msgr_running_recv_time": 3.070570176, "msgr_running_fast_dispatch_time": 0.000000000, "msgr_send_messages_queue_lat": { "avgcount": 11, "sum": 0.346048562, "avgtime": 0.031458960 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "msgr_recv_encrypted_bytes": 3015168, "msgr_send_encrypted_bytes": 2240 } } ], "cct": [ { "labels": {}, "counters": { "total_workers": 0, "unhealthy_workers": 0 } } ], "cephfs_mirror": [ { "labels": {}, "counters": { "mirrored_filesystems": 2, "mirror_enable_failures": 0 } } ], "cephfs_mirror_mirrored_filesystems": [ { "labels": { "filesystem": "cephfs" }, "counters": { "mirroring_peers": 0, "directory_count": 1 } } ], "mempool": [ { "labels": {}, "counters": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_cache_buffer_bytes": 0, "bluestore_cache_buffer_items": 0, "bluestore_extent_bytes": 0, "bluestore_extent_items": 0, "bluestore_blob_bytes": 0, "bluestore_blob_items": 0, "bluestore_shared_blob_bytes": 0, "bluestore_shared_blob_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_items": 0, "bluefs_bytes": 0, "bluefs_items": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "buffer_anon_bytes": 182461, "buffer_anon_items": 55, "buffer_meta_bytes": 0, "buffer_meta_items": 0, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 19336, "osdmap_items": 192, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "mds_co_bytes": 0, "mds_co_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 } } ], "objecter": [ { "labels": {}, "counters": { "op_active": 0, "op_laggy": 0, "op_send": 0, "op_send_bytes": 0, "op_resend": 0, "op_reply": 0, "op_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "op_inflight": 0, "oplen_avg": { "avgcount": 0, "sum": 0 }, "op": 0, "op_r": 0, "op_w": 0, "op_rmw": 0, "op_pg": 0, "osdop_stat": 0, "osdop_create": 0, "osdop_read": 0, "osdop_write": 0, "osdop_writefull": 0, "osdop_writesame": 0, "osdop_append": 0, "osdop_zero": 0, "osdop_truncate": 0, "osdop_delete": 0, "osdop_mapext": 0, "osdop_sparse_read": 0, "osdop_clonerange": 0, "osdop_getxattr": 0, "osdop_setxattr": 0, "osdop_cmpxattr": 0, "osdop_rmxattr": 0, "osdop_resetxattrs": 0, "osdop_call": 0, "osdop_watch": 0, "osdop_notify": 0, "osdop_src_cmpxattr": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_other": 0, "linger_active": 0, "linger_send": 0, "linger_resend": 0, "linger_ping": 0, "poolop_active": 0, "poolop_send": 0, "poolop_resend": 0, "poolstat_active": 0, "poolstat_send": 0, "poolstat_resend": 0, "statfs_active": 0, "statfs_send": 0, "statfs_resend": 0, "command_active": 0, "command_send": 0, "command_resend": 0, "map_epoch": 0, "map_full": 0, "map_inc": 0, "osd_sessions": 0, "osd_session_open": 0, "osd_session_close": 0, "osd_laggy": 0, "omap_wr": 0, "omap_rd": 0, "omap_del": 0 } } ], "throttle-msgr_dispatch_throttler-client": [ { "labels": {}, "counters": { "val": 0, "max": 104857600, "get_started": 0, "get": 122, "get_sum": 485871, "get_or_fail_fail": 0, "get_or_fail_success": 122, "take": 0, "take_sum": 0, "put": 122, "put_sum": 485871, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ], "throttle-msgr_dispatch_throttler-radosclient": [ { "labels": {}, "counters": { "val": 0, "max": 104857600, "get_started": 0, "get": 88, "get_sum": 3004196, "get_or_fail_fail": 0, "get_or_fail_success": 88, "take": 0, "take_sum": 0, "put": 88, "put_sum": 3004196, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ], "throttle-objecter_bytes": [ { "labels": {}, "counters": { "val": 0, "max": 104857600, "get_started": 0, "get": 0, "get_sum": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "take": 0, "take_sum": 0, "put": 0, "put_sum": 0, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ], "throttle-objecter_ops": [ { "labels": {}, "counters": { "val": 0, "max": 1024, "get_started": 0, "get": 0, "get_sum": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "take": 0, "take_sum": 0, "put": 0, "put_sum": 0, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ] } 2024-03-16T07:36:56.960 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-03-16T07:36:56.961 DEBUG:teuthology.orchestra.run.smithi049:counter dump for fs: cephfs> ceph --admin-daemon /var/run/ceph/cephfs-mirror.asok counter dump 2024-03-16T07:36:57.064 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-03-16T07:36:57.064 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker": [ 2024-03-16T07:36:57.064 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:36:57.065 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:36:57.065 INFO:teuthology.orchestra.run.smithi049.stdout: "id": "0" 2024-03-16T07:36:57.065 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:36:57.065 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:36:57.065 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_ready_timeouts": 0, 2024-03-16T07:36:57.065 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_idle_timeouts": 0 2024-03-16T07:36:57.065 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:36:57.065 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:36:57.065 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:36:57.065 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:36:57.065 INFO:teuthology.orchestra.run.smithi049.stdout: "id": "1" 2024-03-16T07:36:57.065 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:36:57.065 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:36:57.065 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_ready_timeouts": 0, 2024-03-16T07:36:57.065 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_idle_timeouts": 0 2024-03-16T07:36:57.065 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:36:57.066 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:36:57.066 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:36:57.066 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:36:57.066 INFO:teuthology.orchestra.run.smithi049.stdout: "id": "2" 2024-03-16T07:36:57.066 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:36:57.066 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:36:57.066 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_ready_timeouts": 0, 2024-03-16T07:36:57.066 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_idle_timeouts": 0 2024-03-16T07:36:57.066 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:36:57.066 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:36:57.066 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:36:57.066 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-0": [ 2024-03-16T07:36:57.066 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:36:57.066 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:36:57.066 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:36:57.067 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 13, 2024-03-16T07:36:57.067 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 150, 2024-03-16T07:36:57.067 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 1872, 2024-03-16T07:36:57.067 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 1060288, 2024-03-16T07:36:57.067 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 26, 2024-03-16T07:36:57.067 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 5, 2024-03-16T07:36:57.067 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 0.379028571, 2024-03-16T07:36:57.067 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.152386882, 2024-03-16T07:36:57.067 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 0.173849705, 2024-03-16T07:36:57.067 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-03-16T07:36:57.067 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T07:36:57.067 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 138, 2024-03-16T07:36:57.067 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.215024751, 2024-03-16T07:36:57.067 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.001558150 2024-03-16T07:36:57.067 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:36:57.067 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-03-16T07:36:57.067 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:36:57.068 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:36:57.068 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:36:57.068 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:36:57.068 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 1872, 2024-03-16T07:36:57.068 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 1060288 2024-03-16T07:36:57.068 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:36:57.068 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:36:57.068 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:36:57.068 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-1": [ 2024-03-16T07:36:57.068 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:36:57.068 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:36:57.068 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:36:57.068 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 122, 2024-03-16T07:36:57.068 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 9, 2024-03-16T07:36:57.068 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 502432, 2024-03-16T07:36:57.068 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 1776, 2024-03-16T07:36:57.069 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 4, 2024-03-16T07:36:57.069 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 0, 2024-03-16T07:36:57.069 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 0.747249292, 2024-03-16T07:36:57.069 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.050702703, 2024-03-16T07:36:57.069 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 0.478504399, 2024-03-16T07:36:57.069 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.191550009, 2024-03-16T07:36:57.069 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T07:36:57.069 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 8, 2024-03-16T07:36:57.069 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.187770743, 2024-03-16T07:36:57.069 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.023471342 2024-03-16T07:36:57.069 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:36:57.069 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-03-16T07:36:57.069 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:36:57.069 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:36:57.070 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:36:57.070 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:36:57.070 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 502432, 2024-03-16T07:36:57.070 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 1776 2024-03-16T07:36:57.070 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:36:57.070 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:36:57.070 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:36:57.070 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-2": [ 2024-03-16T07:36:57.070 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:36:57.070 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:36:57.070 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:36:57.070 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 78, 2024-03-16T07:36:57.070 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 12, 2024-03-16T07:36:57.070 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 3015168, 2024-03-16T07:36:57.071 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 2240, 2024-03-16T07:36:57.071 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 3, 2024-03-16T07:36:57.071 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 1, 2024-03-16T07:36:57.071 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 1.706300595, 2024-03-16T07:36:57.071 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.015250978, 2024-03-16T07:36:57.071 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 3.070570176, 2024-03-16T07:36:57.071 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-03-16T07:36:57.071 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T07:36:57.071 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 11, 2024-03-16T07:36:57.071 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.346048562, 2024-03-16T07:36:57.071 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.031458960 2024-03-16T07:36:57.071 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:36:57.071 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-03-16T07:36:57.071 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:36:57.071 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:36:57.071 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:36:57.072 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:36:57.072 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 3015168, 2024-03-16T07:36:57.072 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 2240 2024-03-16T07:36:57.072 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:36:57.072 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:36:57.072 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:36:57.072 INFO:teuthology.orchestra.run.smithi049.stdout: "cct": [ 2024-03-16T07:36:57.072 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:36:57.072 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:36:57.072 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:36:57.072 INFO:teuthology.orchestra.run.smithi049.stdout: "total_workers": 0, 2024-03-16T07:36:57.072 INFO:teuthology.orchestra.run.smithi049.stdout: "unhealthy_workers": 0 2024-03-16T07:36:57.072 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:36:57.072 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:36:57.072 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:36:57.072 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs_mirror": [ 2024-03-16T07:36:57.072 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:36:57.073 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:36:57.073 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:36:57.073 INFO:teuthology.orchestra.run.smithi049.stdout: "mirrored_filesystems": 2, 2024-03-16T07:36:57.073 INFO:teuthology.orchestra.run.smithi049.stdout: "mirror_enable_failures": 0 2024-03-16T07:36:57.073 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:36:57.073 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:36:57.073 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:36:57.073 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs_mirror_mirrored_filesystems": [ 2024-03-16T07:36:57.073 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:36:57.073 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:36:57.073 INFO:teuthology.orchestra.run.smithi049.stdout: "filesystem": "cephfs" 2024-03-16T07:36:57.073 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:36:57.073 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:36:57.073 INFO:teuthology.orchestra.run.smithi049.stdout: "mirroring_peers": 0, 2024-03-16T07:36:57.073 INFO:teuthology.orchestra.run.smithi049.stdout: "directory_count": 1 2024-03-16T07:36:57.073 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:36:57.073 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:36:57.074 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:36:57.074 INFO:teuthology.orchestra.run.smithi049.stdout: "mempool": [ 2024-03-16T07:36:57.074 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:36:57.074 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:36:57.074 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:36:57.074 INFO:teuthology.orchestra.run.smithi049.stdout: "bloom_filter_bytes": 0, 2024-03-16T07:36:57.074 INFO:teuthology.orchestra.run.smithi049.stdout: "bloom_filter_items": 0, 2024-03-16T07:36:57.074 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_alloc_bytes": 0, 2024-03-16T07:36:57.074 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_alloc_items": 0, 2024-03-16T07:36:57.074 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_data_bytes": 0, 2024-03-16T07:36:57.074 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_data_items": 0, 2024-03-16T07:36:57.074 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_onode_bytes": 0, 2024-03-16T07:36:57.074 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_onode_items": 0, 2024-03-16T07:36:57.074 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_meta_bytes": 0, 2024-03-16T07:36:57.074 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_meta_items": 0, 2024-03-16T07:36:57.075 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_other_bytes": 0, 2024-03-16T07:36:57.075 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_other_items": 0, 2024-03-16T07:36:57.075 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_buffer_bytes": 0, 2024-03-16T07:36:57.075 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_buffer_items": 0, 2024-03-16T07:36:57.075 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_extent_bytes": 0, 2024-03-16T07:36:57.075 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_extent_items": 0, 2024-03-16T07:36:57.075 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_blob_bytes": 0, 2024-03-16T07:36:57.075 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_blob_items": 0, 2024-03-16T07:36:57.075 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_shared_blob_bytes": 0, 2024-03-16T07:36:57.075 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_shared_blob_items": 0, 2024-03-16T07:36:57.075 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_inline_bl_bytes": 0, 2024-03-16T07:36:57.075 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_inline_bl_items": 0, 2024-03-16T07:36:57.075 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_fsck_bytes": 0, 2024-03-16T07:36:57.075 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_fsck_items": 0, 2024-03-16T07:36:57.075 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_txc_bytes": 0, 2024-03-16T07:36:57.075 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_txc_items": 0, 2024-03-16T07:36:57.075 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_deferred_bytes": 0, 2024-03-16T07:36:57.076 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_deferred_items": 0, 2024-03-16T07:36:57.076 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_bytes": 0, 2024-03-16T07:36:57.076 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_items": 0, 2024-03-16T07:36:57.076 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_bytes": 0, 2024-03-16T07:36:57.076 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_items": 0, 2024-03-16T07:36:57.076 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_reader_bytes": 0, 2024-03-16T07:36:57.076 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_reader_items": 0, 2024-03-16T07:36:57.076 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_writer_bytes": 0, 2024-03-16T07:36:57.076 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_writer_items": 0, 2024-03-16T07:36:57.076 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_anon_bytes": 182461, 2024-03-16T07:36:57.076 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_anon_items": 55, 2024-03-16T07:36:57.076 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_meta_bytes": 0, 2024-03-16T07:36:57.076 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_meta_items": 0, 2024-03-16T07:36:57.076 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_bytes": 0, 2024-03-16T07:36:57.076 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_items": 0, 2024-03-16T07:36:57.076 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_mapbl_bytes": 0, 2024-03-16T07:36:57.076 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_mapbl_items": 0, 2024-03-16T07:36:57.077 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pglog_bytes": 0, 2024-03-16T07:36:57.077 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pglog_items": 0, 2024-03-16T07:36:57.077 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_bytes": 19336, 2024-03-16T07:36:57.077 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_items": 192, 2024-03-16T07:36:57.077 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_mapping_bytes": 0, 2024-03-16T07:36:57.077 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_mapping_items": 0, 2024-03-16T07:36:57.077 INFO:teuthology.orchestra.run.smithi049.stdout: "pgmap_bytes": 0, 2024-03-16T07:36:57.077 INFO:teuthology.orchestra.run.smithi049.stdout: "pgmap_items": 0, 2024-03-16T07:36:57.077 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_co_bytes": 0, 2024-03-16T07:36:57.077 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_co_items": 0, 2024-03-16T07:36:57.077 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_1_bytes": 0, 2024-03-16T07:36:57.077 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_1_items": 0, 2024-03-16T07:36:57.077 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_2_bytes": 0, 2024-03-16T07:36:57.077 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_2_items": 0 2024-03-16T07:36:57.077 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:36:57.077 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:36:57.077 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:36:57.078 INFO:teuthology.orchestra.run.smithi049.stdout: "objecter": [ 2024-03-16T07:36:57.078 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:36:57.078 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:36:57.078 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:36:57.078 INFO:teuthology.orchestra.run.smithi049.stdout: "op_active": 0, 2024-03-16T07:36:57.078 INFO:teuthology.orchestra.run.smithi049.stdout: "op_laggy": 0, 2024-03-16T07:36:57.078 INFO:teuthology.orchestra.run.smithi049.stdout: "op_send": 0, 2024-03-16T07:36:57.078 INFO:teuthology.orchestra.run.smithi049.stdout: "op_send_bytes": 0, 2024-03-16T07:36:57.078 INFO:teuthology.orchestra.run.smithi049.stdout: "op_resend": 0, 2024-03-16T07:36:57.078 INFO:teuthology.orchestra.run.smithi049.stdout: "op_reply": 0, 2024-03-16T07:36:57.078 INFO:teuthology.orchestra.run.smithi049.stdout: "op_latency": { 2024-03-16T07:36:57.078 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:36:57.078 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:36:57.078 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:36:57.078 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:36:57.079 INFO:teuthology.orchestra.run.smithi049.stdout: "op_inflight": 0, 2024-03-16T07:36:57.079 INFO:teuthology.orchestra.run.smithi049.stdout: "oplen_avg": { 2024-03-16T07:36:57.079 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:36:57.079 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0 2024-03-16T07:36:57.079 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:36:57.079 INFO:teuthology.orchestra.run.smithi049.stdout: "op": 0, 2024-03-16T07:36:57.079 INFO:teuthology.orchestra.run.smithi049.stdout: "op_r": 0, 2024-03-16T07:36:57.079 INFO:teuthology.orchestra.run.smithi049.stdout: "op_w": 0, 2024-03-16T07:36:57.079 INFO:teuthology.orchestra.run.smithi049.stdout: "op_rmw": 0, 2024-03-16T07:36:57.079 INFO:teuthology.orchestra.run.smithi049.stdout: "op_pg": 0, 2024-03-16T07:36:57.079 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_stat": 0, 2024-03-16T07:36:57.079 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_create": 0, 2024-03-16T07:36:57.079 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_read": 0, 2024-03-16T07:36:57.079 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_write": 0, 2024-03-16T07:36:57.079 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_writefull": 0, 2024-03-16T07:36:57.079 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_writesame": 0, 2024-03-16T07:36:57.080 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_append": 0, 2024-03-16T07:36:57.080 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_zero": 0, 2024-03-16T07:36:57.080 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_truncate": 0, 2024-03-16T07:36:57.080 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_delete": 0, 2024-03-16T07:36:57.080 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_mapext": 0, 2024-03-16T07:36:57.080 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_sparse_read": 0, 2024-03-16T07:36:57.080 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_clonerange": 0, 2024-03-16T07:36:57.080 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_getxattr": 0, 2024-03-16T07:36:57.080 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_setxattr": 0, 2024-03-16T07:36:57.080 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_cmpxattr": 0, 2024-03-16T07:36:57.080 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_rmxattr": 0, 2024-03-16T07:36:57.080 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_resetxattrs": 0, 2024-03-16T07:36:57.080 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_call": 0, 2024-03-16T07:36:57.080 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_watch": 0, 2024-03-16T07:36:57.080 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_notify": 0, 2024-03-16T07:36:57.080 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_src_cmpxattr": 0, 2024-03-16T07:36:57.080 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_pgls": 0, 2024-03-16T07:36:57.081 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_pgls_filter": 0, 2024-03-16T07:36:57.081 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_other": 0, 2024-03-16T07:36:57.081 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_active": 0, 2024-03-16T07:36:57.081 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_send": 0, 2024-03-16T07:36:57.081 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_resend": 0, 2024-03-16T07:36:57.081 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_ping": 0, 2024-03-16T07:36:57.081 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_active": 0, 2024-03-16T07:36:57.081 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_send": 0, 2024-03-16T07:36:57.081 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_resend": 0, 2024-03-16T07:36:57.081 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_active": 0, 2024-03-16T07:36:57.081 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_send": 0, 2024-03-16T07:36:57.081 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_resend": 0, 2024-03-16T07:36:57.081 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_active": 0, 2024-03-16T07:36:57.081 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_send": 0, 2024-03-16T07:36:57.081 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_resend": 0, 2024-03-16T07:36:57.081 INFO:teuthology.orchestra.run.smithi049.stdout: "command_active": 0, 2024-03-16T07:36:57.081 INFO:teuthology.orchestra.run.smithi049.stdout: "command_send": 0, 2024-03-16T07:36:57.082 INFO:teuthology.orchestra.run.smithi049.stdout: "command_resend": 0, 2024-03-16T07:36:57.082 INFO:teuthology.orchestra.run.smithi049.stdout: "map_epoch": 0, 2024-03-16T07:36:57.082 INFO:teuthology.orchestra.run.smithi049.stdout: "map_full": 0, 2024-03-16T07:36:57.082 INFO:teuthology.orchestra.run.smithi049.stdout: "map_inc": 0, 2024-03-16T07:36:57.082 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_sessions": 0, 2024-03-16T07:36:57.082 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_session_open": 0, 2024-03-16T07:36:57.082 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_session_close": 0, 2024-03-16T07:36:57.082 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_laggy": 0, 2024-03-16T07:36:57.082 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_wr": 0, 2024-03-16T07:36:57.082 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_rd": 0, 2024-03-16T07:36:57.082 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_del": 0 2024-03-16T07:36:57.082 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:36:57.082 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:36:57.082 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:36:57.082 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-msgr_dispatch_throttler-client": [ 2024-03-16T07:36:57.082 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:36:57.083 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:36:57.083 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:36:57.083 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:36:57.083 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-03-16T07:36:57.083 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:36:57.083 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 122, 2024-03-16T07:36:57.083 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 485871, 2024-03-16T07:36:57.083 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:36:57.083 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 122, 2024-03-16T07:36:57.083 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:36:57.083 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:36:57.083 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 122, 2024-03-16T07:36:57.083 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 485871, 2024-03-16T07:36:57.083 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:36:57.083 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:36:57.083 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:36:57.084 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:36:57.084 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:36:57.084 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:36:57.084 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:36:57.084 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:36:57.084 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-msgr_dispatch_throttler-radosclient": [ 2024-03-16T07:36:57.084 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:36:57.084 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:36:57.084 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:36:57.084 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:36:57.084 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-03-16T07:36:57.084 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:36:57.084 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 88, 2024-03-16T07:36:57.084 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 3004196, 2024-03-16T07:36:57.084 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:36:57.084 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 88, 2024-03-16T07:36:57.084 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:36:57.085 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:36:57.085 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 88, 2024-03-16T07:36:57.085 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 3004196, 2024-03-16T07:36:57.085 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:36:57.085 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:36:57.085 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:36:57.085 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:36:57.085 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:36:57.085 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:36:57.085 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:36:57.085 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:36:57.085 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-objecter_bytes": [ 2024-03-16T07:36:57.085 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:36:57.085 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:36:57.085 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:36:57.085 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:36:57.085 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-03-16T07:36:57.086 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:36:57.086 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 0, 2024-03-16T07:36:57.086 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 0, 2024-03-16T07:36:57.086 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:36:57.086 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 0, 2024-03-16T07:36:57.086 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:36:57.086 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:36:57.086 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 0, 2024-03-16T07:36:57.086 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 0, 2024-03-16T07:36:57.086 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:36:57.086 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:36:57.086 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:36:57.086 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:36:57.086 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:36:57.086 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:36:57.086 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:36:57.087 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:36:57.087 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-objecter_ops": [ 2024-03-16T07:36:57.087 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:36:57.087 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:36:57.087 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:36:57.087 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:36:57.087 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 1024, 2024-03-16T07:36:57.087 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:36:57.087 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 0, 2024-03-16T07:36:57.087 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 0, 2024-03-16T07:36:57.087 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:36:57.087 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 0, 2024-03-16T07:36:57.087 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:36:57.087 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:36:57.087 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 0, 2024-03-16T07:36:57.088 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 0, 2024-03-16T07:36:57.088 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:36:57.088 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:36:57.088 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:36:57.088 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:36:57.088 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:36:57.088 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:36:57.088 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:36:57.088 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2024-03-16T07:36:57.088 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-03-16T07:36:57.089 DEBUG:tasks.cephfs.test_mirroring:command returned={ "AsyncMessenger::Worker": [ { "labels": { "id": "0" }, "counters": { "msgr_connection_ready_timeouts": 0, "msgr_connection_idle_timeouts": 0 } }, { "labels": { "id": "1" }, "counters": { "msgr_connection_ready_timeouts": 0, "msgr_connection_idle_timeouts": 0 } }, { "labels": { "id": "2" }, "counters": { "msgr_connection_ready_timeouts": 0, "msgr_connection_idle_timeouts": 0 } } ], "AsyncMessenger::Worker-0": [ { "labels": {}, "counters": { "msgr_recv_messages": 13, "msgr_send_messages": 150, "msgr_recv_bytes": 1872, "msgr_send_bytes": 1060288, "msgr_created_connections": 26, "msgr_active_connections": 5, "msgr_running_total_time": 0.379028571, "msgr_running_send_time": 0.152386882, "msgr_running_recv_time": 0.173849705, "msgr_running_fast_dispatch_time": 0.000000000, "msgr_send_messages_queue_lat": { "avgcount": 138, "sum": 0.215024751, "avgtime": 0.001558150 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "msgr_recv_encrypted_bytes": 1872, "msgr_send_encrypted_bytes": 1060288 } } ], "AsyncMessenger::Worker-1": [ { "labels": {}, "counters": { "msgr_recv_messages": 122, "msgr_send_messages": 9, "msgr_recv_bytes": 502432, "msgr_send_bytes": 1776, "msgr_created_connections": 4, "msgr_active_connections": 0, "msgr_running_total_time": 0.747249292, "msgr_running_send_time": 0.050702703, "msgr_running_recv_time": 0.478504399, "msgr_running_fast_dispatch_time": 0.191550009, "msgr_send_messages_queue_lat": { "avgcount": 8, "sum": 0.187770743, "avgtime": 0.023471342 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "msgr_recv_encrypted_bytes": 502432, "msgr_send_encrypted_bytes": 1776 } } ], "AsyncMessenger::Worker-2": [ { "labels": {}, "counters": { "msgr_recv_messages": 78, "msgr_send_messages": 12, "msgr_recv_bytes": 3015168, "msgr_send_bytes": 2240, "msgr_created_connections": 3, "msgr_active_connections": 1, "msgr_running_total_time": 1.706300595, "msgr_running_send_time": 0.015250978, "msgr_running_recv_time": 3.070570176, "msgr_running_fast_dispatch_time": 0.000000000, "msgr_send_messages_queue_lat": { "avgcount": 11, "sum": 0.346048562, "avgtime": 0.031458960 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "msgr_recv_encrypted_bytes": 3015168, "msgr_send_encrypted_bytes": 2240 } } ], "cct": [ { "labels": {}, "counters": { "total_workers": 0, "unhealthy_workers": 0 } } ], "cephfs_mirror": [ { "labels": {}, "counters": { "mirrored_filesystems": 2, "mirror_enable_failures": 0 } } ], "cephfs_mirror_mirrored_filesystems": [ { "labels": { "filesystem": "cephfs" }, "counters": { "mirroring_peers": 0, "directory_count": 1 } } ], "mempool": [ { "labels": {}, "counters": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_cache_buffer_bytes": 0, "bluestore_cache_buffer_items": 0, "bluestore_extent_bytes": 0, "bluestore_extent_items": 0, "bluestore_blob_bytes": 0, "bluestore_blob_items": 0, "bluestore_shared_blob_bytes": 0, "bluestore_shared_blob_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_items": 0, "bluefs_bytes": 0, "bluefs_items": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "buffer_anon_bytes": 182461, "buffer_anon_items": 55, "buffer_meta_bytes": 0, "buffer_meta_items": 0, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 19336, "osdmap_items": 192, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "mds_co_bytes": 0, "mds_co_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 } } ], "objecter": [ { "labels": {}, "counters": { "op_active": 0, "op_laggy": 0, "op_send": 0, "op_send_bytes": 0, "op_resend": 0, "op_reply": 0, "op_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "op_inflight": 0, "oplen_avg": { "avgcount": 0, "sum": 0 }, "op": 0, "op_r": 0, "op_w": 0, "op_rmw": 0, "op_pg": 0, "osdop_stat": 0, "osdop_create": 0, "osdop_read": 0, "osdop_write": 0, "osdop_writefull": 0, "osdop_writesame": 0, "osdop_append": 0, "osdop_zero": 0, "osdop_truncate": 0, "osdop_delete": 0, "osdop_mapext": 0, "osdop_sparse_read": 0, "osdop_clonerange": 0, "osdop_getxattr": 0, "osdop_setxattr": 0, "osdop_cmpxattr": 0, "osdop_rmxattr": 0, "osdop_resetxattrs": 0, "osdop_call": 0, "osdop_watch": 0, "osdop_notify": 0, "osdop_src_cmpxattr": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_other": 0, "linger_active": 0, "linger_send": 0, "linger_resend": 0, "linger_ping": 0, "poolop_active": 0, "poolop_send": 0, "poolop_resend": 0, "poolstat_active": 0, "poolstat_send": 0, "poolstat_resend": 0, "statfs_active": 0, "statfs_send": 0, "statfs_resend": 0, "command_active": 0, "command_send": 0, "command_resend": 0, "map_epoch": 0, "map_full": 0, "map_inc": 0, "osd_sessions": 0, "osd_session_open": 0, "osd_session_close": 0, "osd_laggy": 0, "omap_wr": 0, "omap_rd": 0, "omap_del": 0 } } ], "throttle-msgr_dispatch_throttler-client": [ { "labels": {}, "counters": { "val": 0, "max": 104857600, "get_started": 0, "get": 122, "get_sum": 485871, "get_or_fail_fail": 0, "get_or_fail_success": 122, "take": 0, "take_sum": 0, "put": 122, "put_sum": 485871, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ], "throttle-msgr_dispatch_throttler-radosclient": [ { "labels": {}, "counters": { "val": 0, "max": 104857600, "get_started": 0, "get": 88, "get_sum": 3004196, "get_or_fail_fail": 0, "get_or_fail_success": 88, "take": 0, "take_sum": 0, "put": 88, "put_sum": 3004196, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ], "throttle-objecter_bytes": [ { "labels": {}, "counters": { "val": 0, "max": 104857600, "get_started": 0, "get": 0, "get_sum": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "take": 0, "take_sum": 0, "put": 0, "put_sum": 0, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ], "throttle-objecter_ops": [ { "labels": {}, "counters": { "val": 0, "max": 1024, "get_started": 0, "get": 0, "get_sum": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "take": 0, "take_sum": 0, "put": 0, "put_sum": 0, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ] } 2024-03-16T07:36:57.089 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-03-16T07:36:57.089 DEBUG:teuthology.orchestra.run.smithi049:mirror status for fs: cephfs> ceph --admin-daemon /var/run/ceph/cephfs-mirror.asok fs mirror status cephfs@14 2024-03-16T07:36:57.183 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-03-16T07:36:57.183 INFO:teuthology.orchestra.run.smithi049.stdout: "rados_inst": "172.21.15.49:0/1186634239", 2024-03-16T07:36:57.183 INFO:teuthology.orchestra.run.smithi049.stdout: "peers": {}, 2024-03-16T07:36:57.184 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_dirs": { 2024-03-16T07:36:57.184 INFO:teuthology.orchestra.run.smithi049.stdout: "dir_count": 1 2024-03-16T07:36:57.184 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:36:57.184 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-03-16T07:36:57.191 DEBUG:tasks.cephfs.test_mirroring:command returned={ "rados_inst": "172.21.15.49:0/1186634239", "peers": {}, "snap_dirs": { "dir_count": 1 } } 2024-03-16T07:36:57.191 DEBUG:tasks.cephfs.test_mirroring:initial dir_count=1 2024-03-16T07:36:57.191 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snapshot mirror add cephfs /d1 2024-03-16T07:36:57.543 INFO:teuthology.orchestra.run.smithi049.stdout:{} 2024-03-16T07:37:07.557 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-03-16T07:37:07.558 DEBUG:teuthology.orchestra.run.smithi049:mirror status for fs: cephfs> ceph --admin-daemon /var/run/ceph/cephfs-mirror.asok fs mirror status cephfs@14 2024-03-16T07:37:07.660 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-03-16T07:37:07.660 INFO:teuthology.orchestra.run.smithi049.stdout: "rados_inst": "172.21.15.49:0/1186634239", 2024-03-16T07:37:07.661 INFO:teuthology.orchestra.run.smithi049.stdout: "peers": {}, 2024-03-16T07:37:07.661 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_dirs": { 2024-03-16T07:37:07.661 INFO:teuthology.orchestra.run.smithi049.stdout: "dir_count": 2 2024-03-16T07:37:07.661 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:07.661 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-03-16T07:37:07.668 DEBUG:tasks.cephfs.test_mirroring:command returned={ "rados_inst": "172.21.15.49:0/1186634239", "peers": {}, "snap_dirs": { "dir_count": 2 } } 2024-03-16T07:37:07.668 DEBUG:tasks.cephfs.test_mirroring:new dir_count=2 2024-03-16T07:37:07.668 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-03-16T07:37:07.668 DEBUG:teuthology.orchestra.run.smithi049:counter dump for fs: cephfs> ceph --admin-daemon /var/run/ceph/cephfs-mirror.asok counter dump 2024-03-16T07:37:07.796 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-03-16T07:37:07.796 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker": [ 2024-03-16T07:37:07.796 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:37:07.796 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:37:07.796 INFO:teuthology.orchestra.run.smithi049.stdout: "id": "0" 2024-03-16T07:37:07.796 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:37:07.797 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:37:07.797 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_ready_timeouts": 0, 2024-03-16T07:37:07.797 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_idle_timeouts": 0 2024-03-16T07:37:07.797 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:07.797 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:37:07.797 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:37:07.797 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:37:07.797 INFO:teuthology.orchestra.run.smithi049.stdout: "id": "1" 2024-03-16T07:37:07.797 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:37:07.797 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:37:07.797 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_ready_timeouts": 0, 2024-03-16T07:37:07.797 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_idle_timeouts": 0 2024-03-16T07:37:07.797 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:07.797 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:37:07.797 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:37:07.798 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:37:07.798 INFO:teuthology.orchestra.run.smithi049.stdout: "id": "2" 2024-03-16T07:37:07.798 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:37:07.798 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:37:07.798 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_ready_timeouts": 0, 2024-03-16T07:37:07.798 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_idle_timeouts": 0 2024-03-16T07:37:07.798 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:07.798 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:07.798 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:37:07.798 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-0": [ 2024-03-16T07:37:07.798 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:37:07.798 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:37:07.798 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:37:07.798 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 13, 2024-03-16T07:37:07.798 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 152, 2024-03-16T07:37:07.799 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 1872, 2024-03-16T07:37:07.799 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 1060848, 2024-03-16T07:37:07.799 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 26, 2024-03-16T07:37:07.799 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 5, 2024-03-16T07:37:07.799 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 0.379995820, 2024-03-16T07:37:07.799 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.153268407, 2024-03-16T07:37:07.799 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 0.173849705, 2024-03-16T07:37:07.799 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-03-16T07:37:07.799 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T07:37:07.799 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 140, 2024-03-16T07:37:07.799 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.215374428, 2024-03-16T07:37:07.799 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.001538388 2024-03-16T07:37:07.799 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:37:07.799 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-03-16T07:37:07.799 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:37:07.800 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:37:07.800 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:37:07.800 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:37:07.800 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 1872, 2024-03-16T07:37:07.800 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 1060848 2024-03-16T07:37:07.800 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:07.800 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:07.800 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:37:07.800 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-1": [ 2024-03-16T07:37:07.800 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:37:07.800 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:37:07.800 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:37:07.800 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 122, 2024-03-16T07:37:07.800 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 9, 2024-03-16T07:37:07.800 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 502432, 2024-03-16T07:37:07.800 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 1776, 2024-03-16T07:37:07.801 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 4, 2024-03-16T07:37:07.801 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 0, 2024-03-16T07:37:07.801 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 0.748071738, 2024-03-16T07:37:07.801 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.050778237, 2024-03-16T07:37:07.801 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 0.478876877, 2024-03-16T07:37:07.801 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.191550009, 2024-03-16T07:37:07.801 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T07:37:07.801 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 8, 2024-03-16T07:37:07.801 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.187770743, 2024-03-16T07:37:07.801 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.023471342 2024-03-16T07:37:07.801 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:37:07.801 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-03-16T07:37:07.801 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:37:07.801 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:37:07.801 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:37:07.801 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:37:07.802 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 502432, 2024-03-16T07:37:07.802 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 1776 2024-03-16T07:37:07.802 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:07.802 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:07.802 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:37:07.802 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-2": [ 2024-03-16T07:37:07.802 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:37:07.802 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:37:07.802 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:37:07.802 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 79, 2024-03-16T07:37:07.802 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 12, 2024-03-16T07:37:07.802 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 3060752, 2024-03-16T07:37:07.802 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 2240, 2024-03-16T07:37:07.802 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 3, 2024-03-16T07:37:07.802 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 1, 2024-03-16T07:37:07.802 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 1.735406584, 2024-03-16T07:37:07.803 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.015392300, 2024-03-16T07:37:07.803 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 3.124450875, 2024-03-16T07:37:07.803 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-03-16T07:37:07.803 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T07:37:07.803 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 11, 2024-03-16T07:37:07.803 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.346048562, 2024-03-16T07:37:07.803 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.031458960 2024-03-16T07:37:07.803 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:37:07.803 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-03-16T07:37:07.803 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:37:07.803 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:37:07.803 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:37:07.803 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:37:07.803 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 3060752, 2024-03-16T07:37:07.803 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 2240 2024-03-16T07:37:07.803 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:07.803 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:07.804 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:37:07.804 INFO:teuthology.orchestra.run.smithi049.stdout: "cct": [ 2024-03-16T07:37:07.804 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:37:07.804 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:37:07.804 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:37:07.804 INFO:teuthology.orchestra.run.smithi049.stdout: "total_workers": 0, 2024-03-16T07:37:07.804 INFO:teuthology.orchestra.run.smithi049.stdout: "unhealthy_workers": 0 2024-03-16T07:37:07.804 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:07.804 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:07.804 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:37:07.804 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs_mirror": [ 2024-03-16T07:37:07.804 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:37:07.804 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:37:07.804 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:37:07.804 INFO:teuthology.orchestra.run.smithi049.stdout: "mirrored_filesystems": 2, 2024-03-16T07:37:07.804 INFO:teuthology.orchestra.run.smithi049.stdout: "mirror_enable_failures": 0 2024-03-16T07:37:07.804 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:07.805 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:07.805 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:37:07.805 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs_mirror_mirrored_filesystems": [ 2024-03-16T07:37:07.805 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:37:07.805 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:37:07.805 INFO:teuthology.orchestra.run.smithi049.stdout: "filesystem": "cephfs" 2024-03-16T07:37:07.805 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:37:07.805 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:37:07.805 INFO:teuthology.orchestra.run.smithi049.stdout: "mirroring_peers": 0, 2024-03-16T07:37:07.805 INFO:teuthology.orchestra.run.smithi049.stdout: "directory_count": 2 2024-03-16T07:37:07.805 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:07.805 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:07.805 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:37:07.805 INFO:teuthology.orchestra.run.smithi049.stdout: "mempool": [ 2024-03-16T07:37:07.805 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:37:07.805 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:37:07.805 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:37:07.806 INFO:teuthology.orchestra.run.smithi049.stdout: "bloom_filter_bytes": 0, 2024-03-16T07:37:07.806 INFO:teuthology.orchestra.run.smithi049.stdout: "bloom_filter_items": 0, 2024-03-16T07:37:07.806 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_alloc_bytes": 0, 2024-03-16T07:37:07.806 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_alloc_items": 0, 2024-03-16T07:37:07.806 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_data_bytes": 0, 2024-03-16T07:37:07.806 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_data_items": 0, 2024-03-16T07:37:07.806 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_onode_bytes": 0, 2024-03-16T07:37:07.806 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_onode_items": 0, 2024-03-16T07:37:07.806 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_meta_bytes": 0, 2024-03-16T07:37:07.806 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_meta_items": 0, 2024-03-16T07:37:07.806 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_other_bytes": 0, 2024-03-16T07:37:07.806 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_other_items": 0, 2024-03-16T07:37:07.806 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_buffer_bytes": 0, 2024-03-16T07:37:07.806 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_buffer_items": 0, 2024-03-16T07:37:07.806 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_extent_bytes": 0, 2024-03-16T07:37:07.806 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_extent_items": 0, 2024-03-16T07:37:07.807 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_blob_bytes": 0, 2024-03-16T07:37:07.807 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_blob_items": 0, 2024-03-16T07:37:07.807 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_shared_blob_bytes": 0, 2024-03-16T07:37:07.807 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_shared_blob_items": 0, 2024-03-16T07:37:07.807 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_inline_bl_bytes": 0, 2024-03-16T07:37:07.807 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_inline_bl_items": 0, 2024-03-16T07:37:07.807 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_fsck_bytes": 0, 2024-03-16T07:37:07.807 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_fsck_items": 0, 2024-03-16T07:37:07.807 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_txc_bytes": 0, 2024-03-16T07:37:07.807 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_txc_items": 0, 2024-03-16T07:37:07.807 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_deferred_bytes": 0, 2024-03-16T07:37:07.807 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_deferred_items": 0, 2024-03-16T07:37:07.807 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_bytes": 0, 2024-03-16T07:37:07.807 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_items": 0, 2024-03-16T07:37:07.807 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_bytes": 0, 2024-03-16T07:37:07.807 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_items": 0, 2024-03-16T07:37:07.808 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_reader_bytes": 0, 2024-03-16T07:37:07.808 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_reader_items": 0, 2024-03-16T07:37:07.808 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_writer_bytes": 0, 2024-03-16T07:37:07.808 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_writer_items": 0, 2024-03-16T07:37:07.808 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_anon_bytes": 182461, 2024-03-16T07:37:07.808 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_anon_items": 55, 2024-03-16T07:37:07.808 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_meta_bytes": 0, 2024-03-16T07:37:07.808 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_meta_items": 0, 2024-03-16T07:37:07.808 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_bytes": 0, 2024-03-16T07:37:07.808 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_items": 0, 2024-03-16T07:37:07.808 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_mapbl_bytes": 0, 2024-03-16T07:37:07.808 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_mapbl_items": 0, 2024-03-16T07:37:07.808 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pglog_bytes": 0, 2024-03-16T07:37:07.808 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pglog_items": 0, 2024-03-16T07:37:07.808 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_bytes": 19336, 2024-03-16T07:37:07.808 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_items": 192, 2024-03-16T07:37:07.808 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_mapping_bytes": 0, 2024-03-16T07:37:07.809 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_mapping_items": 0, 2024-03-16T07:37:07.809 INFO:teuthology.orchestra.run.smithi049.stdout: "pgmap_bytes": 0, 2024-03-16T07:37:07.809 INFO:teuthology.orchestra.run.smithi049.stdout: "pgmap_items": 0, 2024-03-16T07:37:07.809 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_co_bytes": 0, 2024-03-16T07:37:07.809 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_co_items": 0, 2024-03-16T07:37:07.809 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_1_bytes": 0, 2024-03-16T07:37:07.809 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_1_items": 0, 2024-03-16T07:37:07.809 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_2_bytes": 0, 2024-03-16T07:37:07.809 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_2_items": 0 2024-03-16T07:37:07.809 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:07.809 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:07.809 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:37:07.809 INFO:teuthology.orchestra.run.smithi049.stdout: "objecter": [ 2024-03-16T07:37:07.809 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:37:07.809 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:37:07.809 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:37:07.810 INFO:teuthology.orchestra.run.smithi049.stdout: "op_active": 0, 2024-03-16T07:37:07.810 INFO:teuthology.orchestra.run.smithi049.stdout: "op_laggy": 0, 2024-03-16T07:37:07.810 INFO:teuthology.orchestra.run.smithi049.stdout: "op_send": 0, 2024-03-16T07:37:07.810 INFO:teuthology.orchestra.run.smithi049.stdout: "op_send_bytes": 0, 2024-03-16T07:37:07.810 INFO:teuthology.orchestra.run.smithi049.stdout: "op_resend": 0, 2024-03-16T07:37:07.810 INFO:teuthology.orchestra.run.smithi049.stdout: "op_reply": 0, 2024-03-16T07:37:07.810 INFO:teuthology.orchestra.run.smithi049.stdout: "op_latency": { 2024-03-16T07:37:07.810 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:37:07.810 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:37:07.810 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:37:07.810 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:37:07.810 INFO:teuthology.orchestra.run.smithi049.stdout: "op_inflight": 0, 2024-03-16T07:37:07.810 INFO:teuthology.orchestra.run.smithi049.stdout: "oplen_avg": { 2024-03-16T07:37:07.810 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:37:07.810 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0 2024-03-16T07:37:07.811 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:37:07.811 INFO:teuthology.orchestra.run.smithi049.stdout: "op": 0, 2024-03-16T07:37:07.811 INFO:teuthology.orchestra.run.smithi049.stdout: "op_r": 0, 2024-03-16T07:37:07.811 INFO:teuthology.orchestra.run.smithi049.stdout: "op_w": 0, 2024-03-16T07:37:07.811 INFO:teuthology.orchestra.run.smithi049.stdout: "op_rmw": 0, 2024-03-16T07:37:07.811 INFO:teuthology.orchestra.run.smithi049.stdout: "op_pg": 0, 2024-03-16T07:37:07.811 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_stat": 0, 2024-03-16T07:37:07.811 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_create": 0, 2024-03-16T07:37:07.811 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_read": 0, 2024-03-16T07:37:07.811 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_write": 0, 2024-03-16T07:37:07.811 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_writefull": 0, 2024-03-16T07:37:07.811 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_writesame": 0, 2024-03-16T07:37:07.811 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_append": 0, 2024-03-16T07:37:07.811 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_zero": 0, 2024-03-16T07:37:07.811 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_truncate": 0, 2024-03-16T07:37:07.811 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_delete": 0, 2024-03-16T07:37:07.812 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_mapext": 0, 2024-03-16T07:37:07.812 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_sparse_read": 0, 2024-03-16T07:37:07.812 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_clonerange": 0, 2024-03-16T07:37:07.812 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_getxattr": 0, 2024-03-16T07:37:07.812 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_setxattr": 0, 2024-03-16T07:37:07.812 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_cmpxattr": 0, 2024-03-16T07:37:07.812 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_rmxattr": 0, 2024-03-16T07:37:07.812 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_resetxattrs": 0, 2024-03-16T07:37:07.812 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_call": 0, 2024-03-16T07:37:07.812 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_watch": 0, 2024-03-16T07:37:07.812 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_notify": 0, 2024-03-16T07:37:07.812 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_src_cmpxattr": 0, 2024-03-16T07:37:07.812 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_pgls": 0, 2024-03-16T07:37:07.812 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_pgls_filter": 0, 2024-03-16T07:37:07.812 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_other": 0, 2024-03-16T07:37:07.812 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_active": 0, 2024-03-16T07:37:07.813 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_send": 0, 2024-03-16T07:37:07.813 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_resend": 0, 2024-03-16T07:37:07.813 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_ping": 0, 2024-03-16T07:37:07.813 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_active": 0, 2024-03-16T07:37:07.813 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_send": 0, 2024-03-16T07:37:07.813 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_resend": 0, 2024-03-16T07:37:07.813 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_active": 0, 2024-03-16T07:37:07.813 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_send": 0, 2024-03-16T07:37:07.813 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_resend": 0, 2024-03-16T07:37:07.813 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_active": 0, 2024-03-16T07:37:07.813 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_send": 0, 2024-03-16T07:37:07.813 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_resend": 0, 2024-03-16T07:37:07.813 INFO:teuthology.orchestra.run.smithi049.stdout: "command_active": 0, 2024-03-16T07:37:07.813 INFO:teuthology.orchestra.run.smithi049.stdout: "command_send": 0, 2024-03-16T07:37:07.813 INFO:teuthology.orchestra.run.smithi049.stdout: "command_resend": 0, 2024-03-16T07:37:07.814 INFO:teuthology.orchestra.run.smithi049.stdout: "map_epoch": 0, 2024-03-16T07:37:07.814 INFO:teuthology.orchestra.run.smithi049.stdout: "map_full": 0, 2024-03-16T07:37:07.814 INFO:teuthology.orchestra.run.smithi049.stdout: "map_inc": 0, 2024-03-16T07:37:07.814 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_sessions": 0, 2024-03-16T07:37:07.814 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_session_open": 0, 2024-03-16T07:37:07.814 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_session_close": 0, 2024-03-16T07:37:07.814 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_laggy": 0, 2024-03-16T07:37:07.814 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_wr": 0, 2024-03-16T07:37:07.814 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_rd": 0, 2024-03-16T07:37:07.814 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_del": 0 2024-03-16T07:37:07.814 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:07.814 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:07.814 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:37:07.814 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-msgr_dispatch_throttler-client": [ 2024-03-16T07:37:07.814 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:37:07.815 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:37:07.815 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:37:07.815 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:37:07.815 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-03-16T07:37:07.815 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:37:07.815 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 122, 2024-03-16T07:37:07.817 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 485871, 2024-03-16T07:37:07.817 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:37:07.817 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 122, 2024-03-16T07:37:07.817 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:37:07.817 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:37:07.817 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 122, 2024-03-16T07:37:07.817 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 485871, 2024-03-16T07:37:07.817 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:37:07.817 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:37:07.818 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:37:07.818 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:37:07.818 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:07.818 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:07.818 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:07.818 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:37:07.818 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-msgr_dispatch_throttler-radosclient": [ 2024-03-16T07:37:07.818 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:37:07.818 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:37:07.818 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:37:07.818 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:37:07.818 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-03-16T07:37:07.818 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:37:07.818 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 89, 2024-03-16T07:37:07.818 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 3049644, 2024-03-16T07:37:07.818 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:37:07.819 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 89, 2024-03-16T07:37:07.819 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:37:07.819 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:37:07.819 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 89, 2024-03-16T07:37:07.819 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 3049644, 2024-03-16T07:37:07.819 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:37:07.819 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:37:07.819 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:37:07.819 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:37:07.819 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:07.819 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:07.819 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:07.819 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:37:07.819 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-objecter_bytes": [ 2024-03-16T07:37:07.820 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:37:07.820 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:37:07.820 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:37:07.820 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:37:07.820 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-03-16T07:37:07.820 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:37:07.820 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 0, 2024-03-16T07:37:07.820 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 0, 2024-03-16T07:37:07.820 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:37:07.820 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 0, 2024-03-16T07:37:07.820 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:37:07.820 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:37:07.820 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 0, 2024-03-16T07:37:07.820 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 0, 2024-03-16T07:37:07.820 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:37:07.820 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:37:07.821 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:37:07.821 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:37:07.821 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:07.821 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:07.821 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:07.821 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:37:07.821 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-objecter_ops": [ 2024-03-16T07:37:07.821 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:37:07.821 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:37:07.821 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:37:07.821 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:37:07.821 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 1024, 2024-03-16T07:37:07.821 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:37:07.821 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 0, 2024-03-16T07:37:07.821 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 0, 2024-03-16T07:37:07.821 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:37:07.821 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 0, 2024-03-16T07:37:07.822 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:37:07.822 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:37:07.822 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 0, 2024-03-16T07:37:07.822 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 0, 2024-03-16T07:37:07.822 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:37:07.822 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:37:07.822 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:37:07.822 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:37:07.822 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:07.822 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:07.822 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:07.822 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2024-03-16T07:37:07.822 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-03-16T07:37:07.823 DEBUG:tasks.cephfs.test_mirroring:command returned={ "AsyncMessenger::Worker": [ { "labels": { "id": "0" }, "counters": { "msgr_connection_ready_timeouts": 0, "msgr_connection_idle_timeouts": 0 } }, { "labels": { "id": "1" }, "counters": { "msgr_connection_ready_timeouts": 0, "msgr_connection_idle_timeouts": 0 } }, { "labels": { "id": "2" }, "counters": { "msgr_connection_ready_timeouts": 0, "msgr_connection_idle_timeouts": 0 } } ], "AsyncMessenger::Worker-0": [ { "labels": {}, "counters": { "msgr_recv_messages": 13, "msgr_send_messages": 152, "msgr_recv_bytes": 1872, "msgr_send_bytes": 1060848, "msgr_created_connections": 26, "msgr_active_connections": 5, "msgr_running_total_time": 0.379995820, "msgr_running_send_time": 0.153268407, "msgr_running_recv_time": 0.173849705, "msgr_running_fast_dispatch_time": 0.000000000, "msgr_send_messages_queue_lat": { "avgcount": 140, "sum": 0.215374428, "avgtime": 0.001538388 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "msgr_recv_encrypted_bytes": 1872, "msgr_send_encrypted_bytes": 1060848 } } ], "AsyncMessenger::Worker-1": [ { "labels": {}, "counters": { "msgr_recv_messages": 122, "msgr_send_messages": 9, "msgr_recv_bytes": 502432, "msgr_send_bytes": 1776, "msgr_created_connections": 4, "msgr_active_connections": 0, "msgr_running_total_time": 0.748071738, "msgr_running_send_time": 0.050778237, "msgr_running_recv_time": 0.478876877, "msgr_running_fast_dispatch_time": 0.191550009, "msgr_send_messages_queue_lat": { "avgcount": 8, "sum": 0.187770743, "avgtime": 0.023471342 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "msgr_recv_encrypted_bytes": 502432, "msgr_send_encrypted_bytes": 1776 } } ], "AsyncMessenger::Worker-2": [ { "labels": {}, "counters": { "msgr_recv_messages": 79, "msgr_send_messages": 12, "msgr_recv_bytes": 3060752, "msgr_send_bytes": 2240, "msgr_created_connections": 3, "msgr_active_connections": 1, "msgr_running_total_time": 1.735406584, "msgr_running_send_time": 0.015392300, "msgr_running_recv_time": 3.124450875, "msgr_running_fast_dispatch_time": 0.000000000, "msgr_send_messages_queue_lat": { "avgcount": 11, "sum": 0.346048562, "avgtime": 0.031458960 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "msgr_recv_encrypted_bytes": 3060752, "msgr_send_encrypted_bytes": 2240 } } ], "cct": [ { "labels": {}, "counters": { "total_workers": 0, "unhealthy_workers": 0 } } ], "cephfs_mirror": [ { "labels": {}, "counters": { "mirrored_filesystems": 2, "mirror_enable_failures": 0 } } ], "cephfs_mirror_mirrored_filesystems": [ { "labels": { "filesystem": "cephfs" }, "counters": { "mirroring_peers": 0, "directory_count": 2 } } ], "mempool": [ { "labels": {}, "counters": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_cache_buffer_bytes": 0, "bluestore_cache_buffer_items": 0, "bluestore_extent_bytes": 0, "bluestore_extent_items": 0, "bluestore_blob_bytes": 0, "bluestore_blob_items": 0, "bluestore_shared_blob_bytes": 0, "bluestore_shared_blob_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_items": 0, "bluefs_bytes": 0, "bluefs_items": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "buffer_anon_bytes": 182461, "buffer_anon_items": 55, "buffer_meta_bytes": 0, "buffer_meta_items": 0, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 19336, "osdmap_items": 192, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "mds_co_bytes": 0, "mds_co_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 } } ], "objecter": [ { "labels": {}, "counters": { "op_active": 0, "op_laggy": 0, "op_send": 0, "op_send_bytes": 0, "op_resend": 0, "op_reply": 0, "op_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "op_inflight": 0, "oplen_avg": { "avgcount": 0, "sum": 0 }, "op": 0, "op_r": 0, "op_w": 0, "op_rmw": 0, "op_pg": 0, "osdop_stat": 0, "osdop_create": 0, "osdop_read": 0, "osdop_write": 0, "osdop_writefull": 0, "osdop_writesame": 0, "osdop_append": 0, "osdop_zero": 0, "osdop_truncate": 0, "osdop_delete": 0, "osdop_mapext": 0, "osdop_sparse_read": 0, "osdop_clonerange": 0, "osdop_getxattr": 0, "osdop_setxattr": 0, "osdop_cmpxattr": 0, "osdop_rmxattr": 0, "osdop_resetxattrs": 0, "osdop_call": 0, "osdop_watch": 0, "osdop_notify": 0, "osdop_src_cmpxattr": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_other": 0, "linger_active": 0, "linger_send": 0, "linger_resend": 0, "linger_ping": 0, "poolop_active": 0, "poolop_send": 0, "poolop_resend": 0, "poolstat_active": 0, "poolstat_send": 0, "poolstat_resend": 0, "statfs_active": 0, "statfs_send": 0, "statfs_resend": 0, "command_active": 0, "command_send": 0, "command_resend": 0, "map_epoch": 0, "map_full": 0, "map_inc": 0, "osd_sessions": 0, "osd_session_open": 0, "osd_session_close": 0, "osd_laggy": 0, "omap_wr": 0, "omap_rd": 0, "omap_del": 0 } } ], "throttle-msgr_dispatch_throttler-client": [ { "labels": {}, "counters": { "val": 0, "max": 104857600, "get_started": 0, "get": 122, "get_sum": 485871, "get_or_fail_fail": 0, "get_or_fail_success": 122, "take": 0, "take_sum": 0, "put": 122, "put_sum": 485871, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ], "throttle-msgr_dispatch_throttler-radosclient": [ { "labels": {}, "counters": { "val": 0, "max": 104857600, "get_started": 0, "get": 89, "get_sum": 3049644, "get_or_fail_fail": 0, "get_or_fail_success": 89, "take": 0, "take_sum": 0, "put": 89, "put_sum": 3049644, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ], "throttle-objecter_bytes": [ { "labels": {}, "counters": { "val": 0, "max": 104857600, "get_started": 0, "get": 0, "get_sum": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "take": 0, "take_sum": 0, "put": 0, "put_sum": 0, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ], "throttle-objecter_ops": [ { "labels": {}, "counters": { "val": 0, "max": 1024, "get_started": 0, "get": 0, "get_sum": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "take": 0, "take_sum": 0, "put": 0, "put_sum": 0, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ] } 2024-03-16T07:37:07.824 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-03-16T07:37:07.824 DEBUG:teuthology.orchestra.run.smithi049:counter dump for fs: cephfs> ceph --admin-daemon /var/run/ceph/cephfs-mirror.asok counter dump 2024-03-16T07:37:07.953 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-03-16T07:37:07.953 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker": [ 2024-03-16T07:37:07.953 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:37:07.953 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:37:07.953 INFO:teuthology.orchestra.run.smithi049.stdout: "id": "0" 2024-03-16T07:37:07.953 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:37:07.953 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:37:07.954 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_ready_timeouts": 0, 2024-03-16T07:37:07.954 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_idle_timeouts": 0 2024-03-16T07:37:07.954 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:07.954 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:37:07.954 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:37:07.954 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:37:07.954 INFO:teuthology.orchestra.run.smithi049.stdout: "id": "1" 2024-03-16T07:37:07.954 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:37:07.954 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:37:07.954 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_ready_timeouts": 0, 2024-03-16T07:37:07.954 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_idle_timeouts": 0 2024-03-16T07:37:07.954 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:07.954 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:37:07.954 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:37:07.954 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:37:07.955 INFO:teuthology.orchestra.run.smithi049.stdout: "id": "2" 2024-03-16T07:37:07.955 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:37:07.955 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:37:07.955 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_ready_timeouts": 0, 2024-03-16T07:37:07.955 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_idle_timeouts": 0 2024-03-16T07:37:07.955 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:07.955 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:07.955 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:37:07.955 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-0": [ 2024-03-16T07:37:07.955 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:37:07.955 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:37:07.955 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:37:07.955 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 13, 2024-03-16T07:37:07.955 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 152, 2024-03-16T07:37:07.955 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 1872, 2024-03-16T07:37:07.955 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 1060848, 2024-03-16T07:37:07.956 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 26, 2024-03-16T07:37:07.956 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 5, 2024-03-16T07:37:07.956 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 0.379995820, 2024-03-16T07:37:07.956 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.153268407, 2024-03-16T07:37:07.956 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 0.173849705, 2024-03-16T07:37:07.956 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-03-16T07:37:07.956 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T07:37:07.956 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 140, 2024-03-16T07:37:07.956 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.215374428, 2024-03-16T07:37:07.956 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.001538388 2024-03-16T07:37:07.956 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:37:07.956 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-03-16T07:37:07.956 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:37:07.956 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:37:07.956 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:37:07.956 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:37:07.957 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 1872, 2024-03-16T07:37:07.957 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 1060848 2024-03-16T07:37:07.957 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:07.957 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:07.957 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:37:07.957 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-1": [ 2024-03-16T07:37:07.957 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:37:07.957 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:37:07.957 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:37:07.957 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 122, 2024-03-16T07:37:07.957 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 9, 2024-03-16T07:37:07.957 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 502432, 2024-03-16T07:37:07.957 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 1776, 2024-03-16T07:37:07.957 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 4, 2024-03-16T07:37:07.957 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 0, 2024-03-16T07:37:07.957 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 0.748071738, 2024-03-16T07:37:07.957 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.050778237, 2024-03-16T07:37:07.958 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 0.478876877, 2024-03-16T07:37:07.958 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.191550009, 2024-03-16T07:37:07.958 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T07:37:07.958 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 8, 2024-03-16T07:37:07.958 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.187770743, 2024-03-16T07:37:07.958 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.023471342 2024-03-16T07:37:07.958 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:37:07.958 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-03-16T07:37:07.958 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:37:07.958 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:37:07.958 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:37:07.958 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:37:07.958 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 502432, 2024-03-16T07:37:07.958 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 1776 2024-03-16T07:37:07.959 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:07.959 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:07.959 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:37:07.959 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-2": [ 2024-03-16T07:37:07.959 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:37:07.959 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:37:07.959 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:37:07.959 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 79, 2024-03-16T07:37:07.959 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 12, 2024-03-16T07:37:07.959 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 3060752, 2024-03-16T07:37:07.959 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 2240, 2024-03-16T07:37:07.959 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 3, 2024-03-16T07:37:07.959 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 1, 2024-03-16T07:37:07.959 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 1.735406584, 2024-03-16T07:37:07.959 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.015392300, 2024-03-16T07:37:07.959 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 3.124450875, 2024-03-16T07:37:07.960 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-03-16T07:37:07.960 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T07:37:07.960 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 11, 2024-03-16T07:37:07.960 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.346048562, 2024-03-16T07:37:07.960 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.031458960 2024-03-16T07:37:07.960 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:37:07.960 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-03-16T07:37:07.960 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:37:07.960 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:37:07.960 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:37:07.960 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:37:07.960 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 3060752, 2024-03-16T07:37:07.960 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 2240 2024-03-16T07:37:07.960 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:07.960 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:07.960 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:37:07.961 INFO:teuthology.orchestra.run.smithi049.stdout: "cct": [ 2024-03-16T07:37:07.961 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:37:07.961 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:37:07.961 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:37:07.961 INFO:teuthology.orchestra.run.smithi049.stdout: "total_workers": 0, 2024-03-16T07:37:07.961 INFO:teuthology.orchestra.run.smithi049.stdout: "unhealthy_workers": 0 2024-03-16T07:37:07.961 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:07.961 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:07.961 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:37:07.961 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs_mirror": [ 2024-03-16T07:37:07.961 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:37:07.961 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:37:07.961 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:37:07.961 INFO:teuthology.orchestra.run.smithi049.stdout: "mirrored_filesystems": 2, 2024-03-16T07:37:07.961 INFO:teuthology.orchestra.run.smithi049.stdout: "mirror_enable_failures": 0 2024-03-16T07:37:07.961 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:07.961 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:07.962 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:37:07.962 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs_mirror_mirrored_filesystems": [ 2024-03-16T07:37:07.962 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:37:07.962 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:37:07.962 INFO:teuthology.orchestra.run.smithi049.stdout: "filesystem": "cephfs" 2024-03-16T07:37:07.962 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:37:07.962 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:37:07.962 INFO:teuthology.orchestra.run.smithi049.stdout: "mirroring_peers": 0, 2024-03-16T07:37:07.962 INFO:teuthology.orchestra.run.smithi049.stdout: "directory_count": 2 2024-03-16T07:37:07.962 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:07.962 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:07.962 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:37:07.962 INFO:teuthology.orchestra.run.smithi049.stdout: "mempool": [ 2024-03-16T07:37:07.962 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:37:07.962 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:37:07.962 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:37:07.962 INFO:teuthology.orchestra.run.smithi049.stdout: "bloom_filter_bytes": 0, 2024-03-16T07:37:07.963 INFO:teuthology.orchestra.run.smithi049.stdout: "bloom_filter_items": 0, 2024-03-16T07:37:07.963 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_alloc_bytes": 0, 2024-03-16T07:37:07.963 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_alloc_items": 0, 2024-03-16T07:37:07.963 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_data_bytes": 0, 2024-03-16T07:37:07.963 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_data_items": 0, 2024-03-16T07:37:07.963 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_onode_bytes": 0, 2024-03-16T07:37:07.963 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_onode_items": 0, 2024-03-16T07:37:07.963 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_meta_bytes": 0, 2024-03-16T07:37:07.963 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_meta_items": 0, 2024-03-16T07:37:07.963 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_other_bytes": 0, 2024-03-16T07:37:07.963 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_other_items": 0, 2024-03-16T07:37:07.963 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_buffer_bytes": 0, 2024-03-16T07:37:07.963 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_buffer_items": 0, 2024-03-16T07:37:07.963 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_extent_bytes": 0, 2024-03-16T07:37:07.963 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_extent_items": 0, 2024-03-16T07:37:07.963 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_blob_bytes": 0, 2024-03-16T07:37:07.964 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_blob_items": 0, 2024-03-16T07:37:07.964 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_shared_blob_bytes": 0, 2024-03-16T07:37:07.964 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_shared_blob_items": 0, 2024-03-16T07:37:07.964 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_inline_bl_bytes": 0, 2024-03-16T07:37:07.964 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_inline_bl_items": 0, 2024-03-16T07:37:07.964 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_fsck_bytes": 0, 2024-03-16T07:37:07.964 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_fsck_items": 0, 2024-03-16T07:37:07.964 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_txc_bytes": 0, 2024-03-16T07:37:07.964 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_txc_items": 0, 2024-03-16T07:37:07.964 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_deferred_bytes": 0, 2024-03-16T07:37:07.964 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_deferred_items": 0, 2024-03-16T07:37:07.964 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_bytes": 0, 2024-03-16T07:37:07.964 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_items": 0, 2024-03-16T07:37:07.964 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_bytes": 0, 2024-03-16T07:37:07.964 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_items": 0, 2024-03-16T07:37:07.964 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_reader_bytes": 0, 2024-03-16T07:37:07.964 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_reader_items": 0, 2024-03-16T07:37:07.965 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_writer_bytes": 0, 2024-03-16T07:37:07.965 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_writer_items": 0, 2024-03-16T07:37:07.965 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_anon_bytes": 182461, 2024-03-16T07:37:07.965 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_anon_items": 55, 2024-03-16T07:37:07.965 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_meta_bytes": 0, 2024-03-16T07:37:07.965 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_meta_items": 0, 2024-03-16T07:37:07.965 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_bytes": 0, 2024-03-16T07:37:07.965 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_items": 0, 2024-03-16T07:37:07.965 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_mapbl_bytes": 0, 2024-03-16T07:37:07.965 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_mapbl_items": 0, 2024-03-16T07:37:07.965 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pglog_bytes": 0, 2024-03-16T07:37:07.965 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pglog_items": 0, 2024-03-16T07:37:07.965 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_bytes": 19336, 2024-03-16T07:37:07.965 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_items": 192, 2024-03-16T07:37:07.965 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_mapping_bytes": 0, 2024-03-16T07:37:07.965 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_mapping_items": 0, 2024-03-16T07:37:07.965 INFO:teuthology.orchestra.run.smithi049.stdout: "pgmap_bytes": 0, 2024-03-16T07:37:07.966 INFO:teuthology.orchestra.run.smithi049.stdout: "pgmap_items": 0, 2024-03-16T07:37:07.966 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_co_bytes": 0, 2024-03-16T07:37:07.966 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_co_items": 0, 2024-03-16T07:37:07.966 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_1_bytes": 0, 2024-03-16T07:37:07.966 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_1_items": 0, 2024-03-16T07:37:07.966 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_2_bytes": 0, 2024-03-16T07:37:07.966 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_2_items": 0 2024-03-16T07:37:07.966 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:07.966 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:07.966 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:37:07.966 INFO:teuthology.orchestra.run.smithi049.stdout: "objecter": [ 2024-03-16T07:37:07.966 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:37:07.966 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:37:07.967 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:37:07.967 INFO:teuthology.orchestra.run.smithi049.stdout: "op_active": 0, 2024-03-16T07:37:07.967 INFO:teuthology.orchestra.run.smithi049.stdout: "op_laggy": 0, 2024-03-16T07:37:07.967 INFO:teuthology.orchestra.run.smithi049.stdout: "op_send": 0, 2024-03-16T07:37:07.967 INFO:teuthology.orchestra.run.smithi049.stdout: "op_send_bytes": 0, 2024-03-16T07:37:07.967 INFO:teuthology.orchestra.run.smithi049.stdout: "op_resend": 0, 2024-03-16T07:37:07.967 INFO:teuthology.orchestra.run.smithi049.stdout: "op_reply": 0, 2024-03-16T07:37:07.967 INFO:teuthology.orchestra.run.smithi049.stdout: "op_latency": { 2024-03-16T07:37:07.967 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:37:07.967 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:37:07.967 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:37:07.967 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:37:07.967 INFO:teuthology.orchestra.run.smithi049.stdout: "op_inflight": 0, 2024-03-16T07:37:07.967 INFO:teuthology.orchestra.run.smithi049.stdout: "oplen_avg": { 2024-03-16T07:37:07.967 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:37:07.967 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0 2024-03-16T07:37:07.967 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:37:07.968 INFO:teuthology.orchestra.run.smithi049.stdout: "op": 0, 2024-03-16T07:37:07.968 INFO:teuthology.orchestra.run.smithi049.stdout: "op_r": 0, 2024-03-16T07:37:07.968 INFO:teuthology.orchestra.run.smithi049.stdout: "op_w": 0, 2024-03-16T07:37:07.968 INFO:teuthology.orchestra.run.smithi049.stdout: "op_rmw": 0, 2024-03-16T07:37:07.968 INFO:teuthology.orchestra.run.smithi049.stdout: "op_pg": 0, 2024-03-16T07:37:07.968 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_stat": 0, 2024-03-16T07:37:07.968 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_create": 0, 2024-03-16T07:37:07.968 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_read": 0, 2024-03-16T07:37:07.968 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_write": 0, 2024-03-16T07:37:07.968 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_writefull": 0, 2024-03-16T07:37:07.968 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_writesame": 0, 2024-03-16T07:37:07.968 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_append": 0, 2024-03-16T07:37:07.968 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_zero": 0, 2024-03-16T07:37:07.968 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_truncate": 0, 2024-03-16T07:37:07.968 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_delete": 0, 2024-03-16T07:37:07.968 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_mapext": 0, 2024-03-16T07:37:07.968 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_sparse_read": 0, 2024-03-16T07:37:07.969 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_clonerange": 0, 2024-03-16T07:37:07.969 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_getxattr": 0, 2024-03-16T07:37:07.969 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_setxattr": 0, 2024-03-16T07:37:07.969 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_cmpxattr": 0, 2024-03-16T07:37:07.969 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_rmxattr": 0, 2024-03-16T07:37:07.969 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_resetxattrs": 0, 2024-03-16T07:37:07.969 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_call": 0, 2024-03-16T07:37:07.969 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_watch": 0, 2024-03-16T07:37:07.969 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_notify": 0, 2024-03-16T07:37:07.969 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_src_cmpxattr": 0, 2024-03-16T07:37:07.969 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_pgls": 0, 2024-03-16T07:37:07.969 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_pgls_filter": 0, 2024-03-16T07:37:07.969 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_other": 0, 2024-03-16T07:37:07.969 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_active": 0, 2024-03-16T07:37:07.969 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_send": 0, 2024-03-16T07:37:07.970 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_resend": 0, 2024-03-16T07:37:07.970 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_ping": 0, 2024-03-16T07:37:07.970 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_active": 0, 2024-03-16T07:37:07.970 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_send": 0, 2024-03-16T07:37:07.970 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_resend": 0, 2024-03-16T07:37:07.970 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_active": 0, 2024-03-16T07:37:07.970 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_send": 0, 2024-03-16T07:37:07.970 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_resend": 0, 2024-03-16T07:37:07.970 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_active": 0, 2024-03-16T07:37:07.970 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_send": 0, 2024-03-16T07:37:07.970 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_resend": 0, 2024-03-16T07:37:07.970 INFO:teuthology.orchestra.run.smithi049.stdout: "command_active": 0, 2024-03-16T07:37:07.970 INFO:teuthology.orchestra.run.smithi049.stdout: "command_send": 0, 2024-03-16T07:37:07.970 INFO:teuthology.orchestra.run.smithi049.stdout: "command_resend": 0, 2024-03-16T07:37:07.970 INFO:teuthology.orchestra.run.smithi049.stdout: "map_epoch": 0, 2024-03-16T07:37:07.971 INFO:teuthology.orchestra.run.smithi049.stdout: "map_full": 0, 2024-03-16T07:37:07.971 INFO:teuthology.orchestra.run.smithi049.stdout: "map_inc": 0, 2024-03-16T07:37:07.971 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_sessions": 0, 2024-03-16T07:37:07.971 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_session_open": 0, 2024-03-16T07:37:07.971 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_session_close": 0, 2024-03-16T07:37:07.971 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_laggy": 0, 2024-03-16T07:37:07.971 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_wr": 0, 2024-03-16T07:37:07.971 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_rd": 0, 2024-03-16T07:37:07.971 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_del": 0 2024-03-16T07:37:07.971 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:07.971 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:07.971 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:37:07.971 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-msgr_dispatch_throttler-client": [ 2024-03-16T07:37:07.971 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:37:07.971 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:37:07.971 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:37:07.972 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:37:07.972 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-03-16T07:37:07.972 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:37:07.972 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 122, 2024-03-16T07:37:07.972 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 485871, 2024-03-16T07:37:07.972 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:37:07.972 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 122, 2024-03-16T07:37:07.972 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:37:07.972 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:37:07.972 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 122, 2024-03-16T07:37:07.972 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 485871, 2024-03-16T07:37:07.972 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:37:07.972 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:37:07.972 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:37:07.972 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:37:07.972 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:07.973 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:07.973 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:07.973 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:37:07.973 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-msgr_dispatch_throttler-radosclient": [ 2024-03-16T07:37:07.973 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:37:07.973 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:37:07.973 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:37:07.973 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:37:07.973 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-03-16T07:37:07.973 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:37:07.973 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 89, 2024-03-16T07:37:07.973 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 3049644, 2024-03-16T07:37:07.973 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:37:07.973 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 89, 2024-03-16T07:37:07.973 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:37:07.974 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:37:07.974 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 89, 2024-03-16T07:37:07.974 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 3049644, 2024-03-16T07:37:07.974 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:37:07.974 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:37:07.974 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:37:07.974 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:37:07.974 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:07.974 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:07.974 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:07.974 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:37:07.974 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-objecter_bytes": [ 2024-03-16T07:37:07.974 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:37:07.974 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:37:07.974 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:37:07.975 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:37:07.975 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-03-16T07:37:07.975 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:37:07.975 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 0, 2024-03-16T07:37:07.975 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 0, 2024-03-16T07:37:07.975 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:37:07.975 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 0, 2024-03-16T07:37:07.975 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:37:07.975 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:37:07.975 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 0, 2024-03-16T07:37:07.975 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 0, 2024-03-16T07:37:07.975 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:37:07.975 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:37:07.975 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:37:07.976 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:37:07.976 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:07.976 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:07.976 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:07.976 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:37:07.976 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-objecter_ops": [ 2024-03-16T07:37:07.976 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:37:07.976 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:37:07.976 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:37:07.976 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:37:07.976 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 1024, 2024-03-16T07:37:07.976 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:37:07.976 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 0, 2024-03-16T07:37:07.976 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 0, 2024-03-16T07:37:07.976 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:37:07.976 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 0, 2024-03-16T07:37:07.976 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:37:07.977 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:37:07.977 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 0, 2024-03-16T07:37:07.977 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 0, 2024-03-16T07:37:07.977 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:37:07.977 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:37:07.977 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:37:07.977 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:37:07.977 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:07.977 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:07.977 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:07.977 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2024-03-16T07:37:07.977 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-03-16T07:37:07.978 DEBUG:tasks.cephfs.test_mirroring:command returned={ "AsyncMessenger::Worker": [ { "labels": { "id": "0" }, "counters": { "msgr_connection_ready_timeouts": 0, "msgr_connection_idle_timeouts": 0 } }, { "labels": { "id": "1" }, "counters": { "msgr_connection_ready_timeouts": 0, "msgr_connection_idle_timeouts": 0 } }, { "labels": { "id": "2" }, "counters": { "msgr_connection_ready_timeouts": 0, "msgr_connection_idle_timeouts": 0 } } ], "AsyncMessenger::Worker-0": [ { "labels": {}, "counters": { "msgr_recv_messages": 13, "msgr_send_messages": 152, "msgr_recv_bytes": 1872, "msgr_send_bytes": 1060848, "msgr_created_connections": 26, "msgr_active_connections": 5, "msgr_running_total_time": 0.379995820, "msgr_running_send_time": 0.153268407, "msgr_running_recv_time": 0.173849705, "msgr_running_fast_dispatch_time": 0.000000000, "msgr_send_messages_queue_lat": { "avgcount": 140, "sum": 0.215374428, "avgtime": 0.001538388 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "msgr_recv_encrypted_bytes": 1872, "msgr_send_encrypted_bytes": 1060848 } } ], "AsyncMessenger::Worker-1": [ { "labels": {}, "counters": { "msgr_recv_messages": 122, "msgr_send_messages": 9, "msgr_recv_bytes": 502432, "msgr_send_bytes": 1776, "msgr_created_connections": 4, "msgr_active_connections": 0, "msgr_running_total_time": 0.748071738, "msgr_running_send_time": 0.050778237, "msgr_running_recv_time": 0.478876877, "msgr_running_fast_dispatch_time": 0.191550009, "msgr_send_messages_queue_lat": { "avgcount": 8, "sum": 0.187770743, "avgtime": 0.023471342 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "msgr_recv_encrypted_bytes": 502432, "msgr_send_encrypted_bytes": 1776 } } ], "AsyncMessenger::Worker-2": [ { "labels": {}, "counters": { "msgr_recv_messages": 79, "msgr_send_messages": 12, "msgr_recv_bytes": 3060752, "msgr_send_bytes": 2240, "msgr_created_connections": 3, "msgr_active_connections": 1, "msgr_running_total_time": 1.735406584, "msgr_running_send_time": 0.015392300, "msgr_running_recv_time": 3.124450875, "msgr_running_fast_dispatch_time": 0.000000000, "msgr_send_messages_queue_lat": { "avgcount": 11, "sum": 0.346048562, "avgtime": 0.031458960 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "msgr_recv_encrypted_bytes": 3060752, "msgr_send_encrypted_bytes": 2240 } } ], "cct": [ { "labels": {}, "counters": { "total_workers": 0, "unhealthy_workers": 0 } } ], "cephfs_mirror": [ { "labels": {}, "counters": { "mirrored_filesystems": 2, "mirror_enable_failures": 0 } } ], "cephfs_mirror_mirrored_filesystems": [ { "labels": { "filesystem": "cephfs" }, "counters": { "mirroring_peers": 0, "directory_count": 2 } } ], "mempool": [ { "labels": {}, "counters": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_cache_buffer_bytes": 0, "bluestore_cache_buffer_items": 0, "bluestore_extent_bytes": 0, "bluestore_extent_items": 0, "bluestore_blob_bytes": 0, "bluestore_blob_items": 0, "bluestore_shared_blob_bytes": 0, "bluestore_shared_blob_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_items": 0, "bluefs_bytes": 0, "bluefs_items": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "buffer_anon_bytes": 182461, "buffer_anon_items": 55, "buffer_meta_bytes": 0, "buffer_meta_items": 0, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 19336, "osdmap_items": 192, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "mds_co_bytes": 0, "mds_co_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 } } ], "objecter": [ { "labels": {}, "counters": { "op_active": 0, "op_laggy": 0, "op_send": 0, "op_send_bytes": 0, "op_resend": 0, "op_reply": 0, "op_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "op_inflight": 0, "oplen_avg": { "avgcount": 0, "sum": 0 }, "op": 0, "op_r": 0, "op_w": 0, "op_rmw": 0, "op_pg": 0, "osdop_stat": 0, "osdop_create": 0, "osdop_read": 0, "osdop_write": 0, "osdop_writefull": 0, "osdop_writesame": 0, "osdop_append": 0, "osdop_zero": 0, "osdop_truncate": 0, "osdop_delete": 0, "osdop_mapext": 0, "osdop_sparse_read": 0, "osdop_clonerange": 0, "osdop_getxattr": 0, "osdop_setxattr": 0, "osdop_cmpxattr": 0, "osdop_rmxattr": 0, "osdop_resetxattrs": 0, "osdop_call": 0, "osdop_watch": 0, "osdop_notify": 0, "osdop_src_cmpxattr": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_other": 0, "linger_active": 0, "linger_send": 0, "linger_resend": 0, "linger_ping": 0, "poolop_active": 0, "poolop_send": 0, "poolop_resend": 0, "poolstat_active": 0, "poolstat_send": 0, "poolstat_resend": 0, "statfs_active": 0, "statfs_send": 0, "statfs_resend": 0, "command_active": 0, "command_send": 0, "command_resend": 0, "map_epoch": 0, "map_full": 0, "map_inc": 0, "osd_sessions": 0, "osd_session_open": 0, "osd_session_close": 0, "osd_laggy": 0, "omap_wr": 0, "omap_rd": 0, "omap_del": 0 } } ], "throttle-msgr_dispatch_throttler-client": [ { "labels": {}, "counters": { "val": 0, "max": 104857600, "get_started": 0, "get": 122, "get_sum": 485871, "get_or_fail_fail": 0, "get_or_fail_success": 122, "take": 0, "take_sum": 0, "put": 122, "put_sum": 485871, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ], "throttle-msgr_dispatch_throttler-radosclient": [ { "labels": {}, "counters": { "val": 0, "max": 104857600, "get_started": 0, "get": 89, "get_sum": 3049644, "get_or_fail_fail": 0, "get_or_fail_success": 89, "take": 0, "take_sum": 0, "put": 89, "put_sum": 3049644, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ], "throttle-objecter_bytes": [ { "labels": {}, "counters": { "val": 0, "max": 104857600, "get_started": 0, "get": 0, "get_sum": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "take": 0, "take_sum": 0, "put": 0, "put_sum": 0, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ], "throttle-objecter_ops": [ { "labels": {}, "counters": { "val": 0, "max": 1024, "get_started": 0, "get": 0, "get_sum": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "take": 0, "take_sum": 0, "put": 0, "put_sum": 0, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ] } 2024-03-16T07:37:07.978 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-03-16T07:37:07.978 DEBUG:teuthology.orchestra.run.smithi049:mirror status for fs: cephfs> ceph --admin-daemon /var/run/ceph/cephfs-mirror.asok fs mirror status cephfs@14 2024-03-16T07:37:08.085 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-03-16T07:37:08.085 INFO:teuthology.orchestra.run.smithi049.stdout: "rados_inst": "172.21.15.49:0/1186634239", 2024-03-16T07:37:08.085 INFO:teuthology.orchestra.run.smithi049.stdout: "peers": {}, 2024-03-16T07:37:08.085 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_dirs": { 2024-03-16T07:37:08.085 INFO:teuthology.orchestra.run.smithi049.stdout: "dir_count": 2 2024-03-16T07:37:08.085 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:08.085 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-03-16T07:37:08.096 DEBUG:tasks.cephfs.test_mirroring:command returned={ "rados_inst": "172.21.15.49:0/1186634239", "peers": {}, "snap_dirs": { "dir_count": 2 } } 2024-03-16T07:37:08.096 DEBUG:tasks.cephfs.test_mirroring:initial dir_count=2 2024-03-16T07:37:08.096 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snapshot mirror add cephfs /d2 2024-03-16T07:37:08.560 INFO:teuthology.orchestra.run.smithi049.stdout:{} 2024-03-16T07:37:09.548 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T07:37:18.574 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-03-16T07:37:18.575 DEBUG:teuthology.orchestra.run.smithi049:mirror status for fs: cephfs> ceph --admin-daemon /var/run/ceph/cephfs-mirror.asok fs mirror status cephfs@14 2024-03-16T07:37:18.676 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-03-16T07:37:18.676 INFO:teuthology.orchestra.run.smithi049.stdout: "rados_inst": "172.21.15.49:0/1186634239", 2024-03-16T07:37:18.676 INFO:teuthology.orchestra.run.smithi049.stdout: "peers": {}, 2024-03-16T07:37:18.676 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_dirs": { 2024-03-16T07:37:18.676 INFO:teuthology.orchestra.run.smithi049.stdout: "dir_count": 3 2024-03-16T07:37:18.676 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:18.676 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-03-16T07:37:18.683 DEBUG:tasks.cephfs.test_mirroring:command returned={ "rados_inst": "172.21.15.49:0/1186634239", "peers": {}, "snap_dirs": { "dir_count": 3 } } 2024-03-16T07:37:18.683 DEBUG:tasks.cephfs.test_mirroring:new dir_count=3 2024-03-16T07:37:18.683 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-03-16T07:37:18.683 DEBUG:teuthology.orchestra.run.smithi049:counter dump for fs: cephfs> ceph --admin-daemon /var/run/ceph/cephfs-mirror.asok counter dump 2024-03-16T07:37:18.789 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-03-16T07:37:18.789 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker": [ 2024-03-16T07:37:18.789 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:37:18.789 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:37:18.789 INFO:teuthology.orchestra.run.smithi049.stdout: "id": "0" 2024-03-16T07:37:18.789 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:37:18.790 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:37:18.790 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_ready_timeouts": 0, 2024-03-16T07:37:18.790 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_idle_timeouts": 0 2024-03-16T07:37:18.790 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:18.790 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:37:18.790 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:37:18.790 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:37:18.790 INFO:teuthology.orchestra.run.smithi049.stdout: "id": "1" 2024-03-16T07:37:18.790 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:37:18.790 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:37:18.790 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_ready_timeouts": 0, 2024-03-16T07:37:18.790 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_idle_timeouts": 0 2024-03-16T07:37:18.790 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:18.790 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:37:18.790 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:37:18.790 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:37:18.791 INFO:teuthology.orchestra.run.smithi049.stdout: "id": "2" 2024-03-16T07:37:18.791 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:37:18.791 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:37:18.791 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_ready_timeouts": 0, 2024-03-16T07:37:18.791 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_idle_timeouts": 0 2024-03-16T07:37:18.791 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:18.791 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:18.791 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:37:18.791 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-0": [ 2024-03-16T07:37:18.791 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:37:18.791 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:37:18.791 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:37:18.791 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 13, 2024-03-16T07:37:18.791 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 154, 2024-03-16T07:37:18.791 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 1872, 2024-03-16T07:37:18.791 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 1061408, 2024-03-16T07:37:18.792 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 26, 2024-03-16T07:37:18.792 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 5, 2024-03-16T07:37:18.792 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 0.380744785, 2024-03-16T07:37:18.792 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.153952794, 2024-03-16T07:37:18.792 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 0.173849705, 2024-03-16T07:37:18.792 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-03-16T07:37:18.792 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T07:37:18.792 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 142, 2024-03-16T07:37:18.792 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.215675838, 2024-03-16T07:37:18.792 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.001518843 2024-03-16T07:37:18.792 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:37:18.792 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-03-16T07:37:18.792 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:37:18.792 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:37:18.792 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:37:18.792 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:37:18.793 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 1872, 2024-03-16T07:37:18.793 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 1061408 2024-03-16T07:37:18.793 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:18.793 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:18.793 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:37:18.793 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-1": [ 2024-03-16T07:37:18.793 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:37:18.793 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:37:18.793 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:37:18.793 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 123, 2024-03-16T07:37:18.793 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 10, 2024-03-16T07:37:18.793 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 502768, 2024-03-16T07:37:18.793 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 2112, 2024-03-16T07:37:18.793 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 4, 2024-03-16T07:37:18.793 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 0, 2024-03-16T07:37:18.793 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 0.752474609, 2024-03-16T07:37:18.794 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.052012174, 2024-03-16T07:37:18.794 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 0.481859068, 2024-03-16T07:37:18.794 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.191550009, 2024-03-16T07:37:18.794 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T07:37:18.794 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 9, 2024-03-16T07:37:18.794 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.188856872, 2024-03-16T07:37:18.794 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.020984096 2024-03-16T07:37:18.794 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:37:18.794 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-03-16T07:37:18.794 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:37:18.794 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:37:18.794 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:37:18.794 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:37:18.794 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 502768, 2024-03-16T07:37:18.794 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 2112 2024-03-16T07:37:18.794 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:18.795 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:18.795 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:37:18.795 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-2": [ 2024-03-16T07:37:18.795 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:37:18.795 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:37:18.795 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:37:18.795 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 80, 2024-03-16T07:37:18.795 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 13, 2024-03-16T07:37:18.795 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 3061520, 2024-03-16T07:37:18.795 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 2576, 2024-03-16T07:37:18.795 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 3, 2024-03-16T07:37:18.795 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 1, 2024-03-16T07:37:18.795 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 1.739031013, 2024-03-16T07:37:18.795 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.016486708, 2024-03-16T07:37:18.795 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 3.126662818, 2024-03-16T07:37:18.795 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-03-16T07:37:18.796 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T07:37:18.796 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 12, 2024-03-16T07:37:18.796 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.346963753, 2024-03-16T07:37:18.796 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.028913646 2024-03-16T07:37:18.796 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:37:18.796 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-03-16T07:37:18.796 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:37:18.796 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:37:18.796 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:37:18.796 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:37:18.796 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 3061520, 2024-03-16T07:37:18.796 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 2576 2024-03-16T07:37:18.796 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:18.796 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:18.797 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:37:18.797 INFO:teuthology.orchestra.run.smithi049.stdout: "cct": [ 2024-03-16T07:37:18.797 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:37:18.797 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:37:18.797 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:37:18.797 INFO:teuthology.orchestra.run.smithi049.stdout: "total_workers": 0, 2024-03-16T07:37:18.797 INFO:teuthology.orchestra.run.smithi049.stdout: "unhealthy_workers": 0 2024-03-16T07:37:18.797 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:18.797 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:18.797 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:37:18.797 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs_mirror": [ 2024-03-16T07:37:18.798 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:37:18.798 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:37:18.798 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:37:18.798 INFO:teuthology.orchestra.run.smithi049.stdout: "mirrored_filesystems": 2, 2024-03-16T07:37:18.798 INFO:teuthology.orchestra.run.smithi049.stdout: "mirror_enable_failures": 0 2024-03-16T07:37:18.798 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:18.798 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:18.798 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:37:18.798 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs_mirror_mirrored_filesystems": [ 2024-03-16T07:37:18.798 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:37:18.798 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:37:18.798 INFO:teuthology.orchestra.run.smithi049.stdout: "filesystem": "cephfs" 2024-03-16T07:37:18.798 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:37:18.799 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:37:18.799 INFO:teuthology.orchestra.run.smithi049.stdout: "mirroring_peers": 0, 2024-03-16T07:37:18.799 INFO:teuthology.orchestra.run.smithi049.stdout: "directory_count": 3 2024-03-16T07:37:18.799 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:18.799 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:18.799 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:37:18.799 INFO:teuthology.orchestra.run.smithi049.stdout: "mempool": [ 2024-03-16T07:37:18.799 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:37:18.799 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:37:18.799 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:37:18.799 INFO:teuthology.orchestra.run.smithi049.stdout: "bloom_filter_bytes": 0, 2024-03-16T07:37:18.799 INFO:teuthology.orchestra.run.smithi049.stdout: "bloom_filter_items": 0, 2024-03-16T07:37:18.799 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_alloc_bytes": 0, 2024-03-16T07:37:18.799 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_alloc_items": 0, 2024-03-16T07:37:18.800 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_data_bytes": 0, 2024-03-16T07:37:18.800 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_data_items": 0, 2024-03-16T07:37:18.800 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_onode_bytes": 0, 2024-03-16T07:37:18.800 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_onode_items": 0, 2024-03-16T07:37:18.800 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_meta_bytes": 0, 2024-03-16T07:37:18.800 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_meta_items": 0, 2024-03-16T07:37:18.800 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_other_bytes": 0, 2024-03-16T07:37:18.800 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_other_items": 0, 2024-03-16T07:37:18.800 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_buffer_bytes": 0, 2024-03-16T07:37:18.800 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_buffer_items": 0, 2024-03-16T07:37:18.801 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_extent_bytes": 0, 2024-03-16T07:37:18.801 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_extent_items": 0, 2024-03-16T07:37:18.801 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_blob_bytes": 0, 2024-03-16T07:37:18.801 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_blob_items": 0, 2024-03-16T07:37:18.801 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_shared_blob_bytes": 0, 2024-03-16T07:37:18.801 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_shared_blob_items": 0, 2024-03-16T07:37:18.801 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_inline_bl_bytes": 0, 2024-03-16T07:37:18.801 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_inline_bl_items": 0, 2024-03-16T07:37:18.801 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_fsck_bytes": 0, 2024-03-16T07:37:18.801 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_fsck_items": 0, 2024-03-16T07:37:18.801 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_txc_bytes": 0, 2024-03-16T07:37:18.801 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_txc_items": 0, 2024-03-16T07:37:18.801 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_deferred_bytes": 0, 2024-03-16T07:37:18.802 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_deferred_items": 0, 2024-03-16T07:37:18.802 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_bytes": 0, 2024-03-16T07:37:18.802 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_items": 0, 2024-03-16T07:37:18.802 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_bytes": 0, 2024-03-16T07:37:18.802 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_items": 0, 2024-03-16T07:37:18.802 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_reader_bytes": 0, 2024-03-16T07:37:18.802 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_reader_items": 0, 2024-03-16T07:37:18.802 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_writer_bytes": 0, 2024-03-16T07:37:18.802 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_writer_items": 0, 2024-03-16T07:37:18.802 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_anon_bytes": 182461, 2024-03-16T07:37:18.802 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_anon_items": 55, 2024-03-16T07:37:18.802 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_meta_bytes": 0, 2024-03-16T07:37:18.802 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_meta_items": 0, 2024-03-16T07:37:18.802 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_bytes": 0, 2024-03-16T07:37:18.803 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_items": 0, 2024-03-16T07:37:18.803 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_mapbl_bytes": 0, 2024-03-16T07:37:18.803 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_mapbl_items": 0, 2024-03-16T07:37:18.803 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pglog_bytes": 0, 2024-03-16T07:37:18.803 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pglog_items": 0, 2024-03-16T07:37:18.803 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_bytes": 19336, 2024-03-16T07:37:18.803 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_items": 192, 2024-03-16T07:37:18.803 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_mapping_bytes": 0, 2024-03-16T07:37:18.803 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_mapping_items": 0, 2024-03-16T07:37:18.803 INFO:teuthology.orchestra.run.smithi049.stdout: "pgmap_bytes": 0, 2024-03-16T07:37:18.803 INFO:teuthology.orchestra.run.smithi049.stdout: "pgmap_items": 0, 2024-03-16T07:37:18.803 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_co_bytes": 0, 2024-03-16T07:37:18.803 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_co_items": 0, 2024-03-16T07:37:18.803 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_1_bytes": 0, 2024-03-16T07:37:18.804 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_1_items": 0, 2024-03-16T07:37:18.804 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_2_bytes": 0, 2024-03-16T07:37:18.804 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_2_items": 0 2024-03-16T07:37:18.804 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:18.804 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:18.804 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:37:18.804 INFO:teuthology.orchestra.run.smithi049.stdout: "objecter": [ 2024-03-16T07:37:18.804 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:37:18.804 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:37:18.804 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:37:18.804 INFO:teuthology.orchestra.run.smithi049.stdout: "op_active": 0, 2024-03-16T07:37:18.804 INFO:teuthology.orchestra.run.smithi049.stdout: "op_laggy": 0, 2024-03-16T07:37:18.804 INFO:teuthology.orchestra.run.smithi049.stdout: "op_send": 0, 2024-03-16T07:37:18.804 INFO:teuthology.orchestra.run.smithi049.stdout: "op_send_bytes": 0, 2024-03-16T07:37:18.804 INFO:teuthology.orchestra.run.smithi049.stdout: "op_resend": 0, 2024-03-16T07:37:18.805 INFO:teuthology.orchestra.run.smithi049.stdout: "op_reply": 0, 2024-03-16T07:37:18.805 INFO:teuthology.orchestra.run.smithi049.stdout: "op_latency": { 2024-03-16T07:37:18.805 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:37:18.805 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:37:18.805 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:37:18.805 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:37:18.805 INFO:teuthology.orchestra.run.smithi049.stdout: "op_inflight": 0, 2024-03-16T07:37:18.805 INFO:teuthology.orchestra.run.smithi049.stdout: "oplen_avg": { 2024-03-16T07:37:18.805 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:37:18.805 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0 2024-03-16T07:37:18.805 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:37:18.805 INFO:teuthology.orchestra.run.smithi049.stdout: "op": 0, 2024-03-16T07:37:18.805 INFO:teuthology.orchestra.run.smithi049.stdout: "op_r": 0, 2024-03-16T07:37:18.805 INFO:teuthology.orchestra.run.smithi049.stdout: "op_w": 0, 2024-03-16T07:37:18.806 INFO:teuthology.orchestra.run.smithi049.stdout: "op_rmw": 0, 2024-03-16T07:37:18.806 INFO:teuthology.orchestra.run.smithi049.stdout: "op_pg": 0, 2024-03-16T07:37:18.806 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_stat": 0, 2024-03-16T07:37:18.806 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_create": 0, 2024-03-16T07:37:18.806 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_read": 0, 2024-03-16T07:37:18.806 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_write": 0, 2024-03-16T07:37:18.806 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_writefull": 0, 2024-03-16T07:37:18.806 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_writesame": 0, 2024-03-16T07:37:18.806 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_append": 0, 2024-03-16T07:37:18.806 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_zero": 0, 2024-03-16T07:37:18.806 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_truncate": 0, 2024-03-16T07:37:18.806 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_delete": 0, 2024-03-16T07:37:18.806 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_mapext": 0, 2024-03-16T07:37:18.806 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_sparse_read": 0, 2024-03-16T07:37:18.806 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_clonerange": 0, 2024-03-16T07:37:18.807 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_getxattr": 0, 2024-03-16T07:37:18.807 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_setxattr": 0, 2024-03-16T07:37:18.807 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_cmpxattr": 0, 2024-03-16T07:37:18.807 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_rmxattr": 0, 2024-03-16T07:37:18.807 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_resetxattrs": 0, 2024-03-16T07:37:18.807 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_call": 0, 2024-03-16T07:37:18.807 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_watch": 0, 2024-03-16T07:37:18.807 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_notify": 0, 2024-03-16T07:37:18.807 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_src_cmpxattr": 0, 2024-03-16T07:37:18.807 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_pgls": 0, 2024-03-16T07:37:18.807 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_pgls_filter": 0, 2024-03-16T07:37:18.807 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_other": 0, 2024-03-16T07:37:18.807 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_active": 0, 2024-03-16T07:37:18.807 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_send": 0, 2024-03-16T07:37:18.807 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_resend": 0, 2024-03-16T07:37:18.808 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_ping": 0, 2024-03-16T07:37:18.808 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_active": 0, 2024-03-16T07:37:18.808 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_send": 0, 2024-03-16T07:37:18.808 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_resend": 0, 2024-03-16T07:37:18.808 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_active": 0, 2024-03-16T07:37:18.808 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_send": 0, 2024-03-16T07:37:18.808 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_resend": 0, 2024-03-16T07:37:18.808 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_active": 0, 2024-03-16T07:37:18.808 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_send": 0, 2024-03-16T07:37:18.808 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_resend": 0, 2024-03-16T07:37:18.808 INFO:teuthology.orchestra.run.smithi049.stdout: "command_active": 0, 2024-03-16T07:37:18.808 INFO:teuthology.orchestra.run.smithi049.stdout: "command_send": 0, 2024-03-16T07:37:18.808 INFO:teuthology.orchestra.run.smithi049.stdout: "command_resend": 0, 2024-03-16T07:37:18.808 INFO:teuthology.orchestra.run.smithi049.stdout: "map_epoch": 0, 2024-03-16T07:37:18.808 INFO:teuthology.orchestra.run.smithi049.stdout: "map_full": 0, 2024-03-16T07:37:18.808 INFO:teuthology.orchestra.run.smithi049.stdout: "map_inc": 0, 2024-03-16T07:37:18.809 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_sessions": 0, 2024-03-16T07:37:18.809 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_session_open": 0, 2024-03-16T07:37:18.809 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_session_close": 0, 2024-03-16T07:37:18.809 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_laggy": 0, 2024-03-16T07:37:18.809 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_wr": 0, 2024-03-16T07:37:18.809 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_rd": 0, 2024-03-16T07:37:18.809 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_del": 0 2024-03-16T07:37:18.809 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:18.809 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:18.809 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:37:18.809 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-msgr_dispatch_throttler-client": [ 2024-03-16T07:37:18.809 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:37:18.809 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:37:18.809 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:37:18.809 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:37:18.810 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-03-16T07:37:18.810 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:37:18.810 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 123, 2024-03-16T07:37:18.810 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 486077, 2024-03-16T07:37:18.810 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:37:18.810 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 123, 2024-03-16T07:37:18.810 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:37:18.810 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:37:18.810 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 123, 2024-03-16T07:37:18.810 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 486077, 2024-03-16T07:37:18.810 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:37:18.810 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:37:18.810 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:37:18.810 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:37:18.810 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:18.811 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:18.811 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:18.811 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:37:18.811 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-msgr_dispatch_throttler-radosclient": [ 2024-03-16T07:37:18.811 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:37:18.811 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:37:18.811 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:37:18.811 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:37:18.811 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-03-16T07:37:18.811 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:37:18.811 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 90, 2024-03-16T07:37:18.811 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 3050272, 2024-03-16T07:37:18.811 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:37:18.811 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 90, 2024-03-16T07:37:18.811 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:37:18.811 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:37:18.812 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 90, 2024-03-16T07:37:18.812 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 3050272, 2024-03-16T07:37:18.812 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:37:18.812 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:37:18.812 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:37:18.812 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:37:18.812 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:18.812 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:18.812 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:18.812 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:37:18.812 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-objecter_bytes": [ 2024-03-16T07:37:18.812 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:37:18.812 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:37:18.812 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:37:18.812 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:37:18.812 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-03-16T07:37:18.813 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:37:18.813 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 0, 2024-03-16T07:37:18.813 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 0, 2024-03-16T07:37:18.813 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:37:18.813 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 0, 2024-03-16T07:37:18.813 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:37:18.813 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:37:18.813 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 0, 2024-03-16T07:37:18.813 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 0, 2024-03-16T07:37:18.813 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:37:18.813 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:37:18.813 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:37:18.813 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:37:18.813 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:18.813 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:18.813 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:18.813 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:37:18.814 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-objecter_ops": [ 2024-03-16T07:37:18.814 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:37:18.814 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:37:18.814 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:37:18.814 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:37:18.814 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 1024, 2024-03-16T07:37:18.814 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:37:18.814 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 0, 2024-03-16T07:37:18.814 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 0, 2024-03-16T07:37:18.814 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:37:18.814 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 0, 2024-03-16T07:37:18.814 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:37:18.814 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:37:18.814 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 0, 2024-03-16T07:37:18.814 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 0, 2024-03-16T07:37:18.815 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:37:18.815 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:37:18.815 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:37:18.815 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:37:18.815 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:18.815 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:18.815 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:18.815 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2024-03-16T07:37:18.815 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-03-16T07:37:18.816 DEBUG:tasks.cephfs.test_mirroring:command returned={ "AsyncMessenger::Worker": [ { "labels": { "id": "0" }, "counters": { "msgr_connection_ready_timeouts": 0, "msgr_connection_idle_timeouts": 0 } }, { "labels": { "id": "1" }, "counters": { "msgr_connection_ready_timeouts": 0, "msgr_connection_idle_timeouts": 0 } }, { "labels": { "id": "2" }, "counters": { "msgr_connection_ready_timeouts": 0, "msgr_connection_idle_timeouts": 0 } } ], "AsyncMessenger::Worker-0": [ { "labels": {}, "counters": { "msgr_recv_messages": 13, "msgr_send_messages": 154, "msgr_recv_bytes": 1872, "msgr_send_bytes": 1061408, "msgr_created_connections": 26, "msgr_active_connections": 5, "msgr_running_total_time": 0.380744785, "msgr_running_send_time": 0.153952794, "msgr_running_recv_time": 0.173849705, "msgr_running_fast_dispatch_time": 0.000000000, "msgr_send_messages_queue_lat": { "avgcount": 142, "sum": 0.215675838, "avgtime": 0.001518843 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "msgr_recv_encrypted_bytes": 1872, "msgr_send_encrypted_bytes": 1061408 } } ], "AsyncMessenger::Worker-1": [ { "labels": {}, "counters": { "msgr_recv_messages": 123, "msgr_send_messages": 10, "msgr_recv_bytes": 502768, "msgr_send_bytes": 2112, "msgr_created_connections": 4, "msgr_active_connections": 0, "msgr_running_total_time": 0.752474609, "msgr_running_send_time": 0.052012174, "msgr_running_recv_time": 0.481859068, "msgr_running_fast_dispatch_time": 0.191550009, "msgr_send_messages_queue_lat": { "avgcount": 9, "sum": 0.188856872, "avgtime": 0.020984096 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "msgr_recv_encrypted_bytes": 502768, "msgr_send_encrypted_bytes": 2112 } } ], "AsyncMessenger::Worker-2": [ { "labels": {}, "counters": { "msgr_recv_messages": 80, "msgr_send_messages": 13, "msgr_recv_bytes": 3061520, "msgr_send_bytes": 2576, "msgr_created_connections": 3, "msgr_active_connections": 1, "msgr_running_total_time": 1.739031013, "msgr_running_send_time": 0.016486708, "msgr_running_recv_time": 3.126662818, "msgr_running_fast_dispatch_time": 0.000000000, "msgr_send_messages_queue_lat": { "avgcount": 12, "sum": 0.346963753, "avgtime": 0.028913646 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "msgr_recv_encrypted_bytes": 3061520, "msgr_send_encrypted_bytes": 2576 } } ], "cct": [ { "labels": {}, "counters": { "total_workers": 0, "unhealthy_workers": 0 } } ], "cephfs_mirror": [ { "labels": {}, "counters": { "mirrored_filesystems": 2, "mirror_enable_failures": 0 } } ], "cephfs_mirror_mirrored_filesystems": [ { "labels": { "filesystem": "cephfs" }, "counters": { "mirroring_peers": 0, "directory_count": 3 } } ], "mempool": [ { "labels": {}, "counters": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_cache_buffer_bytes": 0, "bluestore_cache_buffer_items": 0, "bluestore_extent_bytes": 0, "bluestore_extent_items": 0, "bluestore_blob_bytes": 0, "bluestore_blob_items": 0, "bluestore_shared_blob_bytes": 0, "bluestore_shared_blob_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_items": 0, "bluefs_bytes": 0, "bluefs_items": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "buffer_anon_bytes": 182461, "buffer_anon_items": 55, "buffer_meta_bytes": 0, "buffer_meta_items": 0, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 19336, "osdmap_items": 192, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "mds_co_bytes": 0, "mds_co_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 } } ], "objecter": [ { "labels": {}, "counters": { "op_active": 0, "op_laggy": 0, "op_send": 0, "op_send_bytes": 0, "op_resend": 0, "op_reply": 0, "op_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "op_inflight": 0, "oplen_avg": { "avgcount": 0, "sum": 0 }, "op": 0, "op_r": 0, "op_w": 0, "op_rmw": 0, "op_pg": 0, "osdop_stat": 0, "osdop_create": 0, "osdop_read": 0, "osdop_write": 0, "osdop_writefull": 0, "osdop_writesame": 0, "osdop_append": 0, "osdop_zero": 0, "osdop_truncate": 0, "osdop_delete": 0, "osdop_mapext": 0, "osdop_sparse_read": 0, "osdop_clonerange": 0, "osdop_getxattr": 0, "osdop_setxattr": 0, "osdop_cmpxattr": 0, "osdop_rmxattr": 0, "osdop_resetxattrs": 0, "osdop_call": 0, "osdop_watch": 0, "osdop_notify": 0, "osdop_src_cmpxattr": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_other": 0, "linger_active": 0, "linger_send": 0, "linger_resend": 0, "linger_ping": 0, "poolop_active": 0, "poolop_send": 0, "poolop_resend": 0, "poolstat_active": 0, "poolstat_send": 0, "poolstat_resend": 0, "statfs_active": 0, "statfs_send": 0, "statfs_resend": 0, "command_active": 0, "command_send": 0, "command_resend": 0, "map_epoch": 0, "map_full": 0, "map_inc": 0, "osd_sessions": 0, "osd_session_open": 0, "osd_session_close": 0, "osd_laggy": 0, "omap_wr": 0, "omap_rd": 0, "omap_del": 0 } } ], "throttle-msgr_dispatch_throttler-client": [ { "labels": {}, "counters": { "val": 0, "max": 104857600, "get_started": 0, "get": 123, "get_sum": 486077, "get_or_fail_fail": 0, "get_or_fail_success": 123, "take": 0, "take_sum": 0, "put": 123, "put_sum": 486077, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ], "throttle-msgr_dispatch_throttler-radosclient": [ { "labels": {}, "counters": { "val": 0, "max": 104857600, "get_started": 0, "get": 90, "get_sum": 3050272, "get_or_fail_fail": 0, "get_or_fail_success": 90, "take": 0, "take_sum": 0, "put": 90, "put_sum": 3050272, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ], "throttle-objecter_bytes": [ { "labels": {}, "counters": { "val": 0, "max": 104857600, "get_started": 0, "get": 0, "get_sum": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "take": 0, "take_sum": 0, "put": 0, "put_sum": 0, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ], "throttle-objecter_ops": [ { "labels": {}, "counters": { "val": 0, "max": 1024, "get_started": 0, "get": 0, "get_sum": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "take": 0, "take_sum": 0, "put": 0, "put_sum": 0, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ] } 2024-03-16T07:37:18.816 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-03-16T07:37:18.816 DEBUG:teuthology.orchestra.run.smithi049:counter dump for fs: cephfs> ceph --admin-daemon /var/run/ceph/cephfs-mirror.asok counter dump 2024-03-16T07:37:18.922 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-03-16T07:37:18.922 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker": [ 2024-03-16T07:37:18.922 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:37:18.923 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:37:18.923 INFO:teuthology.orchestra.run.smithi049.stdout: "id": "0" 2024-03-16T07:37:18.923 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:37:18.923 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:37:18.923 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_ready_timeouts": 0, 2024-03-16T07:37:18.923 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_idle_timeouts": 0 2024-03-16T07:37:18.923 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:18.923 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:37:18.923 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:37:18.923 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:37:18.923 INFO:teuthology.orchestra.run.smithi049.stdout: "id": "1" 2024-03-16T07:37:18.923 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:37:18.923 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:37:18.923 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_ready_timeouts": 0, 2024-03-16T07:37:18.924 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_idle_timeouts": 0 2024-03-16T07:37:18.924 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:18.924 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:37:18.924 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:37:18.924 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:37:18.924 INFO:teuthology.orchestra.run.smithi049.stdout: "id": "2" 2024-03-16T07:37:18.924 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:37:18.924 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:37:18.924 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_ready_timeouts": 0, 2024-03-16T07:37:18.924 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_idle_timeouts": 0 2024-03-16T07:37:18.924 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:18.924 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:18.924 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:37:18.924 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-0": [ 2024-03-16T07:37:18.924 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:37:18.925 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:37:18.925 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:37:18.925 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 13, 2024-03-16T07:37:18.925 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 154, 2024-03-16T07:37:18.925 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 1872, 2024-03-16T07:37:18.925 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 1061408, 2024-03-16T07:37:18.925 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 26, 2024-03-16T07:37:18.925 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 5, 2024-03-16T07:37:18.925 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 0.380744785, 2024-03-16T07:37:18.925 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.153952794, 2024-03-16T07:37:18.925 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 0.173849705, 2024-03-16T07:37:18.925 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-03-16T07:37:18.925 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T07:37:18.925 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 142, 2024-03-16T07:37:18.925 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.215675838, 2024-03-16T07:37:18.925 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.001518843 2024-03-16T07:37:18.925 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:37:18.926 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-03-16T07:37:18.926 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:37:18.926 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:37:18.926 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:37:18.926 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:37:18.926 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 1872, 2024-03-16T07:37:18.926 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 1061408 2024-03-16T07:37:18.926 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:18.926 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:18.926 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:37:18.926 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-1": [ 2024-03-16T07:37:18.926 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:37:18.926 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:37:18.926 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:37:18.926 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 123, 2024-03-16T07:37:18.927 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 10, 2024-03-16T07:37:18.927 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 502768, 2024-03-16T07:37:18.927 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 2112, 2024-03-16T07:37:18.927 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 4, 2024-03-16T07:37:18.927 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 0, 2024-03-16T07:37:18.927 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 0.752474609, 2024-03-16T07:37:18.927 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.052012174, 2024-03-16T07:37:18.927 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 0.481859068, 2024-03-16T07:37:18.927 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.191550009, 2024-03-16T07:37:18.927 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T07:37:18.927 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 9, 2024-03-16T07:37:18.927 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.188856872, 2024-03-16T07:37:18.927 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.020984096 2024-03-16T07:37:18.927 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:37:18.927 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-03-16T07:37:18.928 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:37:18.928 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:37:18.928 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:37:18.928 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:37:18.928 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 502768, 2024-03-16T07:37:18.928 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 2112 2024-03-16T07:37:18.928 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:18.928 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:18.928 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:37:18.928 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-2": [ 2024-03-16T07:37:18.928 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:37:18.928 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:37:18.928 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:37:18.928 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 80, 2024-03-16T07:37:18.928 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 13, 2024-03-16T07:37:18.928 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 3061520, 2024-03-16T07:37:18.929 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 2576, 2024-03-16T07:37:18.929 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 3, 2024-03-16T07:37:18.929 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 1, 2024-03-16T07:37:18.929 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 1.739031013, 2024-03-16T07:37:18.929 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.016486708, 2024-03-16T07:37:18.929 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 3.126662818, 2024-03-16T07:37:18.929 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-03-16T07:37:18.929 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T07:37:18.929 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 12, 2024-03-16T07:37:18.929 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.346963753, 2024-03-16T07:37:18.929 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.028913646 2024-03-16T07:37:18.929 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:37:18.929 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-03-16T07:37:18.929 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:37:18.929 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:37:18.929 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:37:18.930 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:37:18.930 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 3061520, 2024-03-16T07:37:18.930 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 2576 2024-03-16T07:37:18.930 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:18.930 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:18.930 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:37:18.930 INFO:teuthology.orchestra.run.smithi049.stdout: "cct": [ 2024-03-16T07:37:18.930 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:37:18.930 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:37:18.930 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:37:18.930 INFO:teuthology.orchestra.run.smithi049.stdout: "total_workers": 0, 2024-03-16T07:37:18.930 INFO:teuthology.orchestra.run.smithi049.stdout: "unhealthy_workers": 0 2024-03-16T07:37:18.930 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:18.930 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:18.930 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:37:18.931 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs_mirror": [ 2024-03-16T07:37:18.931 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:37:18.931 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:37:18.931 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:37:18.931 INFO:teuthology.orchestra.run.smithi049.stdout: "mirrored_filesystems": 2, 2024-03-16T07:37:18.931 INFO:teuthology.orchestra.run.smithi049.stdout: "mirror_enable_failures": 0 2024-03-16T07:37:18.931 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:18.931 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:18.931 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:37:18.931 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs_mirror_mirrored_filesystems": [ 2024-03-16T07:37:18.931 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:37:18.931 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:37:18.931 INFO:teuthology.orchestra.run.smithi049.stdout: "filesystem": "cephfs" 2024-03-16T07:37:18.931 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:37:18.931 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:37:18.931 INFO:teuthology.orchestra.run.smithi049.stdout: "mirroring_peers": 0, 2024-03-16T07:37:18.931 INFO:teuthology.orchestra.run.smithi049.stdout: "directory_count": 3 2024-03-16T07:37:18.932 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:18.932 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:18.932 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:37:18.932 INFO:teuthology.orchestra.run.smithi049.stdout: "mempool": [ 2024-03-16T07:37:18.932 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:37:18.932 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:37:18.932 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:37:18.932 INFO:teuthology.orchestra.run.smithi049.stdout: "bloom_filter_bytes": 0, 2024-03-16T07:37:18.932 INFO:teuthology.orchestra.run.smithi049.stdout: "bloom_filter_items": 0, 2024-03-16T07:37:18.932 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_alloc_bytes": 0, 2024-03-16T07:37:18.932 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_alloc_items": 0, 2024-03-16T07:37:18.932 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_data_bytes": 0, 2024-03-16T07:37:18.932 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_data_items": 0, 2024-03-16T07:37:18.932 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_onode_bytes": 0, 2024-03-16T07:37:18.932 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_onode_items": 0, 2024-03-16T07:37:18.932 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_meta_bytes": 0, 2024-03-16T07:37:18.932 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_meta_items": 0, 2024-03-16T07:37:18.933 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_other_bytes": 0, 2024-03-16T07:37:18.933 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_other_items": 0, 2024-03-16T07:37:18.933 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_buffer_bytes": 0, 2024-03-16T07:37:18.933 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_buffer_items": 0, 2024-03-16T07:37:18.933 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_extent_bytes": 0, 2024-03-16T07:37:18.933 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_extent_items": 0, 2024-03-16T07:37:18.933 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_blob_bytes": 0, 2024-03-16T07:37:18.933 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_blob_items": 0, 2024-03-16T07:37:18.933 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_shared_blob_bytes": 0, 2024-03-16T07:37:18.933 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_shared_blob_items": 0, 2024-03-16T07:37:18.933 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_inline_bl_bytes": 0, 2024-03-16T07:37:18.933 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_inline_bl_items": 0, 2024-03-16T07:37:18.933 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_fsck_bytes": 0, 2024-03-16T07:37:18.933 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_fsck_items": 0, 2024-03-16T07:37:18.933 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_txc_bytes": 0, 2024-03-16T07:37:18.933 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_txc_items": 0, 2024-03-16T07:37:18.934 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_deferred_bytes": 0, 2024-03-16T07:37:18.934 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_deferred_items": 0, 2024-03-16T07:37:18.934 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_bytes": 0, 2024-03-16T07:37:18.934 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_items": 0, 2024-03-16T07:37:18.934 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_bytes": 0, 2024-03-16T07:37:18.934 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_items": 0, 2024-03-16T07:37:18.934 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_reader_bytes": 0, 2024-03-16T07:37:18.934 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_reader_items": 0, 2024-03-16T07:37:18.934 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_writer_bytes": 0, 2024-03-16T07:37:18.934 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_writer_items": 0, 2024-03-16T07:37:18.934 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_anon_bytes": 182461, 2024-03-16T07:37:18.934 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_anon_items": 55, 2024-03-16T07:37:18.934 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_meta_bytes": 0, 2024-03-16T07:37:18.934 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_meta_items": 0, 2024-03-16T07:37:18.934 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_bytes": 0, 2024-03-16T07:37:18.935 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_items": 0, 2024-03-16T07:37:18.935 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_mapbl_bytes": 0, 2024-03-16T07:37:18.935 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_mapbl_items": 0, 2024-03-16T07:37:18.935 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pglog_bytes": 0, 2024-03-16T07:37:18.935 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pglog_items": 0, 2024-03-16T07:37:18.935 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_bytes": 19336, 2024-03-16T07:37:18.935 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_items": 192, 2024-03-16T07:37:18.935 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_mapping_bytes": 0, 2024-03-16T07:37:18.935 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_mapping_items": 0, 2024-03-16T07:37:18.935 INFO:teuthology.orchestra.run.smithi049.stdout: "pgmap_bytes": 0, 2024-03-16T07:37:18.935 INFO:teuthology.orchestra.run.smithi049.stdout: "pgmap_items": 0, 2024-03-16T07:37:18.935 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_co_bytes": 0, 2024-03-16T07:37:18.935 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_co_items": 0, 2024-03-16T07:37:18.935 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_1_bytes": 0, 2024-03-16T07:37:18.935 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_1_items": 0, 2024-03-16T07:37:18.935 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_2_bytes": 0, 2024-03-16T07:37:18.936 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_2_items": 0 2024-03-16T07:37:18.936 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:18.936 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:18.936 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:37:18.936 INFO:teuthology.orchestra.run.smithi049.stdout: "objecter": [ 2024-03-16T07:37:18.936 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:37:18.936 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:37:18.936 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:37:18.936 INFO:teuthology.orchestra.run.smithi049.stdout: "op_active": 0, 2024-03-16T07:37:18.936 INFO:teuthology.orchestra.run.smithi049.stdout: "op_laggy": 0, 2024-03-16T07:37:18.936 INFO:teuthology.orchestra.run.smithi049.stdout: "op_send": 0, 2024-03-16T07:37:18.936 INFO:teuthology.orchestra.run.smithi049.stdout: "op_send_bytes": 0, 2024-03-16T07:37:18.936 INFO:teuthology.orchestra.run.smithi049.stdout: "op_resend": 0, 2024-03-16T07:37:18.936 INFO:teuthology.orchestra.run.smithi049.stdout: "op_reply": 0, 2024-03-16T07:37:18.936 INFO:teuthology.orchestra.run.smithi049.stdout: "op_latency": { 2024-03-16T07:37:18.936 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:37:18.937 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:37:18.937 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:37:18.937 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:37:18.937 INFO:teuthology.orchestra.run.smithi049.stdout: "op_inflight": 0, 2024-03-16T07:37:18.937 INFO:teuthology.orchestra.run.smithi049.stdout: "oplen_avg": { 2024-03-16T07:37:18.937 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:37:18.937 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0 2024-03-16T07:37:18.937 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:37:18.937 INFO:teuthology.orchestra.run.smithi049.stdout: "op": 0, 2024-03-16T07:37:18.937 INFO:teuthology.orchestra.run.smithi049.stdout: "op_r": 0, 2024-03-16T07:37:18.937 INFO:teuthology.orchestra.run.smithi049.stdout: "op_w": 0, 2024-03-16T07:37:18.937 INFO:teuthology.orchestra.run.smithi049.stdout: "op_rmw": 0, 2024-03-16T07:37:18.937 INFO:teuthology.orchestra.run.smithi049.stdout: "op_pg": 0, 2024-03-16T07:37:18.937 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_stat": 0, 2024-03-16T07:37:18.937 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_create": 0, 2024-03-16T07:37:18.938 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_read": 0, 2024-03-16T07:37:18.938 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_write": 0, 2024-03-16T07:37:18.938 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_writefull": 0, 2024-03-16T07:37:18.938 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_writesame": 0, 2024-03-16T07:37:18.938 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_append": 0, 2024-03-16T07:37:18.938 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_zero": 0, 2024-03-16T07:37:18.938 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_truncate": 0, 2024-03-16T07:37:18.938 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_delete": 0, 2024-03-16T07:37:18.938 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_mapext": 0, 2024-03-16T07:37:18.938 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_sparse_read": 0, 2024-03-16T07:37:18.938 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_clonerange": 0, 2024-03-16T07:37:18.938 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_getxattr": 0, 2024-03-16T07:37:18.938 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_setxattr": 0, 2024-03-16T07:37:18.938 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_cmpxattr": 0, 2024-03-16T07:37:18.939 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_rmxattr": 0, 2024-03-16T07:37:18.939 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_resetxattrs": 0, 2024-03-16T07:37:18.939 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_call": 0, 2024-03-16T07:37:18.939 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_watch": 0, 2024-03-16T07:37:18.939 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_notify": 0, 2024-03-16T07:37:18.939 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_src_cmpxattr": 0, 2024-03-16T07:37:18.939 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_pgls": 0, 2024-03-16T07:37:18.939 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_pgls_filter": 0, 2024-03-16T07:37:18.939 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_other": 0, 2024-03-16T07:37:18.939 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_active": 0, 2024-03-16T07:37:18.939 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_send": 0, 2024-03-16T07:37:18.939 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_resend": 0, 2024-03-16T07:37:18.939 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_ping": 0, 2024-03-16T07:37:18.939 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_active": 0, 2024-03-16T07:37:18.940 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_send": 0, 2024-03-16T07:37:18.940 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_resend": 0, 2024-03-16T07:37:18.940 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_active": 0, 2024-03-16T07:37:18.940 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_send": 0, 2024-03-16T07:37:18.940 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_resend": 0, 2024-03-16T07:37:18.940 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_active": 0, 2024-03-16T07:37:18.940 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_send": 0, 2024-03-16T07:37:18.940 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_resend": 0, 2024-03-16T07:37:18.940 INFO:teuthology.orchestra.run.smithi049.stdout: "command_active": 0, 2024-03-16T07:37:18.940 INFO:teuthology.orchestra.run.smithi049.stdout: "command_send": 0, 2024-03-16T07:37:18.940 INFO:teuthology.orchestra.run.smithi049.stdout: "command_resend": 0, 2024-03-16T07:37:18.940 INFO:teuthology.orchestra.run.smithi049.stdout: "map_epoch": 0, 2024-03-16T07:37:18.940 INFO:teuthology.orchestra.run.smithi049.stdout: "map_full": 0, 2024-03-16T07:37:18.940 INFO:teuthology.orchestra.run.smithi049.stdout: "map_inc": 0, 2024-03-16T07:37:18.940 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_sessions": 0, 2024-03-16T07:37:18.940 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_session_open": 0, 2024-03-16T07:37:18.941 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_session_close": 0, 2024-03-16T07:37:18.941 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_laggy": 0, 2024-03-16T07:37:18.941 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_wr": 0, 2024-03-16T07:37:18.941 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_rd": 0, 2024-03-16T07:37:18.941 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_del": 0 2024-03-16T07:37:18.941 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:18.941 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:18.941 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:37:18.941 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-msgr_dispatch_throttler-client": [ 2024-03-16T07:37:18.941 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:37:18.941 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:37:18.941 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:37:18.941 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:37:18.941 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-03-16T07:37:18.942 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:37:18.942 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 123, 2024-03-16T07:37:18.942 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 486077, 2024-03-16T07:37:18.942 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:37:18.942 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 123, 2024-03-16T07:37:18.942 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:37:18.942 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:37:18.942 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 123, 2024-03-16T07:37:18.942 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 486077, 2024-03-16T07:37:18.942 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:37:18.942 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:37:18.942 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:37:18.942 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:37:18.942 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:18.942 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:18.943 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:18.943 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:37:18.943 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-msgr_dispatch_throttler-radosclient": [ 2024-03-16T07:37:18.943 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:37:18.943 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:37:18.943 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:37:18.943 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:37:18.943 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-03-16T07:37:18.943 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:37:18.943 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 90, 2024-03-16T07:37:18.943 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 3050272, 2024-03-16T07:37:18.943 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:37:18.943 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 90, 2024-03-16T07:37:18.943 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:37:18.943 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:37:18.943 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 90, 2024-03-16T07:37:18.944 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 3050272, 2024-03-16T07:37:18.944 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:37:18.944 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:37:18.944 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:37:18.944 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:37:18.944 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:18.944 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:18.944 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:18.944 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:37:18.944 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-objecter_bytes": [ 2024-03-16T07:37:18.944 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:37:18.944 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:37:18.944 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:37:18.944 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:37:18.945 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-03-16T07:37:18.945 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:37:18.945 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 0, 2024-03-16T07:37:18.945 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 0, 2024-03-16T07:37:18.945 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:37:18.945 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 0, 2024-03-16T07:37:18.945 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:37:18.945 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:37:18.945 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 0, 2024-03-16T07:37:18.945 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 0, 2024-03-16T07:37:18.945 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:37:18.945 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:37:18.945 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:37:18.945 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:37:18.945 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:18.946 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:18.946 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:18.946 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:37:18.946 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-objecter_ops": [ 2024-03-16T07:37:18.946 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:37:18.946 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:37:18.946 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:37:18.946 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:37:18.946 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 1024, 2024-03-16T07:37:18.946 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:37:18.946 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 0, 2024-03-16T07:37:18.946 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 0, 2024-03-16T07:37:18.946 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:37:18.946 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 0, 2024-03-16T07:37:18.947 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:37:18.947 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:37:18.947 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 0, 2024-03-16T07:37:18.947 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 0, 2024-03-16T07:37:18.947 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:37:18.947 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:37:18.947 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:37:18.947 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:37:18.947 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:18.947 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:18.947 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:18.947 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2024-03-16T07:37:18.947 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-03-16T07:37:18.948 DEBUG:tasks.cephfs.test_mirroring:command returned={ "AsyncMessenger::Worker": [ { "labels": { "id": "0" }, "counters": { "msgr_connection_ready_timeouts": 0, "msgr_connection_idle_timeouts": 0 } }, { "labels": { "id": "1" }, "counters": { "msgr_connection_ready_timeouts": 0, "msgr_connection_idle_timeouts": 0 } }, { "labels": { "id": "2" }, "counters": { "msgr_connection_ready_timeouts": 0, "msgr_connection_idle_timeouts": 0 } } ], "AsyncMessenger::Worker-0": [ { "labels": {}, "counters": { "msgr_recv_messages": 13, "msgr_send_messages": 154, "msgr_recv_bytes": 1872, "msgr_send_bytes": 1061408, "msgr_created_connections": 26, "msgr_active_connections": 5, "msgr_running_total_time": 0.380744785, "msgr_running_send_time": 0.153952794, "msgr_running_recv_time": 0.173849705, "msgr_running_fast_dispatch_time": 0.000000000, "msgr_send_messages_queue_lat": { "avgcount": 142, "sum": 0.215675838, "avgtime": 0.001518843 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "msgr_recv_encrypted_bytes": 1872, "msgr_send_encrypted_bytes": 1061408 } } ], "AsyncMessenger::Worker-1": [ { "labels": {}, "counters": { "msgr_recv_messages": 123, "msgr_send_messages": 10, "msgr_recv_bytes": 502768, "msgr_send_bytes": 2112, "msgr_created_connections": 4, "msgr_active_connections": 0, "msgr_running_total_time": 0.752474609, "msgr_running_send_time": 0.052012174, "msgr_running_recv_time": 0.481859068, "msgr_running_fast_dispatch_time": 0.191550009, "msgr_send_messages_queue_lat": { "avgcount": 9, "sum": 0.188856872, "avgtime": 0.020984096 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "msgr_recv_encrypted_bytes": 502768, "msgr_send_encrypted_bytes": 2112 } } ], "AsyncMessenger::Worker-2": [ { "labels": {}, "counters": { "msgr_recv_messages": 80, "msgr_send_messages": 13, "msgr_recv_bytes": 3061520, "msgr_send_bytes": 2576, "msgr_created_connections": 3, "msgr_active_connections": 1, "msgr_running_total_time": 1.739031013, "msgr_running_send_time": 0.016486708, "msgr_running_recv_time": 3.126662818, "msgr_running_fast_dispatch_time": 0.000000000, "msgr_send_messages_queue_lat": { "avgcount": 12, "sum": 0.346963753, "avgtime": 0.028913646 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "msgr_recv_encrypted_bytes": 3061520, "msgr_send_encrypted_bytes": 2576 } } ], "cct": [ { "labels": {}, "counters": { "total_workers": 0, "unhealthy_workers": 0 } } ], "cephfs_mirror": [ { "labels": {}, "counters": { "mirrored_filesystems": 2, "mirror_enable_failures": 0 } } ], "cephfs_mirror_mirrored_filesystems": [ { "labels": { "filesystem": "cephfs" }, "counters": { "mirroring_peers": 0, "directory_count": 3 } } ], "mempool": [ { "labels": {}, "counters": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_cache_buffer_bytes": 0, "bluestore_cache_buffer_items": 0, "bluestore_extent_bytes": 0, "bluestore_extent_items": 0, "bluestore_blob_bytes": 0, "bluestore_blob_items": 0, "bluestore_shared_blob_bytes": 0, "bluestore_shared_blob_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_items": 0, "bluefs_bytes": 0, "bluefs_items": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "buffer_anon_bytes": 182461, "buffer_anon_items": 55, "buffer_meta_bytes": 0, "buffer_meta_items": 0, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 19336, "osdmap_items": 192, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "mds_co_bytes": 0, "mds_co_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 } } ], "objecter": [ { "labels": {}, "counters": { "op_active": 0, "op_laggy": 0, "op_send": 0, "op_send_bytes": 0, "op_resend": 0, "op_reply": 0, "op_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "op_inflight": 0, "oplen_avg": { "avgcount": 0, "sum": 0 }, "op": 0, "op_r": 0, "op_w": 0, "op_rmw": 0, "op_pg": 0, "osdop_stat": 0, "osdop_create": 0, "osdop_read": 0, "osdop_write": 0, "osdop_writefull": 0, "osdop_writesame": 0, "osdop_append": 0, "osdop_zero": 0, "osdop_truncate": 0, "osdop_delete": 0, "osdop_mapext": 0, "osdop_sparse_read": 0, "osdop_clonerange": 0, "osdop_getxattr": 0, "osdop_setxattr": 0, "osdop_cmpxattr": 0, "osdop_rmxattr": 0, "osdop_resetxattrs": 0, "osdop_call": 0, "osdop_watch": 0, "osdop_notify": 0, "osdop_src_cmpxattr": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_other": 0, "linger_active": 0, "linger_send": 0, "linger_resend": 0, "linger_ping": 0, "poolop_active": 0, "poolop_send": 0, "poolop_resend": 0, "poolstat_active": 0, "poolstat_send": 0, "poolstat_resend": 0, "statfs_active": 0, "statfs_send": 0, "statfs_resend": 0, "command_active": 0, "command_send": 0, "command_resend": 0, "map_epoch": 0, "map_full": 0, "map_inc": 0, "osd_sessions": 0, "osd_session_open": 0, "osd_session_close": 0, "osd_laggy": 0, "omap_wr": 0, "omap_rd": 0, "omap_del": 0 } } ], "throttle-msgr_dispatch_throttler-client": [ { "labels": {}, "counters": { "val": 0, "max": 104857600, "get_started": 0, "get": 123, "get_sum": 486077, "get_or_fail_fail": 0, "get_or_fail_success": 123, "take": 0, "take_sum": 0, "put": 123, "put_sum": 486077, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ], "throttle-msgr_dispatch_throttler-radosclient": [ { "labels": {}, "counters": { "val": 0, "max": 104857600, "get_started": 0, "get": 90, "get_sum": 3050272, "get_or_fail_fail": 0, "get_or_fail_success": 90, "take": 0, "take_sum": 0, "put": 90, "put_sum": 3050272, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ], "throttle-objecter_bytes": [ { "labels": {}, "counters": { "val": 0, "max": 104857600, "get_started": 0, "get": 0, "get_sum": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "take": 0, "take_sum": 0, "put": 0, "put_sum": 0, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ], "throttle-objecter_ops": [ { "labels": {}, "counters": { "val": 0, "max": 1024, "get_started": 0, "get": 0, "get_sum": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "take": 0, "take_sum": 0, "put": 0, "put_sum": 0, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ] } 2024-03-16T07:37:18.949 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snapshot mirror peer_add cephfs client.mirror_remote@ceph backup_fs 2024-03-16T07:37:19.296 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:37:19.296+0000 7efcec86c640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:37:19.296 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:37:19.296+0000 7efcec86c640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:37:19.296 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:37:19.296+0000 7efcec86c640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:37:19.296 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:37:19.296+0000 7efcec86c640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:37:19.296 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:37:19.296+0000 7efcec86c640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:37:20.285 INFO:teuthology.orchestra.run.smithi049.stdout:{} 2024-03-16T07:37:30.300 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-03-16T07:37:30.300 DEBUG:teuthology.orchestra.run.smithi049:mirror status for fs: cephfs> ceph --admin-daemon /var/run/ceph/cephfs-mirror.asok fs mirror status cephfs@14 2024-03-16T07:37:30.451 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-03-16T07:37:30.451 INFO:teuthology.orchestra.run.smithi049.stdout: "rados_inst": "172.21.15.49:0/1186634239", 2024-03-16T07:37:30.451 INFO:teuthology.orchestra.run.smithi049.stdout: "peers": { 2024-03-16T07:37:30.451 INFO:teuthology.orchestra.run.smithi049.stdout: "8fa2e0a7-a624-43b8-9c12-da3a1afea05a": { 2024-03-16T07:37:30.451 INFO:teuthology.orchestra.run.smithi049.stdout: "remote": { 2024-03-16T07:37:30.451 INFO:teuthology.orchestra.run.smithi049.stdout: "client_name": "client.mirror_remote", 2024-03-16T07:37:30.451 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_name": "ceph", 2024-03-16T07:37:30.451 INFO:teuthology.orchestra.run.smithi049.stdout: "fs_name": "backup_fs" 2024-03-16T07:37:30.451 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:30.451 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:30.451 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:37:30.451 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_dirs": { 2024-03-16T07:37:30.452 INFO:teuthology.orchestra.run.smithi049.stdout: "dir_count": 3 2024-03-16T07:37:30.452 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:30.452 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-03-16T07:37:30.461 DEBUG:tasks.cephfs.test_mirroring:command returned={ "rados_inst": "172.21.15.49:0/1186634239", "peers": { "8fa2e0a7-a624-43b8-9c12-da3a1afea05a": { "remote": { "client_name": "client.mirror_remote", "cluster_name": "ceph", "fs_name": "backup_fs" } } }, "snap_dirs": { "dir_count": 3 } } 2024-03-16T07:37:30.462 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T07:37:30.868 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:37:30.868 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":124,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6690,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6827/875237476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":875237476},{"type":"v1","addr":"172.21.15.49:6827","nonce":875237476}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":113},{"gid":6691,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6829/417322500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":417322500},{"type":"v1","addr":"172.21.15.49:6829","nonce":417322500}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":113},{"gid":6696,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6831/4121914730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":4121914730},{"type":"v1","addr":"172.21.15.49:6831","nonce":4121914730}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":113}],"filesystems":[{"mdsmap":{"epoch":124,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-16T07:35:10.038977+0000","modified":"2024-03-16T07:37:19.309479+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6698},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6698":{"gid":6698,"name":"a","rank":0,"incarnation":114,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6835/1838330688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":1838330688},{"type":"v1","addr":"172.21.15.49:6835","nonce":1838330688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[29],"metadata_pool":28,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6698,"qdb_cluster":[6698]},"id":14,"mirror_info":{"peers":{"8fa2e0a7-a624-43b8-9c12-da3a1afea05a":{"remote":{"client_name":"client.mirror_remote","cluster_name":"ceph","fs_name":"backup_fs"}}}}},{"mdsmap":{"epoch":122,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-16T07:35:23.124362+0000","modified":"2024-03-16T07:35:26.073338+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6697},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6697":{"gid":6697,"name":"e","rank":0,"incarnation":118,"state":"up:active","state_seq":6,"addr":"172.21.15.49:6834/1716116460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":1716116460},{"type":"v1","addr":"172.21.15.49:6834","nonce":1716116460}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[31],"metadata_pool":30,"enabled":true,"fs_name":"backup_fs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6697,"qdb_cluster":[6697]},"id":15}]} 2024-03-16T07:37:30.868 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 124 2024-03-16T07:37:30.880 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-03-16T07:37:30.881 DEBUG:teuthology.orchestra.run.smithi049:counter dump for fs: cephfs> ceph --admin-daemon /var/run/ceph/cephfs-mirror.asok counter dump 2024-03-16T07:37:30.986 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-03-16T07:37:30.986 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker": [ 2024-03-16T07:37:30.986 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:37:30.986 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:37:30.986 INFO:teuthology.orchestra.run.smithi049.stdout: "id": "0" 2024-03-16T07:37:30.986 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:37:30.986 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:37:30.986 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_ready_timeouts": 0, 2024-03-16T07:37:30.986 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_idle_timeouts": 0 2024-03-16T07:37:30.986 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:30.986 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:37:30.986 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:37:30.986 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:37:30.987 INFO:teuthology.orchestra.run.smithi049.stdout: "id": "1" 2024-03-16T07:37:30.987 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:37:30.987 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:37:30.987 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_ready_timeouts": 0, 2024-03-16T07:37:30.987 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_idle_timeouts": 0 2024-03-16T07:37:30.987 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:30.987 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:37:30.987 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:37:30.987 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:37:30.987 INFO:teuthology.orchestra.run.smithi049.stdout: "id": "2" 2024-03-16T07:37:30.987 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:37:30.987 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:37:30.987 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_ready_timeouts": 0, 2024-03-16T07:37:30.987 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_idle_timeouts": 0 2024-03-16T07:37:30.987 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:30.988 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:30.988 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:37:30.988 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-0": [ 2024-03-16T07:37:30.988 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:37:30.988 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:37:30.988 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:37:30.988 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 13, 2024-03-16T07:37:30.988 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 157, 2024-03-16T07:37:30.988 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 1872, 2024-03-16T07:37:30.988 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 1062384, 2024-03-16T07:37:30.988 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 26, 2024-03-16T07:37:30.988 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 5, 2024-03-16T07:37:30.988 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 0.381956141, 2024-03-16T07:37:30.988 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.155062259, 2024-03-16T07:37:30.988 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 0.173849705, 2024-03-16T07:37:30.989 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-03-16T07:37:30.989 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T07:37:30.989 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 145, 2024-03-16T07:37:30.989 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.216155688, 2024-03-16T07:37:30.989 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.001490728 2024-03-16T07:37:30.989 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:37:30.989 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-03-16T07:37:30.989 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:37:30.989 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:37:30.989 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:37:30.989 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:37:30.989 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 1872, 2024-03-16T07:37:30.989 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 1062384 2024-03-16T07:37:30.989 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:30.989 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:30.989 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:37:30.990 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-1": [ 2024-03-16T07:37:30.990 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:37:30.990 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:37:30.990 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:37:30.990 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 124, 2024-03-16T07:37:30.990 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 10, 2024-03-16T07:37:30.990 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 507744, 2024-03-16T07:37:30.990 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 2112, 2024-03-16T07:37:30.990 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 4, 2024-03-16T07:37:30.990 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 0, 2024-03-16T07:37:30.990 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 0.759040141, 2024-03-16T07:37:30.990 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.052074755, 2024-03-16T07:37:30.990 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 0.485403018, 2024-03-16T07:37:30.990 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.194190800, 2024-03-16T07:37:30.990 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T07:37:30.991 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 9, 2024-03-16T07:37:30.991 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.188856872, 2024-03-16T07:37:30.991 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.020984096 2024-03-16T07:37:30.991 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:37:30.991 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-03-16T07:37:30.991 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:37:30.991 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:37:30.991 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:37:30.991 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:37:30.991 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 507744, 2024-03-16T07:37:30.991 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 2112 2024-03-16T07:37:30.991 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:30.991 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:30.991 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:37:30.991 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-2": [ 2024-03-16T07:37:30.991 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:37:30.991 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:37:30.992 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:37:30.992 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 81, 2024-03-16T07:37:30.992 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 13, 2024-03-16T07:37:30.992 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 3107152, 2024-03-16T07:37:30.992 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 2576, 2024-03-16T07:37:30.992 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 3, 2024-03-16T07:37:30.992 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 1, 2024-03-16T07:37:30.992 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 1.770009569, 2024-03-16T07:37:30.992 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.016554462, 2024-03-16T07:37:30.992 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 3.187966414, 2024-03-16T07:37:30.992 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-03-16T07:37:30.992 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T07:37:30.992 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 12, 2024-03-16T07:37:30.992 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.346963753, 2024-03-16T07:37:30.992 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.028913646 2024-03-16T07:37:30.993 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:37:30.993 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-03-16T07:37:30.993 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:37:30.993 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:37:30.993 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:37:30.993 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:37:30.993 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 3107152, 2024-03-16T07:37:30.993 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 2576 2024-03-16T07:37:30.993 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:30.993 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:30.993 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:37:30.993 INFO:teuthology.orchestra.run.smithi049.stdout: "cct": [ 2024-03-16T07:37:30.993 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:37:30.993 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:37:30.993 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:37:30.994 INFO:teuthology.orchestra.run.smithi049.stdout: "total_workers": 0, 2024-03-16T07:37:30.994 INFO:teuthology.orchestra.run.smithi049.stdout: "unhealthy_workers": 0 2024-03-16T07:37:30.994 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:30.994 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:30.994 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:37:30.994 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs_mirror": [ 2024-03-16T07:37:30.994 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:37:30.994 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:37:30.994 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:37:30.994 INFO:teuthology.orchestra.run.smithi049.stdout: "mirrored_filesystems": 2, 2024-03-16T07:37:30.994 INFO:teuthology.orchestra.run.smithi049.stdout: "mirror_enable_failures": 0 2024-03-16T07:37:30.994 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:30.994 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:30.994 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:37:30.995 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs_mirror_mirrored_filesystems": [ 2024-03-16T07:37:30.995 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:37:30.995 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:37:30.995 INFO:teuthology.orchestra.run.smithi049.stdout: "filesystem": "cephfs" 2024-03-16T07:37:30.995 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:37:30.995 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:37:30.995 INFO:teuthology.orchestra.run.smithi049.stdout: "mirroring_peers": 1, 2024-03-16T07:37:30.995 INFO:teuthology.orchestra.run.smithi049.stdout: "directory_count": 3 2024-03-16T07:37:30.995 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:30.995 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:30.995 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:37:30.995 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs_mirror_peers": [ 2024-03-16T07:37:30.995 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:37:30.995 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:37:30.995 INFO:teuthology.orchestra.run.smithi049.stdout: "peer_cluster_filesystem": "backup_fs", 2024-03-16T07:37:30.995 INFO:teuthology.orchestra.run.smithi049.stdout: "peer_cluster_name": "ceph", 2024-03-16T07:37:30.996 INFO:teuthology.orchestra.run.smithi049.stdout: "source_filesystem": "cephfs", 2024-03-16T07:37:30.996 INFO:teuthology.orchestra.run.smithi049.stdout: "source_fscid": "14" 2024-03-16T07:37:30.996 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:37:30.996 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:37:30.996 INFO:teuthology.orchestra.run.smithi049.stdout: "snaps_synced": 0, 2024-03-16T07:37:30.996 INFO:teuthology.orchestra.run.smithi049.stdout: "snaps_deleted": 0, 2024-03-16T07:37:30.996 INFO:teuthology.orchestra.run.smithi049.stdout: "snaps_renamed": 0, 2024-03-16T07:37:30.996 INFO:teuthology.orchestra.run.smithi049.stdout: "sync_failures": 0, 2024-03-16T07:37:30.996 INFO:teuthology.orchestra.run.smithi049.stdout: "avg_sync_time": { 2024-03-16T07:37:30.996 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:37:30.996 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:37:30.996 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:37:30.996 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:37:30.996 INFO:teuthology.orchestra.run.smithi049.stdout: "sync_bytes": 0 2024-03-16T07:37:30.996 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:30.996 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:30.997 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:37:30.997 INFO:teuthology.orchestra.run.smithi049.stdout: "mempool": [ 2024-03-16T07:37:30.997 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:37:30.997 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:37:30.997 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:37:30.997 INFO:teuthology.orchestra.run.smithi049.stdout: "bloom_filter_bytes": 0, 2024-03-16T07:37:30.997 INFO:teuthology.orchestra.run.smithi049.stdout: "bloom_filter_items": 0, 2024-03-16T07:37:30.997 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_alloc_bytes": 0, 2024-03-16T07:37:30.997 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_alloc_items": 0, 2024-03-16T07:37:30.997 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_data_bytes": 0, 2024-03-16T07:37:30.997 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_data_items": 0, 2024-03-16T07:37:30.997 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_onode_bytes": 0, 2024-03-16T07:37:30.997 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_onode_items": 0, 2024-03-16T07:37:30.997 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_meta_bytes": 0, 2024-03-16T07:37:30.997 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_meta_items": 0, 2024-03-16T07:37:30.997 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_other_bytes": 0, 2024-03-16T07:37:30.998 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_other_items": 0, 2024-03-16T07:37:30.998 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_buffer_bytes": 0, 2024-03-16T07:37:30.998 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_buffer_items": 0, 2024-03-16T07:37:30.998 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_extent_bytes": 0, 2024-03-16T07:37:30.998 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_extent_items": 0, 2024-03-16T07:37:30.998 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_blob_bytes": 0, 2024-03-16T07:37:30.998 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_blob_items": 0, 2024-03-16T07:37:30.998 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_shared_blob_bytes": 0, 2024-03-16T07:37:30.998 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_shared_blob_items": 0, 2024-03-16T07:37:30.998 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_inline_bl_bytes": 0, 2024-03-16T07:37:30.998 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_inline_bl_items": 0, 2024-03-16T07:37:30.998 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_fsck_bytes": 0, 2024-03-16T07:37:30.998 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_fsck_items": 0, 2024-03-16T07:37:30.998 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_txc_bytes": 0, 2024-03-16T07:37:30.998 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_txc_items": 0, 2024-03-16T07:37:30.999 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_deferred_bytes": 0, 2024-03-16T07:37:30.999 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_deferred_items": 0, 2024-03-16T07:37:30.999 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_bytes": 0, 2024-03-16T07:37:30.999 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_items": 0, 2024-03-16T07:37:30.999 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_bytes": 0, 2024-03-16T07:37:30.999 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_items": 0, 2024-03-16T07:37:30.999 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_reader_bytes": 0, 2024-03-16T07:37:30.999 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_reader_items": 0, 2024-03-16T07:37:30.999 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_writer_bytes": 0, 2024-03-16T07:37:30.999 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_writer_items": 0, 2024-03-16T07:37:30.999 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_anon_bytes": 201872, 2024-03-16T07:37:30.999 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_anon_items": 79, 2024-03-16T07:37:30.999 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_meta_bytes": 0, 2024-03-16T07:37:30.999 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_meta_items": 0, 2024-03-16T07:37:30.999 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_bytes": 0, 2024-03-16T07:37:31.000 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_items": 0, 2024-03-16T07:37:31.000 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_mapbl_bytes": 0, 2024-03-16T07:37:31.000 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_mapbl_items": 0, 2024-03-16T07:37:31.000 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pglog_bytes": 0, 2024-03-16T07:37:31.000 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pglog_items": 0, 2024-03-16T07:37:31.000 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_bytes": 33848, 2024-03-16T07:37:31.000 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_items": 332, 2024-03-16T07:37:31.000 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_mapping_bytes": 0, 2024-03-16T07:37:31.000 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_mapping_items": 0, 2024-03-16T07:37:31.000 INFO:teuthology.orchestra.run.smithi049.stdout: "pgmap_bytes": 0, 2024-03-16T07:37:31.000 INFO:teuthology.orchestra.run.smithi049.stdout: "pgmap_items": 0, 2024-03-16T07:37:31.000 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_co_bytes": 0, 2024-03-16T07:37:31.000 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_co_items": 0, 2024-03-16T07:37:31.000 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_1_bytes": 0, 2024-03-16T07:37:31.000 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_1_items": 0, 2024-03-16T07:37:31.000 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_2_bytes": 0, 2024-03-16T07:37:31.000 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_2_items": 0 2024-03-16T07:37:31.001 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:31.001 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:31.001 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:37:31.001 INFO:teuthology.orchestra.run.smithi049.stdout: "objecter": [ 2024-03-16T07:37:31.001 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:37:31.001 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:37:31.001 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:37:31.001 INFO:teuthology.orchestra.run.smithi049.stdout: "op_active": 0, 2024-03-16T07:37:31.001 INFO:teuthology.orchestra.run.smithi049.stdout: "op_laggy": 0, 2024-03-16T07:37:31.001 INFO:teuthology.orchestra.run.smithi049.stdout: "op_send": 0, 2024-03-16T07:37:31.001 INFO:teuthology.orchestra.run.smithi049.stdout: "op_send_bytes": 0, 2024-03-16T07:37:31.001 INFO:teuthology.orchestra.run.smithi049.stdout: "op_resend": 0, 2024-03-16T07:37:31.001 INFO:teuthology.orchestra.run.smithi049.stdout: "op_reply": 0, 2024-03-16T07:37:31.001 INFO:teuthology.orchestra.run.smithi049.stdout: "op_latency": { 2024-03-16T07:37:31.001 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:37:31.001 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:37:31.002 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:37:31.002 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:37:31.002 INFO:teuthology.orchestra.run.smithi049.stdout: "op_inflight": 0, 2024-03-16T07:37:31.002 INFO:teuthology.orchestra.run.smithi049.stdout: "oplen_avg": { 2024-03-16T07:37:31.002 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:37:31.002 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0 2024-03-16T07:37:31.002 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:37:31.002 INFO:teuthology.orchestra.run.smithi049.stdout: "op": 0, 2024-03-16T07:37:31.002 INFO:teuthology.orchestra.run.smithi049.stdout: "op_r": 0, 2024-03-16T07:37:31.002 INFO:teuthology.orchestra.run.smithi049.stdout: "op_w": 0, 2024-03-16T07:37:31.002 INFO:teuthology.orchestra.run.smithi049.stdout: "op_rmw": 0, 2024-03-16T07:37:31.002 INFO:teuthology.orchestra.run.smithi049.stdout: "op_pg": 0, 2024-03-16T07:37:31.002 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_stat": 0, 2024-03-16T07:37:31.002 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_create": 0, 2024-03-16T07:37:31.002 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_read": 0, 2024-03-16T07:37:31.003 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_write": 0, 2024-03-16T07:37:31.003 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_writefull": 0, 2024-03-16T07:37:31.003 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_writesame": 0, 2024-03-16T07:37:31.003 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_append": 0, 2024-03-16T07:37:31.003 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_zero": 0, 2024-03-16T07:37:31.003 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_truncate": 0, 2024-03-16T07:37:31.003 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_delete": 0, 2024-03-16T07:37:31.003 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_mapext": 0, 2024-03-16T07:37:31.003 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_sparse_read": 0, 2024-03-16T07:37:31.003 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_clonerange": 0, 2024-03-16T07:37:31.003 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_getxattr": 0, 2024-03-16T07:37:31.003 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_setxattr": 0, 2024-03-16T07:37:31.003 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_cmpxattr": 0, 2024-03-16T07:37:31.003 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_rmxattr": 0, 2024-03-16T07:37:31.003 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_resetxattrs": 0, 2024-03-16T07:37:31.003 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_call": 0, 2024-03-16T07:37:31.004 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_watch": 0, 2024-03-16T07:37:31.004 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_notify": 0, 2024-03-16T07:37:31.004 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_src_cmpxattr": 0, 2024-03-16T07:37:31.004 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_pgls": 0, 2024-03-16T07:37:31.004 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_pgls_filter": 0, 2024-03-16T07:37:31.004 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_other": 0, 2024-03-16T07:37:31.004 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_active": 0, 2024-03-16T07:37:31.004 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_send": 0, 2024-03-16T07:37:31.004 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_resend": 0, 2024-03-16T07:37:31.004 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_ping": 0, 2024-03-16T07:37:31.004 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_active": 0, 2024-03-16T07:37:31.004 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_send": 0, 2024-03-16T07:37:31.004 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_resend": 0, 2024-03-16T07:37:31.004 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_active": 0, 2024-03-16T07:37:31.004 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_send": 0, 2024-03-16T07:37:31.004 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_resend": 0, 2024-03-16T07:37:31.004 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_active": 0, 2024-03-16T07:37:31.005 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_send": 0, 2024-03-16T07:37:31.005 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_resend": 0, 2024-03-16T07:37:31.005 INFO:teuthology.orchestra.run.smithi049.stdout: "command_active": 0, 2024-03-16T07:37:31.005 INFO:teuthology.orchestra.run.smithi049.stdout: "command_send": 0, 2024-03-16T07:37:31.005 INFO:teuthology.orchestra.run.smithi049.stdout: "command_resend": 0, 2024-03-16T07:37:31.005 INFO:teuthology.orchestra.run.smithi049.stdout: "map_epoch": 0, 2024-03-16T07:37:31.005 INFO:teuthology.orchestra.run.smithi049.stdout: "map_full": 0, 2024-03-16T07:37:31.005 INFO:teuthology.orchestra.run.smithi049.stdout: "map_inc": 0, 2024-03-16T07:37:31.005 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_sessions": 0, 2024-03-16T07:37:31.005 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_session_open": 0, 2024-03-16T07:37:31.005 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_session_close": 0, 2024-03-16T07:37:31.005 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_laggy": 0, 2024-03-16T07:37:31.005 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_wr": 0, 2024-03-16T07:37:31.005 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_rd": 0, 2024-03-16T07:37:31.005 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_del": 0 2024-03-16T07:37:31.005 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:31.005 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:31.006 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:37:31.006 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-msgr_dispatch_throttler-client": [ 2024-03-16T07:37:31.006 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:37:31.006 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:37:31.006 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:37:31.006 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:37:31.006 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-03-16T07:37:31.006 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:37:31.006 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 124, 2024-03-16T07:37:31.006 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 490920, 2024-03-16T07:37:31.006 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:37:31.006 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 124, 2024-03-16T07:37:31.006 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:37:31.006 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:37:31.007 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 124, 2024-03-16T07:37:31.007 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 490920, 2024-03-16T07:37:31.007 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:37:31.007 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:37:31.007 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:37:31.007 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:37:31.007 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:31.007 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:31.007 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:31.007 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:37:31.007 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-msgr_dispatch_throttler-radosclient": [ 2024-03-16T07:37:31.007 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:37:31.007 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:37:31.007 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:37:31.007 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:37:31.007 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-03-16T07:37:31.008 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:37:31.008 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 91, 2024-03-16T07:37:31.008 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 3095773, 2024-03-16T07:37:31.008 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:37:31.008 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 91, 2024-03-16T07:37:31.008 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:37:31.008 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:37:31.008 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 91, 2024-03-16T07:37:31.008 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 3095773, 2024-03-16T07:37:31.008 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:37:31.008 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:37:31.008 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:37:31.008 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:37:31.008 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:31.008 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:31.009 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:31.009 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:37:31.009 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-objecter_bytes": [ 2024-03-16T07:37:31.009 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:37:31.009 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:37:31.009 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:37:31.009 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:37:31.009 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-03-16T07:37:31.009 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:37:31.009 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 0, 2024-03-16T07:37:31.009 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 0, 2024-03-16T07:37:31.009 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:37:31.009 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 0, 2024-03-16T07:37:31.009 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:37:31.009 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:37:31.010 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 0, 2024-03-16T07:37:31.010 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 0, 2024-03-16T07:37:31.010 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:37:31.010 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:37:31.010 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:37:31.010 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:37:31.010 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:31.010 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:31.010 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:31.010 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:37:31.010 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-objecter_ops": [ 2024-03-16T07:37:31.010 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:37:31.010 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:37:31.010 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:37:31.010 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:37:31.011 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 1024, 2024-03-16T07:37:31.011 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:37:31.011 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 0, 2024-03-16T07:37:31.011 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 0, 2024-03-16T07:37:31.011 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:37:31.011 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 0, 2024-03-16T07:37:31.011 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:37:31.011 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:37:31.011 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 0, 2024-03-16T07:37:31.011 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 0, 2024-03-16T07:37:31.011 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:37:31.011 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:37:31.011 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:37:31.011 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:37:31.011 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:31.011 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:31.012 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:31.012 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2024-03-16T07:37:31.012 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-03-16T07:37:31.012 DEBUG:tasks.cephfs.test_mirroring:command returned={ "AsyncMessenger::Worker": [ { "labels": { "id": "0" }, "counters": { "msgr_connection_ready_timeouts": 0, "msgr_connection_idle_timeouts": 0 } }, { "labels": { "id": "1" }, "counters": { "msgr_connection_ready_timeouts": 0, "msgr_connection_idle_timeouts": 0 } }, { "labels": { "id": "2" }, "counters": { "msgr_connection_ready_timeouts": 0, "msgr_connection_idle_timeouts": 0 } } ], "AsyncMessenger::Worker-0": [ { "labels": {}, "counters": { "msgr_recv_messages": 13, "msgr_send_messages": 157, "msgr_recv_bytes": 1872, "msgr_send_bytes": 1062384, "msgr_created_connections": 26, "msgr_active_connections": 5, "msgr_running_total_time": 0.381956141, "msgr_running_send_time": 0.155062259, "msgr_running_recv_time": 0.173849705, "msgr_running_fast_dispatch_time": 0.000000000, "msgr_send_messages_queue_lat": { "avgcount": 145, "sum": 0.216155688, "avgtime": 0.001490728 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "msgr_recv_encrypted_bytes": 1872, "msgr_send_encrypted_bytes": 1062384 } } ], "AsyncMessenger::Worker-1": [ { "labels": {}, "counters": { "msgr_recv_messages": 124, "msgr_send_messages": 10, "msgr_recv_bytes": 507744, "msgr_send_bytes": 2112, "msgr_created_connections": 4, "msgr_active_connections": 0, "msgr_running_total_time": 0.759040141, "msgr_running_send_time": 0.052074755, "msgr_running_recv_time": 0.485403018, "msgr_running_fast_dispatch_time": 0.194190800, "msgr_send_messages_queue_lat": { "avgcount": 9, "sum": 0.188856872, "avgtime": 0.020984096 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "msgr_recv_encrypted_bytes": 507744, "msgr_send_encrypted_bytes": 2112 } } ], "AsyncMessenger::Worker-2": [ { "labels": {}, "counters": { "msgr_recv_messages": 81, "msgr_send_messages": 13, "msgr_recv_bytes": 3107152, "msgr_send_bytes": 2576, "msgr_created_connections": 3, "msgr_active_connections": 1, "msgr_running_total_time": 1.770009569, "msgr_running_send_time": 0.016554462, "msgr_running_recv_time": 3.187966414, "msgr_running_fast_dispatch_time": 0.000000000, "msgr_send_messages_queue_lat": { "avgcount": 12, "sum": 0.346963753, "avgtime": 0.028913646 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "msgr_recv_encrypted_bytes": 3107152, "msgr_send_encrypted_bytes": 2576 } } ], "cct": [ { "labels": {}, "counters": { "total_workers": 0, "unhealthy_workers": 0 } } ], "cephfs_mirror": [ { "labels": {}, "counters": { "mirrored_filesystems": 2, "mirror_enable_failures": 0 } } ], "cephfs_mirror_mirrored_filesystems": [ { "labels": { "filesystem": "cephfs" }, "counters": { "mirroring_peers": 1, "directory_count": 3 } } ], "cephfs_mirror_peers": [ { "labels": { "peer_cluster_filesystem": "backup_fs", "peer_cluster_name": "ceph", "source_filesystem": "cephfs", "source_fscid": "14" }, "counters": { "snaps_synced": 0, "snaps_deleted": 0, "snaps_renamed": 0, "sync_failures": 0, "avg_sync_time": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "sync_bytes": 0 } } ], "mempool": [ { "labels": {}, "counters": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_cache_buffer_bytes": 0, "bluestore_cache_buffer_items": 0, "bluestore_extent_bytes": 0, "bluestore_extent_items": 0, "bluestore_blob_bytes": 0, "bluestore_blob_items": 0, "bluestore_shared_blob_bytes": 0, "bluestore_shared_blob_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_items": 0, "bluefs_bytes": 0, "bluefs_items": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "buffer_anon_bytes": 201872, "buffer_anon_items": 79, "buffer_meta_bytes": 0, "buffer_meta_items": 0, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 33848, "osdmap_items": 332, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "mds_co_bytes": 0, "mds_co_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 } } ], "objecter": [ { "labels": {}, "counters": { "op_active": 0, "op_laggy": 0, "op_send": 0, "op_send_bytes": 0, "op_resend": 0, "op_reply": 0, "op_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "op_inflight": 0, "oplen_avg": { "avgcount": 0, "sum": 0 }, "op": 0, "op_r": 0, "op_w": 0, "op_rmw": 0, "op_pg": 0, "osdop_stat": 0, "osdop_create": 0, "osdop_read": 0, "osdop_write": 0, "osdop_writefull": 0, "osdop_writesame": 0, "osdop_append": 0, "osdop_zero": 0, "osdop_truncate": 0, "osdop_delete": 0, "osdop_mapext": 0, "osdop_sparse_read": 0, "osdop_clonerange": 0, "osdop_getxattr": 0, "osdop_setxattr": 0, "osdop_cmpxattr": 0, "osdop_rmxattr": 0, "osdop_resetxattrs": 0, "osdop_call": 0, "osdop_watch": 0, "osdop_notify": 0, "osdop_src_cmpxattr": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_other": 0, "linger_active": 0, "linger_send": 0, "linger_resend": 0, "linger_ping": 0, "poolop_active": 0, "poolop_send": 0, "poolop_resend": 0, "poolstat_active": 0, "poolstat_send": 0, "poolstat_resend": 0, "statfs_active": 0, "statfs_send": 0, "statfs_resend": 0, "command_active": 0, "command_send": 0, "command_resend": 0, "map_epoch": 0, "map_full": 0, "map_inc": 0, "osd_sessions": 0, "osd_session_open": 0, "osd_session_close": 0, "osd_laggy": 0, "omap_wr": 0, "omap_rd": 0, "omap_del": 0 } } ], "throttle-msgr_dispatch_throttler-client": [ { "labels": {}, "counters": { "val": 0, "max": 104857600, "get_started": 0, "get": 124, "get_sum": 490920, "get_or_fail_fail": 0, "get_or_fail_success": 124, "take": 0, "take_sum": 0, "put": 124, "put_sum": 490920, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ], "throttle-msgr_dispatch_throttler-radosclient": [ { "labels": {}, "counters": { "val": 0, "max": 104857600, "get_started": 0, "get": 91, "get_sum": 3095773, "get_or_fail_fail": 0, "get_or_fail_success": 91, "take": 0, "take_sum": 0, "put": 91, "put_sum": 3095773, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ], "throttle-objecter_bytes": [ { "labels": {}, "counters": { "val": 0, "max": 104857600, "get_started": 0, "get": 0, "get_sum": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "take": 0, "take_sum": 0, "put": 0, "put_sum": 0, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ], "throttle-objecter_ops": [ { "labels": {}, "counters": { "val": 0, "max": 1024, "get_started": 0, "get": 0, "get_sum": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "take": 0, "take_sum": 0, "put": 0, "put_sum": 0, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ] } 2024-03-16T07:37:31.013 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-03-16T07:37:31.013 DEBUG:teuthology.orchestra.run.smithi049:counter dump for fs: cephfs> ceph --admin-daemon /var/run/ceph/cephfs-mirror.asok counter dump 2024-03-16T07:37:31.132 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-03-16T07:37:31.132 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker": [ 2024-03-16T07:37:31.132 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:37:31.132 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:37:31.132 INFO:teuthology.orchestra.run.smithi049.stdout: "id": "0" 2024-03-16T07:37:31.132 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:37:31.133 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:37:31.133 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_ready_timeouts": 0, 2024-03-16T07:37:31.133 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_idle_timeouts": 0 2024-03-16T07:37:31.133 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:31.133 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:37:31.133 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:37:31.133 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:37:31.133 INFO:teuthology.orchestra.run.smithi049.stdout: "id": "1" 2024-03-16T07:37:31.133 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:37:31.133 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:37:31.133 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_ready_timeouts": 0, 2024-03-16T07:37:31.133 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_idle_timeouts": 0 2024-03-16T07:37:31.133 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:31.133 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:37:31.133 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:37:31.134 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:37:31.134 INFO:teuthology.orchestra.run.smithi049.stdout: "id": "2" 2024-03-16T07:37:31.134 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:37:31.134 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:37:31.134 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_ready_timeouts": 0, 2024-03-16T07:37:31.134 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_idle_timeouts": 0 2024-03-16T07:37:31.134 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:31.134 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:31.134 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:37:31.134 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-0": [ 2024-03-16T07:37:31.134 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:37:31.134 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:37:31.134 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:37:31.134 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 13, 2024-03-16T07:37:31.134 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 157, 2024-03-16T07:37:31.135 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 1872, 2024-03-16T07:37:31.135 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 1062384, 2024-03-16T07:37:31.135 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 26, 2024-03-16T07:37:31.135 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 5, 2024-03-16T07:37:31.135 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 0.381956141, 2024-03-16T07:37:31.135 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.155062259, 2024-03-16T07:37:31.135 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 0.173849705, 2024-03-16T07:37:31.135 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-03-16T07:37:31.135 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T07:37:31.135 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 145, 2024-03-16T07:37:31.135 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.216155688, 2024-03-16T07:37:31.135 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.001490728 2024-03-16T07:37:31.135 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:37:31.135 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-03-16T07:37:31.135 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:37:31.135 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:37:31.135 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:37:31.136 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:37:31.136 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 1872, 2024-03-16T07:37:31.136 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 1062384 2024-03-16T07:37:31.136 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:31.136 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:31.136 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:37:31.136 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-1": [ 2024-03-16T07:37:31.136 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:37:31.136 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:37:31.136 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:37:31.136 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 124, 2024-03-16T07:37:31.136 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 10, 2024-03-16T07:37:31.136 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 507744, 2024-03-16T07:37:31.137 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 2112, 2024-03-16T07:37:31.137 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 4, 2024-03-16T07:37:31.137 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 0, 2024-03-16T07:37:31.137 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 0.759040141, 2024-03-16T07:37:31.137 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.052074755, 2024-03-16T07:37:31.137 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 0.485403018, 2024-03-16T07:37:31.137 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.194190800, 2024-03-16T07:37:31.137 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T07:37:31.137 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 9, 2024-03-16T07:37:31.137 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.188856872, 2024-03-16T07:37:31.137 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.020984096 2024-03-16T07:37:31.137 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:37:31.137 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-03-16T07:37:31.137 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:37:31.137 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:37:31.137 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:37:31.138 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:37:31.138 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 507744, 2024-03-16T07:37:31.138 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 2112 2024-03-16T07:37:31.138 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:31.138 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:31.138 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:37:31.138 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-2": [ 2024-03-16T07:37:31.138 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:37:31.138 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:37:31.138 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:37:31.138 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 81, 2024-03-16T07:37:31.138 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 13, 2024-03-16T07:37:31.138 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 3107152, 2024-03-16T07:37:31.138 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 2576, 2024-03-16T07:37:31.139 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 3, 2024-03-16T07:37:31.139 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 1, 2024-03-16T07:37:31.139 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 1.770009569, 2024-03-16T07:37:31.139 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.016554462, 2024-03-16T07:37:31.139 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 3.187966414, 2024-03-16T07:37:31.139 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-03-16T07:37:31.139 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T07:37:31.139 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 12, 2024-03-16T07:37:31.139 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.346963753, 2024-03-16T07:37:31.139 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.028913646 2024-03-16T07:37:31.139 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:37:31.139 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-03-16T07:37:31.139 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:37:31.139 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:37:31.139 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:37:31.139 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:37:31.139 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 3107152, 2024-03-16T07:37:31.140 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 2576 2024-03-16T07:37:31.140 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:31.140 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:31.140 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:37:31.140 INFO:teuthology.orchestra.run.smithi049.stdout: "cct": [ 2024-03-16T07:37:31.140 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:37:31.140 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:37:31.140 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:37:31.140 INFO:teuthology.orchestra.run.smithi049.stdout: "total_workers": 0, 2024-03-16T07:37:31.140 INFO:teuthology.orchestra.run.smithi049.stdout: "unhealthy_workers": 0 2024-03-16T07:37:31.140 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:31.140 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:31.140 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:37:31.140 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs_mirror": [ 2024-03-16T07:37:31.140 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:37:31.140 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:37:31.140 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:37:31.141 INFO:teuthology.orchestra.run.smithi049.stdout: "mirrored_filesystems": 2, 2024-03-16T07:37:31.141 INFO:teuthology.orchestra.run.smithi049.stdout: "mirror_enable_failures": 0 2024-03-16T07:37:31.141 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:31.141 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:31.141 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:37:31.141 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs_mirror_mirrored_filesystems": [ 2024-03-16T07:37:31.141 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:37:31.141 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:37:31.141 INFO:teuthology.orchestra.run.smithi049.stdout: "filesystem": "cephfs" 2024-03-16T07:37:31.141 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:37:31.141 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:37:31.141 INFO:teuthology.orchestra.run.smithi049.stdout: "mirroring_peers": 1, 2024-03-16T07:37:31.141 INFO:teuthology.orchestra.run.smithi049.stdout: "directory_count": 3 2024-03-16T07:37:31.141 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:31.141 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:31.141 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:37:31.141 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs_mirror_peers": [ 2024-03-16T07:37:31.142 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:37:31.142 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:37:31.142 INFO:teuthology.orchestra.run.smithi049.stdout: "peer_cluster_filesystem": "backup_fs", 2024-03-16T07:37:31.142 INFO:teuthology.orchestra.run.smithi049.stdout: "peer_cluster_name": "ceph", 2024-03-16T07:37:31.142 INFO:teuthology.orchestra.run.smithi049.stdout: "source_filesystem": "cephfs", 2024-03-16T07:37:31.142 INFO:teuthology.orchestra.run.smithi049.stdout: "source_fscid": "14" 2024-03-16T07:37:31.142 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:37:31.142 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:37:31.142 INFO:teuthology.orchestra.run.smithi049.stdout: "snaps_synced": 0, 2024-03-16T07:37:31.142 INFO:teuthology.orchestra.run.smithi049.stdout: "snaps_deleted": 0, 2024-03-16T07:37:31.142 INFO:teuthology.orchestra.run.smithi049.stdout: "snaps_renamed": 0, 2024-03-16T07:37:31.142 INFO:teuthology.orchestra.run.smithi049.stdout: "sync_failures": 0, 2024-03-16T07:37:31.142 INFO:teuthology.orchestra.run.smithi049.stdout: "avg_sync_time": { 2024-03-16T07:37:31.142 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:37:31.142 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:37:31.142 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:37:31.143 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:37:31.143 INFO:teuthology.orchestra.run.smithi049.stdout: "sync_bytes": 0 2024-03-16T07:37:31.143 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:31.143 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:31.143 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:37:31.143 INFO:teuthology.orchestra.run.smithi049.stdout: "mempool": [ 2024-03-16T07:37:31.143 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:37:31.143 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:37:31.143 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:37:31.143 INFO:teuthology.orchestra.run.smithi049.stdout: "bloom_filter_bytes": 0, 2024-03-16T07:37:31.143 INFO:teuthology.orchestra.run.smithi049.stdout: "bloom_filter_items": 0, 2024-03-16T07:37:31.143 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_alloc_bytes": 0, 2024-03-16T07:37:31.143 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_alloc_items": 0, 2024-03-16T07:37:31.143 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_data_bytes": 0, 2024-03-16T07:37:31.143 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_data_items": 0, 2024-03-16T07:37:31.143 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_onode_bytes": 0, 2024-03-16T07:37:31.143 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_onode_items": 0, 2024-03-16T07:37:31.144 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_meta_bytes": 0, 2024-03-16T07:37:31.144 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_meta_items": 0, 2024-03-16T07:37:31.144 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_other_bytes": 0, 2024-03-16T07:37:31.144 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_other_items": 0, 2024-03-16T07:37:31.144 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_buffer_bytes": 0, 2024-03-16T07:37:31.144 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_buffer_items": 0, 2024-03-16T07:37:31.144 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_extent_bytes": 0, 2024-03-16T07:37:31.144 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_extent_items": 0, 2024-03-16T07:37:31.144 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_blob_bytes": 0, 2024-03-16T07:37:31.144 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_blob_items": 0, 2024-03-16T07:37:31.144 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_shared_blob_bytes": 0, 2024-03-16T07:37:31.144 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_shared_blob_items": 0, 2024-03-16T07:37:31.144 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_inline_bl_bytes": 0, 2024-03-16T07:37:31.144 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_inline_bl_items": 0, 2024-03-16T07:37:31.144 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_fsck_bytes": 0, 2024-03-16T07:37:31.144 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_fsck_items": 0, 2024-03-16T07:37:31.145 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_txc_bytes": 0, 2024-03-16T07:37:31.145 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_txc_items": 0, 2024-03-16T07:37:31.145 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_deferred_bytes": 0, 2024-03-16T07:37:31.145 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_deferred_items": 0, 2024-03-16T07:37:31.145 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_bytes": 0, 2024-03-16T07:37:31.145 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_items": 0, 2024-03-16T07:37:31.145 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_bytes": 0, 2024-03-16T07:37:31.145 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_items": 0, 2024-03-16T07:37:31.145 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_reader_bytes": 0, 2024-03-16T07:37:31.145 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_reader_items": 0, 2024-03-16T07:37:31.145 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_writer_bytes": 0, 2024-03-16T07:37:31.145 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_writer_items": 0, 2024-03-16T07:37:31.145 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_anon_bytes": 201872, 2024-03-16T07:37:31.145 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_anon_items": 79, 2024-03-16T07:37:31.145 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_meta_bytes": 0, 2024-03-16T07:37:31.145 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_meta_items": 0, 2024-03-16T07:37:31.145 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_bytes": 0, 2024-03-16T07:37:31.145 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_items": 0, 2024-03-16T07:37:31.146 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_mapbl_bytes": 0, 2024-03-16T07:37:31.146 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_mapbl_items": 0, 2024-03-16T07:37:31.146 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pglog_bytes": 0, 2024-03-16T07:37:31.146 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pglog_items": 0, 2024-03-16T07:37:31.146 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_bytes": 33848, 2024-03-16T07:37:31.146 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_items": 332, 2024-03-16T07:37:31.146 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_mapping_bytes": 0, 2024-03-16T07:37:31.146 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_mapping_items": 0, 2024-03-16T07:37:31.146 INFO:teuthology.orchestra.run.smithi049.stdout: "pgmap_bytes": 0, 2024-03-16T07:37:31.146 INFO:teuthology.orchestra.run.smithi049.stdout: "pgmap_items": 0, 2024-03-16T07:37:31.146 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_co_bytes": 0, 2024-03-16T07:37:31.146 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_co_items": 0, 2024-03-16T07:37:31.146 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_1_bytes": 0, 2024-03-16T07:37:31.146 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_1_items": 0, 2024-03-16T07:37:31.146 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_2_bytes": 0, 2024-03-16T07:37:31.147 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_2_items": 0 2024-03-16T07:37:31.147 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:31.147 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:31.147 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:37:31.147 INFO:teuthology.orchestra.run.smithi049.stdout: "objecter": [ 2024-03-16T07:37:31.147 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:37:31.147 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:37:31.147 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:37:31.147 INFO:teuthology.orchestra.run.smithi049.stdout: "op_active": 0, 2024-03-16T07:37:31.147 INFO:teuthology.orchestra.run.smithi049.stdout: "op_laggy": 0, 2024-03-16T07:37:31.147 INFO:teuthology.orchestra.run.smithi049.stdout: "op_send": 0, 2024-03-16T07:37:31.147 INFO:teuthology.orchestra.run.smithi049.stdout: "op_send_bytes": 0, 2024-03-16T07:37:31.147 INFO:teuthology.orchestra.run.smithi049.stdout: "op_resend": 0, 2024-03-16T07:37:31.147 INFO:teuthology.orchestra.run.smithi049.stdout: "op_reply": 0, 2024-03-16T07:37:31.147 INFO:teuthology.orchestra.run.smithi049.stdout: "op_latency": { 2024-03-16T07:37:31.147 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:37:31.147 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:37:31.148 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:37:31.148 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:37:31.148 INFO:teuthology.orchestra.run.smithi049.stdout: "op_inflight": 0, 2024-03-16T07:37:31.148 INFO:teuthology.orchestra.run.smithi049.stdout: "oplen_avg": { 2024-03-16T07:37:31.148 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:37:31.148 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0 2024-03-16T07:37:31.148 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:37:31.148 INFO:teuthology.orchestra.run.smithi049.stdout: "op": 0, 2024-03-16T07:37:31.148 INFO:teuthology.orchestra.run.smithi049.stdout: "op_r": 0, 2024-03-16T07:37:31.148 INFO:teuthology.orchestra.run.smithi049.stdout: "op_w": 0, 2024-03-16T07:37:31.148 INFO:teuthology.orchestra.run.smithi049.stdout: "op_rmw": 0, 2024-03-16T07:37:31.148 INFO:teuthology.orchestra.run.smithi049.stdout: "op_pg": 0, 2024-03-16T07:37:31.148 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_stat": 0, 2024-03-16T07:37:31.148 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_create": 0, 2024-03-16T07:37:31.148 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_read": 0, 2024-03-16T07:37:31.148 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_write": 0, 2024-03-16T07:37:31.148 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_writefull": 0, 2024-03-16T07:37:31.148 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_writesame": 0, 2024-03-16T07:37:31.149 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_append": 0, 2024-03-16T07:37:31.149 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_zero": 0, 2024-03-16T07:37:31.149 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_truncate": 0, 2024-03-16T07:37:31.149 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_delete": 0, 2024-03-16T07:37:31.149 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_mapext": 0, 2024-03-16T07:37:31.149 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_sparse_read": 0, 2024-03-16T07:37:31.149 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_clonerange": 0, 2024-03-16T07:37:31.149 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_getxattr": 0, 2024-03-16T07:37:31.149 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_setxattr": 0, 2024-03-16T07:37:31.149 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_cmpxattr": 0, 2024-03-16T07:37:31.149 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_rmxattr": 0, 2024-03-16T07:37:31.149 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_resetxattrs": 0, 2024-03-16T07:37:31.149 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_call": 0, 2024-03-16T07:37:31.149 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_watch": 0, 2024-03-16T07:37:31.149 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_notify": 0, 2024-03-16T07:37:31.149 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_src_cmpxattr": 0, 2024-03-16T07:37:31.149 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_pgls": 0, 2024-03-16T07:37:31.150 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_pgls_filter": 0, 2024-03-16T07:37:31.150 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_other": 0, 2024-03-16T07:37:31.150 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_active": 0, 2024-03-16T07:37:31.150 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_send": 0, 2024-03-16T07:37:31.150 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_resend": 0, 2024-03-16T07:37:31.150 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_ping": 0, 2024-03-16T07:37:31.150 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_active": 0, 2024-03-16T07:37:31.150 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_send": 0, 2024-03-16T07:37:31.150 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_resend": 0, 2024-03-16T07:37:31.150 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_active": 0, 2024-03-16T07:37:31.150 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_send": 0, 2024-03-16T07:37:31.150 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_resend": 0, 2024-03-16T07:37:31.150 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_active": 0, 2024-03-16T07:37:31.150 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_send": 0, 2024-03-16T07:37:31.150 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_resend": 0, 2024-03-16T07:37:31.150 INFO:teuthology.orchestra.run.smithi049.stdout: "command_active": 0, 2024-03-16T07:37:31.150 INFO:teuthology.orchestra.run.smithi049.stdout: "command_send": 0, 2024-03-16T07:37:31.151 INFO:teuthology.orchestra.run.smithi049.stdout: "command_resend": 0, 2024-03-16T07:37:31.151 INFO:teuthology.orchestra.run.smithi049.stdout: "map_epoch": 0, 2024-03-16T07:37:31.151 INFO:teuthology.orchestra.run.smithi049.stdout: "map_full": 0, 2024-03-16T07:37:31.151 INFO:teuthology.orchestra.run.smithi049.stdout: "map_inc": 0, 2024-03-16T07:37:31.151 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_sessions": 0, 2024-03-16T07:37:31.151 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_session_open": 0, 2024-03-16T07:37:31.151 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_session_close": 0, 2024-03-16T07:37:31.151 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_laggy": 0, 2024-03-16T07:37:31.151 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_wr": 0, 2024-03-16T07:37:31.151 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_rd": 0, 2024-03-16T07:37:31.151 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_del": 0 2024-03-16T07:37:31.151 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:31.151 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:31.151 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:37:31.151 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-msgr_dispatch_throttler-client": [ 2024-03-16T07:37:31.151 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:37:31.151 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:37:31.151 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:37:31.152 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:37:31.152 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-03-16T07:37:31.152 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:37:31.152 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 124, 2024-03-16T07:37:31.152 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 490920, 2024-03-16T07:37:31.152 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:37:31.152 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 124, 2024-03-16T07:37:31.152 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:37:31.152 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:37:31.152 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 124, 2024-03-16T07:37:31.152 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 490920, 2024-03-16T07:37:31.152 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:37:31.152 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:37:31.152 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:37:31.152 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:37:31.152 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:31.153 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:31.153 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:31.153 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:37:31.153 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-msgr_dispatch_throttler-radosclient": [ 2024-03-16T07:37:31.153 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:37:31.153 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:37:31.153 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:37:31.153 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:37:31.153 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-03-16T07:37:31.153 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:37:31.153 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 91, 2024-03-16T07:37:31.153 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 3095773, 2024-03-16T07:37:31.153 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:37:31.153 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 91, 2024-03-16T07:37:31.153 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:37:31.153 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:37:31.154 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 91, 2024-03-16T07:37:31.154 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 3095773, 2024-03-16T07:37:31.154 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:37:31.154 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:37:31.154 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:37:31.154 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:37:31.154 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:31.154 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:31.154 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:31.154 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:37:31.154 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-objecter_bytes": [ 2024-03-16T07:37:31.154 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:37:31.154 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:37:31.154 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:37:31.154 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:37:31.154 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-03-16T07:37:31.154 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:37:31.155 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 0, 2024-03-16T07:37:31.155 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 0, 2024-03-16T07:37:31.155 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:37:31.155 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 0, 2024-03-16T07:37:31.155 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:37:31.155 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:37:31.155 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 0, 2024-03-16T07:37:31.155 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 0, 2024-03-16T07:37:31.155 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:37:31.155 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:37:31.155 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:37:31.155 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:37:31.155 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:31.155 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:31.155 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:31.155 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:37:31.155 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-objecter_ops": [ 2024-03-16T07:37:31.155 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:37:31.156 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:37:31.156 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:37:31.156 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:37:31.156 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 1024, 2024-03-16T07:37:31.156 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:37:31.156 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 0, 2024-03-16T07:37:31.156 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 0, 2024-03-16T07:37:31.156 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:37:31.156 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 0, 2024-03-16T07:37:31.156 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:37:31.156 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:37:31.156 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 0, 2024-03-16T07:37:31.156 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 0, 2024-03-16T07:37:31.156 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:37:31.156 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:37:31.157 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:37:31.157 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:37:31.157 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:31.157 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:31.157 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:31.157 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2024-03-16T07:37:31.157 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-03-16T07:37:31.158 DEBUG:tasks.cephfs.test_mirroring:command returned={ "AsyncMessenger::Worker": [ { "labels": { "id": "0" }, "counters": { "msgr_connection_ready_timeouts": 0, "msgr_connection_idle_timeouts": 0 } }, { "labels": { "id": "1" }, "counters": { "msgr_connection_ready_timeouts": 0, "msgr_connection_idle_timeouts": 0 } }, { "labels": { "id": "2" }, "counters": { "msgr_connection_ready_timeouts": 0, "msgr_connection_idle_timeouts": 0 } } ], "AsyncMessenger::Worker-0": [ { "labels": {}, "counters": { "msgr_recv_messages": 13, "msgr_send_messages": 157, "msgr_recv_bytes": 1872, "msgr_send_bytes": 1062384, "msgr_created_connections": 26, "msgr_active_connections": 5, "msgr_running_total_time": 0.381956141, "msgr_running_send_time": 0.155062259, "msgr_running_recv_time": 0.173849705, "msgr_running_fast_dispatch_time": 0.000000000, "msgr_send_messages_queue_lat": { "avgcount": 145, "sum": 0.216155688, "avgtime": 0.001490728 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "msgr_recv_encrypted_bytes": 1872, "msgr_send_encrypted_bytes": 1062384 } } ], "AsyncMessenger::Worker-1": [ { "labels": {}, "counters": { "msgr_recv_messages": 124, "msgr_send_messages": 10, "msgr_recv_bytes": 507744, "msgr_send_bytes": 2112, "msgr_created_connections": 4, "msgr_active_connections": 0, "msgr_running_total_time": 0.759040141, "msgr_running_send_time": 0.052074755, "msgr_running_recv_time": 0.485403018, "msgr_running_fast_dispatch_time": 0.194190800, "msgr_send_messages_queue_lat": { "avgcount": 9, "sum": 0.188856872, "avgtime": 0.020984096 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "msgr_recv_encrypted_bytes": 507744, "msgr_send_encrypted_bytes": 2112 } } ], "AsyncMessenger::Worker-2": [ { "labels": {}, "counters": { "msgr_recv_messages": 81, "msgr_send_messages": 13, "msgr_recv_bytes": 3107152, "msgr_send_bytes": 2576, "msgr_created_connections": 3, "msgr_active_connections": 1, "msgr_running_total_time": 1.770009569, "msgr_running_send_time": 0.016554462, "msgr_running_recv_time": 3.187966414, "msgr_running_fast_dispatch_time": 0.000000000, "msgr_send_messages_queue_lat": { "avgcount": 12, "sum": 0.346963753, "avgtime": 0.028913646 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "msgr_recv_encrypted_bytes": 3107152, "msgr_send_encrypted_bytes": 2576 } } ], "cct": [ { "labels": {}, "counters": { "total_workers": 0, "unhealthy_workers": 0 } } ], "cephfs_mirror": [ { "labels": {}, "counters": { "mirrored_filesystems": 2, "mirror_enable_failures": 0 } } ], "cephfs_mirror_mirrored_filesystems": [ { "labels": { "filesystem": "cephfs" }, "counters": { "mirroring_peers": 1, "directory_count": 3 } } ], "cephfs_mirror_peers": [ { "labels": { "peer_cluster_filesystem": "backup_fs", "peer_cluster_name": "ceph", "source_filesystem": "cephfs", "source_fscid": "14" }, "counters": { "snaps_synced": 0, "snaps_deleted": 0, "snaps_renamed": 0, "sync_failures": 0, "avg_sync_time": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "sync_bytes": 0 } } ], "mempool": [ { "labels": {}, "counters": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_cache_buffer_bytes": 0, "bluestore_cache_buffer_items": 0, "bluestore_extent_bytes": 0, "bluestore_extent_items": 0, "bluestore_blob_bytes": 0, "bluestore_blob_items": 0, "bluestore_shared_blob_bytes": 0, "bluestore_shared_blob_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_items": 0, "bluefs_bytes": 0, "bluefs_items": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "buffer_anon_bytes": 201872, "buffer_anon_items": 79, "buffer_meta_bytes": 0, "buffer_meta_items": 0, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 33848, "osdmap_items": 332, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "mds_co_bytes": 0, "mds_co_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 } } ], "objecter": [ { "labels": {}, "counters": { "op_active": 0, "op_laggy": 0, "op_send": 0, "op_send_bytes": 0, "op_resend": 0, "op_reply": 0, "op_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "op_inflight": 0, "oplen_avg": { "avgcount": 0, "sum": 0 }, "op": 0, "op_r": 0, "op_w": 0, "op_rmw": 0, "op_pg": 0, "osdop_stat": 0, "osdop_create": 0, "osdop_read": 0, "osdop_write": 0, "osdop_writefull": 0, "osdop_writesame": 0, "osdop_append": 0, "osdop_zero": 0, "osdop_truncate": 0, "osdop_delete": 0, "osdop_mapext": 0, "osdop_sparse_read": 0, "osdop_clonerange": 0, "osdop_getxattr": 0, "osdop_setxattr": 0, "osdop_cmpxattr": 0, "osdop_rmxattr": 0, "osdop_resetxattrs": 0, "osdop_call": 0, "osdop_watch": 0, "osdop_notify": 0, "osdop_src_cmpxattr": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_other": 0, "linger_active": 0, "linger_send": 0, "linger_resend": 0, "linger_ping": 0, "poolop_active": 0, "poolop_send": 0, "poolop_resend": 0, "poolstat_active": 0, "poolstat_send": 0, "poolstat_resend": 0, "statfs_active": 0, "statfs_send": 0, "statfs_resend": 0, "command_active": 0, "command_send": 0, "command_resend": 0, "map_epoch": 0, "map_full": 0, "map_inc": 0, "osd_sessions": 0, "osd_session_open": 0, "osd_session_close": 0, "osd_laggy": 0, "omap_wr": 0, "omap_rd": 0, "omap_del": 0 } } ], "throttle-msgr_dispatch_throttler-client": [ { "labels": {}, "counters": { "val": 0, "max": 104857600, "get_started": 0, "get": 124, "get_sum": 490920, "get_or_fail_fail": 0, "get_or_fail_success": 124, "take": 0, "take_sum": 0, "put": 124, "put_sum": 490920, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ], "throttle-msgr_dispatch_throttler-radosclient": [ { "labels": {}, "counters": { "val": 0, "max": 104857600, "get_started": 0, "get": 91, "get_sum": 3095773, "get_or_fail_fail": 0, "get_or_fail_success": 91, "take": 0, "take_sum": 0, "put": 91, "put_sum": 3095773, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ], "throttle-objecter_bytes": [ { "labels": {}, "counters": { "val": 0, "max": 104857600, "get_started": 0, "get": 0, "get_sum": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "take": 0, "take_sum": 0, "put": 0, "put_sum": 0, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ], "throttle-objecter_ops": [ { "labels": {}, "counters": { "val": 0, "max": 1024, "get_started": 0, "get": 0, "get_sum": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "take": 0, "take_sum": 0, "put": 0, "put_sum": 0, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ] } 2024-03-16T07:37:31.158 DEBUG:tasks.cephfs.test_mirroring:taking snapshots 2024-03-16T07:37:31.158 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:37:31.158 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir d0/.snap/snap0) 2024-03-16T07:37:31.178 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:37:31.178 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir d1/.snap/snap0) 2024-03-16T07:37:31.237 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:37:31.237 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir d2/.snap/snap0) 2024-03-16T07:37:39.611 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T07:37:41.299 DEBUG:tasks.cephfs.test_mirroring:checking snap in progress 2024-03-16T07:37:41.299 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T07:37:41.714 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:37:41.714 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":124,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6690,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6827/875237476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":875237476},{"type":"v1","addr":"172.21.15.49:6827","nonce":875237476}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":113},{"gid":6691,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6829/417322500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":417322500},{"type":"v1","addr":"172.21.15.49:6829","nonce":417322500}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":113},{"gid":6696,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6831/4121914730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":4121914730},{"type":"v1","addr":"172.21.15.49:6831","nonce":4121914730}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":113}],"filesystems":[{"mdsmap":{"epoch":124,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-16T07:35:10.038977+0000","modified":"2024-03-16T07:37:19.309479+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6698},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6698":{"gid":6698,"name":"a","rank":0,"incarnation":114,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6835/1838330688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":1838330688},{"type":"v1","addr":"172.21.15.49:6835","nonce":1838330688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[29],"metadata_pool":28,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6698,"qdb_cluster":[6698]},"id":14,"mirror_info":{"peers":{"8fa2e0a7-a624-43b8-9c12-da3a1afea05a":{"remote":{"client_name":"client.mirror_remote","cluster_name":"ceph","fs_name":"backup_fs"}}}}},{"mdsmap":{"epoch":122,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-16T07:35:23.124362+0000","modified":"2024-03-16T07:35:26.073338+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6697},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6697":{"gid":6697,"name":"e","rank":0,"incarnation":118,"state":"up:active","state_seq":6,"addr":"172.21.15.49:6834/1716116460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":1716116460},{"type":"v1","addr":"172.21.15.49:6834","nonce":1716116460}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[31],"metadata_pool":30,"enabled":true,"fs_name":"backup_fs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6697,"qdb_cluster":[6697]},"id":15}]} 2024-03-16T07:37:41.714 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 124 2024-03-16T07:37:41.727 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-03-16T07:37:41.727 DEBUG:teuthology.orchestra.run.smithi049:peer status for fs: cephfs> ceph --admin-daemon /var/run/ceph/cephfs-mirror.asok fs mirror peer status cephfs@14 8fa2e0a7-a624-43b8-9c12-da3a1afea05a 2024-03-16T07:37:45.325 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-03-16T07:37:45.325 INFO:teuthology.orchestra.run.smithi049.stdout: "/d0": { 2024-03-16T07:37:45.325 INFO:teuthology.orchestra.run.smithi049.stdout: "state": "syncing", 2024-03-16T07:37:45.325 INFO:teuthology.orchestra.run.smithi049.stdout: "current_syncing_snap": { 2024-03-16T07:37:45.325 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2, 2024-03-16T07:37:45.325 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "snap0" 2024-03-16T07:37:45.325 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:37:45.325 INFO:teuthology.orchestra.run.smithi049.stdout: "snaps_synced": 0, 2024-03-16T07:37:45.325 INFO:teuthology.orchestra.run.smithi049.stdout: "snaps_deleted": 0, 2024-03-16T07:37:45.325 INFO:teuthology.orchestra.run.smithi049.stdout: "snaps_renamed": 0 2024-03-16T07:37:45.325 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:37:45.325 INFO:teuthology.orchestra.run.smithi049.stdout: "/d1": { 2024-03-16T07:37:45.325 INFO:teuthology.orchestra.run.smithi049.stdout: "state": "idle", 2024-03-16T07:37:45.326 INFO:teuthology.orchestra.run.smithi049.stdout: "snaps_synced": 0, 2024-03-16T07:37:45.326 INFO:teuthology.orchestra.run.smithi049.stdout: "snaps_deleted": 0, 2024-03-16T07:37:45.326 INFO:teuthology.orchestra.run.smithi049.stdout: "snaps_renamed": 0 2024-03-16T07:37:45.326 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:37:45.326 INFO:teuthology.orchestra.run.smithi049.stdout: "/d2": { 2024-03-16T07:37:45.326 INFO:teuthology.orchestra.run.smithi049.stdout: "state": "idle", 2024-03-16T07:37:45.326 INFO:teuthology.orchestra.run.smithi049.stdout: "snaps_synced": 0, 2024-03-16T07:37:45.326 INFO:teuthology.orchestra.run.smithi049.stdout: "snaps_deleted": 0, 2024-03-16T07:37:45.326 INFO:teuthology.orchestra.run.smithi049.stdout: "snaps_renamed": 0 2024-03-16T07:37:45.326 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:45.326 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-03-16T07:37:45.332 DEBUG:tasks.cephfs.test_mirroring:command returned={ "/d0": { "state": "syncing", "current_syncing_snap": { "id": 2, "name": "snap0" }, "snaps_synced": 0, "snaps_deleted": 0, "snaps_renamed": 0 }, "/d1": { "state": "idle", "snaps_synced": 0, "snaps_deleted": 0, "snaps_renamed": 0 }, "/d2": { "state": "idle", "snaps_synced": 0, "snaps_deleted": 0, "snaps_renamed": 0 } } 2024-03-16T07:37:45.333 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T07:37:45.784 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:37:45.784 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":124,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6690,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6827/875237476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":875237476},{"type":"v1","addr":"172.21.15.49:6827","nonce":875237476}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":113},{"gid":6691,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6829/417322500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":417322500},{"type":"v1","addr":"172.21.15.49:6829","nonce":417322500}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":113},{"gid":6696,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6831/4121914730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":4121914730},{"type":"v1","addr":"172.21.15.49:6831","nonce":4121914730}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":113}],"filesystems":[{"mdsmap":{"epoch":124,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-16T07:35:10.038977+0000","modified":"2024-03-16T07:37:19.309479+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6698},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6698":{"gid":6698,"name":"a","rank":0,"incarnation":114,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6835/1838330688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":1838330688},{"type":"v1","addr":"172.21.15.49:6835","nonce":1838330688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[29],"metadata_pool":28,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6698,"qdb_cluster":[6698]},"id":14,"mirror_info":{"peers":{"8fa2e0a7-a624-43b8-9c12-da3a1afea05a":{"remote":{"client_name":"client.mirror_remote","cluster_name":"ceph","fs_name":"backup_fs"}}}}},{"mdsmap":{"epoch":122,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-16T07:35:23.124362+0000","modified":"2024-03-16T07:35:26.073338+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6697},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6697":{"gid":6697,"name":"e","rank":0,"incarnation":118,"state":"up:active","state_seq":6,"addr":"172.21.15.49:6834/1716116460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":1716116460},{"type":"v1","addr":"172.21.15.49:6834","nonce":1716116460}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[31],"metadata_pool":30,"enabled":true,"fs_name":"backup_fs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6697,"qdb_cluster":[6697]},"id":15}]} 2024-03-16T07:37:45.785 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 124 2024-03-16T07:37:45.796 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-03-16T07:37:45.796 DEBUG:teuthology.orchestra.run.smithi049:peer status for fs: cephfs> ceph --admin-daemon /var/run/ceph/cephfs-mirror.asok fs mirror peer status cephfs@14 8fa2e0a7-a624-43b8-9c12-da3a1afea05a 2024-03-16T07:37:50.516 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-03-16T07:37:50.516 INFO:teuthology.orchestra.run.smithi049.stdout: "/d0": { 2024-03-16T07:37:50.517 INFO:teuthology.orchestra.run.smithi049.stdout: "state": "syncing", 2024-03-16T07:37:50.517 INFO:teuthology.orchestra.run.smithi049.stdout: "current_syncing_snap": { 2024-03-16T07:37:50.517 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2, 2024-03-16T07:37:50.517 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "snap0" 2024-03-16T07:37:50.517 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:37:50.517 INFO:teuthology.orchestra.run.smithi049.stdout: "snaps_synced": 0, 2024-03-16T07:37:50.517 INFO:teuthology.orchestra.run.smithi049.stdout: "snaps_deleted": 0, 2024-03-16T07:37:50.517 INFO:teuthology.orchestra.run.smithi049.stdout: "snaps_renamed": 0 2024-03-16T07:37:50.517 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:37:50.517 INFO:teuthology.orchestra.run.smithi049.stdout: "/d1": { 2024-03-16T07:37:50.517 INFO:teuthology.orchestra.run.smithi049.stdout: "state": "syncing", 2024-03-16T07:37:50.517 INFO:teuthology.orchestra.run.smithi049.stdout: "current_syncing_snap": { 2024-03-16T07:37:50.517 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3, 2024-03-16T07:37:50.517 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "snap0" 2024-03-16T07:37:50.518 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:37:50.518 INFO:teuthology.orchestra.run.smithi049.stdout: "snaps_synced": 0, 2024-03-16T07:37:50.518 INFO:teuthology.orchestra.run.smithi049.stdout: "snaps_deleted": 0, 2024-03-16T07:37:50.518 INFO:teuthology.orchestra.run.smithi049.stdout: "snaps_renamed": 0 2024-03-16T07:37:50.518 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:37:50.518 INFO:teuthology.orchestra.run.smithi049.stdout: "/d2": { 2024-03-16T07:37:50.518 INFO:teuthology.orchestra.run.smithi049.stdout: "state": "idle", 2024-03-16T07:37:50.518 INFO:teuthology.orchestra.run.smithi049.stdout: "snaps_synced": 0, 2024-03-16T07:37:50.518 INFO:teuthology.orchestra.run.smithi049.stdout: "snaps_deleted": 0, 2024-03-16T07:37:50.518 INFO:teuthology.orchestra.run.smithi049.stdout: "snaps_renamed": 0 2024-03-16T07:37:50.518 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:50.518 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-03-16T07:37:50.524 DEBUG:tasks.cephfs.test_mirroring:command returned={ "/d0": { "state": "syncing", "current_syncing_snap": { "id": 2, "name": "snap0" }, "snaps_synced": 0, "snaps_deleted": 0, "snaps_renamed": 0 }, "/d1": { "state": "syncing", "current_syncing_snap": { "id": 3, "name": "snap0" }, "snaps_synced": 0, "snaps_deleted": 0, "snaps_renamed": 0 }, "/d2": { "state": "idle", "snaps_synced": 0, "snaps_deleted": 0, "snaps_renamed": 0 } } 2024-03-16T07:37:50.525 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T07:37:50.886 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:37:50.886 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":124,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6690,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6827/875237476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":875237476},{"type":"v1","addr":"172.21.15.49:6827","nonce":875237476}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":113},{"gid":6691,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6829/417322500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":417322500},{"type":"v1","addr":"172.21.15.49:6829","nonce":417322500}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":113},{"gid":6696,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6831/4121914730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":4121914730},{"type":"v1","addr":"172.21.15.49:6831","nonce":4121914730}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":113}],"filesystems":[{"mdsmap":{"epoch":124,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-16T07:35:10.038977+0000","modified":"2024-03-16T07:37:19.309479+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6698},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6698":{"gid":6698,"name":"a","rank":0,"incarnation":114,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6835/1838330688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":1838330688},{"type":"v1","addr":"172.21.15.49:6835","nonce":1838330688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[29],"metadata_pool":28,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6698,"qdb_cluster":[6698]},"id":14,"mirror_info":{"peers":{"8fa2e0a7-a624-43b8-9c12-da3a1afea05a":{"remote":{"client_name":"client.mirror_remote","cluster_name":"ceph","fs_name":"backup_fs"}}}}},{"mdsmap":{"epoch":122,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-16T07:35:23.124362+0000","modified":"2024-03-16T07:35:26.073338+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6697},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6697":{"gid":6697,"name":"e","rank":0,"incarnation":118,"state":"up:active","state_seq":6,"addr":"172.21.15.49:6834/1716116460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":1716116460},{"type":"v1","addr":"172.21.15.49:6834","nonce":1716116460}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[31],"metadata_pool":30,"enabled":true,"fs_name":"backup_fs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6697,"qdb_cluster":[6697]},"id":15}]} 2024-03-16T07:37:50.886 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 124 2024-03-16T07:37:50.899 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-03-16T07:37:50.899 DEBUG:teuthology.orchestra.run.smithi049:peer status for fs: cephfs> ceph --admin-daemon /var/run/ceph/cephfs-mirror.asok fs mirror peer status cephfs@14 8fa2e0a7-a624-43b8-9c12-da3a1afea05a 2024-03-16T07:37:55.544 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-03-16T07:37:55.544 INFO:teuthology.orchestra.run.smithi049.stdout: "/d0": { 2024-03-16T07:37:55.544 INFO:teuthology.orchestra.run.smithi049.stdout: "state": "syncing", 2024-03-16T07:37:55.544 INFO:teuthology.orchestra.run.smithi049.stdout: "current_syncing_snap": { 2024-03-16T07:37:55.544 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 2, 2024-03-16T07:37:55.544 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "snap0" 2024-03-16T07:37:55.544 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:37:55.544 INFO:teuthology.orchestra.run.smithi049.stdout: "snaps_synced": 0, 2024-03-16T07:37:55.544 INFO:teuthology.orchestra.run.smithi049.stdout: "snaps_deleted": 0, 2024-03-16T07:37:55.544 INFO:teuthology.orchestra.run.smithi049.stdout: "snaps_renamed": 0 2024-03-16T07:37:55.544 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:37:55.545 INFO:teuthology.orchestra.run.smithi049.stdout: "/d1": { 2024-03-16T07:37:55.545 INFO:teuthology.orchestra.run.smithi049.stdout: "state": "syncing", 2024-03-16T07:37:55.545 INFO:teuthology.orchestra.run.smithi049.stdout: "current_syncing_snap": { 2024-03-16T07:37:55.545 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 3, 2024-03-16T07:37:55.545 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "snap0" 2024-03-16T07:37:55.545 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:37:55.545 INFO:teuthology.orchestra.run.smithi049.stdout: "snaps_synced": 0, 2024-03-16T07:37:55.545 INFO:teuthology.orchestra.run.smithi049.stdout: "snaps_deleted": 0, 2024-03-16T07:37:55.545 INFO:teuthology.orchestra.run.smithi049.stdout: "snaps_renamed": 0 2024-03-16T07:37:55.545 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:37:55.545 INFO:teuthology.orchestra.run.smithi049.stdout: "/d2": { 2024-03-16T07:37:55.545 INFO:teuthology.orchestra.run.smithi049.stdout: "state": "syncing", 2024-03-16T07:37:55.545 INFO:teuthology.orchestra.run.smithi049.stdout: "current_syncing_snap": { 2024-03-16T07:37:55.545 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 4, 2024-03-16T07:37:55.545 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "snap0" 2024-03-16T07:37:55.545 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:37:55.546 INFO:teuthology.orchestra.run.smithi049.stdout: "snaps_synced": 0, 2024-03-16T07:37:55.546 INFO:teuthology.orchestra.run.smithi049.stdout: "snaps_deleted": 0, 2024-03-16T07:37:55.546 INFO:teuthology.orchestra.run.smithi049.stdout: "snaps_renamed": 0 2024-03-16T07:37:55.546 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:55.546 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-03-16T07:37:55.551 DEBUG:tasks.cephfs.test_mirroring:command returned={ "/d0": { "state": "syncing", "current_syncing_snap": { "id": 2, "name": "snap0" }, "snaps_synced": 0, "snaps_deleted": 0, "snaps_renamed": 0 }, "/d1": { "state": "syncing", "current_syncing_snap": { "id": 3, "name": "snap0" }, "snaps_synced": 0, "snaps_deleted": 0, "snaps_renamed": 0 }, "/d2": { "state": "syncing", "current_syncing_snap": { "id": 4, "name": "snap0" }, "snaps_synced": 0, "snaps_deleted": 0, "snaps_renamed": 0 } } 2024-03-16T07:37:55.552 DEBUG:tasks.cephfs.test_mirroring:removing directories 1 2024-03-16T07:37:55.552 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-03-16T07:37:55.552 DEBUG:teuthology.orchestra.run.smithi049:counter dump for fs: cephfs> ceph --admin-daemon /var/run/ceph/cephfs-mirror.asok counter dump 2024-03-16T07:37:57.511 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-03-16T07:37:57.512 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker": [ 2024-03-16T07:37:57.512 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:37:57.512 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:37:57.512 INFO:teuthology.orchestra.run.smithi049.stdout: "id": "0" 2024-03-16T07:37:57.512 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:37:57.512 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:37:57.512 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_ready_timeouts": 0, 2024-03-16T07:37:57.512 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_idle_timeouts": 0 2024-03-16T07:37:57.512 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:57.512 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:37:57.512 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:37:57.512 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:37:57.513 INFO:teuthology.orchestra.run.smithi049.stdout: "id": "1" 2024-03-16T07:37:57.513 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:37:57.513 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:37:57.513 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_ready_timeouts": 0, 2024-03-16T07:37:57.513 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_idle_timeouts": 0 2024-03-16T07:37:57.513 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:57.513 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:37:57.513 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:37:57.513 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:37:57.513 INFO:teuthology.orchestra.run.smithi049.stdout: "id": "2" 2024-03-16T07:37:57.513 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:37:57.513 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:37:57.513 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_ready_timeouts": 0, 2024-03-16T07:37:57.513 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_idle_timeouts": 0 2024-03-16T07:37:57.514 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:57.514 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:57.514 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:37:57.514 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-0": [ 2024-03-16T07:37:57.514 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:37:57.514 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:37:57.514 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:37:57.514 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 13, 2024-03-16T07:37:57.514 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 162, 2024-03-16T07:37:57.514 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 1872, 2024-03-16T07:37:57.514 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 1063584, 2024-03-16T07:37:57.514 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 26, 2024-03-16T07:37:57.514 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 5, 2024-03-16T07:37:57.514 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 0.664258606, 2024-03-16T07:37:57.514 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.297797271, 2024-03-16T07:37:57.515 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 0.173849705, 2024-03-16T07:37:57.515 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-03-16T07:37:57.515 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T07:37:57.515 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 150, 2024-03-16T07:37:57.515 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.768296481, 2024-03-16T07:37:57.515 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.005121976 2024-03-16T07:37:57.515 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:37:57.515 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-03-16T07:37:57.515 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:37:57.515 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:37:57.515 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:37:57.515 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:37:57.515 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 1872, 2024-03-16T07:37:57.515 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 1063584 2024-03-16T07:37:57.515 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:57.515 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:57.516 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:37:57.516 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-1": [ 2024-03-16T07:37:57.516 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:37:57.516 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:37:57.516 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:37:57.516 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 124, 2024-03-16T07:37:57.516 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 10, 2024-03-16T07:37:57.516 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 507744, 2024-03-16T07:37:57.516 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 2112, 2024-03-16T07:37:57.516 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 4, 2024-03-16T07:37:57.516 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 0, 2024-03-16T07:37:57.516 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 1.294048026, 2024-03-16T07:37:57.516 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.102952865, 2024-03-16T07:37:57.516 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 0.901031633, 2024-03-16T07:37:57.516 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.194190800, 2024-03-16T07:37:57.516 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T07:37:57.516 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 9, 2024-03-16T07:37:57.517 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.188856872, 2024-03-16T07:37:57.517 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.020984096 2024-03-16T07:37:57.517 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:37:57.517 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-03-16T07:37:57.517 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:37:57.517 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:37:57.517 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:37:57.517 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:37:57.517 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 507744, 2024-03-16T07:37:57.517 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 2112 2024-03-16T07:37:57.517 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:57.517 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:57.517 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:37:57.517 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-2": [ 2024-03-16T07:37:57.517 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:37:57.517 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:37:57.518 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:37:57.518 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 81, 2024-03-16T07:37:57.518 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 13, 2024-03-16T07:37:57.518 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 3107152, 2024-03-16T07:37:57.518 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 2576, 2024-03-16T07:37:57.518 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 3, 2024-03-16T07:37:57.518 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 1, 2024-03-16T07:37:57.518 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 2.574221745, 2024-03-16T07:37:57.518 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.150180959, 2024-03-16T07:37:57.518 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 3.438801154, 2024-03-16T07:37:57.518 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-03-16T07:37:57.518 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T07:37:57.518 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 12, 2024-03-16T07:37:57.518 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.346963753, 2024-03-16T07:37:57.518 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.028913646 2024-03-16T07:37:57.519 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:37:57.519 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-03-16T07:37:57.519 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:37:57.519 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:37:57.519 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:37:57.519 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:37:57.519 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 3107152, 2024-03-16T07:37:57.519 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 2576 2024-03-16T07:37:57.519 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:57.519 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:57.519 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:37:57.519 INFO:teuthology.orchestra.run.smithi049.stdout: "cct": [ 2024-03-16T07:37:57.519 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:37:57.519 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:37:57.519 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:37:57.519 INFO:teuthology.orchestra.run.smithi049.stdout: "total_workers": 0, 2024-03-16T07:37:57.519 INFO:teuthology.orchestra.run.smithi049.stdout: "unhealthy_workers": 0 2024-03-16T07:37:57.520 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:57.520 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:57.520 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:37:57.520 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs_mirror": [ 2024-03-16T07:37:57.520 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:37:57.520 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:37:57.520 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:37:57.520 INFO:teuthology.orchestra.run.smithi049.stdout: "mirrored_filesystems": 2, 2024-03-16T07:37:57.520 INFO:teuthology.orchestra.run.smithi049.stdout: "mirror_enable_failures": 0 2024-03-16T07:37:57.520 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:57.520 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:57.520 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:37:57.520 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs_mirror_mirrored_filesystems": [ 2024-03-16T07:37:57.520 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:37:57.520 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:37:57.520 INFO:teuthology.orchestra.run.smithi049.stdout: "filesystem": "cephfs" 2024-03-16T07:37:57.521 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:37:57.521 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:37:57.521 INFO:teuthology.orchestra.run.smithi049.stdout: "mirroring_peers": 1, 2024-03-16T07:37:57.521 INFO:teuthology.orchestra.run.smithi049.stdout: "directory_count": 3 2024-03-16T07:37:57.521 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:57.521 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:57.521 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:37:57.521 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs_mirror_peers": [ 2024-03-16T07:37:57.521 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:37:57.521 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:37:57.521 INFO:teuthology.orchestra.run.smithi049.stdout: "peer_cluster_filesystem": "backup_fs", 2024-03-16T07:37:57.521 INFO:teuthology.orchestra.run.smithi049.stdout: "peer_cluster_name": "ceph", 2024-03-16T07:37:57.521 INFO:teuthology.orchestra.run.smithi049.stdout: "source_filesystem": "cephfs", 2024-03-16T07:37:57.521 INFO:teuthology.orchestra.run.smithi049.stdout: "source_fscid": "14" 2024-03-16T07:37:57.521 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:37:57.521 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:37:57.521 INFO:teuthology.orchestra.run.smithi049.stdout: "snaps_synced": 0, 2024-03-16T07:37:57.522 INFO:teuthology.orchestra.run.smithi049.stdout: "snaps_deleted": 0, 2024-03-16T07:37:57.522 INFO:teuthology.orchestra.run.smithi049.stdout: "snaps_renamed": 0, 2024-03-16T07:37:57.522 INFO:teuthology.orchestra.run.smithi049.stdout: "sync_failures": 2, 2024-03-16T07:37:57.522 INFO:teuthology.orchestra.run.smithi049.stdout: "avg_sync_time": { 2024-03-16T07:37:57.522 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:37:57.522 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:37:57.522 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:37:57.522 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:37:57.522 INFO:teuthology.orchestra.run.smithi049.stdout: "sync_bytes": 0 2024-03-16T07:37:57.522 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:57.522 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:57.522 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:37:57.522 INFO:teuthology.orchestra.run.smithi049.stdout: "mempool": [ 2024-03-16T07:37:57.522 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:37:57.522 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:37:57.522 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:37:57.522 INFO:teuthology.orchestra.run.smithi049.stdout: "bloom_filter_bytes": 0, 2024-03-16T07:37:57.523 INFO:teuthology.orchestra.run.smithi049.stdout: "bloom_filter_items": 0, 2024-03-16T07:37:57.523 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_alloc_bytes": 0, 2024-03-16T07:37:57.523 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_alloc_items": 0, 2024-03-16T07:37:57.523 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_data_bytes": 0, 2024-03-16T07:37:57.523 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_data_items": 0, 2024-03-16T07:37:57.523 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_onode_bytes": 0, 2024-03-16T07:37:57.523 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_onode_items": 0, 2024-03-16T07:37:57.523 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_meta_bytes": 0, 2024-03-16T07:37:57.523 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_meta_items": 0, 2024-03-16T07:37:57.523 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_other_bytes": 0, 2024-03-16T07:37:57.523 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_other_items": 0, 2024-03-16T07:37:57.523 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_buffer_bytes": 0, 2024-03-16T07:37:57.523 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_buffer_items": 0, 2024-03-16T07:37:57.523 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_extent_bytes": 0, 2024-03-16T07:37:57.523 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_extent_items": 0, 2024-03-16T07:37:57.523 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_blob_bytes": 0, 2024-03-16T07:37:57.523 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_blob_items": 0, 2024-03-16T07:37:57.524 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_shared_blob_bytes": 0, 2024-03-16T07:37:57.524 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_shared_blob_items": 0, 2024-03-16T07:37:57.524 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_inline_bl_bytes": 0, 2024-03-16T07:37:57.524 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_inline_bl_items": 0, 2024-03-16T07:37:57.524 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_fsck_bytes": 0, 2024-03-16T07:37:57.524 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_fsck_items": 0, 2024-03-16T07:37:57.524 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_txc_bytes": 0, 2024-03-16T07:37:57.524 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_txc_items": 0, 2024-03-16T07:37:57.524 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_deferred_bytes": 0, 2024-03-16T07:37:57.524 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_deferred_items": 0, 2024-03-16T07:37:57.524 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_bytes": 0, 2024-03-16T07:37:57.524 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_items": 0, 2024-03-16T07:37:57.524 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_bytes": 0, 2024-03-16T07:37:57.524 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_items": 0, 2024-03-16T07:37:57.524 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_reader_bytes": 0, 2024-03-16T07:37:57.524 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_reader_items": 0, 2024-03-16T07:37:57.524 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_writer_bytes": 0, 2024-03-16T07:37:57.524 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_writer_items": 0, 2024-03-16T07:37:57.525 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_anon_bytes": 633605546, 2024-03-16T07:37:57.525 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_anon_items": 230, 2024-03-16T07:37:57.525 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_meta_bytes": 7304, 2024-03-16T07:37:57.525 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_meta_items": 83, 2024-03-16T07:37:57.525 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_bytes": 0, 2024-03-16T07:37:57.525 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_items": 0, 2024-03-16T07:37:57.525 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_mapbl_bytes": 0, 2024-03-16T07:37:57.525 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_mapbl_items": 0, 2024-03-16T07:37:57.525 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pglog_bytes": 0, 2024-03-16T07:37:57.525 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pglog_items": 0, 2024-03-16T07:37:57.525 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_bytes": 33848, 2024-03-16T07:37:57.525 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_items": 332, 2024-03-16T07:37:57.525 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_mapping_bytes": 0, 2024-03-16T07:37:57.525 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_mapping_items": 0, 2024-03-16T07:37:57.525 INFO:teuthology.orchestra.run.smithi049.stdout: "pgmap_bytes": 0, 2024-03-16T07:37:57.525 INFO:teuthology.orchestra.run.smithi049.stdout: "pgmap_items": 0, 2024-03-16T07:37:57.525 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_co_bytes": 0, 2024-03-16T07:37:57.526 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_co_items": 0, 2024-03-16T07:37:57.526 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_1_bytes": 0, 2024-03-16T07:37:57.526 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_1_items": 0, 2024-03-16T07:37:57.526 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_2_bytes": 0, 2024-03-16T07:37:57.526 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_2_items": 0 2024-03-16T07:37:57.526 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:57.526 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:57.526 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:37:57.526 INFO:teuthology.orchestra.run.smithi049.stdout: "objecter": [ 2024-03-16T07:37:57.526 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:37:57.526 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:37:57.526 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:37:57.526 INFO:teuthology.orchestra.run.smithi049.stdout: "op_active": 0, 2024-03-16T07:37:57.526 INFO:teuthology.orchestra.run.smithi049.stdout: "op_laggy": 0, 2024-03-16T07:37:57.526 INFO:teuthology.orchestra.run.smithi049.stdout: "op_send": 0, 2024-03-16T07:37:57.526 INFO:teuthology.orchestra.run.smithi049.stdout: "op_send_bytes": 0, 2024-03-16T07:37:57.526 INFO:teuthology.orchestra.run.smithi049.stdout: "op_resend": 0, 2024-03-16T07:37:57.527 INFO:teuthology.orchestra.run.smithi049.stdout: "op_reply": 0, 2024-03-16T07:37:57.527 INFO:teuthology.orchestra.run.smithi049.stdout: "op_latency": { 2024-03-16T07:37:57.527 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:37:57.527 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:37:57.527 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:37:57.527 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:37:57.527 INFO:teuthology.orchestra.run.smithi049.stdout: "op_inflight": 0, 2024-03-16T07:37:57.527 INFO:teuthology.orchestra.run.smithi049.stdout: "oplen_avg": { 2024-03-16T07:37:57.527 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:37:57.527 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0 2024-03-16T07:37:57.527 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:37:57.527 INFO:teuthology.orchestra.run.smithi049.stdout: "op": 0, 2024-03-16T07:37:57.527 INFO:teuthology.orchestra.run.smithi049.stdout: "op_r": 0, 2024-03-16T07:37:57.527 INFO:teuthology.orchestra.run.smithi049.stdout: "op_w": 0, 2024-03-16T07:37:57.527 INFO:teuthology.orchestra.run.smithi049.stdout: "op_rmw": 0, 2024-03-16T07:37:57.527 INFO:teuthology.orchestra.run.smithi049.stdout: "op_pg": 0, 2024-03-16T07:37:57.527 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_stat": 0, 2024-03-16T07:37:57.528 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_create": 0, 2024-03-16T07:37:57.528 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_read": 0, 2024-03-16T07:37:57.528 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_write": 0, 2024-03-16T07:37:57.528 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_writefull": 0, 2024-03-16T07:37:57.528 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_writesame": 0, 2024-03-16T07:37:57.528 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_append": 0, 2024-03-16T07:37:57.528 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_zero": 0, 2024-03-16T07:37:57.528 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_truncate": 0, 2024-03-16T07:37:57.528 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_delete": 0, 2024-03-16T07:37:57.528 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_mapext": 0, 2024-03-16T07:37:57.528 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_sparse_read": 0, 2024-03-16T07:37:57.528 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_clonerange": 0, 2024-03-16T07:37:57.528 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_getxattr": 0, 2024-03-16T07:37:57.528 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_setxattr": 0, 2024-03-16T07:37:57.528 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_cmpxattr": 0, 2024-03-16T07:37:57.528 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_rmxattr": 0, 2024-03-16T07:37:57.528 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_resetxattrs": 0, 2024-03-16T07:37:57.529 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_call": 0, 2024-03-16T07:37:57.529 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_watch": 0, 2024-03-16T07:37:57.529 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_notify": 0, 2024-03-16T07:37:57.529 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_src_cmpxattr": 0, 2024-03-16T07:37:57.529 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_pgls": 0, 2024-03-16T07:37:57.529 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_pgls_filter": 0, 2024-03-16T07:37:57.529 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_other": 0, 2024-03-16T07:37:57.529 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_active": 0, 2024-03-16T07:37:57.529 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_send": 0, 2024-03-16T07:37:57.529 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_resend": 0, 2024-03-16T07:37:57.529 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_ping": 0, 2024-03-16T07:37:57.529 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_active": 0, 2024-03-16T07:37:57.529 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_send": 0, 2024-03-16T07:37:57.529 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_resend": 0, 2024-03-16T07:37:57.529 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_active": 0, 2024-03-16T07:37:57.529 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_send": 0, 2024-03-16T07:37:57.530 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_resend": 0, 2024-03-16T07:37:57.530 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_active": 0, 2024-03-16T07:37:57.530 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_send": 0, 2024-03-16T07:37:57.530 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_resend": 0, 2024-03-16T07:37:57.530 INFO:teuthology.orchestra.run.smithi049.stdout: "command_active": 0, 2024-03-16T07:37:57.530 INFO:teuthology.orchestra.run.smithi049.stdout: "command_send": 0, 2024-03-16T07:37:57.530 INFO:teuthology.orchestra.run.smithi049.stdout: "command_resend": 0, 2024-03-16T07:37:57.530 INFO:teuthology.orchestra.run.smithi049.stdout: "map_epoch": 0, 2024-03-16T07:37:57.530 INFO:teuthology.orchestra.run.smithi049.stdout: "map_full": 0, 2024-03-16T07:37:57.530 INFO:teuthology.orchestra.run.smithi049.stdout: "map_inc": 0, 2024-03-16T07:37:57.530 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_sessions": 0, 2024-03-16T07:37:57.530 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_session_open": 0, 2024-03-16T07:37:57.530 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_session_close": 0, 2024-03-16T07:37:57.530 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_laggy": 0, 2024-03-16T07:37:57.530 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_wr": 0, 2024-03-16T07:37:57.531 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_rd": 0, 2024-03-16T07:37:57.531 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_del": 0 2024-03-16T07:37:57.531 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:57.531 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:57.531 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:37:57.531 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-msgr_dispatch_throttler-client": [ 2024-03-16T07:37:57.531 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:37:57.531 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:37:57.531 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:37:57.531 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:37:57.531 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-03-16T07:37:57.531 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:37:57.531 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 124, 2024-03-16T07:37:57.531 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 490920, 2024-03-16T07:37:57.531 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:37:57.531 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 124, 2024-03-16T07:37:57.532 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:37:57.532 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:37:57.532 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 124, 2024-03-16T07:37:57.532 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 490920, 2024-03-16T07:37:57.532 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:37:57.532 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:37:57.532 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:37:57.532 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:37:57.532 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:57.532 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:57.532 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:57.532 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:37:57.532 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-msgr_dispatch_throttler-radosclient": [ 2024-03-16T07:37:57.532 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:37:57.532 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:37:57.532 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:37:57.532 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:37:57.533 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-03-16T07:37:57.533 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:37:57.533 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 91, 2024-03-16T07:37:57.533 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 3095773, 2024-03-16T07:37:57.533 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:37:57.533 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 91, 2024-03-16T07:37:57.533 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:37:57.533 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:37:57.533 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 91, 2024-03-16T07:37:57.533 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 3095773, 2024-03-16T07:37:57.533 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:37:57.533 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:37:57.533 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:37:57.533 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:37:57.533 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:57.533 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:57.533 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:57.534 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:37:57.534 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-objecter_bytes": [ 2024-03-16T07:37:57.534 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:37:57.534 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:37:57.534 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:37:57.534 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:37:57.534 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-03-16T07:37:57.534 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:37:57.534 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 0, 2024-03-16T07:37:57.534 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 0, 2024-03-16T07:37:57.534 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:37:57.534 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 0, 2024-03-16T07:37:57.534 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:37:57.534 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:37:57.535 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 0, 2024-03-16T07:37:57.535 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 0, 2024-03-16T07:37:57.535 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:37:57.535 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:37:57.535 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:37:57.535 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:37:57.535 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:57.535 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:57.535 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:57.535 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:37:57.535 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-objecter_ops": [ 2024-03-16T07:37:57.535 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:37:57.535 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:37:57.535 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:37:57.535 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:37:57.535 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 1024, 2024-03-16T07:37:57.535 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:37:57.535 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 0, 2024-03-16T07:37:57.536 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 0, 2024-03-16T07:37:57.536 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:37:57.536 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 0, 2024-03-16T07:37:57.536 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:37:57.536 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:37:57.536 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 0, 2024-03-16T07:37:57.536 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 0, 2024-03-16T07:37:57.536 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:37:57.536 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:37:57.536 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:37:57.536 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:37:57.536 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:57.536 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:57.536 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:37:57.536 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2024-03-16T07:37:57.536 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-03-16T07:37:57.537 DEBUG:tasks.cephfs.test_mirroring:command returned={ "AsyncMessenger::Worker": [ { "labels": { "id": "0" }, "counters": { "msgr_connection_ready_timeouts": 0, "msgr_connection_idle_timeouts": 0 } }, { "labels": { "id": "1" }, "counters": { "msgr_connection_ready_timeouts": 0, "msgr_connection_idle_timeouts": 0 } }, { "labels": { "id": "2" }, "counters": { "msgr_connection_ready_timeouts": 0, "msgr_connection_idle_timeouts": 0 } } ], "AsyncMessenger::Worker-0": [ { "labels": {}, "counters": { "msgr_recv_messages": 13, "msgr_send_messages": 162, "msgr_recv_bytes": 1872, "msgr_send_bytes": 1063584, "msgr_created_connections": 26, "msgr_active_connections": 5, "msgr_running_total_time": 0.664258606, "msgr_running_send_time": 0.297797271, "msgr_running_recv_time": 0.173849705, "msgr_running_fast_dispatch_time": 0.000000000, "msgr_send_messages_queue_lat": { "avgcount": 150, "sum": 0.768296481, "avgtime": 0.005121976 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "msgr_recv_encrypted_bytes": 1872, "msgr_send_encrypted_bytes": 1063584 } } ], "AsyncMessenger::Worker-1": [ { "labels": {}, "counters": { "msgr_recv_messages": 124, "msgr_send_messages": 10, "msgr_recv_bytes": 507744, "msgr_send_bytes": 2112, "msgr_created_connections": 4, "msgr_active_connections": 0, "msgr_running_total_time": 1.294048026, "msgr_running_send_time": 0.102952865, "msgr_running_recv_time": 0.901031633, "msgr_running_fast_dispatch_time": 0.194190800, "msgr_send_messages_queue_lat": { "avgcount": 9, "sum": 0.188856872, "avgtime": 0.020984096 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "msgr_recv_encrypted_bytes": 507744, "msgr_send_encrypted_bytes": 2112 } } ], "AsyncMessenger::Worker-2": [ { "labels": {}, "counters": { "msgr_recv_messages": 81, "msgr_send_messages": 13, "msgr_recv_bytes": 3107152, "msgr_send_bytes": 2576, "msgr_created_connections": 3, "msgr_active_connections": 1, "msgr_running_total_time": 2.574221745, "msgr_running_send_time": 0.150180959, "msgr_running_recv_time": 3.438801154, "msgr_running_fast_dispatch_time": 0.000000000, "msgr_send_messages_queue_lat": { "avgcount": 12, "sum": 0.346963753, "avgtime": 0.028913646 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "msgr_recv_encrypted_bytes": 3107152, "msgr_send_encrypted_bytes": 2576 } } ], "cct": [ { "labels": {}, "counters": { "total_workers": 0, "unhealthy_workers": 0 } } ], "cephfs_mirror": [ { "labels": {}, "counters": { "mirrored_filesystems": 2, "mirror_enable_failures": 0 } } ], "cephfs_mirror_mirrored_filesystems": [ { "labels": { "filesystem": "cephfs" }, "counters": { "mirroring_peers": 1, "directory_count": 3 } } ], "cephfs_mirror_peers": [ { "labels": { "peer_cluster_filesystem": "backup_fs", "peer_cluster_name": "ceph", "source_filesystem": "cephfs", "source_fscid": "14" }, "counters": { "snaps_synced": 0, "snaps_deleted": 0, "snaps_renamed": 0, "sync_failures": 2, "avg_sync_time": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "sync_bytes": 0 } } ], "mempool": [ { "labels": {}, "counters": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_cache_buffer_bytes": 0, "bluestore_cache_buffer_items": 0, "bluestore_extent_bytes": 0, "bluestore_extent_items": 0, "bluestore_blob_bytes": 0, "bluestore_blob_items": 0, "bluestore_shared_blob_bytes": 0, "bluestore_shared_blob_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_items": 0, "bluefs_bytes": 0, "bluefs_items": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "buffer_anon_bytes": 633605546, "buffer_anon_items": 230, "buffer_meta_bytes": 7304, "buffer_meta_items": 83, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 33848, "osdmap_items": 332, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "mds_co_bytes": 0, "mds_co_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 } } ], "objecter": [ { "labels": {}, "counters": { "op_active": 0, "op_laggy": 0, "op_send": 0, "op_send_bytes": 0, "op_resend": 0, "op_reply": 0, "op_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "op_inflight": 0, "oplen_avg": { "avgcount": 0, "sum": 0 }, "op": 0, "op_r": 0, "op_w": 0, "op_rmw": 0, "op_pg": 0, "osdop_stat": 0, "osdop_create": 0, "osdop_read": 0, "osdop_write": 0, "osdop_writefull": 0, "osdop_writesame": 0, "osdop_append": 0, "osdop_zero": 0, "osdop_truncate": 0, "osdop_delete": 0, "osdop_mapext": 0, "osdop_sparse_read": 0, "osdop_clonerange": 0, "osdop_getxattr": 0, "osdop_setxattr": 0, "osdop_cmpxattr": 0, "osdop_rmxattr": 0, "osdop_resetxattrs": 0, "osdop_call": 0, "osdop_watch": 0, "osdop_notify": 0, "osdop_src_cmpxattr": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_other": 0, "linger_active": 0, "linger_send": 0, "linger_resend": 0, "linger_ping": 0, "poolop_active": 0, "poolop_send": 0, "poolop_resend": 0, "poolstat_active": 0, "poolstat_send": 0, "poolstat_resend": 0, "statfs_active": 0, "statfs_send": 0, "statfs_resend": 0, "command_active": 0, "command_send": 0, "command_resend": 0, "map_epoch": 0, "map_full": 0, "map_inc": 0, "osd_sessions": 0, "osd_session_open": 0, "osd_session_close": 0, "osd_laggy": 0, "omap_wr": 0, "omap_rd": 0, "omap_del": 0 } } ], "throttle-msgr_dispatch_throttler-client": [ { "labels": {}, "counters": { "val": 0, "max": 104857600, "get_started": 0, "get": 124, "get_sum": 490920, "get_or_fail_fail": 0, "get_or_fail_success": 124, "take": 0, "take_sum": 0, "put": 124, "put_sum": 490920, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ], "throttle-msgr_dispatch_throttler-radosclient": [ { "labels": {}, "counters": { "val": 0, "max": 104857600, "get_started": 0, "get": 91, "get_sum": 3095773, "get_or_fail_fail": 0, "get_or_fail_success": 91, "take": 0, "take_sum": 0, "put": 91, "put_sum": 3095773, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ], "throttle-objecter_bytes": [ { "labels": {}, "counters": { "val": 0, "max": 104857600, "get_started": 0, "get": 0, "get_sum": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "take": 0, "take_sum": 0, "put": 0, "put_sum": 0, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ], "throttle-objecter_ops": [ { "labels": {}, "counters": { "val": 0, "max": 1024, "get_started": 0, "get": 0, "get_sum": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "take": 0, "take_sum": 0, "put": 0, "put_sum": 0, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ] } 2024-03-16T07:37:57.538 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-03-16T07:37:57.538 DEBUG:teuthology.orchestra.run.smithi049:mirror status for fs: cephfs> ceph --admin-daemon /var/run/ceph/cephfs-mirror.asok fs mirror status cephfs@14 2024-03-16T07:38:01.225 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-03-16T07:38:01.225 INFO:teuthology.orchestra.run.smithi049.stdout: "rados_inst": "172.21.15.49:0/1186634239", 2024-03-16T07:38:01.225 INFO:teuthology.orchestra.run.smithi049.stdout: "peers": { 2024-03-16T07:38:01.226 INFO:teuthology.orchestra.run.smithi049.stdout: "8fa2e0a7-a624-43b8-9c12-da3a1afea05a": { 2024-03-16T07:38:01.226 INFO:teuthology.orchestra.run.smithi049.stdout: "remote": { 2024-03-16T07:38:01.226 INFO:teuthology.orchestra.run.smithi049.stdout: "client_name": "client.mirror_remote", 2024-03-16T07:38:01.226 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_name": "ceph", 2024-03-16T07:38:01.226 INFO:teuthology.orchestra.run.smithi049.stdout: "fs_name": "backup_fs" 2024-03-16T07:38:01.226 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:01.226 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:01.226 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:38:01.226 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_dirs": { 2024-03-16T07:38:01.226 INFO:teuthology.orchestra.run.smithi049.stdout: "dir_count": 3 2024-03-16T07:38:01.226 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:01.226 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-03-16T07:38:01.237 DEBUG:tasks.cephfs.test_mirroring:command returned={ "rados_inst": "172.21.15.49:0/1186634239", "peers": { "8fa2e0a7-a624-43b8-9c12-da3a1afea05a": { "remote": { "client_name": "client.mirror_remote", "cluster_name": "ceph", "fs_name": "backup_fs" } } }, "snap_dirs": { "dir_count": 3 } } 2024-03-16T07:38:01.237 DEBUG:tasks.cephfs.test_mirroring:initial dir_count=3 2024-03-16T07:38:01.237 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snapshot mirror remove cephfs /d0 2024-03-16T07:38:01.759 INFO:teuthology.orchestra.run.smithi049.stdout:{} 2024-03-16T07:38:09.684 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T07:38:11.774 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-03-16T07:38:11.775 DEBUG:teuthology.orchestra.run.smithi049:mirror status for fs: cephfs> ceph --admin-daemon /var/run/ceph/cephfs-mirror.asok fs mirror status cephfs@14 2024-03-16T07:38:14.122 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-03-16T07:38:14.122 INFO:teuthology.orchestra.run.smithi049.stdout: "rados_inst": "172.21.15.49:0/1186634239", 2024-03-16T07:38:14.122 INFO:teuthology.orchestra.run.smithi049.stdout: "peers": { 2024-03-16T07:38:14.122 INFO:teuthology.orchestra.run.smithi049.stdout: "8fa2e0a7-a624-43b8-9c12-da3a1afea05a": { 2024-03-16T07:38:14.122 INFO:teuthology.orchestra.run.smithi049.stdout: "remote": { 2024-03-16T07:38:14.122 INFO:teuthology.orchestra.run.smithi049.stdout: "client_name": "client.mirror_remote", 2024-03-16T07:38:14.122 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_name": "ceph", 2024-03-16T07:38:14.122 INFO:teuthology.orchestra.run.smithi049.stdout: "fs_name": "backup_fs" 2024-03-16T07:38:14.123 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:14.123 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:14.123 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:38:14.123 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_dirs": { 2024-03-16T07:38:14.123 INFO:teuthology.orchestra.run.smithi049.stdout: "dir_count": 2 2024-03-16T07:38:14.123 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:14.123 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-03-16T07:38:14.130 DEBUG:tasks.cephfs.test_mirroring:command returned={ "rados_inst": "172.21.15.49:0/1186634239", "peers": { "8fa2e0a7-a624-43b8-9c12-da3a1afea05a": { "remote": { "client_name": "client.mirror_remote", "cluster_name": "ceph", "fs_name": "backup_fs" } } }, "snap_dirs": { "dir_count": 2 } } 2024-03-16T07:38:14.130 DEBUG:tasks.cephfs.test_mirroring:new dir_count=2 2024-03-16T07:38:14.130 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-03-16T07:38:14.131 DEBUG:teuthology.orchestra.run.smithi049:counter dump for fs: cephfs> ceph --admin-daemon /var/run/ceph/cephfs-mirror.asok counter dump 2024-03-16T07:38:17.928 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-03-16T07:38:17.928 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker": [ 2024-03-16T07:38:17.928 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:38:17.928 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:38:17.928 INFO:teuthology.orchestra.run.smithi049.stdout: "id": "0" 2024-03-16T07:38:17.928 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:38:17.928 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:38:17.928 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_ready_timeouts": 0, 2024-03-16T07:38:17.928 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_idle_timeouts": 0 2024-03-16T07:38:17.929 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:17.929 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:38:17.929 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:38:17.929 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:38:17.929 INFO:teuthology.orchestra.run.smithi049.stdout: "id": "1" 2024-03-16T07:38:17.929 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:38:17.929 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:38:17.929 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_ready_timeouts": 0, 2024-03-16T07:38:17.929 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_idle_timeouts": 0 2024-03-16T07:38:17.929 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:17.929 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:38:17.929 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:38:17.929 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:38:17.929 INFO:teuthology.orchestra.run.smithi049.stdout: "id": "2" 2024-03-16T07:38:17.929 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:38:17.930 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:38:17.930 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_ready_timeouts": 0, 2024-03-16T07:38:17.930 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_idle_timeouts": 0 2024-03-16T07:38:17.930 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:17.930 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:17.930 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:38:17.930 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-0": [ 2024-03-16T07:38:17.930 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:38:17.930 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:38:17.930 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:38:17.930 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 13, 2024-03-16T07:38:17.930 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 166, 2024-03-16T07:38:17.930 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 1872, 2024-03-16T07:38:17.930 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 1064800, 2024-03-16T07:38:17.930 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 26, 2024-03-16T07:38:17.930 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 5, 2024-03-16T07:38:17.931 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 1.230921547, 2024-03-16T07:38:17.931 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.606160012, 2024-03-16T07:38:17.931 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 0.173849705, 2024-03-16T07:38:17.931 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-03-16T07:38:17.931 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T07:38:17.931 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 154, 2024-03-16T07:38:17.931 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 1.257778053, 2024-03-16T07:38:17.931 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.008167389 2024-03-16T07:38:17.931 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:38:17.931 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-03-16T07:38:17.931 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:38:17.931 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:38:17.932 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:38:17.932 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:38:17.932 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 1872, 2024-03-16T07:38:17.932 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 1064800 2024-03-16T07:38:17.932 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:17.932 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:17.932 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:38:17.932 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-1": [ 2024-03-16T07:38:17.932 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:38:17.932 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:38:17.932 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:38:17.932 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 124, 2024-03-16T07:38:17.932 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 10, 2024-03-16T07:38:17.932 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 507744, 2024-03-16T07:38:17.932 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 2112, 2024-03-16T07:38:17.932 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 4, 2024-03-16T07:38:17.933 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 0, 2024-03-16T07:38:17.933 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 1.577493535, 2024-03-16T07:38:17.933 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.154985517, 2024-03-16T07:38:17.933 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 1.025451361, 2024-03-16T07:38:17.933 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.194190800, 2024-03-16T07:38:17.933 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T07:38:17.933 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 9, 2024-03-16T07:38:17.933 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.188856872, 2024-03-16T07:38:17.933 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.020984096 2024-03-16T07:38:17.933 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:38:17.933 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-03-16T07:38:17.933 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:38:17.933 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:38:17.933 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:38:17.933 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:38:17.934 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 507744, 2024-03-16T07:38:17.934 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 2112 2024-03-16T07:38:17.934 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:17.934 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:17.934 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:38:17.934 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-2": [ 2024-03-16T07:38:17.934 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:38:17.934 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:38:17.934 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:38:17.934 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 81, 2024-03-16T07:38:17.934 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 13, 2024-03-16T07:38:17.934 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 3107152, 2024-03-16T07:38:17.934 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 2576, 2024-03-16T07:38:17.934 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 3, 2024-03-16T07:38:17.934 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 1, 2024-03-16T07:38:17.934 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 3.299896746, 2024-03-16T07:38:17.935 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.318427680, 2024-03-16T07:38:17.935 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 3.506588099, 2024-03-16T07:38:17.935 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-03-16T07:38:17.935 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T07:38:17.935 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 12, 2024-03-16T07:38:17.935 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.346963753, 2024-03-16T07:38:17.935 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.028913646 2024-03-16T07:38:17.935 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:38:17.935 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-03-16T07:38:17.935 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:38:17.935 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:38:17.935 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:38:17.935 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:38:17.935 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 3107152, 2024-03-16T07:38:17.935 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 2576 2024-03-16T07:38:17.936 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:17.936 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:17.936 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:38:17.936 INFO:teuthology.orchestra.run.smithi049.stdout: "cct": [ 2024-03-16T07:38:17.936 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:38:17.936 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:38:17.936 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:38:17.936 INFO:teuthology.orchestra.run.smithi049.stdout: "total_workers": 0, 2024-03-16T07:38:17.936 INFO:teuthology.orchestra.run.smithi049.stdout: "unhealthy_workers": 0 2024-03-16T07:38:17.936 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:17.936 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:17.936 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:38:17.936 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs_mirror": [ 2024-03-16T07:38:17.936 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:38:17.936 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:38:17.936 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:38:17.937 INFO:teuthology.orchestra.run.smithi049.stdout: "mirrored_filesystems": 2, 2024-03-16T07:38:17.937 INFO:teuthology.orchestra.run.smithi049.stdout: "mirror_enable_failures": 0 2024-03-16T07:38:17.937 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:17.937 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:17.937 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:38:17.937 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs_mirror_mirrored_filesystems": [ 2024-03-16T07:38:17.937 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:38:17.937 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:38:17.937 INFO:teuthology.orchestra.run.smithi049.stdout: "filesystem": "cephfs" 2024-03-16T07:38:17.937 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:38:17.937 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:38:17.937 INFO:teuthology.orchestra.run.smithi049.stdout: "mirroring_peers": 1, 2024-03-16T07:38:17.937 INFO:teuthology.orchestra.run.smithi049.stdout: "directory_count": 2 2024-03-16T07:38:17.937 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:17.937 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:17.937 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:38:17.938 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs_mirror_peers": [ 2024-03-16T07:38:17.938 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:38:17.938 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:38:17.938 INFO:teuthology.orchestra.run.smithi049.stdout: "peer_cluster_filesystem": "backup_fs", 2024-03-16T07:38:17.938 INFO:teuthology.orchestra.run.smithi049.stdout: "peer_cluster_name": "ceph", 2024-03-16T07:38:17.938 INFO:teuthology.orchestra.run.smithi049.stdout: "source_filesystem": "cephfs", 2024-03-16T07:38:17.938 INFO:teuthology.orchestra.run.smithi049.stdout: "source_fscid": "14" 2024-03-16T07:38:17.938 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:38:17.938 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:38:17.938 INFO:teuthology.orchestra.run.smithi049.stdout: "snaps_synced": 0, 2024-03-16T07:38:17.938 INFO:teuthology.orchestra.run.smithi049.stdout: "snaps_deleted": 0, 2024-03-16T07:38:17.938 INFO:teuthology.orchestra.run.smithi049.stdout: "snaps_renamed": 0, 2024-03-16T07:38:17.938 INFO:teuthology.orchestra.run.smithi049.stdout: "sync_failures": 4, 2024-03-16T07:38:17.938 INFO:teuthology.orchestra.run.smithi049.stdout: "avg_sync_time": { 2024-03-16T07:38:17.939 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:38:17.939 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:38:17.939 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:38:17.939 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:38:17.939 INFO:teuthology.orchestra.run.smithi049.stdout: "sync_bytes": 0 2024-03-16T07:38:17.939 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:17.939 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:17.939 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:38:17.939 INFO:teuthology.orchestra.run.smithi049.stdout: "mempool": [ 2024-03-16T07:38:17.939 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:38:17.939 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:38:17.939 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:38:17.939 INFO:teuthology.orchestra.run.smithi049.stdout: "bloom_filter_bytes": 0, 2024-03-16T07:38:17.939 INFO:teuthology.orchestra.run.smithi049.stdout: "bloom_filter_items": 0, 2024-03-16T07:38:17.939 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_alloc_bytes": 0, 2024-03-16T07:38:17.939 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_alloc_items": 0, 2024-03-16T07:38:17.939 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_data_bytes": 0, 2024-03-16T07:38:17.940 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_data_items": 0, 2024-03-16T07:38:17.940 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_onode_bytes": 0, 2024-03-16T07:38:17.940 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_onode_items": 0, 2024-03-16T07:38:17.940 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_meta_bytes": 0, 2024-03-16T07:38:17.940 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_meta_items": 0, 2024-03-16T07:38:17.940 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_other_bytes": 0, 2024-03-16T07:38:17.940 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_other_items": 0, 2024-03-16T07:38:17.940 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_buffer_bytes": 0, 2024-03-16T07:38:17.940 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_buffer_items": 0, 2024-03-16T07:38:17.940 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_extent_bytes": 0, 2024-03-16T07:38:17.940 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_extent_items": 0, 2024-03-16T07:38:17.940 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_blob_bytes": 0, 2024-03-16T07:38:17.940 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_blob_items": 0, 2024-03-16T07:38:17.940 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_shared_blob_bytes": 0, 2024-03-16T07:38:17.941 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_shared_blob_items": 0, 2024-03-16T07:38:17.941 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_inline_bl_bytes": 0, 2024-03-16T07:38:17.941 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_inline_bl_items": 0, 2024-03-16T07:38:17.941 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_fsck_bytes": 0, 2024-03-16T07:38:17.941 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_fsck_items": 0, 2024-03-16T07:38:17.941 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_txc_bytes": 0, 2024-03-16T07:38:17.941 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_txc_items": 0, 2024-03-16T07:38:17.941 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_deferred_bytes": 0, 2024-03-16T07:38:17.941 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_deferred_items": 0, 2024-03-16T07:38:17.941 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_bytes": 0, 2024-03-16T07:38:17.941 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_items": 0, 2024-03-16T07:38:17.941 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_bytes": 0, 2024-03-16T07:38:17.941 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_items": 0, 2024-03-16T07:38:17.941 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_reader_bytes": 0, 2024-03-16T07:38:17.941 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_reader_items": 0, 2024-03-16T07:38:17.941 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_writer_bytes": 0, 2024-03-16T07:38:17.942 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_writer_items": 0, 2024-03-16T07:38:17.942 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_anon_bytes": 637835837, 2024-03-16T07:38:17.942 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_anon_items": 240, 2024-03-16T07:38:17.942 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_meta_bytes": 7744, 2024-03-16T07:38:17.942 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_meta_items": 88, 2024-03-16T07:38:17.942 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_bytes": 0, 2024-03-16T07:38:17.942 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_items": 0, 2024-03-16T07:38:17.942 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_mapbl_bytes": 0, 2024-03-16T07:38:17.942 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_mapbl_items": 0, 2024-03-16T07:38:17.942 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pglog_bytes": 0, 2024-03-16T07:38:17.942 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pglog_items": 0, 2024-03-16T07:38:17.942 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_bytes": 33848, 2024-03-16T07:38:17.942 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_items": 332, 2024-03-16T07:38:17.943 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_mapping_bytes": 0, 2024-03-16T07:38:17.943 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_mapping_items": 0, 2024-03-16T07:38:17.943 INFO:teuthology.orchestra.run.smithi049.stdout: "pgmap_bytes": 0, 2024-03-16T07:38:17.943 INFO:teuthology.orchestra.run.smithi049.stdout: "pgmap_items": 0, 2024-03-16T07:38:17.943 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_co_bytes": 0, 2024-03-16T07:38:17.943 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_co_items": 0, 2024-03-16T07:38:17.943 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_1_bytes": 0, 2024-03-16T07:38:17.943 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_1_items": 0, 2024-03-16T07:38:17.943 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_2_bytes": 0, 2024-03-16T07:38:17.943 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_2_items": 0 2024-03-16T07:38:17.943 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:17.943 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:17.943 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:38:17.943 INFO:teuthology.orchestra.run.smithi049.stdout: "objecter": [ 2024-03-16T07:38:17.943 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:38:17.944 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:38:17.944 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:38:17.944 INFO:teuthology.orchestra.run.smithi049.stdout: "op_active": 0, 2024-03-16T07:38:17.944 INFO:teuthology.orchestra.run.smithi049.stdout: "op_laggy": 0, 2024-03-16T07:38:17.944 INFO:teuthology.orchestra.run.smithi049.stdout: "op_send": 0, 2024-03-16T07:38:17.944 INFO:teuthology.orchestra.run.smithi049.stdout: "op_send_bytes": 0, 2024-03-16T07:38:17.944 INFO:teuthology.orchestra.run.smithi049.stdout: "op_resend": 0, 2024-03-16T07:38:17.944 INFO:teuthology.orchestra.run.smithi049.stdout: "op_reply": 0, 2024-03-16T07:38:17.944 INFO:teuthology.orchestra.run.smithi049.stdout: "op_latency": { 2024-03-16T07:38:17.944 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:38:17.944 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:38:17.944 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:38:17.944 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:38:17.944 INFO:teuthology.orchestra.run.smithi049.stdout: "op_inflight": 0, 2024-03-16T07:38:17.944 INFO:teuthology.orchestra.run.smithi049.stdout: "oplen_avg": { 2024-03-16T07:38:17.944 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:38:17.945 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0 2024-03-16T07:38:17.945 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:38:17.945 INFO:teuthology.orchestra.run.smithi049.stdout: "op": 0, 2024-03-16T07:38:17.945 INFO:teuthology.orchestra.run.smithi049.stdout: "op_r": 0, 2024-03-16T07:38:17.945 INFO:teuthology.orchestra.run.smithi049.stdout: "op_w": 0, 2024-03-16T07:38:17.945 INFO:teuthology.orchestra.run.smithi049.stdout: "op_rmw": 0, 2024-03-16T07:38:17.945 INFO:teuthology.orchestra.run.smithi049.stdout: "op_pg": 0, 2024-03-16T07:38:17.945 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_stat": 0, 2024-03-16T07:38:17.945 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_create": 0, 2024-03-16T07:38:17.945 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_read": 0, 2024-03-16T07:38:17.945 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_write": 0, 2024-03-16T07:38:17.945 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_writefull": 0, 2024-03-16T07:38:17.945 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_writesame": 0, 2024-03-16T07:38:17.945 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_append": 0, 2024-03-16T07:38:17.945 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_zero": 0, 2024-03-16T07:38:17.945 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_truncate": 0, 2024-03-16T07:38:17.946 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_delete": 0, 2024-03-16T07:38:17.946 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_mapext": 0, 2024-03-16T07:38:17.946 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_sparse_read": 0, 2024-03-16T07:38:17.946 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_clonerange": 0, 2024-03-16T07:38:17.946 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_getxattr": 0, 2024-03-16T07:38:17.946 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_setxattr": 0, 2024-03-16T07:38:17.946 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_cmpxattr": 0, 2024-03-16T07:38:17.946 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_rmxattr": 0, 2024-03-16T07:38:17.946 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_resetxattrs": 0, 2024-03-16T07:38:17.946 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_call": 0, 2024-03-16T07:38:17.946 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_watch": 0, 2024-03-16T07:38:17.946 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_notify": 0, 2024-03-16T07:38:17.946 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_src_cmpxattr": 0, 2024-03-16T07:38:17.946 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_pgls": 0, 2024-03-16T07:38:17.947 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_pgls_filter": 0, 2024-03-16T07:38:17.947 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_other": 0, 2024-03-16T07:38:17.947 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_active": 0, 2024-03-16T07:38:17.947 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_send": 0, 2024-03-16T07:38:17.947 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_resend": 0, 2024-03-16T07:38:17.947 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_ping": 0, 2024-03-16T07:38:17.947 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_active": 0, 2024-03-16T07:38:17.947 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_send": 0, 2024-03-16T07:38:17.947 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_resend": 0, 2024-03-16T07:38:17.947 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_active": 0, 2024-03-16T07:38:17.947 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_send": 0, 2024-03-16T07:38:17.947 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_resend": 0, 2024-03-16T07:38:17.948 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_active": 0, 2024-03-16T07:38:17.948 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_send": 0, 2024-03-16T07:38:17.948 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_resend": 0, 2024-03-16T07:38:17.948 INFO:teuthology.orchestra.run.smithi049.stdout: "command_active": 0, 2024-03-16T07:38:17.948 INFO:teuthology.orchestra.run.smithi049.stdout: "command_send": 0, 2024-03-16T07:38:17.948 INFO:teuthology.orchestra.run.smithi049.stdout: "command_resend": 0, 2024-03-16T07:38:17.948 INFO:teuthology.orchestra.run.smithi049.stdout: "map_epoch": 0, 2024-03-16T07:38:17.948 INFO:teuthology.orchestra.run.smithi049.stdout: "map_full": 0, 2024-03-16T07:38:17.948 INFO:teuthology.orchestra.run.smithi049.stdout: "map_inc": 0, 2024-03-16T07:38:17.948 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_sessions": 0, 2024-03-16T07:38:17.948 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_session_open": 0, 2024-03-16T07:38:17.948 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_session_close": 0, 2024-03-16T07:38:17.948 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_laggy": 0, 2024-03-16T07:38:17.948 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_wr": 0, 2024-03-16T07:38:17.948 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_rd": 0, 2024-03-16T07:38:17.949 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_del": 0 2024-03-16T07:38:17.949 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:17.949 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:17.949 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:38:17.949 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-msgr_dispatch_throttler-client": [ 2024-03-16T07:38:17.949 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:38:17.949 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:38:17.949 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:38:17.949 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:38:17.949 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-03-16T07:38:17.949 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:38:17.949 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 124, 2024-03-16T07:38:17.950 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 490920, 2024-03-16T07:38:17.950 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:38:17.950 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 124, 2024-03-16T07:38:17.950 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:38:17.950 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:38:17.950 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 124, 2024-03-16T07:38:17.950 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 490920, 2024-03-16T07:38:17.950 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:38:17.950 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:38:17.950 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:38:17.950 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:38:17.950 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:17.950 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:17.950 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:17.950 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:38:17.951 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-msgr_dispatch_throttler-radosclient": [ 2024-03-16T07:38:17.951 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:38:17.951 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:38:17.951 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:38:17.951 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:38:17.951 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-03-16T07:38:17.951 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:38:17.951 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 91, 2024-03-16T07:38:17.951 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 3095773, 2024-03-16T07:38:17.951 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:38:17.951 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 91, 2024-03-16T07:38:17.951 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:38:17.951 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:38:17.951 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 91, 2024-03-16T07:38:17.951 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 3095773, 2024-03-16T07:38:17.951 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:38:17.952 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:38:17.952 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:38:17.952 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:38:17.952 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:17.952 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:17.952 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:17.952 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:38:17.952 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-objecter_bytes": [ 2024-03-16T07:38:17.952 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:38:17.952 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:38:17.952 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:38:17.952 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:38:17.952 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-03-16T07:38:17.952 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:38:17.952 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 0, 2024-03-16T07:38:17.952 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 0, 2024-03-16T07:38:17.953 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:38:17.953 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 0, 2024-03-16T07:38:17.953 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:38:17.953 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:38:17.953 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 0, 2024-03-16T07:38:17.953 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 0, 2024-03-16T07:38:17.953 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:38:17.953 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:38:17.953 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:38:17.953 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:38:17.953 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:17.953 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:17.953 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:17.953 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:38:17.953 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-objecter_ops": [ 2024-03-16T07:38:17.953 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:38:17.953 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:38:17.954 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:38:17.954 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:38:17.954 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 1024, 2024-03-16T07:38:17.954 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:38:17.954 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 0, 2024-03-16T07:38:17.954 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 0, 2024-03-16T07:38:17.954 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:38:17.954 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 0, 2024-03-16T07:38:17.954 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:38:17.954 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:38:17.954 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 0, 2024-03-16T07:38:17.954 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 0, 2024-03-16T07:38:17.954 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:38:17.954 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:38:17.954 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:38:17.954 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:38:17.954 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:17.955 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:17.955 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:17.955 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2024-03-16T07:38:17.955 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-03-16T07:38:17.956 DEBUG:tasks.cephfs.test_mirroring:command returned={ "AsyncMessenger::Worker": [ { "labels": { "id": "0" }, "counters": { "msgr_connection_ready_timeouts": 0, "msgr_connection_idle_timeouts": 0 } }, { "labels": { "id": "1" }, "counters": { "msgr_connection_ready_timeouts": 0, "msgr_connection_idle_timeouts": 0 } }, { "labels": { "id": "2" }, "counters": { "msgr_connection_ready_timeouts": 0, "msgr_connection_idle_timeouts": 0 } } ], "AsyncMessenger::Worker-0": [ { "labels": {}, "counters": { "msgr_recv_messages": 13, "msgr_send_messages": 166, "msgr_recv_bytes": 1872, "msgr_send_bytes": 1064800, "msgr_created_connections": 26, "msgr_active_connections": 5, "msgr_running_total_time": 1.230921547, "msgr_running_send_time": 0.606160012, "msgr_running_recv_time": 0.173849705, "msgr_running_fast_dispatch_time": 0.000000000, "msgr_send_messages_queue_lat": { "avgcount": 154, "sum": 1.257778053, "avgtime": 0.008167389 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "msgr_recv_encrypted_bytes": 1872, "msgr_send_encrypted_bytes": 1064800 } } ], "AsyncMessenger::Worker-1": [ { "labels": {}, "counters": { "msgr_recv_messages": 124, "msgr_send_messages": 10, "msgr_recv_bytes": 507744, "msgr_send_bytes": 2112, "msgr_created_connections": 4, "msgr_active_connections": 0, "msgr_running_total_time": 1.577493535, "msgr_running_send_time": 0.154985517, "msgr_running_recv_time": 1.025451361, "msgr_running_fast_dispatch_time": 0.194190800, "msgr_send_messages_queue_lat": { "avgcount": 9, "sum": 0.188856872, "avgtime": 0.020984096 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "msgr_recv_encrypted_bytes": 507744, "msgr_send_encrypted_bytes": 2112 } } ], "AsyncMessenger::Worker-2": [ { "labels": {}, "counters": { "msgr_recv_messages": 81, "msgr_send_messages": 13, "msgr_recv_bytes": 3107152, "msgr_send_bytes": 2576, "msgr_created_connections": 3, "msgr_active_connections": 1, "msgr_running_total_time": 3.299896746, "msgr_running_send_time": 0.318427680, "msgr_running_recv_time": 3.506588099, "msgr_running_fast_dispatch_time": 0.000000000, "msgr_send_messages_queue_lat": { "avgcount": 12, "sum": 0.346963753, "avgtime": 0.028913646 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "msgr_recv_encrypted_bytes": 3107152, "msgr_send_encrypted_bytes": 2576 } } ], "cct": [ { "labels": {}, "counters": { "total_workers": 0, "unhealthy_workers": 0 } } ], "cephfs_mirror": [ { "labels": {}, "counters": { "mirrored_filesystems": 2, "mirror_enable_failures": 0 } } ], "cephfs_mirror_mirrored_filesystems": [ { "labels": { "filesystem": "cephfs" }, "counters": { "mirroring_peers": 1, "directory_count": 2 } } ], "cephfs_mirror_peers": [ { "labels": { "peer_cluster_filesystem": "backup_fs", "peer_cluster_name": "ceph", "source_filesystem": "cephfs", "source_fscid": "14" }, "counters": { "snaps_synced": 0, "snaps_deleted": 0, "snaps_renamed": 0, "sync_failures": 4, "avg_sync_time": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "sync_bytes": 0 } } ], "mempool": [ { "labels": {}, "counters": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_cache_buffer_bytes": 0, "bluestore_cache_buffer_items": 0, "bluestore_extent_bytes": 0, "bluestore_extent_items": 0, "bluestore_blob_bytes": 0, "bluestore_blob_items": 0, "bluestore_shared_blob_bytes": 0, "bluestore_shared_blob_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_items": 0, "bluefs_bytes": 0, "bluefs_items": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "buffer_anon_bytes": 637835837, "buffer_anon_items": 240, "buffer_meta_bytes": 7744, "buffer_meta_items": 88, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 33848, "osdmap_items": 332, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "mds_co_bytes": 0, "mds_co_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 } } ], "objecter": [ { "labels": {}, "counters": { "op_active": 0, "op_laggy": 0, "op_send": 0, "op_send_bytes": 0, "op_resend": 0, "op_reply": 0, "op_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "op_inflight": 0, "oplen_avg": { "avgcount": 0, "sum": 0 }, "op": 0, "op_r": 0, "op_w": 0, "op_rmw": 0, "op_pg": 0, "osdop_stat": 0, "osdop_create": 0, "osdop_read": 0, "osdop_write": 0, "osdop_writefull": 0, "osdop_writesame": 0, "osdop_append": 0, "osdop_zero": 0, "osdop_truncate": 0, "osdop_delete": 0, "osdop_mapext": 0, "osdop_sparse_read": 0, "osdop_clonerange": 0, "osdop_getxattr": 0, "osdop_setxattr": 0, "osdop_cmpxattr": 0, "osdop_rmxattr": 0, "osdop_resetxattrs": 0, "osdop_call": 0, "osdop_watch": 0, "osdop_notify": 0, "osdop_src_cmpxattr": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_other": 0, "linger_active": 0, "linger_send": 0, "linger_resend": 0, "linger_ping": 0, "poolop_active": 0, "poolop_send": 0, "poolop_resend": 0, "poolstat_active": 0, "poolstat_send": 0, "poolstat_resend": 0, "statfs_active": 0, "statfs_send": 0, "statfs_resend": 0, "command_active": 0, "command_send": 0, "command_resend": 0, "map_epoch": 0, "map_full": 0, "map_inc": 0, "osd_sessions": 0, "osd_session_open": 0, "osd_session_close": 0, "osd_laggy": 0, "omap_wr": 0, "omap_rd": 0, "omap_del": 0 } } ], "throttle-msgr_dispatch_throttler-client": [ { "labels": {}, "counters": { "val": 0, "max": 104857600, "get_started": 0, "get": 124, "get_sum": 490920, "get_or_fail_fail": 0, "get_or_fail_success": 124, "take": 0, "take_sum": 0, "put": 124, "put_sum": 490920, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ], "throttle-msgr_dispatch_throttler-radosclient": [ { "labels": {}, "counters": { "val": 0, "max": 104857600, "get_started": 0, "get": 91, "get_sum": 3095773, "get_or_fail_fail": 0, "get_or_fail_success": 91, "take": 0, "take_sum": 0, "put": 91, "put_sum": 3095773, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ], "throttle-objecter_bytes": [ { "labels": {}, "counters": { "val": 0, "max": 104857600, "get_started": 0, "get": 0, "get_sum": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "take": 0, "take_sum": 0, "put": 0, "put_sum": 0, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ], "throttle-objecter_ops": [ { "labels": {}, "counters": { "val": 0, "max": 1024, "get_started": 0, "get": 0, "get_sum": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "take": 0, "take_sum": 0, "put": 0, "put_sum": 0, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ] } 2024-03-16T07:38:17.956 DEBUG:tasks.cephfs.test_mirroring:removing directories 2 2024-03-16T07:38:17.956 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-03-16T07:38:17.956 DEBUG:teuthology.orchestra.run.smithi049:counter dump for fs: cephfs> ceph --admin-daemon /var/run/ceph/cephfs-mirror.asok counter dump 2024-03-16T07:38:19.435 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-03-16T07:38:19.435 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker": [ 2024-03-16T07:38:19.435 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:38:19.435 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:38:19.435 INFO:teuthology.orchestra.run.smithi049.stdout: "id": "0" 2024-03-16T07:38:19.435 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:38:19.436 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:38:19.436 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_ready_timeouts": 0, 2024-03-16T07:38:19.436 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_idle_timeouts": 0 2024-03-16T07:38:19.436 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:19.436 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:38:19.436 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:38:19.436 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:38:19.436 INFO:teuthology.orchestra.run.smithi049.stdout: "id": "1" 2024-03-16T07:38:19.436 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:38:19.436 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:38:19.436 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_ready_timeouts": 0, 2024-03-16T07:38:19.436 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_idle_timeouts": 0 2024-03-16T07:38:19.436 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:19.436 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:38:19.436 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:38:19.436 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:38:19.437 INFO:teuthology.orchestra.run.smithi049.stdout: "id": "2" 2024-03-16T07:38:19.437 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:38:19.437 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:38:19.437 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_ready_timeouts": 0, 2024-03-16T07:38:19.437 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_idle_timeouts": 0 2024-03-16T07:38:19.437 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:19.437 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:19.437 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:38:19.437 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-0": [ 2024-03-16T07:38:19.437 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:38:19.437 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:38:19.437 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:38:19.437 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 13, 2024-03-16T07:38:19.437 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 166, 2024-03-16T07:38:19.437 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 1872, 2024-03-16T07:38:19.438 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 1064800, 2024-03-16T07:38:19.438 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 26, 2024-03-16T07:38:19.438 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 5, 2024-03-16T07:38:19.438 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 1.230921547, 2024-03-16T07:38:19.438 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.606160012, 2024-03-16T07:38:19.438 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 0.173849705, 2024-03-16T07:38:19.438 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-03-16T07:38:19.438 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T07:38:19.438 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 154, 2024-03-16T07:38:19.438 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 1.257778053, 2024-03-16T07:38:19.438 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.008167389 2024-03-16T07:38:19.438 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:38:19.438 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-03-16T07:38:19.438 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:38:19.438 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:38:19.439 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:38:19.439 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:38:19.439 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 1872, 2024-03-16T07:38:19.439 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 1064800 2024-03-16T07:38:19.439 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:19.439 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:19.439 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:38:19.439 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-1": [ 2024-03-16T07:38:19.439 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:38:19.439 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:38:19.439 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:38:19.439 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 124, 2024-03-16T07:38:19.439 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 10, 2024-03-16T07:38:19.439 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 507744, 2024-03-16T07:38:19.439 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 2112, 2024-03-16T07:38:19.439 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 4, 2024-03-16T07:38:19.440 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 0, 2024-03-16T07:38:19.440 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 1.577493535, 2024-03-16T07:38:19.440 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.154985517, 2024-03-16T07:38:19.440 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 1.025451361, 2024-03-16T07:38:19.440 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.194190800, 2024-03-16T07:38:19.440 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T07:38:19.440 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 9, 2024-03-16T07:38:19.440 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.188856872, 2024-03-16T07:38:19.440 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.020984096 2024-03-16T07:38:19.440 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:38:19.440 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-03-16T07:38:19.440 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:38:19.440 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:38:19.440 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:38:19.440 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:38:19.441 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 507744, 2024-03-16T07:38:19.441 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 2112 2024-03-16T07:38:19.441 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:19.441 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:19.441 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:38:19.441 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-2": [ 2024-03-16T07:38:19.441 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:38:19.441 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:38:19.441 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:38:19.441 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 81, 2024-03-16T07:38:19.441 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 13, 2024-03-16T07:38:19.441 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 3107152, 2024-03-16T07:38:19.441 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 2576, 2024-03-16T07:38:19.441 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 3, 2024-03-16T07:38:19.441 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 1, 2024-03-16T07:38:19.441 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 3.299896746, 2024-03-16T07:38:19.442 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.318427680, 2024-03-16T07:38:19.442 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 3.506588099, 2024-03-16T07:38:19.442 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-03-16T07:38:19.442 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T07:38:19.442 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 12, 2024-03-16T07:38:19.442 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.346963753, 2024-03-16T07:38:19.442 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.028913646 2024-03-16T07:38:19.442 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:38:19.442 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-03-16T07:38:19.442 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:38:19.442 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:38:19.442 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:38:19.442 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:38:19.442 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 3107152, 2024-03-16T07:38:19.442 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 2576 2024-03-16T07:38:19.443 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:19.443 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:19.443 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:38:19.443 INFO:teuthology.orchestra.run.smithi049.stdout: "cct": [ 2024-03-16T07:38:19.443 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:38:19.443 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:38:19.443 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:38:19.443 INFO:teuthology.orchestra.run.smithi049.stdout: "total_workers": 0, 2024-03-16T07:38:19.443 INFO:teuthology.orchestra.run.smithi049.stdout: "unhealthy_workers": 0 2024-03-16T07:38:19.443 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:19.443 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:19.443 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:38:19.443 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs_mirror": [ 2024-03-16T07:38:19.443 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:38:19.443 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:38:19.443 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:38:19.444 INFO:teuthology.orchestra.run.smithi049.stdout: "mirrored_filesystems": 2, 2024-03-16T07:38:19.444 INFO:teuthology.orchestra.run.smithi049.stdout: "mirror_enable_failures": 0 2024-03-16T07:38:19.444 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:19.444 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:19.444 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:38:19.444 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs_mirror_mirrored_filesystems": [ 2024-03-16T07:38:19.444 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:38:19.444 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:38:19.444 INFO:teuthology.orchestra.run.smithi049.stdout: "filesystem": "cephfs" 2024-03-16T07:38:19.444 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:38:19.444 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:38:19.444 INFO:teuthology.orchestra.run.smithi049.stdout: "mirroring_peers": 1, 2024-03-16T07:38:19.444 INFO:teuthology.orchestra.run.smithi049.stdout: "directory_count": 2 2024-03-16T07:38:19.444 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:19.444 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:19.444 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:38:19.445 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs_mirror_peers": [ 2024-03-16T07:38:19.445 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:38:19.445 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:38:19.445 INFO:teuthology.orchestra.run.smithi049.stdout: "peer_cluster_filesystem": "backup_fs", 2024-03-16T07:38:19.445 INFO:teuthology.orchestra.run.smithi049.stdout: "peer_cluster_name": "ceph", 2024-03-16T07:38:19.445 INFO:teuthology.orchestra.run.smithi049.stdout: "source_filesystem": "cephfs", 2024-03-16T07:38:19.445 INFO:teuthology.orchestra.run.smithi049.stdout: "source_fscid": "14" 2024-03-16T07:38:19.445 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:38:19.445 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:38:19.445 INFO:teuthology.orchestra.run.smithi049.stdout: "snaps_synced": 0, 2024-03-16T07:38:19.445 INFO:teuthology.orchestra.run.smithi049.stdout: "snaps_deleted": 0, 2024-03-16T07:38:19.445 INFO:teuthology.orchestra.run.smithi049.stdout: "snaps_renamed": 0, 2024-03-16T07:38:19.445 INFO:teuthology.orchestra.run.smithi049.stdout: "sync_failures": 4, 2024-03-16T07:38:19.445 INFO:teuthology.orchestra.run.smithi049.stdout: "avg_sync_time": { 2024-03-16T07:38:19.445 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:38:19.446 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:38:19.446 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:38:19.446 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:38:19.446 INFO:teuthology.orchestra.run.smithi049.stdout: "sync_bytes": 0 2024-03-16T07:38:19.446 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:19.446 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:19.446 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:38:19.446 INFO:teuthology.orchestra.run.smithi049.stdout: "mempool": [ 2024-03-16T07:38:19.446 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:38:19.446 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:38:19.446 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:38:19.446 INFO:teuthology.orchestra.run.smithi049.stdout: "bloom_filter_bytes": 0, 2024-03-16T07:38:19.446 INFO:teuthology.orchestra.run.smithi049.stdout: "bloom_filter_items": 0, 2024-03-16T07:38:19.446 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_alloc_bytes": 0, 2024-03-16T07:38:19.447 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_alloc_items": 0, 2024-03-16T07:38:19.447 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_data_bytes": 0, 2024-03-16T07:38:19.447 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_data_items": 0, 2024-03-16T07:38:19.447 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_onode_bytes": 0, 2024-03-16T07:38:19.447 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_onode_items": 0, 2024-03-16T07:38:19.447 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_meta_bytes": 0, 2024-03-16T07:38:19.447 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_meta_items": 0, 2024-03-16T07:38:19.447 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_other_bytes": 0, 2024-03-16T07:38:19.447 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_other_items": 0, 2024-03-16T07:38:19.447 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_buffer_bytes": 0, 2024-03-16T07:38:19.447 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_buffer_items": 0, 2024-03-16T07:38:19.447 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_extent_bytes": 0, 2024-03-16T07:38:19.447 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_extent_items": 0, 2024-03-16T07:38:19.447 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_blob_bytes": 0, 2024-03-16T07:38:19.447 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_blob_items": 0, 2024-03-16T07:38:19.448 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_shared_blob_bytes": 0, 2024-03-16T07:38:19.448 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_shared_blob_items": 0, 2024-03-16T07:38:19.448 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_inline_bl_bytes": 0, 2024-03-16T07:38:19.448 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_inline_bl_items": 0, 2024-03-16T07:38:19.448 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_fsck_bytes": 0, 2024-03-16T07:38:19.448 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_fsck_items": 0, 2024-03-16T07:38:19.448 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_txc_bytes": 0, 2024-03-16T07:38:19.448 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_txc_items": 0, 2024-03-16T07:38:19.448 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_deferred_bytes": 0, 2024-03-16T07:38:19.448 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_deferred_items": 0, 2024-03-16T07:38:19.448 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_bytes": 0, 2024-03-16T07:38:19.448 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_items": 0, 2024-03-16T07:38:19.448 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_bytes": 0, 2024-03-16T07:38:19.448 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_items": 0, 2024-03-16T07:38:19.448 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_reader_bytes": 0, 2024-03-16T07:38:19.449 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_reader_items": 0, 2024-03-16T07:38:19.449 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_writer_bytes": 0, 2024-03-16T07:38:19.449 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_writer_items": 0, 2024-03-16T07:38:19.449 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_anon_bytes": 629416855, 2024-03-16T07:38:19.449 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_anon_items": 228, 2024-03-16T07:38:19.449 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_meta_bytes": 7304, 2024-03-16T07:38:19.449 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_meta_items": 83, 2024-03-16T07:38:19.449 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_bytes": 0, 2024-03-16T07:38:19.449 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_items": 0, 2024-03-16T07:38:19.449 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_mapbl_bytes": 0, 2024-03-16T07:38:19.449 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_mapbl_items": 0, 2024-03-16T07:38:19.449 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pglog_bytes": 0, 2024-03-16T07:38:19.449 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pglog_items": 0, 2024-03-16T07:38:19.449 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_bytes": 33848, 2024-03-16T07:38:19.449 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_items": 332, 2024-03-16T07:38:19.449 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_mapping_bytes": 0, 2024-03-16T07:38:19.450 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_mapping_items": 0, 2024-03-16T07:38:19.450 INFO:teuthology.orchestra.run.smithi049.stdout: "pgmap_bytes": 0, 2024-03-16T07:38:19.450 INFO:teuthology.orchestra.run.smithi049.stdout: "pgmap_items": 0, 2024-03-16T07:38:19.450 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_co_bytes": 0, 2024-03-16T07:38:19.450 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_co_items": 0, 2024-03-16T07:38:19.450 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_1_bytes": 0, 2024-03-16T07:38:19.450 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_1_items": 0, 2024-03-16T07:38:19.450 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_2_bytes": 0, 2024-03-16T07:38:19.450 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_2_items": 0 2024-03-16T07:38:19.450 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:19.450 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:19.450 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:38:19.450 INFO:teuthology.orchestra.run.smithi049.stdout: "objecter": [ 2024-03-16T07:38:19.450 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:38:19.450 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:38:19.451 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:38:19.451 INFO:teuthology.orchestra.run.smithi049.stdout: "op_active": 0, 2024-03-16T07:38:19.451 INFO:teuthology.orchestra.run.smithi049.stdout: "op_laggy": 0, 2024-03-16T07:38:19.451 INFO:teuthology.orchestra.run.smithi049.stdout: "op_send": 0, 2024-03-16T07:38:19.451 INFO:teuthology.orchestra.run.smithi049.stdout: "op_send_bytes": 0, 2024-03-16T07:38:19.451 INFO:teuthology.orchestra.run.smithi049.stdout: "op_resend": 0, 2024-03-16T07:38:19.451 INFO:teuthology.orchestra.run.smithi049.stdout: "op_reply": 0, 2024-03-16T07:38:19.451 INFO:teuthology.orchestra.run.smithi049.stdout: "op_latency": { 2024-03-16T07:38:19.451 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:38:19.451 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:38:19.451 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:38:19.451 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:38:19.451 INFO:teuthology.orchestra.run.smithi049.stdout: "op_inflight": 0, 2024-03-16T07:38:19.452 INFO:teuthology.orchestra.run.smithi049.stdout: "oplen_avg": { 2024-03-16T07:38:19.452 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:38:19.452 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0 2024-03-16T07:38:19.452 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:38:19.452 INFO:teuthology.orchestra.run.smithi049.stdout: "op": 0, 2024-03-16T07:38:19.452 INFO:teuthology.orchestra.run.smithi049.stdout: "op_r": 0, 2024-03-16T07:38:19.452 INFO:teuthology.orchestra.run.smithi049.stdout: "op_w": 0, 2024-03-16T07:38:19.452 INFO:teuthology.orchestra.run.smithi049.stdout: "op_rmw": 0, 2024-03-16T07:38:19.452 INFO:teuthology.orchestra.run.smithi049.stdout: "op_pg": 0, 2024-03-16T07:38:19.452 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_stat": 0, 2024-03-16T07:38:19.452 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_create": 0, 2024-03-16T07:38:19.452 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_read": 0, 2024-03-16T07:38:19.452 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_write": 0, 2024-03-16T07:38:19.452 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_writefull": 0, 2024-03-16T07:38:19.452 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_writesame": 0, 2024-03-16T07:38:19.453 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_append": 0, 2024-03-16T07:38:19.453 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_zero": 0, 2024-03-16T07:38:19.453 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_truncate": 0, 2024-03-16T07:38:19.453 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_delete": 0, 2024-03-16T07:38:19.453 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_mapext": 0, 2024-03-16T07:38:19.453 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_sparse_read": 0, 2024-03-16T07:38:19.453 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_clonerange": 0, 2024-03-16T07:38:19.453 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_getxattr": 0, 2024-03-16T07:38:19.453 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_setxattr": 0, 2024-03-16T07:38:19.453 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_cmpxattr": 0, 2024-03-16T07:38:19.453 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_rmxattr": 0, 2024-03-16T07:38:19.453 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_resetxattrs": 0, 2024-03-16T07:38:19.453 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_call": 0, 2024-03-16T07:38:19.453 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_watch": 0, 2024-03-16T07:38:19.453 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_notify": 0, 2024-03-16T07:38:19.454 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_src_cmpxattr": 0, 2024-03-16T07:38:19.454 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_pgls": 0, 2024-03-16T07:38:19.454 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_pgls_filter": 0, 2024-03-16T07:38:19.454 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_other": 0, 2024-03-16T07:38:19.454 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_active": 0, 2024-03-16T07:38:19.454 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_send": 0, 2024-03-16T07:38:19.454 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_resend": 0, 2024-03-16T07:38:19.454 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_ping": 0, 2024-03-16T07:38:19.454 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_active": 0, 2024-03-16T07:38:19.454 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_send": 0, 2024-03-16T07:38:19.454 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_resend": 0, 2024-03-16T07:38:19.454 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_active": 0, 2024-03-16T07:38:19.454 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_send": 0, 2024-03-16T07:38:19.454 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_resend": 0, 2024-03-16T07:38:19.454 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_active": 0, 2024-03-16T07:38:19.455 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_send": 0, 2024-03-16T07:38:19.455 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_resend": 0, 2024-03-16T07:38:19.455 INFO:teuthology.orchestra.run.smithi049.stdout: "command_active": 0, 2024-03-16T07:38:19.455 INFO:teuthology.orchestra.run.smithi049.stdout: "command_send": 0, 2024-03-16T07:38:19.455 INFO:teuthology.orchestra.run.smithi049.stdout: "command_resend": 0, 2024-03-16T07:38:19.455 INFO:teuthology.orchestra.run.smithi049.stdout: "map_epoch": 0, 2024-03-16T07:38:19.455 INFO:teuthology.orchestra.run.smithi049.stdout: "map_full": 0, 2024-03-16T07:38:19.455 INFO:teuthology.orchestra.run.smithi049.stdout: "map_inc": 0, 2024-03-16T07:38:19.455 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_sessions": 0, 2024-03-16T07:38:19.455 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_session_open": 0, 2024-03-16T07:38:19.455 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_session_close": 0, 2024-03-16T07:38:19.455 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_laggy": 0, 2024-03-16T07:38:19.455 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_wr": 0, 2024-03-16T07:38:19.455 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_rd": 0, 2024-03-16T07:38:19.455 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_del": 0 2024-03-16T07:38:19.456 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:19.456 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:19.456 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:38:19.456 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-msgr_dispatch_throttler-client": [ 2024-03-16T07:38:19.456 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:38:19.456 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:38:19.456 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:38:19.456 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:38:19.456 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-03-16T07:38:19.456 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:38:19.456 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 124, 2024-03-16T07:38:19.456 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 490920, 2024-03-16T07:38:19.457 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:38:19.457 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 124, 2024-03-16T07:38:19.457 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:38:19.457 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:38:19.457 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 124, 2024-03-16T07:38:19.457 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 490920, 2024-03-16T07:38:19.457 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:38:19.457 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:38:19.457 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:38:19.457 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:38:19.457 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:19.457 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:19.457 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:19.457 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:38:19.457 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-msgr_dispatch_throttler-radosclient": [ 2024-03-16T07:38:19.458 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:38:19.458 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:38:19.458 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:38:19.458 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:38:19.458 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-03-16T07:38:19.458 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:38:19.458 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 91, 2024-03-16T07:38:19.458 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 3095773, 2024-03-16T07:38:19.458 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:38:19.458 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 91, 2024-03-16T07:38:19.458 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:38:19.458 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:38:19.458 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 91, 2024-03-16T07:38:19.458 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 3095773, 2024-03-16T07:38:19.458 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:38:19.459 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:38:19.459 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:38:19.459 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:38:19.459 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:19.459 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:19.459 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:19.459 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:38:19.459 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-objecter_bytes": [ 2024-03-16T07:38:19.459 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:38:19.459 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:38:19.459 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:38:19.459 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:38:19.459 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-03-16T07:38:19.459 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:38:19.459 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 0, 2024-03-16T07:38:19.460 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 0, 2024-03-16T07:38:19.460 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:38:19.460 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 0, 2024-03-16T07:38:19.460 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:38:19.460 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:38:19.460 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 0, 2024-03-16T07:38:19.460 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 0, 2024-03-16T07:38:19.460 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:38:19.460 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:38:19.460 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:38:19.460 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:38:19.460 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:19.460 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:19.460 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:19.460 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:38:19.461 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-objecter_ops": [ 2024-03-16T07:38:19.461 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:38:19.461 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:38:19.461 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:38:19.461 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:38:19.461 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 1024, 2024-03-16T07:38:19.461 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:38:19.461 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 0, 2024-03-16T07:38:19.461 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 0, 2024-03-16T07:38:19.461 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:38:19.461 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 0, 2024-03-16T07:38:19.461 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:38:19.461 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:38:19.461 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 0, 2024-03-16T07:38:19.461 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 0, 2024-03-16T07:38:19.461 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:38:19.462 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:38:19.462 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:38:19.462 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:38:19.462 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:19.462 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:19.462 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:19.462 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2024-03-16T07:38:19.462 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-03-16T07:38:19.463 DEBUG:tasks.cephfs.test_mirroring:command returned={ "AsyncMessenger::Worker": [ { "labels": { "id": "0" }, "counters": { "msgr_connection_ready_timeouts": 0, "msgr_connection_idle_timeouts": 0 } }, { "labels": { "id": "1" }, "counters": { "msgr_connection_ready_timeouts": 0, "msgr_connection_idle_timeouts": 0 } }, { "labels": { "id": "2" }, "counters": { "msgr_connection_ready_timeouts": 0, "msgr_connection_idle_timeouts": 0 } } ], "AsyncMessenger::Worker-0": [ { "labels": {}, "counters": { "msgr_recv_messages": 13, "msgr_send_messages": 166, "msgr_recv_bytes": 1872, "msgr_send_bytes": 1064800, "msgr_created_connections": 26, "msgr_active_connections": 5, "msgr_running_total_time": 1.230921547, "msgr_running_send_time": 0.606160012, "msgr_running_recv_time": 0.173849705, "msgr_running_fast_dispatch_time": 0.000000000, "msgr_send_messages_queue_lat": { "avgcount": 154, "sum": 1.257778053, "avgtime": 0.008167389 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "msgr_recv_encrypted_bytes": 1872, "msgr_send_encrypted_bytes": 1064800 } } ], "AsyncMessenger::Worker-1": [ { "labels": {}, "counters": { "msgr_recv_messages": 124, "msgr_send_messages": 10, "msgr_recv_bytes": 507744, "msgr_send_bytes": 2112, "msgr_created_connections": 4, "msgr_active_connections": 0, "msgr_running_total_time": 1.577493535, "msgr_running_send_time": 0.154985517, "msgr_running_recv_time": 1.025451361, "msgr_running_fast_dispatch_time": 0.194190800, "msgr_send_messages_queue_lat": { "avgcount": 9, "sum": 0.188856872, "avgtime": 0.020984096 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "msgr_recv_encrypted_bytes": 507744, "msgr_send_encrypted_bytes": 2112 } } ], "AsyncMessenger::Worker-2": [ { "labels": {}, "counters": { "msgr_recv_messages": 81, "msgr_send_messages": 13, "msgr_recv_bytes": 3107152, "msgr_send_bytes": 2576, "msgr_created_connections": 3, "msgr_active_connections": 1, "msgr_running_total_time": 3.299896746, "msgr_running_send_time": 0.318427680, "msgr_running_recv_time": 3.506588099, "msgr_running_fast_dispatch_time": 0.000000000, "msgr_send_messages_queue_lat": { "avgcount": 12, "sum": 0.346963753, "avgtime": 0.028913646 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "msgr_recv_encrypted_bytes": 3107152, "msgr_send_encrypted_bytes": 2576 } } ], "cct": [ { "labels": {}, "counters": { "total_workers": 0, "unhealthy_workers": 0 } } ], "cephfs_mirror": [ { "labels": {}, "counters": { "mirrored_filesystems": 2, "mirror_enable_failures": 0 } } ], "cephfs_mirror_mirrored_filesystems": [ { "labels": { "filesystem": "cephfs" }, "counters": { "mirroring_peers": 1, "directory_count": 2 } } ], "cephfs_mirror_peers": [ { "labels": { "peer_cluster_filesystem": "backup_fs", "peer_cluster_name": "ceph", "source_filesystem": "cephfs", "source_fscid": "14" }, "counters": { "snaps_synced": 0, "snaps_deleted": 0, "snaps_renamed": 0, "sync_failures": 4, "avg_sync_time": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "sync_bytes": 0 } } ], "mempool": [ { "labels": {}, "counters": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_cache_buffer_bytes": 0, "bluestore_cache_buffer_items": 0, "bluestore_extent_bytes": 0, "bluestore_extent_items": 0, "bluestore_blob_bytes": 0, "bluestore_blob_items": 0, "bluestore_shared_blob_bytes": 0, "bluestore_shared_blob_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_items": 0, "bluefs_bytes": 0, "bluefs_items": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "buffer_anon_bytes": 629416855, "buffer_anon_items": 228, "buffer_meta_bytes": 7304, "buffer_meta_items": 83, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 33848, "osdmap_items": 332, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "mds_co_bytes": 0, "mds_co_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 } } ], "objecter": [ { "labels": {}, "counters": { "op_active": 0, "op_laggy": 0, "op_send": 0, "op_send_bytes": 0, "op_resend": 0, "op_reply": 0, "op_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "op_inflight": 0, "oplen_avg": { "avgcount": 0, "sum": 0 }, "op": 0, "op_r": 0, "op_w": 0, "op_rmw": 0, "op_pg": 0, "osdop_stat": 0, "osdop_create": 0, "osdop_read": 0, "osdop_write": 0, "osdop_writefull": 0, "osdop_writesame": 0, "osdop_append": 0, "osdop_zero": 0, "osdop_truncate": 0, "osdop_delete": 0, "osdop_mapext": 0, "osdop_sparse_read": 0, "osdop_clonerange": 0, "osdop_getxattr": 0, "osdop_setxattr": 0, "osdop_cmpxattr": 0, "osdop_rmxattr": 0, "osdop_resetxattrs": 0, "osdop_call": 0, "osdop_watch": 0, "osdop_notify": 0, "osdop_src_cmpxattr": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_other": 0, "linger_active": 0, "linger_send": 0, "linger_resend": 0, "linger_ping": 0, "poolop_active": 0, "poolop_send": 0, "poolop_resend": 0, "poolstat_active": 0, "poolstat_send": 0, "poolstat_resend": 0, "statfs_active": 0, "statfs_send": 0, "statfs_resend": 0, "command_active": 0, "command_send": 0, "command_resend": 0, "map_epoch": 0, "map_full": 0, "map_inc": 0, "osd_sessions": 0, "osd_session_open": 0, "osd_session_close": 0, "osd_laggy": 0, "omap_wr": 0, "omap_rd": 0, "omap_del": 0 } } ], "throttle-msgr_dispatch_throttler-client": [ { "labels": {}, "counters": { "val": 0, "max": 104857600, "get_started": 0, "get": 124, "get_sum": 490920, "get_or_fail_fail": 0, "get_or_fail_success": 124, "take": 0, "take_sum": 0, "put": 124, "put_sum": 490920, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ], "throttle-msgr_dispatch_throttler-radosclient": [ { "labels": {}, "counters": { "val": 0, "max": 104857600, "get_started": 0, "get": 91, "get_sum": 3095773, "get_or_fail_fail": 0, "get_or_fail_success": 91, "take": 0, "take_sum": 0, "put": 91, "put_sum": 3095773, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ], "throttle-objecter_bytes": [ { "labels": {}, "counters": { "val": 0, "max": 104857600, "get_started": 0, "get": 0, "get_sum": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "take": 0, "take_sum": 0, "put": 0, "put_sum": 0, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ], "throttle-objecter_ops": [ { "labels": {}, "counters": { "val": 0, "max": 1024, "get_started": 0, "get": 0, "get_sum": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "take": 0, "take_sum": 0, "put": 0, "put_sum": 0, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ] } 2024-03-16T07:38:19.463 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-03-16T07:38:19.464 DEBUG:teuthology.orchestra.run.smithi049:mirror status for fs: cephfs> ceph --admin-daemon /var/run/ceph/cephfs-mirror.asok fs mirror status cephfs@14 2024-03-16T07:38:21.455 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-03-16T07:38:21.455 INFO:teuthology.orchestra.run.smithi049.stdout: "rados_inst": "172.21.15.49:0/1186634239", 2024-03-16T07:38:21.455 INFO:teuthology.orchestra.run.smithi049.stdout: "peers": { 2024-03-16T07:38:21.455 INFO:teuthology.orchestra.run.smithi049.stdout: "8fa2e0a7-a624-43b8-9c12-da3a1afea05a": { 2024-03-16T07:38:21.455 INFO:teuthology.orchestra.run.smithi049.stdout: "remote": { 2024-03-16T07:38:21.455 INFO:teuthology.orchestra.run.smithi049.stdout: "client_name": "client.mirror_remote", 2024-03-16T07:38:21.456 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_name": "ceph", 2024-03-16T07:38:21.456 INFO:teuthology.orchestra.run.smithi049.stdout: "fs_name": "backup_fs" 2024-03-16T07:38:21.456 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:21.456 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:21.456 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:38:21.456 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_dirs": { 2024-03-16T07:38:21.456 INFO:teuthology.orchestra.run.smithi049.stdout: "dir_count": 2 2024-03-16T07:38:21.456 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:21.456 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-03-16T07:38:21.465 DEBUG:tasks.cephfs.test_mirroring:command returned={ "rados_inst": "172.21.15.49:0/1186634239", "peers": { "8fa2e0a7-a624-43b8-9c12-da3a1afea05a": { "remote": { "client_name": "client.mirror_remote", "cluster_name": "ceph", "fs_name": "backup_fs" } } }, "snap_dirs": { "dir_count": 2 } } 2024-03-16T07:38:21.465 DEBUG:tasks.cephfs.test_mirroring:initial dir_count=2 2024-03-16T07:38:21.466 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snapshot mirror remove cephfs /d1 2024-03-16T07:38:21.878 INFO:teuthology.orchestra.run.smithi049.stdout:{} 2024-03-16T07:38:31.895 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-03-16T07:38:31.895 DEBUG:teuthology.orchestra.run.smithi049:mirror status for fs: cephfs> ceph --admin-daemon /var/run/ceph/cephfs-mirror.asok fs mirror status cephfs@14 2024-03-16T07:38:35.987 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-03-16T07:38:35.987 INFO:teuthology.orchestra.run.smithi049.stdout: "rados_inst": "172.21.15.49:0/1186634239", 2024-03-16T07:38:35.987 INFO:teuthology.orchestra.run.smithi049.stdout: "peers": { 2024-03-16T07:38:35.988 INFO:teuthology.orchestra.run.smithi049.stdout: "8fa2e0a7-a624-43b8-9c12-da3a1afea05a": { 2024-03-16T07:38:35.988 INFO:teuthology.orchestra.run.smithi049.stdout: "remote": { 2024-03-16T07:38:35.988 INFO:teuthology.orchestra.run.smithi049.stdout: "client_name": "client.mirror_remote", 2024-03-16T07:38:35.988 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_name": "ceph", 2024-03-16T07:38:35.988 INFO:teuthology.orchestra.run.smithi049.stdout: "fs_name": "backup_fs" 2024-03-16T07:38:35.988 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:35.988 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:35.988 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:38:35.988 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_dirs": { 2024-03-16T07:38:35.988 INFO:teuthology.orchestra.run.smithi049.stdout: "dir_count": 1 2024-03-16T07:38:35.988 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:35.988 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-03-16T07:38:35.995 DEBUG:tasks.cephfs.test_mirroring:command returned={ "rados_inst": "172.21.15.49:0/1186634239", "peers": { "8fa2e0a7-a624-43b8-9c12-da3a1afea05a": { "remote": { "client_name": "client.mirror_remote", "cluster_name": "ceph", "fs_name": "backup_fs" } } }, "snap_dirs": { "dir_count": 1 } } 2024-03-16T07:38:35.995 DEBUG:tasks.cephfs.test_mirroring:new dir_count=1 2024-03-16T07:38:35.995 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-03-16T07:38:35.995 DEBUG:teuthology.orchestra.run.smithi049:counter dump for fs: cephfs> ceph --admin-daemon /var/run/ceph/cephfs-mirror.asok counter dump 2024-03-16T07:38:38.224 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-03-16T07:38:38.224 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker": [ 2024-03-16T07:38:38.224 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:38:38.224 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:38:38.225 INFO:teuthology.orchestra.run.smithi049.stdout: "id": "0" 2024-03-16T07:38:38.225 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:38:38.225 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:38:38.225 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_ready_timeouts": 0, 2024-03-16T07:38:38.225 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_idle_timeouts": 0 2024-03-16T07:38:38.225 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:38.225 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:38:38.225 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:38:38.225 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:38:38.225 INFO:teuthology.orchestra.run.smithi049.stdout: "id": "1" 2024-03-16T07:38:38.226 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:38:38.226 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:38:38.226 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_ready_timeouts": 0, 2024-03-16T07:38:38.226 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_idle_timeouts": 0 2024-03-16T07:38:38.226 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:38.226 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:38:38.226 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:38:38.226 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:38:38.226 INFO:teuthology.orchestra.run.smithi049.stdout: "id": "2" 2024-03-16T07:38:38.226 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:38:38.227 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:38:38.227 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_ready_timeouts": 0, 2024-03-16T07:38:38.227 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_idle_timeouts": 0 2024-03-16T07:38:38.227 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:38.227 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:38.227 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:38:38.227 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-0": [ 2024-03-16T07:38:38.227 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:38:38.227 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:38:38.227 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:38:38.227 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 13, 2024-03-16T07:38:38.227 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 170, 2024-03-16T07:38:38.228 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 1872, 2024-03-16T07:38:38.228 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 1066016, 2024-03-16T07:38:38.228 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 26, 2024-03-16T07:38:38.228 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 5, 2024-03-16T07:38:38.228 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 2.037208767, 2024-03-16T07:38:38.228 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.700646802, 2024-03-16T07:38:38.228 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 0.173849705, 2024-03-16T07:38:38.228 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-03-16T07:38:38.228 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T07:38:38.228 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 158, 2024-03-16T07:38:38.228 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 2.477412949, 2024-03-16T07:38:38.228 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.015679828 2024-03-16T07:38:38.229 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:38:38.229 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-03-16T07:38:38.229 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:38:38.229 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:38:38.229 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:38:38.229 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:38:38.229 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 1872, 2024-03-16T07:38:38.229 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 1066016 2024-03-16T07:38:38.229 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:38.229 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:38.229 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:38:38.229 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-1": [ 2024-03-16T07:38:38.230 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:38:38.230 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:38:38.230 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:38:38.230 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 124, 2024-03-16T07:38:38.230 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 10, 2024-03-16T07:38:38.230 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 507744, 2024-03-16T07:38:38.230 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 2112, 2024-03-16T07:38:38.230 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 4, 2024-03-16T07:38:38.230 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 0, 2024-03-16T07:38:38.230 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 1.750629373, 2024-03-16T07:38:38.230 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.202996520, 2024-03-16T07:38:38.230 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 1.100549210, 2024-03-16T07:38:38.231 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.194190800, 2024-03-16T07:38:38.231 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T07:38:38.231 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 9, 2024-03-16T07:38:38.231 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.188856872, 2024-03-16T07:38:38.231 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.020984096 2024-03-16T07:38:38.231 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:38:38.231 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-03-16T07:38:38.231 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:38:38.231 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:38:38.231 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:38:38.231 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:38:38.231 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 507744, 2024-03-16T07:38:38.232 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 2112 2024-03-16T07:38:38.232 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:38.232 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:38.232 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:38:38.232 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-2": [ 2024-03-16T07:38:38.232 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:38:38.232 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:38:38.232 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:38:38.232 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 82, 2024-03-16T07:38:38.232 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 13, 2024-03-16T07:38:38.232 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 3152736, 2024-03-16T07:38:38.232 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 2576, 2024-03-16T07:38:38.232 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 3, 2024-03-16T07:38:38.233 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 1, 2024-03-16T07:38:38.233 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 4.234645153, 2024-03-16T07:38:38.233 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.440172124, 2024-03-16T07:38:38.233 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 4.025711911, 2024-03-16T07:38:38.233 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-03-16T07:38:38.233 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T07:38:38.233 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 12, 2024-03-16T07:38:38.233 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.346963753, 2024-03-16T07:38:38.233 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.028913646 2024-03-16T07:38:38.233 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:38:38.233 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-03-16T07:38:38.233 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:38:38.233 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:38:38.233 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:38:38.234 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:38:38.234 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 3152736, 2024-03-16T07:38:38.234 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 2576 2024-03-16T07:38:38.234 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:38.234 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:38.234 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:38:38.234 INFO:teuthology.orchestra.run.smithi049.stdout: "cct": [ 2024-03-16T07:38:38.234 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:38:38.234 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:38:38.234 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:38:38.234 INFO:teuthology.orchestra.run.smithi049.stdout: "total_workers": 0, 2024-03-16T07:38:38.234 INFO:teuthology.orchestra.run.smithi049.stdout: "unhealthy_workers": 0 2024-03-16T07:38:38.235 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:38.235 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:38.235 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:38:38.235 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs_mirror": [ 2024-03-16T07:38:38.235 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:38:38.235 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:38:38.235 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:38:38.235 INFO:teuthology.orchestra.run.smithi049.stdout: "mirrored_filesystems": 2, 2024-03-16T07:38:38.235 INFO:teuthology.orchestra.run.smithi049.stdout: "mirror_enable_failures": 0 2024-03-16T07:38:38.235 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:38.235 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:38.235 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:38:38.235 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs_mirror_mirrored_filesystems": [ 2024-03-16T07:38:38.236 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:38:38.236 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:38:38.236 INFO:teuthology.orchestra.run.smithi049.stdout: "filesystem": "cephfs" 2024-03-16T07:38:38.236 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:38:38.236 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:38:38.236 INFO:teuthology.orchestra.run.smithi049.stdout: "mirroring_peers": 1, 2024-03-16T07:38:38.236 INFO:teuthology.orchestra.run.smithi049.stdout: "directory_count": 1 2024-03-16T07:38:38.236 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:38.236 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:38.236 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:38:38.236 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs_mirror_peers": [ 2024-03-16T07:38:38.236 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:38:38.236 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:38:38.236 INFO:teuthology.orchestra.run.smithi049.stdout: "peer_cluster_filesystem": "backup_fs", 2024-03-16T07:38:38.237 INFO:teuthology.orchestra.run.smithi049.stdout: "peer_cluster_name": "ceph", 2024-03-16T07:38:38.237 INFO:teuthology.orchestra.run.smithi049.stdout: "source_filesystem": "cephfs", 2024-03-16T07:38:38.237 INFO:teuthology.orchestra.run.smithi049.stdout: "source_fscid": "14" 2024-03-16T07:38:38.237 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:38:38.237 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:38:38.237 INFO:teuthology.orchestra.run.smithi049.stdout: "snaps_synced": 0, 2024-03-16T07:38:38.237 INFO:teuthology.orchestra.run.smithi049.stdout: "snaps_deleted": 0, 2024-03-16T07:38:38.237 INFO:teuthology.orchestra.run.smithi049.stdout: "snaps_renamed": 0, 2024-03-16T07:38:38.237 INFO:teuthology.orchestra.run.smithi049.stdout: "sync_failures": 5, 2024-03-16T07:38:38.237 INFO:teuthology.orchestra.run.smithi049.stdout: "avg_sync_time": { 2024-03-16T07:38:38.237 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:38:38.237 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:38:38.237 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:38:38.237 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:38:38.238 INFO:teuthology.orchestra.run.smithi049.stdout: "sync_bytes": 0 2024-03-16T07:38:38.238 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:38.238 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:38.238 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:38:38.238 INFO:teuthology.orchestra.run.smithi049.stdout: "mempool": [ 2024-03-16T07:38:38.238 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:38:38.238 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:38:38.238 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:38:38.238 INFO:teuthology.orchestra.run.smithi049.stdout: "bloom_filter_bytes": 0, 2024-03-16T07:38:38.238 INFO:teuthology.orchestra.run.smithi049.stdout: "bloom_filter_items": 0, 2024-03-16T07:38:38.238 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_alloc_bytes": 0, 2024-03-16T07:38:38.238 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_alloc_items": 0, 2024-03-16T07:38:38.239 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_data_bytes": 0, 2024-03-16T07:38:38.239 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_data_items": 0, 2024-03-16T07:38:38.239 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_onode_bytes": 0, 2024-03-16T07:38:38.239 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_onode_items": 0, 2024-03-16T07:38:38.239 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_meta_bytes": 0, 2024-03-16T07:38:38.239 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_meta_items": 0, 2024-03-16T07:38:38.239 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_other_bytes": 0, 2024-03-16T07:38:38.239 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_other_items": 0, 2024-03-16T07:38:38.239 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_buffer_bytes": 0, 2024-03-16T07:38:38.239 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_buffer_items": 0, 2024-03-16T07:38:38.239 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_extent_bytes": 0, 2024-03-16T07:38:38.239 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_extent_items": 0, 2024-03-16T07:38:38.240 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_blob_bytes": 0, 2024-03-16T07:38:38.240 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_blob_items": 0, 2024-03-16T07:38:38.240 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_shared_blob_bytes": 0, 2024-03-16T07:38:38.240 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_shared_blob_items": 0, 2024-03-16T07:38:38.240 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_inline_bl_bytes": 0, 2024-03-16T07:38:38.240 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_inline_bl_items": 0, 2024-03-16T07:38:38.240 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_fsck_bytes": 0, 2024-03-16T07:38:38.240 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_fsck_items": 0, 2024-03-16T07:38:38.240 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_txc_bytes": 0, 2024-03-16T07:38:38.240 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_txc_items": 0, 2024-03-16T07:38:38.240 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_deferred_bytes": 0, 2024-03-16T07:38:38.240 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_deferred_items": 0, 2024-03-16T07:38:38.240 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_bytes": 0, 2024-03-16T07:38:38.240 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_items": 0, 2024-03-16T07:38:38.240 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_bytes": 0, 2024-03-16T07:38:38.241 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_items": 0, 2024-03-16T07:38:38.241 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_reader_bytes": 0, 2024-03-16T07:38:38.241 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_reader_items": 0, 2024-03-16T07:38:38.241 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_writer_bytes": 0, 2024-03-16T07:38:38.241 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_writer_items": 0, 2024-03-16T07:38:38.241 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_anon_bytes": 621030888, 2024-03-16T07:38:38.241 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_anon_items": 231, 2024-03-16T07:38:38.241 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_meta_bytes": 7216, 2024-03-16T07:38:38.241 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_meta_items": 82, 2024-03-16T07:38:38.241 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_bytes": 0, 2024-03-16T07:38:38.241 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_items": 0, 2024-03-16T07:38:38.241 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_mapbl_bytes": 0, 2024-03-16T07:38:38.241 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_mapbl_items": 0, 2024-03-16T07:38:38.241 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pglog_bytes": 0, 2024-03-16T07:38:38.242 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pglog_items": 0, 2024-03-16T07:38:38.242 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_bytes": 33848, 2024-03-16T07:38:38.242 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_items": 332, 2024-03-16T07:38:38.242 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_mapping_bytes": 0, 2024-03-16T07:38:38.242 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_mapping_items": 0, 2024-03-16T07:38:38.242 INFO:teuthology.orchestra.run.smithi049.stdout: "pgmap_bytes": 0, 2024-03-16T07:38:38.242 INFO:teuthology.orchestra.run.smithi049.stdout: "pgmap_items": 0, 2024-03-16T07:38:38.242 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_co_bytes": 0, 2024-03-16T07:38:38.242 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_co_items": 0, 2024-03-16T07:38:38.242 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_1_bytes": 0, 2024-03-16T07:38:38.242 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_1_items": 0, 2024-03-16T07:38:38.243 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_2_bytes": 0, 2024-03-16T07:38:38.243 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_2_items": 0 2024-03-16T07:38:38.243 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:38.243 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:38.243 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:38:38.243 INFO:teuthology.orchestra.run.smithi049.stdout: "objecter": [ 2024-03-16T07:38:38.243 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:38:38.243 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:38:38.243 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:38:38.243 INFO:teuthology.orchestra.run.smithi049.stdout: "op_active": 0, 2024-03-16T07:38:38.243 INFO:teuthology.orchestra.run.smithi049.stdout: "op_laggy": 0, 2024-03-16T07:38:38.244 INFO:teuthology.orchestra.run.smithi049.stdout: "op_send": 0, 2024-03-16T07:38:38.244 INFO:teuthology.orchestra.run.smithi049.stdout: "op_send_bytes": 0, 2024-03-16T07:38:38.244 INFO:teuthology.orchestra.run.smithi049.stdout: "op_resend": 0, 2024-03-16T07:38:38.244 INFO:teuthology.orchestra.run.smithi049.stdout: "op_reply": 0, 2024-03-16T07:38:38.244 INFO:teuthology.orchestra.run.smithi049.stdout: "op_latency": { 2024-03-16T07:38:38.244 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:38:38.244 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:38:38.244 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:38:38.244 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:38:38.244 INFO:teuthology.orchestra.run.smithi049.stdout: "op_inflight": 0, 2024-03-16T07:38:38.244 INFO:teuthology.orchestra.run.smithi049.stdout: "oplen_avg": { 2024-03-16T07:38:38.244 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:38:38.245 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0 2024-03-16T07:38:38.245 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:38:38.245 INFO:teuthology.orchestra.run.smithi049.stdout: "op": 0, 2024-03-16T07:38:38.245 INFO:teuthology.orchestra.run.smithi049.stdout: "op_r": 0, 2024-03-16T07:38:38.245 INFO:teuthology.orchestra.run.smithi049.stdout: "op_w": 0, 2024-03-16T07:38:38.245 INFO:teuthology.orchestra.run.smithi049.stdout: "op_rmw": 0, 2024-03-16T07:38:38.245 INFO:teuthology.orchestra.run.smithi049.stdout: "op_pg": 0, 2024-03-16T07:38:38.245 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_stat": 0, 2024-03-16T07:38:38.245 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_create": 0, 2024-03-16T07:38:38.245 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_read": 0, 2024-03-16T07:38:38.245 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_write": 0, 2024-03-16T07:38:38.246 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_writefull": 0, 2024-03-16T07:38:38.246 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_writesame": 0, 2024-03-16T07:38:38.246 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_append": 0, 2024-03-16T07:38:38.246 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_zero": 0, 2024-03-16T07:38:38.246 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_truncate": 0, 2024-03-16T07:38:38.246 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_delete": 0, 2024-03-16T07:38:38.246 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_mapext": 0, 2024-03-16T07:38:38.246 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_sparse_read": 0, 2024-03-16T07:38:38.246 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_clonerange": 0, 2024-03-16T07:38:38.246 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_getxattr": 0, 2024-03-16T07:38:38.246 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_setxattr": 0, 2024-03-16T07:38:38.246 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_cmpxattr": 0, 2024-03-16T07:38:38.247 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_rmxattr": 0, 2024-03-16T07:38:38.247 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_resetxattrs": 0, 2024-03-16T07:38:38.247 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_call": 0, 2024-03-16T07:38:38.247 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_watch": 0, 2024-03-16T07:38:38.247 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_notify": 0, 2024-03-16T07:38:38.247 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_src_cmpxattr": 0, 2024-03-16T07:38:38.247 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_pgls": 0, 2024-03-16T07:38:38.247 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_pgls_filter": 0, 2024-03-16T07:38:38.247 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_other": 0, 2024-03-16T07:38:38.247 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_active": 0, 2024-03-16T07:38:38.247 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_send": 0, 2024-03-16T07:38:38.247 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_resend": 0, 2024-03-16T07:38:38.247 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_ping": 0, 2024-03-16T07:38:38.247 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_active": 0, 2024-03-16T07:38:38.248 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_send": 0, 2024-03-16T07:38:38.248 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_resend": 0, 2024-03-16T07:38:38.248 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_active": 0, 2024-03-16T07:38:38.248 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_send": 0, 2024-03-16T07:38:38.248 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_resend": 0, 2024-03-16T07:38:38.248 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_active": 0, 2024-03-16T07:38:38.248 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_send": 0, 2024-03-16T07:38:38.248 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_resend": 0, 2024-03-16T07:38:38.248 INFO:teuthology.orchestra.run.smithi049.stdout: "command_active": 0, 2024-03-16T07:38:38.248 INFO:teuthology.orchestra.run.smithi049.stdout: "command_send": 0, 2024-03-16T07:38:38.248 INFO:teuthology.orchestra.run.smithi049.stdout: "command_resend": 0, 2024-03-16T07:38:38.248 INFO:teuthology.orchestra.run.smithi049.stdout: "map_epoch": 0, 2024-03-16T07:38:38.249 INFO:teuthology.orchestra.run.smithi049.stdout: "map_full": 0, 2024-03-16T07:38:38.249 INFO:teuthology.orchestra.run.smithi049.stdout: "map_inc": 0, 2024-03-16T07:38:38.249 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_sessions": 0, 2024-03-16T07:38:38.249 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_session_open": 0, 2024-03-16T07:38:38.249 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_session_close": 0, 2024-03-16T07:38:38.249 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_laggy": 0, 2024-03-16T07:38:38.249 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_wr": 0, 2024-03-16T07:38:38.249 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_rd": 0, 2024-03-16T07:38:38.249 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_del": 0 2024-03-16T07:38:38.249 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:38.249 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:38.249 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:38:38.249 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-msgr_dispatch_throttler-client": [ 2024-03-16T07:38:38.250 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:38:38.250 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:38:38.250 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:38:38.250 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:38:38.250 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-03-16T07:38:38.250 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:38:38.250 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 124, 2024-03-16T07:38:38.250 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 490920, 2024-03-16T07:38:38.250 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:38:38.250 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 124, 2024-03-16T07:38:38.250 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:38:38.250 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:38:38.251 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 124, 2024-03-16T07:38:38.251 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 490920, 2024-03-16T07:38:38.251 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:38:38.251 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:38:38.251 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:38:38.251 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:38:38.251 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:38.251 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:38.251 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:38.251 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:38:38.251 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-msgr_dispatch_throttler-radosclient": [ 2024-03-16T07:38:38.251 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:38:38.252 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:38:38.252 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:38:38.252 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:38:38.252 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-03-16T07:38:38.252 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:38:38.252 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 92, 2024-03-16T07:38:38.252 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 3141221, 2024-03-16T07:38:38.252 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:38:38.252 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 92, 2024-03-16T07:38:38.252 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:38:38.252 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:38:38.252 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 92, 2024-03-16T07:38:38.253 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 3141221, 2024-03-16T07:38:38.253 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:38:38.253 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:38:38.253 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:38:38.253 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:38:38.253 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:38.253 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:38.253 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:38.253 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:38:38.253 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-objecter_bytes": [ 2024-03-16T07:38:38.253 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:38:38.253 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:38:38.253 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:38:38.253 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:38:38.253 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-03-16T07:38:38.254 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:38:38.254 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 0, 2024-03-16T07:38:38.254 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 0, 2024-03-16T07:38:38.254 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:38:38.254 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 0, 2024-03-16T07:38:38.254 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:38:38.254 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:38:38.254 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 0, 2024-03-16T07:38:38.254 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 0, 2024-03-16T07:38:38.254 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:38:38.254 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:38:38.254 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:38:38.255 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:38:38.255 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:38.255 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:38.255 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:38.255 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:38:38.255 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-objecter_ops": [ 2024-03-16T07:38:38.255 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:38:38.255 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:38:38.255 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:38:38.255 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:38:38.255 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 1024, 2024-03-16T07:38:38.255 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:38:38.255 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 0, 2024-03-16T07:38:38.256 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 0, 2024-03-16T07:38:38.256 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:38:38.256 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 0, 2024-03-16T07:38:38.256 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:38:38.256 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:38:38.256 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 0, 2024-03-16T07:38:38.256 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 0, 2024-03-16T07:38:38.256 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:38:38.256 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:38:38.256 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:38:38.256 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:38:38.256 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:38.256 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:38.257 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:38.257 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2024-03-16T07:38:38.257 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-03-16T07:38:38.258 DEBUG:tasks.cephfs.test_mirroring:command returned={ "AsyncMessenger::Worker": [ { "labels": { "id": "0" }, "counters": { "msgr_connection_ready_timeouts": 0, "msgr_connection_idle_timeouts": 0 } }, { "labels": { "id": "1" }, "counters": { "msgr_connection_ready_timeouts": 0, "msgr_connection_idle_timeouts": 0 } }, { "labels": { "id": "2" }, "counters": { "msgr_connection_ready_timeouts": 0, "msgr_connection_idle_timeouts": 0 } } ], "AsyncMessenger::Worker-0": [ { "labels": {}, "counters": { "msgr_recv_messages": 13, "msgr_send_messages": 170, "msgr_recv_bytes": 1872, "msgr_send_bytes": 1066016, "msgr_created_connections": 26, "msgr_active_connections": 5, "msgr_running_total_time": 2.037208767, "msgr_running_send_time": 0.700646802, "msgr_running_recv_time": 0.173849705, "msgr_running_fast_dispatch_time": 0.000000000, "msgr_send_messages_queue_lat": { "avgcount": 158, "sum": 2.477412949, "avgtime": 0.015679828 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "msgr_recv_encrypted_bytes": 1872, "msgr_send_encrypted_bytes": 1066016 } } ], "AsyncMessenger::Worker-1": [ { "labels": {}, "counters": { "msgr_recv_messages": 124, "msgr_send_messages": 10, "msgr_recv_bytes": 507744, "msgr_send_bytes": 2112, "msgr_created_connections": 4, "msgr_active_connections": 0, "msgr_running_total_time": 1.750629373, "msgr_running_send_time": 0.202996520, "msgr_running_recv_time": 1.100549210, "msgr_running_fast_dispatch_time": 0.194190800, "msgr_send_messages_queue_lat": { "avgcount": 9, "sum": 0.188856872, "avgtime": 0.020984096 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "msgr_recv_encrypted_bytes": 507744, "msgr_send_encrypted_bytes": 2112 } } ], "AsyncMessenger::Worker-2": [ { "labels": {}, "counters": { "msgr_recv_messages": 82, "msgr_send_messages": 13, "msgr_recv_bytes": 3152736, "msgr_send_bytes": 2576, "msgr_created_connections": 3, "msgr_active_connections": 1, "msgr_running_total_time": 4.234645153, "msgr_running_send_time": 0.440172124, "msgr_running_recv_time": 4.025711911, "msgr_running_fast_dispatch_time": 0.000000000, "msgr_send_messages_queue_lat": { "avgcount": 12, "sum": 0.346963753, "avgtime": 0.028913646 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "msgr_recv_encrypted_bytes": 3152736, "msgr_send_encrypted_bytes": 2576 } } ], "cct": [ { "labels": {}, "counters": { "total_workers": 0, "unhealthy_workers": 0 } } ], "cephfs_mirror": [ { "labels": {}, "counters": { "mirrored_filesystems": 2, "mirror_enable_failures": 0 } } ], "cephfs_mirror_mirrored_filesystems": [ { "labels": { "filesystem": "cephfs" }, "counters": { "mirroring_peers": 1, "directory_count": 1 } } ], "cephfs_mirror_peers": [ { "labels": { "peer_cluster_filesystem": "backup_fs", "peer_cluster_name": "ceph", "source_filesystem": "cephfs", "source_fscid": "14" }, "counters": { "snaps_synced": 0, "snaps_deleted": 0, "snaps_renamed": 0, "sync_failures": 5, "avg_sync_time": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "sync_bytes": 0 } } ], "mempool": [ { "labels": {}, "counters": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_cache_buffer_bytes": 0, "bluestore_cache_buffer_items": 0, "bluestore_extent_bytes": 0, "bluestore_extent_items": 0, "bluestore_blob_bytes": 0, "bluestore_blob_items": 0, "bluestore_shared_blob_bytes": 0, "bluestore_shared_blob_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_items": 0, "bluefs_bytes": 0, "bluefs_items": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "buffer_anon_bytes": 621030888, "buffer_anon_items": 231, "buffer_meta_bytes": 7216, "buffer_meta_items": 82, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 33848, "osdmap_items": 332, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "mds_co_bytes": 0, "mds_co_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 } } ], "objecter": [ { "labels": {}, "counters": { "op_active": 0, "op_laggy": 0, "op_send": 0, "op_send_bytes": 0, "op_resend": 0, "op_reply": 0, "op_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "op_inflight": 0, "oplen_avg": { "avgcount": 0, "sum": 0 }, "op": 0, "op_r": 0, "op_w": 0, "op_rmw": 0, "op_pg": 0, "osdop_stat": 0, "osdop_create": 0, "osdop_read": 0, "osdop_write": 0, "osdop_writefull": 0, "osdop_writesame": 0, "osdop_append": 0, "osdop_zero": 0, "osdop_truncate": 0, "osdop_delete": 0, "osdop_mapext": 0, "osdop_sparse_read": 0, "osdop_clonerange": 0, "osdop_getxattr": 0, "osdop_setxattr": 0, "osdop_cmpxattr": 0, "osdop_rmxattr": 0, "osdop_resetxattrs": 0, "osdop_call": 0, "osdop_watch": 0, "osdop_notify": 0, "osdop_src_cmpxattr": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_other": 0, "linger_active": 0, "linger_send": 0, "linger_resend": 0, "linger_ping": 0, "poolop_active": 0, "poolop_send": 0, "poolop_resend": 0, "poolstat_active": 0, "poolstat_send": 0, "poolstat_resend": 0, "statfs_active": 0, "statfs_send": 0, "statfs_resend": 0, "command_active": 0, "command_send": 0, "command_resend": 0, "map_epoch": 0, "map_full": 0, "map_inc": 0, "osd_sessions": 0, "osd_session_open": 0, "osd_session_close": 0, "osd_laggy": 0, "omap_wr": 0, "omap_rd": 0, "omap_del": 0 } } ], "throttle-msgr_dispatch_throttler-client": [ { "labels": {}, "counters": { "val": 0, "max": 104857600, "get_started": 0, "get": 124, "get_sum": 490920, "get_or_fail_fail": 0, "get_or_fail_success": 124, "take": 0, "take_sum": 0, "put": 124, "put_sum": 490920, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ], "throttle-msgr_dispatch_throttler-radosclient": [ { "labels": {}, "counters": { "val": 0, "max": 104857600, "get_started": 0, "get": 92, "get_sum": 3141221, "get_or_fail_fail": 0, "get_or_fail_success": 92, "take": 0, "take_sum": 0, "put": 92, "put_sum": 3141221, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ], "throttle-objecter_bytes": [ { "labels": {}, "counters": { "val": 0, "max": 104857600, "get_started": 0, "get": 0, "get_sum": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "take": 0, "take_sum": 0, "put": 0, "put_sum": 0, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ], "throttle-objecter_ops": [ { "labels": {}, "counters": { "val": 0, "max": 1024, "get_started": 0, "get": 0, "get_sum": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "take": 0, "take_sum": 0, "put": 0, "put_sum": 0, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ] } 2024-03-16T07:38:38.258 DEBUG:tasks.cephfs.test_mirroring:removing directories 3 2024-03-16T07:38:38.258 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-03-16T07:38:38.259 DEBUG:teuthology.orchestra.run.smithi049:counter dump for fs: cephfs> ceph --admin-daemon /var/run/ceph/cephfs-mirror.asok counter dump 2024-03-16T07:38:38.517 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-03-16T07:38:38.517 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker": [ 2024-03-16T07:38:38.518 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:38:38.518 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:38:38.518 INFO:teuthology.orchestra.run.smithi049.stdout: "id": "0" 2024-03-16T07:38:38.518 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:38:38.518 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:38:38.518 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_ready_timeouts": 0, 2024-03-16T07:38:38.518 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_idle_timeouts": 0 2024-03-16T07:38:38.518 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:38.518 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:38:38.518 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:38:38.518 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:38:38.518 INFO:teuthology.orchestra.run.smithi049.stdout: "id": "1" 2024-03-16T07:38:38.518 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:38:38.518 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:38:38.518 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_ready_timeouts": 0, 2024-03-16T07:38:38.518 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_idle_timeouts": 0 2024-03-16T07:38:38.519 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:38.519 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:38:38.519 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:38:38.519 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:38:38.519 INFO:teuthology.orchestra.run.smithi049.stdout: "id": "2" 2024-03-16T07:38:38.519 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:38:38.519 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:38:38.519 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_ready_timeouts": 0, 2024-03-16T07:38:38.519 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_idle_timeouts": 0 2024-03-16T07:38:38.519 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:38.519 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:38.519 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:38:38.519 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-0": [ 2024-03-16T07:38:38.519 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:38:38.519 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:38:38.520 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:38:38.520 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 13, 2024-03-16T07:38:38.520 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 170, 2024-03-16T07:38:38.520 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 1872, 2024-03-16T07:38:38.520 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 1066016, 2024-03-16T07:38:38.520 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 26, 2024-03-16T07:38:38.520 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 5, 2024-03-16T07:38:38.520 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 2.037208767, 2024-03-16T07:38:38.520 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.700646802, 2024-03-16T07:38:38.520 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 0.173849705, 2024-03-16T07:38:38.520 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-03-16T07:38:38.520 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T07:38:38.520 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 158, 2024-03-16T07:38:38.520 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 2.477412949, 2024-03-16T07:38:38.520 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.015679828 2024-03-16T07:38:38.520 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:38:38.521 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-03-16T07:38:38.521 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:38:38.521 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:38:38.521 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:38:38.521 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:38:38.521 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 1872, 2024-03-16T07:38:38.521 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 1066016 2024-03-16T07:38:38.521 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:38.521 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:38.521 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:38:38.521 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-1": [ 2024-03-16T07:38:38.521 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:38:38.521 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:38:38.521 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:38:38.521 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 124, 2024-03-16T07:38:38.521 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 10, 2024-03-16T07:38:38.521 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 507744, 2024-03-16T07:38:38.522 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 2112, 2024-03-16T07:38:38.522 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 4, 2024-03-16T07:38:38.522 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 0, 2024-03-16T07:38:38.522 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 1.750629373, 2024-03-16T07:38:38.522 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.202996520, 2024-03-16T07:38:38.522 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 1.100549210, 2024-03-16T07:38:38.522 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.194190800, 2024-03-16T07:38:38.522 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T07:38:38.522 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 9, 2024-03-16T07:38:38.522 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.188856872, 2024-03-16T07:38:38.522 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.020984096 2024-03-16T07:38:38.522 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:38:38.522 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-03-16T07:38:38.522 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:38:38.522 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:38:38.522 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:38:38.522 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:38:38.523 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 507744, 2024-03-16T07:38:38.523 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 2112 2024-03-16T07:38:38.523 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:38.523 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:38.523 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:38:38.523 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-2": [ 2024-03-16T07:38:38.523 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:38:38.523 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:38:38.523 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:38:38.523 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 82, 2024-03-16T07:38:38.523 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 13, 2024-03-16T07:38:38.523 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 3152736, 2024-03-16T07:38:38.523 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 2576, 2024-03-16T07:38:38.523 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 3, 2024-03-16T07:38:38.523 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 1, 2024-03-16T07:38:38.523 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 4.234645153, 2024-03-16T07:38:38.524 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.440172124, 2024-03-16T07:38:38.524 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 4.025711911, 2024-03-16T07:38:38.524 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-03-16T07:38:38.524 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T07:38:38.524 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 12, 2024-03-16T07:38:38.524 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.346963753, 2024-03-16T07:38:38.524 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.028913646 2024-03-16T07:38:38.524 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:38:38.524 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-03-16T07:38:38.524 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:38:38.524 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:38:38.524 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:38:38.524 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:38:38.524 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 3152736, 2024-03-16T07:38:38.524 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 2576 2024-03-16T07:38:38.524 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:38.524 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:38.525 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:38:38.525 INFO:teuthology.orchestra.run.smithi049.stdout: "cct": [ 2024-03-16T07:38:38.525 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:38:38.525 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:38:38.525 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:38:38.525 INFO:teuthology.orchestra.run.smithi049.stdout: "total_workers": 0, 2024-03-16T07:38:38.525 INFO:teuthology.orchestra.run.smithi049.stdout: "unhealthy_workers": 0 2024-03-16T07:38:38.525 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:38.525 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:38.525 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:38:38.525 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs_mirror": [ 2024-03-16T07:38:38.525 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:38:38.525 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:38:38.525 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:38:38.525 INFO:teuthology.orchestra.run.smithi049.stdout: "mirrored_filesystems": 2, 2024-03-16T07:38:38.525 INFO:teuthology.orchestra.run.smithi049.stdout: "mirror_enable_failures": 0 2024-03-16T07:38:38.525 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:38.526 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:38.526 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:38:38.526 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs_mirror_mirrored_filesystems": [ 2024-03-16T07:38:38.526 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:38:38.526 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:38:38.526 INFO:teuthology.orchestra.run.smithi049.stdout: "filesystem": "cephfs" 2024-03-16T07:38:38.526 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:38:38.526 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:38:38.526 INFO:teuthology.orchestra.run.smithi049.stdout: "mirroring_peers": 1, 2024-03-16T07:38:38.526 INFO:teuthology.orchestra.run.smithi049.stdout: "directory_count": 1 2024-03-16T07:38:38.526 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:38.526 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:38.526 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:38:38.526 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs_mirror_peers": [ 2024-03-16T07:38:38.526 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:38:38.526 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:38:38.527 INFO:teuthology.orchestra.run.smithi049.stdout: "peer_cluster_filesystem": "backup_fs", 2024-03-16T07:38:38.527 INFO:teuthology.orchestra.run.smithi049.stdout: "peer_cluster_name": "ceph", 2024-03-16T07:38:38.527 INFO:teuthology.orchestra.run.smithi049.stdout: "source_filesystem": "cephfs", 2024-03-16T07:38:38.527 INFO:teuthology.orchestra.run.smithi049.stdout: "source_fscid": "14" 2024-03-16T07:38:38.527 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:38:38.527 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:38:38.527 INFO:teuthology.orchestra.run.smithi049.stdout: "snaps_synced": 0, 2024-03-16T07:38:38.527 INFO:teuthology.orchestra.run.smithi049.stdout: "snaps_deleted": 0, 2024-03-16T07:38:38.527 INFO:teuthology.orchestra.run.smithi049.stdout: "snaps_renamed": 0, 2024-03-16T07:38:38.527 INFO:teuthology.orchestra.run.smithi049.stdout: "sync_failures": 5, 2024-03-16T07:38:38.527 INFO:teuthology.orchestra.run.smithi049.stdout: "avg_sync_time": { 2024-03-16T07:38:38.527 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:38:38.527 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:38:38.527 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:38:38.527 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:38:38.527 INFO:teuthology.orchestra.run.smithi049.stdout: "sync_bytes": 0 2024-03-16T07:38:38.528 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:38.528 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:38.528 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:38:38.528 INFO:teuthology.orchestra.run.smithi049.stdout: "mempool": [ 2024-03-16T07:38:38.528 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:38:38.528 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:38:38.528 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:38:38.528 INFO:teuthology.orchestra.run.smithi049.stdout: "bloom_filter_bytes": 0, 2024-03-16T07:38:38.528 INFO:teuthology.orchestra.run.smithi049.stdout: "bloom_filter_items": 0, 2024-03-16T07:38:38.528 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_alloc_bytes": 0, 2024-03-16T07:38:38.528 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_alloc_items": 0, 2024-03-16T07:38:38.528 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_data_bytes": 0, 2024-03-16T07:38:38.528 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_data_items": 0, 2024-03-16T07:38:38.528 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_onode_bytes": 0, 2024-03-16T07:38:38.528 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_onode_items": 0, 2024-03-16T07:38:38.529 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_meta_bytes": 0, 2024-03-16T07:38:38.529 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_meta_items": 0, 2024-03-16T07:38:38.529 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_other_bytes": 0, 2024-03-16T07:38:38.529 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_other_items": 0, 2024-03-16T07:38:38.529 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_buffer_bytes": 0, 2024-03-16T07:38:38.529 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_buffer_items": 0, 2024-03-16T07:38:38.529 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_extent_bytes": 0, 2024-03-16T07:38:38.529 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_extent_items": 0, 2024-03-16T07:38:38.529 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_blob_bytes": 0, 2024-03-16T07:38:38.529 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_blob_items": 0, 2024-03-16T07:38:38.529 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_shared_blob_bytes": 0, 2024-03-16T07:38:38.529 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_shared_blob_items": 0, 2024-03-16T07:38:38.529 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_inline_bl_bytes": 0, 2024-03-16T07:38:38.529 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_inline_bl_items": 0, 2024-03-16T07:38:38.529 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_fsck_bytes": 0, 2024-03-16T07:38:38.529 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_fsck_items": 0, 2024-03-16T07:38:38.530 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_txc_bytes": 0, 2024-03-16T07:38:38.530 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_txc_items": 0, 2024-03-16T07:38:38.530 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_deferred_bytes": 0, 2024-03-16T07:38:38.530 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_deferred_items": 0, 2024-03-16T07:38:38.530 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_bytes": 0, 2024-03-16T07:38:38.530 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_items": 0, 2024-03-16T07:38:38.530 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_bytes": 0, 2024-03-16T07:38:38.530 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_items": 0, 2024-03-16T07:38:38.530 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_reader_bytes": 0, 2024-03-16T07:38:38.530 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_reader_items": 0, 2024-03-16T07:38:38.530 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_writer_bytes": 0, 2024-03-16T07:38:38.530 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_writer_items": 0, 2024-03-16T07:38:38.530 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_anon_bytes": 621030888, 2024-03-16T07:38:38.530 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_anon_items": 231, 2024-03-16T07:38:38.531 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_meta_bytes": 7216, 2024-03-16T07:38:38.531 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_meta_items": 82, 2024-03-16T07:38:38.531 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_bytes": 0, 2024-03-16T07:38:38.531 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_items": 0, 2024-03-16T07:38:38.531 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_mapbl_bytes": 0, 2024-03-16T07:38:38.531 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_mapbl_items": 0, 2024-03-16T07:38:38.531 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pglog_bytes": 0, 2024-03-16T07:38:38.531 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pglog_items": 0, 2024-03-16T07:38:38.531 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_bytes": 33848, 2024-03-16T07:38:38.531 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_items": 332, 2024-03-16T07:38:38.531 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_mapping_bytes": 0, 2024-03-16T07:38:38.531 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_mapping_items": 0, 2024-03-16T07:38:38.531 INFO:teuthology.orchestra.run.smithi049.stdout: "pgmap_bytes": 0, 2024-03-16T07:38:38.531 INFO:teuthology.orchestra.run.smithi049.stdout: "pgmap_items": 0, 2024-03-16T07:38:38.531 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_co_bytes": 0, 2024-03-16T07:38:38.532 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_co_items": 0, 2024-03-16T07:38:38.532 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_1_bytes": 0, 2024-03-16T07:38:38.532 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_1_items": 0, 2024-03-16T07:38:38.532 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_2_bytes": 0, 2024-03-16T07:38:38.532 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_2_items": 0 2024-03-16T07:38:38.532 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:38.532 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:38.532 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:38:38.532 INFO:teuthology.orchestra.run.smithi049.stdout: "objecter": [ 2024-03-16T07:38:38.532 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:38:38.532 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:38:38.532 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:38:38.532 INFO:teuthology.orchestra.run.smithi049.stdout: "op_active": 0, 2024-03-16T07:38:38.532 INFO:teuthology.orchestra.run.smithi049.stdout: "op_laggy": 0, 2024-03-16T07:38:38.532 INFO:teuthology.orchestra.run.smithi049.stdout: "op_send": 0, 2024-03-16T07:38:38.533 INFO:teuthology.orchestra.run.smithi049.stdout: "op_send_bytes": 0, 2024-03-16T07:38:38.533 INFO:teuthology.orchestra.run.smithi049.stdout: "op_resend": 0, 2024-03-16T07:38:38.533 INFO:teuthology.orchestra.run.smithi049.stdout: "op_reply": 0, 2024-03-16T07:38:38.533 INFO:teuthology.orchestra.run.smithi049.stdout: "op_latency": { 2024-03-16T07:38:38.533 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:38:38.533 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:38:38.533 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:38:38.533 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:38:38.533 INFO:teuthology.orchestra.run.smithi049.stdout: "op_inflight": 0, 2024-03-16T07:38:38.533 INFO:teuthology.orchestra.run.smithi049.stdout: "oplen_avg": { 2024-03-16T07:38:38.533 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:38:38.533 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0 2024-03-16T07:38:38.533 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:38:38.533 INFO:teuthology.orchestra.run.smithi049.stdout: "op": 0, 2024-03-16T07:38:38.533 INFO:teuthology.orchestra.run.smithi049.stdout: "op_r": 0, 2024-03-16T07:38:38.533 INFO:teuthology.orchestra.run.smithi049.stdout: "op_w": 0, 2024-03-16T07:38:38.534 INFO:teuthology.orchestra.run.smithi049.stdout: "op_rmw": 0, 2024-03-16T07:38:38.534 INFO:teuthology.orchestra.run.smithi049.stdout: "op_pg": 0, 2024-03-16T07:38:38.534 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_stat": 0, 2024-03-16T07:38:38.534 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_create": 0, 2024-03-16T07:38:38.534 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_read": 0, 2024-03-16T07:38:38.534 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_write": 0, 2024-03-16T07:38:38.534 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_writefull": 0, 2024-03-16T07:38:38.534 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_writesame": 0, 2024-03-16T07:38:38.534 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_append": 0, 2024-03-16T07:38:38.534 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_zero": 0, 2024-03-16T07:38:38.534 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_truncate": 0, 2024-03-16T07:38:38.534 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_delete": 0, 2024-03-16T07:38:38.534 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_mapext": 0, 2024-03-16T07:38:38.534 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_sparse_read": 0, 2024-03-16T07:38:38.535 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_clonerange": 0, 2024-03-16T07:38:38.535 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_getxattr": 0, 2024-03-16T07:38:38.535 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_setxattr": 0, 2024-03-16T07:38:38.535 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_cmpxattr": 0, 2024-03-16T07:38:38.535 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_rmxattr": 0, 2024-03-16T07:38:38.535 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_resetxattrs": 0, 2024-03-16T07:38:38.535 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_call": 0, 2024-03-16T07:38:38.535 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_watch": 0, 2024-03-16T07:38:38.535 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_notify": 0, 2024-03-16T07:38:38.535 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_src_cmpxattr": 0, 2024-03-16T07:38:38.535 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_pgls": 0, 2024-03-16T07:38:38.535 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_pgls_filter": 0, 2024-03-16T07:38:38.535 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_other": 0, 2024-03-16T07:38:38.535 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_active": 0, 2024-03-16T07:38:38.535 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_send": 0, 2024-03-16T07:38:38.535 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_resend": 0, 2024-03-16T07:38:38.535 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_ping": 0, 2024-03-16T07:38:38.535 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_active": 0, 2024-03-16T07:38:38.536 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_send": 0, 2024-03-16T07:38:38.536 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_resend": 0, 2024-03-16T07:38:38.536 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_active": 0, 2024-03-16T07:38:38.536 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_send": 0, 2024-03-16T07:38:38.536 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_resend": 0, 2024-03-16T07:38:38.536 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_active": 0, 2024-03-16T07:38:38.536 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_send": 0, 2024-03-16T07:38:38.536 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_resend": 0, 2024-03-16T07:38:38.536 INFO:teuthology.orchestra.run.smithi049.stdout: "command_active": 0, 2024-03-16T07:38:38.536 INFO:teuthology.orchestra.run.smithi049.stdout: "command_send": 0, 2024-03-16T07:38:38.536 INFO:teuthology.orchestra.run.smithi049.stdout: "command_resend": 0, 2024-03-16T07:38:38.536 INFO:teuthology.orchestra.run.smithi049.stdout: "map_epoch": 0, 2024-03-16T07:38:38.536 INFO:teuthology.orchestra.run.smithi049.stdout: "map_full": 0, 2024-03-16T07:38:38.536 INFO:teuthology.orchestra.run.smithi049.stdout: "map_inc": 0, 2024-03-16T07:38:38.537 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_sessions": 0, 2024-03-16T07:38:38.537 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_session_open": 0, 2024-03-16T07:38:38.537 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_session_close": 0, 2024-03-16T07:38:38.537 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_laggy": 0, 2024-03-16T07:38:38.537 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_wr": 0, 2024-03-16T07:38:38.537 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_rd": 0, 2024-03-16T07:38:38.537 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_del": 0 2024-03-16T07:38:38.537 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:38.537 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:38.537 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:38:38.537 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-msgr_dispatch_throttler-client": [ 2024-03-16T07:38:38.537 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:38:38.537 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:38:38.537 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:38:38.537 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:38:38.538 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-03-16T07:38:38.538 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:38:38.538 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 124, 2024-03-16T07:38:38.538 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 490920, 2024-03-16T07:38:38.538 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:38:38.538 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 124, 2024-03-16T07:38:38.538 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:38:38.538 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:38:38.538 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 124, 2024-03-16T07:38:38.538 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 490920, 2024-03-16T07:38:38.538 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:38:38.538 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:38:38.538 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:38:38.538 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:38:38.538 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:38.538 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:38.539 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:38.539 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:38:38.539 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-msgr_dispatch_throttler-radosclient": [ 2024-03-16T07:38:38.539 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:38:38.539 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:38:38.539 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:38:38.539 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:38:38.539 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-03-16T07:38:38.539 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:38:38.539 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 92, 2024-03-16T07:38:38.539 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 3141221, 2024-03-16T07:38:38.539 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:38:38.539 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 92, 2024-03-16T07:38:38.539 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:38:38.539 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:38:38.539 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 92, 2024-03-16T07:38:38.540 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 3141221, 2024-03-16T07:38:38.540 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:38:38.540 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:38:38.540 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:38:38.540 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:38:38.540 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:38.540 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:38.540 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:38.540 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:38:38.540 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-objecter_bytes": [ 2024-03-16T07:38:38.540 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:38:38.540 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:38:38.540 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:38:38.540 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:38:38.540 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-03-16T07:38:38.541 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:38:38.541 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 0, 2024-03-16T07:38:38.541 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 0, 2024-03-16T07:38:38.541 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:38:38.541 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 0, 2024-03-16T07:38:38.541 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:38:38.541 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:38:38.541 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 0, 2024-03-16T07:38:38.541 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 0, 2024-03-16T07:38:38.541 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:38:38.541 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:38:38.541 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:38:38.541 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:38:38.541 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:38.542 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:38.542 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:38.542 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:38:38.542 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-objecter_ops": [ 2024-03-16T07:38:38.542 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:38:38.542 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:38:38.542 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:38:38.542 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:38:38.542 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 1024, 2024-03-16T07:38:38.542 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:38:38.542 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 0, 2024-03-16T07:38:38.542 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 0, 2024-03-16T07:38:38.542 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:38:38.542 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 0, 2024-03-16T07:38:38.543 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:38:38.543 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:38:38.543 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 0, 2024-03-16T07:38:38.543 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 0, 2024-03-16T07:38:38.543 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:38:38.543 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:38:38.543 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:38:38.543 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:38:38.543 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:38.543 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:38.543 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:38.543 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2024-03-16T07:38:38.543 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-03-16T07:38:38.544 DEBUG:tasks.cephfs.test_mirroring:command returned={ "AsyncMessenger::Worker": [ { "labels": { "id": "0" }, "counters": { "msgr_connection_ready_timeouts": 0, "msgr_connection_idle_timeouts": 0 } }, { "labels": { "id": "1" }, "counters": { "msgr_connection_ready_timeouts": 0, "msgr_connection_idle_timeouts": 0 } }, { "labels": { "id": "2" }, "counters": { "msgr_connection_ready_timeouts": 0, "msgr_connection_idle_timeouts": 0 } } ], "AsyncMessenger::Worker-0": [ { "labels": {}, "counters": { "msgr_recv_messages": 13, "msgr_send_messages": 170, "msgr_recv_bytes": 1872, "msgr_send_bytes": 1066016, "msgr_created_connections": 26, "msgr_active_connections": 5, "msgr_running_total_time": 2.037208767, "msgr_running_send_time": 0.700646802, "msgr_running_recv_time": 0.173849705, "msgr_running_fast_dispatch_time": 0.000000000, "msgr_send_messages_queue_lat": { "avgcount": 158, "sum": 2.477412949, "avgtime": 0.015679828 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "msgr_recv_encrypted_bytes": 1872, "msgr_send_encrypted_bytes": 1066016 } } ], "AsyncMessenger::Worker-1": [ { "labels": {}, "counters": { "msgr_recv_messages": 124, "msgr_send_messages": 10, "msgr_recv_bytes": 507744, "msgr_send_bytes": 2112, "msgr_created_connections": 4, "msgr_active_connections": 0, "msgr_running_total_time": 1.750629373, "msgr_running_send_time": 0.202996520, "msgr_running_recv_time": 1.100549210, "msgr_running_fast_dispatch_time": 0.194190800, "msgr_send_messages_queue_lat": { "avgcount": 9, "sum": 0.188856872, "avgtime": 0.020984096 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "msgr_recv_encrypted_bytes": 507744, "msgr_send_encrypted_bytes": 2112 } } ], "AsyncMessenger::Worker-2": [ { "labels": {}, "counters": { "msgr_recv_messages": 82, "msgr_send_messages": 13, "msgr_recv_bytes": 3152736, "msgr_send_bytes": 2576, "msgr_created_connections": 3, "msgr_active_connections": 1, "msgr_running_total_time": 4.234645153, "msgr_running_send_time": 0.440172124, "msgr_running_recv_time": 4.025711911, "msgr_running_fast_dispatch_time": 0.000000000, "msgr_send_messages_queue_lat": { "avgcount": 12, "sum": 0.346963753, "avgtime": 0.028913646 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "msgr_recv_encrypted_bytes": 3152736, "msgr_send_encrypted_bytes": 2576 } } ], "cct": [ { "labels": {}, "counters": { "total_workers": 0, "unhealthy_workers": 0 } } ], "cephfs_mirror": [ { "labels": {}, "counters": { "mirrored_filesystems": 2, "mirror_enable_failures": 0 } } ], "cephfs_mirror_mirrored_filesystems": [ { "labels": { "filesystem": "cephfs" }, "counters": { "mirroring_peers": 1, "directory_count": 1 } } ], "cephfs_mirror_peers": [ { "labels": { "peer_cluster_filesystem": "backup_fs", "peer_cluster_name": "ceph", "source_filesystem": "cephfs", "source_fscid": "14" }, "counters": { "snaps_synced": 0, "snaps_deleted": 0, "snaps_renamed": 0, "sync_failures": 5, "avg_sync_time": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "sync_bytes": 0 } } ], "mempool": [ { "labels": {}, "counters": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_cache_buffer_bytes": 0, "bluestore_cache_buffer_items": 0, "bluestore_extent_bytes": 0, "bluestore_extent_items": 0, "bluestore_blob_bytes": 0, "bluestore_blob_items": 0, "bluestore_shared_blob_bytes": 0, "bluestore_shared_blob_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_items": 0, "bluefs_bytes": 0, "bluefs_items": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "buffer_anon_bytes": 621030888, "buffer_anon_items": 231, "buffer_meta_bytes": 7216, "buffer_meta_items": 82, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 33848, "osdmap_items": 332, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "mds_co_bytes": 0, "mds_co_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 } } ], "objecter": [ { "labels": {}, "counters": { "op_active": 0, "op_laggy": 0, "op_send": 0, "op_send_bytes": 0, "op_resend": 0, "op_reply": 0, "op_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "op_inflight": 0, "oplen_avg": { "avgcount": 0, "sum": 0 }, "op": 0, "op_r": 0, "op_w": 0, "op_rmw": 0, "op_pg": 0, "osdop_stat": 0, "osdop_create": 0, "osdop_read": 0, "osdop_write": 0, "osdop_writefull": 0, "osdop_writesame": 0, "osdop_append": 0, "osdop_zero": 0, "osdop_truncate": 0, "osdop_delete": 0, "osdop_mapext": 0, "osdop_sparse_read": 0, "osdop_clonerange": 0, "osdop_getxattr": 0, "osdop_setxattr": 0, "osdop_cmpxattr": 0, "osdop_rmxattr": 0, "osdop_resetxattrs": 0, "osdop_call": 0, "osdop_watch": 0, "osdop_notify": 0, "osdop_src_cmpxattr": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_other": 0, "linger_active": 0, "linger_send": 0, "linger_resend": 0, "linger_ping": 0, "poolop_active": 0, "poolop_send": 0, "poolop_resend": 0, "poolstat_active": 0, "poolstat_send": 0, "poolstat_resend": 0, "statfs_active": 0, "statfs_send": 0, "statfs_resend": 0, "command_active": 0, "command_send": 0, "command_resend": 0, "map_epoch": 0, "map_full": 0, "map_inc": 0, "osd_sessions": 0, "osd_session_open": 0, "osd_session_close": 0, "osd_laggy": 0, "omap_wr": 0, "omap_rd": 0, "omap_del": 0 } } ], "throttle-msgr_dispatch_throttler-client": [ { "labels": {}, "counters": { "val": 0, "max": 104857600, "get_started": 0, "get": 124, "get_sum": 490920, "get_or_fail_fail": 0, "get_or_fail_success": 124, "take": 0, "take_sum": 0, "put": 124, "put_sum": 490920, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ], "throttle-msgr_dispatch_throttler-radosclient": [ { "labels": {}, "counters": { "val": 0, "max": 104857600, "get_started": 0, "get": 92, "get_sum": 3141221, "get_or_fail_fail": 0, "get_or_fail_success": 92, "take": 0, "take_sum": 0, "put": 92, "put_sum": 3141221, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ], "throttle-objecter_bytes": [ { "labels": {}, "counters": { "val": 0, "max": 104857600, "get_started": 0, "get": 0, "get_sum": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "take": 0, "take_sum": 0, "put": 0, "put_sum": 0, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ], "throttle-objecter_ops": [ { "labels": {}, "counters": { "val": 0, "max": 1024, "get_started": 0, "get": 0, "get_sum": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "take": 0, "take_sum": 0, "put": 0, "put_sum": 0, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ] } 2024-03-16T07:38:38.545 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-03-16T07:38:38.545 DEBUG:teuthology.orchestra.run.smithi049:mirror status for fs: cephfs> ceph --admin-daemon /var/run/ceph/cephfs-mirror.asok fs mirror status cephfs@14 2024-03-16T07:38:39.765 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T07:38:42.783 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-03-16T07:38:42.783 INFO:teuthology.orchestra.run.smithi049.stdout: "rados_inst": "172.21.15.49:0/1186634239", 2024-03-16T07:38:42.784 INFO:teuthology.orchestra.run.smithi049.stdout: "peers": { 2024-03-16T07:38:42.784 INFO:teuthology.orchestra.run.smithi049.stdout: "8fa2e0a7-a624-43b8-9c12-da3a1afea05a": { 2024-03-16T07:38:42.784 INFO:teuthology.orchestra.run.smithi049.stdout: "remote": { 2024-03-16T07:38:42.784 INFO:teuthology.orchestra.run.smithi049.stdout: "client_name": "client.mirror_remote", 2024-03-16T07:38:42.784 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_name": "ceph", 2024-03-16T07:38:42.784 INFO:teuthology.orchestra.run.smithi049.stdout: "fs_name": "backup_fs" 2024-03-16T07:38:42.784 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:42.784 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:42.784 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:38:42.784 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_dirs": { 2024-03-16T07:38:42.784 INFO:teuthology.orchestra.run.smithi049.stdout: "dir_count": 1 2024-03-16T07:38:42.784 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:42.784 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-03-16T07:38:42.794 DEBUG:tasks.cephfs.test_mirroring:command returned={ "rados_inst": "172.21.15.49:0/1186634239", "peers": { "8fa2e0a7-a624-43b8-9c12-da3a1afea05a": { "remote": { "client_name": "client.mirror_remote", "cluster_name": "ceph", "fs_name": "backup_fs" } } }, "snap_dirs": { "dir_count": 1 } } 2024-03-16T07:38:42.794 DEBUG:tasks.cephfs.test_mirroring:initial dir_count=1 2024-03-16T07:38:42.794 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snapshot mirror remove cephfs /d2 2024-03-16T07:38:43.253 INFO:teuthology.orchestra.run.smithi049.stdout:{} 2024-03-16T07:38:53.267 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-03-16T07:38:53.268 DEBUG:teuthology.orchestra.run.smithi049:mirror status for fs: cephfs> ceph --admin-daemon /var/run/ceph/cephfs-mirror.asok fs mirror status cephfs@14 2024-03-16T07:38:53.370 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-03-16T07:38:53.370 INFO:teuthology.orchestra.run.smithi049.stdout: "rados_inst": "172.21.15.49:0/1186634239", 2024-03-16T07:38:53.370 INFO:teuthology.orchestra.run.smithi049.stdout: "peers": { 2024-03-16T07:38:53.370 INFO:teuthology.orchestra.run.smithi049.stdout: "8fa2e0a7-a624-43b8-9c12-da3a1afea05a": { 2024-03-16T07:38:53.370 INFO:teuthology.orchestra.run.smithi049.stdout: "remote": { 2024-03-16T07:38:53.370 INFO:teuthology.orchestra.run.smithi049.stdout: "client_name": "client.mirror_remote", 2024-03-16T07:38:53.370 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_name": "ceph", 2024-03-16T07:38:53.371 INFO:teuthology.orchestra.run.smithi049.stdout: "fs_name": "backup_fs" 2024-03-16T07:38:53.371 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:53.371 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:53.371 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:38:53.371 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_dirs": { 2024-03-16T07:38:53.371 INFO:teuthology.orchestra.run.smithi049.stdout: "dir_count": 0 2024-03-16T07:38:53.371 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:53.371 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-03-16T07:38:53.377 DEBUG:tasks.cephfs.test_mirroring:command returned={ "rados_inst": "172.21.15.49:0/1186634239", "peers": { "8fa2e0a7-a624-43b8-9c12-da3a1afea05a": { "remote": { "client_name": "client.mirror_remote", "cluster_name": "ceph", "fs_name": "backup_fs" } } }, "snap_dirs": { "dir_count": 0 } } 2024-03-16T07:38:53.378 DEBUG:tasks.cephfs.test_mirroring:new dir_count=0 2024-03-16T07:38:53.378 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-03-16T07:38:53.378 DEBUG:teuthology.orchestra.run.smithi049:counter dump for fs: cephfs> ceph --admin-daemon /var/run/ceph/cephfs-mirror.asok counter dump 2024-03-16T07:38:53.491 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-03-16T07:38:53.492 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker": [ 2024-03-16T07:38:53.492 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:38:53.492 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:38:53.492 INFO:teuthology.orchestra.run.smithi049.stdout: "id": "0" 2024-03-16T07:38:53.492 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:38:53.492 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:38:53.492 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_ready_timeouts": 0, 2024-03-16T07:38:53.492 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_idle_timeouts": 0 2024-03-16T07:38:53.492 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:53.492 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:38:53.492 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:38:53.492 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:38:53.493 INFO:teuthology.orchestra.run.smithi049.stdout: "id": "1" 2024-03-16T07:38:53.493 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:38:53.493 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:38:53.493 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_ready_timeouts": 0, 2024-03-16T07:38:53.493 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_idle_timeouts": 0 2024-03-16T07:38:53.493 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:53.493 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:38:53.493 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:38:53.493 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:38:53.493 INFO:teuthology.orchestra.run.smithi049.stdout: "id": "2" 2024-03-16T07:38:53.493 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:38:53.493 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:38:53.493 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_ready_timeouts": 0, 2024-03-16T07:38:53.493 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_idle_timeouts": 0 2024-03-16T07:38:53.493 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:53.493 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:53.494 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:38:53.494 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-0": [ 2024-03-16T07:38:53.494 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:38:53.494 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:38:53.494 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:38:53.494 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 13, 2024-03-16T07:38:53.494 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 173, 2024-03-16T07:38:53.494 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 1872, 2024-03-16T07:38:53.494 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 1066992, 2024-03-16T07:38:53.494 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 26, 2024-03-16T07:38:53.494 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 5, 2024-03-16T07:38:53.494 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 2.038935273, 2024-03-16T07:38:53.494 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.702270275, 2024-03-16T07:38:53.494 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 0.173849705, 2024-03-16T07:38:53.494 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-03-16T07:38:53.494 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T07:38:53.495 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 161, 2024-03-16T07:38:53.495 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 2.556057352, 2024-03-16T07:38:53.495 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.015876132 2024-03-16T07:38:53.495 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:38:53.495 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-03-16T07:38:53.495 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:38:53.495 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:38:53.495 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:38:53.495 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:38:53.495 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 1872, 2024-03-16T07:38:53.495 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 1066992 2024-03-16T07:38:53.495 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:53.495 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:53.495 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:38:53.495 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-1": [ 2024-03-16T07:38:53.495 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:38:53.495 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:38:53.496 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:38:53.496 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 124, 2024-03-16T07:38:53.496 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 10, 2024-03-16T07:38:53.496 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 507744, 2024-03-16T07:38:53.496 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 2112, 2024-03-16T07:38:53.496 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 4, 2024-03-16T07:38:53.496 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 0, 2024-03-16T07:38:53.496 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 2.044325311, 2024-03-16T07:38:53.496 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.264026370, 2024-03-16T07:38:53.496 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 1.156963787, 2024-03-16T07:38:53.496 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.194190800, 2024-03-16T07:38:53.496 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T07:38:53.496 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 9, 2024-03-16T07:38:53.496 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.188856872, 2024-03-16T07:38:53.496 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.020984096 2024-03-16T07:38:53.496 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:38:53.496 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-03-16T07:38:53.497 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:38:53.497 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:38:53.497 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:38:53.497 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:38:53.497 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 507744, 2024-03-16T07:38:53.497 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 2112 2024-03-16T07:38:53.497 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:53.497 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:53.497 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:38:53.497 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-2": [ 2024-03-16T07:38:53.497 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:38:53.497 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:38:53.497 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:38:53.497 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 82, 2024-03-16T07:38:53.497 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 13, 2024-03-16T07:38:53.497 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 3152736, 2024-03-16T07:38:53.498 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 2576, 2024-03-16T07:38:53.498 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 3, 2024-03-16T07:38:53.498 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 1, 2024-03-16T07:38:53.498 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 4.888935958, 2024-03-16T07:38:53.498 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.598114497, 2024-03-16T07:38:53.498 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 4.385401985, 2024-03-16T07:38:53.498 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-03-16T07:38:53.498 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T07:38:53.498 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 12, 2024-03-16T07:38:53.498 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.346963753, 2024-03-16T07:38:53.498 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.028913646 2024-03-16T07:38:53.498 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:38:53.498 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-03-16T07:38:53.498 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:38:53.499 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:38:53.499 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:38:53.499 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:38:53.499 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 3152736, 2024-03-16T07:38:53.499 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 2576 2024-03-16T07:38:53.499 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:53.499 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:53.499 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:38:53.499 INFO:teuthology.orchestra.run.smithi049.stdout: "cct": [ 2024-03-16T07:38:53.499 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:38:53.499 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:38:53.499 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:38:53.499 INFO:teuthology.orchestra.run.smithi049.stdout: "total_workers": 0, 2024-03-16T07:38:53.499 INFO:teuthology.orchestra.run.smithi049.stdout: "unhealthy_workers": 0 2024-03-16T07:38:53.500 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:53.500 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:53.500 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:38:53.500 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs_mirror": [ 2024-03-16T07:38:53.500 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:38:53.500 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:38:53.500 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:38:53.500 INFO:teuthology.orchestra.run.smithi049.stdout: "mirrored_filesystems": 2, 2024-03-16T07:38:53.500 INFO:teuthology.orchestra.run.smithi049.stdout: "mirror_enable_failures": 0 2024-03-16T07:38:53.500 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:53.500 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:53.500 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:38:53.501 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs_mirror_mirrored_filesystems": [ 2024-03-16T07:38:53.501 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:38:53.501 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:38:53.501 INFO:teuthology.orchestra.run.smithi049.stdout: "filesystem": "cephfs" 2024-03-16T07:38:53.501 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:38:53.501 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:38:53.501 INFO:teuthology.orchestra.run.smithi049.stdout: "mirroring_peers": 1, 2024-03-16T07:38:53.501 INFO:teuthology.orchestra.run.smithi049.stdout: "directory_count": 0 2024-03-16T07:38:53.501 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:53.501 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:53.501 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:38:53.501 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs_mirror_peers": [ 2024-03-16T07:38:53.501 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:38:53.501 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:38:53.502 INFO:teuthology.orchestra.run.smithi049.stdout: "peer_cluster_filesystem": "backup_fs", 2024-03-16T07:38:53.502 INFO:teuthology.orchestra.run.smithi049.stdout: "peer_cluster_name": "ceph", 2024-03-16T07:38:53.502 INFO:teuthology.orchestra.run.smithi049.stdout: "source_filesystem": "cephfs", 2024-03-16T07:38:53.502 INFO:teuthology.orchestra.run.smithi049.stdout: "source_fscid": "14" 2024-03-16T07:38:53.502 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:38:53.502 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:38:53.502 INFO:teuthology.orchestra.run.smithi049.stdout: "snaps_synced": 0, 2024-03-16T07:38:53.502 INFO:teuthology.orchestra.run.smithi049.stdout: "snaps_deleted": 0, 2024-03-16T07:38:53.502 INFO:teuthology.orchestra.run.smithi049.stdout: "snaps_renamed": 0, 2024-03-16T07:38:53.502 INFO:teuthology.orchestra.run.smithi049.stdout: "sync_failures": 6, 2024-03-16T07:38:53.502 INFO:teuthology.orchestra.run.smithi049.stdout: "avg_sync_time": { 2024-03-16T07:38:53.502 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:38:53.502 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:38:53.502 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:38:53.502 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:38:53.503 INFO:teuthology.orchestra.run.smithi049.stdout: "sync_bytes": 0 2024-03-16T07:38:53.503 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:53.503 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:53.503 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:38:53.503 INFO:teuthology.orchestra.run.smithi049.stdout: "mempool": [ 2024-03-16T07:38:53.503 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:38:53.503 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:38:53.503 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:38:53.503 INFO:teuthology.orchestra.run.smithi049.stdout: "bloom_filter_bytes": 0, 2024-03-16T07:38:53.503 INFO:teuthology.orchestra.run.smithi049.stdout: "bloom_filter_items": 0, 2024-03-16T07:38:53.503 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_alloc_bytes": 0, 2024-03-16T07:38:53.503 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_alloc_items": 0, 2024-03-16T07:38:53.503 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_data_bytes": 0, 2024-03-16T07:38:53.503 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_data_items": 0, 2024-03-16T07:38:53.504 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_onode_bytes": 0, 2024-03-16T07:38:53.504 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_onode_items": 0, 2024-03-16T07:38:53.504 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_meta_bytes": 0, 2024-03-16T07:38:53.504 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_meta_items": 0, 2024-03-16T07:38:53.504 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_other_bytes": 0, 2024-03-16T07:38:53.504 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_other_items": 0, 2024-03-16T07:38:53.504 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_buffer_bytes": 0, 2024-03-16T07:38:53.504 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_buffer_items": 0, 2024-03-16T07:38:53.504 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_extent_bytes": 0, 2024-03-16T07:38:53.504 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_extent_items": 0, 2024-03-16T07:38:53.504 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_blob_bytes": 0, 2024-03-16T07:38:53.504 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_blob_items": 0, 2024-03-16T07:38:53.504 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_shared_blob_bytes": 0, 2024-03-16T07:38:53.504 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_shared_blob_items": 0, 2024-03-16T07:38:53.504 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_inline_bl_bytes": 0, 2024-03-16T07:38:53.505 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_inline_bl_items": 0, 2024-03-16T07:38:53.505 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_fsck_bytes": 0, 2024-03-16T07:38:53.505 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_fsck_items": 0, 2024-03-16T07:38:53.505 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_txc_bytes": 0, 2024-03-16T07:38:53.505 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_txc_items": 0, 2024-03-16T07:38:53.505 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_deferred_bytes": 0, 2024-03-16T07:38:53.505 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_deferred_items": 0, 2024-03-16T07:38:53.505 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_bytes": 0, 2024-03-16T07:38:53.505 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_items": 0, 2024-03-16T07:38:53.505 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_bytes": 0, 2024-03-16T07:38:53.505 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_items": 0, 2024-03-16T07:38:53.505 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_reader_bytes": 0, 2024-03-16T07:38:53.505 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_reader_items": 0, 2024-03-16T07:38:53.505 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_writer_bytes": 0, 2024-03-16T07:38:53.506 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_writer_items": 0, 2024-03-16T07:38:53.506 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_anon_bytes": 621022131, 2024-03-16T07:38:53.506 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_anon_items": 220, 2024-03-16T07:38:53.506 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_meta_bytes": 7040, 2024-03-16T07:38:53.506 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_meta_items": 80, 2024-03-16T07:38:53.506 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_bytes": 0, 2024-03-16T07:38:53.506 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_items": 0, 2024-03-16T07:38:53.506 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_mapbl_bytes": 0, 2024-03-16T07:38:53.506 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_mapbl_items": 0, 2024-03-16T07:38:53.506 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pglog_bytes": 0, 2024-03-16T07:38:53.506 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pglog_items": 0, 2024-03-16T07:38:53.506 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_bytes": 33848, 2024-03-16T07:38:53.506 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_items": 332, 2024-03-16T07:38:53.507 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_mapping_bytes": 0, 2024-03-16T07:38:53.507 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_mapping_items": 0, 2024-03-16T07:38:53.507 INFO:teuthology.orchestra.run.smithi049.stdout: "pgmap_bytes": 0, 2024-03-16T07:38:53.507 INFO:teuthology.orchestra.run.smithi049.stdout: "pgmap_items": 0, 2024-03-16T07:38:53.507 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_co_bytes": 0, 2024-03-16T07:38:53.507 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_co_items": 0, 2024-03-16T07:38:53.507 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_1_bytes": 0, 2024-03-16T07:38:53.507 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_1_items": 0, 2024-03-16T07:38:53.507 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_2_bytes": 0, 2024-03-16T07:38:53.507 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_2_items": 0 2024-03-16T07:38:53.507 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:53.507 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:53.507 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:38:53.507 INFO:teuthology.orchestra.run.smithi049.stdout: "objecter": [ 2024-03-16T07:38:53.507 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:38:53.508 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:38:53.508 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:38:53.508 INFO:teuthology.orchestra.run.smithi049.stdout: "op_active": 0, 2024-03-16T07:38:53.508 INFO:teuthology.orchestra.run.smithi049.stdout: "op_laggy": 0, 2024-03-16T07:38:53.508 INFO:teuthology.orchestra.run.smithi049.stdout: "op_send": 0, 2024-03-16T07:38:53.508 INFO:teuthology.orchestra.run.smithi049.stdout: "op_send_bytes": 0, 2024-03-16T07:38:53.508 INFO:teuthology.orchestra.run.smithi049.stdout: "op_resend": 0, 2024-03-16T07:38:53.508 INFO:teuthology.orchestra.run.smithi049.stdout: "op_reply": 0, 2024-03-16T07:38:53.508 INFO:teuthology.orchestra.run.smithi049.stdout: "op_latency": { 2024-03-16T07:38:53.508 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:38:53.508 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:38:53.508 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:38:53.508 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:38:53.508 INFO:teuthology.orchestra.run.smithi049.stdout: "op_inflight": 0, 2024-03-16T07:38:53.508 INFO:teuthology.orchestra.run.smithi049.stdout: "oplen_avg": { 2024-03-16T07:38:53.509 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:38:53.509 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0 2024-03-16T07:38:53.509 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:38:53.509 INFO:teuthology.orchestra.run.smithi049.stdout: "op": 0, 2024-03-16T07:38:53.509 INFO:teuthology.orchestra.run.smithi049.stdout: "op_r": 0, 2024-03-16T07:38:53.509 INFO:teuthology.orchestra.run.smithi049.stdout: "op_w": 0, 2024-03-16T07:38:53.509 INFO:teuthology.orchestra.run.smithi049.stdout: "op_rmw": 0, 2024-03-16T07:38:53.509 INFO:teuthology.orchestra.run.smithi049.stdout: "op_pg": 0, 2024-03-16T07:38:53.509 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_stat": 0, 2024-03-16T07:38:53.509 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_create": 0, 2024-03-16T07:38:53.509 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_read": 0, 2024-03-16T07:38:53.509 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_write": 0, 2024-03-16T07:38:53.509 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_writefull": 0, 2024-03-16T07:38:53.509 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_writesame": 0, 2024-03-16T07:38:53.510 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_append": 0, 2024-03-16T07:38:53.510 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_zero": 0, 2024-03-16T07:38:53.510 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_truncate": 0, 2024-03-16T07:38:53.510 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_delete": 0, 2024-03-16T07:38:53.510 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_mapext": 0, 2024-03-16T07:38:53.510 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_sparse_read": 0, 2024-03-16T07:38:53.510 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_clonerange": 0, 2024-03-16T07:38:53.510 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_getxattr": 0, 2024-03-16T07:38:53.510 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_setxattr": 0, 2024-03-16T07:38:53.510 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_cmpxattr": 0, 2024-03-16T07:38:53.510 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_rmxattr": 0, 2024-03-16T07:38:53.510 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_resetxattrs": 0, 2024-03-16T07:38:53.510 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_call": 0, 2024-03-16T07:38:53.510 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_watch": 0, 2024-03-16T07:38:53.511 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_notify": 0, 2024-03-16T07:38:53.511 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_src_cmpxattr": 0, 2024-03-16T07:38:53.511 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_pgls": 0, 2024-03-16T07:38:53.511 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_pgls_filter": 0, 2024-03-16T07:38:53.511 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_other": 0, 2024-03-16T07:38:53.511 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_active": 0, 2024-03-16T07:38:53.511 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_send": 0, 2024-03-16T07:38:53.511 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_resend": 0, 2024-03-16T07:38:53.511 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_ping": 0, 2024-03-16T07:38:53.511 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_active": 0, 2024-03-16T07:38:53.511 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_send": 0, 2024-03-16T07:38:53.511 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_resend": 0, 2024-03-16T07:38:53.511 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_active": 0, 2024-03-16T07:38:53.511 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_send": 0, 2024-03-16T07:38:53.511 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_resend": 0, 2024-03-16T07:38:53.512 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_active": 0, 2024-03-16T07:38:53.512 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_send": 0, 2024-03-16T07:38:53.512 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_resend": 0, 2024-03-16T07:38:53.512 INFO:teuthology.orchestra.run.smithi049.stdout: "command_active": 0, 2024-03-16T07:38:53.512 INFO:teuthology.orchestra.run.smithi049.stdout: "command_send": 0, 2024-03-16T07:38:53.512 INFO:teuthology.orchestra.run.smithi049.stdout: "command_resend": 0, 2024-03-16T07:38:53.512 INFO:teuthology.orchestra.run.smithi049.stdout: "map_epoch": 0, 2024-03-16T07:38:53.512 INFO:teuthology.orchestra.run.smithi049.stdout: "map_full": 0, 2024-03-16T07:38:53.512 INFO:teuthology.orchestra.run.smithi049.stdout: "map_inc": 0, 2024-03-16T07:38:53.512 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_sessions": 0, 2024-03-16T07:38:53.512 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_session_open": 0, 2024-03-16T07:38:53.512 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_session_close": 0, 2024-03-16T07:38:53.512 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_laggy": 0, 2024-03-16T07:38:53.512 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_wr": 0, 2024-03-16T07:38:53.513 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_rd": 0, 2024-03-16T07:38:53.513 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_del": 0 2024-03-16T07:38:53.513 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:53.513 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:53.513 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:38:53.513 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-msgr_dispatch_throttler-client": [ 2024-03-16T07:38:53.513 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:38:53.513 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:38:53.513 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:38:53.513 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:38:53.513 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-03-16T07:38:53.513 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:38:53.513 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 124, 2024-03-16T07:38:53.513 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 490920, 2024-03-16T07:38:53.513 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:38:53.514 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 124, 2024-03-16T07:38:53.514 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:38:53.514 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:38:53.514 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 124, 2024-03-16T07:38:53.514 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 490920, 2024-03-16T07:38:53.514 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:38:53.514 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:38:53.514 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:38:53.514 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:38:53.514 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:53.514 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:53.514 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:53.514 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:38:53.514 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-msgr_dispatch_throttler-radosclient": [ 2024-03-16T07:38:53.515 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:38:53.515 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:38:53.515 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:38:53.515 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:38:53.515 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-03-16T07:38:53.515 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:38:53.515 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 92, 2024-03-16T07:38:53.515 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 3141221, 2024-03-16T07:38:53.515 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:38:53.515 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 92, 2024-03-16T07:38:53.515 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:38:53.515 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:38:53.515 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 92, 2024-03-16T07:38:53.515 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 3141221, 2024-03-16T07:38:53.515 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:38:53.515 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:38:53.516 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:38:53.516 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:38:53.516 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:53.516 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:53.516 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:53.516 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:38:53.516 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-objecter_bytes": [ 2024-03-16T07:38:53.516 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:38:53.516 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:38:53.516 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:38:53.516 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:38:53.516 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-03-16T07:38:53.516 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:38:53.516 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 0, 2024-03-16T07:38:53.516 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 0, 2024-03-16T07:38:53.516 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:38:53.517 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 0, 2024-03-16T07:38:53.517 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:38:53.517 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:38:53.517 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 0, 2024-03-16T07:38:53.517 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 0, 2024-03-16T07:38:53.517 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:38:53.517 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:38:53.517 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:38:53.517 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:38:53.517 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:53.517 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:53.517 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:53.517 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:38:53.517 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-objecter_ops": [ 2024-03-16T07:38:53.518 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:38:53.518 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:38:53.518 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:38:53.518 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:38:53.518 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 1024, 2024-03-16T07:38:53.518 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:38:53.518 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 0, 2024-03-16T07:38:53.518 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 0, 2024-03-16T07:38:53.518 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:38:53.518 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 0, 2024-03-16T07:38:53.518 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:38:53.518 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:38:53.518 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 0, 2024-03-16T07:38:53.518 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 0, 2024-03-16T07:38:53.518 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:38:53.519 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:38:53.519 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:38:53.519 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:38:53.519 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:53.519 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:53.519 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:53.519 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2024-03-16T07:38:53.519 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-03-16T07:38:53.520 DEBUG:tasks.cephfs.test_mirroring:command returned={ "AsyncMessenger::Worker": [ { "labels": { "id": "0" }, "counters": { "msgr_connection_ready_timeouts": 0, "msgr_connection_idle_timeouts": 0 } }, { "labels": { "id": "1" }, "counters": { "msgr_connection_ready_timeouts": 0, "msgr_connection_idle_timeouts": 0 } }, { "labels": { "id": "2" }, "counters": { "msgr_connection_ready_timeouts": 0, "msgr_connection_idle_timeouts": 0 } } ], "AsyncMessenger::Worker-0": [ { "labels": {}, "counters": { "msgr_recv_messages": 13, "msgr_send_messages": 173, "msgr_recv_bytes": 1872, "msgr_send_bytes": 1066992, "msgr_created_connections": 26, "msgr_active_connections": 5, "msgr_running_total_time": 2.038935273, "msgr_running_send_time": 0.702270275, "msgr_running_recv_time": 0.173849705, "msgr_running_fast_dispatch_time": 0.000000000, "msgr_send_messages_queue_lat": { "avgcount": 161, "sum": 2.556057352, "avgtime": 0.015876132 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "msgr_recv_encrypted_bytes": 1872, "msgr_send_encrypted_bytes": 1066992 } } ], "AsyncMessenger::Worker-1": [ { "labels": {}, "counters": { "msgr_recv_messages": 124, "msgr_send_messages": 10, "msgr_recv_bytes": 507744, "msgr_send_bytes": 2112, "msgr_created_connections": 4, "msgr_active_connections": 0, "msgr_running_total_time": 2.044325311, "msgr_running_send_time": 0.264026370, "msgr_running_recv_time": 1.156963787, "msgr_running_fast_dispatch_time": 0.194190800, "msgr_send_messages_queue_lat": { "avgcount": 9, "sum": 0.188856872, "avgtime": 0.020984096 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "msgr_recv_encrypted_bytes": 507744, "msgr_send_encrypted_bytes": 2112 } } ], "AsyncMessenger::Worker-2": [ { "labels": {}, "counters": { "msgr_recv_messages": 82, "msgr_send_messages": 13, "msgr_recv_bytes": 3152736, "msgr_send_bytes": 2576, "msgr_created_connections": 3, "msgr_active_connections": 1, "msgr_running_total_time": 4.888935958, "msgr_running_send_time": 0.598114497, "msgr_running_recv_time": 4.385401985, "msgr_running_fast_dispatch_time": 0.000000000, "msgr_send_messages_queue_lat": { "avgcount": 12, "sum": 0.346963753, "avgtime": 0.028913646 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "msgr_recv_encrypted_bytes": 3152736, "msgr_send_encrypted_bytes": 2576 } } ], "cct": [ { "labels": {}, "counters": { "total_workers": 0, "unhealthy_workers": 0 } } ], "cephfs_mirror": [ { "labels": {}, "counters": { "mirrored_filesystems": 2, "mirror_enable_failures": 0 } } ], "cephfs_mirror_mirrored_filesystems": [ { "labels": { "filesystem": "cephfs" }, "counters": { "mirroring_peers": 1, "directory_count": 0 } } ], "cephfs_mirror_peers": [ { "labels": { "peer_cluster_filesystem": "backup_fs", "peer_cluster_name": "ceph", "source_filesystem": "cephfs", "source_fscid": "14" }, "counters": { "snaps_synced": 0, "snaps_deleted": 0, "snaps_renamed": 0, "sync_failures": 6, "avg_sync_time": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "sync_bytes": 0 } } ], "mempool": [ { "labels": {}, "counters": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_cache_buffer_bytes": 0, "bluestore_cache_buffer_items": 0, "bluestore_extent_bytes": 0, "bluestore_extent_items": 0, "bluestore_blob_bytes": 0, "bluestore_blob_items": 0, "bluestore_shared_blob_bytes": 0, "bluestore_shared_blob_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_items": 0, "bluefs_bytes": 0, "bluefs_items": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "buffer_anon_bytes": 621022131, "buffer_anon_items": 220, "buffer_meta_bytes": 7040, "buffer_meta_items": 80, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 33848, "osdmap_items": 332, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "mds_co_bytes": 0, "mds_co_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 } } ], "objecter": [ { "labels": {}, "counters": { "op_active": 0, "op_laggy": 0, "op_send": 0, "op_send_bytes": 0, "op_resend": 0, "op_reply": 0, "op_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "op_inflight": 0, "oplen_avg": { "avgcount": 0, "sum": 0 }, "op": 0, "op_r": 0, "op_w": 0, "op_rmw": 0, "op_pg": 0, "osdop_stat": 0, "osdop_create": 0, "osdop_read": 0, "osdop_write": 0, "osdop_writefull": 0, "osdop_writesame": 0, "osdop_append": 0, "osdop_zero": 0, "osdop_truncate": 0, "osdop_delete": 0, "osdop_mapext": 0, "osdop_sparse_read": 0, "osdop_clonerange": 0, "osdop_getxattr": 0, "osdop_setxattr": 0, "osdop_cmpxattr": 0, "osdop_rmxattr": 0, "osdop_resetxattrs": 0, "osdop_call": 0, "osdop_watch": 0, "osdop_notify": 0, "osdop_src_cmpxattr": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_other": 0, "linger_active": 0, "linger_send": 0, "linger_resend": 0, "linger_ping": 0, "poolop_active": 0, "poolop_send": 0, "poolop_resend": 0, "poolstat_active": 0, "poolstat_send": 0, "poolstat_resend": 0, "statfs_active": 0, "statfs_send": 0, "statfs_resend": 0, "command_active": 0, "command_send": 0, "command_resend": 0, "map_epoch": 0, "map_full": 0, "map_inc": 0, "osd_sessions": 0, "osd_session_open": 0, "osd_session_close": 0, "osd_laggy": 0, "omap_wr": 0, "omap_rd": 0, "omap_del": 0 } } ], "throttle-msgr_dispatch_throttler-client": [ { "labels": {}, "counters": { "val": 0, "max": 104857600, "get_started": 0, "get": 124, "get_sum": 490920, "get_or_fail_fail": 0, "get_or_fail_success": 124, "take": 0, "take_sum": 0, "put": 124, "put_sum": 490920, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ], "throttle-msgr_dispatch_throttler-radosclient": [ { "labels": {}, "counters": { "val": 0, "max": 104857600, "get_started": 0, "get": 92, "get_sum": 3141221, "get_or_fail_fail": 0, "get_or_fail_success": 92, "take": 0, "take_sum": 0, "put": 92, "put_sum": 3141221, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ], "throttle-objecter_bytes": [ { "labels": {}, "counters": { "val": 0, "max": 104857600, "get_started": 0, "get": 0, "get_sum": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "take": 0, "take_sum": 0, "put": 0, "put_sum": 0, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ], "throttle-objecter_ops": [ { "labels": {}, "counters": { "val": 0, "max": 1024, "get_started": 0, "get": 0, "get_sum": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "take": 0, "take_sum": 0, "put": 0, "put_sum": 0, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ] } 2024-03-16T07:38:53.520 DEBUG:tasks.cephfs.test_mirroring:removing snapshots 2024-03-16T07:38:53.521 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:38:53.521 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir d0/.snap/snap0) 2024-03-16T07:38:53.540 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:38:53.540 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir d1/.snap/snap0) 2024-03-16T07:38:53.601 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:38:53.601 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir d2/.snap/snap0) 2024-03-16T07:38:53.660 DEBUG:tasks.cephfs.test_mirroring:deleting file.0 2024-03-16T07:38:53.660 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:38:53.660 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f d0/file.0) 2024-03-16T07:38:53.772 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:38:53.772 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f d1/file.0) 2024-03-16T07:38:53.846 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:38:53.846 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f d2/file.0) 2024-03-16T07:38:53.919 DEBUG:tasks.cephfs.test_mirroring:deleting file.1 2024-03-16T07:38:53.919 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:38:53.919 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f d0/file.1) 2024-03-16T07:38:53.993 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:38:53.993 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f d1/file.1) 2024-03-16T07:38:54.079 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:38:54.079 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f d2/file.1) 2024-03-16T07:38:54.200 DEBUG:tasks.cephfs.test_mirroring:deleting file.2 2024-03-16T07:38:54.200 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:38:54.201 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f d0/file.2) 2024-03-16T07:38:54.286 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:38:54.286 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f d1/file.2) 2024-03-16T07:38:54.358 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:38:54.358 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f d2/file.2) 2024-03-16T07:38:54.434 DEBUG:tasks.cephfs.test_mirroring:deleting file.3 2024-03-16T07:38:54.434 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:38:54.434 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f d0/file.3) 2024-03-16T07:38:54.558 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:38:54.558 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f d1/file.3) 2024-03-16T07:38:54.680 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:38:54.681 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f d2/file.3) 2024-03-16T07:38:54.753 DEBUG:tasks.cephfs.test_mirroring:creating new files... 2024-03-16T07:38:54.754 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-03-16T07:38:54.754 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-16T07:38:54.770 DEBUG:teuthology.orchestra.run.smithi049:> stdin-killer -- python3 -c ' 2024-03-16T07:38:54.770 DEBUG:teuthology.orchestra.run.smithi049:> import os 2024-03-16T07:38:54.770 DEBUG:teuthology.orchestra.run.smithi049:> import uuid 2024-03-16T07:38:54.770 DEBUG:teuthology.orchestra.run.smithi049:> 2024-03-16T07:38:54.770 DEBUG:teuthology.orchestra.run.smithi049:> n = 50 2024-03-16T07:38:54.770 DEBUG:teuthology.orchestra.run.smithi049:> create_hard_links = False 2024-03-16T07:38:54.770 DEBUG:teuthology.orchestra.run.smithi049:> if 0 > 0: 2024-03-16T07:38:54.770 DEBUG:teuthology.orchestra.run.smithi049:> create_hard_links = True 2024-03-16T07:38:54.770 DEBUG:teuthology.orchestra.run.smithi049:> path = "/home/ubuntu/cephtest/mnt.0/d0/file" 2024-03-16T07:38:54.770 DEBUG:teuthology.orchestra.run.smithi049:> 2024-03-16T07:38:54.770 DEBUG:teuthology.orchestra.run.smithi049:> dpath = os.path.dirname(path) 2024-03-16T07:38:54.770 DEBUG:teuthology.orchestra.run.smithi049:> fnameprefix = os.path.basename(path) 2024-03-16T07:38:54.770 DEBUG:teuthology.orchestra.run.smithi049:> os.makedirs(dpath, exist_ok=True) 2024-03-16T07:38:54.770 DEBUG:teuthology.orchestra.run.smithi049:> 2024-03-16T07:38:54.771 DEBUG:teuthology.orchestra.run.smithi049:> try: 2024-03-16T07:38:54.771 DEBUG:teuthology.orchestra.run.smithi049:> dirfd = os.open(dpath, os.O_DIRECTORY) 2024-03-16T07:38:54.771 DEBUG:teuthology.orchestra.run.smithi049:> 2024-03-16T07:38:54.771 DEBUG:teuthology.orchestra.run.smithi049:> for i in range(n): 2024-03-16T07:38:54.771 DEBUG:teuthology.orchestra.run.smithi049:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2024-03-16T07:38:54.771 DEBUG:teuthology.orchestra.run.smithi049:> with open(fpath, '"'"'w'"'"') as f: 2024-03-16T07:38:54.771 DEBUG:teuthology.orchestra.run.smithi049:> f.write(f"{i}") 2024-03-16T07:38:54.771 DEBUG:teuthology.orchestra.run.smithi049:> if True: 2024-03-16T07:38:54.771 DEBUG:teuthology.orchestra.run.smithi049:> f.flush() 2024-03-16T07:38:54.771 DEBUG:teuthology.orchestra.run.smithi049:> os.fsync(f.fileno()) 2024-03-16T07:38:54.771 DEBUG:teuthology.orchestra.run.smithi049:> if False: 2024-03-16T07:38:54.771 DEBUG:teuthology.orchestra.run.smithi049:> os.unlink(fpath) 2024-03-16T07:38:54.771 DEBUG:teuthology.orchestra.run.smithi049:> if False: 2024-03-16T07:38:54.771 DEBUG:teuthology.orchestra.run.smithi049:> os.fsync(dirfd) 2024-03-16T07:38:54.771 DEBUG:teuthology.orchestra.run.smithi049:> if create_hard_links: 2024-03-16T07:38:54.771 DEBUG:teuthology.orchestra.run.smithi049:> for j in range(0): 2024-03-16T07:38:54.771 DEBUG:teuthology.orchestra.run.smithi049:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2024-03-16T07:38:54.772 DEBUG:teuthology.orchestra.run.smithi049:> if False: 2024-03-16T07:38:54.772 DEBUG:teuthology.orchestra.run.smithi049:> os.fsync(dirfd) 2024-03-16T07:38:54.772 DEBUG:teuthology.orchestra.run.smithi049:> finally: 2024-03-16T07:38:54.772 DEBUG:teuthology.orchestra.run.smithi049:> os.close(dirfd) 2024-03-16T07:38:54.772 DEBUG:teuthology.orchestra.run.smithi049:> ' 2024-03-16T07:38:55.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-16T07:38:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-16T07:38:55.038 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-03-16T07:38:55.039 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-16T07:38:55.098 DEBUG:teuthology.orchestra.run.smithi049:> stdin-killer -- python3 -c ' 2024-03-16T07:38:55.098 DEBUG:teuthology.orchestra.run.smithi049:> import os 2024-03-16T07:38:55.098 DEBUG:teuthology.orchestra.run.smithi049:> import uuid 2024-03-16T07:38:55.098 DEBUG:teuthology.orchestra.run.smithi049:> 2024-03-16T07:38:55.098 DEBUG:teuthology.orchestra.run.smithi049:> n = 50 2024-03-16T07:38:55.098 DEBUG:teuthology.orchestra.run.smithi049:> create_hard_links = False 2024-03-16T07:38:55.098 DEBUG:teuthology.orchestra.run.smithi049:> if 0 > 0: 2024-03-16T07:38:55.099 DEBUG:teuthology.orchestra.run.smithi049:> create_hard_links = True 2024-03-16T07:38:55.099 DEBUG:teuthology.orchestra.run.smithi049:> path = "/home/ubuntu/cephtest/mnt.0/d1/file" 2024-03-16T07:38:55.099 DEBUG:teuthology.orchestra.run.smithi049:> 2024-03-16T07:38:55.099 DEBUG:teuthology.orchestra.run.smithi049:> dpath = os.path.dirname(path) 2024-03-16T07:38:55.099 DEBUG:teuthology.orchestra.run.smithi049:> fnameprefix = os.path.basename(path) 2024-03-16T07:38:55.099 DEBUG:teuthology.orchestra.run.smithi049:> os.makedirs(dpath, exist_ok=True) 2024-03-16T07:38:55.099 DEBUG:teuthology.orchestra.run.smithi049:> 2024-03-16T07:38:55.099 DEBUG:teuthology.orchestra.run.smithi049:> try: 2024-03-16T07:38:55.099 DEBUG:teuthology.orchestra.run.smithi049:> dirfd = os.open(dpath, os.O_DIRECTORY) 2024-03-16T07:38:55.099 DEBUG:teuthology.orchestra.run.smithi049:> 2024-03-16T07:38:55.099 DEBUG:teuthology.orchestra.run.smithi049:> for i in range(n): 2024-03-16T07:38:55.100 DEBUG:teuthology.orchestra.run.smithi049:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2024-03-16T07:38:55.100 DEBUG:teuthology.orchestra.run.smithi049:> with open(fpath, '"'"'w'"'"') as f: 2024-03-16T07:38:55.100 DEBUG:teuthology.orchestra.run.smithi049:> f.write(f"{i}") 2024-03-16T07:38:55.100 DEBUG:teuthology.orchestra.run.smithi049:> if True: 2024-03-16T07:38:55.100 DEBUG:teuthology.orchestra.run.smithi049:> f.flush() 2024-03-16T07:38:55.100 DEBUG:teuthology.orchestra.run.smithi049:> os.fsync(f.fileno()) 2024-03-16T07:38:55.100 DEBUG:teuthology.orchestra.run.smithi049:> if False: 2024-03-16T07:38:55.100 DEBUG:teuthology.orchestra.run.smithi049:> os.unlink(fpath) 2024-03-16T07:38:55.100 DEBUG:teuthology.orchestra.run.smithi049:> if False: 2024-03-16T07:38:55.101 DEBUG:teuthology.orchestra.run.smithi049:> os.fsync(dirfd) 2024-03-16T07:38:55.101 DEBUG:teuthology.orchestra.run.smithi049:> if create_hard_links: 2024-03-16T07:38:55.101 DEBUG:teuthology.orchestra.run.smithi049:> for j in range(0): 2024-03-16T07:38:55.101 DEBUG:teuthology.orchestra.run.smithi049:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2024-03-16T07:38:55.101 DEBUG:teuthology.orchestra.run.smithi049:> if False: 2024-03-16T07:38:55.101 DEBUG:teuthology.orchestra.run.smithi049:> os.fsync(dirfd) 2024-03-16T07:38:55.101 DEBUG:teuthology.orchestra.run.smithi049:> finally: 2024-03-16T07:38:55.101 DEBUG:teuthology.orchestra.run.smithi049:> os.close(dirfd) 2024-03-16T07:38:55.101 DEBUG:teuthology.orchestra.run.smithi049:> ' 2024-03-16T07:38:55.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-16T07:38:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-16T07:38:55.430 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-03-16T07:38:55.430 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-16T07:38:55.486 DEBUG:teuthology.orchestra.run.smithi049:> stdin-killer -- python3 -c ' 2024-03-16T07:38:55.486 DEBUG:teuthology.orchestra.run.smithi049:> import os 2024-03-16T07:38:55.486 DEBUG:teuthology.orchestra.run.smithi049:> import uuid 2024-03-16T07:38:55.486 DEBUG:teuthology.orchestra.run.smithi049:> 2024-03-16T07:38:55.486 DEBUG:teuthology.orchestra.run.smithi049:> n = 50 2024-03-16T07:38:55.486 DEBUG:teuthology.orchestra.run.smithi049:> create_hard_links = False 2024-03-16T07:38:55.486 DEBUG:teuthology.orchestra.run.smithi049:> if 0 > 0: 2024-03-16T07:38:55.486 DEBUG:teuthology.orchestra.run.smithi049:> create_hard_links = True 2024-03-16T07:38:55.486 DEBUG:teuthology.orchestra.run.smithi049:> path = "/home/ubuntu/cephtest/mnt.0/d2/file" 2024-03-16T07:38:55.486 DEBUG:teuthology.orchestra.run.smithi049:> 2024-03-16T07:38:55.486 DEBUG:teuthology.orchestra.run.smithi049:> dpath = os.path.dirname(path) 2024-03-16T07:38:55.486 DEBUG:teuthology.orchestra.run.smithi049:> fnameprefix = os.path.basename(path) 2024-03-16T07:38:55.486 DEBUG:teuthology.orchestra.run.smithi049:> os.makedirs(dpath, exist_ok=True) 2024-03-16T07:38:55.486 DEBUG:teuthology.orchestra.run.smithi049:> 2024-03-16T07:38:55.487 DEBUG:teuthology.orchestra.run.smithi049:> try: 2024-03-16T07:38:55.487 DEBUG:teuthology.orchestra.run.smithi049:> dirfd = os.open(dpath, os.O_DIRECTORY) 2024-03-16T07:38:55.487 DEBUG:teuthology.orchestra.run.smithi049:> 2024-03-16T07:38:55.487 DEBUG:teuthology.orchestra.run.smithi049:> for i in range(n): 2024-03-16T07:38:55.487 DEBUG:teuthology.orchestra.run.smithi049:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2024-03-16T07:38:55.487 DEBUG:teuthology.orchestra.run.smithi049:> with open(fpath, '"'"'w'"'"') as f: 2024-03-16T07:38:55.487 DEBUG:teuthology.orchestra.run.smithi049:> f.write(f"{i}") 2024-03-16T07:38:55.487 DEBUG:teuthology.orchestra.run.smithi049:> if True: 2024-03-16T07:38:55.487 DEBUG:teuthology.orchestra.run.smithi049:> f.flush() 2024-03-16T07:38:55.487 DEBUG:teuthology.orchestra.run.smithi049:> os.fsync(f.fileno()) 2024-03-16T07:38:55.487 DEBUG:teuthology.orchestra.run.smithi049:> if False: 2024-03-16T07:38:55.487 DEBUG:teuthology.orchestra.run.smithi049:> os.unlink(fpath) 2024-03-16T07:38:55.487 DEBUG:teuthology.orchestra.run.smithi049:> if False: 2024-03-16T07:38:55.487 DEBUG:teuthology.orchestra.run.smithi049:> os.fsync(dirfd) 2024-03-16T07:38:55.487 DEBUG:teuthology.orchestra.run.smithi049:> if create_hard_links: 2024-03-16T07:38:55.487 DEBUG:teuthology.orchestra.run.smithi049:> for j in range(0): 2024-03-16T07:38:55.487 DEBUG:teuthology.orchestra.run.smithi049:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2024-03-16T07:38:55.487 DEBUG:teuthology.orchestra.run.smithi049:> if False: 2024-03-16T07:38:55.488 DEBUG:teuthology.orchestra.run.smithi049:> os.fsync(dirfd) 2024-03-16T07:38:55.488 DEBUG:teuthology.orchestra.run.smithi049:> finally: 2024-03-16T07:38:55.488 DEBUG:teuthology.orchestra.run.smithi049:> os.close(dirfd) 2024-03-16T07:38:55.488 DEBUG:teuthology.orchestra.run.smithi049:> ' 2024-03-16T07:38:55.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-03-16T07:38:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-16T07:38:55.757 DEBUG:tasks.cephfs.test_mirroring:adding directory paths 2024-03-16T07:38:55.757 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-03-16T07:38:55.758 DEBUG:teuthology.orchestra.run.smithi049:counter dump for fs: cephfs> ceph --admin-daemon /var/run/ceph/cephfs-mirror.asok counter dump 2024-03-16T07:38:55.973 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-03-16T07:38:55.973 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker": [ 2024-03-16T07:38:55.973 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:38:55.973 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:38:55.973 INFO:teuthology.orchestra.run.smithi049.stdout: "id": "0" 2024-03-16T07:38:55.973 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:38:55.973 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:38:55.974 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_ready_timeouts": 0, 2024-03-16T07:38:55.974 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_idle_timeouts": 0 2024-03-16T07:38:55.974 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:55.974 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:38:55.974 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:38:55.974 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:38:55.974 INFO:teuthology.orchestra.run.smithi049.stdout: "id": "1" 2024-03-16T07:38:55.974 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:38:55.974 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:38:55.974 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_ready_timeouts": 0, 2024-03-16T07:38:55.974 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_idle_timeouts": 0 2024-03-16T07:38:55.974 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:55.974 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:38:55.974 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:38:55.975 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:38:55.975 INFO:teuthology.orchestra.run.smithi049.stdout: "id": "2" 2024-03-16T07:38:55.975 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:38:55.975 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:38:55.975 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_ready_timeouts": 0, 2024-03-16T07:38:55.975 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_idle_timeouts": 0 2024-03-16T07:38:55.975 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:55.975 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:55.975 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:38:55.975 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-0": [ 2024-03-16T07:38:55.975 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:38:55.975 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:38:55.975 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:38:55.975 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 13, 2024-03-16T07:38:55.976 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 173, 2024-03-16T07:38:55.976 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 1872, 2024-03-16T07:38:55.976 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 1066992, 2024-03-16T07:38:55.976 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 26, 2024-03-16T07:38:55.976 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 5, 2024-03-16T07:38:55.976 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 2.038935273, 2024-03-16T07:38:55.976 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.702270275, 2024-03-16T07:38:55.976 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 0.173849705, 2024-03-16T07:38:55.976 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-03-16T07:38:55.976 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T07:38:55.976 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 161, 2024-03-16T07:38:55.976 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 2.556057352, 2024-03-16T07:38:55.976 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.015876132 2024-03-16T07:38:55.976 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:38:55.976 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-03-16T07:38:55.977 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:38:55.977 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:38:55.977 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:38:55.977 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:38:55.977 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 1872, 2024-03-16T07:38:55.977 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 1066992 2024-03-16T07:38:55.977 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:55.977 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:55.977 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:38:55.977 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-1": [ 2024-03-16T07:38:55.977 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:38:55.977 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:38:55.977 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:38:55.977 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 124, 2024-03-16T07:38:55.977 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 10, 2024-03-16T07:38:55.978 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 507744, 2024-03-16T07:38:55.978 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 2112, 2024-03-16T07:38:55.978 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 4, 2024-03-16T07:38:55.978 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 0, 2024-03-16T07:38:55.978 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 2.044325311, 2024-03-16T07:38:55.978 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.264026370, 2024-03-16T07:38:55.978 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 1.156963787, 2024-03-16T07:38:55.978 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.194190800, 2024-03-16T07:38:55.978 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T07:38:55.978 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 9, 2024-03-16T07:38:55.978 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.188856872, 2024-03-16T07:38:55.978 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.020984096 2024-03-16T07:38:55.978 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:38:55.979 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-03-16T07:38:55.979 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:38:55.979 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:38:55.979 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:38:55.979 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:38:55.979 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 507744, 2024-03-16T07:38:55.979 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 2112 2024-03-16T07:38:55.979 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:55.979 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:55.979 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:38:55.979 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-2": [ 2024-03-16T07:38:55.979 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:38:55.979 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:38:55.979 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:38:55.979 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 82, 2024-03-16T07:38:55.979 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 13, 2024-03-16T07:38:55.980 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 3152736, 2024-03-16T07:38:55.980 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 2576, 2024-03-16T07:38:55.980 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 3, 2024-03-16T07:38:55.980 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 1, 2024-03-16T07:38:55.980 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 4.889598933, 2024-03-16T07:38:55.980 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.598187261, 2024-03-16T07:38:55.980 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 4.385640920, 2024-03-16T07:38:55.980 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-03-16T07:38:55.980 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T07:38:55.980 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 12, 2024-03-16T07:38:55.980 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.346963753, 2024-03-16T07:38:55.980 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.028913646 2024-03-16T07:38:55.980 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:38:55.980 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-03-16T07:38:55.980 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:38:55.981 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:38:55.981 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:38:55.981 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:38:55.981 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 3152736, 2024-03-16T07:38:55.981 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 2576 2024-03-16T07:38:55.981 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:55.981 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:55.981 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:38:55.981 INFO:teuthology.orchestra.run.smithi049.stdout: "cct": [ 2024-03-16T07:38:55.981 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:38:55.981 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:38:55.981 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:38:55.981 INFO:teuthology.orchestra.run.smithi049.stdout: "total_workers": 0, 2024-03-16T07:38:55.981 INFO:teuthology.orchestra.run.smithi049.stdout: "unhealthy_workers": 0 2024-03-16T07:38:55.981 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:55.982 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:55.982 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:38:55.982 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs_mirror": [ 2024-03-16T07:38:55.982 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:38:55.982 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:38:55.982 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:38:55.982 INFO:teuthology.orchestra.run.smithi049.stdout: "mirrored_filesystems": 2, 2024-03-16T07:38:55.982 INFO:teuthology.orchestra.run.smithi049.stdout: "mirror_enable_failures": 0 2024-03-16T07:38:55.982 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:55.982 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:55.982 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:38:55.982 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs_mirror_mirrored_filesystems": [ 2024-03-16T07:38:55.982 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:38:55.982 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:38:55.983 INFO:teuthology.orchestra.run.smithi049.stdout: "filesystem": "cephfs" 2024-03-16T07:38:55.983 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:38:55.983 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:38:55.983 INFO:teuthology.orchestra.run.smithi049.stdout: "mirroring_peers": 1, 2024-03-16T07:38:55.983 INFO:teuthology.orchestra.run.smithi049.stdout: "directory_count": 0 2024-03-16T07:38:55.983 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:55.983 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:55.983 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:38:55.983 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs_mirror_peers": [ 2024-03-16T07:38:55.983 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:38:55.983 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:38:55.983 INFO:teuthology.orchestra.run.smithi049.stdout: "peer_cluster_filesystem": "backup_fs", 2024-03-16T07:38:55.983 INFO:teuthology.orchestra.run.smithi049.stdout: "peer_cluster_name": "ceph", 2024-03-16T07:38:55.983 INFO:teuthology.orchestra.run.smithi049.stdout: "source_filesystem": "cephfs", 2024-03-16T07:38:55.983 INFO:teuthology.orchestra.run.smithi049.stdout: "source_fscid": "14" 2024-03-16T07:38:55.984 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:38:55.984 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:38:55.984 INFO:teuthology.orchestra.run.smithi049.stdout: "snaps_synced": 0, 2024-03-16T07:38:55.984 INFO:teuthology.orchestra.run.smithi049.stdout: "snaps_deleted": 0, 2024-03-16T07:38:55.984 INFO:teuthology.orchestra.run.smithi049.stdout: "snaps_renamed": 0, 2024-03-16T07:38:55.984 INFO:teuthology.orchestra.run.smithi049.stdout: "sync_failures": 6, 2024-03-16T07:38:55.984 INFO:teuthology.orchestra.run.smithi049.stdout: "avg_sync_time": { 2024-03-16T07:38:55.984 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:38:55.984 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:38:55.984 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:38:55.984 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:38:55.984 INFO:teuthology.orchestra.run.smithi049.stdout: "sync_bytes": 0 2024-03-16T07:38:55.984 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:55.984 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:55.984 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:38:55.984 INFO:teuthology.orchestra.run.smithi049.stdout: "mempool": [ 2024-03-16T07:38:55.985 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:38:55.985 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:38:55.985 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:38:55.985 INFO:teuthology.orchestra.run.smithi049.stdout: "bloom_filter_bytes": 0, 2024-03-16T07:38:55.985 INFO:teuthology.orchestra.run.smithi049.stdout: "bloom_filter_items": 0, 2024-03-16T07:38:55.985 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_alloc_bytes": 0, 2024-03-16T07:38:55.985 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_alloc_items": 0, 2024-03-16T07:38:55.985 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_data_bytes": 0, 2024-03-16T07:38:55.985 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_data_items": 0, 2024-03-16T07:38:55.985 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_onode_bytes": 0, 2024-03-16T07:38:55.985 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_onode_items": 0, 2024-03-16T07:38:55.985 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_meta_bytes": 0, 2024-03-16T07:38:55.985 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_meta_items": 0, 2024-03-16T07:38:55.985 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_other_bytes": 0, 2024-03-16T07:38:55.985 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_other_items": 0, 2024-03-16T07:38:55.986 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_buffer_bytes": 0, 2024-03-16T07:38:55.986 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_buffer_items": 0, 2024-03-16T07:38:55.986 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_extent_bytes": 0, 2024-03-16T07:38:55.986 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_extent_items": 0, 2024-03-16T07:38:55.986 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_blob_bytes": 0, 2024-03-16T07:38:55.986 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_blob_items": 0, 2024-03-16T07:38:55.986 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_shared_blob_bytes": 0, 2024-03-16T07:38:55.986 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_shared_blob_items": 0, 2024-03-16T07:38:55.986 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_inline_bl_bytes": 0, 2024-03-16T07:38:55.986 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_inline_bl_items": 0, 2024-03-16T07:38:55.986 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_fsck_bytes": 0, 2024-03-16T07:38:55.986 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_fsck_items": 0, 2024-03-16T07:38:55.986 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_txc_bytes": 0, 2024-03-16T07:38:55.986 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_txc_items": 0, 2024-03-16T07:38:55.986 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_deferred_bytes": 0, 2024-03-16T07:38:55.987 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_deferred_items": 0, 2024-03-16T07:38:55.987 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_bytes": 0, 2024-03-16T07:38:55.987 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_items": 0, 2024-03-16T07:38:55.987 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_bytes": 0, 2024-03-16T07:38:55.987 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_items": 0, 2024-03-16T07:38:55.987 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_reader_bytes": 0, 2024-03-16T07:38:55.987 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_reader_items": 0, 2024-03-16T07:38:55.987 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_writer_bytes": 0, 2024-03-16T07:38:55.987 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_writer_items": 0, 2024-03-16T07:38:55.987 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_anon_bytes": 621022131, 2024-03-16T07:38:55.987 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_anon_items": 220, 2024-03-16T07:38:55.987 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_meta_bytes": 7040, 2024-03-16T07:38:55.987 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_meta_items": 80, 2024-03-16T07:38:55.987 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_bytes": 0, 2024-03-16T07:38:55.987 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_items": 0, 2024-03-16T07:38:55.988 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_mapbl_bytes": 0, 2024-03-16T07:38:55.988 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_mapbl_items": 0, 2024-03-16T07:38:55.988 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pglog_bytes": 0, 2024-03-16T07:38:55.988 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pglog_items": 0, 2024-03-16T07:38:55.988 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_bytes": 33848, 2024-03-16T07:38:55.988 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_items": 332, 2024-03-16T07:38:55.988 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_mapping_bytes": 0, 2024-03-16T07:38:55.988 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_mapping_items": 0, 2024-03-16T07:38:55.988 INFO:teuthology.orchestra.run.smithi049.stdout: "pgmap_bytes": 0, 2024-03-16T07:38:55.988 INFO:teuthology.orchestra.run.smithi049.stdout: "pgmap_items": 0, 2024-03-16T07:38:55.988 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_co_bytes": 0, 2024-03-16T07:38:55.988 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_co_items": 0, 2024-03-16T07:38:55.988 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_1_bytes": 0, 2024-03-16T07:38:55.988 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_1_items": 0, 2024-03-16T07:38:55.988 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_2_bytes": 0, 2024-03-16T07:38:55.989 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_2_items": 0 2024-03-16T07:38:55.989 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:55.989 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:55.989 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:38:55.989 INFO:teuthology.orchestra.run.smithi049.stdout: "objecter": [ 2024-03-16T07:38:55.989 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:38:55.989 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:38:55.989 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:38:55.989 INFO:teuthology.orchestra.run.smithi049.stdout: "op_active": 0, 2024-03-16T07:38:55.990 INFO:teuthology.orchestra.run.smithi049.stdout: "op_laggy": 0, 2024-03-16T07:38:55.990 INFO:teuthology.orchestra.run.smithi049.stdout: "op_send": 0, 2024-03-16T07:38:55.990 INFO:teuthology.orchestra.run.smithi049.stdout: "op_send_bytes": 0, 2024-03-16T07:38:55.990 INFO:teuthology.orchestra.run.smithi049.stdout: "op_resend": 0, 2024-03-16T07:38:55.990 INFO:teuthology.orchestra.run.smithi049.stdout: "op_reply": 0, 2024-03-16T07:38:55.990 INFO:teuthology.orchestra.run.smithi049.stdout: "op_latency": { 2024-03-16T07:38:55.990 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:38:55.990 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:38:55.990 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:38:55.990 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:38:55.990 INFO:teuthology.orchestra.run.smithi049.stdout: "op_inflight": 0, 2024-03-16T07:38:55.990 INFO:teuthology.orchestra.run.smithi049.stdout: "oplen_avg": { 2024-03-16T07:38:55.990 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:38:55.991 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0 2024-03-16T07:38:55.991 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:38:55.991 INFO:teuthology.orchestra.run.smithi049.stdout: "op": 0, 2024-03-16T07:38:55.991 INFO:teuthology.orchestra.run.smithi049.stdout: "op_r": 0, 2024-03-16T07:38:55.991 INFO:teuthology.orchestra.run.smithi049.stdout: "op_w": 0, 2024-03-16T07:38:55.991 INFO:teuthology.orchestra.run.smithi049.stdout: "op_rmw": 0, 2024-03-16T07:38:55.991 INFO:teuthology.orchestra.run.smithi049.stdout: "op_pg": 0, 2024-03-16T07:38:55.991 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_stat": 0, 2024-03-16T07:38:55.991 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_create": 0, 2024-03-16T07:38:55.991 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_read": 0, 2024-03-16T07:38:55.991 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_write": 0, 2024-03-16T07:38:55.991 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_writefull": 0, 2024-03-16T07:38:55.991 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_writesame": 0, 2024-03-16T07:38:55.991 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_append": 0, 2024-03-16T07:38:55.991 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_zero": 0, 2024-03-16T07:38:55.991 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_truncate": 0, 2024-03-16T07:38:55.991 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_delete": 0, 2024-03-16T07:38:55.992 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_mapext": 0, 2024-03-16T07:38:55.992 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_sparse_read": 0, 2024-03-16T07:38:55.992 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_clonerange": 0, 2024-03-16T07:38:55.992 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_getxattr": 0, 2024-03-16T07:38:55.992 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_setxattr": 0, 2024-03-16T07:38:55.992 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_cmpxattr": 0, 2024-03-16T07:38:55.992 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_rmxattr": 0, 2024-03-16T07:38:55.992 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_resetxattrs": 0, 2024-03-16T07:38:55.992 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_call": 0, 2024-03-16T07:38:55.992 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_watch": 0, 2024-03-16T07:38:55.992 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_notify": 0, 2024-03-16T07:38:55.992 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_src_cmpxattr": 0, 2024-03-16T07:38:55.992 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_pgls": 0, 2024-03-16T07:38:55.992 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_pgls_filter": 0, 2024-03-16T07:38:55.992 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_other": 0, 2024-03-16T07:38:55.992 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_active": 0, 2024-03-16T07:38:55.993 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_send": 0, 2024-03-16T07:38:55.993 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_resend": 0, 2024-03-16T07:38:55.993 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_ping": 0, 2024-03-16T07:38:55.993 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_active": 0, 2024-03-16T07:38:55.993 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_send": 0, 2024-03-16T07:38:55.993 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_resend": 0, 2024-03-16T07:38:55.993 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_active": 0, 2024-03-16T07:38:55.993 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_send": 0, 2024-03-16T07:38:55.993 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_resend": 0, 2024-03-16T07:38:55.993 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_active": 0, 2024-03-16T07:38:55.993 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_send": 0, 2024-03-16T07:38:55.993 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_resend": 0, 2024-03-16T07:38:55.993 INFO:teuthology.orchestra.run.smithi049.stdout: "command_active": 0, 2024-03-16T07:38:55.993 INFO:teuthology.orchestra.run.smithi049.stdout: "command_send": 0, 2024-03-16T07:38:55.993 INFO:teuthology.orchestra.run.smithi049.stdout: "command_resend": 0, 2024-03-16T07:38:55.993 INFO:teuthology.orchestra.run.smithi049.stdout: "map_epoch": 0, 2024-03-16T07:38:55.994 INFO:teuthology.orchestra.run.smithi049.stdout: "map_full": 0, 2024-03-16T07:38:55.994 INFO:teuthology.orchestra.run.smithi049.stdout: "map_inc": 0, 2024-03-16T07:38:55.994 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_sessions": 0, 2024-03-16T07:38:55.994 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_session_open": 0, 2024-03-16T07:38:55.994 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_session_close": 0, 2024-03-16T07:38:55.994 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_laggy": 0, 2024-03-16T07:38:55.994 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_wr": 0, 2024-03-16T07:38:55.994 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_rd": 0, 2024-03-16T07:38:55.994 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_del": 0 2024-03-16T07:38:55.994 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:55.994 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:55.994 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:38:55.994 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-msgr_dispatch_throttler-client": [ 2024-03-16T07:38:55.994 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:38:55.995 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:38:55.995 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:38:55.995 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:38:55.995 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-03-16T07:38:55.995 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:38:55.995 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 124, 2024-03-16T07:38:55.995 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 490920, 2024-03-16T07:38:55.995 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:38:55.995 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 124, 2024-03-16T07:38:55.995 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:38:55.995 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:38:55.995 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 124, 2024-03-16T07:38:55.995 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 490920, 2024-03-16T07:38:55.995 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:38:55.995 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:38:55.996 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:38:55.996 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:38:55.996 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:55.996 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:55.996 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:55.996 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:38:55.996 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-msgr_dispatch_throttler-radosclient": [ 2024-03-16T07:38:55.996 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:38:55.996 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:38:55.996 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:38:55.996 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:38:55.996 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-03-16T07:38:55.996 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:38:55.996 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 92, 2024-03-16T07:38:55.996 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 3141221, 2024-03-16T07:38:55.997 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:38:55.997 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 92, 2024-03-16T07:38:55.997 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:38:55.997 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:38:55.997 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 92, 2024-03-16T07:38:55.997 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 3141221, 2024-03-16T07:38:55.997 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:38:55.997 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:38:55.997 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:38:55.997 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:38:55.997 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:55.997 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:55.997 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:55.997 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:38:55.997 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-objecter_bytes": [ 2024-03-16T07:38:55.998 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:38:55.998 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:38:55.998 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:38:55.998 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:38:55.998 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-03-16T07:38:55.998 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:38:55.998 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 0, 2024-03-16T07:38:55.998 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 0, 2024-03-16T07:38:55.998 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:38:55.998 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 0, 2024-03-16T07:38:55.998 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:38:55.998 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:38:55.998 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 0, 2024-03-16T07:38:55.998 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 0, 2024-03-16T07:38:55.999 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:38:55.999 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:38:55.999 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:38:55.999 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:38:55.999 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:55.999 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:55.999 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:55.999 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:38:55.999 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-objecter_ops": [ 2024-03-16T07:38:55.999 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:38:55.999 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:38:55.999 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:38:55.999 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:38:55.999 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 1024, 2024-03-16T07:38:56.000 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:38:56.000 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 0, 2024-03-16T07:38:56.000 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 0, 2024-03-16T07:38:56.000 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:38:56.000 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 0, 2024-03-16T07:38:56.000 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:38:56.000 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:38:56.000 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 0, 2024-03-16T07:38:56.000 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 0, 2024-03-16T07:38:56.000 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:38:56.000 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:38:56.000 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:38:56.000 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:38:56.000 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:56.000 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:56.001 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:56.001 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2024-03-16T07:38:56.001 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-03-16T07:38:56.002 DEBUG:tasks.cephfs.test_mirroring:command returned={ "AsyncMessenger::Worker": [ { "labels": { "id": "0" }, "counters": { "msgr_connection_ready_timeouts": 0, "msgr_connection_idle_timeouts": 0 } }, { "labels": { "id": "1" }, "counters": { "msgr_connection_ready_timeouts": 0, "msgr_connection_idle_timeouts": 0 } }, { "labels": { "id": "2" }, "counters": { "msgr_connection_ready_timeouts": 0, "msgr_connection_idle_timeouts": 0 } } ], "AsyncMessenger::Worker-0": [ { "labels": {}, "counters": { "msgr_recv_messages": 13, "msgr_send_messages": 173, "msgr_recv_bytes": 1872, "msgr_send_bytes": 1066992, "msgr_created_connections": 26, "msgr_active_connections": 5, "msgr_running_total_time": 2.038935273, "msgr_running_send_time": 0.702270275, "msgr_running_recv_time": 0.173849705, "msgr_running_fast_dispatch_time": 0.000000000, "msgr_send_messages_queue_lat": { "avgcount": 161, "sum": 2.556057352, "avgtime": 0.015876132 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "msgr_recv_encrypted_bytes": 1872, "msgr_send_encrypted_bytes": 1066992 } } ], "AsyncMessenger::Worker-1": [ { "labels": {}, "counters": { "msgr_recv_messages": 124, "msgr_send_messages": 10, "msgr_recv_bytes": 507744, "msgr_send_bytes": 2112, "msgr_created_connections": 4, "msgr_active_connections": 0, "msgr_running_total_time": 2.044325311, "msgr_running_send_time": 0.264026370, "msgr_running_recv_time": 1.156963787, "msgr_running_fast_dispatch_time": 0.194190800, "msgr_send_messages_queue_lat": { "avgcount": 9, "sum": 0.188856872, "avgtime": 0.020984096 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "msgr_recv_encrypted_bytes": 507744, "msgr_send_encrypted_bytes": 2112 } } ], "AsyncMessenger::Worker-2": [ { "labels": {}, "counters": { "msgr_recv_messages": 82, "msgr_send_messages": 13, "msgr_recv_bytes": 3152736, "msgr_send_bytes": 2576, "msgr_created_connections": 3, "msgr_active_connections": 1, "msgr_running_total_time": 4.889598933, "msgr_running_send_time": 0.598187261, "msgr_running_recv_time": 4.385640920, "msgr_running_fast_dispatch_time": 0.000000000, "msgr_send_messages_queue_lat": { "avgcount": 12, "sum": 0.346963753, "avgtime": 0.028913646 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "msgr_recv_encrypted_bytes": 3152736, "msgr_send_encrypted_bytes": 2576 } } ], "cct": [ { "labels": {}, "counters": { "total_workers": 0, "unhealthy_workers": 0 } } ], "cephfs_mirror": [ { "labels": {}, "counters": { "mirrored_filesystems": 2, "mirror_enable_failures": 0 } } ], "cephfs_mirror_mirrored_filesystems": [ { "labels": { "filesystem": "cephfs" }, "counters": { "mirroring_peers": 1, "directory_count": 0 } } ], "cephfs_mirror_peers": [ { "labels": { "peer_cluster_filesystem": "backup_fs", "peer_cluster_name": "ceph", "source_filesystem": "cephfs", "source_fscid": "14" }, "counters": { "snaps_synced": 0, "snaps_deleted": 0, "snaps_renamed": 0, "sync_failures": 6, "avg_sync_time": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "sync_bytes": 0 } } ], "mempool": [ { "labels": {}, "counters": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_cache_buffer_bytes": 0, "bluestore_cache_buffer_items": 0, "bluestore_extent_bytes": 0, "bluestore_extent_items": 0, "bluestore_blob_bytes": 0, "bluestore_blob_items": 0, "bluestore_shared_blob_bytes": 0, "bluestore_shared_blob_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_items": 0, "bluefs_bytes": 0, "bluefs_items": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "buffer_anon_bytes": 621022131, "buffer_anon_items": 220, "buffer_meta_bytes": 7040, "buffer_meta_items": 80, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 33848, "osdmap_items": 332, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "mds_co_bytes": 0, "mds_co_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 } } ], "objecter": [ { "labels": {}, "counters": { "op_active": 0, "op_laggy": 0, "op_send": 0, "op_send_bytes": 0, "op_resend": 0, "op_reply": 0, "op_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "op_inflight": 0, "oplen_avg": { "avgcount": 0, "sum": 0 }, "op": 0, "op_r": 0, "op_w": 0, "op_rmw": 0, "op_pg": 0, "osdop_stat": 0, "osdop_create": 0, "osdop_read": 0, "osdop_write": 0, "osdop_writefull": 0, "osdop_writesame": 0, "osdop_append": 0, "osdop_zero": 0, "osdop_truncate": 0, "osdop_delete": 0, "osdop_mapext": 0, "osdop_sparse_read": 0, "osdop_clonerange": 0, "osdop_getxattr": 0, "osdop_setxattr": 0, "osdop_cmpxattr": 0, "osdop_rmxattr": 0, "osdop_resetxattrs": 0, "osdop_call": 0, "osdop_watch": 0, "osdop_notify": 0, "osdop_src_cmpxattr": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_other": 0, "linger_active": 0, "linger_send": 0, "linger_resend": 0, "linger_ping": 0, "poolop_active": 0, "poolop_send": 0, "poolop_resend": 0, "poolstat_active": 0, "poolstat_send": 0, "poolstat_resend": 0, "statfs_active": 0, "statfs_send": 0, "statfs_resend": 0, "command_active": 0, "command_send": 0, "command_resend": 0, "map_epoch": 0, "map_full": 0, "map_inc": 0, "osd_sessions": 0, "osd_session_open": 0, "osd_session_close": 0, "osd_laggy": 0, "omap_wr": 0, "omap_rd": 0, "omap_del": 0 } } ], "throttle-msgr_dispatch_throttler-client": [ { "labels": {}, "counters": { "val": 0, "max": 104857600, "get_started": 0, "get": 124, "get_sum": 490920, "get_or_fail_fail": 0, "get_or_fail_success": 124, "take": 0, "take_sum": 0, "put": 124, "put_sum": 490920, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ], "throttle-msgr_dispatch_throttler-radosclient": [ { "labels": {}, "counters": { "val": 0, "max": 104857600, "get_started": 0, "get": 92, "get_sum": 3141221, "get_or_fail_fail": 0, "get_or_fail_success": 92, "take": 0, "take_sum": 0, "put": 92, "put_sum": 3141221, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ], "throttle-objecter_bytes": [ { "labels": {}, "counters": { "val": 0, "max": 104857600, "get_started": 0, "get": 0, "get_sum": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "take": 0, "take_sum": 0, "put": 0, "put_sum": 0, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ], "throttle-objecter_ops": [ { "labels": {}, "counters": { "val": 0, "max": 1024, "get_started": 0, "get": 0, "get_sum": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "take": 0, "take_sum": 0, "put": 0, "put_sum": 0, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ] } 2024-03-16T07:38:56.002 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-03-16T07:38:56.002 DEBUG:teuthology.orchestra.run.smithi049:mirror status for fs: cephfs> ceph --admin-daemon /var/run/ceph/cephfs-mirror.asok fs mirror status cephfs@14 2024-03-16T07:38:56.125 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-03-16T07:38:56.125 INFO:teuthology.orchestra.run.smithi049.stdout: "rados_inst": "172.21.15.49:0/1186634239", 2024-03-16T07:38:56.125 INFO:teuthology.orchestra.run.smithi049.stdout: "peers": { 2024-03-16T07:38:56.125 INFO:teuthology.orchestra.run.smithi049.stdout: "8fa2e0a7-a624-43b8-9c12-da3a1afea05a": { 2024-03-16T07:38:56.125 INFO:teuthology.orchestra.run.smithi049.stdout: "remote": { 2024-03-16T07:38:56.125 INFO:teuthology.orchestra.run.smithi049.stdout: "client_name": "client.mirror_remote", 2024-03-16T07:38:56.125 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_name": "ceph", 2024-03-16T07:38:56.125 INFO:teuthology.orchestra.run.smithi049.stdout: "fs_name": "backup_fs" 2024-03-16T07:38:56.125 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:56.125 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:56.125 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:38:56.125 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_dirs": { 2024-03-16T07:38:56.125 INFO:teuthology.orchestra.run.smithi049.stdout: "dir_count": 0 2024-03-16T07:38:56.125 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:38:56.126 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-03-16T07:38:56.133 DEBUG:tasks.cephfs.test_mirroring:command returned={ "rados_inst": "172.21.15.49:0/1186634239", "peers": { "8fa2e0a7-a624-43b8-9c12-da3a1afea05a": { "remote": { "client_name": "client.mirror_remote", "cluster_name": "ceph", "fs_name": "backup_fs" } } }, "snap_dirs": { "dir_count": 0 } } 2024-03-16T07:38:56.133 DEBUG:tasks.cephfs.test_mirroring:initial dir_count=0 2024-03-16T07:38:56.133 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snapshot mirror add cephfs /d0 2024-03-16T07:38:56.465 INFO:teuthology.orchestra.run.smithi049.stdout:{} 2024-03-16T07:39:06.479 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-03-16T07:39:06.479 DEBUG:teuthology.orchestra.run.smithi049:mirror status for fs: cephfs> ceph --admin-daemon /var/run/ceph/cephfs-mirror.asok fs mirror status cephfs@14 2024-03-16T07:39:06.575 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-03-16T07:39:06.575 INFO:teuthology.orchestra.run.smithi049.stdout: "rados_inst": "172.21.15.49:0/1186634239", 2024-03-16T07:39:06.575 INFO:teuthology.orchestra.run.smithi049.stdout: "peers": { 2024-03-16T07:39:06.575 INFO:teuthology.orchestra.run.smithi049.stdout: "8fa2e0a7-a624-43b8-9c12-da3a1afea05a": { 2024-03-16T07:39:06.575 INFO:teuthology.orchestra.run.smithi049.stdout: "remote": { 2024-03-16T07:39:06.576 INFO:teuthology.orchestra.run.smithi049.stdout: "client_name": "client.mirror_remote", 2024-03-16T07:39:06.576 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_name": "ceph", 2024-03-16T07:39:06.576 INFO:teuthology.orchestra.run.smithi049.stdout: "fs_name": "backup_fs" 2024-03-16T07:39:06.576 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:06.576 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:06.576 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:39:06.576 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_dirs": { 2024-03-16T07:39:06.576 INFO:teuthology.orchestra.run.smithi049.stdout: "dir_count": 1 2024-03-16T07:39:06.576 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:06.576 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-03-16T07:39:06.582 DEBUG:tasks.cephfs.test_mirroring:command returned={ "rados_inst": "172.21.15.49:0/1186634239", "peers": { "8fa2e0a7-a624-43b8-9c12-da3a1afea05a": { "remote": { "client_name": "client.mirror_remote", "cluster_name": "ceph", "fs_name": "backup_fs" } } }, "snap_dirs": { "dir_count": 1 } } 2024-03-16T07:39:06.583 DEBUG:tasks.cephfs.test_mirroring:new dir_count=1 2024-03-16T07:39:06.583 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-03-16T07:39:06.583 DEBUG:teuthology.orchestra.run.smithi049:counter dump for fs: cephfs> ceph --admin-daemon /var/run/ceph/cephfs-mirror.asok counter dump 2024-03-16T07:39:06.752 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-03-16T07:39:06.752 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker": [ 2024-03-16T07:39:06.752 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:39:06.752 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:39:06.752 INFO:teuthology.orchestra.run.smithi049.stdout: "id": "0" 2024-03-16T07:39:06.752 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:39:06.752 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:39:06.752 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_ready_timeouts": 0, 2024-03-16T07:39:06.752 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_idle_timeouts": 0 2024-03-16T07:39:06.753 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:06.753 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:39:06.753 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:39:06.753 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:39:06.753 INFO:teuthology.orchestra.run.smithi049.stdout: "id": "1" 2024-03-16T07:39:06.753 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:39:06.753 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:39:06.753 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_ready_timeouts": 0, 2024-03-16T07:39:06.753 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_idle_timeouts": 0 2024-03-16T07:39:06.753 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:06.753 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:39:06.753 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:39:06.753 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:39:06.753 INFO:teuthology.orchestra.run.smithi049.stdout: "id": "2" 2024-03-16T07:39:06.753 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:39:06.754 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:39:06.754 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_ready_timeouts": 0, 2024-03-16T07:39:06.754 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_idle_timeouts": 0 2024-03-16T07:39:06.754 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:06.754 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:06.754 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:39:06.754 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-0": [ 2024-03-16T07:39:06.754 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:39:06.754 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:39:06.754 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:39:06.754 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 13, 2024-03-16T07:39:06.754 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 175, 2024-03-16T07:39:06.754 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 1872, 2024-03-16T07:39:06.755 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 1067728, 2024-03-16T07:39:06.755 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 26, 2024-03-16T07:39:06.755 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 5, 2024-03-16T07:39:06.755 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 2.040295273, 2024-03-16T07:39:06.755 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.703530458, 2024-03-16T07:39:06.755 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 0.173849705, 2024-03-16T07:39:06.755 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-03-16T07:39:06.755 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T07:39:06.755 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 163, 2024-03-16T07:39:06.755 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 2.556496083, 2024-03-16T07:39:06.755 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.015684025 2024-03-16T07:39:06.755 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:39:06.755 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-03-16T07:39:06.755 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:39:06.755 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:39:06.756 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:39:06.756 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:39:06.756 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 1872, 2024-03-16T07:39:06.756 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 1067728 2024-03-16T07:39:06.756 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:06.756 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:06.756 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:39:06.756 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-1": [ 2024-03-16T07:39:06.756 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:39:06.756 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:39:06.756 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:39:06.756 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 124, 2024-03-16T07:39:06.756 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 10, 2024-03-16T07:39:06.756 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 507744, 2024-03-16T07:39:06.757 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 2112, 2024-03-16T07:39:06.757 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 4, 2024-03-16T07:39:06.757 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 0, 2024-03-16T07:39:06.757 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 2.044660565, 2024-03-16T07:39:06.757 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.264069518, 2024-03-16T07:39:06.757 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 1.157098723, 2024-03-16T07:39:06.757 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.194190800, 2024-03-16T07:39:06.757 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T07:39:06.757 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 9, 2024-03-16T07:39:06.757 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.188856872, 2024-03-16T07:39:06.757 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.020984096 2024-03-16T07:39:06.757 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:39:06.757 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-03-16T07:39:06.757 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:39:06.757 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:39:06.758 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:39:06.758 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:39:06.758 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 507744, 2024-03-16T07:39:06.758 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 2112 2024-03-16T07:39:06.758 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:06.758 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:06.758 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:39:06.758 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-2": [ 2024-03-16T07:39:06.758 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:39:06.758 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:39:06.758 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:39:06.758 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 82, 2024-03-16T07:39:06.758 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 13, 2024-03-16T07:39:06.758 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 3152736, 2024-03-16T07:39:06.759 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 2576, 2024-03-16T07:39:06.759 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 3, 2024-03-16T07:39:06.759 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 1, 2024-03-16T07:39:06.759 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 4.890038656, 2024-03-16T07:39:06.759 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.598237296, 2024-03-16T07:39:06.759 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 4.385775509, 2024-03-16T07:39:06.759 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-03-16T07:39:06.759 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T07:39:06.759 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 12, 2024-03-16T07:39:06.759 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.346963753, 2024-03-16T07:39:06.759 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.028913646 2024-03-16T07:39:06.759 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:39:06.759 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-03-16T07:39:06.759 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:39:06.759 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:39:06.760 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:39:06.760 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:39:06.760 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 3152736, 2024-03-16T07:39:06.760 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 2576 2024-03-16T07:39:06.760 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:06.760 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:06.760 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:39:06.760 INFO:teuthology.orchestra.run.smithi049.stdout: "cct": [ 2024-03-16T07:39:06.760 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:39:06.760 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:39:06.760 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:39:06.760 INFO:teuthology.orchestra.run.smithi049.stdout: "total_workers": 0, 2024-03-16T07:39:06.760 INFO:teuthology.orchestra.run.smithi049.stdout: "unhealthy_workers": 0 2024-03-16T07:39:06.760 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:06.760 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:06.761 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:39:06.761 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs_mirror": [ 2024-03-16T07:39:06.761 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:39:06.761 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:39:06.761 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:39:06.761 INFO:teuthology.orchestra.run.smithi049.stdout: "mirrored_filesystems": 2, 2024-03-16T07:39:06.761 INFO:teuthology.orchestra.run.smithi049.stdout: "mirror_enable_failures": 0 2024-03-16T07:39:06.761 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:06.761 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:06.761 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:39:06.761 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs_mirror_mirrored_filesystems": [ 2024-03-16T07:39:06.761 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:39:06.761 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:39:06.761 INFO:teuthology.orchestra.run.smithi049.stdout: "filesystem": "cephfs" 2024-03-16T07:39:06.761 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:39:06.762 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:39:06.762 INFO:teuthology.orchestra.run.smithi049.stdout: "mirroring_peers": 1, 2024-03-16T07:39:06.762 INFO:teuthology.orchestra.run.smithi049.stdout: "directory_count": 1 2024-03-16T07:39:06.762 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:06.762 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:06.762 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:39:06.762 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs_mirror_peers": [ 2024-03-16T07:39:06.762 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:39:06.762 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:39:06.762 INFO:teuthology.orchestra.run.smithi049.stdout: "peer_cluster_filesystem": "backup_fs", 2024-03-16T07:39:06.762 INFO:teuthology.orchestra.run.smithi049.stdout: "peer_cluster_name": "ceph", 2024-03-16T07:39:06.762 INFO:teuthology.orchestra.run.smithi049.stdout: "source_filesystem": "cephfs", 2024-03-16T07:39:06.762 INFO:teuthology.orchestra.run.smithi049.stdout: "source_fscid": "14" 2024-03-16T07:39:06.762 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:39:06.762 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:39:06.763 INFO:teuthology.orchestra.run.smithi049.stdout: "snaps_synced": 0, 2024-03-16T07:39:06.763 INFO:teuthology.orchestra.run.smithi049.stdout: "snaps_deleted": 0, 2024-03-16T07:39:06.763 INFO:teuthology.orchestra.run.smithi049.stdout: "snaps_renamed": 0, 2024-03-16T07:39:06.763 INFO:teuthology.orchestra.run.smithi049.stdout: "sync_failures": 6, 2024-03-16T07:39:06.763 INFO:teuthology.orchestra.run.smithi049.stdout: "avg_sync_time": { 2024-03-16T07:39:06.763 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:39:06.763 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:39:06.763 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:39:06.763 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:39:06.763 INFO:teuthology.orchestra.run.smithi049.stdout: "sync_bytes": 0 2024-03-16T07:39:06.763 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:06.763 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:06.763 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:39:06.763 INFO:teuthology.orchestra.run.smithi049.stdout: "mempool": [ 2024-03-16T07:39:06.763 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:39:06.764 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:39:06.764 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:39:06.764 INFO:teuthology.orchestra.run.smithi049.stdout: "bloom_filter_bytes": 0, 2024-03-16T07:39:06.764 INFO:teuthology.orchestra.run.smithi049.stdout: "bloom_filter_items": 0, 2024-03-16T07:39:06.764 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_alloc_bytes": 0, 2024-03-16T07:39:06.764 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_alloc_items": 0, 2024-03-16T07:39:06.764 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_data_bytes": 0, 2024-03-16T07:39:06.764 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_data_items": 0, 2024-03-16T07:39:06.764 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_onode_bytes": 0, 2024-03-16T07:39:06.764 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_onode_items": 0, 2024-03-16T07:39:06.764 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_meta_bytes": 0, 2024-03-16T07:39:06.764 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_meta_items": 0, 2024-03-16T07:39:06.764 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_other_bytes": 0, 2024-03-16T07:39:06.764 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_other_items": 0, 2024-03-16T07:39:06.764 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_buffer_bytes": 0, 2024-03-16T07:39:06.765 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_buffer_items": 0, 2024-03-16T07:39:06.765 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_extent_bytes": 0, 2024-03-16T07:39:06.765 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_extent_items": 0, 2024-03-16T07:39:06.765 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_blob_bytes": 0, 2024-03-16T07:39:06.765 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_blob_items": 0, 2024-03-16T07:39:06.765 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_shared_blob_bytes": 0, 2024-03-16T07:39:06.765 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_shared_blob_items": 0, 2024-03-16T07:39:06.765 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_inline_bl_bytes": 0, 2024-03-16T07:39:06.765 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_inline_bl_items": 0, 2024-03-16T07:39:06.765 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_fsck_bytes": 0, 2024-03-16T07:39:06.765 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_fsck_items": 0, 2024-03-16T07:39:06.765 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_txc_bytes": 0, 2024-03-16T07:39:06.765 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_txc_items": 0, 2024-03-16T07:39:06.765 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_deferred_bytes": 0, 2024-03-16T07:39:06.765 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_deferred_items": 0, 2024-03-16T07:39:06.766 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_bytes": 0, 2024-03-16T07:39:06.766 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_items": 0, 2024-03-16T07:39:06.766 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_bytes": 0, 2024-03-16T07:39:06.766 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_items": 0, 2024-03-16T07:39:06.766 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_reader_bytes": 0, 2024-03-16T07:39:06.766 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_reader_items": 0, 2024-03-16T07:39:06.766 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_writer_bytes": 0, 2024-03-16T07:39:06.766 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_writer_items": 0, 2024-03-16T07:39:06.766 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_anon_bytes": 621022131, 2024-03-16T07:39:06.766 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_anon_items": 220, 2024-03-16T07:39:06.766 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_meta_bytes": 7040, 2024-03-16T07:39:06.766 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_meta_items": 80, 2024-03-16T07:39:06.766 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_bytes": 0, 2024-03-16T07:39:06.766 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_items": 0, 2024-03-16T07:39:06.766 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_mapbl_bytes": 0, 2024-03-16T07:39:06.767 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_mapbl_items": 0, 2024-03-16T07:39:06.767 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pglog_bytes": 0, 2024-03-16T07:39:06.767 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pglog_items": 0, 2024-03-16T07:39:06.767 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_bytes": 33952, 2024-03-16T07:39:06.767 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_items": 334, 2024-03-16T07:39:06.767 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_mapping_bytes": 0, 2024-03-16T07:39:06.767 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_mapping_items": 0, 2024-03-16T07:39:06.767 INFO:teuthology.orchestra.run.smithi049.stdout: "pgmap_bytes": 0, 2024-03-16T07:39:06.767 INFO:teuthology.orchestra.run.smithi049.stdout: "pgmap_items": 0, 2024-03-16T07:39:06.767 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_co_bytes": 0, 2024-03-16T07:39:06.767 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_co_items": 0, 2024-03-16T07:39:06.767 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_1_bytes": 0, 2024-03-16T07:39:06.767 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_1_items": 0, 2024-03-16T07:39:06.767 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_2_bytes": 0, 2024-03-16T07:39:06.768 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_2_items": 0 2024-03-16T07:39:06.768 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:06.768 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:06.768 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:39:06.768 INFO:teuthology.orchestra.run.smithi049.stdout: "objecter": [ 2024-03-16T07:39:06.768 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:39:06.768 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:39:06.768 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:39:06.768 INFO:teuthology.orchestra.run.smithi049.stdout: "op_active": 0, 2024-03-16T07:39:06.768 INFO:teuthology.orchestra.run.smithi049.stdout: "op_laggy": 0, 2024-03-16T07:39:06.768 INFO:teuthology.orchestra.run.smithi049.stdout: "op_send": 0, 2024-03-16T07:39:06.768 INFO:teuthology.orchestra.run.smithi049.stdout: "op_send_bytes": 0, 2024-03-16T07:39:06.768 INFO:teuthology.orchestra.run.smithi049.stdout: "op_resend": 0, 2024-03-16T07:39:06.769 INFO:teuthology.orchestra.run.smithi049.stdout: "op_reply": 0, 2024-03-16T07:39:06.769 INFO:teuthology.orchestra.run.smithi049.stdout: "op_latency": { 2024-03-16T07:39:06.769 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:39:06.769 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:39:06.769 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:39:06.769 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:39:06.769 INFO:teuthology.orchestra.run.smithi049.stdout: "op_inflight": 0, 2024-03-16T07:39:06.769 INFO:teuthology.orchestra.run.smithi049.stdout: "oplen_avg": { 2024-03-16T07:39:06.769 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:39:06.769 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0 2024-03-16T07:39:06.769 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:39:06.769 INFO:teuthology.orchestra.run.smithi049.stdout: "op": 0, 2024-03-16T07:39:06.769 INFO:teuthology.orchestra.run.smithi049.stdout: "op_r": 0, 2024-03-16T07:39:06.769 INFO:teuthology.orchestra.run.smithi049.stdout: "op_w": 0, 2024-03-16T07:39:06.769 INFO:teuthology.orchestra.run.smithi049.stdout: "op_rmw": 0, 2024-03-16T07:39:06.770 INFO:teuthology.orchestra.run.smithi049.stdout: "op_pg": 0, 2024-03-16T07:39:06.770 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_stat": 0, 2024-03-16T07:39:06.770 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_create": 0, 2024-03-16T07:39:06.770 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_read": 0, 2024-03-16T07:39:06.770 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_write": 0, 2024-03-16T07:39:06.770 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_writefull": 0, 2024-03-16T07:39:06.770 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_writesame": 0, 2024-03-16T07:39:06.770 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_append": 0, 2024-03-16T07:39:06.770 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_zero": 0, 2024-03-16T07:39:06.770 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_truncate": 0, 2024-03-16T07:39:06.770 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_delete": 0, 2024-03-16T07:39:06.770 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_mapext": 0, 2024-03-16T07:39:06.770 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_sparse_read": 0, 2024-03-16T07:39:06.770 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_clonerange": 0, 2024-03-16T07:39:06.771 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_getxattr": 0, 2024-03-16T07:39:06.771 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_setxattr": 0, 2024-03-16T07:39:06.771 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_cmpxattr": 0, 2024-03-16T07:39:06.771 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_rmxattr": 0, 2024-03-16T07:39:06.771 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_resetxattrs": 0, 2024-03-16T07:39:06.771 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_call": 0, 2024-03-16T07:39:06.771 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_watch": 0, 2024-03-16T07:39:06.771 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_notify": 0, 2024-03-16T07:39:06.771 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_src_cmpxattr": 0, 2024-03-16T07:39:06.771 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_pgls": 0, 2024-03-16T07:39:06.771 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_pgls_filter": 0, 2024-03-16T07:39:06.771 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_other": 0, 2024-03-16T07:39:06.771 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_active": 0, 2024-03-16T07:39:06.771 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_send": 0, 2024-03-16T07:39:06.771 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_resend": 0, 2024-03-16T07:39:06.772 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_ping": 0, 2024-03-16T07:39:06.772 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_active": 0, 2024-03-16T07:39:06.772 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_send": 0, 2024-03-16T07:39:06.772 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_resend": 0, 2024-03-16T07:39:06.772 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_active": 0, 2024-03-16T07:39:06.772 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_send": 0, 2024-03-16T07:39:06.772 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_resend": 0, 2024-03-16T07:39:06.772 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_active": 0, 2024-03-16T07:39:06.772 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_send": 0, 2024-03-16T07:39:06.772 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_resend": 0, 2024-03-16T07:39:06.772 INFO:teuthology.orchestra.run.smithi049.stdout: "command_active": 0, 2024-03-16T07:39:06.772 INFO:teuthology.orchestra.run.smithi049.stdout: "command_send": 0, 2024-03-16T07:39:06.772 INFO:teuthology.orchestra.run.smithi049.stdout: "command_resend": 0, 2024-03-16T07:39:06.772 INFO:teuthology.orchestra.run.smithi049.stdout: "map_epoch": 0, 2024-03-16T07:39:06.773 INFO:teuthology.orchestra.run.smithi049.stdout: "map_full": 0, 2024-03-16T07:39:06.773 INFO:teuthology.orchestra.run.smithi049.stdout: "map_inc": 0, 2024-03-16T07:39:06.773 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_sessions": 0, 2024-03-16T07:39:06.773 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_session_open": 0, 2024-03-16T07:39:06.773 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_session_close": 0, 2024-03-16T07:39:06.773 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_laggy": 0, 2024-03-16T07:39:06.773 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_wr": 0, 2024-03-16T07:39:06.773 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_rd": 0, 2024-03-16T07:39:06.773 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_del": 0 2024-03-16T07:39:06.773 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:06.773 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:06.773 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:39:06.773 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-msgr_dispatch_throttler-client": [ 2024-03-16T07:39:06.773 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:39:06.773 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:39:06.774 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:39:06.774 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:39:06.774 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-03-16T07:39:06.774 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:39:06.774 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 124, 2024-03-16T07:39:06.774 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 490920, 2024-03-16T07:39:06.774 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:39:06.774 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 124, 2024-03-16T07:39:06.774 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:39:06.774 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:39:06.774 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 124, 2024-03-16T07:39:06.774 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 490920, 2024-03-16T07:39:06.774 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:39:06.774 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:39:06.774 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:39:06.775 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:39:06.775 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:06.775 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:06.775 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:06.775 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:39:06.775 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-msgr_dispatch_throttler-radosclient": [ 2024-03-16T07:39:06.775 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:39:06.775 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:39:06.775 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:39:06.775 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:39:06.775 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-03-16T07:39:06.775 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:39:06.775 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 92, 2024-03-16T07:39:06.775 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 3141221, 2024-03-16T07:39:06.775 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:39:06.775 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 92, 2024-03-16T07:39:06.776 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:39:06.776 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:39:06.776 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 92, 2024-03-16T07:39:06.776 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 3141221, 2024-03-16T07:39:06.776 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:39:06.776 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:39:06.776 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:39:06.776 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:39:06.776 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:06.776 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:06.776 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:06.776 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:39:06.776 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-objecter_bytes": [ 2024-03-16T07:39:06.776 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:39:06.776 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:39:06.776 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:39:06.777 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:39:06.777 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-03-16T07:39:06.777 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:39:06.777 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 0, 2024-03-16T07:39:06.777 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 0, 2024-03-16T07:39:06.777 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:39:06.777 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 0, 2024-03-16T07:39:06.777 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:39:06.777 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:39:06.777 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 0, 2024-03-16T07:39:06.777 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 0, 2024-03-16T07:39:06.777 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:39:06.778 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:39:06.778 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:39:06.778 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:39:06.778 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:06.778 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:06.778 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:06.778 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:39:06.778 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-objecter_ops": [ 2024-03-16T07:39:06.778 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:39:06.778 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:39:06.778 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:39:06.778 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:39:06.778 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 1024, 2024-03-16T07:39:06.778 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:39:06.779 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 0, 2024-03-16T07:39:06.779 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 0, 2024-03-16T07:39:06.779 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:39:06.779 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 0, 2024-03-16T07:39:06.779 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:39:06.779 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:39:06.779 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 0, 2024-03-16T07:39:06.779 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 0, 2024-03-16T07:39:06.779 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:39:06.779 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:39:06.779 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:39:06.779 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:39:06.779 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:06.779 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:06.780 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:06.780 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2024-03-16T07:39:06.780 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-03-16T07:39:06.781 DEBUG:tasks.cephfs.test_mirroring:command returned={ "AsyncMessenger::Worker": [ { "labels": { "id": "0" }, "counters": { "msgr_connection_ready_timeouts": 0, "msgr_connection_idle_timeouts": 0 } }, { "labels": { "id": "1" }, "counters": { "msgr_connection_ready_timeouts": 0, "msgr_connection_idle_timeouts": 0 } }, { "labels": { "id": "2" }, "counters": { "msgr_connection_ready_timeouts": 0, "msgr_connection_idle_timeouts": 0 } } ], "AsyncMessenger::Worker-0": [ { "labels": {}, "counters": { "msgr_recv_messages": 13, "msgr_send_messages": 175, "msgr_recv_bytes": 1872, "msgr_send_bytes": 1067728, "msgr_created_connections": 26, "msgr_active_connections": 5, "msgr_running_total_time": 2.040295273, "msgr_running_send_time": 0.703530458, "msgr_running_recv_time": 0.173849705, "msgr_running_fast_dispatch_time": 0.000000000, "msgr_send_messages_queue_lat": { "avgcount": 163, "sum": 2.556496083, "avgtime": 0.015684025 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "msgr_recv_encrypted_bytes": 1872, "msgr_send_encrypted_bytes": 1067728 } } ], "AsyncMessenger::Worker-1": [ { "labels": {}, "counters": { "msgr_recv_messages": 124, "msgr_send_messages": 10, "msgr_recv_bytes": 507744, "msgr_send_bytes": 2112, "msgr_created_connections": 4, "msgr_active_connections": 0, "msgr_running_total_time": 2.044660565, "msgr_running_send_time": 0.264069518, "msgr_running_recv_time": 1.157098723, "msgr_running_fast_dispatch_time": 0.194190800, "msgr_send_messages_queue_lat": { "avgcount": 9, "sum": 0.188856872, "avgtime": 0.020984096 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "msgr_recv_encrypted_bytes": 507744, "msgr_send_encrypted_bytes": 2112 } } ], "AsyncMessenger::Worker-2": [ { "labels": {}, "counters": { "msgr_recv_messages": 82, "msgr_send_messages": 13, "msgr_recv_bytes": 3152736, "msgr_send_bytes": 2576, "msgr_created_connections": 3, "msgr_active_connections": 1, "msgr_running_total_time": 4.890038656, "msgr_running_send_time": 0.598237296, "msgr_running_recv_time": 4.385775509, "msgr_running_fast_dispatch_time": 0.000000000, "msgr_send_messages_queue_lat": { "avgcount": 12, "sum": 0.346963753, "avgtime": 0.028913646 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "msgr_recv_encrypted_bytes": 3152736, "msgr_send_encrypted_bytes": 2576 } } ], "cct": [ { "labels": {}, "counters": { "total_workers": 0, "unhealthy_workers": 0 } } ], "cephfs_mirror": [ { "labels": {}, "counters": { "mirrored_filesystems": 2, "mirror_enable_failures": 0 } } ], "cephfs_mirror_mirrored_filesystems": [ { "labels": { "filesystem": "cephfs" }, "counters": { "mirroring_peers": 1, "directory_count": 1 } } ], "cephfs_mirror_peers": [ { "labels": { "peer_cluster_filesystem": "backup_fs", "peer_cluster_name": "ceph", "source_filesystem": "cephfs", "source_fscid": "14" }, "counters": { "snaps_synced": 0, "snaps_deleted": 0, "snaps_renamed": 0, "sync_failures": 6, "avg_sync_time": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "sync_bytes": 0 } } ], "mempool": [ { "labels": {}, "counters": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_cache_buffer_bytes": 0, "bluestore_cache_buffer_items": 0, "bluestore_extent_bytes": 0, "bluestore_extent_items": 0, "bluestore_blob_bytes": 0, "bluestore_blob_items": 0, "bluestore_shared_blob_bytes": 0, "bluestore_shared_blob_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_items": 0, "bluefs_bytes": 0, "bluefs_items": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "buffer_anon_bytes": 621022131, "buffer_anon_items": 220, "buffer_meta_bytes": 7040, "buffer_meta_items": 80, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 33952, "osdmap_items": 334, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "mds_co_bytes": 0, "mds_co_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 } } ], "objecter": [ { "labels": {}, "counters": { "op_active": 0, "op_laggy": 0, "op_send": 0, "op_send_bytes": 0, "op_resend": 0, "op_reply": 0, "op_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "op_inflight": 0, "oplen_avg": { "avgcount": 0, "sum": 0 }, "op": 0, "op_r": 0, "op_w": 0, "op_rmw": 0, "op_pg": 0, "osdop_stat": 0, "osdop_create": 0, "osdop_read": 0, "osdop_write": 0, "osdop_writefull": 0, "osdop_writesame": 0, "osdop_append": 0, "osdop_zero": 0, "osdop_truncate": 0, "osdop_delete": 0, "osdop_mapext": 0, "osdop_sparse_read": 0, "osdop_clonerange": 0, "osdop_getxattr": 0, "osdop_setxattr": 0, "osdop_cmpxattr": 0, "osdop_rmxattr": 0, "osdop_resetxattrs": 0, "osdop_call": 0, "osdop_watch": 0, "osdop_notify": 0, "osdop_src_cmpxattr": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_other": 0, "linger_active": 0, "linger_send": 0, "linger_resend": 0, "linger_ping": 0, "poolop_active": 0, "poolop_send": 0, "poolop_resend": 0, "poolstat_active": 0, "poolstat_send": 0, "poolstat_resend": 0, "statfs_active": 0, "statfs_send": 0, "statfs_resend": 0, "command_active": 0, "command_send": 0, "command_resend": 0, "map_epoch": 0, "map_full": 0, "map_inc": 0, "osd_sessions": 0, "osd_session_open": 0, "osd_session_close": 0, "osd_laggy": 0, "omap_wr": 0, "omap_rd": 0, "omap_del": 0 } } ], "throttle-msgr_dispatch_throttler-client": [ { "labels": {}, "counters": { "val": 0, "max": 104857600, "get_started": 0, "get": 124, "get_sum": 490920, "get_or_fail_fail": 0, "get_or_fail_success": 124, "take": 0, "take_sum": 0, "put": 124, "put_sum": 490920, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ], "throttle-msgr_dispatch_throttler-radosclient": [ { "labels": {}, "counters": { "val": 0, "max": 104857600, "get_started": 0, "get": 92, "get_sum": 3141221, "get_or_fail_fail": 0, "get_or_fail_success": 92, "take": 0, "take_sum": 0, "put": 92, "put_sum": 3141221, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ], "throttle-objecter_bytes": [ { "labels": {}, "counters": { "val": 0, "max": 104857600, "get_started": 0, "get": 0, "get_sum": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "take": 0, "take_sum": 0, "put": 0, "put_sum": 0, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ], "throttle-objecter_ops": [ { "labels": {}, "counters": { "val": 0, "max": 1024, "get_started": 0, "get": 0, "get_sum": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "take": 0, "take_sum": 0, "put": 0, "put_sum": 0, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ] } 2024-03-16T07:39:06.781 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-03-16T07:39:06.781 DEBUG:teuthology.orchestra.run.smithi049:counter dump for fs: cephfs> ceph --admin-daemon /var/run/ceph/cephfs-mirror.asok counter dump 2024-03-16T07:39:06.893 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-03-16T07:39:06.893 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker": [ 2024-03-16T07:39:06.893 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:39:06.893 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:39:06.893 INFO:teuthology.orchestra.run.smithi049.stdout: "id": "0" 2024-03-16T07:39:06.893 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:39:06.893 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:39:06.894 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_ready_timeouts": 0, 2024-03-16T07:39:06.894 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_idle_timeouts": 0 2024-03-16T07:39:06.894 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:06.894 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:39:06.894 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:39:06.894 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:39:06.894 INFO:teuthology.orchestra.run.smithi049.stdout: "id": "1" 2024-03-16T07:39:06.894 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:39:06.894 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:39:06.894 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_ready_timeouts": 0, 2024-03-16T07:39:06.894 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_idle_timeouts": 0 2024-03-16T07:39:06.894 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:06.894 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:39:06.895 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:39:06.895 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:39:06.895 INFO:teuthology.orchestra.run.smithi049.stdout: "id": "2" 2024-03-16T07:39:06.895 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:39:06.895 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:39:06.895 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_ready_timeouts": 0, 2024-03-16T07:39:06.895 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_idle_timeouts": 0 2024-03-16T07:39:06.895 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:06.895 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:06.895 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:39:06.895 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-0": [ 2024-03-16T07:39:06.895 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:39:06.895 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:39:06.895 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:39:06.895 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 13, 2024-03-16T07:39:06.895 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 175, 2024-03-16T07:39:06.896 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 1872, 2024-03-16T07:39:06.896 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 1067728, 2024-03-16T07:39:06.896 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 26, 2024-03-16T07:39:06.896 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 5, 2024-03-16T07:39:06.896 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 2.040295273, 2024-03-16T07:39:06.896 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.703530458, 2024-03-16T07:39:06.896 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 0.173849705, 2024-03-16T07:39:06.896 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-03-16T07:39:06.896 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T07:39:06.896 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 163, 2024-03-16T07:39:06.896 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 2.556496083, 2024-03-16T07:39:06.896 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.015684025 2024-03-16T07:39:06.896 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:39:06.896 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-03-16T07:39:06.897 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:39:06.897 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:39:06.897 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:39:06.897 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:39:06.897 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 1872, 2024-03-16T07:39:06.897 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 1067728 2024-03-16T07:39:06.897 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:06.897 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:06.897 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:39:06.897 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-1": [ 2024-03-16T07:39:06.897 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:39:06.897 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:39:06.897 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:39:06.897 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 124, 2024-03-16T07:39:06.897 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 10, 2024-03-16T07:39:06.898 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 507744, 2024-03-16T07:39:06.898 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 2112, 2024-03-16T07:39:06.898 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 4, 2024-03-16T07:39:06.898 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 0, 2024-03-16T07:39:06.898 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 2.044660565, 2024-03-16T07:39:06.898 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.264069518, 2024-03-16T07:39:06.898 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 1.157098723, 2024-03-16T07:39:06.898 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.194190800, 2024-03-16T07:39:06.898 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T07:39:06.898 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 9, 2024-03-16T07:39:06.898 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.188856872, 2024-03-16T07:39:06.898 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.020984096 2024-03-16T07:39:06.898 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:39:06.898 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-03-16T07:39:06.898 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:39:06.899 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:39:06.899 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:39:06.899 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:39:06.899 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 507744, 2024-03-16T07:39:06.899 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 2112 2024-03-16T07:39:06.899 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:06.899 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:06.899 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:39:06.899 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-2": [ 2024-03-16T07:39:06.899 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:39:06.899 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:39:06.899 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:39:06.899 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 82, 2024-03-16T07:39:06.899 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 13, 2024-03-16T07:39:06.899 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 3152736, 2024-03-16T07:39:06.900 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 2576, 2024-03-16T07:39:06.900 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 3, 2024-03-16T07:39:06.900 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 1, 2024-03-16T07:39:06.900 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 4.890038656, 2024-03-16T07:39:06.900 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.598237296, 2024-03-16T07:39:06.900 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 4.385775509, 2024-03-16T07:39:06.900 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-03-16T07:39:06.900 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T07:39:06.900 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 12, 2024-03-16T07:39:06.900 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.346963753, 2024-03-16T07:39:06.900 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.028913646 2024-03-16T07:39:06.900 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:39:06.900 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-03-16T07:39:06.900 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:39:06.900 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:39:06.900 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:39:06.901 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:39:06.901 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 3152736, 2024-03-16T07:39:06.901 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 2576 2024-03-16T07:39:06.901 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:06.901 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:06.901 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:39:06.901 INFO:teuthology.orchestra.run.smithi049.stdout: "cct": [ 2024-03-16T07:39:06.901 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:39:06.901 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:39:06.901 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:39:06.901 INFO:teuthology.orchestra.run.smithi049.stdout: "total_workers": 0, 2024-03-16T07:39:06.901 INFO:teuthology.orchestra.run.smithi049.stdout: "unhealthy_workers": 0 2024-03-16T07:39:06.901 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:06.901 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:06.901 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:39:06.902 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs_mirror": [ 2024-03-16T07:39:06.902 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:39:06.902 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:39:06.902 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:39:06.902 INFO:teuthology.orchestra.run.smithi049.stdout: "mirrored_filesystems": 2, 2024-03-16T07:39:06.902 INFO:teuthology.orchestra.run.smithi049.stdout: "mirror_enable_failures": 0 2024-03-16T07:39:06.902 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:06.902 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:06.902 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:39:06.902 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs_mirror_mirrored_filesystems": [ 2024-03-16T07:39:06.902 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:39:06.902 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:39:06.902 INFO:teuthology.orchestra.run.smithi049.stdout: "filesystem": "cephfs" 2024-03-16T07:39:06.902 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:39:06.903 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:39:06.903 INFO:teuthology.orchestra.run.smithi049.stdout: "mirroring_peers": 1, 2024-03-16T07:39:06.903 INFO:teuthology.orchestra.run.smithi049.stdout: "directory_count": 1 2024-03-16T07:39:06.903 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:06.903 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:06.903 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:39:06.903 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs_mirror_peers": [ 2024-03-16T07:39:06.903 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:39:06.903 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:39:06.903 INFO:teuthology.orchestra.run.smithi049.stdout: "peer_cluster_filesystem": "backup_fs", 2024-03-16T07:39:06.903 INFO:teuthology.orchestra.run.smithi049.stdout: "peer_cluster_name": "ceph", 2024-03-16T07:39:06.903 INFO:teuthology.orchestra.run.smithi049.stdout: "source_filesystem": "cephfs", 2024-03-16T07:39:06.903 INFO:teuthology.orchestra.run.smithi049.stdout: "source_fscid": "14" 2024-03-16T07:39:06.903 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:39:06.903 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:39:06.904 INFO:teuthology.orchestra.run.smithi049.stdout: "snaps_synced": 0, 2024-03-16T07:39:06.904 INFO:teuthology.orchestra.run.smithi049.stdout: "snaps_deleted": 0, 2024-03-16T07:39:06.904 INFO:teuthology.orchestra.run.smithi049.stdout: "snaps_renamed": 0, 2024-03-16T07:39:06.904 INFO:teuthology.orchestra.run.smithi049.stdout: "sync_failures": 6, 2024-03-16T07:39:06.904 INFO:teuthology.orchestra.run.smithi049.stdout: "avg_sync_time": { 2024-03-16T07:39:06.904 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:39:06.904 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:39:06.904 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:39:06.904 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:39:06.904 INFO:teuthology.orchestra.run.smithi049.stdout: "sync_bytes": 0 2024-03-16T07:39:06.904 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:06.904 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:06.904 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:39:06.904 INFO:teuthology.orchestra.run.smithi049.stdout: "mempool": [ 2024-03-16T07:39:06.904 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:39:06.905 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:39:06.905 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:39:06.905 INFO:teuthology.orchestra.run.smithi049.stdout: "bloom_filter_bytes": 0, 2024-03-16T07:39:06.905 INFO:teuthology.orchestra.run.smithi049.stdout: "bloom_filter_items": 0, 2024-03-16T07:39:06.905 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_alloc_bytes": 0, 2024-03-16T07:39:06.905 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_alloc_items": 0, 2024-03-16T07:39:06.905 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_data_bytes": 0, 2024-03-16T07:39:06.905 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_data_items": 0, 2024-03-16T07:39:06.905 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_onode_bytes": 0, 2024-03-16T07:39:06.905 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_onode_items": 0, 2024-03-16T07:39:06.905 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_meta_bytes": 0, 2024-03-16T07:39:06.905 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_meta_items": 0, 2024-03-16T07:39:06.905 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_other_bytes": 0, 2024-03-16T07:39:06.905 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_other_items": 0, 2024-03-16T07:39:06.905 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_buffer_bytes": 0, 2024-03-16T07:39:06.906 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_buffer_items": 0, 2024-03-16T07:39:06.906 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_extent_bytes": 0, 2024-03-16T07:39:06.906 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_extent_items": 0, 2024-03-16T07:39:06.906 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_blob_bytes": 0, 2024-03-16T07:39:06.906 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_blob_items": 0, 2024-03-16T07:39:06.906 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_shared_blob_bytes": 0, 2024-03-16T07:39:06.906 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_shared_blob_items": 0, 2024-03-16T07:39:06.906 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_inline_bl_bytes": 0, 2024-03-16T07:39:06.906 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_inline_bl_items": 0, 2024-03-16T07:39:06.906 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_fsck_bytes": 0, 2024-03-16T07:39:06.906 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_fsck_items": 0, 2024-03-16T07:39:06.906 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_txc_bytes": 0, 2024-03-16T07:39:06.906 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_txc_items": 0, 2024-03-16T07:39:06.906 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_deferred_bytes": 0, 2024-03-16T07:39:06.906 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_deferred_items": 0, 2024-03-16T07:39:06.907 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_bytes": 0, 2024-03-16T07:39:06.907 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_items": 0, 2024-03-16T07:39:06.907 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_bytes": 0, 2024-03-16T07:39:06.907 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_items": 0, 2024-03-16T07:39:06.907 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_reader_bytes": 0, 2024-03-16T07:39:06.907 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_reader_items": 0, 2024-03-16T07:39:06.907 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_writer_bytes": 0, 2024-03-16T07:39:06.907 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_writer_items": 0, 2024-03-16T07:39:06.907 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_anon_bytes": 621022131, 2024-03-16T07:39:06.907 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_anon_items": 220, 2024-03-16T07:39:06.907 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_meta_bytes": 7040, 2024-03-16T07:39:06.907 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_meta_items": 80, 2024-03-16T07:39:06.907 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_bytes": 0, 2024-03-16T07:39:06.907 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_items": 0, 2024-03-16T07:39:06.907 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_mapbl_bytes": 0, 2024-03-16T07:39:06.907 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_mapbl_items": 0, 2024-03-16T07:39:06.908 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pglog_bytes": 0, 2024-03-16T07:39:06.908 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pglog_items": 0, 2024-03-16T07:39:06.908 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_bytes": 33952, 2024-03-16T07:39:06.908 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_items": 334, 2024-03-16T07:39:06.908 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_mapping_bytes": 0, 2024-03-16T07:39:06.908 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_mapping_items": 0, 2024-03-16T07:39:06.908 INFO:teuthology.orchestra.run.smithi049.stdout: "pgmap_bytes": 0, 2024-03-16T07:39:06.908 INFO:teuthology.orchestra.run.smithi049.stdout: "pgmap_items": 0, 2024-03-16T07:39:06.908 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_co_bytes": 0, 2024-03-16T07:39:06.908 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_co_items": 0, 2024-03-16T07:39:06.908 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_1_bytes": 0, 2024-03-16T07:39:06.908 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_1_items": 0, 2024-03-16T07:39:06.908 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_2_bytes": 0, 2024-03-16T07:39:06.908 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_2_items": 0 2024-03-16T07:39:06.908 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:06.909 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:06.909 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:39:06.909 INFO:teuthology.orchestra.run.smithi049.stdout: "objecter": [ 2024-03-16T07:39:06.909 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:39:06.909 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:39:06.909 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:39:06.909 INFO:teuthology.orchestra.run.smithi049.stdout: "op_active": 0, 2024-03-16T07:39:06.909 INFO:teuthology.orchestra.run.smithi049.stdout: "op_laggy": 0, 2024-03-16T07:39:06.909 INFO:teuthology.orchestra.run.smithi049.stdout: "op_send": 0, 2024-03-16T07:39:06.909 INFO:teuthology.orchestra.run.smithi049.stdout: "op_send_bytes": 0, 2024-03-16T07:39:06.909 INFO:teuthology.orchestra.run.smithi049.stdout: "op_resend": 0, 2024-03-16T07:39:06.909 INFO:teuthology.orchestra.run.smithi049.stdout: "op_reply": 0, 2024-03-16T07:39:06.909 INFO:teuthology.orchestra.run.smithi049.stdout: "op_latency": { 2024-03-16T07:39:06.909 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:39:06.909 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:39:06.910 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:39:06.910 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:39:06.910 INFO:teuthology.orchestra.run.smithi049.stdout: "op_inflight": 0, 2024-03-16T07:39:06.910 INFO:teuthology.orchestra.run.smithi049.stdout: "oplen_avg": { 2024-03-16T07:39:06.910 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:39:06.910 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0 2024-03-16T07:39:06.910 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:39:06.910 INFO:teuthology.orchestra.run.smithi049.stdout: "op": 0, 2024-03-16T07:39:06.910 INFO:teuthology.orchestra.run.smithi049.stdout: "op_r": 0, 2024-03-16T07:39:06.910 INFO:teuthology.orchestra.run.smithi049.stdout: "op_w": 0, 2024-03-16T07:39:06.910 INFO:teuthology.orchestra.run.smithi049.stdout: "op_rmw": 0, 2024-03-16T07:39:06.910 INFO:teuthology.orchestra.run.smithi049.stdout: "op_pg": 0, 2024-03-16T07:39:06.910 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_stat": 0, 2024-03-16T07:39:06.910 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_create": 0, 2024-03-16T07:39:06.911 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_read": 0, 2024-03-16T07:39:06.911 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_write": 0, 2024-03-16T07:39:06.911 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_writefull": 0, 2024-03-16T07:39:06.911 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_writesame": 0, 2024-03-16T07:39:06.911 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_append": 0, 2024-03-16T07:39:06.911 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_zero": 0, 2024-03-16T07:39:06.911 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_truncate": 0, 2024-03-16T07:39:06.911 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_delete": 0, 2024-03-16T07:39:06.911 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_mapext": 0, 2024-03-16T07:39:06.911 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_sparse_read": 0, 2024-03-16T07:39:06.911 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_clonerange": 0, 2024-03-16T07:39:06.911 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_getxattr": 0, 2024-03-16T07:39:06.911 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_setxattr": 0, 2024-03-16T07:39:06.911 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_cmpxattr": 0, 2024-03-16T07:39:06.911 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_rmxattr": 0, 2024-03-16T07:39:06.912 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_resetxattrs": 0, 2024-03-16T07:39:06.912 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_call": 0, 2024-03-16T07:39:06.912 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_watch": 0, 2024-03-16T07:39:06.912 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_notify": 0, 2024-03-16T07:39:06.912 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_src_cmpxattr": 0, 2024-03-16T07:39:06.912 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_pgls": 0, 2024-03-16T07:39:06.912 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_pgls_filter": 0, 2024-03-16T07:39:06.912 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_other": 0, 2024-03-16T07:39:06.912 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_active": 0, 2024-03-16T07:39:06.912 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_send": 0, 2024-03-16T07:39:06.912 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_resend": 0, 2024-03-16T07:39:06.912 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_ping": 0, 2024-03-16T07:39:06.912 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_active": 0, 2024-03-16T07:39:06.912 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_send": 0, 2024-03-16T07:39:06.912 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_resend": 0, 2024-03-16T07:39:06.913 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_active": 0, 2024-03-16T07:39:06.913 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_send": 0, 2024-03-16T07:39:06.913 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_resend": 0, 2024-03-16T07:39:06.913 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_active": 0, 2024-03-16T07:39:06.913 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_send": 0, 2024-03-16T07:39:06.913 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_resend": 0, 2024-03-16T07:39:06.913 INFO:teuthology.orchestra.run.smithi049.stdout: "command_active": 0, 2024-03-16T07:39:06.913 INFO:teuthology.orchestra.run.smithi049.stdout: "command_send": 0, 2024-03-16T07:39:06.913 INFO:teuthology.orchestra.run.smithi049.stdout: "command_resend": 0, 2024-03-16T07:39:06.913 INFO:teuthology.orchestra.run.smithi049.stdout: "map_epoch": 0, 2024-03-16T07:39:06.913 INFO:teuthology.orchestra.run.smithi049.stdout: "map_full": 0, 2024-03-16T07:39:06.913 INFO:teuthology.orchestra.run.smithi049.stdout: "map_inc": 0, 2024-03-16T07:39:06.913 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_sessions": 0, 2024-03-16T07:39:06.913 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_session_open": 0, 2024-03-16T07:39:06.913 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_session_close": 0, 2024-03-16T07:39:06.914 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_laggy": 0, 2024-03-16T07:39:06.914 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_wr": 0, 2024-03-16T07:39:06.914 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_rd": 0, 2024-03-16T07:39:06.914 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_del": 0 2024-03-16T07:39:06.914 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:06.914 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:06.914 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:39:06.914 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-msgr_dispatch_throttler-client": [ 2024-03-16T07:39:06.914 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:39:06.914 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:39:06.914 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:39:06.914 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:39:06.914 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-03-16T07:39:06.914 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:39:06.915 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 124, 2024-03-16T07:39:06.915 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 490920, 2024-03-16T07:39:06.915 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:39:06.915 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 124, 2024-03-16T07:39:06.915 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:39:06.915 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:39:06.915 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 124, 2024-03-16T07:39:06.915 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 490920, 2024-03-16T07:39:06.915 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:39:06.915 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:39:06.915 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:39:06.915 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:39:06.915 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:06.915 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:06.915 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:06.915 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:39:06.916 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-msgr_dispatch_throttler-radosclient": [ 2024-03-16T07:39:06.916 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:39:06.916 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:39:06.916 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:39:06.916 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:39:06.916 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-03-16T07:39:06.916 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:39:06.916 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 92, 2024-03-16T07:39:06.916 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 3141221, 2024-03-16T07:39:06.916 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:39:06.916 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 92, 2024-03-16T07:39:06.916 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:39:06.916 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:39:06.916 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 92, 2024-03-16T07:39:06.916 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 3141221, 2024-03-16T07:39:06.917 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:39:06.917 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:39:06.917 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:39:06.917 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:39:06.917 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:06.917 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:06.917 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:06.917 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:39:06.917 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-objecter_bytes": [ 2024-03-16T07:39:06.917 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:39:06.917 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:39:06.917 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:39:06.917 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:39:06.917 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-03-16T07:39:06.917 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:39:06.918 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 0, 2024-03-16T07:39:06.918 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 0, 2024-03-16T07:39:06.918 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:39:06.918 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 0, 2024-03-16T07:39:06.918 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:39:06.918 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:39:06.918 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 0, 2024-03-16T07:39:06.918 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 0, 2024-03-16T07:39:06.918 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:39:06.918 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:39:06.918 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:39:06.918 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:39:06.918 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:06.918 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:06.918 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:06.919 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:39:06.919 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-objecter_ops": [ 2024-03-16T07:39:06.919 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:39:06.919 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:39:06.919 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:39:06.919 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:39:06.919 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 1024, 2024-03-16T07:39:06.919 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:39:06.919 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 0, 2024-03-16T07:39:06.919 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 0, 2024-03-16T07:39:06.919 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:39:06.919 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 0, 2024-03-16T07:39:06.919 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:39:06.919 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:39:06.919 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 0, 2024-03-16T07:39:06.920 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 0, 2024-03-16T07:39:06.920 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:39:06.920 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:39:06.920 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:39:06.920 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:39:06.920 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:06.920 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:06.920 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:06.920 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2024-03-16T07:39:06.920 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-03-16T07:39:06.921 DEBUG:tasks.cephfs.test_mirroring:command returned={ "AsyncMessenger::Worker": [ { "labels": { "id": "0" }, "counters": { "msgr_connection_ready_timeouts": 0, "msgr_connection_idle_timeouts": 0 } }, { "labels": { "id": "1" }, "counters": { "msgr_connection_ready_timeouts": 0, "msgr_connection_idle_timeouts": 0 } }, { "labels": { "id": "2" }, "counters": { "msgr_connection_ready_timeouts": 0, "msgr_connection_idle_timeouts": 0 } } ], "AsyncMessenger::Worker-0": [ { "labels": {}, "counters": { "msgr_recv_messages": 13, "msgr_send_messages": 175, "msgr_recv_bytes": 1872, "msgr_send_bytes": 1067728, "msgr_created_connections": 26, "msgr_active_connections": 5, "msgr_running_total_time": 2.040295273, "msgr_running_send_time": 0.703530458, "msgr_running_recv_time": 0.173849705, "msgr_running_fast_dispatch_time": 0.000000000, "msgr_send_messages_queue_lat": { "avgcount": 163, "sum": 2.556496083, "avgtime": 0.015684025 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "msgr_recv_encrypted_bytes": 1872, "msgr_send_encrypted_bytes": 1067728 } } ], "AsyncMessenger::Worker-1": [ { "labels": {}, "counters": { "msgr_recv_messages": 124, "msgr_send_messages": 10, "msgr_recv_bytes": 507744, "msgr_send_bytes": 2112, "msgr_created_connections": 4, "msgr_active_connections": 0, "msgr_running_total_time": 2.044660565, "msgr_running_send_time": 0.264069518, "msgr_running_recv_time": 1.157098723, "msgr_running_fast_dispatch_time": 0.194190800, "msgr_send_messages_queue_lat": { "avgcount": 9, "sum": 0.188856872, "avgtime": 0.020984096 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "msgr_recv_encrypted_bytes": 507744, "msgr_send_encrypted_bytes": 2112 } } ], "AsyncMessenger::Worker-2": [ { "labels": {}, "counters": { "msgr_recv_messages": 82, "msgr_send_messages": 13, "msgr_recv_bytes": 3152736, "msgr_send_bytes": 2576, "msgr_created_connections": 3, "msgr_active_connections": 1, "msgr_running_total_time": 4.890038656, "msgr_running_send_time": 0.598237296, "msgr_running_recv_time": 4.385775509, "msgr_running_fast_dispatch_time": 0.000000000, "msgr_send_messages_queue_lat": { "avgcount": 12, "sum": 0.346963753, "avgtime": 0.028913646 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "msgr_recv_encrypted_bytes": 3152736, "msgr_send_encrypted_bytes": 2576 } } ], "cct": [ { "labels": {}, "counters": { "total_workers": 0, "unhealthy_workers": 0 } } ], "cephfs_mirror": [ { "labels": {}, "counters": { "mirrored_filesystems": 2, "mirror_enable_failures": 0 } } ], "cephfs_mirror_mirrored_filesystems": [ { "labels": { "filesystem": "cephfs" }, "counters": { "mirroring_peers": 1, "directory_count": 1 } } ], "cephfs_mirror_peers": [ { "labels": { "peer_cluster_filesystem": "backup_fs", "peer_cluster_name": "ceph", "source_filesystem": "cephfs", "source_fscid": "14" }, "counters": { "snaps_synced": 0, "snaps_deleted": 0, "snaps_renamed": 0, "sync_failures": 6, "avg_sync_time": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "sync_bytes": 0 } } ], "mempool": [ { "labels": {}, "counters": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_cache_buffer_bytes": 0, "bluestore_cache_buffer_items": 0, "bluestore_extent_bytes": 0, "bluestore_extent_items": 0, "bluestore_blob_bytes": 0, "bluestore_blob_items": 0, "bluestore_shared_blob_bytes": 0, "bluestore_shared_blob_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_items": 0, "bluefs_bytes": 0, "bluefs_items": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "buffer_anon_bytes": 621022131, "buffer_anon_items": 220, "buffer_meta_bytes": 7040, "buffer_meta_items": 80, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 33952, "osdmap_items": 334, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "mds_co_bytes": 0, "mds_co_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 } } ], "objecter": [ { "labels": {}, "counters": { "op_active": 0, "op_laggy": 0, "op_send": 0, "op_send_bytes": 0, "op_resend": 0, "op_reply": 0, "op_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "op_inflight": 0, "oplen_avg": { "avgcount": 0, "sum": 0 }, "op": 0, "op_r": 0, "op_w": 0, "op_rmw": 0, "op_pg": 0, "osdop_stat": 0, "osdop_create": 0, "osdop_read": 0, "osdop_write": 0, "osdop_writefull": 0, "osdop_writesame": 0, "osdop_append": 0, "osdop_zero": 0, "osdop_truncate": 0, "osdop_delete": 0, "osdop_mapext": 0, "osdop_sparse_read": 0, "osdop_clonerange": 0, "osdop_getxattr": 0, "osdop_setxattr": 0, "osdop_cmpxattr": 0, "osdop_rmxattr": 0, "osdop_resetxattrs": 0, "osdop_call": 0, "osdop_watch": 0, "osdop_notify": 0, "osdop_src_cmpxattr": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_other": 0, "linger_active": 0, "linger_send": 0, "linger_resend": 0, "linger_ping": 0, "poolop_active": 0, "poolop_send": 0, "poolop_resend": 0, "poolstat_active": 0, "poolstat_send": 0, "poolstat_resend": 0, "statfs_active": 0, "statfs_send": 0, "statfs_resend": 0, "command_active": 0, "command_send": 0, "command_resend": 0, "map_epoch": 0, "map_full": 0, "map_inc": 0, "osd_sessions": 0, "osd_session_open": 0, "osd_session_close": 0, "osd_laggy": 0, "omap_wr": 0, "omap_rd": 0, "omap_del": 0 } } ], "throttle-msgr_dispatch_throttler-client": [ { "labels": {}, "counters": { "val": 0, "max": 104857600, "get_started": 0, "get": 124, "get_sum": 490920, "get_or_fail_fail": 0, "get_or_fail_success": 124, "take": 0, "take_sum": 0, "put": 124, "put_sum": 490920, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ], "throttle-msgr_dispatch_throttler-radosclient": [ { "labels": {}, "counters": { "val": 0, "max": 104857600, "get_started": 0, "get": 92, "get_sum": 3141221, "get_or_fail_fail": 0, "get_or_fail_success": 92, "take": 0, "take_sum": 0, "put": 92, "put_sum": 3141221, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ], "throttle-objecter_bytes": [ { "labels": {}, "counters": { "val": 0, "max": 104857600, "get_started": 0, "get": 0, "get_sum": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "take": 0, "take_sum": 0, "put": 0, "put_sum": 0, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ], "throttle-objecter_ops": [ { "labels": {}, "counters": { "val": 0, "max": 1024, "get_started": 0, "get": 0, "get_sum": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "take": 0, "take_sum": 0, "put": 0, "put_sum": 0, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ] } 2024-03-16T07:39:06.921 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-03-16T07:39:06.922 DEBUG:teuthology.orchestra.run.smithi049:mirror status for fs: cephfs> ceph --admin-daemon /var/run/ceph/cephfs-mirror.asok fs mirror status cephfs@14 2024-03-16T07:39:07.020 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-03-16T07:39:07.021 INFO:teuthology.orchestra.run.smithi049.stdout: "rados_inst": "172.21.15.49:0/1186634239", 2024-03-16T07:39:07.021 INFO:teuthology.orchestra.run.smithi049.stdout: "peers": { 2024-03-16T07:39:07.021 INFO:teuthology.orchestra.run.smithi049.stdout: "8fa2e0a7-a624-43b8-9c12-da3a1afea05a": { 2024-03-16T07:39:07.021 INFO:teuthology.orchestra.run.smithi049.stdout: "remote": { 2024-03-16T07:39:07.021 INFO:teuthology.orchestra.run.smithi049.stdout: "client_name": "client.mirror_remote", 2024-03-16T07:39:07.021 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_name": "ceph", 2024-03-16T07:39:07.021 INFO:teuthology.orchestra.run.smithi049.stdout: "fs_name": "backup_fs" 2024-03-16T07:39:07.021 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:07.021 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:07.021 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:39:07.021 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_dirs": { 2024-03-16T07:39:07.022 INFO:teuthology.orchestra.run.smithi049.stdout: "dir_count": 1 2024-03-16T07:39:07.022 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:07.022 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-03-16T07:39:07.029 DEBUG:tasks.cephfs.test_mirroring:command returned={ "rados_inst": "172.21.15.49:0/1186634239", "peers": { "8fa2e0a7-a624-43b8-9c12-da3a1afea05a": { "remote": { "client_name": "client.mirror_remote", "cluster_name": "ceph", "fs_name": "backup_fs" } } }, "snap_dirs": { "dir_count": 1 } } 2024-03-16T07:39:07.029 DEBUG:tasks.cephfs.test_mirroring:initial dir_count=1 2024-03-16T07:39:07.029 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snapshot mirror add cephfs /d1 2024-03-16T07:39:07.365 INFO:teuthology.orchestra.run.smithi049.stdout:{} 2024-03-16T07:39:09.836 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T07:39:17.378 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-03-16T07:39:17.379 DEBUG:teuthology.orchestra.run.smithi049:mirror status for fs: cephfs> ceph --admin-daemon /var/run/ceph/cephfs-mirror.asok fs mirror status cephfs@14 2024-03-16T07:39:17.482 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-03-16T07:39:17.482 INFO:teuthology.orchestra.run.smithi049.stdout: "rados_inst": "172.21.15.49:0/1186634239", 2024-03-16T07:39:17.482 INFO:teuthology.orchestra.run.smithi049.stdout: "peers": { 2024-03-16T07:39:17.482 INFO:teuthology.orchestra.run.smithi049.stdout: "8fa2e0a7-a624-43b8-9c12-da3a1afea05a": { 2024-03-16T07:39:17.482 INFO:teuthology.orchestra.run.smithi049.stdout: "remote": { 2024-03-16T07:39:17.482 INFO:teuthology.orchestra.run.smithi049.stdout: "client_name": "client.mirror_remote", 2024-03-16T07:39:17.482 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_name": "ceph", 2024-03-16T07:39:17.482 INFO:teuthology.orchestra.run.smithi049.stdout: "fs_name": "backup_fs" 2024-03-16T07:39:17.483 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:17.483 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:17.483 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:39:17.483 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_dirs": { 2024-03-16T07:39:17.483 INFO:teuthology.orchestra.run.smithi049.stdout: "dir_count": 2 2024-03-16T07:39:17.483 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:17.483 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-03-16T07:39:17.490 DEBUG:tasks.cephfs.test_mirroring:command returned={ "rados_inst": "172.21.15.49:0/1186634239", "peers": { "8fa2e0a7-a624-43b8-9c12-da3a1afea05a": { "remote": { "client_name": "client.mirror_remote", "cluster_name": "ceph", "fs_name": "backup_fs" } } }, "snap_dirs": { "dir_count": 2 } } 2024-03-16T07:39:17.490 DEBUG:tasks.cephfs.test_mirroring:new dir_count=2 2024-03-16T07:39:17.490 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-03-16T07:39:17.490 DEBUG:teuthology.orchestra.run.smithi049:counter dump for fs: cephfs> ceph --admin-daemon /var/run/ceph/cephfs-mirror.asok counter dump 2024-03-16T07:39:17.605 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-03-16T07:39:17.605 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker": [ 2024-03-16T07:39:17.605 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:39:17.605 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:39:17.605 INFO:teuthology.orchestra.run.smithi049.stdout: "id": "0" 2024-03-16T07:39:17.605 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:39:17.605 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:39:17.605 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_ready_timeouts": 0, 2024-03-16T07:39:17.606 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_idle_timeouts": 0 2024-03-16T07:39:17.606 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:17.606 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:39:17.606 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:39:17.606 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:39:17.606 INFO:teuthology.orchestra.run.smithi049.stdout: "id": "1" 2024-03-16T07:39:17.606 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:39:17.606 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:39:17.606 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_ready_timeouts": 0, 2024-03-16T07:39:17.606 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_idle_timeouts": 0 2024-03-16T07:39:17.607 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:17.607 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:39:17.607 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:39:17.607 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:39:17.607 INFO:teuthology.orchestra.run.smithi049.stdout: "id": "2" 2024-03-16T07:39:17.607 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:39:17.607 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:39:17.607 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_ready_timeouts": 0, 2024-03-16T07:39:17.607 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_idle_timeouts": 0 2024-03-16T07:39:17.607 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:17.607 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:17.607 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:39:17.607 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-0": [ 2024-03-16T07:39:17.608 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:39:17.608 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:39:17.608 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:39:17.608 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 13, 2024-03-16T07:39:17.608 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 178, 2024-03-16T07:39:17.608 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 1872, 2024-03-16T07:39:17.608 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 1068704, 2024-03-16T07:39:17.608 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 26, 2024-03-16T07:39:17.608 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 5, 2024-03-16T07:39:17.608 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 2.041602467, 2024-03-16T07:39:17.608 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.704730287, 2024-03-16T07:39:17.608 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 0.173849705, 2024-03-16T07:39:17.608 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-03-16T07:39:17.609 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T07:39:17.609 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 166, 2024-03-16T07:39:17.609 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 2.556965177, 2024-03-16T07:39:17.609 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.015403404 2024-03-16T07:39:17.609 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:39:17.609 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-03-16T07:39:17.609 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:39:17.609 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:39:17.609 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:39:17.609 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:39:17.609 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 1872, 2024-03-16T07:39:17.609 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 1068704 2024-03-16T07:39:17.609 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:17.609 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:17.610 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:39:17.610 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-1": [ 2024-03-16T07:39:17.610 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:39:17.610 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:39:17.610 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:39:17.610 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 124, 2024-03-16T07:39:17.610 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 10, 2024-03-16T07:39:17.610 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 507744, 2024-03-16T07:39:17.610 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 2112, 2024-03-16T07:39:17.610 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 4, 2024-03-16T07:39:17.610 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 0, 2024-03-16T07:39:17.610 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 2.045292250, 2024-03-16T07:39:17.610 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.264131183, 2024-03-16T07:39:17.610 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 1.157315433, 2024-03-16T07:39:17.611 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.194190800, 2024-03-16T07:39:17.611 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T07:39:17.611 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 9, 2024-03-16T07:39:17.611 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.188856872, 2024-03-16T07:39:17.611 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.020984096 2024-03-16T07:39:17.611 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:39:17.611 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-03-16T07:39:17.611 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:39:17.611 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:39:17.611 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:39:17.611 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:39:17.611 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 507744, 2024-03-16T07:39:17.611 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 2112 2024-03-16T07:39:17.611 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:17.611 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:17.612 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:39:17.612 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-2": [ 2024-03-16T07:39:17.612 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:39:17.612 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:39:17.612 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:39:17.612 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 82, 2024-03-16T07:39:17.612 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 13, 2024-03-16T07:39:17.612 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 3152736, 2024-03-16T07:39:17.612 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 2576, 2024-03-16T07:39:17.612 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 3, 2024-03-16T07:39:17.612 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 1, 2024-03-16T07:39:17.612 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 4.890430419, 2024-03-16T07:39:17.612 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.598288080, 2024-03-16T07:39:17.613 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 4.385908202, 2024-03-16T07:39:17.613 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-03-16T07:39:17.613 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T07:39:17.613 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 12, 2024-03-16T07:39:17.613 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.346963753, 2024-03-16T07:39:17.613 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.028913646 2024-03-16T07:39:17.613 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:39:17.613 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-03-16T07:39:17.613 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:39:17.613 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:39:17.613 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:39:17.613 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:39:17.613 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 3152736, 2024-03-16T07:39:17.613 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 2576 2024-03-16T07:39:17.613 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:17.614 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:17.614 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:39:17.614 INFO:teuthology.orchestra.run.smithi049.stdout: "cct": [ 2024-03-16T07:39:17.614 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:39:17.614 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:39:17.614 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:39:17.614 INFO:teuthology.orchestra.run.smithi049.stdout: "total_workers": 0, 2024-03-16T07:39:17.614 INFO:teuthology.orchestra.run.smithi049.stdout: "unhealthy_workers": 0 2024-03-16T07:39:17.614 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:17.614 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:17.614 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:39:17.614 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs_mirror": [ 2024-03-16T07:39:17.614 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:39:17.614 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:39:17.615 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:39:17.615 INFO:teuthology.orchestra.run.smithi049.stdout: "mirrored_filesystems": 2, 2024-03-16T07:39:17.615 INFO:teuthology.orchestra.run.smithi049.stdout: "mirror_enable_failures": 0 2024-03-16T07:39:17.615 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:17.615 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:17.615 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:39:17.615 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs_mirror_mirrored_filesystems": [ 2024-03-16T07:39:17.615 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:39:17.615 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:39:17.615 INFO:teuthology.orchestra.run.smithi049.stdout: "filesystem": "cephfs" 2024-03-16T07:39:17.615 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:39:17.615 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:39:17.615 INFO:teuthology.orchestra.run.smithi049.stdout: "mirroring_peers": 1, 2024-03-16T07:39:17.615 INFO:teuthology.orchestra.run.smithi049.stdout: "directory_count": 2 2024-03-16T07:39:17.616 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:17.616 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:17.616 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:39:17.616 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs_mirror_peers": [ 2024-03-16T07:39:17.616 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:39:17.616 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:39:17.616 INFO:teuthology.orchestra.run.smithi049.stdout: "peer_cluster_filesystem": "backup_fs", 2024-03-16T07:39:17.616 INFO:teuthology.orchestra.run.smithi049.stdout: "peer_cluster_name": "ceph", 2024-03-16T07:39:17.616 INFO:teuthology.orchestra.run.smithi049.stdout: "source_filesystem": "cephfs", 2024-03-16T07:39:17.616 INFO:teuthology.orchestra.run.smithi049.stdout: "source_fscid": "14" 2024-03-16T07:39:17.616 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:39:17.616 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:39:17.616 INFO:teuthology.orchestra.run.smithi049.stdout: "snaps_synced": 0, 2024-03-16T07:39:17.616 INFO:teuthology.orchestra.run.smithi049.stdout: "snaps_deleted": 0, 2024-03-16T07:39:17.616 INFO:teuthology.orchestra.run.smithi049.stdout: "snaps_renamed": 0, 2024-03-16T07:39:17.617 INFO:teuthology.orchestra.run.smithi049.stdout: "sync_failures": 6, 2024-03-16T07:39:17.617 INFO:teuthology.orchestra.run.smithi049.stdout: "avg_sync_time": { 2024-03-16T07:39:17.617 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:39:17.617 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:39:17.617 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:39:17.617 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:39:17.617 INFO:teuthology.orchestra.run.smithi049.stdout: "sync_bytes": 0 2024-03-16T07:39:17.617 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:17.617 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:17.617 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:39:17.617 INFO:teuthology.orchestra.run.smithi049.stdout: "mempool": [ 2024-03-16T07:39:17.617 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:39:17.617 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:39:17.617 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:39:17.617 INFO:teuthology.orchestra.run.smithi049.stdout: "bloom_filter_bytes": 0, 2024-03-16T07:39:17.618 INFO:teuthology.orchestra.run.smithi049.stdout: "bloom_filter_items": 0, 2024-03-16T07:39:17.618 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_alloc_bytes": 0, 2024-03-16T07:39:17.618 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_alloc_items": 0, 2024-03-16T07:39:17.618 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_data_bytes": 0, 2024-03-16T07:39:17.618 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_data_items": 0, 2024-03-16T07:39:17.618 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_onode_bytes": 0, 2024-03-16T07:39:17.618 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_onode_items": 0, 2024-03-16T07:39:17.618 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_meta_bytes": 0, 2024-03-16T07:39:17.618 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_meta_items": 0, 2024-03-16T07:39:17.618 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_other_bytes": 0, 2024-03-16T07:39:17.618 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_other_items": 0, 2024-03-16T07:39:17.618 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_buffer_bytes": 0, 2024-03-16T07:39:17.618 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_buffer_items": 0, 2024-03-16T07:39:17.618 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_extent_bytes": 0, 2024-03-16T07:39:17.618 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_extent_items": 0, 2024-03-16T07:39:17.619 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_blob_bytes": 0, 2024-03-16T07:39:17.619 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_blob_items": 0, 2024-03-16T07:39:17.619 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_shared_blob_bytes": 0, 2024-03-16T07:39:17.619 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_shared_blob_items": 0, 2024-03-16T07:39:17.619 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_inline_bl_bytes": 0, 2024-03-16T07:39:17.619 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_inline_bl_items": 0, 2024-03-16T07:39:17.619 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_fsck_bytes": 0, 2024-03-16T07:39:17.619 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_fsck_items": 0, 2024-03-16T07:39:17.619 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_txc_bytes": 0, 2024-03-16T07:39:17.619 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_txc_items": 0, 2024-03-16T07:39:17.619 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_deferred_bytes": 0, 2024-03-16T07:39:17.619 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_deferred_items": 0, 2024-03-16T07:39:17.619 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_bytes": 0, 2024-03-16T07:39:17.619 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_items": 0, 2024-03-16T07:39:17.619 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_bytes": 0, 2024-03-16T07:39:17.620 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_items": 0, 2024-03-16T07:39:17.620 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_reader_bytes": 0, 2024-03-16T07:39:17.620 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_reader_items": 0, 2024-03-16T07:39:17.620 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_writer_bytes": 0, 2024-03-16T07:39:17.620 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_writer_items": 0, 2024-03-16T07:39:17.620 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_anon_bytes": 621022131, 2024-03-16T07:39:17.620 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_anon_items": 220, 2024-03-16T07:39:17.620 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_meta_bytes": 7040, 2024-03-16T07:39:17.620 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_meta_items": 80, 2024-03-16T07:39:17.620 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_bytes": 0, 2024-03-16T07:39:17.620 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_items": 0, 2024-03-16T07:39:17.620 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_mapbl_bytes": 0, 2024-03-16T07:39:17.620 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_mapbl_items": 0, 2024-03-16T07:39:17.620 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pglog_bytes": 0, 2024-03-16T07:39:17.620 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pglog_items": 0, 2024-03-16T07:39:17.621 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_bytes": 33952, 2024-03-16T07:39:17.621 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_items": 334, 2024-03-16T07:39:17.621 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_mapping_bytes": 0, 2024-03-16T07:39:17.621 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_mapping_items": 0, 2024-03-16T07:39:17.621 INFO:teuthology.orchestra.run.smithi049.stdout: "pgmap_bytes": 0, 2024-03-16T07:39:17.621 INFO:teuthology.orchestra.run.smithi049.stdout: "pgmap_items": 0, 2024-03-16T07:39:17.621 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_co_bytes": 0, 2024-03-16T07:39:17.621 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_co_items": 0, 2024-03-16T07:39:17.621 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_1_bytes": 0, 2024-03-16T07:39:17.621 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_1_items": 0, 2024-03-16T07:39:17.621 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_2_bytes": 0, 2024-03-16T07:39:17.621 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_2_items": 0 2024-03-16T07:39:17.621 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:17.621 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:17.622 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:39:17.622 INFO:teuthology.orchestra.run.smithi049.stdout: "objecter": [ 2024-03-16T07:39:17.622 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:39:17.622 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:39:17.622 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:39:17.622 INFO:teuthology.orchestra.run.smithi049.stdout: "op_active": 0, 2024-03-16T07:39:17.622 INFO:teuthology.orchestra.run.smithi049.stdout: "op_laggy": 0, 2024-03-16T07:39:17.622 INFO:teuthology.orchestra.run.smithi049.stdout: "op_send": 0, 2024-03-16T07:39:17.622 INFO:teuthology.orchestra.run.smithi049.stdout: "op_send_bytes": 0, 2024-03-16T07:39:17.622 INFO:teuthology.orchestra.run.smithi049.stdout: "op_resend": 0, 2024-03-16T07:39:17.622 INFO:teuthology.orchestra.run.smithi049.stdout: "op_reply": 0, 2024-03-16T07:39:17.622 INFO:teuthology.orchestra.run.smithi049.stdout: "op_latency": { 2024-03-16T07:39:17.622 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:39:17.623 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:39:17.623 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:39:17.623 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:39:17.623 INFO:teuthology.orchestra.run.smithi049.stdout: "op_inflight": 0, 2024-03-16T07:39:17.623 INFO:teuthology.orchestra.run.smithi049.stdout: "oplen_avg": { 2024-03-16T07:39:17.623 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:39:17.623 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0 2024-03-16T07:39:17.623 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:39:17.623 INFO:teuthology.orchestra.run.smithi049.stdout: "op": 0, 2024-03-16T07:39:17.623 INFO:teuthology.orchestra.run.smithi049.stdout: "op_r": 0, 2024-03-16T07:39:17.623 INFO:teuthology.orchestra.run.smithi049.stdout: "op_w": 0, 2024-03-16T07:39:17.623 INFO:teuthology.orchestra.run.smithi049.stdout: "op_rmw": 0, 2024-03-16T07:39:17.623 INFO:teuthology.orchestra.run.smithi049.stdout: "op_pg": 0, 2024-03-16T07:39:17.623 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_stat": 0, 2024-03-16T07:39:17.624 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_create": 0, 2024-03-16T07:39:17.624 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_read": 0, 2024-03-16T07:39:17.624 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_write": 0, 2024-03-16T07:39:17.624 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_writefull": 0, 2024-03-16T07:39:17.624 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_writesame": 0, 2024-03-16T07:39:17.624 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_append": 0, 2024-03-16T07:39:17.624 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_zero": 0, 2024-03-16T07:39:17.624 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_truncate": 0, 2024-03-16T07:39:17.624 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_delete": 0, 2024-03-16T07:39:17.624 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_mapext": 0, 2024-03-16T07:39:17.624 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_sparse_read": 0, 2024-03-16T07:39:17.624 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_clonerange": 0, 2024-03-16T07:39:17.624 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_getxattr": 0, 2024-03-16T07:39:17.624 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_setxattr": 0, 2024-03-16T07:39:17.624 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_cmpxattr": 0, 2024-03-16T07:39:17.625 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_rmxattr": 0, 2024-03-16T07:39:17.625 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_resetxattrs": 0, 2024-03-16T07:39:17.625 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_call": 0, 2024-03-16T07:39:17.625 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_watch": 0, 2024-03-16T07:39:17.625 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_notify": 0, 2024-03-16T07:39:17.625 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_src_cmpxattr": 0, 2024-03-16T07:39:17.625 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_pgls": 0, 2024-03-16T07:39:17.625 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_pgls_filter": 0, 2024-03-16T07:39:17.625 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_other": 0, 2024-03-16T07:39:17.625 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_active": 0, 2024-03-16T07:39:17.625 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_send": 0, 2024-03-16T07:39:17.625 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_resend": 0, 2024-03-16T07:39:17.625 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_ping": 0, 2024-03-16T07:39:17.625 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_active": 0, 2024-03-16T07:39:17.626 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_send": 0, 2024-03-16T07:39:17.626 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_resend": 0, 2024-03-16T07:39:17.626 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_active": 0, 2024-03-16T07:39:17.626 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_send": 0, 2024-03-16T07:39:17.626 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_resend": 0, 2024-03-16T07:39:17.626 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_active": 0, 2024-03-16T07:39:17.626 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_send": 0, 2024-03-16T07:39:17.626 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_resend": 0, 2024-03-16T07:39:17.626 INFO:teuthology.orchestra.run.smithi049.stdout: "command_active": 0, 2024-03-16T07:39:17.626 INFO:teuthology.orchestra.run.smithi049.stdout: "command_send": 0, 2024-03-16T07:39:17.626 INFO:teuthology.orchestra.run.smithi049.stdout: "command_resend": 0, 2024-03-16T07:39:17.626 INFO:teuthology.orchestra.run.smithi049.stdout: "map_epoch": 0, 2024-03-16T07:39:17.626 INFO:teuthology.orchestra.run.smithi049.stdout: "map_full": 0, 2024-03-16T07:39:17.627 INFO:teuthology.orchestra.run.smithi049.stdout: "map_inc": 0, 2024-03-16T07:39:17.627 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_sessions": 0, 2024-03-16T07:39:17.627 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_session_open": 0, 2024-03-16T07:39:17.627 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_session_close": 0, 2024-03-16T07:39:17.627 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_laggy": 0, 2024-03-16T07:39:17.627 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_wr": 0, 2024-03-16T07:39:17.627 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_rd": 0, 2024-03-16T07:39:17.627 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_del": 0 2024-03-16T07:39:17.627 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:17.627 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:17.627 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:39:17.627 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-msgr_dispatch_throttler-client": [ 2024-03-16T07:39:17.627 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:39:17.627 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:39:17.627 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:39:17.628 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:39:17.628 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-03-16T07:39:17.628 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:39:17.628 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 124, 2024-03-16T07:39:17.628 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 490920, 2024-03-16T07:39:17.628 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:39:17.628 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 124, 2024-03-16T07:39:17.628 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:39:17.628 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:39:17.628 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 124, 2024-03-16T07:39:17.628 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 490920, 2024-03-16T07:39:17.628 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:39:17.628 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:39:17.629 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:39:17.629 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:39:17.629 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:17.629 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:17.629 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:17.629 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:39:17.629 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-msgr_dispatch_throttler-radosclient": [ 2024-03-16T07:39:17.629 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:39:17.629 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:39:17.629 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:39:17.629 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:39:17.629 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-03-16T07:39:17.630 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:39:17.630 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 92, 2024-03-16T07:39:17.630 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 3141221, 2024-03-16T07:39:17.630 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:39:17.630 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 92, 2024-03-16T07:39:17.630 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:39:17.630 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:39:17.630 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 92, 2024-03-16T07:39:17.630 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 3141221, 2024-03-16T07:39:17.630 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:39:17.630 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:39:17.631 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:39:17.631 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:39:17.631 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:17.631 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:17.631 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:17.631 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:39:17.631 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-objecter_bytes": [ 2024-03-16T07:39:17.631 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:39:17.631 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:39:17.631 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:39:17.631 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:39:17.631 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-03-16T07:39:17.631 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:39:17.631 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 0, 2024-03-16T07:39:17.631 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 0, 2024-03-16T07:39:17.632 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:39:17.632 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 0, 2024-03-16T07:39:17.632 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:39:17.632 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:39:17.632 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 0, 2024-03-16T07:39:17.632 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 0, 2024-03-16T07:39:17.632 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:39:17.632 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:39:17.632 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:39:17.632 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:39:17.632 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:17.632 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:17.632 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:17.632 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:39:17.632 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-objecter_ops": [ 2024-03-16T07:39:17.633 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:39:17.633 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:39:17.633 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:39:17.633 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:39:17.633 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 1024, 2024-03-16T07:39:17.633 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:39:17.633 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 0, 2024-03-16T07:39:17.633 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 0, 2024-03-16T07:39:17.633 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:39:17.633 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 0, 2024-03-16T07:39:17.633 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:39:17.633 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:39:17.633 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 0, 2024-03-16T07:39:17.633 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 0, 2024-03-16T07:39:17.633 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:39:17.633 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:39:17.634 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:39:17.634 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:39:17.634 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:17.634 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:17.634 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:17.634 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2024-03-16T07:39:17.634 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-03-16T07:39:17.635 DEBUG:tasks.cephfs.test_mirroring:command returned={ "AsyncMessenger::Worker": [ { "labels": { "id": "0" }, "counters": { "msgr_connection_ready_timeouts": 0, "msgr_connection_idle_timeouts": 0 } }, { "labels": { "id": "1" }, "counters": { "msgr_connection_ready_timeouts": 0, "msgr_connection_idle_timeouts": 0 } }, { "labels": { "id": "2" }, "counters": { "msgr_connection_ready_timeouts": 0, "msgr_connection_idle_timeouts": 0 } } ], "AsyncMessenger::Worker-0": [ { "labels": {}, "counters": { "msgr_recv_messages": 13, "msgr_send_messages": 178, "msgr_recv_bytes": 1872, "msgr_send_bytes": 1068704, "msgr_created_connections": 26, "msgr_active_connections": 5, "msgr_running_total_time": 2.041602467, "msgr_running_send_time": 0.704730287, "msgr_running_recv_time": 0.173849705, "msgr_running_fast_dispatch_time": 0.000000000, "msgr_send_messages_queue_lat": { "avgcount": 166, "sum": 2.556965177, "avgtime": 0.015403404 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "msgr_recv_encrypted_bytes": 1872, "msgr_send_encrypted_bytes": 1068704 } } ], "AsyncMessenger::Worker-1": [ { "labels": {}, "counters": { "msgr_recv_messages": 124, "msgr_send_messages": 10, "msgr_recv_bytes": 507744, "msgr_send_bytes": 2112, "msgr_created_connections": 4, "msgr_active_connections": 0, "msgr_running_total_time": 2.045292250, "msgr_running_send_time": 0.264131183, "msgr_running_recv_time": 1.157315433, "msgr_running_fast_dispatch_time": 0.194190800, "msgr_send_messages_queue_lat": { "avgcount": 9, "sum": 0.188856872, "avgtime": 0.020984096 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "msgr_recv_encrypted_bytes": 507744, "msgr_send_encrypted_bytes": 2112 } } ], "AsyncMessenger::Worker-2": [ { "labels": {}, "counters": { "msgr_recv_messages": 82, "msgr_send_messages": 13, "msgr_recv_bytes": 3152736, "msgr_send_bytes": 2576, "msgr_created_connections": 3, "msgr_active_connections": 1, "msgr_running_total_time": 4.890430419, "msgr_running_send_time": 0.598288080, "msgr_running_recv_time": 4.385908202, "msgr_running_fast_dispatch_time": 0.000000000, "msgr_send_messages_queue_lat": { "avgcount": 12, "sum": 0.346963753, "avgtime": 0.028913646 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "msgr_recv_encrypted_bytes": 3152736, "msgr_send_encrypted_bytes": 2576 } } ], "cct": [ { "labels": {}, "counters": { "total_workers": 0, "unhealthy_workers": 0 } } ], "cephfs_mirror": [ { "labels": {}, "counters": { "mirrored_filesystems": 2, "mirror_enable_failures": 0 } } ], "cephfs_mirror_mirrored_filesystems": [ { "labels": { "filesystem": "cephfs" }, "counters": { "mirroring_peers": 1, "directory_count": 2 } } ], "cephfs_mirror_peers": [ { "labels": { "peer_cluster_filesystem": "backup_fs", "peer_cluster_name": "ceph", "source_filesystem": "cephfs", "source_fscid": "14" }, "counters": { "snaps_synced": 0, "snaps_deleted": 0, "snaps_renamed": 0, "sync_failures": 6, "avg_sync_time": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "sync_bytes": 0 } } ], "mempool": [ { "labels": {}, "counters": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_cache_buffer_bytes": 0, "bluestore_cache_buffer_items": 0, "bluestore_extent_bytes": 0, "bluestore_extent_items": 0, "bluestore_blob_bytes": 0, "bluestore_blob_items": 0, "bluestore_shared_blob_bytes": 0, "bluestore_shared_blob_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_items": 0, "bluefs_bytes": 0, "bluefs_items": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "buffer_anon_bytes": 621022131, "buffer_anon_items": 220, "buffer_meta_bytes": 7040, "buffer_meta_items": 80, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 33952, "osdmap_items": 334, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "mds_co_bytes": 0, "mds_co_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 } } ], "objecter": [ { "labels": {}, "counters": { "op_active": 0, "op_laggy": 0, "op_send": 0, "op_send_bytes": 0, "op_resend": 0, "op_reply": 0, "op_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "op_inflight": 0, "oplen_avg": { "avgcount": 0, "sum": 0 }, "op": 0, "op_r": 0, "op_w": 0, "op_rmw": 0, "op_pg": 0, "osdop_stat": 0, "osdop_create": 0, "osdop_read": 0, "osdop_write": 0, "osdop_writefull": 0, "osdop_writesame": 0, "osdop_append": 0, "osdop_zero": 0, "osdop_truncate": 0, "osdop_delete": 0, "osdop_mapext": 0, "osdop_sparse_read": 0, "osdop_clonerange": 0, "osdop_getxattr": 0, "osdop_setxattr": 0, "osdop_cmpxattr": 0, "osdop_rmxattr": 0, "osdop_resetxattrs": 0, "osdop_call": 0, "osdop_watch": 0, "osdop_notify": 0, "osdop_src_cmpxattr": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_other": 0, "linger_active": 0, "linger_send": 0, "linger_resend": 0, "linger_ping": 0, "poolop_active": 0, "poolop_send": 0, "poolop_resend": 0, "poolstat_active": 0, "poolstat_send": 0, "poolstat_resend": 0, "statfs_active": 0, "statfs_send": 0, "statfs_resend": 0, "command_active": 0, "command_send": 0, "command_resend": 0, "map_epoch": 0, "map_full": 0, "map_inc": 0, "osd_sessions": 0, "osd_session_open": 0, "osd_session_close": 0, "osd_laggy": 0, "omap_wr": 0, "omap_rd": 0, "omap_del": 0 } } ], "throttle-msgr_dispatch_throttler-client": [ { "labels": {}, "counters": { "val": 0, "max": 104857600, "get_started": 0, "get": 124, "get_sum": 490920, "get_or_fail_fail": 0, "get_or_fail_success": 124, "take": 0, "take_sum": 0, "put": 124, "put_sum": 490920, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ], "throttle-msgr_dispatch_throttler-radosclient": [ { "labels": {}, "counters": { "val": 0, "max": 104857600, "get_started": 0, "get": 92, "get_sum": 3141221, "get_or_fail_fail": 0, "get_or_fail_success": 92, "take": 0, "take_sum": 0, "put": 92, "put_sum": 3141221, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ], "throttle-objecter_bytes": [ { "labels": {}, "counters": { "val": 0, "max": 104857600, "get_started": 0, "get": 0, "get_sum": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "take": 0, "take_sum": 0, "put": 0, "put_sum": 0, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ], "throttle-objecter_ops": [ { "labels": {}, "counters": { "val": 0, "max": 1024, "get_started": 0, "get": 0, "get_sum": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "take": 0, "take_sum": 0, "put": 0, "put_sum": 0, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ] } 2024-03-16T07:39:17.635 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-03-16T07:39:17.636 DEBUG:teuthology.orchestra.run.smithi049:counter dump for fs: cephfs> ceph --admin-daemon /var/run/ceph/cephfs-mirror.asok counter dump 2024-03-16T07:39:17.759 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-03-16T07:39:17.759 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker": [ 2024-03-16T07:39:17.759 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:39:17.759 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:39:17.759 INFO:teuthology.orchestra.run.smithi049.stdout: "id": "0" 2024-03-16T07:39:17.759 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:39:17.759 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:39:17.760 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_ready_timeouts": 0, 2024-03-16T07:39:17.760 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_idle_timeouts": 0 2024-03-16T07:39:17.760 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:17.760 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:39:17.760 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:39:17.760 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:39:17.760 INFO:teuthology.orchestra.run.smithi049.stdout: "id": "1" 2024-03-16T07:39:17.760 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:39:17.760 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:39:17.760 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_ready_timeouts": 0, 2024-03-16T07:39:17.760 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_idle_timeouts": 0 2024-03-16T07:39:17.760 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:17.760 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:39:17.760 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:39:17.760 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:39:17.761 INFO:teuthology.orchestra.run.smithi049.stdout: "id": "2" 2024-03-16T07:39:17.761 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:39:17.761 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:39:17.761 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_ready_timeouts": 0, 2024-03-16T07:39:17.761 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_idle_timeouts": 0 2024-03-16T07:39:17.761 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:17.761 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:17.761 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:39:17.761 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-0": [ 2024-03-16T07:39:17.761 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:39:17.761 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:39:17.761 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:39:17.761 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 13, 2024-03-16T07:39:17.762 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 178, 2024-03-16T07:39:17.762 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 1872, 2024-03-16T07:39:17.762 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 1068704, 2024-03-16T07:39:17.762 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 26, 2024-03-16T07:39:17.762 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 5, 2024-03-16T07:39:17.762 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 2.041602467, 2024-03-16T07:39:17.762 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.704730287, 2024-03-16T07:39:17.762 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 0.173849705, 2024-03-16T07:39:17.762 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-03-16T07:39:17.762 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T07:39:17.762 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 166, 2024-03-16T07:39:17.762 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 2.556965177, 2024-03-16T07:39:17.762 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.015403404 2024-03-16T07:39:17.763 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:39:17.763 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-03-16T07:39:17.763 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:39:17.763 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:39:17.763 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:39:17.763 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:39:17.763 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 1872, 2024-03-16T07:39:17.763 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 1068704 2024-03-16T07:39:17.763 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:17.763 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:17.763 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:39:17.763 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-1": [ 2024-03-16T07:39:17.763 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:39:17.764 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:39:17.764 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:39:17.764 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 124, 2024-03-16T07:39:17.764 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 10, 2024-03-16T07:39:17.764 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 507744, 2024-03-16T07:39:17.764 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 2112, 2024-03-16T07:39:17.764 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 4, 2024-03-16T07:39:17.764 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 0, 2024-03-16T07:39:17.764 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 2.045292250, 2024-03-16T07:39:17.764 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.264131183, 2024-03-16T07:39:17.764 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 1.157315433, 2024-03-16T07:39:17.764 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.194190800, 2024-03-16T07:39:17.764 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T07:39:17.764 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 9, 2024-03-16T07:39:17.764 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.188856872, 2024-03-16T07:39:17.765 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.020984096 2024-03-16T07:39:17.765 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:39:17.765 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-03-16T07:39:17.765 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:39:17.765 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:39:17.765 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:39:17.765 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:39:17.765 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 507744, 2024-03-16T07:39:17.765 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 2112 2024-03-16T07:39:17.765 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:17.765 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:17.765 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:39:17.766 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-2": [ 2024-03-16T07:39:17.766 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:39:17.766 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:39:17.766 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:39:17.766 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 82, 2024-03-16T07:39:17.766 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 13, 2024-03-16T07:39:17.766 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 3152736, 2024-03-16T07:39:17.766 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 2576, 2024-03-16T07:39:17.766 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 3, 2024-03-16T07:39:17.766 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 1, 2024-03-16T07:39:17.766 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 4.890430419, 2024-03-16T07:39:17.766 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.598288080, 2024-03-16T07:39:17.766 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 4.385908202, 2024-03-16T07:39:17.766 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-03-16T07:39:17.766 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T07:39:17.767 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 12, 2024-03-16T07:39:17.767 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.346963753, 2024-03-16T07:39:17.767 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.028913646 2024-03-16T07:39:17.767 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:39:17.767 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-03-16T07:39:17.767 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:39:17.767 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:39:17.767 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:39:17.767 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:39:17.767 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 3152736, 2024-03-16T07:39:17.767 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 2576 2024-03-16T07:39:17.767 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:17.767 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:17.767 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:39:17.767 INFO:teuthology.orchestra.run.smithi049.stdout: "cct": [ 2024-03-16T07:39:17.768 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:39:17.768 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:39:17.768 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:39:17.768 INFO:teuthology.orchestra.run.smithi049.stdout: "total_workers": 0, 2024-03-16T07:39:17.768 INFO:teuthology.orchestra.run.smithi049.stdout: "unhealthy_workers": 0 2024-03-16T07:39:17.768 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:17.768 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:17.768 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:39:17.768 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs_mirror": [ 2024-03-16T07:39:17.768 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:39:17.768 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:39:17.768 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:39:17.768 INFO:teuthology.orchestra.run.smithi049.stdout: "mirrored_filesystems": 2, 2024-03-16T07:39:17.769 INFO:teuthology.orchestra.run.smithi049.stdout: "mirror_enable_failures": 0 2024-03-16T07:39:17.769 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:17.769 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:17.769 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:39:17.769 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs_mirror_mirrored_filesystems": [ 2024-03-16T07:39:17.769 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:39:17.769 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:39:17.769 INFO:teuthology.orchestra.run.smithi049.stdout: "filesystem": "cephfs" 2024-03-16T07:39:17.769 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:39:17.769 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:39:17.769 INFO:teuthology.orchestra.run.smithi049.stdout: "mirroring_peers": 1, 2024-03-16T07:39:17.769 INFO:teuthology.orchestra.run.smithi049.stdout: "directory_count": 2 2024-03-16T07:39:17.769 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:17.769 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:17.770 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:39:17.770 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs_mirror_peers": [ 2024-03-16T07:39:17.770 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:39:17.770 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:39:17.770 INFO:teuthology.orchestra.run.smithi049.stdout: "peer_cluster_filesystem": "backup_fs", 2024-03-16T07:39:17.770 INFO:teuthology.orchestra.run.smithi049.stdout: "peer_cluster_name": "ceph", 2024-03-16T07:39:17.770 INFO:teuthology.orchestra.run.smithi049.stdout: "source_filesystem": "cephfs", 2024-03-16T07:39:17.770 INFO:teuthology.orchestra.run.smithi049.stdout: "source_fscid": "14" 2024-03-16T07:39:17.770 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:39:17.770 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:39:17.770 INFO:teuthology.orchestra.run.smithi049.stdout: "snaps_synced": 0, 2024-03-16T07:39:17.770 INFO:teuthology.orchestra.run.smithi049.stdout: "snaps_deleted": 0, 2024-03-16T07:39:17.770 INFO:teuthology.orchestra.run.smithi049.stdout: "snaps_renamed": 0, 2024-03-16T07:39:17.771 INFO:teuthology.orchestra.run.smithi049.stdout: "sync_failures": 6, 2024-03-16T07:39:17.771 INFO:teuthology.orchestra.run.smithi049.stdout: "avg_sync_time": { 2024-03-16T07:39:17.771 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:39:17.771 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:39:17.771 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:39:17.771 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:39:17.771 INFO:teuthology.orchestra.run.smithi049.stdout: "sync_bytes": 0 2024-03-16T07:39:17.771 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:17.771 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:17.771 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:39:17.771 INFO:teuthology.orchestra.run.smithi049.stdout: "mempool": [ 2024-03-16T07:39:17.771 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:39:17.771 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:39:17.771 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:39:17.771 INFO:teuthology.orchestra.run.smithi049.stdout: "bloom_filter_bytes": 0, 2024-03-16T07:39:17.771 INFO:teuthology.orchestra.run.smithi049.stdout: "bloom_filter_items": 0, 2024-03-16T07:39:17.772 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_alloc_bytes": 0, 2024-03-16T07:39:17.772 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_alloc_items": 0, 2024-03-16T07:39:17.772 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_data_bytes": 0, 2024-03-16T07:39:17.772 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_data_items": 0, 2024-03-16T07:39:17.772 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_onode_bytes": 0, 2024-03-16T07:39:17.772 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_onode_items": 0, 2024-03-16T07:39:17.772 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_meta_bytes": 0, 2024-03-16T07:39:17.772 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_meta_items": 0, 2024-03-16T07:39:17.772 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_other_bytes": 0, 2024-03-16T07:39:17.772 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_other_items": 0, 2024-03-16T07:39:17.772 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_buffer_bytes": 0, 2024-03-16T07:39:17.772 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_buffer_items": 0, 2024-03-16T07:39:17.772 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_extent_bytes": 0, 2024-03-16T07:39:17.772 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_extent_items": 0, 2024-03-16T07:39:17.772 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_blob_bytes": 0, 2024-03-16T07:39:17.773 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_blob_items": 0, 2024-03-16T07:39:17.773 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_shared_blob_bytes": 0, 2024-03-16T07:39:17.773 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_shared_blob_items": 0, 2024-03-16T07:39:17.773 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_inline_bl_bytes": 0, 2024-03-16T07:39:17.773 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_inline_bl_items": 0, 2024-03-16T07:39:17.773 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_fsck_bytes": 0, 2024-03-16T07:39:17.773 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_fsck_items": 0, 2024-03-16T07:39:17.773 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_txc_bytes": 0, 2024-03-16T07:39:17.773 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_txc_items": 0, 2024-03-16T07:39:17.773 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_deferred_bytes": 0, 2024-03-16T07:39:17.773 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_deferred_items": 0, 2024-03-16T07:39:17.773 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_bytes": 0, 2024-03-16T07:39:17.773 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_items": 0, 2024-03-16T07:39:17.773 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_bytes": 0, 2024-03-16T07:39:17.773 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_items": 0, 2024-03-16T07:39:17.773 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_reader_bytes": 0, 2024-03-16T07:39:17.774 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_reader_items": 0, 2024-03-16T07:39:17.774 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_writer_bytes": 0, 2024-03-16T07:39:17.774 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_writer_items": 0, 2024-03-16T07:39:17.774 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_anon_bytes": 621022131, 2024-03-16T07:39:17.774 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_anon_items": 220, 2024-03-16T07:39:17.774 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_meta_bytes": 7040, 2024-03-16T07:39:17.774 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_meta_items": 80, 2024-03-16T07:39:17.774 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_bytes": 0, 2024-03-16T07:39:17.774 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_items": 0, 2024-03-16T07:39:17.774 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_mapbl_bytes": 0, 2024-03-16T07:39:17.774 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_mapbl_items": 0, 2024-03-16T07:39:17.774 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pglog_bytes": 0, 2024-03-16T07:39:17.774 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pglog_items": 0, 2024-03-16T07:39:17.774 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_bytes": 33952, 2024-03-16T07:39:17.774 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_items": 334, 2024-03-16T07:39:17.774 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_mapping_bytes": 0, 2024-03-16T07:39:17.775 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_mapping_items": 0, 2024-03-16T07:39:17.775 INFO:teuthology.orchestra.run.smithi049.stdout: "pgmap_bytes": 0, 2024-03-16T07:39:17.775 INFO:teuthology.orchestra.run.smithi049.stdout: "pgmap_items": 0, 2024-03-16T07:39:17.775 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_co_bytes": 0, 2024-03-16T07:39:17.775 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_co_items": 0, 2024-03-16T07:39:17.775 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_1_bytes": 0, 2024-03-16T07:39:17.775 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_1_items": 0, 2024-03-16T07:39:17.775 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_2_bytes": 0, 2024-03-16T07:39:17.775 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_2_items": 0 2024-03-16T07:39:17.775 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:17.775 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:17.775 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:39:17.775 INFO:teuthology.orchestra.run.smithi049.stdout: "objecter": [ 2024-03-16T07:39:17.775 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:39:17.775 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:39:17.775 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:39:17.776 INFO:teuthology.orchestra.run.smithi049.stdout: "op_active": 0, 2024-03-16T07:39:17.776 INFO:teuthology.orchestra.run.smithi049.stdout: "op_laggy": 0, 2024-03-16T07:39:17.776 INFO:teuthology.orchestra.run.smithi049.stdout: "op_send": 0, 2024-03-16T07:39:17.776 INFO:teuthology.orchestra.run.smithi049.stdout: "op_send_bytes": 0, 2024-03-16T07:39:17.776 INFO:teuthology.orchestra.run.smithi049.stdout: "op_resend": 0, 2024-03-16T07:39:17.776 INFO:teuthology.orchestra.run.smithi049.stdout: "op_reply": 0, 2024-03-16T07:39:17.776 INFO:teuthology.orchestra.run.smithi049.stdout: "op_latency": { 2024-03-16T07:39:17.776 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:39:17.776 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:39:17.776 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:39:17.776 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:39:17.776 INFO:teuthology.orchestra.run.smithi049.stdout: "op_inflight": 0, 2024-03-16T07:39:17.776 INFO:teuthology.orchestra.run.smithi049.stdout: "oplen_avg": { 2024-03-16T07:39:17.776 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:39:17.776 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0 2024-03-16T07:39:17.776 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:39:17.777 INFO:teuthology.orchestra.run.smithi049.stdout: "op": 0, 2024-03-16T07:39:17.777 INFO:teuthology.orchestra.run.smithi049.stdout: "op_r": 0, 2024-03-16T07:39:17.777 INFO:teuthology.orchestra.run.smithi049.stdout: "op_w": 0, 2024-03-16T07:39:17.777 INFO:teuthology.orchestra.run.smithi049.stdout: "op_rmw": 0, 2024-03-16T07:39:17.777 INFO:teuthology.orchestra.run.smithi049.stdout: "op_pg": 0, 2024-03-16T07:39:17.777 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_stat": 0, 2024-03-16T07:39:17.777 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_create": 0, 2024-03-16T07:39:17.777 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_read": 0, 2024-03-16T07:39:17.777 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_write": 0, 2024-03-16T07:39:17.777 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_writefull": 0, 2024-03-16T07:39:17.777 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_writesame": 0, 2024-03-16T07:39:17.777 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_append": 0, 2024-03-16T07:39:17.777 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_zero": 0, 2024-03-16T07:39:17.777 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_truncate": 0, 2024-03-16T07:39:17.777 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_delete": 0, 2024-03-16T07:39:17.777 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_mapext": 0, 2024-03-16T07:39:17.778 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_sparse_read": 0, 2024-03-16T07:39:17.778 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_clonerange": 0, 2024-03-16T07:39:17.778 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_getxattr": 0, 2024-03-16T07:39:17.778 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_setxattr": 0, 2024-03-16T07:39:17.778 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_cmpxattr": 0, 2024-03-16T07:39:17.778 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_rmxattr": 0, 2024-03-16T07:39:17.778 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_resetxattrs": 0, 2024-03-16T07:39:17.778 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_call": 0, 2024-03-16T07:39:17.778 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_watch": 0, 2024-03-16T07:39:17.778 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_notify": 0, 2024-03-16T07:39:17.778 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_src_cmpxattr": 0, 2024-03-16T07:39:17.778 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_pgls": 0, 2024-03-16T07:39:17.778 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_pgls_filter": 0, 2024-03-16T07:39:17.778 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_other": 0, 2024-03-16T07:39:17.778 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_active": 0, 2024-03-16T07:39:17.779 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_send": 0, 2024-03-16T07:39:17.779 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_resend": 0, 2024-03-16T07:39:17.779 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_ping": 0, 2024-03-16T07:39:17.779 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_active": 0, 2024-03-16T07:39:17.779 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_send": 0, 2024-03-16T07:39:17.779 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_resend": 0, 2024-03-16T07:39:17.779 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_active": 0, 2024-03-16T07:39:17.779 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_send": 0, 2024-03-16T07:39:17.779 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_resend": 0, 2024-03-16T07:39:17.779 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_active": 0, 2024-03-16T07:39:17.779 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_send": 0, 2024-03-16T07:39:17.779 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_resend": 0, 2024-03-16T07:39:17.779 INFO:teuthology.orchestra.run.smithi049.stdout: "command_active": 0, 2024-03-16T07:39:17.779 INFO:teuthology.orchestra.run.smithi049.stdout: "command_send": 0, 2024-03-16T07:39:17.779 INFO:teuthology.orchestra.run.smithi049.stdout: "command_resend": 0, 2024-03-16T07:39:17.780 INFO:teuthology.orchestra.run.smithi049.stdout: "map_epoch": 0, 2024-03-16T07:39:17.780 INFO:teuthology.orchestra.run.smithi049.stdout: "map_full": 0, 2024-03-16T07:39:17.780 INFO:teuthology.orchestra.run.smithi049.stdout: "map_inc": 0, 2024-03-16T07:39:17.780 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_sessions": 0, 2024-03-16T07:39:17.780 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_session_open": 0, 2024-03-16T07:39:17.780 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_session_close": 0, 2024-03-16T07:39:17.780 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_laggy": 0, 2024-03-16T07:39:17.780 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_wr": 0, 2024-03-16T07:39:17.780 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_rd": 0, 2024-03-16T07:39:17.780 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_del": 0 2024-03-16T07:39:17.780 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:17.780 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:17.780 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:39:17.780 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-msgr_dispatch_throttler-client": [ 2024-03-16T07:39:17.780 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:39:17.780 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:39:17.781 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:39:17.781 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:39:17.781 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-03-16T07:39:17.781 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:39:17.781 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 124, 2024-03-16T07:39:17.781 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 490920, 2024-03-16T07:39:17.781 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:39:17.781 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 124, 2024-03-16T07:39:17.781 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:39:17.781 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:39:17.781 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 124, 2024-03-16T07:39:17.781 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 490920, 2024-03-16T07:39:17.781 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:39:17.781 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:39:17.781 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:39:17.782 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:39:17.782 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:17.782 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:17.782 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:17.782 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:39:17.782 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-msgr_dispatch_throttler-radosclient": [ 2024-03-16T07:39:17.782 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:39:17.782 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:39:17.782 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:39:17.782 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:39:17.782 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-03-16T07:39:17.782 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:39:17.782 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 92, 2024-03-16T07:39:17.782 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 3141221, 2024-03-16T07:39:17.783 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:39:17.783 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 92, 2024-03-16T07:39:17.783 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:39:17.783 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:39:17.783 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 92, 2024-03-16T07:39:17.783 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 3141221, 2024-03-16T07:39:17.783 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:39:17.783 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:39:17.783 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:39:17.783 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:39:17.783 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:17.783 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:17.783 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:17.783 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:39:17.783 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-objecter_bytes": [ 2024-03-16T07:39:17.783 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:39:17.784 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:39:17.784 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:39:17.784 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:39:17.784 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-03-16T07:39:17.784 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:39:17.784 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 0, 2024-03-16T07:39:17.784 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 0, 2024-03-16T07:39:17.784 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:39:17.784 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 0, 2024-03-16T07:39:17.784 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:39:17.784 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:39:17.784 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 0, 2024-03-16T07:39:17.785 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 0, 2024-03-16T07:39:17.785 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:39:17.785 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:39:17.785 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:39:17.785 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:39:17.785 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:17.785 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:17.785 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:17.785 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:39:17.785 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-objecter_ops": [ 2024-03-16T07:39:17.785 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:39:17.785 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:39:17.785 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:39:17.785 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:39:17.785 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 1024, 2024-03-16T07:39:17.786 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:39:17.786 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 0, 2024-03-16T07:39:17.786 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 0, 2024-03-16T07:39:17.786 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:39:17.786 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 0, 2024-03-16T07:39:17.786 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:39:17.786 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:39:17.786 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 0, 2024-03-16T07:39:17.786 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 0, 2024-03-16T07:39:17.786 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:39:17.786 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:39:17.786 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:39:17.786 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:39:17.786 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:17.786 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:17.787 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:17.787 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2024-03-16T07:39:17.787 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-03-16T07:39:17.788 DEBUG:tasks.cephfs.test_mirroring:command returned={ "AsyncMessenger::Worker": [ { "labels": { "id": "0" }, "counters": { "msgr_connection_ready_timeouts": 0, "msgr_connection_idle_timeouts": 0 } }, { "labels": { "id": "1" }, "counters": { "msgr_connection_ready_timeouts": 0, "msgr_connection_idle_timeouts": 0 } }, { "labels": { "id": "2" }, "counters": { "msgr_connection_ready_timeouts": 0, "msgr_connection_idle_timeouts": 0 } } ], "AsyncMessenger::Worker-0": [ { "labels": {}, "counters": { "msgr_recv_messages": 13, "msgr_send_messages": 178, "msgr_recv_bytes": 1872, "msgr_send_bytes": 1068704, "msgr_created_connections": 26, "msgr_active_connections": 5, "msgr_running_total_time": 2.041602467, "msgr_running_send_time": 0.704730287, "msgr_running_recv_time": 0.173849705, "msgr_running_fast_dispatch_time": 0.000000000, "msgr_send_messages_queue_lat": { "avgcount": 166, "sum": 2.556965177, "avgtime": 0.015403404 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "msgr_recv_encrypted_bytes": 1872, "msgr_send_encrypted_bytes": 1068704 } } ], "AsyncMessenger::Worker-1": [ { "labels": {}, "counters": { "msgr_recv_messages": 124, "msgr_send_messages": 10, "msgr_recv_bytes": 507744, "msgr_send_bytes": 2112, "msgr_created_connections": 4, "msgr_active_connections": 0, "msgr_running_total_time": 2.045292250, "msgr_running_send_time": 0.264131183, "msgr_running_recv_time": 1.157315433, "msgr_running_fast_dispatch_time": 0.194190800, "msgr_send_messages_queue_lat": { "avgcount": 9, "sum": 0.188856872, "avgtime": 0.020984096 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "msgr_recv_encrypted_bytes": 507744, "msgr_send_encrypted_bytes": 2112 } } ], "AsyncMessenger::Worker-2": [ { "labels": {}, "counters": { "msgr_recv_messages": 82, "msgr_send_messages": 13, "msgr_recv_bytes": 3152736, "msgr_send_bytes": 2576, "msgr_created_connections": 3, "msgr_active_connections": 1, "msgr_running_total_time": 4.890430419, "msgr_running_send_time": 0.598288080, "msgr_running_recv_time": 4.385908202, "msgr_running_fast_dispatch_time": 0.000000000, "msgr_send_messages_queue_lat": { "avgcount": 12, "sum": 0.346963753, "avgtime": 0.028913646 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "msgr_recv_encrypted_bytes": 3152736, "msgr_send_encrypted_bytes": 2576 } } ], "cct": [ { "labels": {}, "counters": { "total_workers": 0, "unhealthy_workers": 0 } } ], "cephfs_mirror": [ { "labels": {}, "counters": { "mirrored_filesystems": 2, "mirror_enable_failures": 0 } } ], "cephfs_mirror_mirrored_filesystems": [ { "labels": { "filesystem": "cephfs" }, "counters": { "mirroring_peers": 1, "directory_count": 2 } } ], "cephfs_mirror_peers": [ { "labels": { "peer_cluster_filesystem": "backup_fs", "peer_cluster_name": "ceph", "source_filesystem": "cephfs", "source_fscid": "14" }, "counters": { "snaps_synced": 0, "snaps_deleted": 0, "snaps_renamed": 0, "sync_failures": 6, "avg_sync_time": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "sync_bytes": 0 } } ], "mempool": [ { "labels": {}, "counters": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_cache_buffer_bytes": 0, "bluestore_cache_buffer_items": 0, "bluestore_extent_bytes": 0, "bluestore_extent_items": 0, "bluestore_blob_bytes": 0, "bluestore_blob_items": 0, "bluestore_shared_blob_bytes": 0, "bluestore_shared_blob_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_items": 0, "bluefs_bytes": 0, "bluefs_items": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "buffer_anon_bytes": 621022131, "buffer_anon_items": 220, "buffer_meta_bytes": 7040, "buffer_meta_items": 80, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 33952, "osdmap_items": 334, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "mds_co_bytes": 0, "mds_co_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 } } ], "objecter": [ { "labels": {}, "counters": { "op_active": 0, "op_laggy": 0, "op_send": 0, "op_send_bytes": 0, "op_resend": 0, "op_reply": 0, "op_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "op_inflight": 0, "oplen_avg": { "avgcount": 0, "sum": 0 }, "op": 0, "op_r": 0, "op_w": 0, "op_rmw": 0, "op_pg": 0, "osdop_stat": 0, "osdop_create": 0, "osdop_read": 0, "osdop_write": 0, "osdop_writefull": 0, "osdop_writesame": 0, "osdop_append": 0, "osdop_zero": 0, "osdop_truncate": 0, "osdop_delete": 0, "osdop_mapext": 0, "osdop_sparse_read": 0, "osdop_clonerange": 0, "osdop_getxattr": 0, "osdop_setxattr": 0, "osdop_cmpxattr": 0, "osdop_rmxattr": 0, "osdop_resetxattrs": 0, "osdop_call": 0, "osdop_watch": 0, "osdop_notify": 0, "osdop_src_cmpxattr": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_other": 0, "linger_active": 0, "linger_send": 0, "linger_resend": 0, "linger_ping": 0, "poolop_active": 0, "poolop_send": 0, "poolop_resend": 0, "poolstat_active": 0, "poolstat_send": 0, "poolstat_resend": 0, "statfs_active": 0, "statfs_send": 0, "statfs_resend": 0, "command_active": 0, "command_send": 0, "command_resend": 0, "map_epoch": 0, "map_full": 0, "map_inc": 0, "osd_sessions": 0, "osd_session_open": 0, "osd_session_close": 0, "osd_laggy": 0, "omap_wr": 0, "omap_rd": 0, "omap_del": 0 } } ], "throttle-msgr_dispatch_throttler-client": [ { "labels": {}, "counters": { "val": 0, "max": 104857600, "get_started": 0, "get": 124, "get_sum": 490920, "get_or_fail_fail": 0, "get_or_fail_success": 124, "take": 0, "take_sum": 0, "put": 124, "put_sum": 490920, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ], "throttle-msgr_dispatch_throttler-radosclient": [ { "labels": {}, "counters": { "val": 0, "max": 104857600, "get_started": 0, "get": 92, "get_sum": 3141221, "get_or_fail_fail": 0, "get_or_fail_success": 92, "take": 0, "take_sum": 0, "put": 92, "put_sum": 3141221, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ], "throttle-objecter_bytes": [ { "labels": {}, "counters": { "val": 0, "max": 104857600, "get_started": 0, "get": 0, "get_sum": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "take": 0, "take_sum": 0, "put": 0, "put_sum": 0, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ], "throttle-objecter_ops": [ { "labels": {}, "counters": { "val": 0, "max": 1024, "get_started": 0, "get": 0, "get_sum": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "take": 0, "take_sum": 0, "put": 0, "put_sum": 0, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ] } 2024-03-16T07:39:17.788 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-03-16T07:39:17.788 DEBUG:teuthology.orchestra.run.smithi049:mirror status for fs: cephfs> ceph --admin-daemon /var/run/ceph/cephfs-mirror.asok fs mirror status cephfs@14 2024-03-16T07:39:17.891 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-03-16T07:39:17.891 INFO:teuthology.orchestra.run.smithi049.stdout: "rados_inst": "172.21.15.49:0/1186634239", 2024-03-16T07:39:17.891 INFO:teuthology.orchestra.run.smithi049.stdout: "peers": { 2024-03-16T07:39:17.891 INFO:teuthology.orchestra.run.smithi049.stdout: "8fa2e0a7-a624-43b8-9c12-da3a1afea05a": { 2024-03-16T07:39:17.891 INFO:teuthology.orchestra.run.smithi049.stdout: "remote": { 2024-03-16T07:39:17.891 INFO:teuthology.orchestra.run.smithi049.stdout: "client_name": "client.mirror_remote", 2024-03-16T07:39:17.891 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_name": "ceph", 2024-03-16T07:39:17.891 INFO:teuthology.orchestra.run.smithi049.stdout: "fs_name": "backup_fs" 2024-03-16T07:39:17.891 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:17.891 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:17.892 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:39:17.892 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_dirs": { 2024-03-16T07:39:17.892 INFO:teuthology.orchestra.run.smithi049.stdout: "dir_count": 2 2024-03-16T07:39:17.892 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:17.892 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-03-16T07:39:17.899 DEBUG:tasks.cephfs.test_mirroring:command returned={ "rados_inst": "172.21.15.49:0/1186634239", "peers": { "8fa2e0a7-a624-43b8-9c12-da3a1afea05a": { "remote": { "client_name": "client.mirror_remote", "cluster_name": "ceph", "fs_name": "backup_fs" } } }, "snap_dirs": { "dir_count": 2 } } 2024-03-16T07:39:17.899 DEBUG:tasks.cephfs.test_mirroring:initial dir_count=2 2024-03-16T07:39:17.899 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snapshot mirror add cephfs /d2 2024-03-16T07:39:18.235 INFO:teuthology.orchestra.run.smithi049.stdout:{} 2024-03-16T07:39:28.255 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-03-16T07:39:28.255 DEBUG:teuthology.orchestra.run.smithi049:mirror status for fs: cephfs> ceph --admin-daemon /var/run/ceph/cephfs-mirror.asok fs mirror status cephfs@14 2024-03-16T07:39:28.358 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-03-16T07:39:28.359 INFO:teuthology.orchestra.run.smithi049.stdout: "rados_inst": "172.21.15.49:0/1186634239", 2024-03-16T07:39:28.359 INFO:teuthology.orchestra.run.smithi049.stdout: "peers": { 2024-03-16T07:39:28.359 INFO:teuthology.orchestra.run.smithi049.stdout: "8fa2e0a7-a624-43b8-9c12-da3a1afea05a": { 2024-03-16T07:39:28.359 INFO:teuthology.orchestra.run.smithi049.stdout: "remote": { 2024-03-16T07:39:28.359 INFO:teuthology.orchestra.run.smithi049.stdout: "client_name": "client.mirror_remote", 2024-03-16T07:39:28.359 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_name": "ceph", 2024-03-16T07:39:28.359 INFO:teuthology.orchestra.run.smithi049.stdout: "fs_name": "backup_fs" 2024-03-16T07:39:28.359 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:28.359 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:28.359 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:39:28.359 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_dirs": { 2024-03-16T07:39:28.359 INFO:teuthology.orchestra.run.smithi049.stdout: "dir_count": 3 2024-03-16T07:39:28.360 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:28.360 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-03-16T07:39:28.366 DEBUG:tasks.cephfs.test_mirroring:command returned={ "rados_inst": "172.21.15.49:0/1186634239", "peers": { "8fa2e0a7-a624-43b8-9c12-da3a1afea05a": { "remote": { "client_name": "client.mirror_remote", "cluster_name": "ceph", "fs_name": "backup_fs" } } }, "snap_dirs": { "dir_count": 3 } } 2024-03-16T07:39:28.367 DEBUG:tasks.cephfs.test_mirroring:new dir_count=3 2024-03-16T07:39:28.367 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-03-16T07:39:28.367 DEBUG:teuthology.orchestra.run.smithi049:counter dump for fs: cephfs> ceph --admin-daemon /var/run/ceph/cephfs-mirror.asok counter dump 2024-03-16T07:39:28.487 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-03-16T07:39:28.488 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker": [ 2024-03-16T07:39:28.488 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:39:28.488 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:39:28.488 INFO:teuthology.orchestra.run.smithi049.stdout: "id": "0" 2024-03-16T07:39:28.488 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:39:28.488 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:39:28.488 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_ready_timeouts": 0, 2024-03-16T07:39:28.488 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_idle_timeouts": 0 2024-03-16T07:39:28.488 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:28.488 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:39:28.488 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:39:28.488 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:39:28.488 INFO:teuthology.orchestra.run.smithi049.stdout: "id": "1" 2024-03-16T07:39:28.489 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:39:28.489 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:39:28.489 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_ready_timeouts": 0, 2024-03-16T07:39:28.489 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_idle_timeouts": 0 2024-03-16T07:39:28.489 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:28.489 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:39:28.489 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:39:28.489 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:39:28.489 INFO:teuthology.orchestra.run.smithi049.stdout: "id": "2" 2024-03-16T07:39:28.489 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:39:28.489 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:39:28.489 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_ready_timeouts": 0, 2024-03-16T07:39:28.489 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_idle_timeouts": 0 2024-03-16T07:39:28.489 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:28.489 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:28.490 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:39:28.490 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-0": [ 2024-03-16T07:39:28.490 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:39:28.490 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:39:28.490 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:39:28.490 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 13, 2024-03-16T07:39:28.490 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 180, 2024-03-16T07:39:28.490 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 1872, 2024-03-16T07:39:28.490 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 1069440, 2024-03-16T07:39:28.490 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 26, 2024-03-16T07:39:28.490 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 5, 2024-03-16T07:39:28.490 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 2.042634682, 2024-03-16T07:39:28.490 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.705686050, 2024-03-16T07:39:28.491 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 0.173849705, 2024-03-16T07:39:28.491 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-03-16T07:39:28.491 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T07:39:28.491 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 168, 2024-03-16T07:39:28.491 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 2.557303951, 2024-03-16T07:39:28.491 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.015222047 2024-03-16T07:39:28.491 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:39:28.491 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-03-16T07:39:28.491 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:39:28.491 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:39:28.491 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:39:28.491 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:39:28.491 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 1872, 2024-03-16T07:39:28.491 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 1069440 2024-03-16T07:39:28.492 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:28.492 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:28.492 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:39:28.492 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-1": [ 2024-03-16T07:39:28.492 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:39:28.492 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:39:28.492 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:39:28.492 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 124, 2024-03-16T07:39:28.492 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 10, 2024-03-16T07:39:28.492 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 507744, 2024-03-16T07:39:28.492 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 2112, 2024-03-16T07:39:28.492 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 4, 2024-03-16T07:39:28.492 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 0, 2024-03-16T07:39:28.492 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 2.045680134, 2024-03-16T07:39:28.492 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.264183423, 2024-03-16T07:39:28.492 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 1.157454751, 2024-03-16T07:39:28.493 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.194190800, 2024-03-16T07:39:28.493 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T07:39:28.493 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 9, 2024-03-16T07:39:28.493 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.188856872, 2024-03-16T07:39:28.493 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.020984096 2024-03-16T07:39:28.493 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:39:28.493 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-03-16T07:39:28.493 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:39:28.493 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:39:28.493 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:39:28.493 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:39:28.493 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 507744, 2024-03-16T07:39:28.493 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 2112 2024-03-16T07:39:28.493 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:28.493 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:28.493 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:39:28.493 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-2": [ 2024-03-16T07:39:28.494 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:39:28.494 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:39:28.494 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:39:28.494 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 82, 2024-03-16T07:39:28.494 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 13, 2024-03-16T07:39:28.494 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 3152736, 2024-03-16T07:39:28.494 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 2576, 2024-03-16T07:39:28.494 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 3, 2024-03-16T07:39:28.494 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 1, 2024-03-16T07:39:28.494 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 4.890828829, 2024-03-16T07:39:28.494 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.598335676, 2024-03-16T07:39:28.494 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 4.386051133, 2024-03-16T07:39:28.494 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-03-16T07:39:28.494 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T07:39:28.495 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 12, 2024-03-16T07:39:28.495 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.346963753, 2024-03-16T07:39:28.495 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.028913646 2024-03-16T07:39:28.495 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:39:28.495 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-03-16T07:39:28.495 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:39:28.495 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:39:28.495 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:39:28.495 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:39:28.495 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 3152736, 2024-03-16T07:39:28.495 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 2576 2024-03-16T07:39:28.495 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:28.495 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:28.496 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:39:28.496 INFO:teuthology.orchestra.run.smithi049.stdout: "cct": [ 2024-03-16T07:39:28.496 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:39:28.496 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:39:28.496 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:39:28.496 INFO:teuthology.orchestra.run.smithi049.stdout: "total_workers": 0, 2024-03-16T07:39:28.496 INFO:teuthology.orchestra.run.smithi049.stdout: "unhealthy_workers": 0 2024-03-16T07:39:28.496 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:28.496 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:28.497 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:39:28.497 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs_mirror": [ 2024-03-16T07:39:28.497 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:39:28.497 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:39:28.497 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:39:28.497 INFO:teuthology.orchestra.run.smithi049.stdout: "mirrored_filesystems": 2, 2024-03-16T07:39:28.497 INFO:teuthology.orchestra.run.smithi049.stdout: "mirror_enable_failures": 0 2024-03-16T07:39:28.497 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:28.497 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:28.497 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:39:28.497 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs_mirror_mirrored_filesystems": [ 2024-03-16T07:39:28.497 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:39:28.497 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:39:28.497 INFO:teuthology.orchestra.run.smithi049.stdout: "filesystem": "cephfs" 2024-03-16T07:39:28.497 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:39:28.498 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:39:28.498 INFO:teuthology.orchestra.run.smithi049.stdout: "mirroring_peers": 1, 2024-03-16T07:39:28.498 INFO:teuthology.orchestra.run.smithi049.stdout: "directory_count": 3 2024-03-16T07:39:28.498 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:28.498 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:28.498 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:39:28.498 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs_mirror_peers": [ 2024-03-16T07:39:28.498 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:39:28.498 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:39:28.498 INFO:teuthology.orchestra.run.smithi049.stdout: "peer_cluster_filesystem": "backup_fs", 2024-03-16T07:39:28.498 INFO:teuthology.orchestra.run.smithi049.stdout: "peer_cluster_name": "ceph", 2024-03-16T07:39:28.498 INFO:teuthology.orchestra.run.smithi049.stdout: "source_filesystem": "cephfs", 2024-03-16T07:39:28.499 INFO:teuthology.orchestra.run.smithi049.stdout: "source_fscid": "14" 2024-03-16T07:39:28.499 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:39:28.499 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:39:28.499 INFO:teuthology.orchestra.run.smithi049.stdout: "snaps_synced": 0, 2024-03-16T07:39:28.499 INFO:teuthology.orchestra.run.smithi049.stdout: "snaps_deleted": 0, 2024-03-16T07:39:28.499 INFO:teuthology.orchestra.run.smithi049.stdout: "snaps_renamed": 0, 2024-03-16T07:39:28.499 INFO:teuthology.orchestra.run.smithi049.stdout: "sync_failures": 6, 2024-03-16T07:39:28.499 INFO:teuthology.orchestra.run.smithi049.stdout: "avg_sync_time": { 2024-03-16T07:39:28.499 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:39:28.499 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:39:28.499 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:39:28.500 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:39:28.500 INFO:teuthology.orchestra.run.smithi049.stdout: "sync_bytes": 0 2024-03-16T07:39:28.500 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:28.500 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:28.500 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:39:28.500 INFO:teuthology.orchestra.run.smithi049.stdout: "mempool": [ 2024-03-16T07:39:28.500 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:39:28.500 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:39:28.500 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:39:28.500 INFO:teuthology.orchestra.run.smithi049.stdout: "bloom_filter_bytes": 0, 2024-03-16T07:39:28.500 INFO:teuthology.orchestra.run.smithi049.stdout: "bloom_filter_items": 0, 2024-03-16T07:39:28.500 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_alloc_bytes": 0, 2024-03-16T07:39:28.500 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_alloc_items": 0, 2024-03-16T07:39:28.500 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_data_bytes": 0, 2024-03-16T07:39:28.500 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_data_items": 0, 2024-03-16T07:39:28.501 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_onode_bytes": 0, 2024-03-16T07:39:28.501 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_onode_items": 0, 2024-03-16T07:39:28.501 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_meta_bytes": 0, 2024-03-16T07:39:28.501 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_meta_items": 0, 2024-03-16T07:39:28.501 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_other_bytes": 0, 2024-03-16T07:39:28.501 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_other_items": 0, 2024-03-16T07:39:28.501 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_buffer_bytes": 0, 2024-03-16T07:39:28.501 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_buffer_items": 0, 2024-03-16T07:39:28.501 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_extent_bytes": 0, 2024-03-16T07:39:28.501 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_extent_items": 0, 2024-03-16T07:39:28.501 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_blob_bytes": 0, 2024-03-16T07:39:28.501 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_blob_items": 0, 2024-03-16T07:39:28.501 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_shared_blob_bytes": 0, 2024-03-16T07:39:28.501 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_shared_blob_items": 0, 2024-03-16T07:39:28.501 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_inline_bl_bytes": 0, 2024-03-16T07:39:28.501 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_inline_bl_items": 0, 2024-03-16T07:39:28.501 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_fsck_bytes": 0, 2024-03-16T07:39:28.502 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_fsck_items": 0, 2024-03-16T07:39:28.502 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_txc_bytes": 0, 2024-03-16T07:39:28.502 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_txc_items": 0, 2024-03-16T07:39:28.502 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_deferred_bytes": 0, 2024-03-16T07:39:28.502 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_deferred_items": 0, 2024-03-16T07:39:28.502 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_bytes": 0, 2024-03-16T07:39:28.502 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_items": 0, 2024-03-16T07:39:28.502 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_bytes": 0, 2024-03-16T07:39:28.502 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_items": 0, 2024-03-16T07:39:28.502 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_reader_bytes": 0, 2024-03-16T07:39:28.502 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_reader_items": 0, 2024-03-16T07:39:28.502 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_writer_bytes": 0, 2024-03-16T07:39:28.502 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_writer_items": 0, 2024-03-16T07:39:28.502 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_anon_bytes": 621022131, 2024-03-16T07:39:28.502 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_anon_items": 220, 2024-03-16T07:39:28.503 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_meta_bytes": 7040, 2024-03-16T07:39:28.503 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_meta_items": 80, 2024-03-16T07:39:28.503 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_bytes": 0, 2024-03-16T07:39:28.503 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_items": 0, 2024-03-16T07:39:28.503 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_mapbl_bytes": 0, 2024-03-16T07:39:28.503 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_mapbl_items": 0, 2024-03-16T07:39:28.503 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pglog_bytes": 0, 2024-03-16T07:39:28.503 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pglog_items": 0, 2024-03-16T07:39:28.503 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_bytes": 33952, 2024-03-16T07:39:28.503 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_items": 334, 2024-03-16T07:39:28.503 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_mapping_bytes": 0, 2024-03-16T07:39:28.503 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_mapping_items": 0, 2024-03-16T07:39:28.503 INFO:teuthology.orchestra.run.smithi049.stdout: "pgmap_bytes": 0, 2024-03-16T07:39:28.503 INFO:teuthology.orchestra.run.smithi049.stdout: "pgmap_items": 0, 2024-03-16T07:39:28.503 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_co_bytes": 0, 2024-03-16T07:39:28.503 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_co_items": 0, 2024-03-16T07:39:28.503 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_1_bytes": 0, 2024-03-16T07:39:28.504 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_1_items": 0, 2024-03-16T07:39:28.504 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_2_bytes": 0, 2024-03-16T07:39:28.504 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_2_items": 0 2024-03-16T07:39:28.504 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:28.504 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:28.504 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:39:28.504 INFO:teuthology.orchestra.run.smithi049.stdout: "objecter": [ 2024-03-16T07:39:28.504 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:39:28.504 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:39:28.504 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:39:28.504 INFO:teuthology.orchestra.run.smithi049.stdout: "op_active": 0, 2024-03-16T07:39:28.504 INFO:teuthology.orchestra.run.smithi049.stdout: "op_laggy": 0, 2024-03-16T07:39:28.504 INFO:teuthology.orchestra.run.smithi049.stdout: "op_send": 0, 2024-03-16T07:39:28.504 INFO:teuthology.orchestra.run.smithi049.stdout: "op_send_bytes": 0, 2024-03-16T07:39:28.504 INFO:teuthology.orchestra.run.smithi049.stdout: "op_resend": 0, 2024-03-16T07:39:28.505 INFO:teuthology.orchestra.run.smithi049.stdout: "op_reply": 0, 2024-03-16T07:39:28.505 INFO:teuthology.orchestra.run.smithi049.stdout: "op_latency": { 2024-03-16T07:39:28.505 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:39:28.505 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:39:28.505 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:39:28.505 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:39:28.505 INFO:teuthology.orchestra.run.smithi049.stdout: "op_inflight": 0, 2024-03-16T07:39:28.505 INFO:teuthology.orchestra.run.smithi049.stdout: "oplen_avg": { 2024-03-16T07:39:28.505 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:39:28.505 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0 2024-03-16T07:39:28.505 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:39:28.505 INFO:teuthology.orchestra.run.smithi049.stdout: "op": 0, 2024-03-16T07:39:28.505 INFO:teuthology.orchestra.run.smithi049.stdout: "op_r": 0, 2024-03-16T07:39:28.505 INFO:teuthology.orchestra.run.smithi049.stdout: "op_w": 0, 2024-03-16T07:39:28.505 INFO:teuthology.orchestra.run.smithi049.stdout: "op_rmw": 0, 2024-03-16T07:39:28.506 INFO:teuthology.orchestra.run.smithi049.stdout: "op_pg": 0, 2024-03-16T07:39:28.506 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_stat": 0, 2024-03-16T07:39:28.506 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_create": 0, 2024-03-16T07:39:28.506 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_read": 0, 2024-03-16T07:39:28.506 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_write": 0, 2024-03-16T07:39:28.506 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_writefull": 0, 2024-03-16T07:39:28.506 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_writesame": 0, 2024-03-16T07:39:28.506 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_append": 0, 2024-03-16T07:39:28.506 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_zero": 0, 2024-03-16T07:39:28.506 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_truncate": 0, 2024-03-16T07:39:28.506 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_delete": 0, 2024-03-16T07:39:28.506 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_mapext": 0, 2024-03-16T07:39:28.506 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_sparse_read": 0, 2024-03-16T07:39:28.506 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_clonerange": 0, 2024-03-16T07:39:28.506 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_getxattr": 0, 2024-03-16T07:39:28.507 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_setxattr": 0, 2024-03-16T07:39:28.507 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_cmpxattr": 0, 2024-03-16T07:39:28.507 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_rmxattr": 0, 2024-03-16T07:39:28.507 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_resetxattrs": 0, 2024-03-16T07:39:28.507 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_call": 0, 2024-03-16T07:39:28.507 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_watch": 0, 2024-03-16T07:39:28.507 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_notify": 0, 2024-03-16T07:39:28.507 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_src_cmpxattr": 0, 2024-03-16T07:39:28.507 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_pgls": 0, 2024-03-16T07:39:28.507 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_pgls_filter": 0, 2024-03-16T07:39:28.507 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_other": 0, 2024-03-16T07:39:28.507 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_active": 0, 2024-03-16T07:39:28.507 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_send": 0, 2024-03-16T07:39:28.507 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_resend": 0, 2024-03-16T07:39:28.508 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_ping": 0, 2024-03-16T07:39:28.508 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_active": 0, 2024-03-16T07:39:28.508 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_send": 0, 2024-03-16T07:39:28.508 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_resend": 0, 2024-03-16T07:39:28.508 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_active": 0, 2024-03-16T07:39:28.508 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_send": 0, 2024-03-16T07:39:28.508 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_resend": 0, 2024-03-16T07:39:28.508 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_active": 0, 2024-03-16T07:39:28.508 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_send": 0, 2024-03-16T07:39:28.508 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_resend": 0, 2024-03-16T07:39:28.508 INFO:teuthology.orchestra.run.smithi049.stdout: "command_active": 0, 2024-03-16T07:39:28.508 INFO:teuthology.orchestra.run.smithi049.stdout: "command_send": 0, 2024-03-16T07:39:28.508 INFO:teuthology.orchestra.run.smithi049.stdout: "command_resend": 0, 2024-03-16T07:39:28.508 INFO:teuthology.orchestra.run.smithi049.stdout: "map_epoch": 0, 2024-03-16T07:39:28.508 INFO:teuthology.orchestra.run.smithi049.stdout: "map_full": 0, 2024-03-16T07:39:28.509 INFO:teuthology.orchestra.run.smithi049.stdout: "map_inc": 0, 2024-03-16T07:39:28.509 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_sessions": 0, 2024-03-16T07:39:28.509 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_session_open": 0, 2024-03-16T07:39:28.509 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_session_close": 0, 2024-03-16T07:39:28.509 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_laggy": 0, 2024-03-16T07:39:28.509 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_wr": 0, 2024-03-16T07:39:28.509 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_rd": 0, 2024-03-16T07:39:28.509 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_del": 0 2024-03-16T07:39:28.509 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:28.509 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:28.509 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:39:28.509 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-msgr_dispatch_throttler-client": [ 2024-03-16T07:39:28.509 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:39:28.509 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:39:28.509 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:39:28.510 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:39:28.510 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-03-16T07:39:28.510 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:39:28.510 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 124, 2024-03-16T07:39:28.510 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 490920, 2024-03-16T07:39:28.510 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:39:28.510 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 124, 2024-03-16T07:39:28.510 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:39:28.510 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:39:28.510 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 124, 2024-03-16T07:39:28.510 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 490920, 2024-03-16T07:39:28.510 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:39:28.510 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:39:28.510 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:39:28.511 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:39:28.511 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:28.511 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:28.511 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:28.511 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:39:28.511 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-msgr_dispatch_throttler-radosclient": [ 2024-03-16T07:39:28.511 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:39:28.511 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:39:28.511 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:39:28.511 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:39:28.511 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-03-16T07:39:28.511 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:39:28.512 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 92, 2024-03-16T07:39:28.512 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 3141221, 2024-03-16T07:39:28.512 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:39:28.512 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 92, 2024-03-16T07:39:28.512 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:39:28.512 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:39:28.512 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 92, 2024-03-16T07:39:28.512 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 3141221, 2024-03-16T07:39:28.512 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:39:28.512 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:39:28.512 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:39:28.512 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:39:28.512 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:28.512 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:28.512 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:28.513 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:39:28.513 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-objecter_bytes": [ 2024-03-16T07:39:28.513 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:39:28.513 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:39:28.513 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:39:28.513 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:39:28.513 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-03-16T07:39:28.513 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:39:28.513 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 0, 2024-03-16T07:39:28.513 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 0, 2024-03-16T07:39:28.513 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:39:28.513 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 0, 2024-03-16T07:39:28.513 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:39:28.513 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:39:28.513 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 0, 2024-03-16T07:39:28.513 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 0, 2024-03-16T07:39:28.513 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:39:28.514 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:39:28.514 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:39:28.514 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:39:28.514 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:28.514 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:28.514 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:28.514 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:39:28.514 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-objecter_ops": [ 2024-03-16T07:39:28.514 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:39:28.514 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:39:28.514 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:39:28.514 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:39:28.514 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 1024, 2024-03-16T07:39:28.514 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:39:28.515 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 0, 2024-03-16T07:39:28.515 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 0, 2024-03-16T07:39:28.515 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:39:28.515 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 0, 2024-03-16T07:39:28.515 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:39:28.515 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:39:28.515 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 0, 2024-03-16T07:39:28.515 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 0, 2024-03-16T07:39:28.515 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:39:28.515 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:39:28.515 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:39:28.515 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:39:28.515 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:28.515 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:28.516 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:39:28.516 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2024-03-16T07:39:28.516 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-03-16T07:39:28.516 DEBUG:tasks.cephfs.test_mirroring:command returned={ "AsyncMessenger::Worker": [ { "labels": { "id": "0" }, "counters": { "msgr_connection_ready_timeouts": 0, "msgr_connection_idle_timeouts": 0 } }, { "labels": { "id": "1" }, "counters": { "msgr_connection_ready_timeouts": 0, "msgr_connection_idle_timeouts": 0 } }, { "labels": { "id": "2" }, "counters": { "msgr_connection_ready_timeouts": 0, "msgr_connection_idle_timeouts": 0 } } ], "AsyncMessenger::Worker-0": [ { "labels": {}, "counters": { "msgr_recv_messages": 13, "msgr_send_messages": 180, "msgr_recv_bytes": 1872, "msgr_send_bytes": 1069440, "msgr_created_connections": 26, "msgr_active_connections": 5, "msgr_running_total_time": 2.042634682, "msgr_running_send_time": 0.705686050, "msgr_running_recv_time": 0.173849705, "msgr_running_fast_dispatch_time": 0.000000000, "msgr_send_messages_queue_lat": { "avgcount": 168, "sum": 2.557303951, "avgtime": 0.015222047 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "msgr_recv_encrypted_bytes": 1872, "msgr_send_encrypted_bytes": 1069440 } } ], "AsyncMessenger::Worker-1": [ { "labels": {}, "counters": { "msgr_recv_messages": 124, "msgr_send_messages": 10, "msgr_recv_bytes": 507744, "msgr_send_bytes": 2112, "msgr_created_connections": 4, "msgr_active_connections": 0, "msgr_running_total_time": 2.045680134, "msgr_running_send_time": 0.264183423, "msgr_running_recv_time": 1.157454751, "msgr_running_fast_dispatch_time": 0.194190800, "msgr_send_messages_queue_lat": { "avgcount": 9, "sum": 0.188856872, "avgtime": 0.020984096 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "msgr_recv_encrypted_bytes": 507744, "msgr_send_encrypted_bytes": 2112 } } ], "AsyncMessenger::Worker-2": [ { "labels": {}, "counters": { "msgr_recv_messages": 82, "msgr_send_messages": 13, "msgr_recv_bytes": 3152736, "msgr_send_bytes": 2576, "msgr_created_connections": 3, "msgr_active_connections": 1, "msgr_running_total_time": 4.890828829, "msgr_running_send_time": 0.598335676, "msgr_running_recv_time": 4.386051133, "msgr_running_fast_dispatch_time": 0.000000000, "msgr_send_messages_queue_lat": { "avgcount": 12, "sum": 0.346963753, "avgtime": 0.028913646 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "msgr_recv_encrypted_bytes": 3152736, "msgr_send_encrypted_bytes": 2576 } } ], "cct": [ { "labels": {}, "counters": { "total_workers": 0, "unhealthy_workers": 0 } } ], "cephfs_mirror": [ { "labels": {}, "counters": { "mirrored_filesystems": 2, "mirror_enable_failures": 0 } } ], "cephfs_mirror_mirrored_filesystems": [ { "labels": { "filesystem": "cephfs" }, "counters": { "mirroring_peers": 1, "directory_count": 3 } } ], "cephfs_mirror_peers": [ { "labels": { "peer_cluster_filesystem": "backup_fs", "peer_cluster_name": "ceph", "source_filesystem": "cephfs", "source_fscid": "14" }, "counters": { "snaps_synced": 0, "snaps_deleted": 0, "snaps_renamed": 0, "sync_failures": 6, "avg_sync_time": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "sync_bytes": 0 } } ], "mempool": [ { "labels": {}, "counters": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_cache_buffer_bytes": 0, "bluestore_cache_buffer_items": 0, "bluestore_extent_bytes": 0, "bluestore_extent_items": 0, "bluestore_blob_bytes": 0, "bluestore_blob_items": 0, "bluestore_shared_blob_bytes": 0, "bluestore_shared_blob_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_items": 0, "bluefs_bytes": 0, "bluefs_items": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "buffer_anon_bytes": 621022131, "buffer_anon_items": 220, "buffer_meta_bytes": 7040, "buffer_meta_items": 80, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 33952, "osdmap_items": 334, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "mds_co_bytes": 0, "mds_co_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 } } ], "objecter": [ { "labels": {}, "counters": { "op_active": 0, "op_laggy": 0, "op_send": 0, "op_send_bytes": 0, "op_resend": 0, "op_reply": 0, "op_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "op_inflight": 0, "oplen_avg": { "avgcount": 0, "sum": 0 }, "op": 0, "op_r": 0, "op_w": 0, "op_rmw": 0, "op_pg": 0, "osdop_stat": 0, "osdop_create": 0, "osdop_read": 0, "osdop_write": 0, "osdop_writefull": 0, "osdop_writesame": 0, "osdop_append": 0, "osdop_zero": 0, "osdop_truncate": 0, "osdop_delete": 0, "osdop_mapext": 0, "osdop_sparse_read": 0, "osdop_clonerange": 0, "osdop_getxattr": 0, "osdop_setxattr": 0, "osdop_cmpxattr": 0, "osdop_rmxattr": 0, "osdop_resetxattrs": 0, "osdop_call": 0, "osdop_watch": 0, "osdop_notify": 0, "osdop_src_cmpxattr": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_other": 0, "linger_active": 0, "linger_send": 0, "linger_resend": 0, "linger_ping": 0, "poolop_active": 0, "poolop_send": 0, "poolop_resend": 0, "poolstat_active": 0, "poolstat_send": 0, "poolstat_resend": 0, "statfs_active": 0, "statfs_send": 0, "statfs_resend": 0, "command_active": 0, "command_send": 0, "command_resend": 0, "map_epoch": 0, "map_full": 0, "map_inc": 0, "osd_sessions": 0, "osd_session_open": 0, "osd_session_close": 0, "osd_laggy": 0, "omap_wr": 0, "omap_rd": 0, "omap_del": 0 } } ], "throttle-msgr_dispatch_throttler-client": [ { "labels": {}, "counters": { "val": 0, "max": 104857600, "get_started": 0, "get": 124, "get_sum": 490920, "get_or_fail_fail": 0, "get_or_fail_success": 124, "take": 0, "take_sum": 0, "put": 124, "put_sum": 490920, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ], "throttle-msgr_dispatch_throttler-radosclient": [ { "labels": {}, "counters": { "val": 0, "max": 104857600, "get_started": 0, "get": 92, "get_sum": 3141221, "get_or_fail_fail": 0, "get_or_fail_success": 92, "take": 0, "take_sum": 0, "put": 92, "put_sum": 3141221, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ], "throttle-objecter_bytes": [ { "labels": {}, "counters": { "val": 0, "max": 104857600, "get_started": 0, "get": 0, "get_sum": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "take": 0, "take_sum": 0, "put": 0, "put_sum": 0, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ], "throttle-objecter_ops": [ { "labels": {}, "counters": { "val": 0, "max": 1024, "get_started": 0, "get": 0, "get_sum": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "take": 0, "take_sum": 0, "put": 0, "put_sum": 0, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ] } 2024-03-16T07:39:28.517 DEBUG:tasks.cephfs.test_mirroring:creating new snapshots... 2024-03-16T07:39:28.517 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:39:28.517 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir d0/.snap/snap0) 2024-03-16T07:39:28.537 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:39:28.537 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir d1/.snap/snap0) 2024-03-16T07:39:28.598 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:39:28.598 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir d2/.snap/snap0) 2024-03-16T07:39:39.900 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T07:40:09.973 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T07:40:28.660 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T07:40:29.001 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:40:29.002 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":124,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6690,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6827/875237476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":875237476},{"type":"v1","addr":"172.21.15.49:6827","nonce":875237476}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":113},{"gid":6691,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6829/417322500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":417322500},{"type":"v1","addr":"172.21.15.49:6829","nonce":417322500}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":113},{"gid":6696,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6831/4121914730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":4121914730},{"type":"v1","addr":"172.21.15.49:6831","nonce":4121914730}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":113}],"filesystems":[{"mdsmap":{"epoch":124,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-16T07:35:10.038977+0000","modified":"2024-03-16T07:37:19.309479+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6698},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6698":{"gid":6698,"name":"a","rank":0,"incarnation":114,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6835/1838330688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":1838330688},{"type":"v1","addr":"172.21.15.49:6835","nonce":1838330688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[29],"metadata_pool":28,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6698,"qdb_cluster":[6698]},"id":14,"mirror_info":{"peers":{"8fa2e0a7-a624-43b8-9c12-da3a1afea05a":{"remote":{"client_name":"client.mirror_remote","cluster_name":"ceph","fs_name":"backup_fs"}}}}},{"mdsmap":{"epoch":122,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-16T07:35:23.124362+0000","modified":"2024-03-16T07:35:26.073338+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6697},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6697":{"gid":6697,"name":"e","rank":0,"incarnation":118,"state":"up:active","state_seq":6,"addr":"172.21.15.49:6834/1716116460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":1716116460},{"type":"v1","addr":"172.21.15.49:6834","nonce":1716116460}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[31],"metadata_pool":30,"enabled":true,"fs_name":"backup_fs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6697,"qdb_cluster":[6697]},"id":15}]} 2024-03-16T07:40:29.002 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 124 2024-03-16T07:40:29.014 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-03-16T07:40:29.015 DEBUG:teuthology.orchestra.run.smithi049:peer status for fs: cephfs> ceph --admin-daemon /var/run/ceph/cephfs-mirror.asok fs mirror peer status cephfs@14 8fa2e0a7-a624-43b8-9c12-da3a1afea05a 2024-03-16T07:40:29.131 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-03-16T07:40:29.131 INFO:teuthology.orchestra.run.smithi049.stdout: "/d0": { 2024-03-16T07:40:29.131 INFO:teuthology.orchestra.run.smithi049.stdout: "state": "idle", 2024-03-16T07:40:29.131 INFO:teuthology.orchestra.run.smithi049.stdout: "last_synced_snap": { 2024-03-16T07:40:29.131 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 8, 2024-03-16T07:40:29.131 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "snap0", 2024-03-16T07:40:29.131 INFO:teuthology.orchestra.run.smithi049.stdout: "sync_duration": 1.7279525259999999, 2024-03-16T07:40:29.132 INFO:teuthology.orchestra.run.smithi049.stdout: "sync_time_stamp": "1689.277487s" 2024-03-16T07:40:29.132 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:40:29.132 INFO:teuthology.orchestra.run.smithi049.stdout: "snaps_synced": 1, 2024-03-16T07:40:29.132 INFO:teuthology.orchestra.run.smithi049.stdout: "snaps_deleted": 0, 2024-03-16T07:40:29.132 INFO:teuthology.orchestra.run.smithi049.stdout: "snaps_renamed": 0 2024-03-16T07:40:29.132 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:40:29.132 INFO:teuthology.orchestra.run.smithi049.stdout: "/d1": { 2024-03-16T07:40:29.132 INFO:teuthology.orchestra.run.smithi049.stdout: "state": "idle", 2024-03-16T07:40:29.132 INFO:teuthology.orchestra.run.smithi049.stdout: "last_synced_snap": { 2024-03-16T07:40:29.132 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 9, 2024-03-16T07:40:29.132 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "snap0", 2024-03-16T07:40:29.132 INFO:teuthology.orchestra.run.smithi049.stdout: "sync_duration": 0.57498420299999997, 2024-03-16T07:40:29.132 INFO:teuthology.orchestra.run.smithi049.stdout: "sync_time_stamp": "1698.445235s" 2024-03-16T07:40:29.132 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:40:29.132 INFO:teuthology.orchestra.run.smithi049.stdout: "snaps_synced": 1, 2024-03-16T07:40:29.133 INFO:teuthology.orchestra.run.smithi049.stdout: "snaps_deleted": 0, 2024-03-16T07:40:29.133 INFO:teuthology.orchestra.run.smithi049.stdout: "snaps_renamed": 0 2024-03-16T07:40:29.133 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:40:29.133 INFO:teuthology.orchestra.run.smithi049.stdout: "/d2": { 2024-03-16T07:40:29.133 INFO:teuthology.orchestra.run.smithi049.stdout: "state": "idle", 2024-03-16T07:40:29.133 INFO:teuthology.orchestra.run.smithi049.stdout: "last_synced_snap": { 2024-03-16T07:40:29.133 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 10, 2024-03-16T07:40:29.133 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "snap0", 2024-03-16T07:40:29.133 INFO:teuthology.orchestra.run.smithi049.stdout: "sync_duration": 1.6699541200000001, 2024-03-16T07:40:29.133 INFO:teuthology.orchestra.run.smithi049.stdout: "sync_time_stamp": "1689.426483s" 2024-03-16T07:40:29.133 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:40:29.133 INFO:teuthology.orchestra.run.smithi049.stdout: "snaps_synced": 1, 2024-03-16T07:40:29.133 INFO:teuthology.orchestra.run.smithi049.stdout: "snaps_deleted": 0, 2024-03-16T07:40:29.133 INFO:teuthology.orchestra.run.smithi049.stdout: "snaps_renamed": 0 2024-03-16T07:40:29.133 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:40:29.134 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-03-16T07:40:29.142 DEBUG:tasks.cephfs.test_mirroring:command returned={ "/d0": { "state": "idle", "last_synced_snap": { "id": 8, "name": "snap0", "sync_duration": 1.7279525259999999, "sync_time_stamp": "1689.277487s" }, "snaps_synced": 1, "snaps_deleted": 0, "snaps_renamed": 0 }, "/d1": { "state": "idle", "last_synced_snap": { "id": 9, "name": "snap0", "sync_duration": 0.57498420299999997, "sync_time_stamp": "1698.445235s" }, "snaps_synced": 1, "snaps_deleted": 0, "snaps_renamed": 0 }, "/d2": { "state": "idle", "last_synced_snap": { "id": 10, "name": "snap0", "sync_duration": 1.6699541200000001, "sync_time_stamp": "1689.426483s" }, "snaps_synced": 1, "snaps_deleted": 0, "snaps_renamed": 0 } } 2024-03-16T07:40:29.142 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:40:29.143 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.1 && exec ls d0/.snap) 2024-03-16T07:40:29.160 INFO:teuthology.orchestra.run.smithi049.stdout:snap0 2024-03-16T07:40:29.161 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:40:29.162 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec find -L d0/.snap/snap0 -type f -exec md5sum '{}' +) 2024-03-16T07:40:29.234 INFO:teuthology.orchestra.run.smithi049.stdout:a5bfc9e07964f8dddeb95fc584cd965d d0/.snap/snap0/file_37 2024-03-16T07:40:29.235 INFO:teuthology.orchestra.run.smithi049.stdout:b6d767d2f8ed5d21a44b0e5886680cb9 d0/.snap/snap0/file_22 2024-03-16T07:40:29.237 INFO:teuthology.orchestra.run.smithi049.stdout:182be0c5cdcd5072bb1864cdee4d3d6e d0/.snap/snap0/file_33 2024-03-16T07:40:29.238 INFO:teuthology.orchestra.run.smithi049.stdout:c4ca4238a0b923820dcc509a6f75849b d0/.snap/snap0/file_1 2024-03-16T07:40:29.240 INFO:teuthology.orchestra.run.smithi049.stdout:67c6a1e7ce56d3d6fa748ab6d9af3fd7 d0/.snap/snap0/file_47 2024-03-16T07:40:29.242 INFO:teuthology.orchestra.run.smithi049.stdout:a87ff679a2f3e71d9181a67b7542122c d0/.snap/snap0/file_4 2024-03-16T07:40:29.243 INFO:teuthology.orchestra.run.smithi049.stdout:6c8349cc7260ae62e3b1396831a8398f d0/.snap/snap0/file_45 2024-03-16T07:40:29.245 INFO:teuthology.orchestra.run.smithi049.stdout:d3d9446802a44259755d38e6d163e820 d0/.snap/snap0/file_10 2024-03-16T07:40:29.246 INFO:teuthology.orchestra.run.smithi049.stdout:642e92efb79421734881b53e1e1b18b6 d0/.snap/snap0/file_48 2024-03-16T07:40:29.248 INFO:teuthology.orchestra.run.smithi049.stdout:3c59dc048e8850243be8079a5c74d079 d0/.snap/snap0/file_21 2024-03-16T07:40:29.249 INFO:teuthology.orchestra.run.smithi049.stdout:6512bd43d9caa6e02c990b0a82652dca d0/.snap/snap0/file_11 2024-03-16T07:40:29.251 INFO:teuthology.orchestra.run.smithi049.stdout:e4da3b7fbbce2345d7772b0674a318d5 d0/.snap/snap0/file_5 2024-03-16T07:40:29.253 INFO:teuthology.orchestra.run.smithi049.stdout:1679091c5a880faf6fb5e6087eb1b2dc d0/.snap/snap0/file_6 2024-03-16T07:40:29.254 INFO:teuthology.orchestra.run.smithi049.stdout:aab3238922bcc25a6f606eb525ffdc56 d0/.snap/snap0/file_14 2024-03-16T07:40:29.256 INFO:teuthology.orchestra.run.smithi049.stdout:98f13708210194c475687be6106a3b84 d0/.snap/snap0/file_20 2024-03-16T07:40:29.257 INFO:teuthology.orchestra.run.smithi049.stdout:c81e728d9d4c2f636f067f89cc14862c d0/.snap/snap0/file_2 2024-03-16T07:40:29.259 INFO:teuthology.orchestra.run.smithi049.stdout:f7177163c833dff4b38fc8d2872f1ec6 d0/.snap/snap0/file_44 2024-03-16T07:40:29.260 INFO:teuthology.orchestra.run.smithi049.stdout:3416a75f4cea9109507cacd8e2f2aefc d0/.snap/snap0/file_41 2024-03-16T07:40:29.261 INFO:teuthology.orchestra.run.smithi049.stdout:c74d97b01eae257e44aa9d5bade97baf d0/.snap/snap0/file_16 2024-03-16T07:40:29.263 INFO:teuthology.orchestra.run.smithi049.stdout:34173cb38f07f89ddbebc2ac9128303f d0/.snap/snap0/file_30 2024-03-16T07:40:29.264 INFO:teuthology.orchestra.run.smithi049.stdout:37693cfc748049e45d87b8c7d8b9aacd d0/.snap/snap0/file_23 2024-03-16T07:40:29.265 INFO:teuthology.orchestra.run.smithi049.stdout:a5771bce93e200c36f7cd9dfd0e5deaa d0/.snap/snap0/file_38 2024-03-16T07:40:29.267 INFO:teuthology.orchestra.run.smithi049.stdout:c51ce410c124a10e0db5e4b97fc2af39 d0/.snap/snap0/file_13 2024-03-16T07:40:29.268 INFO:teuthology.orchestra.run.smithi049.stdout:8e296a067a37563370ded05f5a3bf3ec d0/.snap/snap0/file_25 2024-03-16T07:40:29.270 INFO:teuthology.orchestra.run.smithi049.stdout:cfcd208495d565ef66e7dff9f98764da d0/.snap/snap0/file_0 2024-03-16T07:40:29.271 INFO:teuthology.orchestra.run.smithi049.stdout:33e75ff09dd601bbe69f351039152189 d0/.snap/snap0/file_28 2024-03-16T07:40:29.272 INFO:teuthology.orchestra.run.smithi049.stdout:02e74f10e0327ad868d138f2b4fdd6f0 d0/.snap/snap0/file_27 2024-03-16T07:40:29.274 INFO:teuthology.orchestra.run.smithi049.stdout:6364d3f0f495b6ab9dcf8d3b5c6e0b01 d0/.snap/snap0/file_32 2024-03-16T07:40:29.275 INFO:teuthology.orchestra.run.smithi049.stdout:6ea9ab1baa0efb9e19094440c317e21b d0/.snap/snap0/file_29 2024-03-16T07:40:29.277 INFO:teuthology.orchestra.run.smithi049.stdout:f457c545a9ded88f18ecee47145a72c0 d0/.snap/snap0/file_49 2024-03-16T07:40:29.278 INFO:teuthology.orchestra.run.smithi049.stdout:4e732ced3463d06de0ca9a15b6153677 d0/.snap/snap0/file_26 2024-03-16T07:40:29.280 INFO:teuthology.orchestra.run.smithi049.stdout:e369853df766fa44e1ed0ff613f563bd d0/.snap/snap0/file_34 2024-03-16T07:40:29.282 INFO:teuthology.orchestra.run.smithi049.stdout:17e62166fc8586dfa4d1bc0e1742c08b d0/.snap/snap0/file_43 2024-03-16T07:40:29.283 INFO:teuthology.orchestra.run.smithi049.stdout:1f0e3dad99908345f7439f8ffabdffc4 d0/.snap/snap0/file_19 2024-03-16T07:40:29.285 INFO:teuthology.orchestra.run.smithi049.stdout:a1d0c6e83f027327d8461063f4ac58a6 d0/.snap/snap0/file_42 2024-03-16T07:40:29.286 INFO:teuthology.orchestra.run.smithi049.stdout:d645920e395fedad7bbbed0eca3fe2e0 d0/.snap/snap0/file_40 2024-03-16T07:40:29.287 INFO:teuthology.orchestra.run.smithi049.stdout:eccbc87e4b5ce2fe28308fd9f2a7baf3 d0/.snap/snap0/file_3 2024-03-16T07:40:29.289 INFO:teuthology.orchestra.run.smithi049.stdout:6f4922f45568161a8cdf4ad2299f6d23 d0/.snap/snap0/file_18 2024-03-16T07:40:29.291 INFO:teuthology.orchestra.run.smithi049.stdout:d9d4f495e875a2e075a1a4a6e1b9770f d0/.snap/snap0/file_46 2024-03-16T07:40:29.292 INFO:teuthology.orchestra.run.smithi049.stdout:d67d8ab4f4c10bf22aa353e27879133c d0/.snap/snap0/file_39 2024-03-16T07:40:29.293 INFO:teuthology.orchestra.run.smithi049.stdout:19ca14e7ea6328a42e0eb13d585e4c22 d0/.snap/snap0/file_36 2024-03-16T07:40:29.295 INFO:teuthology.orchestra.run.smithi049.stdout:45c48cce2e2d7fbdea1afc51c7c6ad26 d0/.snap/snap0/file_9 2024-03-16T07:40:29.296 INFO:teuthology.orchestra.run.smithi049.stdout:c9f0f895fb98ab9159f51fd0297e236d d0/.snap/snap0/file_8 2024-03-16T07:40:29.298 INFO:teuthology.orchestra.run.smithi049.stdout:1ff1de774005f8da13f42943881c655f d0/.snap/snap0/file_24 2024-03-16T07:40:29.300 INFO:teuthology.orchestra.run.smithi049.stdout:c16a5320fa475530d9583c34fd356ef5 d0/.snap/snap0/file_31 2024-03-16T07:40:29.301 INFO:teuthology.orchestra.run.smithi049.stdout:c20ad4d76fe97759aa27a0c99bff6710 d0/.snap/snap0/file_12 2024-03-16T07:40:29.303 INFO:teuthology.orchestra.run.smithi049.stdout:1c383cd30b7c298ab50293adfecb7b18 d0/.snap/snap0/file_35 2024-03-16T07:40:29.304 INFO:teuthology.orchestra.run.smithi049.stdout:8f14e45fceea167a5a36dedd4bea2543 d0/.snap/snap0/file_7 2024-03-16T07:40:29.306 INFO:teuthology.orchestra.run.smithi049.stdout:9bf31c7ff062936a96d3c8bd1f8f2ff3 d0/.snap/snap0/file_15 2024-03-16T07:40:29.308 INFO:teuthology.orchestra.run.smithi049.stdout:70efdf2ec9b086079795c442636b55fb d0/.snap/snap0/file_17 2024-03-16T07:40:29.309 DEBUG:tasks.cephfs.test_mirroring:source snapshot checksum snap0 6dd11ff9fb98d2d64d6abf2a14e31702 2024-03-16T07:40:29.309 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:40:29.309 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.1 && exec find -L d0/.snap/snap0 -type f -exec md5sum '{}' +) 2024-03-16T07:40:29.369 INFO:teuthology.orchestra.run.smithi049.stdout:a5bfc9e07964f8dddeb95fc584cd965d d0/.snap/snap0/file_37 2024-03-16T07:40:29.371 INFO:teuthology.orchestra.run.smithi049.stdout:b6d767d2f8ed5d21a44b0e5886680cb9 d0/.snap/snap0/file_22 2024-03-16T07:40:29.373 INFO:teuthology.orchestra.run.smithi049.stdout:182be0c5cdcd5072bb1864cdee4d3d6e d0/.snap/snap0/file_33 2024-03-16T07:40:29.374 INFO:teuthology.orchestra.run.smithi049.stdout:c4ca4238a0b923820dcc509a6f75849b d0/.snap/snap0/file_1 2024-03-16T07:40:29.376 INFO:teuthology.orchestra.run.smithi049.stdout:67c6a1e7ce56d3d6fa748ab6d9af3fd7 d0/.snap/snap0/file_47 2024-03-16T07:40:29.377 INFO:teuthology.orchestra.run.smithi049.stdout:a87ff679a2f3e71d9181a67b7542122c d0/.snap/snap0/file_4 2024-03-16T07:40:29.378 INFO:teuthology.orchestra.run.smithi049.stdout:6c8349cc7260ae62e3b1396831a8398f d0/.snap/snap0/file_45 2024-03-16T07:40:29.380 INFO:teuthology.orchestra.run.smithi049.stdout:d3d9446802a44259755d38e6d163e820 d0/.snap/snap0/file_10 2024-03-16T07:40:29.381 INFO:teuthology.orchestra.run.smithi049.stdout:642e92efb79421734881b53e1e1b18b6 d0/.snap/snap0/file_48 2024-03-16T07:40:29.382 INFO:teuthology.orchestra.run.smithi049.stdout:3c59dc048e8850243be8079a5c74d079 d0/.snap/snap0/file_21 2024-03-16T07:40:29.383 INFO:teuthology.orchestra.run.smithi049.stdout:6512bd43d9caa6e02c990b0a82652dca d0/.snap/snap0/file_11 2024-03-16T07:40:29.384 INFO:teuthology.orchestra.run.smithi049.stdout:e4da3b7fbbce2345d7772b0674a318d5 d0/.snap/snap0/file_5 2024-03-16T07:40:29.386 INFO:teuthology.orchestra.run.smithi049.stdout:1679091c5a880faf6fb5e6087eb1b2dc d0/.snap/snap0/file_6 2024-03-16T07:40:29.387 INFO:teuthology.orchestra.run.smithi049.stdout:aab3238922bcc25a6f606eb525ffdc56 d0/.snap/snap0/file_14 2024-03-16T07:40:29.388 INFO:teuthology.orchestra.run.smithi049.stdout:98f13708210194c475687be6106a3b84 d0/.snap/snap0/file_20 2024-03-16T07:40:29.390 INFO:teuthology.orchestra.run.smithi049.stdout:c81e728d9d4c2f636f067f89cc14862c d0/.snap/snap0/file_2 2024-03-16T07:40:29.392 INFO:teuthology.orchestra.run.smithi049.stdout:f7177163c833dff4b38fc8d2872f1ec6 d0/.snap/snap0/file_44 2024-03-16T07:40:29.393 INFO:teuthology.orchestra.run.smithi049.stdout:3416a75f4cea9109507cacd8e2f2aefc d0/.snap/snap0/file_41 2024-03-16T07:40:29.394 INFO:teuthology.orchestra.run.smithi049.stdout:c74d97b01eae257e44aa9d5bade97baf d0/.snap/snap0/file_16 2024-03-16T07:40:29.395 INFO:teuthology.orchestra.run.smithi049.stdout:34173cb38f07f89ddbebc2ac9128303f d0/.snap/snap0/file_30 2024-03-16T07:40:29.397 INFO:teuthology.orchestra.run.smithi049.stdout:37693cfc748049e45d87b8c7d8b9aacd d0/.snap/snap0/file_23 2024-03-16T07:40:29.399 INFO:teuthology.orchestra.run.smithi049.stdout:a5771bce93e200c36f7cd9dfd0e5deaa d0/.snap/snap0/file_38 2024-03-16T07:40:29.400 INFO:teuthology.orchestra.run.smithi049.stdout:c51ce410c124a10e0db5e4b97fc2af39 d0/.snap/snap0/file_13 2024-03-16T07:40:29.401 INFO:teuthology.orchestra.run.smithi049.stdout:8e296a067a37563370ded05f5a3bf3ec d0/.snap/snap0/file_25 2024-03-16T07:40:29.402 INFO:teuthology.orchestra.run.smithi049.stdout:cfcd208495d565ef66e7dff9f98764da d0/.snap/snap0/file_0 2024-03-16T07:40:29.404 INFO:teuthology.orchestra.run.smithi049.stdout:33e75ff09dd601bbe69f351039152189 d0/.snap/snap0/file_28 2024-03-16T07:40:29.405 INFO:teuthology.orchestra.run.smithi049.stdout:02e74f10e0327ad868d138f2b4fdd6f0 d0/.snap/snap0/file_27 2024-03-16T07:40:29.406 INFO:teuthology.orchestra.run.smithi049.stdout:6364d3f0f495b6ab9dcf8d3b5c6e0b01 d0/.snap/snap0/file_32 2024-03-16T07:40:29.407 INFO:teuthology.orchestra.run.smithi049.stdout:6ea9ab1baa0efb9e19094440c317e21b d0/.snap/snap0/file_29 2024-03-16T07:40:29.408 INFO:teuthology.orchestra.run.smithi049.stdout:f457c545a9ded88f18ecee47145a72c0 d0/.snap/snap0/file_49 2024-03-16T07:40:29.410 INFO:teuthology.orchestra.run.smithi049.stdout:4e732ced3463d06de0ca9a15b6153677 d0/.snap/snap0/file_26 2024-03-16T07:40:29.411 INFO:teuthology.orchestra.run.smithi049.stdout:e369853df766fa44e1ed0ff613f563bd d0/.snap/snap0/file_34 2024-03-16T07:40:29.412 INFO:teuthology.orchestra.run.smithi049.stdout:17e62166fc8586dfa4d1bc0e1742c08b d0/.snap/snap0/file_43 2024-03-16T07:40:29.413 INFO:teuthology.orchestra.run.smithi049.stdout:1f0e3dad99908345f7439f8ffabdffc4 d0/.snap/snap0/file_19 2024-03-16T07:40:29.414 INFO:teuthology.orchestra.run.smithi049.stdout:a1d0c6e83f027327d8461063f4ac58a6 d0/.snap/snap0/file_42 2024-03-16T07:40:29.416 INFO:teuthology.orchestra.run.smithi049.stdout:d645920e395fedad7bbbed0eca3fe2e0 d0/.snap/snap0/file_40 2024-03-16T07:40:29.417 INFO:teuthology.orchestra.run.smithi049.stdout:eccbc87e4b5ce2fe28308fd9f2a7baf3 d0/.snap/snap0/file_3 2024-03-16T07:40:29.418 INFO:teuthology.orchestra.run.smithi049.stdout:6f4922f45568161a8cdf4ad2299f6d23 d0/.snap/snap0/file_18 2024-03-16T07:40:29.420 INFO:teuthology.orchestra.run.smithi049.stdout:d9d4f495e875a2e075a1a4a6e1b9770f d0/.snap/snap0/file_46 2024-03-16T07:40:29.421 INFO:teuthology.orchestra.run.smithi049.stdout:d67d8ab4f4c10bf22aa353e27879133c d0/.snap/snap0/file_39 2024-03-16T07:40:29.422 INFO:teuthology.orchestra.run.smithi049.stdout:19ca14e7ea6328a42e0eb13d585e4c22 d0/.snap/snap0/file_36 2024-03-16T07:40:29.424 INFO:teuthology.orchestra.run.smithi049.stdout:45c48cce2e2d7fbdea1afc51c7c6ad26 d0/.snap/snap0/file_9 2024-03-16T07:40:29.425 INFO:teuthology.orchestra.run.smithi049.stdout:c9f0f895fb98ab9159f51fd0297e236d d0/.snap/snap0/file_8 2024-03-16T07:40:29.426 INFO:teuthology.orchestra.run.smithi049.stdout:1ff1de774005f8da13f42943881c655f d0/.snap/snap0/file_24 2024-03-16T07:40:29.427 INFO:teuthology.orchestra.run.smithi049.stdout:c16a5320fa475530d9583c34fd356ef5 d0/.snap/snap0/file_31 2024-03-16T07:40:29.428 INFO:teuthology.orchestra.run.smithi049.stdout:c20ad4d76fe97759aa27a0c99bff6710 d0/.snap/snap0/file_12 2024-03-16T07:40:29.430 INFO:teuthology.orchestra.run.smithi049.stdout:1c383cd30b7c298ab50293adfecb7b18 d0/.snap/snap0/file_35 2024-03-16T07:40:29.431 INFO:teuthology.orchestra.run.smithi049.stdout:8f14e45fceea167a5a36dedd4bea2543 d0/.snap/snap0/file_7 2024-03-16T07:40:29.432 INFO:teuthology.orchestra.run.smithi049.stdout:9bf31c7ff062936a96d3c8bd1f8f2ff3 d0/.snap/snap0/file_15 2024-03-16T07:40:29.434 INFO:teuthology.orchestra.run.smithi049.stdout:70efdf2ec9b086079795c442636b55fb d0/.snap/snap0/file_17 2024-03-16T07:40:29.434 DEBUG:tasks.cephfs.test_mirroring:destination snapshot checksum snap0 6dd11ff9fb98d2d64d6abf2a14e31702 2024-03-16T07:40:29.435 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T07:40:29.899 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:40:29.900 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":124,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6690,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6827/875237476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":875237476},{"type":"v1","addr":"172.21.15.49:6827","nonce":875237476}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":113},{"gid":6691,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6829/417322500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":417322500},{"type":"v1","addr":"172.21.15.49:6829","nonce":417322500}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":113},{"gid":6696,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6831/4121914730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":4121914730},{"type":"v1","addr":"172.21.15.49:6831","nonce":4121914730}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":113}],"filesystems":[{"mdsmap":{"epoch":124,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-16T07:35:10.038977+0000","modified":"2024-03-16T07:37:19.309479+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6698},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6698":{"gid":6698,"name":"a","rank":0,"incarnation":114,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6835/1838330688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":1838330688},{"type":"v1","addr":"172.21.15.49:6835","nonce":1838330688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[29],"metadata_pool":28,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6698,"qdb_cluster":[6698]},"id":14,"mirror_info":{"peers":{"8fa2e0a7-a624-43b8-9c12-da3a1afea05a":{"remote":{"client_name":"client.mirror_remote","cluster_name":"ceph","fs_name":"backup_fs"}}}}},{"mdsmap":{"epoch":122,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-16T07:35:23.124362+0000","modified":"2024-03-16T07:35:26.073338+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6697},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6697":{"gid":6697,"name":"e","rank":0,"incarnation":118,"state":"up:active","state_seq":6,"addr":"172.21.15.49:6834/1716116460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":1716116460},{"type":"v1","addr":"172.21.15.49:6834","nonce":1716116460}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[31],"metadata_pool":30,"enabled":true,"fs_name":"backup_fs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6697,"qdb_cluster":[6697]},"id":15}]} 2024-03-16T07:40:29.900 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 124 2024-03-16T07:40:29.912 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-03-16T07:40:29.912 DEBUG:teuthology.orchestra.run.smithi049:peer status for fs: cephfs> ceph --admin-daemon /var/run/ceph/cephfs-mirror.asok fs mirror peer status cephfs@14 8fa2e0a7-a624-43b8-9c12-da3a1afea05a 2024-03-16T07:40:30.009 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-03-16T07:40:30.009 INFO:teuthology.orchestra.run.smithi049.stdout: "/d0": { 2024-03-16T07:40:30.009 INFO:teuthology.orchestra.run.smithi049.stdout: "state": "idle", 2024-03-16T07:40:30.009 INFO:teuthology.orchestra.run.smithi049.stdout: "last_synced_snap": { 2024-03-16T07:40:30.009 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 8, 2024-03-16T07:40:30.009 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "snap0", 2024-03-16T07:40:30.009 INFO:teuthology.orchestra.run.smithi049.stdout: "sync_duration": 1.7279525259999999, 2024-03-16T07:40:30.009 INFO:teuthology.orchestra.run.smithi049.stdout: "sync_time_stamp": "1689.277487s" 2024-03-16T07:40:30.009 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:40:30.009 INFO:teuthology.orchestra.run.smithi049.stdout: "snaps_synced": 1, 2024-03-16T07:40:30.010 INFO:teuthology.orchestra.run.smithi049.stdout: "snaps_deleted": 0, 2024-03-16T07:40:30.010 INFO:teuthology.orchestra.run.smithi049.stdout: "snaps_renamed": 0 2024-03-16T07:40:30.010 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:40:30.010 INFO:teuthology.orchestra.run.smithi049.stdout: "/d1": { 2024-03-16T07:40:30.010 INFO:teuthology.orchestra.run.smithi049.stdout: "state": "idle", 2024-03-16T07:40:30.010 INFO:teuthology.orchestra.run.smithi049.stdout: "last_synced_snap": { 2024-03-16T07:40:30.010 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 9, 2024-03-16T07:40:30.010 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "snap0", 2024-03-16T07:40:30.010 INFO:teuthology.orchestra.run.smithi049.stdout: "sync_duration": 0.57498420299999997, 2024-03-16T07:40:30.010 INFO:teuthology.orchestra.run.smithi049.stdout: "sync_time_stamp": "1698.445235s" 2024-03-16T07:40:30.010 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:40:30.010 INFO:teuthology.orchestra.run.smithi049.stdout: "snaps_synced": 1, 2024-03-16T07:40:30.010 INFO:teuthology.orchestra.run.smithi049.stdout: "snaps_deleted": 0, 2024-03-16T07:40:30.010 INFO:teuthology.orchestra.run.smithi049.stdout: "snaps_renamed": 0 2024-03-16T07:40:30.011 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:40:30.011 INFO:teuthology.orchestra.run.smithi049.stdout: "/d2": { 2024-03-16T07:40:30.011 INFO:teuthology.orchestra.run.smithi049.stdout: "state": "idle", 2024-03-16T07:40:30.011 INFO:teuthology.orchestra.run.smithi049.stdout: "last_synced_snap": { 2024-03-16T07:40:30.011 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 10, 2024-03-16T07:40:30.011 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "snap0", 2024-03-16T07:40:30.011 INFO:teuthology.orchestra.run.smithi049.stdout: "sync_duration": 1.6699541200000001, 2024-03-16T07:40:30.011 INFO:teuthology.orchestra.run.smithi049.stdout: "sync_time_stamp": "1689.426483s" 2024-03-16T07:40:30.011 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:40:30.011 INFO:teuthology.orchestra.run.smithi049.stdout: "snaps_synced": 1, 2024-03-16T07:40:30.011 INFO:teuthology.orchestra.run.smithi049.stdout: "snaps_deleted": 0, 2024-03-16T07:40:30.011 INFO:teuthology.orchestra.run.smithi049.stdout: "snaps_renamed": 0 2024-03-16T07:40:30.011 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:40:30.011 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-03-16T07:40:30.016 DEBUG:tasks.cephfs.test_mirroring:command returned={ "/d0": { "state": "idle", "last_synced_snap": { "id": 8, "name": "snap0", "sync_duration": 1.7279525259999999, "sync_time_stamp": "1689.277487s" }, "snaps_synced": 1, "snaps_deleted": 0, "snaps_renamed": 0 }, "/d1": { "state": "idle", "last_synced_snap": { "id": 9, "name": "snap0", "sync_duration": 0.57498420299999997, "sync_time_stamp": "1698.445235s" }, "snaps_synced": 1, "snaps_deleted": 0, "snaps_renamed": 0 }, "/d2": { "state": "idle", "last_synced_snap": { "id": 10, "name": "snap0", "sync_duration": 1.6699541200000001, "sync_time_stamp": "1689.426483s" }, "snaps_synced": 1, "snaps_deleted": 0, "snaps_renamed": 0 } } 2024-03-16T07:40:30.017 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:40:30.017 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.1 && exec ls d1/.snap) 2024-03-16T07:40:30.035 INFO:teuthology.orchestra.run.smithi049.stdout:snap0 2024-03-16T07:40:30.036 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:40:30.036 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec find -L d1/.snap/snap0 -type f -exec md5sum '{}' +) 2024-03-16T07:40:30.097 INFO:teuthology.orchestra.run.smithi049.stdout:a5bfc9e07964f8dddeb95fc584cd965d d1/.snap/snap0/file_37 2024-03-16T07:40:30.098 INFO:teuthology.orchestra.run.smithi049.stdout:b6d767d2f8ed5d21a44b0e5886680cb9 d1/.snap/snap0/file_22 2024-03-16T07:40:30.100 INFO:teuthology.orchestra.run.smithi049.stdout:182be0c5cdcd5072bb1864cdee4d3d6e d1/.snap/snap0/file_33 2024-03-16T07:40:30.101 INFO:teuthology.orchestra.run.smithi049.stdout:c4ca4238a0b923820dcc509a6f75849b d1/.snap/snap0/file_1 2024-03-16T07:40:30.103 INFO:teuthology.orchestra.run.smithi049.stdout:67c6a1e7ce56d3d6fa748ab6d9af3fd7 d1/.snap/snap0/file_47 2024-03-16T07:40:30.104 INFO:teuthology.orchestra.run.smithi049.stdout:a87ff679a2f3e71d9181a67b7542122c d1/.snap/snap0/file_4 2024-03-16T07:40:30.106 INFO:teuthology.orchestra.run.smithi049.stdout:6c8349cc7260ae62e3b1396831a8398f d1/.snap/snap0/file_45 2024-03-16T07:40:30.107 INFO:teuthology.orchestra.run.smithi049.stdout:d3d9446802a44259755d38e6d163e820 d1/.snap/snap0/file_10 2024-03-16T07:40:30.109 INFO:teuthology.orchestra.run.smithi049.stdout:642e92efb79421734881b53e1e1b18b6 d1/.snap/snap0/file_48 2024-03-16T07:40:30.110 INFO:teuthology.orchestra.run.smithi049.stdout:3c59dc048e8850243be8079a5c74d079 d1/.snap/snap0/file_21 2024-03-16T07:40:30.112 INFO:teuthology.orchestra.run.smithi049.stdout:6512bd43d9caa6e02c990b0a82652dca d1/.snap/snap0/file_11 2024-03-16T07:40:30.113 INFO:teuthology.orchestra.run.smithi049.stdout:e4da3b7fbbce2345d7772b0674a318d5 d1/.snap/snap0/file_5 2024-03-16T07:40:30.114 INFO:teuthology.orchestra.run.smithi049.stdout:1679091c5a880faf6fb5e6087eb1b2dc d1/.snap/snap0/file_6 2024-03-16T07:40:30.116 INFO:teuthology.orchestra.run.smithi049.stdout:aab3238922bcc25a6f606eb525ffdc56 d1/.snap/snap0/file_14 2024-03-16T07:40:30.117 INFO:teuthology.orchestra.run.smithi049.stdout:98f13708210194c475687be6106a3b84 d1/.snap/snap0/file_20 2024-03-16T07:40:30.119 INFO:teuthology.orchestra.run.smithi049.stdout:c81e728d9d4c2f636f067f89cc14862c d1/.snap/snap0/file_2 2024-03-16T07:40:30.120 INFO:teuthology.orchestra.run.smithi049.stdout:f7177163c833dff4b38fc8d2872f1ec6 d1/.snap/snap0/file_44 2024-03-16T07:40:30.122 INFO:teuthology.orchestra.run.smithi049.stdout:3416a75f4cea9109507cacd8e2f2aefc d1/.snap/snap0/file_41 2024-03-16T07:40:30.123 INFO:teuthology.orchestra.run.smithi049.stdout:c74d97b01eae257e44aa9d5bade97baf d1/.snap/snap0/file_16 2024-03-16T07:40:30.125 INFO:teuthology.orchestra.run.smithi049.stdout:34173cb38f07f89ddbebc2ac9128303f d1/.snap/snap0/file_30 2024-03-16T07:40:30.126 INFO:teuthology.orchestra.run.smithi049.stdout:37693cfc748049e45d87b8c7d8b9aacd d1/.snap/snap0/file_23 2024-03-16T07:40:30.127 INFO:teuthology.orchestra.run.smithi049.stdout:a5771bce93e200c36f7cd9dfd0e5deaa d1/.snap/snap0/file_38 2024-03-16T07:40:30.129 INFO:teuthology.orchestra.run.smithi049.stdout:c51ce410c124a10e0db5e4b97fc2af39 d1/.snap/snap0/file_13 2024-03-16T07:40:30.130 INFO:teuthology.orchestra.run.smithi049.stdout:8e296a067a37563370ded05f5a3bf3ec d1/.snap/snap0/file_25 2024-03-16T07:40:30.131 INFO:teuthology.orchestra.run.smithi049.stdout:cfcd208495d565ef66e7dff9f98764da d1/.snap/snap0/file_0 2024-03-16T07:40:30.133 INFO:teuthology.orchestra.run.smithi049.stdout:33e75ff09dd601bbe69f351039152189 d1/.snap/snap0/file_28 2024-03-16T07:40:30.134 INFO:teuthology.orchestra.run.smithi049.stdout:02e74f10e0327ad868d138f2b4fdd6f0 d1/.snap/snap0/file_27 2024-03-16T07:40:30.136 INFO:teuthology.orchestra.run.smithi049.stdout:6364d3f0f495b6ab9dcf8d3b5c6e0b01 d1/.snap/snap0/file_32 2024-03-16T07:40:30.137 INFO:teuthology.orchestra.run.smithi049.stdout:6ea9ab1baa0efb9e19094440c317e21b d1/.snap/snap0/file_29 2024-03-16T07:40:30.139 INFO:teuthology.orchestra.run.smithi049.stdout:f457c545a9ded88f18ecee47145a72c0 d1/.snap/snap0/file_49 2024-03-16T07:40:30.140 INFO:teuthology.orchestra.run.smithi049.stdout:4e732ced3463d06de0ca9a15b6153677 d1/.snap/snap0/file_26 2024-03-16T07:40:30.141 INFO:teuthology.orchestra.run.smithi049.stdout:e369853df766fa44e1ed0ff613f563bd d1/.snap/snap0/file_34 2024-03-16T07:40:30.143 INFO:teuthology.orchestra.run.smithi049.stdout:17e62166fc8586dfa4d1bc0e1742c08b d1/.snap/snap0/file_43 2024-03-16T07:40:30.144 INFO:teuthology.orchestra.run.smithi049.stdout:1f0e3dad99908345f7439f8ffabdffc4 d1/.snap/snap0/file_19 2024-03-16T07:40:30.145 INFO:teuthology.orchestra.run.smithi049.stdout:a1d0c6e83f027327d8461063f4ac58a6 d1/.snap/snap0/file_42 2024-03-16T07:40:30.147 INFO:teuthology.orchestra.run.smithi049.stdout:d645920e395fedad7bbbed0eca3fe2e0 d1/.snap/snap0/file_40 2024-03-16T07:40:30.148 INFO:teuthology.orchestra.run.smithi049.stdout:eccbc87e4b5ce2fe28308fd9f2a7baf3 d1/.snap/snap0/file_3 2024-03-16T07:40:30.150 INFO:teuthology.orchestra.run.smithi049.stdout:6f4922f45568161a8cdf4ad2299f6d23 d1/.snap/snap0/file_18 2024-03-16T07:40:30.151 INFO:teuthology.orchestra.run.smithi049.stdout:d9d4f495e875a2e075a1a4a6e1b9770f d1/.snap/snap0/file_46 2024-03-16T07:40:30.152 INFO:teuthology.orchestra.run.smithi049.stdout:d67d8ab4f4c10bf22aa353e27879133c d1/.snap/snap0/file_39 2024-03-16T07:40:30.154 INFO:teuthology.orchestra.run.smithi049.stdout:19ca14e7ea6328a42e0eb13d585e4c22 d1/.snap/snap0/file_36 2024-03-16T07:40:30.155 INFO:teuthology.orchestra.run.smithi049.stdout:45c48cce2e2d7fbdea1afc51c7c6ad26 d1/.snap/snap0/file_9 2024-03-16T07:40:30.157 INFO:teuthology.orchestra.run.smithi049.stdout:c9f0f895fb98ab9159f51fd0297e236d d1/.snap/snap0/file_8 2024-03-16T07:40:30.158 INFO:teuthology.orchestra.run.smithi049.stdout:1ff1de774005f8da13f42943881c655f d1/.snap/snap0/file_24 2024-03-16T07:40:30.160 INFO:teuthology.orchestra.run.smithi049.stdout:c16a5320fa475530d9583c34fd356ef5 d1/.snap/snap0/file_31 2024-03-16T07:40:30.161 INFO:teuthology.orchestra.run.smithi049.stdout:c20ad4d76fe97759aa27a0c99bff6710 d1/.snap/snap0/file_12 2024-03-16T07:40:30.162 INFO:teuthology.orchestra.run.smithi049.stdout:1c383cd30b7c298ab50293adfecb7b18 d1/.snap/snap0/file_35 2024-03-16T07:40:30.164 INFO:teuthology.orchestra.run.smithi049.stdout:8f14e45fceea167a5a36dedd4bea2543 d1/.snap/snap0/file_7 2024-03-16T07:40:30.165 INFO:teuthology.orchestra.run.smithi049.stdout:9bf31c7ff062936a96d3c8bd1f8f2ff3 d1/.snap/snap0/file_15 2024-03-16T07:40:30.167 INFO:teuthology.orchestra.run.smithi049.stdout:70efdf2ec9b086079795c442636b55fb d1/.snap/snap0/file_17 2024-03-16T07:40:30.168 DEBUG:tasks.cephfs.test_mirroring:source snapshot checksum snap0 8dcb5c5dfdec2b1610d18dd93e7e8d9c 2024-03-16T07:40:30.168 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:40:30.168 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.1 && exec find -L d1/.snap/snap0 -type f -exec md5sum '{}' +) 2024-03-16T07:40:30.228 INFO:teuthology.orchestra.run.smithi049.stdout:a5bfc9e07964f8dddeb95fc584cd965d d1/.snap/snap0/file_37 2024-03-16T07:40:30.229 INFO:teuthology.orchestra.run.smithi049.stdout:b6d767d2f8ed5d21a44b0e5886680cb9 d1/.snap/snap0/file_22 2024-03-16T07:40:30.231 INFO:teuthology.orchestra.run.smithi049.stdout:182be0c5cdcd5072bb1864cdee4d3d6e d1/.snap/snap0/file_33 2024-03-16T07:40:30.232 INFO:teuthology.orchestra.run.smithi049.stdout:c4ca4238a0b923820dcc509a6f75849b d1/.snap/snap0/file_1 2024-03-16T07:40:30.234 INFO:teuthology.orchestra.run.smithi049.stdout:67c6a1e7ce56d3d6fa748ab6d9af3fd7 d1/.snap/snap0/file_47 2024-03-16T07:40:30.235 INFO:teuthology.orchestra.run.smithi049.stdout:a87ff679a2f3e71d9181a67b7542122c d1/.snap/snap0/file_4 2024-03-16T07:40:30.237 INFO:teuthology.orchestra.run.smithi049.stdout:6c8349cc7260ae62e3b1396831a8398f d1/.snap/snap0/file_45 2024-03-16T07:40:30.238 INFO:teuthology.orchestra.run.smithi049.stdout:d3d9446802a44259755d38e6d163e820 d1/.snap/snap0/file_10 2024-03-16T07:40:30.240 INFO:teuthology.orchestra.run.smithi049.stdout:642e92efb79421734881b53e1e1b18b6 d1/.snap/snap0/file_48 2024-03-16T07:40:30.241 INFO:teuthology.orchestra.run.smithi049.stdout:3c59dc048e8850243be8079a5c74d079 d1/.snap/snap0/file_21 2024-03-16T07:40:30.243 INFO:teuthology.orchestra.run.smithi049.stdout:6512bd43d9caa6e02c990b0a82652dca d1/.snap/snap0/file_11 2024-03-16T07:40:30.244 INFO:teuthology.orchestra.run.smithi049.stdout:e4da3b7fbbce2345d7772b0674a318d5 d1/.snap/snap0/file_5 2024-03-16T07:40:30.246 INFO:teuthology.orchestra.run.smithi049.stdout:1679091c5a880faf6fb5e6087eb1b2dc d1/.snap/snap0/file_6 2024-03-16T07:40:30.247 INFO:teuthology.orchestra.run.smithi049.stdout:aab3238922bcc25a6f606eb525ffdc56 d1/.snap/snap0/file_14 2024-03-16T07:40:30.249 INFO:teuthology.orchestra.run.smithi049.stdout:98f13708210194c475687be6106a3b84 d1/.snap/snap0/file_20 2024-03-16T07:40:30.250 INFO:teuthology.orchestra.run.smithi049.stdout:c81e728d9d4c2f636f067f89cc14862c d1/.snap/snap0/file_2 2024-03-16T07:40:30.252 INFO:teuthology.orchestra.run.smithi049.stdout:f7177163c833dff4b38fc8d2872f1ec6 d1/.snap/snap0/file_44 2024-03-16T07:40:30.253 INFO:teuthology.orchestra.run.smithi049.stdout:3416a75f4cea9109507cacd8e2f2aefc d1/.snap/snap0/file_41 2024-03-16T07:40:30.254 INFO:teuthology.orchestra.run.smithi049.stdout:c74d97b01eae257e44aa9d5bade97baf d1/.snap/snap0/file_16 2024-03-16T07:40:30.256 INFO:teuthology.orchestra.run.smithi049.stdout:34173cb38f07f89ddbebc2ac9128303f d1/.snap/snap0/file_30 2024-03-16T07:40:30.257 INFO:teuthology.orchestra.run.smithi049.stdout:37693cfc748049e45d87b8c7d8b9aacd d1/.snap/snap0/file_23 2024-03-16T07:40:30.258 INFO:teuthology.orchestra.run.smithi049.stdout:a5771bce93e200c36f7cd9dfd0e5deaa d1/.snap/snap0/file_38 2024-03-16T07:40:30.259 INFO:teuthology.orchestra.run.smithi049.stdout:c51ce410c124a10e0db5e4b97fc2af39 d1/.snap/snap0/file_13 2024-03-16T07:40:30.261 INFO:teuthology.orchestra.run.smithi049.stdout:8e296a067a37563370ded05f5a3bf3ec d1/.snap/snap0/file_25 2024-03-16T07:40:30.262 INFO:teuthology.orchestra.run.smithi049.stdout:cfcd208495d565ef66e7dff9f98764da d1/.snap/snap0/file_0 2024-03-16T07:40:30.264 INFO:teuthology.orchestra.run.smithi049.stdout:33e75ff09dd601bbe69f351039152189 d1/.snap/snap0/file_28 2024-03-16T07:40:30.265 INFO:teuthology.orchestra.run.smithi049.stdout:02e74f10e0327ad868d138f2b4fdd6f0 d1/.snap/snap0/file_27 2024-03-16T07:40:30.266 INFO:teuthology.orchestra.run.smithi049.stdout:6364d3f0f495b6ab9dcf8d3b5c6e0b01 d1/.snap/snap0/file_32 2024-03-16T07:40:30.268 INFO:teuthology.orchestra.run.smithi049.stdout:6ea9ab1baa0efb9e19094440c317e21b d1/.snap/snap0/file_29 2024-03-16T07:40:30.269 INFO:teuthology.orchestra.run.smithi049.stdout:f457c545a9ded88f18ecee47145a72c0 d1/.snap/snap0/file_49 2024-03-16T07:40:30.270 INFO:teuthology.orchestra.run.smithi049.stdout:4e732ced3463d06de0ca9a15b6153677 d1/.snap/snap0/file_26 2024-03-16T07:40:30.271 INFO:teuthology.orchestra.run.smithi049.stdout:e369853df766fa44e1ed0ff613f563bd d1/.snap/snap0/file_34 2024-03-16T07:40:30.273 INFO:teuthology.orchestra.run.smithi049.stdout:17e62166fc8586dfa4d1bc0e1742c08b d1/.snap/snap0/file_43 2024-03-16T07:40:30.274 INFO:teuthology.orchestra.run.smithi049.stdout:1f0e3dad99908345f7439f8ffabdffc4 d1/.snap/snap0/file_19 2024-03-16T07:40:30.275 INFO:teuthology.orchestra.run.smithi049.stdout:a1d0c6e83f027327d8461063f4ac58a6 d1/.snap/snap0/file_42 2024-03-16T07:40:30.276 INFO:teuthology.orchestra.run.smithi049.stdout:d645920e395fedad7bbbed0eca3fe2e0 d1/.snap/snap0/file_40 2024-03-16T07:40:30.278 INFO:teuthology.orchestra.run.smithi049.stdout:eccbc87e4b5ce2fe28308fd9f2a7baf3 d1/.snap/snap0/file_3 2024-03-16T07:40:30.279 INFO:teuthology.orchestra.run.smithi049.stdout:6f4922f45568161a8cdf4ad2299f6d23 d1/.snap/snap0/file_18 2024-03-16T07:40:30.280 INFO:teuthology.orchestra.run.smithi049.stdout:d9d4f495e875a2e075a1a4a6e1b9770f d1/.snap/snap0/file_46 2024-03-16T07:40:30.282 INFO:teuthology.orchestra.run.smithi049.stdout:d67d8ab4f4c10bf22aa353e27879133c d1/.snap/snap0/file_39 2024-03-16T07:40:30.283 INFO:teuthology.orchestra.run.smithi049.stdout:19ca14e7ea6328a42e0eb13d585e4c22 d1/.snap/snap0/file_36 2024-03-16T07:40:30.284 INFO:teuthology.orchestra.run.smithi049.stdout:45c48cce2e2d7fbdea1afc51c7c6ad26 d1/.snap/snap0/file_9 2024-03-16T07:40:30.285 INFO:teuthology.orchestra.run.smithi049.stdout:c9f0f895fb98ab9159f51fd0297e236d d1/.snap/snap0/file_8 2024-03-16T07:40:30.287 INFO:teuthology.orchestra.run.smithi049.stdout:1ff1de774005f8da13f42943881c655f d1/.snap/snap0/file_24 2024-03-16T07:40:30.288 INFO:teuthology.orchestra.run.smithi049.stdout:c16a5320fa475530d9583c34fd356ef5 d1/.snap/snap0/file_31 2024-03-16T07:40:30.289 INFO:teuthology.orchestra.run.smithi049.stdout:c20ad4d76fe97759aa27a0c99bff6710 d1/.snap/snap0/file_12 2024-03-16T07:40:30.290 INFO:teuthology.orchestra.run.smithi049.stdout:1c383cd30b7c298ab50293adfecb7b18 d1/.snap/snap0/file_35 2024-03-16T07:40:30.292 INFO:teuthology.orchestra.run.smithi049.stdout:8f14e45fceea167a5a36dedd4bea2543 d1/.snap/snap0/file_7 2024-03-16T07:40:30.293 INFO:teuthology.orchestra.run.smithi049.stdout:9bf31c7ff062936a96d3c8bd1f8f2ff3 d1/.snap/snap0/file_15 2024-03-16T07:40:30.294 INFO:teuthology.orchestra.run.smithi049.stdout:70efdf2ec9b086079795c442636b55fb d1/.snap/snap0/file_17 2024-03-16T07:40:30.295 DEBUG:tasks.cephfs.test_mirroring:destination snapshot checksum snap0 8dcb5c5dfdec2b1610d18dd93e7e8d9c 2024-03-16T07:40:30.295 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T07:40:30.690 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:40:30.690 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":124,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6690,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6827/875237476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":875237476},{"type":"v1","addr":"172.21.15.49:6827","nonce":875237476}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":113},{"gid":6691,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6829/417322500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":417322500},{"type":"v1","addr":"172.21.15.49:6829","nonce":417322500}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":113},{"gid":6696,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6831/4121914730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":4121914730},{"type":"v1","addr":"172.21.15.49:6831","nonce":4121914730}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":113}],"filesystems":[{"mdsmap":{"epoch":124,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-16T07:35:10.038977+0000","modified":"2024-03-16T07:37:19.309479+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6698},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6698":{"gid":6698,"name":"a","rank":0,"incarnation":114,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6835/1838330688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":1838330688},{"type":"v1","addr":"172.21.15.49:6835","nonce":1838330688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[29],"metadata_pool":28,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6698,"qdb_cluster":[6698]},"id":14,"mirror_info":{"peers":{"8fa2e0a7-a624-43b8-9c12-da3a1afea05a":{"remote":{"client_name":"client.mirror_remote","cluster_name":"ceph","fs_name":"backup_fs"}}}}},{"mdsmap":{"epoch":122,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-16T07:35:23.124362+0000","modified":"2024-03-16T07:35:26.073338+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6697},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6697":{"gid":6697,"name":"e","rank":0,"incarnation":118,"state":"up:active","state_seq":6,"addr":"172.21.15.49:6834/1716116460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":1716116460},{"type":"v1","addr":"172.21.15.49:6834","nonce":1716116460}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[31],"metadata_pool":30,"enabled":true,"fs_name":"backup_fs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6697,"qdb_cluster":[6697]},"id":15}]} 2024-03-16T07:40:30.690 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 124 2024-03-16T07:40:30.703 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-03-16T07:40:30.703 DEBUG:teuthology.orchestra.run.smithi049:peer status for fs: cephfs> ceph --admin-daemon /var/run/ceph/cephfs-mirror.asok fs mirror peer status cephfs@14 8fa2e0a7-a624-43b8-9c12-da3a1afea05a 2024-03-16T07:40:30.806 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-03-16T07:40:30.806 INFO:teuthology.orchestra.run.smithi049.stdout: "/d0": { 2024-03-16T07:40:30.806 INFO:teuthology.orchestra.run.smithi049.stdout: "state": "idle", 2024-03-16T07:40:30.807 INFO:teuthology.orchestra.run.smithi049.stdout: "last_synced_snap": { 2024-03-16T07:40:30.807 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 8, 2024-03-16T07:40:30.807 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "snap0", 2024-03-16T07:40:30.807 INFO:teuthology.orchestra.run.smithi049.stdout: "sync_duration": 1.7279525259999999, 2024-03-16T07:40:30.807 INFO:teuthology.orchestra.run.smithi049.stdout: "sync_time_stamp": "1689.277487s" 2024-03-16T07:40:30.807 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:40:30.807 INFO:teuthology.orchestra.run.smithi049.stdout: "snaps_synced": 1, 2024-03-16T07:40:30.807 INFO:teuthology.orchestra.run.smithi049.stdout: "snaps_deleted": 0, 2024-03-16T07:40:30.807 INFO:teuthology.orchestra.run.smithi049.stdout: "snaps_renamed": 0 2024-03-16T07:40:30.807 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:40:30.807 INFO:teuthology.orchestra.run.smithi049.stdout: "/d1": { 2024-03-16T07:40:30.807 INFO:teuthology.orchestra.run.smithi049.stdout: "state": "idle", 2024-03-16T07:40:30.807 INFO:teuthology.orchestra.run.smithi049.stdout: "last_synced_snap": { 2024-03-16T07:40:30.807 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 9, 2024-03-16T07:40:30.807 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "snap0", 2024-03-16T07:40:30.807 INFO:teuthology.orchestra.run.smithi049.stdout: "sync_duration": 0.57498420299999997, 2024-03-16T07:40:30.808 INFO:teuthology.orchestra.run.smithi049.stdout: "sync_time_stamp": "1698.445235s" 2024-03-16T07:40:30.808 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:40:30.808 INFO:teuthology.orchestra.run.smithi049.stdout: "snaps_synced": 1, 2024-03-16T07:40:30.808 INFO:teuthology.orchestra.run.smithi049.stdout: "snaps_deleted": 0, 2024-03-16T07:40:30.808 INFO:teuthology.orchestra.run.smithi049.stdout: "snaps_renamed": 0 2024-03-16T07:40:30.808 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:40:30.808 INFO:teuthology.orchestra.run.smithi049.stdout: "/d2": { 2024-03-16T07:40:30.808 INFO:teuthology.orchestra.run.smithi049.stdout: "state": "idle", 2024-03-16T07:40:30.808 INFO:teuthology.orchestra.run.smithi049.stdout: "last_synced_snap": { 2024-03-16T07:40:30.808 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 10, 2024-03-16T07:40:30.808 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "snap0", 2024-03-16T07:40:30.808 INFO:teuthology.orchestra.run.smithi049.stdout: "sync_duration": 1.6699541200000001, 2024-03-16T07:40:30.808 INFO:teuthology.orchestra.run.smithi049.stdout: "sync_time_stamp": "1689.426483s" 2024-03-16T07:40:30.808 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:40:30.808 INFO:teuthology.orchestra.run.smithi049.stdout: "snaps_synced": 1, 2024-03-16T07:40:30.808 INFO:teuthology.orchestra.run.smithi049.stdout: "snaps_deleted": 0, 2024-03-16T07:40:30.809 INFO:teuthology.orchestra.run.smithi049.stdout: "snaps_renamed": 0 2024-03-16T07:40:30.809 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:40:30.809 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-03-16T07:40:30.818 DEBUG:tasks.cephfs.test_mirroring:command returned={ "/d0": { "state": "idle", "last_synced_snap": { "id": 8, "name": "snap0", "sync_duration": 1.7279525259999999, "sync_time_stamp": "1689.277487s" }, "snaps_synced": 1, "snaps_deleted": 0, "snaps_renamed": 0 }, "/d1": { "state": "idle", "last_synced_snap": { "id": 9, "name": "snap0", "sync_duration": 0.57498420299999997, "sync_time_stamp": "1698.445235s" }, "snaps_synced": 1, "snaps_deleted": 0, "snaps_renamed": 0 }, "/d2": { "state": "idle", "last_synced_snap": { "id": 10, "name": "snap0", "sync_duration": 1.6699541200000001, "sync_time_stamp": "1689.426483s" }, "snaps_synced": 1, "snaps_deleted": 0, "snaps_renamed": 0 } } 2024-03-16T07:40:30.818 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:40:30.818 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.1 && exec ls d2/.snap) 2024-03-16T07:40:30.835 INFO:teuthology.orchestra.run.smithi049.stdout:snap0 2024-03-16T07:40:30.836 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:40:30.836 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec find -L d2/.snap/snap0 -type f -exec md5sum '{}' +) 2024-03-16T07:40:30.897 INFO:teuthology.orchestra.run.smithi049.stdout:a5bfc9e07964f8dddeb95fc584cd965d d2/.snap/snap0/file_37 2024-03-16T07:40:30.898 INFO:teuthology.orchestra.run.smithi049.stdout:b6d767d2f8ed5d21a44b0e5886680cb9 d2/.snap/snap0/file_22 2024-03-16T07:40:30.900 INFO:teuthology.orchestra.run.smithi049.stdout:182be0c5cdcd5072bb1864cdee4d3d6e d2/.snap/snap0/file_33 2024-03-16T07:40:30.901 INFO:teuthology.orchestra.run.smithi049.stdout:c4ca4238a0b923820dcc509a6f75849b d2/.snap/snap0/file_1 2024-03-16T07:40:30.903 INFO:teuthology.orchestra.run.smithi049.stdout:67c6a1e7ce56d3d6fa748ab6d9af3fd7 d2/.snap/snap0/file_47 2024-03-16T07:40:30.904 INFO:teuthology.orchestra.run.smithi049.stdout:a87ff679a2f3e71d9181a67b7542122c d2/.snap/snap0/file_4 2024-03-16T07:40:30.906 INFO:teuthology.orchestra.run.smithi049.stdout:6c8349cc7260ae62e3b1396831a8398f d2/.snap/snap0/file_45 2024-03-16T07:40:30.907 INFO:teuthology.orchestra.run.smithi049.stdout:d3d9446802a44259755d38e6d163e820 d2/.snap/snap0/file_10 2024-03-16T07:40:30.909 INFO:teuthology.orchestra.run.smithi049.stdout:642e92efb79421734881b53e1e1b18b6 d2/.snap/snap0/file_48 2024-03-16T07:40:30.910 INFO:teuthology.orchestra.run.smithi049.stdout:3c59dc048e8850243be8079a5c74d079 d2/.snap/snap0/file_21 2024-03-16T07:40:30.911 INFO:teuthology.orchestra.run.smithi049.stdout:6512bd43d9caa6e02c990b0a82652dca d2/.snap/snap0/file_11 2024-03-16T07:40:30.912 INFO:teuthology.orchestra.run.smithi049.stdout:e4da3b7fbbce2345d7772b0674a318d5 d2/.snap/snap0/file_5 2024-03-16T07:40:30.914 INFO:teuthology.orchestra.run.smithi049.stdout:1679091c5a880faf6fb5e6087eb1b2dc d2/.snap/snap0/file_6 2024-03-16T07:40:30.915 INFO:teuthology.orchestra.run.smithi049.stdout:aab3238922bcc25a6f606eb525ffdc56 d2/.snap/snap0/file_14 2024-03-16T07:40:30.916 INFO:teuthology.orchestra.run.smithi049.stdout:98f13708210194c475687be6106a3b84 d2/.snap/snap0/file_20 2024-03-16T07:40:30.918 INFO:teuthology.orchestra.run.smithi049.stdout:c81e728d9d4c2f636f067f89cc14862c d2/.snap/snap0/file_2 2024-03-16T07:40:30.919 INFO:teuthology.orchestra.run.smithi049.stdout:f7177163c833dff4b38fc8d2872f1ec6 d2/.snap/snap0/file_44 2024-03-16T07:40:30.920 INFO:teuthology.orchestra.run.smithi049.stdout:3416a75f4cea9109507cacd8e2f2aefc d2/.snap/snap0/file_41 2024-03-16T07:40:30.922 INFO:teuthology.orchestra.run.smithi049.stdout:c74d97b01eae257e44aa9d5bade97baf d2/.snap/snap0/file_16 2024-03-16T07:40:30.923 INFO:teuthology.orchestra.run.smithi049.stdout:34173cb38f07f89ddbebc2ac9128303f d2/.snap/snap0/file_30 2024-03-16T07:40:30.924 INFO:teuthology.orchestra.run.smithi049.stdout:37693cfc748049e45d87b8c7d8b9aacd d2/.snap/snap0/file_23 2024-03-16T07:40:30.926 INFO:teuthology.orchestra.run.smithi049.stdout:a5771bce93e200c36f7cd9dfd0e5deaa d2/.snap/snap0/file_38 2024-03-16T07:40:30.927 INFO:teuthology.orchestra.run.smithi049.stdout:c51ce410c124a10e0db5e4b97fc2af39 d2/.snap/snap0/file_13 2024-03-16T07:40:30.929 INFO:teuthology.orchestra.run.smithi049.stdout:8e296a067a37563370ded05f5a3bf3ec d2/.snap/snap0/file_25 2024-03-16T07:40:30.930 INFO:teuthology.orchestra.run.smithi049.stdout:cfcd208495d565ef66e7dff9f98764da d2/.snap/snap0/file_0 2024-03-16T07:40:30.931 INFO:teuthology.orchestra.run.smithi049.stdout:33e75ff09dd601bbe69f351039152189 d2/.snap/snap0/file_28 2024-03-16T07:40:30.933 INFO:teuthology.orchestra.run.smithi049.stdout:02e74f10e0327ad868d138f2b4fdd6f0 d2/.snap/snap0/file_27 2024-03-16T07:40:30.934 INFO:teuthology.orchestra.run.smithi049.stdout:6364d3f0f495b6ab9dcf8d3b5c6e0b01 d2/.snap/snap0/file_32 2024-03-16T07:40:30.936 INFO:teuthology.orchestra.run.smithi049.stdout:6ea9ab1baa0efb9e19094440c317e21b d2/.snap/snap0/file_29 2024-03-16T07:40:30.937 INFO:teuthology.orchestra.run.smithi049.stdout:f457c545a9ded88f18ecee47145a72c0 d2/.snap/snap0/file_49 2024-03-16T07:40:30.938 INFO:teuthology.orchestra.run.smithi049.stdout:4e732ced3463d06de0ca9a15b6153677 d2/.snap/snap0/file_26 2024-03-16T07:40:30.940 INFO:teuthology.orchestra.run.smithi049.stdout:e369853df766fa44e1ed0ff613f563bd d2/.snap/snap0/file_34 2024-03-16T07:40:30.941 INFO:teuthology.orchestra.run.smithi049.stdout:17e62166fc8586dfa4d1bc0e1742c08b d2/.snap/snap0/file_43 2024-03-16T07:40:30.942 INFO:teuthology.orchestra.run.smithi049.stdout:1f0e3dad99908345f7439f8ffabdffc4 d2/.snap/snap0/file_19 2024-03-16T07:40:30.944 INFO:teuthology.orchestra.run.smithi049.stdout:a1d0c6e83f027327d8461063f4ac58a6 d2/.snap/snap0/file_42 2024-03-16T07:40:30.945 INFO:teuthology.orchestra.run.smithi049.stdout:d645920e395fedad7bbbed0eca3fe2e0 d2/.snap/snap0/file_40 2024-03-16T07:40:30.947 INFO:teuthology.orchestra.run.smithi049.stdout:eccbc87e4b5ce2fe28308fd9f2a7baf3 d2/.snap/snap0/file_3 2024-03-16T07:40:30.948 INFO:teuthology.orchestra.run.smithi049.stdout:6f4922f45568161a8cdf4ad2299f6d23 d2/.snap/snap0/file_18 2024-03-16T07:40:30.950 INFO:teuthology.orchestra.run.smithi049.stdout:d9d4f495e875a2e075a1a4a6e1b9770f d2/.snap/snap0/file_46 2024-03-16T07:40:30.951 INFO:teuthology.orchestra.run.smithi049.stdout:d67d8ab4f4c10bf22aa353e27879133c d2/.snap/snap0/file_39 2024-03-16T07:40:30.952 INFO:teuthology.orchestra.run.smithi049.stdout:19ca14e7ea6328a42e0eb13d585e4c22 d2/.snap/snap0/file_36 2024-03-16T07:40:30.954 INFO:teuthology.orchestra.run.smithi049.stdout:45c48cce2e2d7fbdea1afc51c7c6ad26 d2/.snap/snap0/file_9 2024-03-16T07:40:30.955 INFO:teuthology.orchestra.run.smithi049.stdout:c9f0f895fb98ab9159f51fd0297e236d d2/.snap/snap0/file_8 2024-03-16T07:40:30.957 INFO:teuthology.orchestra.run.smithi049.stdout:1ff1de774005f8da13f42943881c655f d2/.snap/snap0/file_24 2024-03-16T07:40:30.958 INFO:teuthology.orchestra.run.smithi049.stdout:c16a5320fa475530d9583c34fd356ef5 d2/.snap/snap0/file_31 2024-03-16T07:40:30.959 INFO:teuthology.orchestra.run.smithi049.stdout:c20ad4d76fe97759aa27a0c99bff6710 d2/.snap/snap0/file_12 2024-03-16T07:40:30.960 INFO:teuthology.orchestra.run.smithi049.stdout:1c383cd30b7c298ab50293adfecb7b18 d2/.snap/snap0/file_35 2024-03-16T07:40:30.962 INFO:teuthology.orchestra.run.smithi049.stdout:8f14e45fceea167a5a36dedd4bea2543 d2/.snap/snap0/file_7 2024-03-16T07:40:30.963 INFO:teuthology.orchestra.run.smithi049.stdout:9bf31c7ff062936a96d3c8bd1f8f2ff3 d2/.snap/snap0/file_15 2024-03-16T07:40:30.965 INFO:teuthology.orchestra.run.smithi049.stdout:70efdf2ec9b086079795c442636b55fb d2/.snap/snap0/file_17 2024-03-16T07:40:30.965 DEBUG:tasks.cephfs.test_mirroring:source snapshot checksum snap0 85286606b1e3e24b93bf548d0a5adbd8 2024-03-16T07:40:30.966 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:40:30.966 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.1 && exec find -L d2/.snap/snap0 -type f -exec md5sum '{}' +) 2024-03-16T07:40:31.025 INFO:teuthology.orchestra.run.smithi049.stdout:a5bfc9e07964f8dddeb95fc584cd965d d2/.snap/snap0/file_37 2024-03-16T07:40:31.026 INFO:teuthology.orchestra.run.smithi049.stdout:b6d767d2f8ed5d21a44b0e5886680cb9 d2/.snap/snap0/file_22 2024-03-16T07:40:31.027 INFO:teuthology.orchestra.run.smithi049.stdout:182be0c5cdcd5072bb1864cdee4d3d6e d2/.snap/snap0/file_33 2024-03-16T07:40:31.029 INFO:teuthology.orchestra.run.smithi049.stdout:c4ca4238a0b923820dcc509a6f75849b d2/.snap/snap0/file_1 2024-03-16T07:40:31.030 INFO:teuthology.orchestra.run.smithi049.stdout:67c6a1e7ce56d3d6fa748ab6d9af3fd7 d2/.snap/snap0/file_47 2024-03-16T07:40:31.031 INFO:teuthology.orchestra.run.smithi049.stdout:a87ff679a2f3e71d9181a67b7542122c d2/.snap/snap0/file_4 2024-03-16T07:40:31.032 INFO:teuthology.orchestra.run.smithi049.stdout:6c8349cc7260ae62e3b1396831a8398f d2/.snap/snap0/file_45 2024-03-16T07:40:31.034 INFO:teuthology.orchestra.run.smithi049.stdout:d3d9446802a44259755d38e6d163e820 d2/.snap/snap0/file_10 2024-03-16T07:40:31.035 INFO:teuthology.orchestra.run.smithi049.stdout:642e92efb79421734881b53e1e1b18b6 d2/.snap/snap0/file_48 2024-03-16T07:40:31.036 INFO:teuthology.orchestra.run.smithi049.stdout:3c59dc048e8850243be8079a5c74d079 d2/.snap/snap0/file_21 2024-03-16T07:40:31.037 INFO:teuthology.orchestra.run.smithi049.stdout:6512bd43d9caa6e02c990b0a82652dca d2/.snap/snap0/file_11 2024-03-16T07:40:31.038 INFO:teuthology.orchestra.run.smithi049.stdout:e4da3b7fbbce2345d7772b0674a318d5 d2/.snap/snap0/file_5 2024-03-16T07:40:31.040 INFO:teuthology.orchestra.run.smithi049.stdout:1679091c5a880faf6fb5e6087eb1b2dc d2/.snap/snap0/file_6 2024-03-16T07:40:31.041 INFO:teuthology.orchestra.run.smithi049.stdout:aab3238922bcc25a6f606eb525ffdc56 d2/.snap/snap0/file_14 2024-03-16T07:40:31.042 INFO:teuthology.orchestra.run.smithi049.stdout:98f13708210194c475687be6106a3b84 d2/.snap/snap0/file_20 2024-03-16T07:40:31.043 INFO:teuthology.orchestra.run.smithi049.stdout:c81e728d9d4c2f636f067f89cc14862c d2/.snap/snap0/file_2 2024-03-16T07:40:31.044 INFO:teuthology.orchestra.run.smithi049.stdout:f7177163c833dff4b38fc8d2872f1ec6 d2/.snap/snap0/file_44 2024-03-16T07:40:31.046 INFO:teuthology.orchestra.run.smithi049.stdout:3416a75f4cea9109507cacd8e2f2aefc d2/.snap/snap0/file_41 2024-03-16T07:40:31.047 INFO:teuthology.orchestra.run.smithi049.stdout:c74d97b01eae257e44aa9d5bade97baf d2/.snap/snap0/file_16 2024-03-16T07:40:31.048 INFO:teuthology.orchestra.run.smithi049.stdout:34173cb38f07f89ddbebc2ac9128303f d2/.snap/snap0/file_30 2024-03-16T07:40:31.049 INFO:teuthology.orchestra.run.smithi049.stdout:37693cfc748049e45d87b8c7d8b9aacd d2/.snap/snap0/file_23 2024-03-16T07:40:31.050 INFO:teuthology.orchestra.run.smithi049.stdout:a5771bce93e200c36f7cd9dfd0e5deaa d2/.snap/snap0/file_38 2024-03-16T07:40:31.051 INFO:teuthology.orchestra.run.smithi049.stdout:c51ce410c124a10e0db5e4b97fc2af39 d2/.snap/snap0/file_13 2024-03-16T07:40:31.052 INFO:teuthology.orchestra.run.smithi049.stdout:8e296a067a37563370ded05f5a3bf3ec d2/.snap/snap0/file_25 2024-03-16T07:40:31.054 INFO:teuthology.orchestra.run.smithi049.stdout:cfcd208495d565ef66e7dff9f98764da d2/.snap/snap0/file_0 2024-03-16T07:40:31.055 INFO:teuthology.orchestra.run.smithi049.stdout:33e75ff09dd601bbe69f351039152189 d2/.snap/snap0/file_28 2024-03-16T07:40:31.056 INFO:teuthology.orchestra.run.smithi049.stdout:02e74f10e0327ad868d138f2b4fdd6f0 d2/.snap/snap0/file_27 2024-03-16T07:40:31.057 INFO:teuthology.orchestra.run.smithi049.stdout:6364d3f0f495b6ab9dcf8d3b5c6e0b01 d2/.snap/snap0/file_32 2024-03-16T07:40:31.058 INFO:teuthology.orchestra.run.smithi049.stdout:6ea9ab1baa0efb9e19094440c317e21b d2/.snap/snap0/file_29 2024-03-16T07:40:31.060 INFO:teuthology.orchestra.run.smithi049.stdout:f457c545a9ded88f18ecee47145a72c0 d2/.snap/snap0/file_49 2024-03-16T07:40:31.061 INFO:teuthology.orchestra.run.smithi049.stdout:4e732ced3463d06de0ca9a15b6153677 d2/.snap/snap0/file_26 2024-03-16T07:40:31.062 INFO:teuthology.orchestra.run.smithi049.stdout:e369853df766fa44e1ed0ff613f563bd d2/.snap/snap0/file_34 2024-03-16T07:40:31.063 INFO:teuthology.orchestra.run.smithi049.stdout:17e62166fc8586dfa4d1bc0e1742c08b d2/.snap/snap0/file_43 2024-03-16T07:40:31.064 INFO:teuthology.orchestra.run.smithi049.stdout:1f0e3dad99908345f7439f8ffabdffc4 d2/.snap/snap0/file_19 2024-03-16T07:40:31.066 INFO:teuthology.orchestra.run.smithi049.stdout:a1d0c6e83f027327d8461063f4ac58a6 d2/.snap/snap0/file_42 2024-03-16T07:40:31.067 INFO:teuthology.orchestra.run.smithi049.stdout:d645920e395fedad7bbbed0eca3fe2e0 d2/.snap/snap0/file_40 2024-03-16T07:40:31.068 INFO:teuthology.orchestra.run.smithi049.stdout:eccbc87e4b5ce2fe28308fd9f2a7baf3 d2/.snap/snap0/file_3 2024-03-16T07:40:31.069 INFO:teuthology.orchestra.run.smithi049.stdout:6f4922f45568161a8cdf4ad2299f6d23 d2/.snap/snap0/file_18 2024-03-16T07:40:31.070 INFO:teuthology.orchestra.run.smithi049.stdout:d9d4f495e875a2e075a1a4a6e1b9770f d2/.snap/snap0/file_46 2024-03-16T07:40:31.072 INFO:teuthology.orchestra.run.smithi049.stdout:d67d8ab4f4c10bf22aa353e27879133c d2/.snap/snap0/file_39 2024-03-16T07:40:31.073 INFO:teuthology.orchestra.run.smithi049.stdout:19ca14e7ea6328a42e0eb13d585e4c22 d2/.snap/snap0/file_36 2024-03-16T07:40:31.074 INFO:teuthology.orchestra.run.smithi049.stdout:45c48cce2e2d7fbdea1afc51c7c6ad26 d2/.snap/snap0/file_9 2024-03-16T07:40:31.075 INFO:teuthology.orchestra.run.smithi049.stdout:c9f0f895fb98ab9159f51fd0297e236d d2/.snap/snap0/file_8 2024-03-16T07:40:31.076 INFO:teuthology.orchestra.run.smithi049.stdout:1ff1de774005f8da13f42943881c655f d2/.snap/snap0/file_24 2024-03-16T07:40:31.078 INFO:teuthology.orchestra.run.smithi049.stdout:c16a5320fa475530d9583c34fd356ef5 d2/.snap/snap0/file_31 2024-03-16T07:40:31.079 INFO:teuthology.orchestra.run.smithi049.stdout:c20ad4d76fe97759aa27a0c99bff6710 d2/.snap/snap0/file_12 2024-03-16T07:40:31.082 INFO:teuthology.orchestra.run.smithi049.stdout:1c383cd30b7c298ab50293adfecb7b18 d2/.snap/snap0/file_35 2024-03-16T07:40:31.082 INFO:teuthology.orchestra.run.smithi049.stdout:8f14e45fceea167a5a36dedd4bea2543 d2/.snap/snap0/file_7 2024-03-16T07:40:31.082 INFO:teuthology.orchestra.run.smithi049.stdout:9bf31c7ff062936a96d3c8bd1f8f2ff3 d2/.snap/snap0/file_15 2024-03-16T07:40:31.084 INFO:teuthology.orchestra.run.smithi049.stdout:70efdf2ec9b086079795c442636b55fb d2/.snap/snap0/file_17 2024-03-16T07:40:31.085 DEBUG:tasks.cephfs.test_mirroring:destination snapshot checksum snap0 85286606b1e3e24b93bf548d0a5adbd8 2024-03-16T07:40:31.085 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-03-16T07:40:31.085 DEBUG:teuthology.orchestra.run.smithi049:counter dump for fs: cephfs> ceph --admin-daemon /var/run/ceph/cephfs-mirror.asok counter dump 2024-03-16T07:40:31.289 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-03-16T07:40:31.290 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker": [ 2024-03-16T07:40:31.290 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:40:31.290 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:40:31.290 INFO:teuthology.orchestra.run.smithi049.stdout: "id": "0" 2024-03-16T07:40:31.290 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:40:31.290 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:40:31.290 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_ready_timeouts": 0, 2024-03-16T07:40:31.290 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_idle_timeouts": 0 2024-03-16T07:40:31.290 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:40:31.290 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:40:31.290 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:40:31.290 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:40:31.290 INFO:teuthology.orchestra.run.smithi049.stdout: "id": "1" 2024-03-16T07:40:31.291 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:40:31.291 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:40:31.291 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_ready_timeouts": 0, 2024-03-16T07:40:31.291 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_idle_timeouts": 0 2024-03-16T07:40:31.291 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:40:31.291 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:40:31.291 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:40:31.291 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:40:31.291 INFO:teuthology.orchestra.run.smithi049.stdout: "id": "2" 2024-03-16T07:40:31.291 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:40:31.291 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:40:31.291 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_ready_timeouts": 0, 2024-03-16T07:40:31.291 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_connection_idle_timeouts": 0 2024-03-16T07:40:31.291 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:40:31.291 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:40:31.292 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:40:31.292 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-0": [ 2024-03-16T07:40:31.292 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:40:31.292 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:40:31.292 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:40:31.292 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 13, 2024-03-16T07:40:31.292 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 192, 2024-03-16T07:40:31.292 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 1872, 2024-03-16T07:40:31.292 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 1072320, 2024-03-16T07:40:31.292 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 26, 2024-03-16T07:40:31.292 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 5, 2024-03-16T07:40:31.292 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 2.047934707, 2024-03-16T07:40:31.292 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.710573523, 2024-03-16T07:40:31.292 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 0.173849705, 2024-03-16T07:40:31.292 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-03-16T07:40:31.293 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T07:40:31.293 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 180, 2024-03-16T07:40:31.293 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 2.559101477, 2024-03-16T07:40:31.293 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.014217230 2024-03-16T07:40:31.293 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:40:31.293 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-03-16T07:40:31.293 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:40:31.293 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:40:31.293 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:40:31.293 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:40:31.293 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 1872, 2024-03-16T07:40:31.293 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 1072320 2024-03-16T07:40:31.293 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:40:31.293 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:40:31.293 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:40:31.293 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-1": [ 2024-03-16T07:40:31.294 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:40:31.294 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:40:31.294 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:40:31.294 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 125, 2024-03-16T07:40:31.294 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 11, 2024-03-16T07:40:31.294 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 508080, 2024-03-16T07:40:31.294 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 2448, 2024-03-16T07:40:31.294 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 4, 2024-03-16T07:40:31.294 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 0, 2024-03-16T07:40:31.294 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 2.050515416, 2024-03-16T07:40:31.294 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.264951864, 2024-03-16T07:40:31.294 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 1.159519719, 2024-03-16T07:40:31.294 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.194190800, 2024-03-16T07:40:31.294 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T07:40:31.294 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 10, 2024-03-16T07:40:31.294 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.189021381, 2024-03-16T07:40:31.295 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.018902138 2024-03-16T07:40:31.295 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:40:31.295 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-03-16T07:40:31.295 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:40:31.295 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:40:31.295 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:40:31.295 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:40:31.295 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 508080, 2024-03-16T07:40:31.295 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 2448 2024-03-16T07:40:31.295 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:40:31.295 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:40:31.295 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:40:31.295 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-2": [ 2024-03-16T07:40:31.295 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:40:31.295 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:40:31.295 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:40:31.296 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 83, 2024-03-16T07:40:31.296 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 14, 2024-03-16T07:40:31.296 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 3153504, 2024-03-16T07:40:31.296 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 2912, 2024-03-16T07:40:31.296 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 3, 2024-03-16T07:40:31.296 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 1, 2024-03-16T07:40:31.296 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 4.895743899, 2024-03-16T07:40:31.296 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.599301273, 2024-03-16T07:40:31.296 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 4.388387375, 2024-03-16T07:40:31.296 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-03-16T07:40:31.296 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-03-16T07:40:31.296 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 13, 2024-03-16T07:40:31.296 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.347167496, 2024-03-16T07:40:31.296 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.026705192 2024-03-16T07:40:31.296 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:40:31.296 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-03-16T07:40:31.296 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:40:31.297 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:40:31.297 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:40:31.297 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:40:31.297 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 3153504, 2024-03-16T07:40:31.297 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 2912 2024-03-16T07:40:31.297 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:40:31.297 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:40:31.297 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:40:31.297 INFO:teuthology.orchestra.run.smithi049.stdout: "cct": [ 2024-03-16T07:40:31.297 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:40:31.297 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:40:31.297 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:40:31.297 INFO:teuthology.orchestra.run.smithi049.stdout: "total_workers": 0, 2024-03-16T07:40:31.297 INFO:teuthology.orchestra.run.smithi049.stdout: "unhealthy_workers": 0 2024-03-16T07:40:31.297 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:40:31.298 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:40:31.298 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:40:31.298 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs_mirror": [ 2024-03-16T07:40:31.298 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:40:31.298 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:40:31.298 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:40:31.298 INFO:teuthology.orchestra.run.smithi049.stdout: "mirrored_filesystems": 2, 2024-03-16T07:40:31.298 INFO:teuthology.orchestra.run.smithi049.stdout: "mirror_enable_failures": 0 2024-03-16T07:40:31.298 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:40:31.298 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:40:31.298 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:40:31.298 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs_mirror_mirrored_filesystems": [ 2024-03-16T07:40:31.298 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:40:31.298 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:40:31.298 INFO:teuthology.orchestra.run.smithi049.stdout: "filesystem": "cephfs" 2024-03-16T07:40:31.299 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:40:31.299 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:40:31.299 INFO:teuthology.orchestra.run.smithi049.stdout: "mirroring_peers": 1, 2024-03-16T07:40:31.299 INFO:teuthology.orchestra.run.smithi049.stdout: "directory_count": 3 2024-03-16T07:40:31.299 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:40:31.299 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:40:31.299 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:40:31.299 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs_mirror_peers": [ 2024-03-16T07:40:31.299 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:40:31.299 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": { 2024-03-16T07:40:31.299 INFO:teuthology.orchestra.run.smithi049.stdout: "peer_cluster_filesystem": "backup_fs", 2024-03-16T07:40:31.299 INFO:teuthology.orchestra.run.smithi049.stdout: "peer_cluster_name": "ceph", 2024-03-16T07:40:31.299 INFO:teuthology.orchestra.run.smithi049.stdout: "source_filesystem": "cephfs", 2024-03-16T07:40:31.299 INFO:teuthology.orchestra.run.smithi049.stdout: "source_fscid": "14" 2024-03-16T07:40:31.299 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:40:31.299 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:40:31.300 INFO:teuthology.orchestra.run.smithi049.stdout: "snaps_synced": 3, 2024-03-16T07:40:31.300 INFO:teuthology.orchestra.run.smithi049.stdout: "snaps_deleted": 0, 2024-03-16T07:40:31.300 INFO:teuthology.orchestra.run.smithi049.stdout: "snaps_renamed": 0, 2024-03-16T07:40:31.300 INFO:teuthology.orchestra.run.smithi049.stdout: "sync_failures": 7, 2024-03-16T07:40:31.300 INFO:teuthology.orchestra.run.smithi049.stdout: "avg_sync_time": { 2024-03-16T07:40:31.300 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 3, 2024-03-16T07:40:31.300 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 3.972890848, 2024-03-16T07:40:31.300 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 1.324296949 2024-03-16T07:40:31.300 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:40:31.300 INFO:teuthology.orchestra.run.smithi049.stdout: "sync_bytes": 270 2024-03-16T07:40:31.300 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:40:31.300 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:40:31.300 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:40:31.300 INFO:teuthology.orchestra.run.smithi049.stdout: "mempool": [ 2024-03-16T07:40:31.300 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:40:31.300 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:40:31.301 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:40:31.301 INFO:teuthology.orchestra.run.smithi049.stdout: "bloom_filter_bytes": 0, 2024-03-16T07:40:31.301 INFO:teuthology.orchestra.run.smithi049.stdout: "bloom_filter_items": 0, 2024-03-16T07:40:31.301 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_alloc_bytes": 0, 2024-03-16T07:40:31.301 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_alloc_items": 0, 2024-03-16T07:40:31.301 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_data_bytes": 0, 2024-03-16T07:40:31.301 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_data_items": 0, 2024-03-16T07:40:31.301 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_onode_bytes": 0, 2024-03-16T07:40:31.301 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_onode_items": 0, 2024-03-16T07:40:31.301 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_meta_bytes": 0, 2024-03-16T07:40:31.301 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_meta_items": 0, 2024-03-16T07:40:31.301 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_other_bytes": 0, 2024-03-16T07:40:31.301 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_other_items": 0, 2024-03-16T07:40:31.301 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_buffer_bytes": 0, 2024-03-16T07:40:31.301 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_buffer_items": 0, 2024-03-16T07:40:31.301 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_extent_bytes": 0, 2024-03-16T07:40:31.302 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_extent_items": 0, 2024-03-16T07:40:31.302 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_blob_bytes": 0, 2024-03-16T07:40:31.302 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_blob_items": 0, 2024-03-16T07:40:31.302 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_shared_blob_bytes": 0, 2024-03-16T07:40:31.302 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_shared_blob_items": 0, 2024-03-16T07:40:31.302 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_inline_bl_bytes": 0, 2024-03-16T07:40:31.302 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_inline_bl_items": 0, 2024-03-16T07:40:31.302 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_fsck_bytes": 0, 2024-03-16T07:40:31.302 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_fsck_items": 0, 2024-03-16T07:40:31.302 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_txc_bytes": 0, 2024-03-16T07:40:31.302 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_txc_items": 0, 2024-03-16T07:40:31.302 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_deferred_bytes": 0, 2024-03-16T07:40:31.302 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_deferred_items": 0, 2024-03-16T07:40:31.302 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_bytes": 0, 2024-03-16T07:40:31.302 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_items": 0, 2024-03-16T07:40:31.302 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_bytes": 0, 2024-03-16T07:40:31.303 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_items": 0, 2024-03-16T07:40:31.303 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_reader_bytes": 0, 2024-03-16T07:40:31.303 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_reader_items": 0, 2024-03-16T07:40:31.303 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_writer_bytes": 0, 2024-03-16T07:40:31.303 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_writer_items": 0, 2024-03-16T07:40:31.303 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_anon_bytes": 206376450, 2024-03-16T07:40:31.303 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_anon_items": 466, 2024-03-16T07:40:31.303 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_meta_bytes": 17512, 2024-03-16T07:40:31.303 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_meta_items": 199, 2024-03-16T07:40:31.303 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_bytes": 0, 2024-03-16T07:40:31.303 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_items": 0, 2024-03-16T07:40:31.303 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_mapbl_bytes": 0, 2024-03-16T07:40:31.303 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_mapbl_items": 0, 2024-03-16T07:40:31.303 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pglog_bytes": 0, 2024-03-16T07:40:31.303 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pglog_items": 0, 2024-03-16T07:40:31.303 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_bytes": 34160, 2024-03-16T07:40:31.303 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_items": 338, 2024-03-16T07:40:31.304 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_mapping_bytes": 0, 2024-03-16T07:40:31.304 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_mapping_items": 0, 2024-03-16T07:40:31.304 INFO:teuthology.orchestra.run.smithi049.stdout: "pgmap_bytes": 0, 2024-03-16T07:40:31.304 INFO:teuthology.orchestra.run.smithi049.stdout: "pgmap_items": 0, 2024-03-16T07:40:31.304 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_co_bytes": 0, 2024-03-16T07:40:31.304 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_co_items": 0, 2024-03-16T07:40:31.304 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_1_bytes": 0, 2024-03-16T07:40:31.304 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_1_items": 0, 2024-03-16T07:40:31.304 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_2_bytes": 0, 2024-03-16T07:40:31.304 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_2_items": 0 2024-03-16T07:40:31.304 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:40:31.304 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:40:31.304 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:40:31.304 INFO:teuthology.orchestra.run.smithi049.stdout: "objecter": [ 2024-03-16T07:40:31.304 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:40:31.304 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:40:31.305 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:40:31.305 INFO:teuthology.orchestra.run.smithi049.stdout: "op_active": 0, 2024-03-16T07:40:31.305 INFO:teuthology.orchestra.run.smithi049.stdout: "op_laggy": 0, 2024-03-16T07:40:31.305 INFO:teuthology.orchestra.run.smithi049.stdout: "op_send": 0, 2024-03-16T07:40:31.305 INFO:teuthology.orchestra.run.smithi049.stdout: "op_send_bytes": 0, 2024-03-16T07:40:31.305 INFO:teuthology.orchestra.run.smithi049.stdout: "op_resend": 0, 2024-03-16T07:40:31.305 INFO:teuthology.orchestra.run.smithi049.stdout: "op_reply": 0, 2024-03-16T07:40:31.305 INFO:teuthology.orchestra.run.smithi049.stdout: "op_latency": { 2024-03-16T07:40:31.305 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:40:31.305 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:40:31.305 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:40:31.305 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:40:31.305 INFO:teuthology.orchestra.run.smithi049.stdout: "op_inflight": 0, 2024-03-16T07:40:31.305 INFO:teuthology.orchestra.run.smithi049.stdout: "oplen_avg": { 2024-03-16T07:40:31.305 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:40:31.305 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0 2024-03-16T07:40:31.305 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-03-16T07:40:31.306 INFO:teuthology.orchestra.run.smithi049.stdout: "op": 0, 2024-03-16T07:40:31.306 INFO:teuthology.orchestra.run.smithi049.stdout: "op_r": 0, 2024-03-16T07:40:31.306 INFO:teuthology.orchestra.run.smithi049.stdout: "op_w": 0, 2024-03-16T07:40:31.306 INFO:teuthology.orchestra.run.smithi049.stdout: "op_rmw": 0, 2024-03-16T07:40:31.306 INFO:teuthology.orchestra.run.smithi049.stdout: "op_pg": 0, 2024-03-16T07:40:31.306 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_stat": 0, 2024-03-16T07:40:31.306 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_create": 0, 2024-03-16T07:40:31.306 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_read": 0, 2024-03-16T07:40:31.306 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_write": 0, 2024-03-16T07:40:31.306 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_writefull": 0, 2024-03-16T07:40:31.306 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_writesame": 0, 2024-03-16T07:40:31.306 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_append": 0, 2024-03-16T07:40:31.306 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_zero": 0, 2024-03-16T07:40:31.306 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_truncate": 0, 2024-03-16T07:40:31.306 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_delete": 0, 2024-03-16T07:40:31.306 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_mapext": 0, 2024-03-16T07:40:31.307 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_sparse_read": 0, 2024-03-16T07:40:31.307 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_clonerange": 0, 2024-03-16T07:40:31.307 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_getxattr": 0, 2024-03-16T07:40:31.307 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_setxattr": 0, 2024-03-16T07:40:31.307 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_cmpxattr": 0, 2024-03-16T07:40:31.307 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_rmxattr": 0, 2024-03-16T07:40:31.307 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_resetxattrs": 0, 2024-03-16T07:40:31.307 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_call": 0, 2024-03-16T07:40:31.307 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_watch": 0, 2024-03-16T07:40:31.307 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_notify": 0, 2024-03-16T07:40:31.307 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_src_cmpxattr": 0, 2024-03-16T07:40:31.307 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_pgls": 0, 2024-03-16T07:40:31.307 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_pgls_filter": 0, 2024-03-16T07:40:31.307 INFO:teuthology.orchestra.run.smithi049.stdout: "osdop_other": 0, 2024-03-16T07:40:31.307 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_active": 0, 2024-03-16T07:40:31.307 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_send": 0, 2024-03-16T07:40:31.308 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_resend": 0, 2024-03-16T07:40:31.308 INFO:teuthology.orchestra.run.smithi049.stdout: "linger_ping": 0, 2024-03-16T07:40:31.308 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_active": 0, 2024-03-16T07:40:31.308 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_send": 0, 2024-03-16T07:40:31.308 INFO:teuthology.orchestra.run.smithi049.stdout: "poolop_resend": 0, 2024-03-16T07:40:31.308 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_active": 0, 2024-03-16T07:40:31.308 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_send": 0, 2024-03-16T07:40:31.308 INFO:teuthology.orchestra.run.smithi049.stdout: "poolstat_resend": 0, 2024-03-16T07:40:31.308 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_active": 0, 2024-03-16T07:40:31.308 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_send": 0, 2024-03-16T07:40:31.308 INFO:teuthology.orchestra.run.smithi049.stdout: "statfs_resend": 0, 2024-03-16T07:40:31.308 INFO:teuthology.orchestra.run.smithi049.stdout: "command_active": 0, 2024-03-16T07:40:31.308 INFO:teuthology.orchestra.run.smithi049.stdout: "command_send": 0, 2024-03-16T07:40:31.308 INFO:teuthology.orchestra.run.smithi049.stdout: "command_resend": 0, 2024-03-16T07:40:31.308 INFO:teuthology.orchestra.run.smithi049.stdout: "map_epoch": 0, 2024-03-16T07:40:31.308 INFO:teuthology.orchestra.run.smithi049.stdout: "map_full": 0, 2024-03-16T07:40:31.308 INFO:teuthology.orchestra.run.smithi049.stdout: "map_inc": 0, 2024-03-16T07:40:31.309 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_sessions": 0, 2024-03-16T07:40:31.309 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_session_open": 0, 2024-03-16T07:40:31.309 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_session_close": 0, 2024-03-16T07:40:31.309 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_laggy": 0, 2024-03-16T07:40:31.309 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_wr": 0, 2024-03-16T07:40:31.309 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_rd": 0, 2024-03-16T07:40:31.309 INFO:teuthology.orchestra.run.smithi049.stdout: "omap_del": 0 2024-03-16T07:40:31.309 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:40:31.309 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:40:31.309 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:40:31.309 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-msgr_dispatch_throttler-client": [ 2024-03-16T07:40:31.309 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:40:31.309 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:40:31.309 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:40:31.309 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:40:31.309 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-03-16T07:40:31.310 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:40:31.310 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 125, 2024-03-16T07:40:31.310 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 491126, 2024-03-16T07:40:31.310 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:40:31.310 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 125, 2024-03-16T07:40:31.310 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:40:31.310 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:40:31.310 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 125, 2024-03-16T07:40:31.310 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 491126, 2024-03-16T07:40:31.310 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:40:31.310 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:40:31.310 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:40:31.310 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:40:31.310 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:40:31.311 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:40:31.311 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:40:31.311 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:40:31.311 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-msgr_dispatch_throttler-radosclient": [ 2024-03-16T07:40:31.311 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:40:31.311 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:40:31.311 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:40:31.311 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:40:31.311 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-03-16T07:40:31.311 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:40:31.311 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 93, 2024-03-16T07:40:31.311 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 3141849, 2024-03-16T07:40:31.311 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:40:31.311 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 93, 2024-03-16T07:40:31.311 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:40:31.311 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:40:31.312 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 93, 2024-03-16T07:40:31.312 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 3141849, 2024-03-16T07:40:31.312 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:40:31.312 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:40:31.312 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:40:31.312 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:40:31.312 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:40:31.312 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:40:31.312 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:40:31.312 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:40:31.312 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-objecter_bytes": [ 2024-03-16T07:40:31.312 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:40:31.312 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:40:31.312 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:40:31.312 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:40:31.313 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-03-16T07:40:31.313 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:40:31.313 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 0, 2024-03-16T07:40:31.313 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 0, 2024-03-16T07:40:31.313 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:40:31.313 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 0, 2024-03-16T07:40:31.313 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:40:31.313 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:40:31.313 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 0, 2024-03-16T07:40:31.313 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 0, 2024-03-16T07:40:31.313 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:40:31.313 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:40:31.313 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:40:31.313 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:40:31.313 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:40:31.313 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:40:31.314 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:40:31.314 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-03-16T07:40:31.314 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-objecter_ops": [ 2024-03-16T07:40:31.314 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-03-16T07:40:31.314 INFO:teuthology.orchestra.run.smithi049.stdout: "labels": {}, 2024-03-16T07:40:31.314 INFO:teuthology.orchestra.run.smithi049.stdout: "counters": { 2024-03-16T07:40:31.314 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-03-16T07:40:31.314 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 1024, 2024-03-16T07:40:31.314 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-03-16T07:40:31.314 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 0, 2024-03-16T07:40:31.314 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 0, 2024-03-16T07:40:31.314 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-03-16T07:40:31.314 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 0, 2024-03-16T07:40:31.314 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-03-16T07:40:31.314 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-03-16T07:40:31.314 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 0, 2024-03-16T07:40:31.315 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 0, 2024-03-16T07:40:31.315 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-03-16T07:40:31.315 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-03-16T07:40:31.315 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-03-16T07:40:31.315 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-03-16T07:40:31.315 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:40:31.315 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:40:31.315 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-03-16T07:40:31.315 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2024-03-16T07:40:31.315 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-03-16T07:40:31.316 DEBUG:tasks.cephfs.test_mirroring:command returned={ "AsyncMessenger::Worker": [ { "labels": { "id": "0" }, "counters": { "msgr_connection_ready_timeouts": 0, "msgr_connection_idle_timeouts": 0 } }, { "labels": { "id": "1" }, "counters": { "msgr_connection_ready_timeouts": 0, "msgr_connection_idle_timeouts": 0 } }, { "labels": { "id": "2" }, "counters": { "msgr_connection_ready_timeouts": 0, "msgr_connection_idle_timeouts": 0 } } ], "AsyncMessenger::Worker-0": [ { "labels": {}, "counters": { "msgr_recv_messages": 13, "msgr_send_messages": 192, "msgr_recv_bytes": 1872, "msgr_send_bytes": 1072320, "msgr_created_connections": 26, "msgr_active_connections": 5, "msgr_running_total_time": 2.047934707, "msgr_running_send_time": 0.710573523, "msgr_running_recv_time": 0.173849705, "msgr_running_fast_dispatch_time": 0.000000000, "msgr_send_messages_queue_lat": { "avgcount": 180, "sum": 2.559101477, "avgtime": 0.014217230 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "msgr_recv_encrypted_bytes": 1872, "msgr_send_encrypted_bytes": 1072320 } } ], "AsyncMessenger::Worker-1": [ { "labels": {}, "counters": { "msgr_recv_messages": 125, "msgr_send_messages": 11, "msgr_recv_bytes": 508080, "msgr_send_bytes": 2448, "msgr_created_connections": 4, "msgr_active_connections": 0, "msgr_running_total_time": 2.050515416, "msgr_running_send_time": 0.264951864, "msgr_running_recv_time": 1.159519719, "msgr_running_fast_dispatch_time": 0.194190800, "msgr_send_messages_queue_lat": { "avgcount": 10, "sum": 0.189021381, "avgtime": 0.018902138 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "msgr_recv_encrypted_bytes": 508080, "msgr_send_encrypted_bytes": 2448 } } ], "AsyncMessenger::Worker-2": [ { "labels": {}, "counters": { "msgr_recv_messages": 83, "msgr_send_messages": 14, "msgr_recv_bytes": 3153504, "msgr_send_bytes": 2912, "msgr_created_connections": 3, "msgr_active_connections": 1, "msgr_running_total_time": 4.895743899, "msgr_running_send_time": 0.599301273, "msgr_running_recv_time": 4.388387375, "msgr_running_fast_dispatch_time": 0.000000000, "msgr_send_messages_queue_lat": { "avgcount": 13, "sum": 0.347167496, "avgtime": 0.026705192 }, "msgr_handle_ack_lat": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "msgr_recv_encrypted_bytes": 3153504, "msgr_send_encrypted_bytes": 2912 } } ], "cct": [ { "labels": {}, "counters": { "total_workers": 0, "unhealthy_workers": 0 } } ], "cephfs_mirror": [ { "labels": {}, "counters": { "mirrored_filesystems": 2, "mirror_enable_failures": 0 } } ], "cephfs_mirror_mirrored_filesystems": [ { "labels": { "filesystem": "cephfs" }, "counters": { "mirroring_peers": 1, "directory_count": 3 } } ], "cephfs_mirror_peers": [ { "labels": { "peer_cluster_filesystem": "backup_fs", "peer_cluster_name": "ceph", "source_filesystem": "cephfs", "source_fscid": "14" }, "counters": { "snaps_synced": 3, "snaps_deleted": 0, "snaps_renamed": 0, "sync_failures": 7, "avg_sync_time": { "avgcount": 3, "sum": 3.972890848, "avgtime": 1.324296949 }, "sync_bytes": 270 } } ], "mempool": [ { "labels": {}, "counters": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_cache_buffer_bytes": 0, "bluestore_cache_buffer_items": 0, "bluestore_extent_bytes": 0, "bluestore_extent_items": 0, "bluestore_blob_bytes": 0, "bluestore_blob_items": 0, "bluestore_shared_blob_bytes": 0, "bluestore_shared_blob_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_items": 0, "bluefs_bytes": 0, "bluefs_items": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "buffer_anon_bytes": 206376450, "buffer_anon_items": 466, "buffer_meta_bytes": 17512, "buffer_meta_items": 199, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 34160, "osdmap_items": 338, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "mds_co_bytes": 0, "mds_co_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 } } ], "objecter": [ { "labels": {}, "counters": { "op_active": 0, "op_laggy": 0, "op_send": 0, "op_send_bytes": 0, "op_resend": 0, "op_reply": 0, "op_latency": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 }, "op_inflight": 0, "oplen_avg": { "avgcount": 0, "sum": 0 }, "op": 0, "op_r": 0, "op_w": 0, "op_rmw": 0, "op_pg": 0, "osdop_stat": 0, "osdop_create": 0, "osdop_read": 0, "osdop_write": 0, "osdop_writefull": 0, "osdop_writesame": 0, "osdop_append": 0, "osdop_zero": 0, "osdop_truncate": 0, "osdop_delete": 0, "osdop_mapext": 0, "osdop_sparse_read": 0, "osdop_clonerange": 0, "osdop_getxattr": 0, "osdop_setxattr": 0, "osdop_cmpxattr": 0, "osdop_rmxattr": 0, "osdop_resetxattrs": 0, "osdop_call": 0, "osdop_watch": 0, "osdop_notify": 0, "osdop_src_cmpxattr": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_other": 0, "linger_active": 0, "linger_send": 0, "linger_resend": 0, "linger_ping": 0, "poolop_active": 0, "poolop_send": 0, "poolop_resend": 0, "poolstat_active": 0, "poolstat_send": 0, "poolstat_resend": 0, "statfs_active": 0, "statfs_send": 0, "statfs_resend": 0, "command_active": 0, "command_send": 0, "command_resend": 0, "map_epoch": 0, "map_full": 0, "map_inc": 0, "osd_sessions": 0, "osd_session_open": 0, "osd_session_close": 0, "osd_laggy": 0, "omap_wr": 0, "omap_rd": 0, "omap_del": 0 } } ], "throttle-msgr_dispatch_throttler-client": [ { "labels": {}, "counters": { "val": 0, "max": 104857600, "get_started": 0, "get": 125, "get_sum": 491126, "get_or_fail_fail": 0, "get_or_fail_success": 125, "take": 0, "take_sum": 0, "put": 125, "put_sum": 491126, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ], "throttle-msgr_dispatch_throttler-radosclient": [ { "labels": {}, "counters": { "val": 0, "max": 104857600, "get_started": 0, "get": 93, "get_sum": 3141849, "get_or_fail_fail": 0, "get_or_fail_success": 93, "take": 0, "take_sum": 0, "put": 93, "put_sum": 3141849, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ], "throttle-objecter_bytes": [ { "labels": {}, "counters": { "val": 0, "max": 104857600, "get_started": 0, "get": 0, "get_sum": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "take": 0, "take_sum": 0, "put": 0, "put_sum": 0, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ], "throttle-objecter_ops": [ { "labels": {}, "counters": { "val": 0, "max": 1024, "get_started": 0, "get": 0, "get_sum": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "take": 0, "take_sum": 0, "put": 0, "put_sum": 0, "wait": { "avgcount": 0, "sum": 0.000000000, "avgtime": 0.000000000 } } } ] } 2024-03-16T07:40:31.316 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable mirroring 2024-03-16T07:40:32.482 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-03-16T07:40:32.483 DEBUG:teuthology.orchestra.run.smithi049:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-03-16T07:40:32.529 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-03-16T07:40:32.529 INFO:tasks.cephfs.mount:Terminating background process 2024-03-16T07:40:32.530 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-03-16T07:40:32.530 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-16T07:40:32.546 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T07:40:32.966 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:40:32.967+0000 7f1293037040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-16T07:40:32.987 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:40:32.987 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":177,"fsid":"f91af061-9eac-4793-87fa-8d27ae3d242f","created":"2024-03-16T07:24:20.357868+0000","modified":"2024-03-16T07:39:00.416906+0000","last_up_change":"2024-03-16T07:24:27.474980+0000","last_in_change":"2024-03-16T07:24:21.254179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":31,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T07:24:28.947521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":28,"pool_name":"cephfs_metadata","create_time":"2024-03-16T07:35:08.344405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"167","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.309999942779541,"score_stable":1.309999942779541,"optimal_score":1,"raw_score_acting":1.309999942779541,"raw_score_stable":1.309999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":29,"pool_name":"cephfs_data","create_time":"2024-03-16T07:35:09.019172+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"176","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":7,"snap_epoch":176,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":30,"pool_name":"backup_fs_metadata","create_time":"2024-03-16T07:35:21.682702+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"171","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"backup_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.309999942779541,"score_stable":1.309999942779541,"optimal_score":1,"raw_score_acting":1.309999942779541,"raw_score_stable":1.309999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":31,"pool_name":"backup_fs_data","create_time":"2024-03-16T07:35:22.052108+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"172","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"backup_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.0299999713897705,"score_stable":1.0299999713897705,"optimal_score":1,"raw_score_acting":1.0299999713897705,"raw_score_stable":1.0299999713897705,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2df14aac-98dc-4e3c-ae7e-9eb677aa30be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6801","nonce":2744935777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6803","nonce":2744935777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6807","nonce":2744935777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6805","nonce":2744935777}]},"public_addr":"172.21.15.49:6801/2744935777","cluster_addr":"172.21.15.49:6803/2744935777","heartbeat_back_addr":"172.21.15.49:6807/2744935777","heartbeat_front_addr":"172.21.15.49:6805/2744935777","state":["exists","up"]},{"osd":1,"uuid":"80461bd9-59ef-46df-9eea-bad92d960c57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6811","nonce":1655120118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6815","nonce":1655120118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6821","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6823","nonce":1655120118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6817","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6819","nonce":1655120118}]},"public_addr":"172.21.15.49:6811/1655120118","cluster_addr":"172.21.15.49:6815/1655120118","heartbeat_back_addr":"172.21.15.49:6823/1655120118","heartbeat_front_addr":"172.21.15.49:6819/1655120118","state":["exists","up"]},{"osd":2,"uuid":"d6bf40eb-6e42-4ec9-8b3d-0b6c5a6def79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6810","nonce":3815472376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6814","nonce":3815472376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6822","nonce":3815472376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6818","nonce":3815472376}]},"public_addr":"172.21.15.49:6810/3815472376","cluster_addr":"172.21.15.49:6814/3815472376","heartbeat_back_addr":"172.21.15.49:6822/3815472376","heartbeat_front_addr":"172.21.15.49:6818/3815472376","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.641492+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.668598+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.614940+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"29.2d","mappings":[{"from":1,"to":2}]},{"pgid":"29.31","mappings":[{"from":0,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.49:6825/3151425488":"2024-03-17T07:35:34.187396+0000","172.21.15.49:6824/3151425488":"2024-03-17T07:35:34.187396+0000","172.21.15.49:0/549066423":"2024-03-17T07:35:34.187396+0000","172.21.15.49:0/3515296168":"2024-03-17T07:35:34.187396+0000","172.21.15.49:0/2374823119":"2024-03-17T07:35:34.187396+0000","172.21.15.49:0/467150732":"2024-03-17T07:35:34.187396+0000","172.21.15.49:0/2082959977":"2024-03-17T07:35:34.187396+0000","172.21.15.49:0/3804079701":"2024-03-17T07:35:34.187396+0000","172.21.15.49:0/1510403812":"2024-03-17T07:35:34.187396+0000","172.21.15.49:0/2539031077":"2024-03-17T07:35:34.187396+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":29,"snaps":[{"begin":2,"length":6}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T07:40:33.000 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-16T07:24:28.947521+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 28, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-16T07:35:08.344405+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '167', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.309999942779541, 'score_stable': 1.309999942779541, 'optimal_score': 1, 'raw_score_acting': 1.309999942779541, 'raw_score_stable': 1.309999942779541, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 29, 'pool_name': 'cephfs_data', 'create_time': '2024-03-16T07:35:09.019172+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '176', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 7, 'snap_epoch': 176, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 30, 'pool_name': 'backup_fs_metadata', 'create_time': '2024-03-16T07:35:21.682702+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '171', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'backup_fs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.309999942779541, 'score_stable': 1.309999942779541, 'optimal_score': 1, 'raw_score_acting': 1.309999942779541, 'raw_score_stable': 1.309999942779541, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 31, 'pool_name': 'backup_fs_data', 'create_time': '2024-03-16T07:35:22.052108+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '172', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'backup_fs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.0299999713897705, 'score_stable': 1.0299999713897705, 'optimal_score': 1, 'raw_score_acting': 1.0299999713897705, 'raw_score_stable': 1.0299999713897705, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-16T07:40:33.001 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-16T07:40:33.037 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:40:33.039+0000 7f1293037040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-16T07:40:33.425 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2024-03-16T07:40:33.439 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-16T07:40:33.474 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:40:33.476+0000 7f1293037040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-16T07:40:33.547 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:40:33.549+0000 7f1293037040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-16T07:40:33.628 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:40:33.630+0000 7f1293037040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-16T07:40:33.706 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:40:33.708+0000 7f1293037040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-16T07:40:33.781 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:40:33.783+0000 7f1293037040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-16T07:40:33.782 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2024-03-16T07:40:33.800 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-16T07:40:33.927 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:40:33.929+0000 7f1293037040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-16T07:40:33.998 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:40:34.000+0000 7f1293037040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-16T07:40:34.077 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:40:34.079+0000 7f1293037040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-16T07:40:34.136 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:40:34.138+0000 7f1293037040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-16T07:40:34.148 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2024-03-16T07:40:34.163 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get backup_fs_metadata pg_num 2024-03-16T07:40:34.207 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:40:34.209+0000 7f1293037040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-16T07:40:34.551 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2024-03-16T07:40:34.565 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get backup_fs_data pg_num 2024-03-16T07:40:34.581 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:40:34.583+0000 7f1293037040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-16T07:40:34.732 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:40:34.734+0000 7f1293037040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-16T07:40:34.848 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:40:34.850+0000 7f1293037040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-16T07:40:34.927 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:40:34.929+0000 7f1293037040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-16T07:40:34.958 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2024-03-16T07:40:34.973 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-16T07:40:35.055 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:40:35.057+0000 7f1293037040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-16T07:40:35.177 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:40:35.179+0000 7f1293037040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-16T07:40:35.384 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:40:35.386+0000 7f1293037040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-16T07:40:35.415 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:6825/3151425488 2024-03-17T07:35:34.187396+0000 2024-03-16T07:40:35.416 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:6824/3151425488 2024-03-17T07:35:34.187396+0000 2024-03-16T07:40:35.416 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/549066423 2024-03-17T07:35:34.187396+0000 2024-03-16T07:40:35.416 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/3515296168 2024-03-17T07:35:34.187396+0000 2024-03-16T07:40:35.416 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/2374823119 2024-03-17T07:35:34.187396+0000 2024-03-16T07:40:35.416 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/467150732 2024-03-17T07:35:34.187396+0000 2024-03-16T07:40:35.416 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/2082959977 2024-03-17T07:35:34.187396+0000 2024-03-16T07:40:35.416 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/3804079701 2024-03-17T07:35:34.187396+0000 2024-03-16T07:40:35.416 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/1510403812 2024-03-17T07:35:34.187396+0000 2024-03-16T07:40:35.416 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/2539031077 2024-03-17T07:35:34.187396+0000 2024-03-16T07:40:35.416 INFO:teuthology.orchestra.run.smithi049.stderr:listed 10 entries 2024-03-16T07:40:35.429 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi049.front.sepia.ceph.com... 2024-03-16T07:40:35.429 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:40:35.429 DEBUG:teuthology.orchestra.run.smithi049:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-03-16T07:40:35.430 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:40:35.432+0000 7f1293037040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-16T07:40:35.465 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi049.stderr:ceph-fuse[82245]: fuse finished with error 0 and tester_r 0 2024-03-16T07:40:35.468 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi049.front.sepia.ceph.com 2024-03-16T07:40:35.468 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:40:35.468 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-03-16T07:40:35.589 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:40:35.591+0000 7f1293037040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-16T07:40:35.648 INFO:tasks.cephfs.mount:Terminating background process 2024-03-16T07:40:35.648 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-03-16T07:40:35.649 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-16T07:40:35.706 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T07:40:36.085 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:40:36.085 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":177,"fsid":"f91af061-9eac-4793-87fa-8d27ae3d242f","created":"2024-03-16T07:24:20.357868+0000","modified":"2024-03-16T07:39:00.416906+0000","last_up_change":"2024-03-16T07:24:27.474980+0000","last_in_change":"2024-03-16T07:24:21.254179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":31,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T07:24:28.947521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":28,"pool_name":"cephfs_metadata","create_time":"2024-03-16T07:35:08.344405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"167","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.309999942779541,"score_stable":1.309999942779541,"optimal_score":1,"raw_score_acting":1.309999942779541,"raw_score_stable":1.309999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":29,"pool_name":"cephfs_data","create_time":"2024-03-16T07:35:09.019172+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"176","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":7,"snap_epoch":176,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":30,"pool_name":"backup_fs_metadata","create_time":"2024-03-16T07:35:21.682702+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"171","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"backup_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.309999942779541,"score_stable":1.309999942779541,"optimal_score":1,"raw_score_acting":1.309999942779541,"raw_score_stable":1.309999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":31,"pool_name":"backup_fs_data","create_time":"2024-03-16T07:35:22.052108+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"172","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"backup_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.0299999713897705,"score_stable":1.0299999713897705,"optimal_score":1,"raw_score_acting":1.0299999713897705,"raw_score_stable":1.0299999713897705,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2df14aac-98dc-4e3c-ae7e-9eb677aa30be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6801","nonce":2744935777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6803","nonce":2744935777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6807","nonce":2744935777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6805","nonce":2744935777}]},"public_addr":"172.21.15.49:6801/2744935777","cluster_addr":"172.21.15.49:6803/2744935777","heartbeat_back_addr":"172.21.15.49:6807/2744935777","heartbeat_front_addr":"172.21.15.49:6805/2744935777","state":["exists","up"]},{"osd":1,"uuid":"80461bd9-59ef-46df-9eea-bad92d960c57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6811","nonce":1655120118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6815","nonce":1655120118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6821","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6823","nonce":1655120118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6817","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6819","nonce":1655120118}]},"public_addr":"172.21.15.49:6811/1655120118","cluster_addr":"172.21.15.49:6815/1655120118","heartbeat_back_addr":"172.21.15.49:6823/1655120118","heartbeat_front_addr":"172.21.15.49:6819/1655120118","state":["exists","up"]},{"osd":2,"uuid":"d6bf40eb-6e42-4ec9-8b3d-0b6c5a6def79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6810","nonce":3815472376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6814","nonce":3815472376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6822","nonce":3815472376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6818","nonce":3815472376}]},"public_addr":"172.21.15.49:6810/3815472376","cluster_addr":"172.21.15.49:6814/3815472376","heartbeat_back_addr":"172.21.15.49:6822/3815472376","heartbeat_front_addr":"172.21.15.49:6818/3815472376","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.641492+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.668598+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.614940+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"29.2d","mappings":[{"from":1,"to":2}]},{"pgid":"29.31","mappings":[{"from":0,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.49:6825/3151425488":"2024-03-17T07:35:34.187396+0000","172.21.15.49:6824/3151425488":"2024-03-17T07:35:34.187396+0000","172.21.15.49:0/549066423":"2024-03-17T07:35:34.187396+0000","172.21.15.49:0/3515296168":"2024-03-17T07:35:34.187396+0000","172.21.15.49:0/2374823119":"2024-03-17T07:35:34.187396+0000","172.21.15.49:0/467150732":"2024-03-17T07:35:34.187396+0000","172.21.15.49:0/2082959977":"2024-03-17T07:35:34.187396+0000","172.21.15.49:0/3804079701":"2024-03-17T07:35:34.187396+0000","172.21.15.49:0/1510403812":"2024-03-17T07:35:34.187396+0000","172.21.15.49:0/2539031077":"2024-03-17T07:35:34.187396+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":29,"snaps":[{"begin":2,"length":6}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T07:40:36.099 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-16T07:24:28.947521+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 28, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-16T07:35:08.344405+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '167', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.309999942779541, 'score_stable': 1.309999942779541, 'optimal_score': 1, 'raw_score_acting': 1.309999942779541, 'raw_score_stable': 1.309999942779541, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 29, 'pool_name': 'cephfs_data', 'create_time': '2024-03-16T07:35:09.019172+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '176', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 7, 'snap_epoch': 176, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 30, 'pool_name': 'backup_fs_metadata', 'create_time': '2024-03-16T07:35:21.682702+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '171', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'backup_fs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.309999942779541, 'score_stable': 1.309999942779541, 'optimal_score': 1, 'raw_score_acting': 1.309999942779541, 'raw_score_stable': 1.309999942779541, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 31, 'pool_name': 'backup_fs_data', 'create_time': '2024-03-16T07:35:22.052108+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '172', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'backup_fs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.0299999713897705, 'score_stable': 1.0299999713897705, 'optimal_score': 1, 'raw_score_acting': 1.0299999713897705, 'raw_score_stable': 1.0299999713897705, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-16T07:40:36.099 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-16T07:40:36.504 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:40:36.506+0000 7f1293037040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-16T07:40:36.513 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2024-03-16T07:40:36.527 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-16T07:40:36.875 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2024-03-16T07:40:36.890 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-16T07:40:36.955 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:40:36.957+0000 7f1293037040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-16T07:40:37.010 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:40:37.012+0000 7f1293037040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-16T07:40:37.134 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:40:37.136+0000 7f1293037040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-16T07:40:37.224 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2024-03-16T07:40:37.240 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get backup_fs_metadata pg_num 2024-03-16T07:40:37.254 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:40:37.256+0000 7f1217c3a640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:40:37.254 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:40:37.256+0000 7f1217c3a640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:40:37.254 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:40:37.256+0000 7f1217c3a640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:40:37.254 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:40:37.256+0000 7f1217c3a640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:40:37.254 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:40:37.256+0000 7f1217c3a640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:40:37.255 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:40:37.256+0000 7f1214c34640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:40:37.255 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:40:37.256+0000 7f1214c34640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:40:37.255 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:40:37.256+0000 7f1214c34640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:40:37.255 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:40:37.256+0000 7f1214c34640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:40:37.255 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:40:37.256+0000 7f1214c34640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:40:37.285 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:40:37.287+0000 7f1214c34640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:40:37.286 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:40:37.287+0000 7f1214c34640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:40:37.286 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:40:37.287+0000 7f1217c3a640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:40:37.286 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:40:37.287+0000 7f1217c3a640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:40:37.286 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:40:37.287+0000 7f1217c3a640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:40:37.286 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:40:37.287+0000 7f1217c3a640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:40:37.286 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:40:37.287+0000 7f1217c3a640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:40:37.286 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:40:37.287+0000 7f1214c34640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:40:37.286 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:40:37.287+0000 7f1214c34640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:40:37.286 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-03-16T07:40:37.287+0000 7f1214c34640 -1 client.0 error registering admin socket command: (17) File exists 2024-03-16T07:40:37.597 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2024-03-16T07:40:37.611 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get backup_fs_data pg_num 2024-03-16T07:40:38.093 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2024-03-16T07:40:38.106 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-16T07:40:38.509 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/1731871169 2024-03-17T07:40:37.149498+0000 2024-03-16T07:40:38.510 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/1513827497 2024-03-17T07:40:37.149498+0000 2024-03-16T07:40:38.510 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:6825/1771093342 2024-03-17T07:40:37.149498+0000 2024-03-16T07:40:38.510 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:6824/1771093342 2024-03-17T07:40:37.149498+0000 2024-03-16T07:40:38.510 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/2518883128 2024-03-17T07:40:37.149498+0000 2024-03-16T07:40:38.510 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/1502855966 2024-03-17T07:40:37.149498+0000 2024-03-16T07:40:38.510 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/3515874822 2024-03-17T07:40:37.149498+0000 2024-03-16T07:40:38.510 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:6825/3151425488 2024-03-17T07:35:34.187396+0000 2024-03-16T07:40:38.510 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:6824/3151425488 2024-03-17T07:35:34.187396+0000 2024-03-16T07:40:38.510 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/549066423 2024-03-17T07:35:34.187396+0000 2024-03-16T07:40:38.510 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/3515296168 2024-03-17T07:35:34.187396+0000 2024-03-16T07:40:38.511 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/2374823119 2024-03-17T07:35:34.187396+0000 2024-03-16T07:40:38.511 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/467150732 2024-03-17T07:35:34.187396+0000 2024-03-16T07:40:38.511 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/2082959977 2024-03-17T07:35:34.187396+0000 2024-03-16T07:40:38.511 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/3804079701 2024-03-17T07:35:34.187396+0000 2024-03-16T07:40:38.511 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/1510403812 2024-03-17T07:35:34.187396+0000 2024-03-16T07:40:38.511 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/2539031077 2024-03-17T07:35:34.187396+0000 2024-03-16T07:40:38.511 INFO:teuthology.orchestra.run.smithi049.stderr:listed 17 entries 2024-03-16T07:40:38.523 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi049.front.sepia.ceph.com... 2024-03-16T07:40:38.523 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:40:38.524 DEBUG:teuthology.orchestra.run.smithi049:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2024-03-16T07:40:38.554 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi049.stderr:ceph-fuse[84869]: fuse finished with error 0 and tester_r 0 2024-03-16T07:40:38.556 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi049.front.sepia.ceph.com 2024-03-16T07:40:38.556 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:40:38.556 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-03-16T07:40:38.661 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T07:40:39.030 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:40:39.031 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":124,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6690,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6827/875237476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":875237476},{"type":"v1","addr":"172.21.15.49:6827","nonce":875237476}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":113},{"gid":6691,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6829/417322500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":417322500},{"type":"v1","addr":"172.21.15.49:6829","nonce":417322500}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":113},{"gid":6696,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6831/4121914730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":4121914730},{"type":"v1","addr":"172.21.15.49:6831","nonce":4121914730}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":113}],"filesystems":[{"mdsmap":{"epoch":124,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-16T07:35:10.038977+0000","modified":"2024-03-16T07:37:19.309479+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6698},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6698":{"gid":6698,"name":"a","rank":0,"incarnation":114,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6835/1838330688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":1838330688},{"type":"v1","addr":"172.21.15.49:6835","nonce":1838330688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[29],"metadata_pool":28,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6698,"qdb_cluster":[6698]},"id":14,"mirror_info":{"peers":{"8fa2e0a7-a624-43b8-9c12-da3a1afea05a":{"remote":{"client_name":"client.mirror_remote","cluster_name":"ceph","fs_name":"backup_fs"}}}}},{"mdsmap":{"epoch":122,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-16T07:35:23.124362+0000","modified":"2024-03-16T07:35:26.073338+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6697},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6697":{"gid":6697,"name":"e","rank":0,"incarnation":118,"state":"up:active","state_seq":6,"addr":"172.21.15.49:6834/1716116460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":1716116460},{"type":"v1","addr":"172.21.15.49:6834","nonce":1716116460}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[31],"metadata_pool":30,"enabled":true,"fs_name":"backup_fs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6697,"qdb_cluster":[6697]},"id":15}]} 2024-03-16T07:40:39.031 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 124 2024-03-16T07:40:39.044 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T07:40:39.402 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:40:39.402 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":178,"fsid":"f91af061-9eac-4793-87fa-8d27ae3d242f","created":"2024-03-16T07:24:20.357868+0000","modified":"2024-03-16T07:40:37.149548+0000","last_up_change":"2024-03-16T07:24:27.474980+0000","last_in_change":"2024-03-16T07:24:21.254179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":31,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T07:24:28.947521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":28,"pool_name":"cephfs_metadata","create_time":"2024-03-16T07:35:08.344405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"167","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.309999942779541,"score_stable":1.309999942779541,"optimal_score":1,"raw_score_acting":1.309999942779541,"raw_score_stable":1.309999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":29,"pool_name":"cephfs_data","create_time":"2024-03-16T07:35:09.019172+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"176","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":7,"snap_epoch":176,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":30,"pool_name":"backup_fs_metadata","create_time":"2024-03-16T07:35:21.682702+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"171","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"backup_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.309999942779541,"score_stable":1.309999942779541,"optimal_score":1,"raw_score_acting":1.309999942779541,"raw_score_stable":1.309999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":31,"pool_name":"backup_fs_data","create_time":"2024-03-16T07:35:22.052108+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"172","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"backup_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.0299999713897705,"score_stable":1.0299999713897705,"optimal_score":1,"raw_score_acting":1.0299999713897705,"raw_score_stable":1.0299999713897705,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2df14aac-98dc-4e3c-ae7e-9eb677aa30be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6801","nonce":2744935777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6803","nonce":2744935777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6807","nonce":2744935777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6805","nonce":2744935777}]},"public_addr":"172.21.15.49:6801/2744935777","cluster_addr":"172.21.15.49:6803/2744935777","heartbeat_back_addr":"172.21.15.49:6807/2744935777","heartbeat_front_addr":"172.21.15.49:6805/2744935777","state":["exists","up"]},{"osd":1,"uuid":"80461bd9-59ef-46df-9eea-bad92d960c57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6811","nonce":1655120118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6815","nonce":1655120118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6821","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6823","nonce":1655120118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6817","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6819","nonce":1655120118}]},"public_addr":"172.21.15.49:6811/1655120118","cluster_addr":"172.21.15.49:6815/1655120118","heartbeat_back_addr":"172.21.15.49:6823/1655120118","heartbeat_front_addr":"172.21.15.49:6819/1655120118","state":["exists","up"]},{"osd":2,"uuid":"d6bf40eb-6e42-4ec9-8b3d-0b6c5a6def79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6810","nonce":3815472376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6814","nonce":3815472376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6822","nonce":3815472376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6818","nonce":3815472376}]},"public_addr":"172.21.15.49:6810/3815472376","cluster_addr":"172.21.15.49:6814/3815472376","heartbeat_back_addr":"172.21.15.49:6822/3815472376","heartbeat_front_addr":"172.21.15.49:6818/3815472376","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.641492+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.668598+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.614940+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"29.2d","mappings":[{"from":1,"to":2}]},{"pgid":"29.31","mappings":[{"from":0,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.49:0/1731871169":"2024-03-17T07:40:37.149498+0000","172.21.15.49:0/1513827497":"2024-03-17T07:40:37.149498+0000","172.21.15.49:6825/1771093342":"2024-03-17T07:40:37.149498+0000","172.21.15.49:6824/1771093342":"2024-03-17T07:40:37.149498+0000","172.21.15.49:0/2518883128":"2024-03-17T07:40:37.149498+0000","172.21.15.49:0/1502855966":"2024-03-17T07:40:37.149498+0000","172.21.15.49:0/3515874822":"2024-03-17T07:40:37.149498+0000","172.21.15.49:6825/3151425488":"2024-03-17T07:35:34.187396+0000","172.21.15.49:6824/3151425488":"2024-03-17T07:35:34.187396+0000","172.21.15.49:0/549066423":"2024-03-17T07:35:34.187396+0000","172.21.15.49:0/3515296168":"2024-03-17T07:35:34.187396+0000","172.21.15.49:0/2374823119":"2024-03-17T07:35:34.187396+0000","172.21.15.49:0/467150732":"2024-03-17T07:35:34.187396+0000","172.21.15.49:0/2082959977":"2024-03-17T07:35:34.187396+0000","172.21.15.49:0/3804079701":"2024-03-17T07:35:34.187396+0000","172.21.15.49:0/1510403812":"2024-03-17T07:35:34.187396+0000","172.21.15.49:0/2539031077":"2024-03-17T07:35:34.187396+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T07:40:39.415 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-16T07:24:28.947521+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 28, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-16T07:35:08.344405+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '167', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.309999942779541, 'score_stable': 1.309999942779541, 'optimal_score': 1, 'raw_score_acting': 1.309999942779541, 'raw_score_stable': 1.309999942779541, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 29, 'pool_name': 'cephfs_data', 'create_time': '2024-03-16T07:35:09.019172+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '176', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 7, 'snap_epoch': 176, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 30, 'pool_name': 'backup_fs_metadata', 'create_time': '2024-03-16T07:35:21.682702+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '171', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'backup_fs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.309999942779541, 'score_stable': 1.309999942779541, 'optimal_score': 1, 'raw_score_acting': 1.309999942779541, 'raw_score_stable': 1.309999942779541, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 31, 'pool_name': 'backup_fs_data', 'create_time': '2024-03-16T07:35:22.052108+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '172', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'backup_fs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.0299999713897705, 'score_stable': 1.0299999713897705, 'optimal_score': 1, 'raw_score_acting': 1.0299999713897705, 'raw_score_stable': 1.0299999713897705, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-16T07:40:39.415 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-16T07:40:39.760 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2024-03-16T07:40:39.777 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-16T07:40:40.027 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T07:40:40.153 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2024-03-16T07:40:40.169 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-16T07:40:40.516 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2024-03-16T07:40:40.530 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get backup_fs_metadata pg_num 2024-03-16T07:40:40.874 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2024-03-16T07:40:40.887 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get backup_fs_data pg_num 2024-03-16T07:40:41.198 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2024-03-16T07:40:41.212 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T07:40:41.573 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:40:41.573 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":124,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6690,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6827/875237476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":875237476},{"type":"v1","addr":"172.21.15.49:6827","nonce":875237476}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":113},{"gid":6691,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6829/417322500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":417322500},{"type":"v1","addr":"172.21.15.49:6829","nonce":417322500}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":113},{"gid":6696,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6831/4121914730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":4121914730},{"type":"v1","addr":"172.21.15.49:6831","nonce":4121914730}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":113}],"filesystems":[{"mdsmap":{"epoch":124,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-16T07:35:10.038977+0000","modified":"2024-03-16T07:37:19.309479+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6698},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6698":{"gid":6698,"name":"a","rank":0,"incarnation":114,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6835/1838330688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":1838330688},{"type":"v1","addr":"172.21.15.49:6835","nonce":1838330688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[29],"metadata_pool":28,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6698,"qdb_cluster":[6698]},"id":14,"mirror_info":{"peers":{"8fa2e0a7-a624-43b8-9c12-da3a1afea05a":{"remote":{"client_name":"client.mirror_remote","cluster_name":"ceph","fs_name":"backup_fs"}}}}},{"mdsmap":{"epoch":122,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-16T07:35:23.124362+0000","modified":"2024-03-16T07:35:26.073338+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6697},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6697":{"gid":6697,"name":"e","rank":0,"incarnation":118,"state":"up:active","state_seq":6,"addr":"172.21.15.49:6834/1716116460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":1716116460},{"type":"v1","addr":"172.21.15.49:6834","nonce":1716116460}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[31],"metadata_pool":30,"enabled":true,"fs_name":"backup_fs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6697,"qdb_cluster":[6697]},"id":15}]} 2024-03-16T07:40:41.574 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 124 2024-03-16T07:40:41.591 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T07:40:41.910 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:40:41.910 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":178,"fsid":"f91af061-9eac-4793-87fa-8d27ae3d242f","created":"2024-03-16T07:24:20.357868+0000","modified":"2024-03-16T07:40:37.149548+0000","last_up_change":"2024-03-16T07:24:27.474980+0000","last_in_change":"2024-03-16T07:24:21.254179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":31,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T07:24:28.947521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":28,"pool_name":"cephfs_metadata","create_time":"2024-03-16T07:35:08.344405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"167","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.309999942779541,"score_stable":1.309999942779541,"optimal_score":1,"raw_score_acting":1.309999942779541,"raw_score_stable":1.309999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":29,"pool_name":"cephfs_data","create_time":"2024-03-16T07:35:09.019172+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"176","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":7,"snap_epoch":176,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":30,"pool_name":"backup_fs_metadata","create_time":"2024-03-16T07:35:21.682702+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"171","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"backup_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.309999942779541,"score_stable":1.309999942779541,"optimal_score":1,"raw_score_acting":1.309999942779541,"raw_score_stable":1.309999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":31,"pool_name":"backup_fs_data","create_time":"2024-03-16T07:35:22.052108+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"172","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"backup_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.0299999713897705,"score_stable":1.0299999713897705,"optimal_score":1,"raw_score_acting":1.0299999713897705,"raw_score_stable":1.0299999713897705,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2df14aac-98dc-4e3c-ae7e-9eb677aa30be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6801","nonce":2744935777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6803","nonce":2744935777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6807","nonce":2744935777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6805","nonce":2744935777}]},"public_addr":"172.21.15.49:6801/2744935777","cluster_addr":"172.21.15.49:6803/2744935777","heartbeat_back_addr":"172.21.15.49:6807/2744935777","heartbeat_front_addr":"172.21.15.49:6805/2744935777","state":["exists","up"]},{"osd":1,"uuid":"80461bd9-59ef-46df-9eea-bad92d960c57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6811","nonce":1655120118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6815","nonce":1655120118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6821","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6823","nonce":1655120118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6817","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6819","nonce":1655120118}]},"public_addr":"172.21.15.49:6811/1655120118","cluster_addr":"172.21.15.49:6815/1655120118","heartbeat_back_addr":"172.21.15.49:6823/1655120118","heartbeat_front_addr":"172.21.15.49:6819/1655120118","state":["exists","up"]},{"osd":2,"uuid":"d6bf40eb-6e42-4ec9-8b3d-0b6c5a6def79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6810","nonce":3815472376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6814","nonce":3815472376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6822","nonce":3815472376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6818","nonce":3815472376}]},"public_addr":"172.21.15.49:6810/3815472376","cluster_addr":"172.21.15.49:6814/3815472376","heartbeat_back_addr":"172.21.15.49:6822/3815472376","heartbeat_front_addr":"172.21.15.49:6818/3815472376","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.641492+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.668598+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.614940+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"29.2d","mappings":[{"from":1,"to":2}]},{"pgid":"29.31","mappings":[{"from":0,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.49:0/1731871169":"2024-03-17T07:40:37.149498+0000","172.21.15.49:0/1513827497":"2024-03-17T07:40:37.149498+0000","172.21.15.49:6825/1771093342":"2024-03-17T07:40:37.149498+0000","172.21.15.49:6824/1771093342":"2024-03-17T07:40:37.149498+0000","172.21.15.49:0/2518883128":"2024-03-17T07:40:37.149498+0000","172.21.15.49:0/1502855966":"2024-03-17T07:40:37.149498+0000","172.21.15.49:0/3515874822":"2024-03-17T07:40:37.149498+0000","172.21.15.49:6825/3151425488":"2024-03-17T07:35:34.187396+0000","172.21.15.49:6824/3151425488":"2024-03-17T07:35:34.187396+0000","172.21.15.49:0/549066423":"2024-03-17T07:35:34.187396+0000","172.21.15.49:0/3515296168":"2024-03-17T07:35:34.187396+0000","172.21.15.49:0/2374823119":"2024-03-17T07:35:34.187396+0000","172.21.15.49:0/467150732":"2024-03-17T07:35:34.187396+0000","172.21.15.49:0/2082959977":"2024-03-17T07:35:34.187396+0000","172.21.15.49:0/3804079701":"2024-03-17T07:35:34.187396+0000","172.21.15.49:0/1510403812":"2024-03-17T07:35:34.187396+0000","172.21.15.49:0/2539031077":"2024-03-17T07:35:34.187396+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T07:40:41.922 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-03-16T07:40:41.922 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T07:40:42.327 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:40:42.327 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":124,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6690,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6827/875237476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":875237476},{"type":"v1","addr":"172.21.15.49:6827","nonce":875237476}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":113},{"gid":6691,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6829/417322500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":417322500},{"type":"v1","addr":"172.21.15.49:6829","nonce":417322500}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":113},{"gid":6696,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6831/4121914730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":4121914730},{"type":"v1","addr":"172.21.15.49:6831","nonce":4121914730}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":113}],"filesystems":[{"mdsmap":{"epoch":124,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-16T07:35:10.038977+0000","modified":"2024-03-16T07:37:19.309479+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6698},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6698":{"gid":6698,"name":"a","rank":0,"incarnation":114,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6835/1838330688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":1838330688},{"type":"v1","addr":"172.21.15.49:6835","nonce":1838330688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[29],"metadata_pool":28,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6698,"qdb_cluster":[6698]},"id":14,"mirror_info":{"peers":{"8fa2e0a7-a624-43b8-9c12-da3a1afea05a":{"remote":{"client_name":"client.mirror_remote","cluster_name":"ceph","fs_name":"backup_fs"}}}}},{"mdsmap":{"epoch":122,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-16T07:35:23.124362+0000","modified":"2024-03-16T07:35:26.073338+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6697},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6697":{"gid":6697,"name":"e","rank":0,"incarnation":118,"state":"up:active","state_seq":6,"addr":"172.21.15.49:6834/1716116460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":1716116460},{"type":"v1","addr":"172.21.15.49:6834","nonce":1716116460}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[31],"metadata_pool":30,"enabled":true,"fs_name":"backup_fs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6697,"qdb_cluster":[6697]},"id":15}]} 2024-03-16T07:40:42.328 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 124 2024-03-16T07:40:42.341 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T07:40:42.685 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:40:42.685 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":124,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6690,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6827/875237476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":875237476},{"type":"v1","addr":"172.21.15.49:6827","nonce":875237476}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":113},{"gid":6691,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6829/417322500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":417322500},{"type":"v1","addr":"172.21.15.49:6829","nonce":417322500}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":113},{"gid":6696,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6831/4121914730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":4121914730},{"type":"v1","addr":"172.21.15.49:6831","nonce":4121914730}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":113}],"filesystems":[{"mdsmap":{"epoch":124,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-16T07:35:10.038977+0000","modified":"2024-03-16T07:37:19.309479+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6698},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6698":{"gid":6698,"name":"a","rank":0,"incarnation":114,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6835/1838330688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":1838330688},{"type":"v1","addr":"172.21.15.49:6835","nonce":1838330688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[29],"metadata_pool":28,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6698,"qdb_cluster":[6698]},"id":14,"mirror_info":{"peers":{"8fa2e0a7-a624-43b8-9c12-da3a1afea05a":{"remote":{"client_name":"client.mirror_remote","cluster_name":"ceph","fs_name":"backup_fs"}}}}},{"mdsmap":{"epoch":122,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-16T07:35:23.124362+0000","modified":"2024-03-16T07:35:26.073338+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6697},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6697":{"gid":6697,"name":"e","rank":0,"incarnation":118,"state":"up:active","state_seq":6,"addr":"172.21.15.49:6834/1716116460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":1716116460},{"type":"v1","addr":"172.21.15.49:6834","nonce":1716116460}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[31],"metadata_pool":30,"enabled":true,"fs_name":"backup_fs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6697,"qdb_cluster":[6697]},"id":15}]} 2024-03-16T07:40:42.685 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 124 2024-03-16T07:40:42.698 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T07:40:43.128 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:40:43.128 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":178,"fsid":"f91af061-9eac-4793-87fa-8d27ae3d242f","created":"2024-03-16T07:24:20.357868+0000","modified":"2024-03-16T07:40:37.149548+0000","last_up_change":"2024-03-16T07:24:27.474980+0000","last_in_change":"2024-03-16T07:24:21.254179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":31,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T07:24:28.947521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":28,"pool_name":"cephfs_metadata","create_time":"2024-03-16T07:35:08.344405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"167","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.309999942779541,"score_stable":1.309999942779541,"optimal_score":1,"raw_score_acting":1.309999942779541,"raw_score_stable":1.309999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":29,"pool_name":"cephfs_data","create_time":"2024-03-16T07:35:09.019172+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"176","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":7,"snap_epoch":176,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":30,"pool_name":"backup_fs_metadata","create_time":"2024-03-16T07:35:21.682702+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"171","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"backup_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.309999942779541,"score_stable":1.309999942779541,"optimal_score":1,"raw_score_acting":1.309999942779541,"raw_score_stable":1.309999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":31,"pool_name":"backup_fs_data","create_time":"2024-03-16T07:35:22.052108+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"172","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"backup_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.0299999713897705,"score_stable":1.0299999713897705,"optimal_score":1,"raw_score_acting":1.0299999713897705,"raw_score_stable":1.0299999713897705,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2df14aac-98dc-4e3c-ae7e-9eb677aa30be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6801","nonce":2744935777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6803","nonce":2744935777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6807","nonce":2744935777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6805","nonce":2744935777}]},"public_addr":"172.21.15.49:6801/2744935777","cluster_addr":"172.21.15.49:6803/2744935777","heartbeat_back_addr":"172.21.15.49:6807/2744935777","heartbeat_front_addr":"172.21.15.49:6805/2744935777","state":["exists","up"]},{"osd":1,"uuid":"80461bd9-59ef-46df-9eea-bad92d960c57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6811","nonce":1655120118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6815","nonce":1655120118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6821","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6823","nonce":1655120118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6817","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6819","nonce":1655120118}]},"public_addr":"172.21.15.49:6811/1655120118","cluster_addr":"172.21.15.49:6815/1655120118","heartbeat_back_addr":"172.21.15.49:6823/1655120118","heartbeat_front_addr":"172.21.15.49:6819/1655120118","state":["exists","up"]},{"osd":2,"uuid":"d6bf40eb-6e42-4ec9-8b3d-0b6c5a6def79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6810","nonce":3815472376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6814","nonce":3815472376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6822","nonce":3815472376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6818","nonce":3815472376}]},"public_addr":"172.21.15.49:6810/3815472376","cluster_addr":"172.21.15.49:6814/3815472376","heartbeat_back_addr":"172.21.15.49:6822/3815472376","heartbeat_front_addr":"172.21.15.49:6818/3815472376","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.641492+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.668598+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.614940+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"29.2d","mappings":[{"from":1,"to":2}]},{"pgid":"29.31","mappings":[{"from":0,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.49:0/1731871169":"2024-03-17T07:40:37.149498+0000","172.21.15.49:0/1513827497":"2024-03-17T07:40:37.149498+0000","172.21.15.49:6825/1771093342":"2024-03-17T07:40:37.149498+0000","172.21.15.49:6824/1771093342":"2024-03-17T07:40:37.149498+0000","172.21.15.49:0/2518883128":"2024-03-17T07:40:37.149498+0000","172.21.15.49:0/1502855966":"2024-03-17T07:40:37.149498+0000","172.21.15.49:0/3515874822":"2024-03-17T07:40:37.149498+0000","172.21.15.49:6825/3151425488":"2024-03-17T07:35:34.187396+0000","172.21.15.49:6824/3151425488":"2024-03-17T07:35:34.187396+0000","172.21.15.49:0/549066423":"2024-03-17T07:35:34.187396+0000","172.21.15.49:0/3515296168":"2024-03-17T07:35:34.187396+0000","172.21.15.49:0/2374823119":"2024-03-17T07:35:34.187396+0000","172.21.15.49:0/467150732":"2024-03-17T07:35:34.187396+0000","172.21.15.49:0/2082959977":"2024-03-17T07:35:34.187396+0000","172.21.15.49:0/3804079701":"2024-03-17T07:35:34.187396+0000","172.21.15.49:0/1510403812":"2024-03-17T07:35:34.187396+0000","172.21.15.49:0/2539031077":"2024-03-17T07:35:34.187396+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T07:40:43.145 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-03-16T07:40:43.535 INFO:tasks.ceph.mon.a.smithi049.stderr:2024-03-16T07:40:43.537+0000 7feb67011640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-03-16T07:40:43.536 INFO:teuthology.orchestra.run.smithi049.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-03-16T07:40:43.540 INFO:tasks.ceph.mds.a.smithi049.stderr: -4533> 2024-03-16T07:35:16.328+0000 7fb96d2d3640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-03-16T07:40:43.558 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-03-16T07:40:43.575 INFO:tasks.ceph.mds.a.smithi049.stdout:starting mds.a at 2024-03-16T07:40:44.551 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-03-16T07:40:45.538 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_metadata' removed 2024-03-16T07:40:45.557 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-03-16T07:40:46.539 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_data' removed 2024-03-16T07:40:46.558 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T07:40:46.898 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:40:46.898 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":181,"fsid":"f91af061-9eac-4793-87fa-8d27ae3d242f","created":"2024-03-16T07:24:20.357868+0000","modified":"2024-03-16T07:40:46.540998+0000","last_up_change":"2024-03-16T07:24:27.474980+0000","last_in_change":"2024-03-16T07:24:21.254179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":31,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T07:24:28.947521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":30,"pool_name":"backup_fs_metadata","create_time":"2024-03-16T07:35:21.682702+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"171","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"backup_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.309999942779541,"score_stable":1.309999942779541,"optimal_score":1,"raw_score_acting":1.309999942779541,"raw_score_stable":1.309999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":31,"pool_name":"backup_fs_data","create_time":"2024-03-16T07:35:22.052108+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"172","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"backup_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.0299999713897705,"score_stable":1.0299999713897705,"optimal_score":1,"raw_score_acting":1.0299999713897705,"raw_score_stable":1.0299999713897705,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2df14aac-98dc-4e3c-ae7e-9eb677aa30be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6801","nonce":2744935777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6803","nonce":2744935777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6807","nonce":2744935777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6805","nonce":2744935777}]},"public_addr":"172.21.15.49:6801/2744935777","cluster_addr":"172.21.15.49:6803/2744935777","heartbeat_back_addr":"172.21.15.49:6807/2744935777","heartbeat_front_addr":"172.21.15.49:6805/2744935777","state":["exists","up"]},{"osd":1,"uuid":"80461bd9-59ef-46df-9eea-bad92d960c57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6811","nonce":1655120118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6815","nonce":1655120118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6821","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6823","nonce":1655120118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6817","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6819","nonce":1655120118}]},"public_addr":"172.21.15.49:6811/1655120118","cluster_addr":"172.21.15.49:6815/1655120118","heartbeat_back_addr":"172.21.15.49:6823/1655120118","heartbeat_front_addr":"172.21.15.49:6819/1655120118","state":["exists","up"]},{"osd":2,"uuid":"d6bf40eb-6e42-4ec9-8b3d-0b6c5a6def79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6810","nonce":3815472376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6814","nonce":3815472376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6822","nonce":3815472376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6818","nonce":3815472376}]},"public_addr":"172.21.15.49:6810/3815472376","cluster_addr":"172.21.15.49:6814/3815472376","heartbeat_back_addr":"172.21.15.49:6822/3815472376","heartbeat_front_addr":"172.21.15.49:6818/3815472376","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.641492+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.668598+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.614940+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.49:6835/1838330688":"2024-03-17T07:40:43.537931+0000","172.21.15.49:0/1731871169":"2024-03-17T07:40:37.149498+0000","172.21.15.49:0/1513827497":"2024-03-17T07:40:37.149498+0000","172.21.15.49:6825/1771093342":"2024-03-17T07:40:37.149498+0000","172.21.15.49:6824/1771093342":"2024-03-17T07:40:37.149498+0000","172.21.15.49:0/2518883128":"2024-03-17T07:40:37.149498+0000","172.21.15.49:0/1502855966":"2024-03-17T07:40:37.149498+0000","172.21.15.49:0/3515874822":"2024-03-17T07:40:37.149498+0000","172.21.15.49:6825/3151425488":"2024-03-17T07:35:34.187396+0000","172.21.15.49:6833/1838330688":"2024-03-17T07:40:43.537931+0000","172.21.15.49:6824/3151425488":"2024-03-17T07:35:34.187396+0000","172.21.15.49:0/549066423":"2024-03-17T07:35:34.187396+0000","172.21.15.49:0/3515296168":"2024-03-17T07:35:34.187396+0000","172.21.15.49:0/2374823119":"2024-03-17T07:35:34.187396+0000","172.21.15.49:0/467150732":"2024-03-17T07:35:34.187396+0000","172.21.15.49:0/2082959977":"2024-03-17T07:35:34.187396+0000","172.21.15.49:0/3804079701":"2024-03-17T07:35:34.187396+0000","172.21.15.49:0/1510403812":"2024-03-17T07:35:34.187396+0000","172.21.15.49:0/2539031077":"2024-03-17T07:35:34.187396+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T07:40:46.912 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-16T07:24:28.947521+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 30, 'pool_name': 'backup_fs_metadata', 'create_time': '2024-03-16T07:35:21.682702+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '171', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'backup_fs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.309999942779541, 'score_stable': 1.309999942779541, 'optimal_score': 1, 'raw_score_acting': 1.309999942779541, 'raw_score_stable': 1.309999942779541, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 31, 'pool_name': 'backup_fs_data', 'create_time': '2024-03-16T07:35:22.052108+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '172', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'backup_fs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.0299999713897705, 'score_stable': 1.0299999713897705, 'optimal_score': 1, 'raw_score_acting': 1.0299999713897705, 'raw_score_stable': 1.0299999713897705, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-16T07:40:46.912 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-16T07:40:47.237 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2024-03-16T07:40:47.251 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get backup_fs_metadata pg_num 2024-03-16T07:40:47.578 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2024-03-16T07:40:47.591 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get backup_fs_data pg_num 2024-03-16T07:40:47.905 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2024-03-16T07:40:47.919 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T07:40:48.258 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:40:48.258 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":126,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6690,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6827/875237476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":875237476},{"type":"v1","addr":"172.21.15.49:6827","nonce":875237476}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":113},{"gid":6691,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6829/417322500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":417322500},{"type":"v1","addr":"172.21.15.49:6829","nonce":417322500}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":113},{"gid":6696,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6831/4121914730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":4121914730},{"type":"v1","addr":"172.21.15.49:6831","nonce":4121914730}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":113},{"gid":7066,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/3871040331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":3871040331},{"type":"v1","addr":"172.21.15.49:6835","nonce":3871040331}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":126}],"filesystems":[{"mdsmap":{"epoch":122,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-16T07:35:23.124362+0000","modified":"2024-03-16T07:35:26.073338+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6697},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6697":{"gid":6697,"name":"e","rank":0,"incarnation":118,"state":"up:active","state_seq":6,"addr":"172.21.15.49:6834/1716116460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":1716116460},{"type":"v1","addr":"172.21.15.49:6834","nonce":1716116460}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[31],"metadata_pool":30,"enabled":true,"fs_name":"backup_fs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6697,"qdb_cluster":[6697]},"id":15}]} 2024-03-16T07:40:48.259 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 126 2024-03-16T07:40:48.271 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T07:40:48.573 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:40:48.573 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":181,"fsid":"f91af061-9eac-4793-87fa-8d27ae3d242f","created":"2024-03-16T07:24:20.357868+0000","modified":"2024-03-16T07:40:46.540998+0000","last_up_change":"2024-03-16T07:24:27.474980+0000","last_in_change":"2024-03-16T07:24:21.254179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":31,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T07:24:28.947521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":30,"pool_name":"backup_fs_metadata","create_time":"2024-03-16T07:35:21.682702+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"171","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"backup_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.309999942779541,"score_stable":1.309999942779541,"optimal_score":1,"raw_score_acting":1.309999942779541,"raw_score_stable":1.309999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":31,"pool_name":"backup_fs_data","create_time":"2024-03-16T07:35:22.052108+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"172","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"backup_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.0299999713897705,"score_stable":1.0299999713897705,"optimal_score":1,"raw_score_acting":1.0299999713897705,"raw_score_stable":1.0299999713897705,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2df14aac-98dc-4e3c-ae7e-9eb677aa30be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6801","nonce":2744935777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6803","nonce":2744935777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6807","nonce":2744935777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6805","nonce":2744935777}]},"public_addr":"172.21.15.49:6801/2744935777","cluster_addr":"172.21.15.49:6803/2744935777","heartbeat_back_addr":"172.21.15.49:6807/2744935777","heartbeat_front_addr":"172.21.15.49:6805/2744935777","state":["exists","up"]},{"osd":1,"uuid":"80461bd9-59ef-46df-9eea-bad92d960c57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6811","nonce":1655120118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6815","nonce":1655120118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6821","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6823","nonce":1655120118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6817","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6819","nonce":1655120118}]},"public_addr":"172.21.15.49:6811/1655120118","cluster_addr":"172.21.15.49:6815/1655120118","heartbeat_back_addr":"172.21.15.49:6823/1655120118","heartbeat_front_addr":"172.21.15.49:6819/1655120118","state":["exists","up"]},{"osd":2,"uuid":"d6bf40eb-6e42-4ec9-8b3d-0b6c5a6def79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6810","nonce":3815472376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6814","nonce":3815472376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6822","nonce":3815472376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6818","nonce":3815472376}]},"public_addr":"172.21.15.49:6810/3815472376","cluster_addr":"172.21.15.49:6814/3815472376","heartbeat_back_addr":"172.21.15.49:6822/3815472376","heartbeat_front_addr":"172.21.15.49:6818/3815472376","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.641492+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.668598+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.614940+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.49:6835/1838330688":"2024-03-17T07:40:43.537931+0000","172.21.15.49:0/1731871169":"2024-03-17T07:40:37.149498+0000","172.21.15.49:0/1513827497":"2024-03-17T07:40:37.149498+0000","172.21.15.49:6825/1771093342":"2024-03-17T07:40:37.149498+0000","172.21.15.49:6824/1771093342":"2024-03-17T07:40:37.149498+0000","172.21.15.49:0/2518883128":"2024-03-17T07:40:37.149498+0000","172.21.15.49:0/1502855966":"2024-03-17T07:40:37.149498+0000","172.21.15.49:0/3515874822":"2024-03-17T07:40:37.149498+0000","172.21.15.49:6825/3151425488":"2024-03-17T07:35:34.187396+0000","172.21.15.49:6833/1838330688":"2024-03-17T07:40:43.537931+0000","172.21.15.49:6824/3151425488":"2024-03-17T07:35:34.187396+0000","172.21.15.49:0/549066423":"2024-03-17T07:35:34.187396+0000","172.21.15.49:0/3515296168":"2024-03-17T07:35:34.187396+0000","172.21.15.49:0/2374823119":"2024-03-17T07:35:34.187396+0000","172.21.15.49:0/467150732":"2024-03-17T07:35:34.187396+0000","172.21.15.49:0/2082959977":"2024-03-17T07:35:34.187396+0000","172.21.15.49:0/3804079701":"2024-03-17T07:35:34.187396+0000","172.21.15.49:0/1510403812":"2024-03-17T07:35:34.187396+0000","172.21.15.49:0/2539031077":"2024-03-17T07:35:34.187396+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T07:40:48.587 INFO:tasks.cephfs.filesystem:Destroying file system backup_fs and related pools 2024-03-16T07:40:48.587 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T07:40:48.926 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:40:48.926 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":126,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6690,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6827/875237476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":875237476},{"type":"v1","addr":"172.21.15.49:6827","nonce":875237476}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":113},{"gid":6691,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6829/417322500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":417322500},{"type":"v1","addr":"172.21.15.49:6829","nonce":417322500}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":113},{"gid":6696,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6831/4121914730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":4121914730},{"type":"v1","addr":"172.21.15.49:6831","nonce":4121914730}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":113},{"gid":7066,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/3871040331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":3871040331},{"type":"v1","addr":"172.21.15.49:6835","nonce":3871040331}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":126}],"filesystems":[{"mdsmap":{"epoch":122,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-16T07:35:23.124362+0000","modified":"2024-03-16T07:35:26.073338+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6697},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6697":{"gid":6697,"name":"e","rank":0,"incarnation":118,"state":"up:active","state_seq":6,"addr":"172.21.15.49:6834/1716116460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":1716116460},{"type":"v1","addr":"172.21.15.49:6834","nonce":1716116460}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[31],"metadata_pool":30,"enabled":true,"fs_name":"backup_fs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6697,"qdb_cluster":[6697]},"id":15}]} 2024-03-16T07:40:48.927 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 126 2024-03-16T07:40:48.939 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T07:40:49.315 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:40:49.315 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":126,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6690,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6827/875237476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":875237476},{"type":"v1","addr":"172.21.15.49:6827","nonce":875237476}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":113},{"gid":6691,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6829/417322500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":417322500},{"type":"v1","addr":"172.21.15.49:6829","nonce":417322500}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":113},{"gid":6696,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6831/4121914730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":4121914730},{"type":"v1","addr":"172.21.15.49:6831","nonce":4121914730}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":113},{"gid":7066,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/3871040331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":3871040331},{"type":"v1","addr":"172.21.15.49:6835","nonce":3871040331}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":126}],"filesystems":[{"mdsmap":{"epoch":122,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-16T07:35:23.124362+0000","modified":"2024-03-16T07:35:26.073338+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6697},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6697":{"gid":6697,"name":"e","rank":0,"incarnation":118,"state":"up:active","state_seq":6,"addr":"172.21.15.49:6834/1716116460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":1716116460},{"type":"v1","addr":"172.21.15.49:6834","nonce":1716116460}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[31],"metadata_pool":30,"enabled":true,"fs_name":"backup_fs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6697,"qdb_cluster":[6697]},"id":15}]} 2024-03-16T07:40:49.315 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 126 2024-03-16T07:40:49.328 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T07:40:49.636 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:40:49.636 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":181,"fsid":"f91af061-9eac-4793-87fa-8d27ae3d242f","created":"2024-03-16T07:24:20.357868+0000","modified":"2024-03-16T07:40:46.540998+0000","last_up_change":"2024-03-16T07:24:27.474980+0000","last_in_change":"2024-03-16T07:24:21.254179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":31,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T07:24:28.947521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":30,"pool_name":"backup_fs_metadata","create_time":"2024-03-16T07:35:21.682702+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"171","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"backup_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.309999942779541,"score_stable":1.309999942779541,"optimal_score":1,"raw_score_acting":1.309999942779541,"raw_score_stable":1.309999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":31,"pool_name":"backup_fs_data","create_time":"2024-03-16T07:35:22.052108+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"172","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"backup_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.0299999713897705,"score_stable":1.0299999713897705,"optimal_score":1,"raw_score_acting":1.0299999713897705,"raw_score_stable":1.0299999713897705,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2df14aac-98dc-4e3c-ae7e-9eb677aa30be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6801","nonce":2744935777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6803","nonce":2744935777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6807","nonce":2744935777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6805","nonce":2744935777}]},"public_addr":"172.21.15.49:6801/2744935777","cluster_addr":"172.21.15.49:6803/2744935777","heartbeat_back_addr":"172.21.15.49:6807/2744935777","heartbeat_front_addr":"172.21.15.49:6805/2744935777","state":["exists","up"]},{"osd":1,"uuid":"80461bd9-59ef-46df-9eea-bad92d960c57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6811","nonce":1655120118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6815","nonce":1655120118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6821","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6823","nonce":1655120118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6817","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6819","nonce":1655120118}]},"public_addr":"172.21.15.49:6811/1655120118","cluster_addr":"172.21.15.49:6815/1655120118","heartbeat_back_addr":"172.21.15.49:6823/1655120118","heartbeat_front_addr":"172.21.15.49:6819/1655120118","state":["exists","up"]},{"osd":2,"uuid":"d6bf40eb-6e42-4ec9-8b3d-0b6c5a6def79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6810","nonce":3815472376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6814","nonce":3815472376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6822","nonce":3815472376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6818","nonce":3815472376}]},"public_addr":"172.21.15.49:6810/3815472376","cluster_addr":"172.21.15.49:6814/3815472376","heartbeat_back_addr":"172.21.15.49:6822/3815472376","heartbeat_front_addr":"172.21.15.49:6818/3815472376","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.641492+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.668598+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.614940+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.49:6835/1838330688":"2024-03-17T07:40:43.537931+0000","172.21.15.49:0/1731871169":"2024-03-17T07:40:37.149498+0000","172.21.15.49:0/1513827497":"2024-03-17T07:40:37.149498+0000","172.21.15.49:6825/1771093342":"2024-03-17T07:40:37.149498+0000","172.21.15.49:6824/1771093342":"2024-03-17T07:40:37.149498+0000","172.21.15.49:0/2518883128":"2024-03-17T07:40:37.149498+0000","172.21.15.49:0/1502855966":"2024-03-17T07:40:37.149498+0000","172.21.15.49:0/3515874822":"2024-03-17T07:40:37.149498+0000","172.21.15.49:6825/3151425488":"2024-03-17T07:35:34.187396+0000","172.21.15.49:6833/1838330688":"2024-03-17T07:40:43.537931+0000","172.21.15.49:6824/3151425488":"2024-03-17T07:35:34.187396+0000","172.21.15.49:0/549066423":"2024-03-17T07:35:34.187396+0000","172.21.15.49:0/3515296168":"2024-03-17T07:35:34.187396+0000","172.21.15.49:0/2374823119":"2024-03-17T07:35:34.187396+0000","172.21.15.49:0/467150732":"2024-03-17T07:35:34.187396+0000","172.21.15.49:0/2082959977":"2024-03-17T07:35:34.187396+0000","172.21.15.49:0/3804079701":"2024-03-17T07:35:34.187396+0000","172.21.15.49:0/1510403812":"2024-03-17T07:35:34.187396+0000","172.21.15.49:0/2539031077":"2024-03-17T07:35:34.187396+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T07:40:49.649 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail backup_fs 2024-03-16T07:40:50.047 INFO:tasks.ceph.mon.a.smithi049.stderr:2024-03-16T07:40:50.048+0000 7feb67011640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-03-16T07:40:50.047 INFO:teuthology.orchestra.run.smithi049.stderr:backup_fs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-03-16T07:40:50.063 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm backup_fs --yes-i-really-mean-it 2024-03-16T07:40:50.081 INFO:tasks.ceph.mds.e.smithi049.stdout:starting mds.e at 2024-03-16T07:40:51.063 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm backup_fs_metadata backup_fs_metadata --yes-i-really-really-mean-it 2024-03-16T07:40:52.051 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'backup_fs_metadata' removed 2024-03-16T07:40:52.070 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm backup_fs_data backup_fs_data --yes-i-really-really-mean-it 2024-03-16T07:40:53.054 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'backup_fs_data' removed 2024-03-16T07:40:53.081 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-03-16T07:40:53.410 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_mirroring.TestMirroring.test_cephfs_mirror_cancel_mirroring_and_readd' 2024-03-16T07:40:54.071 INFO:tasks.cephfs_test_runner:Test adding a directory path for synchronization post removal of already added directory paths ... FAIL 2024-03-16T07:40:54.071 INFO:tasks.cephfs_test_runner: 2024-03-16T07:40:54.071 INFO:tasks.cephfs_test_runner:====================================================================== 2024-03-16T07:40:54.071 INFO:tasks.cephfs_test_runner:FAIL: test_cephfs_mirror_cancel_mirroring_and_readd (tasks.cephfs.test_mirroring.TestMirroring) 2024-03-16T07:40:54.071 INFO:tasks.cephfs_test_runner:Test adding a directory path for synchronization post removal of already added directory paths 2024-03-16T07:40:54.071 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-03-16T07:40:54.072 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-03-16T07:40:54.072 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_3d78f5ba07bf18880172c07d4d7b4ac00c9d30af/qa/tasks/cephfs/test_mirroring.py", line 1432, in test_cephfs_mirror_cancel_mirroring_and_readd 2024-03-16T07:40:54.072 INFO:tasks.cephfs_test_runner: self.assertGreater(vafter["counters"]["snaps_deleted"], vbefore["counters"]["snaps_deleted"]) 2024-03-16T07:40:54.072 INFO:tasks.cephfs_test_runner:AssertionError: 0 not greater than 0 2024-03-16T07:40:54.072 INFO:tasks.cephfs_test_runner: 2024-03-16T07:40:54.072 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-03-16T07:40:54.072 INFO:tasks.cephfs_test_runner:Ran 7 tests in 952.338s 2024-03-16T07:40:54.072 INFO:tasks.cephfs_test_runner: 2024-03-16T07:40:54.072 INFO:tasks.cephfs_test_runner:FAILED (failures=1) 2024-03-16T07:40:54.072 INFO:tasks.cephfs_test_runner: 2024-03-16T07:40:54.072 INFO:tasks.cephfs_test_runner:====================================================================== 2024-03-16T07:40:54.072 INFO:tasks.cephfs_test_runner:FAIL: test_cephfs_mirror_cancel_mirroring_and_readd (tasks.cephfs.test_mirroring.TestMirroring) 2024-03-16T07:40:54.072 INFO:tasks.cephfs_test_runner:Test adding a directory path for synchronization post removal of already added directory paths 2024-03-16T07:40:54.072 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-03-16T07:40:54.072 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-03-16T07:40:54.072 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_3d78f5ba07bf18880172c07d4d7b4ac00c9d30af/qa/tasks/cephfs/test_mirroring.py", line 1432, in test_cephfs_mirror_cancel_mirroring_and_readd 2024-03-16T07:40:54.073 INFO:tasks.cephfs_test_runner: self.assertGreater(vafter["counters"]["snaps_deleted"], vbefore["counters"]["snaps_deleted"]) 2024-03-16T07:40:54.073 INFO:tasks.cephfs_test_runner:AssertionError: 0 not greater than 0 2024-03-16T07:40:54.073 INFO:tasks.cephfs_test_runner: 2024-03-16T07:40:54.073 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_3d78f5ba07bf18880172c07d4d7b4ac00c9d30af/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_cephfs_mirror_cancel_mirroring_and_readd (tasks.cephfs.test_mirroring.TestMirroring) 2024-03-16T07:40:54.268 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=4c2d2d079ae6456baebfa9833f07a18d Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_3d78f5ba07bf18880172c07d4d7b4ac00c9d30af/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_cephfs_mirror_cancel_mirroring_and_readd (tasks.cephfs.test_mirroring.TestMirroring) 2024-03-16T07:40:54.269 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-03-16T07:40:54.278 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-03-16T07:40:54.301 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-03-16T07:40:54.302 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-03-16T07:40:54.302 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-16T07:40:54.321 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056354,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497664k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=13886 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248828k,nr_inodes=812207,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497664k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2024-03-16T07:40:54.321 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-03-16T07:40:54.322 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-16T07:40:54.378 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056354,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497664k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=13886 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248828k,nr_inodes=812207,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497664k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2024-03-16T07:40:54.378 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:40:54.378 DEBUG:teuthology.orchestra.run.smithi049:> ip netns list 2024-03-16T07:40:54.434 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 1) 2024-03-16T07:40:54.434 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-03-16T07:40:54.434 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:40:54.435 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-16T07:40:54.505 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:40:54.505 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-16T07:40:54.578 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T07:40:54.578 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link delete ceph-brx 2024-03-16T07:40:54.677 DEBUG:teuthology.run_tasks:Unwinding manager cephfs-mirror 2024-03-16T07:40:54.687 DEBUG:tasks.cephfs_mirror.client.mirror:waiting for process to exit 2024-03-16T07:40:54.687 INFO:teuthology.orchestra.run:waiting for 300 2024-03-16T07:40:54.787 DEBUG:teuthology.orchestra.run:got remote process result: 42 2024-03-16T07:41:10.093 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T07:41:40.160 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T07:41:54.789 DEBUG:teuthology.orchestra.run:timed out waiting; will kill: 2024-03-16T07:42:10.232 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T07:42:40.303 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T07:42:54.791 DEBUG:teuthology.orchestra.run:timed out waiting; will kill: 2024-03-16T07:42:54.791 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi049 with status 42: "cd /home/ubuntu/cephtest && adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/cephfs-mirror-client.mirror.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes cephfs-mirror --cluster ceph --id mirror" 2024-03-16T07:42:54.797 INFO:tasks.cephfs_mirror.client.mirror:Stopped 2024-03-16T07:42:54.797 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-03-16T07:42:54.808 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-03-16T07:42:54.808 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-16T07:42:55.123 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:42:55.123 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2024-03-16T07:42:55.135 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":77,"stamp":"2024-03-16T07:42:53.193239+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1354,"num_read_kb":2769,"num_write":397,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":240,"ondisk_log_size":240,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":2,"kb":314572800,"kb_used":183648,"kb_used_data":6836,"kb_used_omap":4,"kb_used_meta":176763,"kb_avail":314389152,"statfs":{"total":322122547200,"available":321934491648,"internally_reserved":0,"allocated":7000064,"data_stored":3563603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":181005647},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002072"},"pg_stats":[{"pgid":"1.0","version":"178'240","reported_seq":972,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-03-16T07:40:53.822940+0000","last_change":"2024-03-16T07:24:31.650537+0000","last_active":"2024-03-16T07:40:53.822940+0000","last_peered":"2024-03-16T07:40:53.822940+0000","last_clean":"2024-03-16T07:40:53.822940+0000","last_became_active":"2024-03-16T07:24:31.649574+0000","last_became_peered":"2024-03-16T07:24:31.649574+0000","last_unstale":"2024-03-16T07:40:53.822940+0000","last_undegraded":"2024-03-16T07:40:53.822940+0000","last_fullsized":"2024-03-16T07:40:53.822940+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:29.719970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:29.719970+0000","last_clean_scrub_stamp":"2024-03-16T07:24:29.719970+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:31:35.774554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1354,"num_read_kb":2769,"num_write":397,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1354,"num_read_kb":2769,"num_write":397,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":240,"ondisk_log_size":240,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738584,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":59444,"kb_used_data":1892,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":104798156,"statfs":{"total":107374182400,"available":107313311744,"internally_reserved":0,"allocated":1937408,"data_stored":794289,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738584,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":60024,"kb_used_data":2472,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":104797576,"statfs":{"total":107374182400,"available":107312717824,"internally_reserved":0,"allocated":2531328,"data_stored":1384657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738584,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":64180,"kb_used_data":2472,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":104793420,"statfs":{"total":107374182400,"available":107308462080,"internally_reserved":0,"allocated":2531328,"data_stored":1384657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":63175109},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-16T07:42:55.136 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-16T07:42:55.431 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:42:55.432 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2024-03-16T07:42:55.444 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":78,"stamp":"2024-03-16T07:42:55.193679+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1354,"num_read_kb":2769,"num_write":397,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":240,"ondisk_log_size":240,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":2,"kb":314572800,"kb_used":183648,"kb_used_data":6836,"kb_used_omap":4,"kb_used_meta":176763,"kb_avail":314389152,"statfs":{"total":322122547200,"available":321934491648,"internally_reserved":0,"allocated":7000064,"data_stored":3563603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":181005647},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002215"},"pg_stats":[{"pgid":"1.0","version":"178'240","reported_seq":972,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-03-16T07:40:53.822940+0000","last_change":"2024-03-16T07:24:31.650537+0000","last_active":"2024-03-16T07:40:53.822940+0000","last_peered":"2024-03-16T07:40:53.822940+0000","last_clean":"2024-03-16T07:40:53.822940+0000","last_became_active":"2024-03-16T07:24:31.649574+0000","last_became_peered":"2024-03-16T07:24:31.649574+0000","last_unstale":"2024-03-16T07:40:53.822940+0000","last_undegraded":"2024-03-16T07:40:53.822940+0000","last_fullsized":"2024-03-16T07:40:53.822940+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:29.719970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:29.719970+0000","last_clean_scrub_stamp":"2024-03-16T07:24:29.719970+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:31:35.774554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1354,"num_read_kb":2769,"num_write":397,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1354,"num_read_kb":2769,"num_write":397,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":240,"ondisk_log_size":240,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738584,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":59444,"kb_used_data":1892,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":104798156,"statfs":{"total":107374182400,"available":107313311744,"internally_reserved":0,"allocated":1937408,"data_stored":794289,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738584,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":60024,"kb_used_data":2472,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":104797576,"statfs":{"total":107374182400,"available":107312717824,"internally_reserved":0,"allocated":2531328,"data_stored":1384657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738584,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":64180,"kb_used_data":2472,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":104793420,"statfs":{"total":107374182400,"available":107308462080,"internally_reserved":0,"allocated":2531328,"data_stored":1384657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":63175109},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-16T07:42:55.445 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-03-16T07:42:55.445 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-16T07:42:55.743 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:42:55.743 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2024-03-16T07:42:55.756 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":78,"stamp":"2024-03-16T07:42:55.193679+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1354,"num_read_kb":2769,"num_write":397,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":240,"ondisk_log_size":240,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":2,"kb":314572800,"kb_used":183648,"kb_used_data":6836,"kb_used_omap":4,"kb_used_meta":176763,"kb_avail":314389152,"statfs":{"total":322122547200,"available":321934491648,"internally_reserved":0,"allocated":7000064,"data_stored":3563603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":181005647},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002215"},"pg_stats":[{"pgid":"1.0","version":"178'240","reported_seq":972,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-03-16T07:40:53.822940+0000","last_change":"2024-03-16T07:24:31.650537+0000","last_active":"2024-03-16T07:40:53.822940+0000","last_peered":"2024-03-16T07:40:53.822940+0000","last_clean":"2024-03-16T07:40:53.822940+0000","last_became_active":"2024-03-16T07:24:31.649574+0000","last_became_peered":"2024-03-16T07:24:31.649574+0000","last_unstale":"2024-03-16T07:40:53.822940+0000","last_undegraded":"2024-03-16T07:40:53.822940+0000","last_fullsized":"2024-03-16T07:40:53.822940+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:29.719970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:29.719970+0000","last_clean_scrub_stamp":"2024-03-16T07:24:29.719970+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:31:35.774554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1354,"num_read_kb":2769,"num_write":397,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1354,"num_read_kb":2769,"num_write":397,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":240,"ondisk_log_size":240,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738584,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":59444,"kb_used_data":1892,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":104798156,"statfs":{"total":107374182400,"available":107313311744,"internally_reserved":0,"allocated":1937408,"data_stored":794289,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738584,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":60024,"kb_used_data":2472,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":104797576,"statfs":{"total":107374182400,"available":107312717824,"internally_reserved":0,"allocated":2531328,"data_stored":1384657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738584,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":64180,"kb_used_data":2472,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":104793420,"statfs":{"total":107374182400,"available":107308462080,"internally_reserved":0,"allocated":2531328,"data_stored":1384657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":63175109},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-16T07:42:55.756 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T07:42:56.062 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:42:56.062 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":184,"fsid":"f91af061-9eac-4793-87fa-8d27ae3d242f","created":"2024-03-16T07:24:20.357868+0000","modified":"2024-03-16T07:40:53.053620+0000","last_up_change":"2024-03-16T07:24:27.474980+0000","last_in_change":"2024-03-16T07:24:21.254179+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":31,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T07:24:28.947521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2df14aac-98dc-4e3c-ae7e-9eb677aa30be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6801","nonce":2744935777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6803","nonce":2744935777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6807","nonce":2744935777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":2744935777},{"type":"v1","addr":"172.21.15.49:6805","nonce":2744935777}]},"public_addr":"172.21.15.49:6801/2744935777","cluster_addr":"172.21.15.49:6803/2744935777","heartbeat_back_addr":"172.21.15.49:6807/2744935777","heartbeat_front_addr":"172.21.15.49:6805/2744935777","state":["exists","up"]},{"osd":1,"uuid":"80461bd9-59ef-46df-9eea-bad92d960c57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6809","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6811","nonce":1655120118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6813","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6815","nonce":1655120118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6821","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6823","nonce":1655120118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6817","nonce":1655120118},{"type":"v1","addr":"172.21.15.49:6819","nonce":1655120118}]},"public_addr":"172.21.15.49:6811/1655120118","cluster_addr":"172.21.15.49:6815/1655120118","heartbeat_back_addr":"172.21.15.49:6823/1655120118","heartbeat_front_addr":"172.21.15.49:6819/1655120118","state":["exists","up"]},{"osd":2,"uuid":"d6bf40eb-6e42-4ec9-8b3d-0b6c5a6def79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6810","nonce":3815472376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6814","nonce":3815472376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6822","nonce":3815472376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3815472376},{"type":"v1","addr":"172.21.15.49:6818","nonce":3815472376}]},"public_addr":"172.21.15.49:6810/3815472376","cluster_addr":"172.21.15.49:6814/3815472376","heartbeat_back_addr":"172.21.15.49:6822/3815472376","heartbeat_front_addr":"172.21.15.49:6818/3815472376","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.641492+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.668598+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T07:24:25.614940+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.49:6834/1716116460":"2024-03-17T07:40:50.049343+0000","172.21.15.49:6832/1716116460":"2024-03-17T07:40:50.049343+0000","172.21.15.49:6835/1838330688":"2024-03-17T07:40:43.537931+0000","172.21.15.49:0/1731871169":"2024-03-17T07:40:37.149498+0000","172.21.15.49:0/1513827497":"2024-03-17T07:40:37.149498+0000","172.21.15.49:6825/1771093342":"2024-03-17T07:40:37.149498+0000","172.21.15.49:6824/1771093342":"2024-03-17T07:40:37.149498+0000","172.21.15.49:0/2518883128":"2024-03-17T07:40:37.149498+0000","172.21.15.49:0/1502855966":"2024-03-17T07:40:37.149498+0000","172.21.15.49:0/3515874822":"2024-03-17T07:40:37.149498+0000","172.21.15.49:6825/3151425488":"2024-03-17T07:35:34.187396+0000","172.21.15.49:6833/1838330688":"2024-03-17T07:40:43.537931+0000","172.21.15.49:6824/3151425488":"2024-03-17T07:35:34.187396+0000","172.21.15.49:0/549066423":"2024-03-17T07:35:34.187396+0000","172.21.15.49:0/3515296168":"2024-03-17T07:35:34.187396+0000","172.21.15.49:0/2374823119":"2024-03-17T07:35:34.187396+0000","172.21.15.49:0/467150732":"2024-03-17T07:35:34.187396+0000","172.21.15.49:0/2082959977":"2024-03-17T07:35:34.187396+0000","172.21.15.49:0/3804079701":"2024-03-17T07:35:34.187396+0000","172.21.15.49:0/1510403812":"2024-03-17T07:35:34.187396+0000","172.21.15.49:0/2539031077":"2024-03-17T07:35:34.187396+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T07:42:57.075 INFO:tasks.ceph:Scrubbing osd.0 2024-03-16T07:42:57.076 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-03-16T07:42:57.220 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-03-16T07:42:57.221 INFO:teuthology.orchestra.run.smithi049.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-16T07:42:57.221 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-03-16T07:42:57.232 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-03-16T07:42:57.538 INFO:teuthology.orchestra.run.smithi049.stderr:instructed osd(s) 0 to deep-scrub 2024-03-16T07:42:57.552 INFO:tasks.ceph:Scrubbing osd.1 2024-03-16T07:42:57.552 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-03-16T07:42:57.684 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-03-16T07:42:57.684 INFO:teuthology.orchestra.run.smithi049.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-16T07:42:57.684 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-03-16T07:42:57.695 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-03-16T07:42:57.995 INFO:teuthology.orchestra.run.smithi049.stderr:instructed osd(s) 1 to deep-scrub 2024-03-16T07:42:58.008 INFO:tasks.ceph:Scrubbing osd.2 2024-03-16T07:42:58.009 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-03-16T07:42:58.141 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-03-16T07:42:58.141 INFO:teuthology.orchestra.run.smithi049.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-16T07:42:58.141 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-03-16T07:42:58.152 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-03-16T07:42:58.455 INFO:teuthology.orchestra.run.smithi049.stderr:instructed osd(s) 2 to deep-scrub 2024-03-16T07:42:58.468 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-16T07:42:58.768 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:42:58.768 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2024-03-16T07:42:58.780 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":79,"stamp":"2024-03-16T07:42:57.193957+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1354,"num_read_kb":2769,"num_write":397,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":240,"ondisk_log_size":240,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":2,"kb":314572800,"kb_used":183648,"kb_used_data":6836,"kb_used_omap":4,"kb_used_meta":176763,"kb_avail":314389152,"statfs":{"total":322122547200,"available":321934491648,"internally_reserved":0,"allocated":7000064,"data_stored":3563603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":181005647},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002141"},"pg_stats":[{"pgid":"1.0","version":"178'240","reported_seq":972,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-03-16T07:40:53.822940+0000","last_change":"2024-03-16T07:24:31.650537+0000","last_active":"2024-03-16T07:40:53.822940+0000","last_peered":"2024-03-16T07:40:53.822940+0000","last_clean":"2024-03-16T07:40:53.822940+0000","last_became_active":"2024-03-16T07:24:31.649574+0000","last_became_peered":"2024-03-16T07:24:31.649574+0000","last_unstale":"2024-03-16T07:40:53.822940+0000","last_undegraded":"2024-03-16T07:40:53.822940+0000","last_fullsized":"2024-03-16T07:40:53.822940+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T07:24:29.719970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T07:24:29.719970+0000","last_clean_scrub_stamp":"2024-03-16T07:24:29.719970+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T10:31:35.774554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1354,"num_read_kb":2769,"num_write":397,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1354,"num_read_kb":2769,"num_write":397,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":240,"ondisk_log_size":240,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738584,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":59444,"kb_used_data":1892,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":104798156,"statfs":{"total":107374182400,"available":107313311744,"internally_reserved":0,"allocated":1937408,"data_stored":794289,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738584,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":60024,"kb_used_data":2472,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":104797576,"statfs":{"total":107374182400,"available":107312717824,"internally_reserved":0,"allocated":2531328,"data_stored":1384657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738584,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":64180,"kb_used_data":2472,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":104793420,"statfs":{"total":107374182400,"available":107308462080,"internally_reserved":0,"allocated":2531328,"data_stored":1384657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":63175109},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-16T07:42:58.784 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-03-16T07:24:29.719970+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=16, tm_hour=7, tm_min=24, tm_sec=29, tm_wday=5, tm_yday=76, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=16, tm_hour=7, tm_min=42, tm_sec=56, tm_wday=5, tm_yday=76, tm_isdst=0) 2024-03-16T07:42:58.784 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-03-16T07:43:10.367 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T07:43:18.785 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-16T07:43:19.099 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:43:19.100 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2024-03-16T07:43:19.112 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":89,"stamp":"2024-03-16T07:43:17.197204+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1354,"num_read_kb":2769,"num_write":397,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":242,"ondisk_log_size":242,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":2,"kb":314572800,"kb_used":183636,"kb_used_data":6836,"kb_used_omap":4,"kb_used_meta":176763,"kb_avail":314389164,"statfs":{"total":322122547200,"available":321934503936,"internally_reserved":0,"allocated":7000064,"data_stored":3563603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":181005647},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001826"},"pg_stats":[{"pgid":"1.0","version":"184'242","reported_seq":983,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-03-16T07:42:58.613023+0000","last_change":"2024-03-16T07:42:58.613051+0000","last_active":"2024-03-16T07:42:58.613023+0000","last_peered":"2024-03-16T07:42:58.613023+0000","last_clean":"2024-03-16T07:42:58.613023+0000","last_became_active":"2024-03-16T07:24:31.649574+0000","last_became_peered":"2024-03-16T07:24:31.649574+0000","last_unstale":"2024-03-16T07:42:58.613023+0000","last_undegraded":"2024-03-16T07:42:58.613023+0000","last_fullsized":"2024-03-16T07:42:58.613023+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"184'242","last_scrub_stamp":"2024-03-16T07:42:58.612970+0000","last_deep_scrub":"184'242","last_deep_scrub_stamp":"2024-03-16T07:42:58.612970+0000","last_clean_scrub_stamp":"2024-03-16T07:42:58.612970+0000","objects_scrubbed":2,"log_size":242,"log_dups_size":0,"ondisk_log_size":242,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T08:07:16.130654+0000","scrub_duration":22,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1354,"num_read_kb":2769,"num_write":397,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1354,"num_read_kb":2769,"num_write":397,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":242,"ondisk_log_size":242,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738588,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":59444,"kb_used_data":1892,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":104798156,"statfs":{"total":107374182400,"available":107313311744,"internally_reserved":0,"allocated":1937408,"data_stored":794289,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738588,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":60016,"kb_used_data":2472,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":104797584,"statfs":{"total":107374182400,"available":107312726016,"internally_reserved":0,"allocated":2531328,"data_stored":1384657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738588,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":64176,"kb_used_data":2472,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":104793424,"statfs":{"total":107374182400,"available":107308466176,"internally_reserved":0,"allocated":2531328,"data_stored":1384657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":63175109},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-16T07:43:19.113 DEBUG:teuthology.orchestra.run.smithi049:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-03-16T07:43:19.430 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-03-16T07:43:19.430 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T07:43:19.769 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-03-16T07:43:19.770 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":128,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6690,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6827/875237476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":875237476},{"type":"v1","addr":"172.21.15.49:6827","nonce":875237476}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":113},{"gid":6691,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6829/417322500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":417322500},{"type":"v1","addr":"172.21.15.49:6829","nonce":417322500}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":113},{"gid":6696,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6831/4121914730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":4121914730},{"type":"v1","addr":"172.21.15.49:6831","nonce":4121914730}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":113},{"gid":7066,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/3871040331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6833","nonce":3871040331},{"type":"v1","addr":"172.21.15.49:6835","nonce":3871040331}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":126},{"gid":7102,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6834/923496095","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":923496095},{"type":"v1","addr":"172.21.15.49:6834","nonce":923496095}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":128}],"filesystems":[]} 2024-03-16T07:43:19.770 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 128 2024-03-16T07:43:19.782 DEBUG:tasks.cephfs.filesystem:already dead... 2024-03-16T07:43:19.783 INFO:teuthology.misc:Shutting down mds daemons... 2024-03-16T07:43:19.783 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-03-16T07:43:19.783 INFO:teuthology.orchestra.run:waiting for 300 2024-03-16T07:43:19.792 INFO:tasks.ceph.mds.a:Stopped 2024-03-16T07:43:19.792 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-03-16T07:43:19.792 INFO:teuthology.orchestra.run:waiting for 300 2024-03-16T07:43:19.841 INFO:tasks.ceph.mds.b:Stopped 2024-03-16T07:43:19.842 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-03-16T07:43:19.842 INFO:teuthology.orchestra.run:waiting for 300 2024-03-16T07:43:19.891 INFO:tasks.ceph.mds.c:Stopped 2024-03-16T07:43:19.891 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-03-16T07:43:19.892 INFO:teuthology.orchestra.run:waiting for 300 2024-03-16T07:43:19.942 INFO:tasks.ceph.mds.d:Stopped 2024-03-16T07:43:19.942 DEBUG:tasks.ceph.mds.e:waiting for process to exit 2024-03-16T07:43:19.943 INFO:teuthology.orchestra.run:waiting for 300 2024-03-16T07:43:19.991 INFO:tasks.ceph.mds.e:Stopped 2024-03-16T07:43:19.991 INFO:teuthology.misc:Shutting down osd daemons... 2024-03-16T07:43:19.991 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-03-16T07:43:19.992 INFO:teuthology.orchestra.run:waiting for 300 2024-03-16T07:43:20.066 INFO:tasks.ceph.osd.0:Stopped 2024-03-16T07:43:20.066 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-03-16T07:43:20.066 INFO:teuthology.orchestra.run:waiting for 300 2024-03-16T07:43:20.134 INFO:tasks.ceph.osd.1:Stopped 2024-03-16T07:43:20.134 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-03-16T07:43:20.134 INFO:teuthology.orchestra.run:waiting for 300 2024-03-16T07:43:20.220 INFO:tasks.ceph.osd.2:Stopped 2024-03-16T07:43:20.221 INFO:teuthology.misc:Shutting down mgr daemons... 2024-03-16T07:43:20.221 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-03-16T07:43:20.221 INFO:teuthology.orchestra.run:waiting for 300 2024-03-16T07:43:20.255 INFO:tasks.ceph.mgr.x:Stopped 2024-03-16T07:43:20.255 INFO:teuthology.misc:Shutting down mon daemons... 2024-03-16T07:43:20.255 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-03-16T07:43:20.255 INFO:teuthology.orchestra.run:waiting for 300 2024-03-16T07:43:20.308 INFO:tasks.ceph.mon.a:Stopped 2024-03-16T07:43:20.308 INFO:tasks.ceph:Checking cluster log for badness... 2024-03-16T07:43:20.308 DEBUG:teuthology.orchestra.run.smithi049:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | head -n 1 2024-03-16T07:43:20.382 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi049.front.sepia.ceph.com 2024-03-16T07:43:20.382 DEBUG:teuthology.orchestra.run.smithi049:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-03-16T07:43:20.563 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi049.front.sepia.ceph.com 2024-03-16T07:43:20.563 DEBUG:teuthology.orchestra.run.smithi049:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-03-16T07:43:20.644 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi049.front.sepia.ceph.com 2024-03-16T07:43:20.645 DEBUG:teuthology.orchestra.run.smithi049:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-03-16T07:43:20.720 INFO:tasks.ceph:Archiving mon data... 2024-03-16T07:43:20.721 DEBUG:teuthology.misc:Transferring archived files from smithi049:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/pdonnell-2024-03-15_13:00:41-fs-wip-batrick-testing-20240314.183243-distro-default-smithi/7602244/data/mon.a.tgz 2024-03-16T07:43:20.721 DEBUG:teuthology.orchestra.run.smithi049:> mktemp 2024-03-16T07:43:20.736 INFO:teuthology.orchestra.run.smithi049.stdout:/tmp/tmp.jzUvFIf4Rz 2024-03-16T07:43:20.736 DEBUG:teuthology.orchestra.run.smithi049:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.jzUvFIf4Rz 2024-03-16T07:43:21.009 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod 0666 /tmp/tmp.jzUvFIf4Rz 2024-03-16T07:43:21.099 DEBUG:teuthology.orchestra.remote:smithi049:/tmp/tmp.jzUvFIf4Rz is 1MB 2024-03-16T07:43:21.316 DEBUG:teuthology.orchestra.run.smithi049:> rm -fr /tmp/tmp.jzUvFIf4Rz 2024-03-16T07:43:21.333 INFO:tasks.ceph:Cleaning ceph cluster... 2024-03-16T07:43:21.333 DEBUG:teuthology.orchestra.run.smithi049:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-03-16T07:43:21.525 DEBUG:tasks.ceph:valgrind exception message: valgrind error: Leak_StillReachable malloc malloc strdup 2024-03-16T07:43:21.525 INFO:tasks.ceph:Archiving crash dumps... 2024-03-16T07:43:21.527 DEBUG:teuthology.misc:Transferring archived files from smithi049:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2024-03-15_13:00:41-fs-wip-batrick-testing-20240314.183243-distro-default-smithi/7602244/remote/smithi049/crash 2024-03-16T07:43:21.528 DEBUG:teuthology.orchestra.run.smithi049:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-03-16T07:43:21.558 INFO:tasks.ceph:Shutting down logrotate 2024-03-16T07:43:21.558 DEBUG:teuthology.orchestra.run.smithi049:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T07:43:21.658 DEBUG:teuthology.orchestra.run.smithi049:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-03-16T07:43:21.689 INFO:tasks.ceph:Compressing logs... 2024-03-16T07:43:21.689 DEBUG:teuthology.orchestra.run.smithi049:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-03-16T07:43:22.080 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51127.log 2024-03-16T07:43:22.081 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66595.log 2024-03-16T07:43:22.081 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.51127.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40550.log 2024-03-16T07:43:22.081 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51127.log.gz 2024-03-16T07:43:22.081 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.66595.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80459.log 2024-03-16T07:43:22.081 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66595.log.gz 2024-03-16T07:43:22.082 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.40550.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47122.log 2024-03-16T07:43:22.082 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40550.log.gz 2024-03-16T07:43:22.082 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.80459.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42368.log 2024-03-16T07:43:22.082 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.80459.log.gz 2024-03-16T07:43:22.082 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.47122.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49444.log 2024-03-16T07:43:22.082 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47122.log.gz 2024-03-16T07:43:22.082 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75381.log 2024-03-16T07:43:22.083 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.42368.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42368.log.gz 2024-03-16T07:43:22.083 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.49444.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68298.log 2024-03-16T07:43:22.083 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49444.log.gz 2024-03-16T07:43:22.083 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.75381.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69544.log 2024-03-16T07:43:22.083 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.75381.log.gz 2024-03-16T07:43:22.083 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65684.log 2024-03-16T07:43:22.083 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.68298.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68298.log.gz 2024-03-16T07:43:22.083 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.69544.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80796.log 2024-03-16T07:43:22.083 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69544.log.gz 2024-03-16T07:43:22.084 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.65684.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61272.log 2024-03-16T07:43:22.084 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65684.log.gz 2024-03-16T07:43:22.084 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51085.log 2024-03-16T07:43:22.084 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.80796.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.80796.log.gz 2024-03-16T07:43:22.084 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.61272.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73860.log 2024-03-16T07:43:22.084 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61272.log.gz 2024-03-16T07:43:22.084 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.51085.log: /var/log/ceph/ceph-client.admin.79158.log 2024-03-16T07:43:22.084 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51085.log.gz 2024-03-16T07:43:22.085 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67877.log 2024-03-16T07:43:22.085 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.73860.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.73860.log.gz 2024-03-16T07:43:22.085 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.79158.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73127.log 2024-03-16T07:43:22.085 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.79158.log.gz 2024-03-16T07:43:22.085 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.67877.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78100.log 2024-03-16T07:43:22.085 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67877.log.gz 2024-03-16T07:43:22.085 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74623.log 2024-03-16T07:43:22.085 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.73127.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.73127.log.gz 2024-03-16T07:43:22.085 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.78100.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83657.log 2024-03-16T07:43:22.086 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.78100.log.gz 2024-03-16T07:43:22.086 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.74623.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-03-16T07:43:22.086 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74623.log.gz 2024-03-16T07:43:22.086 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35233.log 2024-03-16T07:43:22.086 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.83657.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.83657.log.gz 2024-03-16T07:43:22.086 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84033.log 2024-03-16T07:43:22.086 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.35233.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72657.log 2024-03-16T07:43:22.086 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35233.log.gz 2024-03-16T07:43:22.087 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40508.log 2024-03-16T07:43:22.087 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.84033.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.84033.log.gz 2024-03-16T07:43:22.087 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.72657.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55961.log 2024-03-16T07:43:22.087 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72657.log.gz 2024-03-16T07:43:22.087 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.40508.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40508.log.gz 2024-03-16T07:43:22.087 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88646.log 2024-03-16T07:43:22.087 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88730.log 2024-03-16T07:43:22.087 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.55961.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55961.log.gz 2024-03-16T07:43:22.087 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.88646.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79666.log 2024-03-16T07:43:22.088 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.88646.log.gz 2024-03-16T07:43:22.088 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.88730.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58477.log 2024-03-16T07:43:22.088 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.88730.log.gz 2024-03-16T07:43:22.088 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.79666.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46139.log 2024-03-16T07:43:22.088 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.79666.log.gz 2024-03-16T07:43:22.088 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.58477.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52208.log 2024-03-16T07:43:22.088 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58477.log.gz 2024-03-16T07:43:22.088 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.46139.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83158.log 2024-03-16T07:43:22.089 INFO:teuthology.orchestra.run.smithi049.stderr: 49.5% -- replaced with /var/log/ceph/ceph-client.admin.46139.log.gz 2024-03-16T07:43:22.089 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.52208.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78588.log 2024-03-16T07:43:22.089 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52208.log.gz 2024-03-16T07:43:22.089 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.83158.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72112.log 2024-03-16T07:43:22.089 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.83158.log.gz 2024-03-16T07:43:22.089 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.78588.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74359.log 2024-03-16T07:43:22.089 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.78588.log.gz 2024-03-16T07:43:22.089 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.72112.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80105.log 2024-03-16T07:43:22.090 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72112.log.gz 2024-03-16T07:43:22.090 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.74359.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74359.log.gz 2024-03-16T07:43:22.090 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49818.log 2024-03-16T07:43:22.090 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.80105.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86154.log 2024-03-16T07:43:22.090 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.80105.log.gz 2024-03-16T07:43:22.090 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.49818.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62030.log 2024-03-16T07:43:22.090 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49818.log.gz 2024-03-16T07:43:22.090 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.86154.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.86154.log.gz 2024-03-16T07:43:22.091 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35153.log 2024-03-16T07:43:22.091 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.62030.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39310.log 2024-03-16T07:43:22.091 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62030.log.gz 2024-03-16T07:43:22.091 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.35153.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65726.log 0.0% 2024-03-16T07:43:22.091 INFO:teuthology.orchestra.run.smithi049.stderr: -- replaced with /var/log/ceph/ceph-client.admin.35153.log.gz 2024-03-16T07:43:22.091 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.39310.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80586.log 2024-03-16T07:43:22.091 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39310.log.gz 2024-03-16T07:43:22.091 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.65726.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58627.log 2024-03-16T07:43:22.092 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65726.log.gz 2024-03-16T07:43:22.092 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.80586.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57396.log 2024-03-16T07:43:22.092 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.80586.log.gz 2024-03-16T07:43:22.092 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.58627.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44098.log 2024-03-16T07:43:22.092 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58627.log.gz 2024-03-16T07:43:22.092 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.57396.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51348.log 2024-03-16T07:43:22.092 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57396.log.gz 2024-03-16T07:43:22.092 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.44098.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54114.log 2024-03-16T07:43:22.093 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44098.log.gz 2024-03-16T07:43:22.093 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.51348.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65037.log 2024-03-16T07:43:22.093 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51348.log.gz 2024-03-16T07:43:22.093 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.54114.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84102.log 2024-03-16T07:43:22.093 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54114.log.gz 2024-03-16T07:43:22.093 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.65037.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57270.log 2024-03-16T07:43:22.093 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65037.log.gz 2024-03-16T07:43:22.093 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.84102.log: gzip -5 --verbose 0.0% -- -- replaced with /var/log/ceph/ceph-client.admin.84102.log.gz /var/log/ceph/ceph-client.admin.69632.log 2024-03-16T07:43:22.094 INFO:teuthology.orchestra.run.smithi049.stderr: 2024-03-16T07:43:22.094 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.57270.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50562.log 2024-03-16T07:43:22.094 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57270.log.gz 2024-03-16T07:43:22.094 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.69632.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55587.log 2024-03-16T07:43:22.094 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69632.log.gz 2024-03-16T07:43:22.094 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.50562.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64579.log 2024-03-16T07:43:22.094 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50562.log.gz 2024-03-16T07:43:22.094 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.55587.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79792.log 2024-03-16T07:43:22.095 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55587.log.gz 2024-03-16T07:43:22.095 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.64579.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60925.log 2024-03-16T07:43:22.095 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64579.log.gz 2024-03-16T07:43:22.095 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.79792.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49129.log 2024-03-16T07:43:22.095 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.79792.log.gz 2024-03-16T07:43:22.095 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.60925.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68527.log 2024-03-16T07:43:22.095 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60925.log.gz 2024-03-16T07:43:22.095 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.49129.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68442.log 2024-03-16T07:43:22.096 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49129.log.gz 2024-03-16T07:43:22.096 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.68527.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57354.log 2024-03-16T07:43:22.096 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68527.log.gz 2024-03-16T07:43:22.096 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.68442.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42725.log 2024-03-16T07:43:22.096 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68442.log.gz 2024-03-16T07:43:22.096 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.57354.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67962.log 2024-03-16T07:43:22.096 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57354.log.gz 2024-03-16T07:43:22.096 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.42725.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89743.log 2024-03-16T07:43:22.096 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42725.log.gz 2024-03-16T07:43:22.097 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.67962.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56621.log 2024-03-16T07:43:22.097 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67962.log.gz 2024-03-16T07:43:22.097 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.89743.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.46468.log 2024-03-16T07:43:22.097 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.89743.log.gz 2024-03-16T07:43:22.097 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.56621.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58086.log 2024-03-16T07:43:22.097 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56621.log.gz 2024-03-16T07:43:22.097 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.0.46468.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83465.log 2024-03-16T07:43:22.097 INFO:teuthology.orchestra.run.smithi049.stderr: 32.5% -- replaced with /var/log/ceph/ceph-client.0.46468.log.gz 2024-03-16T07:43:22.098 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.58086.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50916.log 2024-03-16T07:43:22.098 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58086.log.gz 2024-03-16T07:43:22.098 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.83465.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60149.log 2024-03-16T07:43:22.098 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.83465.log.gz 2024-03-16T07:43:22.098 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.50916.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57854.log 2024-03-16T07:43:22.098 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50916.log.gz 2024-03-16T07:43:22.098 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.60149.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76658.log 2024-03-16T07:43:22.098 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60149.log.gz 2024-03-16T07:43:22.099 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.57854.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35394.log 2024-03-16T07:43:22.099 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57854.log.gz 2024-03-16T07:43:22.099 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.76658.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89515.log 2024-03-16T07:43:22.099 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.76658.log.gz 2024-03-16T07:43:22.099 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.35394.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75507.log 2024-03-16T07:43:22.099 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35394.log.gz 2024-03-16T07:43:22.099 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.89515.log: gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.89827.log -- replaced with /var/log/ceph/ceph-client.admin.89515.log.gz 2024-03-16T07:43:22.099 INFO:teuthology.orchestra.run.smithi049.stderr: 2024-03-16T07:43:22.100 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.75507.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60859.log 2024-03-16T07:43:22.100 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.75507.log.gz 2024-03-16T07:43:22.100 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.89827.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50249.log 2024-03-16T07:43:22.100 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.89827.log.gz 2024-03-16T07:43:22.100 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.60859.log: gzip -5 0.0% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.60859.log.gz 2024-03-16T07:43:22.100 INFO:teuthology.orchestra.run.smithi049.stderr: /var/log/ceph/ceph-client.admin.73032.log 2024-03-16T07:43:22.100 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.50249.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86715.log 2024-03-16T07:43:22.100 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50249.log.gz 2024-03-16T07:43:22.101 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.73032.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40340.log 2024-03-16T07:43:22.101 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.73032.log.gz 2024-03-16T07:43:22.101 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.86715.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70825.log 2024-03-16T07:43:22.101 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.86715.log.gz 2024-03-16T07:43:22.101 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.40340.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49307.log 2024-03-16T07:43:22.101 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40340.log.gz 2024-03-16T07:43:22.101 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.70825.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40466.log 2024-03-16T07:43:22.101 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70825.log.gz 2024-03-16T07:43:22.102 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.49307.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86415.log 2024-03-16T07:43:22.102 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49307.log.gz 2024-03-16T07:43:22.102 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.40466.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86978.log 0.0% 2024-03-16T07:43:22.102 INFO:teuthology.orchestra.run.smithi049.stderr: -- replaced with /var/log/ceph/ceph-client.admin.40466.log.gz 2024-03-16T07:43:22.102 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.86415.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71141.log 2024-03-16T07:43:22.102 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.86415.log.gz 2024-03-16T07:43:22.102 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.86978.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45366.log 2024-03-16T07:43:22.102 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.86978.log.gz 2024-03-16T07:43:22.103 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.71141.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75633.log 2024-03-16T07:43:22.103 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71141.log.gz 2024-03-16T07:43:22.103 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.45366.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84454.log 2024-03-16T07:43:22.103 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45366.log.gz 2024-03-16T07:43:22.103 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.75633.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69237.log 2024-03-16T07:43:22.103 INFO:teuthology.orchestra.run.smithi049.stderr: 49.1% -- replaced with /var/log/ceph/ceph-client.admin.75633.log.gz 2024-03-16T07:43:22.103 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.84454.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76616.log 2024-03-16T07:43:22.103 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.84454.log.gz 2024-03-16T07:43:22.104 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.69237.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50688.log 2024-03-16T07:43:22.104 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69237.log.gz 2024-03-16T07:43:22.104 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.76616.log: gzip -5 --verbose 0.0% -- -- replaced with /var/log/ceph/ceph-client.admin.76616.log.gz 2024-03-16T07:43:22.104 INFO:teuthology.orchestra.run.smithi049.stderr: /var/log/ceph/ceph-client.admin.55272.log 2024-03-16T07:43:22.104 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.50688.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81382.log 2024-03-16T07:43:22.104 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50688.log.gz 2024-03-16T07:43:22.104 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.55272.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67326.log 2024-03-16T07:43:22.104 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55272.log.gz 2024-03-16T07:43:22.105 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.81382.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.81382.log.gz 2024-03-16T07:43:22.105 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60299.log 2024-03-16T07:43:22.105 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.67326.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71575.log 2024-03-16T07:43:22.105 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67326.log.gz 2024-03-16T07:43:22.105 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.60299.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91015.log 2024-03-16T07:43:22.105 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60299.log.gz 2024-03-16T07:43:22.105 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.71575.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81985.log 2024-03-16T07:43:22.105 INFO:teuthology.orchestra.run.smithi049.stderr: 48.6% -- replaced with /var/log/ceph/ceph-client.admin.71575.log.gz 2024-03-16T07:43:22.105 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/cephfs-mirror-client.mirror.log 2024-03-16T07:43:22.106 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.91015.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.91015.log.gz 2024-03-16T07:43:22.106 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.81985.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75423.log 2024-03-16T07:43:22.106 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.81985.log.gz 2024-03-16T07:43:22.106 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/valgrind/cephfs-mirror-client.mirror.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67920.log 2024-03-16T07:43:22.106 INFO:teuthology.orchestra.run.smithi049.stderr: 79.3% -- replaced with /var/log/ceph/valgrind/cephfs-mirror-client.mirror.log.gz 2024-03-16T07:43:22.106 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.75423.log: gzip -5 --verbose 0.0% -- -- replaced with /var/log/ceph/ceph-client.admin.75423.log.gz /var/log/ceph/ceph-client.admin.56999.log 2024-03-16T07:43:22.106 INFO:teuthology.orchestra.run.smithi049.stderr: 2024-03-16T07:43:22.106 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.67920.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72615.log 2024-03-16T07:43:22.107 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67920.log.gz 2024-03-16T07:43:22.107 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.56999.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66365.log 2024-03-16T07:43:22.107 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56999.log.gz 2024-03-16T07:43:22.107 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.72615.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63391.log 2024-03-16T07:43:22.107 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72615.log.gz 2024-03-16T07:43:22.107 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.66365.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65558.log 2024-03-16T07:43:22.107 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66365.log.gz 2024-03-16T07:43:22.107 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.63391.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39175.log 2024-03-16T07:43:22.108 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63391.log.gz 2024-03-16T07:43:22.108 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.65558.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53401.log 2024-03-16T07:43:22.108 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65558.log.gz 2024-03-16T07:43:22.108 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.39175.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56392.log 2024-03-16T07:43:22.108 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39175.log.gz 2024-03-16T07:43:22.108 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.53401.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53443.log 2024-03-16T07:43:22.108 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53401.log.gz 2024-03-16T07:43:22.108 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.56392.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49359.log 2024-03-16T07:43:22.109 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56392.log.gz 2024-03-16T07:43:22.109 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.53443.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82818.log 2024-03-16T07:43:22.109 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53443.log.gz 2024-03-16T07:43:22.109 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.49359.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57228.log 2024-03-16T07:43:22.109 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49359.log.gz 2024-03-16T07:43:22.109 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.82818.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56350.log 2024-03-16T07:43:22.109 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.82818.log.gz 2024-03-16T07:43:22.109 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.57228.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73463.log 2024-03-16T07:43:22.109 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57228.log.gz 2024-03-16T07:43:22.110 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.56350.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44661.log 2024-03-16T07:43:22.110 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56350.log.gz 2024-03-16T07:43:22.110 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.73463.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79834.log 2024-03-16T07:43:22.110 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.73463.log.gz 2024-03-16T07:43:22.110 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.44661.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42503.log 2024-03-16T07:43:22.110 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44661.log.gz 2024-03-16T07:43:22.110 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.79834.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62156.log 2024-03-16T07:43:22.110 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.79834.log.gz 2024-03-16T07:43:22.111 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.42503.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73421.log 2024-03-16T07:43:22.111 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42503.log.gz 2024-03-16T07:43:22.111 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.62156.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84144.log 2024-03-16T07:43:22.111 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62156.log.gz 2024-03-16T07:43:22.111 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.73421.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.mirror.40927.log 2024-03-16T07:43:22.111 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.73421.log.gz 2024-03-16T07:43:22.111 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.84144.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79498.log 2024-03-16T07:43:22.111 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.84144.log.gz 2024-03-16T07:43:22.112 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.mirror.40927.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62721.log 2024-03-16T07:43:22.112 INFO:teuthology.orchestra.run.smithi049.stderr: 18.7% -- replaced with /var/log/ceph/ceph-client.mirror.40927.log.gz 2024-03-16T07:43:22.112 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.79498.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50207.log 2024-03-16T07:43:22.112 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.79498.log.gz 2024-03-16T07:43:22.112 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.62721.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79242.log 2024-03-16T07:43:22.112 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62721.log.gz 2024-03-16T07:43:22.112 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.50207.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61748.log 2024-03-16T07:43:22.112 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50207.log.gz 2024-03-16T07:43:22.112 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.79242.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68611.log 2024-03-16T07:43:22.113 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.79242.log.gz 2024-03-16T07:43:22.113 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.61748.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40256.log 2024-03-16T07:43:22.113 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61748.log.gz 2024-03-16T07:43:22.113 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.68611.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65205.log 2024-03-16T07:43:22.113 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68611.log.gz 2024-03-16T07:43:22.113 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.40256.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47248.log 2024-03-16T07:43:22.113 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40256.log.gz 2024-03-16T07:43:22.113 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.65205.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49402.log 2024-03-16T07:43:22.114 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65205.log.gz 2024-03-16T07:43:22.114 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.47248.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59544.log 2024-03-16T07:43:22.114 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47248.log.gz 2024-03-16T07:43:22.114 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.49402.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63486.log 2024-03-16T07:43:22.114 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49402.log.gz 2024-03-16T07:43:22.114 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.59544.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69279.log 2024-03-16T07:43:22.114 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59544.log.gz 2024-03-16T07:43:22.114 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.63486.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84370.log 0.0% 2024-03-16T07:43:22.115 INFO:teuthology.orchestra.run.smithi049.stderr: -- replaced with /var/log/ceph/ceph-client.admin.63486.log.gz 2024-03-16T07:43:22.115 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.69279.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50520.log 2024-03-16T07:43:22.115 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69279.log.gz 2024-03-16T07:43:22.115 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.84370.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53615.log 2024-03-16T07:43:22.115 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.84370.log.gz 2024-03-16T07:43:22.115 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.50520.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62282.log 2024-03-16T07:43:22.115 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50520.log.gz 2024-03-16T07:43:22.115 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.53615.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53527.log 2024-03-16T07:43:22.116 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53615.log.gz 2024-03-16T07:43:22.116 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.62282.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67123.log 2024-03-16T07:43:22.116 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62282.log.gz 2024-03-16T07:43:22.116 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.53527.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54932.log 2024-03-16T07:43:22.116 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53527.log.gz 2024-03-16T07:43:22.116 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.67123.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40844.log 2024-03-16T07:43:22.116 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67123.log.gz 2024-03-16T07:43:22.116 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.54932.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81495.log 2024-03-16T07:43:22.116 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54932.log.gz 2024-03-16T07:43:22.117 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.40844.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39876.log 2024-03-16T07:43:22.117 INFO:teuthology.orchestra.run.smithi049.stderr: 48.1% -- replaced with /var/log/ceph/ceph-client.admin.40844.log.gz 2024-03-16T07:43:22.117 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.81495.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91099.log 2024-03-16T07:43:22.117 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.81495.log.gz 2024-03-16T07:43:22.117 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.39876.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69884.log 2024-03-16T07:43:22.117 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39876.log.gz 2024-03-16T07:43:22.117 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.91099.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62324.log 2024-03-16T07:43:22.117 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.91099.log.gz 2024-03-16T07:43:22.118 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.69884.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73607.log 2024-03-16T07:43:22.118 INFO:teuthology.orchestra.run.smithi049.stderr: 49.5% -- replaced with /var/log/ceph/ceph-client.admin.69884.log.gz 2024-03-16T07:43:22.118 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.62324.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45887.log 2024-03-16T07:43:22.118 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62324.log.gz 2024-03-16T07:43:22.118 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.73607.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76965.log 2024-03-16T07:43:22.118 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.73607.log.gz 2024-03-16T07:43:22.118 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.45887.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43088.log 2024-03-16T07:43:22.118 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45887.log.gz 2024-03-16T07:43:22.119 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.76965.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73169.log 2024-03-16T07:43:22.119 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.76965.log.gz 2024-03-16T07:43:22.119 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.43088.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60233.log 2024-03-16T07:43:22.119 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43088.log.gz 2024-03-16T07:43:22.119 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.73169.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56873.log 2024-03-16T07:43:22.119 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.73169.log.gz 2024-03-16T07:43:22.119 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.60233.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89378.log 2024-03-16T07:43:22.119 INFO:teuthology.orchestra.run.smithi049.stderr: 49.5% -- replaced with /var/log/ceph/ceph-client.admin.60233.log.gz 2024-03-16T07:43:22.120 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.56873.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77371.log 2024-03-16T07:43:22.120 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56873.log.gz 2024-03-16T07:43:22.120 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.89378.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46013.log 2024-03-16T07:43:22.120 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.89378.log.gz 2024-03-16T07:43:22.120 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.77371.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84412.log 2024-03-16T07:43:22.120 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.77371.log.gz 2024-03-16T07:43:22.120 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.46013.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80063.log 2024-03-16T07:43:22.120 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46013.log.gz 2024-03-16T07:43:22.120 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.84412.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69502.log 2024-03-16T07:43:22.121 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.84412.log.gz 2024-03-16T07:43:22.121 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.80063.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48455.log 2024-03-16T07:43:22.121 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.80063.log.gz 2024-03-16T07:43:22.121 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.69502.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45929.log 2024-03-16T07:43:22.121 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69502.log.gz 2024-03-16T07:43:22.121 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.48455.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43800.log 2024-03-16T07:43:22.121 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48455.log.gz 2024-03-16T07:43:22.121 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.45929.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67715.log 2024-03-16T07:43:22.122 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45929.log.gz 2024-03-16T07:43:22.122 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.43800.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57956.log 2024-03-16T07:43:22.122 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43800.log.gz 2024-03-16T07:43:22.122 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.67715.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61946.log 2024-03-16T07:43:22.122 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67715.log.gz 2024-03-16T07:43:22.122 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.57956.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90663.log 2024-03-16T07:43:22.122 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57956.log.gz 2024-03-16T07:43:22.122 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.61946.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59800.log 2024-03-16T07:43:22.123 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61946.log.gz 2024-03-16T07:43:22.123 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.90663.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46055.log 2024-03-16T07:43:22.123 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.90663.log.gz 2024-03-16T07:43:22.123 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.59800.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55800.log 2024-03-16T07:43:22.123 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59800.log.gz 2024-03-16T07:43:22.123 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.46055.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50814.log 2024-03-16T07:43:22.123 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46055.log.gz 2024-03-16T07:43:22.123 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.55800.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40424.log 2024-03-16T07:43:22.123 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55800.log.gz 2024-03-16T07:43:22.124 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.50814.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83591.log 2024-03-16T07:43:22.124 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50814.log.gz 2024-03-16T07:43:22.124 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.40424.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89198.log 2024-03-16T07:43:22.124 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40424.log.gz 2024-03-16T07:43:22.124 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.83591.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74257.log 2024-03-16T07:43:22.124 INFO:teuthology.orchestra.run.smithi049.stderr: 48.6% -- replaced with /var/log/ceph/ceph-client.admin.83591.log.gz 2024-03-16T07:43:22.124 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.89198.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.59305.log 2024-03-16T07:43:22.124 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.89198.log.gz 2024-03-16T07:43:22.125 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.74257.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77263.log 2024-03-16T07:43:22.125 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74257.log.gz 2024-03-16T07:43:22.125 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.1.59305.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61843.log 2024-03-16T07:43:22.125 INFO:teuthology.orchestra.run.smithi049.stderr: 33.7% -- replaced with /var/log/ceph/ceph-client.1.59305.log.gz 2024-03-16T07:43:22.125 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.77263.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57914.log 2024-03-16T07:43:22.125 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.77263.log.gz 2024-03-16T07:43:22.125 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.61843.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72342.log 2024-03-16T07:43:22.125 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61843.log.gz 2024-03-16T07:43:22.125 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.57914.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51839.log 2024-03-16T07:43:22.126 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57914.log.gz 2024-03-16T07:43:22.126 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.72342.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77053.log 2024-03-16T07:43:22.126 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72342.log.gz 2024-03-16T07:43:22.126 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.51839.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74028.log 2024-03-16T07:43:22.126 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51839.log.gz 2024-03-16T07:43:22.126 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.77053.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68172.log 2024-03-16T07:43:22.126 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.77053.log.gz 2024-03-16T07:43:22.127 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.74028.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88562.log 2024-03-16T07:43:22.127 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74028.log.gz 2024-03-16T07:43:22.127 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.68172.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53571.log 2024-03-16T07:43:22.127 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68172.log.gz 2024-03-16T07:43:22.127 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.88562.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62637.log 2024-03-16T07:43:22.127 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.88562.log.gz 2024-03-16T07:43:22.127 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.53571.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47703.log 2024-03-16T07:43:22.127 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53571.log.gz 2024-03-16T07:43:22.127 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.62637.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68485.log 2024-03-16T07:43:22.128 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62637.log.gz 2024-03-16T07:43:22.128 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.47703.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68256.log 2024-03-16T07:43:22.128 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47703.log.gz 2024-03-16T07:43:22.128 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.68485.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49955.log 2024-03-16T07:43:22.128 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68485.log.gz 2024-03-16T07:43:22.128 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.68256.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69950.log 2024-03-16T07:43:22.128 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68256.log.gz 2024-03-16T07:43:22.128 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.49955.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56747.log 2024-03-16T07:43:22.129 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49955.log.gz 2024-03-16T07:43:22.129 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.69950.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58393.log 2024-03-16T07:43:22.129 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69950.log.gz 2024-03-16T07:43:22.129 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.56747.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61230.log 2024-03-16T07:43:22.129 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56747.log.gz 2024-03-16T07:43:22.129 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.58393.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71053.log 2024-03-16T07:43:22.129 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58393.log.gz 2024-03-16T07:43:22.129 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.61230.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49045.log 2024-03-16T07:43:22.130 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61230.log.gz 2024-03-16T07:43:22.130 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.71053.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57041.log 2024-03-16T07:43:22.130 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71053.log.gz 2024-03-16T07:43:22.130 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.49045.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63784.log 2024-03-16T07:43:22.130 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49045.log.gz 2024-03-16T07:43:22.130 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.57041.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63528.log 2024-03-16T07:43:22.130 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57041.log.gz 2024-03-16T07:43:22.130 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.63784.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69321.log 2024-03-16T07:43:22.131 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63784.log.gz 2024-03-16T07:43:22.131 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.63528.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39626.log 2024-03-16T07:43:22.131 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63528.log.gz 2024-03-16T07:43:22.131 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48961.log 2024-03-16T07:43:22.131 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.69321.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69321.log.gz 2024-03-16T07:43:22.131 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.39626.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61314.log 2024-03-16T07:43:22.131 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39626.log.gz 2024-03-16T07:43:22.131 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.48961.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39226.log 2024-03-16T07:43:22.132 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48961.log.gz 2024-03-16T07:43:22.132 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.61314.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90392.log 2024-03-16T07:43:22.132 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61314.log.gz 2024-03-16T07:43:22.132 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.39226.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49776.log 2024-03-16T07:43:22.132 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39226.log.gz 2024-03-16T07:43:22.132 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.90392.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89701.log 2024-03-16T07:43:22.132 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.90392.log.gz 2024-03-16T07:43:22.132 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.49776.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48858.log 2024-03-16T07:43:22.132 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49776.log.gz 2024-03-16T07:43:22.133 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.89701.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69409.log 2024-03-16T07:43:22.133 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.89701.log.gz 2024-03-16T07:43:22.133 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.48858.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44530.log 2024-03-16T07:43:22.133 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48858.log.gz 2024-03-16T07:43:22.133 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.69409.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69365.log 2024-03-16T07:43:22.133 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69409.log.gz 2024-03-16T07:43:22.133 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.44530.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87861.log 2024-03-16T07:43:22.133 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44530.log.gz 2024-03-16T07:43:22.134 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.69365.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82986.log 2024-03-16T07:43:22.134 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69365.log.gz 2024-03-16T07:43:22.134 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.87861.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48512.log 2024-03-16T07:43:22.134 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.87861.log.gz 2024-03-16T07:43:22.134 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.82986.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83907.log 2024-03-16T07:43:22.134 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.82986.log.gz 2024-03-16T07:43:22.134 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.48512.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90705.log 2024-03-16T07:43:22.134 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48512.log.gz 2024-03-16T07:43:22.135 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57186.log 2024-03-16T07:43:22.135 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.83907.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.83907.log.gz 2024-03-16T07:43:22.135 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.90705.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68569.log 2024-03-16T07:43:22.135 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.90705.log.gz 2024-03-16T07:43:22.135 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.57186.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58267.log 2024-03-16T07:43:22.135 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57186.log.gz 2024-03-16T07:43:22.135 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.68569.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79624.log 2024-03-16T07:43:22.135 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68569.log.gz 2024-03-16T07:43:22.135 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.58267.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49003.log 2024-03-16T07:43:22.136 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58267.log.gz 2024-03-16T07:43:22.136 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.79624.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70867.log 2024-03-16T07:43:22.136 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.79624.log.gz 2024-03-16T07:43:22.136 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.49003.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50394.log 2024-03-16T07:43:22.136 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49003.log.gz 2024-03-16T07:43:22.136 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.70867.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63700.log 2024-03-16T07:43:22.136 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70867.log.gz 2024-03-16T07:43:22.136 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.50394.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64012.log 2024-03-16T07:43:22.136 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50394.log.gz 2024-03-16T07:43:22.137 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.63700.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49871.log 2024-03-16T07:43:22.137 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63700.log.gz 2024-03-16T07:43:22.137 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.64012.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66553.log 2024-03-16T07:43:22.137 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64012.log.gz 2024-03-16T07:43:22.137 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.49871.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42637.log 2024-03-16T07:43:22.137 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49871.log.gz 2024-03-16T07:43:22.137 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.66553.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77221.log 2024-03-16T07:43:22.137 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66553.log.gz 2024-03-16T07:43:22.138 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.42637.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73818.log 2024-03-16T07:43:22.138 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42637.log.gz 2024-03-16T07:43:22.138 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.77221.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49657.log 2024-03-16T07:43:22.138 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.77221.log.gz 2024-03-16T07:43:22.138 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78504.log 2024-03-16T07:43:22.138 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.73818.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.73818.log.gz 2024-03-16T07:43:22.138 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.49657.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43619.log 2024-03-16T07:43:22.138 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49657.log.gz 2024-03-16T07:43:22.139 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.78504.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43941.log 2024-03-16T07:43:22.139 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.78504.log.gz 2024-03-16T07:43:22.139 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.43619.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51169.log 2024-03-16T07:43:22.139 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43619.log.gz 2024-03-16T07:43:22.139 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.43941.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83507.log 2024-03-16T07:43:22.139 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43941.log.gz 2024-03-16T07:43:22.139 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.51169.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80502.log 2024-03-16T07:43:22.139 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51169.log.gz 2024-03-16T07:43:22.140 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.83507.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90476.log 2024-03-16T07:43:22.140 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.83507.log.gz 2024-03-16T07:43:22.140 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.80502.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55545.log 2024-03-16T07:43:22.140 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.80502.log.gz 2024-03-16T07:43:22.140 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.90476.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86273.log 2024-03-16T07:43:22.140 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.90476.log.gz 2024-03-16T07:43:22.140 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.55545.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45576.log 2024-03-16T07:43:22.141 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55545.log.gz 2024-03-16T07:43:22.141 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.86273.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62468.log 2024-03-16T07:43:22.141 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.86273.log.gz 2024-03-16T07:43:22.141 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.45576.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48570.log 2024-03-16T07:43:22.141 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45576.log.gz 2024-03-16T07:43:22.141 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.62468.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44572.log 2024-03-16T07:43:22.141 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62468.log.gz 2024-03-16T07:43:22.141 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.48570.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45971.log 2024-03-16T07:43:22.141 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48570.log.gz 2024-03-16T07:43:22.142 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.44572.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39416.log 2024-03-16T07:43:22.142 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44572.log.gz 2024-03-16T07:43:22.142 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.45971.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91141.log 2024-03-16T07:43:22.142 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45971.log.gz 2024-03-16T07:43:22.142 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.39416.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57101.log 2024-03-16T07:43:22.142 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39416.log.gz 2024-03-16T07:43:22.142 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.91141.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68779.log 2024-03-16T07:43:22.143 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.91141.log.gz 2024-03-16T07:43:22.143 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.57101.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55230.log 2024-03-16T07:43:22.143 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57101.log.gz 2024-03-16T07:43:22.143 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.68779.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43372.log 2024-03-16T07:43:22.143 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68779.log.gz 2024-03-16T07:43:22.143 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.55230.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91225.log 2024-03-16T07:43:22.143 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55230.log.gz 2024-03-16T07:43:22.143 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.43372.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58137.log 2024-03-16T07:43:22.143 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43372.log.gz 2024-03-16T07:43:22.144 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.91225.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.91225.log.gz 2024-03-16T07:43:22.144 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73547.log 2024-03-16T07:43:22.144 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.58137.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57533.log 2024-03-16T07:43:22.144 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58137.log.gz 2024-03-16T07:43:22.144 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.73547.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42411.log 2024-03-16T07:43:22.144 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.73547.log.gz 2024-03-16T07:43:22.144 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.57533.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73902.log 2024-03-16T07:43:22.144 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57533.log.gz 2024-03-16T07:43:22.144 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.42411.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73505.log 2024-03-16T07:43:22.145 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42411.log.gz 2024-03-16T07:43:22.145 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.73902.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50039.log 2024-03-16T07:43:22.145 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.73902.log.gz 2024-03-16T07:43:22.145 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.73505.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86655.log 2024-03-16T07:43:22.145 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.73505.log.gz 2024-03-16T07:43:22.145 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.50039.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74986.log 2024-03-16T07:43:22.145 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50039.log.gz 2024-03-16T07:43:22.145 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.86655.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63435.log 2024-03-16T07:43:22.146 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.86655.log.gz 2024-03-16T07:43:22.146 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.74986.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-03-16T07:43:22.146 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74986.log.gz 2024-03-16T07:43:22.146 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.63435.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59935.log 2024-03-16T07:43:22.146 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63435.log.gz 2024-03-16T07:43:22.146 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62072.log 2024-03-16T07:43:22.146 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.59935.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44362.log 2024-03-16T07:43:22.146 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59935.log.gz 2024-03-16T07:43:22.147 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.62072.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62072.log.gz 2024-03-16T07:43:22.147 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67631.log 2024-03-16T07:43:22.147 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.44362.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-03-16T07:43:22.147 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44362.log.gz 2024-03-16T07:43:22.147 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.67631.log: gzip -5 0.0% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.67631.log.gz 2024-03-16T07:43:22.147 INFO:teuthology.orchestra.run.smithi049.stderr: /var/log/ceph/ceph-client.admin.85920.log 2024-03-16T07:43:22.147 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74944.log 2024-03-16T07:43:22.147 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.85920.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.85920.log.gz 2024-03-16T07:43:22.148 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72913.log 2024-03-16T07:43:22.148 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44142.log 2024-03-16T07:43:22.148 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.74944.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74944.log.gz 2024-03-16T07:43:22.148 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.72913.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45236.log 2024-03-16T07:43:22.148 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72913.log.gz 2024-03-16T07:43:22.148 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.44142.log: gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.53796.log -- replaced with /var/log/ceph/ceph-client.admin.44142.log.gz 2024-03-16T07:43:22.148 INFO:teuthology.orchestra.run.smithi049.stderr: 2024-03-16T07:43:22.148 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68004.log 2024-03-16T07:43:22.148 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.45236.log: 88.7% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-03-16T07:43:22.149 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45236.log.gz 2024-03-16T07:43:22.149 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.53796.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82860.log 2024-03-16T07:43:22.149 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53796.log.gz 2024-03-16T07:43:22.149 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.68004.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76116.log 2024-03-16T07:43:22.149 INFO:teuthology.orchestra.run.smithi049.stderr: 89.1% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-03-16T07:43:22.149 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68004.log.gz 2024-03-16T07:43:22.149 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.82860.log: gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.79200.log 2024-03-16T07:43:22.149 INFO:teuthology.orchestra.run.smithi049.stderr: -- replaced with /var/log/ceph/ceph-client.admin.82860.log.gz 2024-03-16T07:43:22.150 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.76116.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72300.log 2024-03-16T07:43:22.150 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.76116.log.gz 2024-03-16T07:43:22.150 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83381.log 2024-03-16T07:43:22.150 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.79200.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.79200.log.gz 2024-03-16T07:43:22.150 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.72300.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72300.log.gz 2024-03-16T07:43:22.150 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73253.log 2024-03-16T07:43:22.150 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.83381.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89045.log 2024-03-16T07:43:22.151 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.83381.log.gz 2024-03-16T07:43:22.151 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.73253.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81444.log 2024-03-16T07:43:22.151 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.73253.log.gz 2024-03-16T07:43:22.151 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.89045.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39749.log 2024-03-16T07:43:22.151 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.89045.log.gz 2024-03-16T07:43:22.151 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.81444.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.41469.log 2024-03-16T07:43:22.151 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.81444.log.gz 2024-03-16T07:43:22.151 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.39749.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71491.log 2024-03-16T07:43:22.151 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39749.log.gz 2024-03-16T07:43:22.152 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.0.41469.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71097.log 2024-03-16T07:43:22.152 INFO:teuthology.orchestra.run.smithi049.stderr: 33.7% -- replaced with /var/log/ceph/ceph-client.0.41469.log.gz 2024-03-16T07:43:22.152 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.71491.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.71491.log.gz 2024-03-16T07:43:22.152 INFO:teuthology.orchestra.run.smithi049.stderr: --verbose -- /var/log/ceph/ceph-client.admin.73337.log 2024-03-16T07:43:22.152 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.71097.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64054.log 2024-03-16T07:43:22.152 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71097.log.gz 2024-03-16T07:43:22.152 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.73337.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71011.log 2024-03-16T07:43:22.152 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.73337.log.gz 2024-03-16T07:43:22.153 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.64054.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74070.log 2024-03-16T07:43:22.153 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64054.log.gz 2024-03-16T07:43:22.153 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.71011.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56266.log 2024-03-16T07:43:22.153 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71011.log.gz 2024-03-16T07:43:22.153 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.74070.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81625.log 2024-03-16T07:43:22.153 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74070.log.gz 2024-03-16T07:43:22.153 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.56266.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74317.log 2024-03-16T07:43:22.153 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56266.log.gz 2024-03-16T07:43:22.153 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.81625.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83781.log 2024-03-16T07:43:22.154 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.81625.log.gz 2024-03-16T07:43:22.154 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.74317.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60586.log 2024-03-16T07:43:22.154 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74317.log.gz 2024-03-16T07:43:22.154 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.83781.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.83781.log.gz 2024-03-16T07:43:22.154 INFO:teuthology.orchestra.run.smithi049.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.68046.log 2024-03-16T07:43:22.154 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.60586.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90014.log 2024-03-16T07:43:22.154 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60586.log.gz 2024-03-16T07:43:22.154 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.68046.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60502.log 2024-03-16T07:43:22.155 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68046.log.gz 2024-03-16T07:43:22.155 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.90014.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77767.log 2024-03-16T07:43:22.155 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.90014.log.gz 2024-03-16T07:43:22.155 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.60502.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74215.log 2024-03-16T07:43:22.155 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60502.log.gz 2024-03-16T07:43:22.155 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.77767.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83991.log 2024-03-16T07:43:22.155 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.77767.log.gz 2024-03-16T07:43:22.155 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.74215.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39045.log 2024-03-16T07:43:22.156 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74215.log.gz 2024-03-16T07:43:22.156 INFO:teuthology.orchestra.run.smithi049.stderr:gzip/var/log/ceph/ceph-client.admin.83991.log: -5 --verbose -- /var/log/ceph/ceph-client.1.84869.log 2024-03-16T07:43:22.156 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.83991.log.gz 2024-03-16T07:43:22.156 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.39045.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55842.log 2024-03-16T07:43:22.156 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39045.log.gz 2024-03-16T07:43:22.156 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.1.84869.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38988.log 2024-03-16T07:43:22.156 INFO:teuthology.orchestra.run.smithi049.stderr: 33.7% -- replaced with /var/log/ceph/ceph-client.1.84869.log.gz 2024-03-16T07:43:22.156 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.55842.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83865.log 2024-03-16T07:43:22.157 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55842.log.gz 2024-03-16T07:43:22.157 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.38988.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47352.log 2024-03-16T07:43:22.157 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38988.log.gz 2024-03-16T07:43:22.157 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.83865.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78901.log 2024-03-16T07:43:22.157 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.83865.log.gz 2024-03-16T07:43:22.157 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.47352.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55146.log 2024-03-16T07:43:22.157 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47352.log.gz 2024-03-16T07:43:22.157 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.78901.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43234.log 2024-03-16T07:43:22.158 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.78901.log.gz 2024-03-16T07:43:22.158 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.55146.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58042.log 2024-03-16T07:43:22.158 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55146.log.gz 2024-03-16T07:43:22.158 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.43234.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52442.log 2024-03-16T07:43:22.158 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43234.log.gz 2024-03-16T07:43:22.158 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.58042.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53708.log 2024-03-16T07:43:22.158 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58042.log.gz 2024-03-16T07:43:22.158 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.52442.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68214.log 2024-03-16T07:43:22.159 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52442.log.gz 2024-03-16T07:43:22.159 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.53708.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62511.log 2024-03-16T07:43:22.159 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53708.log.gz 2024-03-16T07:43:22.159 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.68214.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75699.log 2024-03-16T07:43:22.159 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68214.log.gz 2024-03-16T07:43:22.159 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.62511.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90266.log 2024-03-16T07:43:22.159 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62511.log.gz 2024-03-16T07:43:22.159 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.75699.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64162.log 2024-03-16T07:43:22.160 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.75699.log.gz 2024-03-16T07:43:22.160 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.90266.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87609.log 2024-03-16T07:43:22.160 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.90266.log.gz 2024-03-16T07:43:22.160 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.64162.log: gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.47661.log -- replaced with /var/log/ceph/ceph-client.admin.64162.log.gz 2024-03-16T07:43:22.160 INFO:teuthology.orchestra.run.smithi049.stderr: 2024-03-16T07:43:22.160 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.87609.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68874.log 2024-03-16T07:43:22.160 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.87609.log.gz 2024-03-16T07:43:22.160 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.47661.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47038.log 2024-03-16T07:43:22.161 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47661.log.gz 2024-03-16T07:43:22.161 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.68874.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58519.log 2024-03-16T07:43:22.161 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68874.log.gz 2024-03-16T07:43:22.161 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.47038.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38537.log 2024-03-16T07:43:22.161 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47038.log.gz 2024-03-16T07:43:22.161 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.58519.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69716.log 2024-03-16T07:43:22.161 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58519.log.gz 2024-03-16T07:43:22.161 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.38537.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48744.log 2024-03-16T07:43:22.162 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38537.log.gz 2024-03-16T07:43:22.162 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.69716.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63221.log 2024-03-16T07:43:22.162 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69716.log.gz 2024-03-16T07:43:22.162 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.48744.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59981.log 2024-03-16T07:43:22.162 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48744.log.gz 2024-03-16T07:43:22.162 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.63221.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56663.log 2024-03-16T07:43:22.162 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63221.log.gz 2024-03-16T07:43:22.162 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.59981.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51001.log 2024-03-16T07:43:22.163 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59981.log.gz 2024-03-16T07:43:22.163 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.56663.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90308.log 2024-03-16T07:43:22.163 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56663.log.gz 2024-03-16T07:43:22.163 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.51001.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58435.log 2024-03-16T07:43:22.163 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51001.log.gz 2024-03-16T07:43:22.163 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.90308.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64995.log 2024-03-16T07:43:22.163 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.90308.log.gz 2024-03-16T07:43:22.163 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52036.log 2024-03-16T07:43:22.164 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.58435.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58435.log.gz 2024-03-16T07:43:22.164 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.64995.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35193.log 2024-03-16T07:43:22.164 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64995.log.gz 2024-03-16T07:43:22.164 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.52036.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45534.log 2024-03-16T07:43:22.164 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52036.log.gz 2024-03-16T07:43:22.164 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.35193.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66231.log 2024-03-16T07:43:22.164 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35193.log.gz 2024-03-16T07:43:22.164 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.45534.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67421.log 2024-03-16T07:43:22.164 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45534.log.gz 2024-03-16T07:43:22.165 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.66231.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91493.log 2024-03-16T07:43:22.165 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66231.log.gz 2024-03-16T07:43:22.165 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.67421.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45620.log 2024-03-16T07:43:22.165 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67421.log.gz 2024-03-16T07:43:22.165 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.91493.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83722.log 2024-03-16T07:43:22.165 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.91493.log.gz 2024-03-16T07:43:22.165 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.45620.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77305.log 2024-03-16T07:43:22.165 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45620.log.gz 2024-03-16T07:43:22.166 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.83722.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89785.log 2024-03-16T07:43:22.166 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.83722.log.gz 2024-03-16T07:43:22.166 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.77305.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69195.log 2024-03-16T07:43:22.166 INFO:teuthology.orchestra.run.smithi049.stderr: 49.1% -- replaced with /var/log/ceph/ceph-client.admin.77305.log.gz 2024-03-16T07:43:22.166 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.89785.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.70628.log 2024-03-16T07:43:22.166 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.89785.log.gz 2024-03-16T07:43:22.166 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5/var/log/ceph/ceph-client.admin.69195.log: --verbose -- /var/log/ceph/ceph-client.admin.78850.log 2024-03-16T07:43:22.166 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69195.log.gz 2024-03-16T07:43:22.167 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.1.70628.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39584.log 2024-03-16T07:43:22.167 INFO:teuthology.orchestra.run.smithi049.stderr: 33.3% -- replaced with /var/log/ceph/ceph-client.1.70628.log.gz 2024-03-16T07:43:22.167 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.78850.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89473.log 2024-03-16T07:43:22.167 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.78850.log.gz 2024-03-16T07:43:22.167 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.39584.log: gzip -5 --verbose 0.0% -- -- replaced with /var/log/ceph/ceph-client.admin.39584.log.gz 2024-03-16T07:43:22.167 INFO:teuthology.orchestra.run.smithi049.stderr: /var/log/ceph/ceph-client.admin.72258.log 2024-03-16T07:43:22.167 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.89473.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56056.log 2024-03-16T07:43:22.167 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.89473.log.gz 2024-03-16T07:43:22.167 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.72258.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69153.log 2024-03-16T07:43:22.168 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72258.log.gz 2024-03-16T07:43:22.168 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.56056.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52376.log 2024-03-16T07:43:22.168 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56056.log.gz 2024-03-16T07:43:22.168 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.64839.log 2024-03-16T07:43:22.168 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.69153.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69153.log.gz 2024-03-16T07:43:22.168 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.52376.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61664.log 2024-03-16T07:43:22.168 INFO:teuthology.orchestra.run.smithi049.stderr: 48.6% -- replaced with /var/log/ceph/ceph-client.admin.52376.log.gz 2024-03-16T07:43:22.168 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.1.64839.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44615.log 2024-03-16T07:43:22.168 INFO:teuthology.orchestra.run.smithi049.stderr: 32.9% -- replaced with /var/log/ceph/ceph-client.1.64839.log.gz 2024-03-16T07:43:22.169 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.61664.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45408.log 2024-03-16T07:43:22.169 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61664.log.gz 2024-03-16T07:43:22.169 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.44615.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71192.log 2024-03-16T07:43:22.169 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44615.log.gz 2024-03-16T07:43:22.169 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.45408.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44877.log 2024-03-16T07:43:22.169 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45408.log.gz 2024-03-16T07:43:22.169 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.71192.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45324.log 2024-03-16T07:43:22.169 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71192.log.gz 2024-03-16T07:43:22.170 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.44877.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81254.log 2024-03-16T07:43:22.170 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44877.log.gz 2024-03-16T07:43:22.170 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.45324.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69012.log 2024-03-16T07:43:22.170 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45324.log.gz 2024-03-16T07:43:22.170 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.81254.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66952.log 2024-03-16T07:43:22.170 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.81254.log.gz 2024-03-16T07:43:22.170 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.69012.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82944.log 2024-03-16T07:43:22.170 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69012.log.gz 2024-03-16T07:43:22.171 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.66952.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50959.log 2024-03-16T07:43:22.171 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66952.log.gz 2024-03-16T07:43:22.171 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.82944.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49615.log 2024-03-16T07:43:22.171 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.82944.log.gz 2024-03-16T07:43:22.171 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.50959.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74485.log 2024-03-16T07:43:22.171 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50959.log.gz 2024-03-16T07:43:22.171 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.49615.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45845.log 2024-03-16T07:43:22.171 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49615.log.gz 2024-03-16T07:43:22.172 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.74485.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85754.log 2024-03-16T07:43:22.172 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74485.log.gz 2024-03-16T07:43:22.172 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.45845.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81170.log 2024-03-16T07:43:22.172 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45845.log.gz 2024-03-16T07:43:22.172 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.85754.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70783.log 2024-03-16T07:43:22.172 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.85754.log.gz 2024-03-16T07:43:22.172 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.81170.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62679.log 2024-03-16T07:43:22.172 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.81170.log.gz 2024-03-16T07:43:22.173 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.70210.log 2024-03-16T07:43:22.173 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.70783.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70783.log.gz 2024-03-16T07:43:22.173 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.62679.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44006.log 2024-03-16T07:43:22.173 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62679.log.gz 2024-03-16T07:43:22.173 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.0.70210.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58561.log 2024-03-16T07:43:22.173 INFO:teuthology.orchestra.run.smithi049.stderr: 33.7% -- replaced with /var/log/ceph/ceph-client.0.70210.log.gz 2024-03-16T07:43:22.173 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.44006.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88604.log 2024-03-16T07:43:22.173 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44006.log.gz 2024-03-16T07:43:22.174 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.58561.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61622.log 2024-03-16T07:43:22.174 INFO:teuthology.orchestra.run.smithi049.stderr: 48.6% -- replaced with /var/log/ceph/ceph-client.admin.58561.log.gz 2024-03-16T07:43:22.174 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.88604.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.46882.log 2024-03-16T07:43:22.174 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.88604.log.gz 2024-03-16T07:43:22.174 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.61622.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71641.log 2024-03-16T07:43:22.174 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61622.log.gz 2024-03-16T07:43:22.174 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.1.46882.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81793.log 2024-03-16T07:43:22.174 INFO:teuthology.orchestra.run.smithi049.stderr: 34.1% -- replaced with /var/log/ceph/ceph-client.1.46882.log.gz 2024-03-16T07:43:22.175 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.71641.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71641.log.gz 2024-03-16T07:43:22.175 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71322.log 2024-03-16T07:43:22.175 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.81793.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44277.log 2024-03-16T07:43:22.175 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.81793.log.gz 2024-03-16T07:43:22.175 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.71322.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45757.log 2024-03-16T07:43:22.175 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71322.log.gz 2024-03-16T07:43:22.175 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.44277.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51043.log 2024-03-16T07:43:22.175 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44277.log.gz 2024-03-16T07:43:22.176 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.45757.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55398.log 2024-03-16T07:43:22.176 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45757.log.gz 2024-03-16T07:43:22.176 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.51043.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75209.log 2024-03-16T07:43:22.176 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51043.log.gz 2024-03-16T07:43:22.176 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.55398.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44404.log 2024-03-16T07:43:22.176 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55398.log.gz 2024-03-16T07:43:22.176 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.75209.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45799.log 2024-03-16T07:43:22.176 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.75209.log.gz 2024-03-16T07:43:22.177 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.44404.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75339.log 2024-03-16T07:43:22.177 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44404.log.gz 2024-03-16T07:43:22.177 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.45799.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71723.log 2024-03-16T07:43:22.177 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45799.log.gz 2024-03-16T07:43:22.177 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.75339.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45282.log 2024-03-16T07:43:22.177 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.75339.log.gz 2024-03-16T07:43:22.177 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.71723.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43189.log 2024-03-16T07:43:22.177 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71723.log.gz 2024-03-16T07:43:22.177 INFO:teuthology.orchestra.run.smithi049.stderr:gzip/var/log/ceph/ceph-client.admin.45282.log: -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-03-16T07:43:22.178 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45282.log.gz 2024-03-16T07:43:22.178 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.43189.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52082.log 2024-03-16T07:43:22.178 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43189.log.gz 2024-03-16T07:43:22.178 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39131.log 2024-03-16T07:43:22.178 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.52082.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47447.log 2024-03-16T07:43:22.178 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52082.log.gz 2024-03-16T07:43:22.178 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.39131.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39131.log.gz 2024-03-16T07:43:22.178 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73734.log 2024-03-16T07:43:22.179 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.47447.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54817.log 2024-03-16T07:43:22.179 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47447.log.gz 2024-03-16T07:43:22.179 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.73734.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.73734.log.gz 2024-03-16T07:43:22.179 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81579.log 2024-03-16T07:43:22.179 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.54817.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.58887.log 2024-03-16T07:43:22.179 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54817.log.gz 2024-03-16T07:43:22.179 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.81579.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.81579.log.gz 2024-03-16T07:43:22.179 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61027.log 2024-03-16T07:43:22.179 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.0.58887.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62763.log 2024-03-16T07:43:22.180 INFO:teuthology.orchestra.run.smithi049.stderr: 32.1% -- replaced with /var/log/ceph/ceph-client.0.58887.log.gz 2024-03-16T07:43:22.180 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.61027.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61027.log.gz 2024-03-16T07:43:22.180 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83423.log 2024-03-16T07:43:22.180 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.62763.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66721.log 2024-03-16T07:43:22.180 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62763.log.gz 2024-03-16T07:43:22.180 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.83423.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.83423.log.gz 2024-03-16T07:43:22.180 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62114.log 2024-03-16T07:43:22.180 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.66721.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47577.log 2024-03-16T07:43:22.180 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66721.log.gz 2024-03-16T07:43:22.181 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.62114.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62114.log.gz 2024-03-16T07:43:22.181 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47619.log 2024-03-16T07:43:22.181 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.47577.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54875.log 2024-03-16T07:43:22.181 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47577.log.gz 2024-03-16T07:43:22.181 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.47619.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47619.log.gz 2024-03-16T07:43:22.181 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45715.log 2024-03-16T07:43:22.181 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.54875.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73776.log 2024-03-16T07:43:22.181 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54875.log.gz 2024-03-16T07:43:22.181 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.45715.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45715.log.gz 2024-03-16T07:43:22.182 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90931.log 2024-03-16T07:43:22.182 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.73776.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60460.log 2024-03-16T07:43:22.182 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.73776.log.gz 2024-03-16T07:43:22.182 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.90931.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.90931.log.gz 2024-03-16T07:43:22.182 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58351.log 2024-03-16T07:43:22.182 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.60460.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67165.log 2024-03-16T07:43:22.182 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60460.log.gz 2024-03-16T07:43:22.182 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.58351.log: gzip 0.0% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.58351.log.gz 2024-03-16T07:43:22.183 INFO:teuthology.orchestra.run.smithi049.stderr: -- /var/log/ceph/ceph-client.admin.51669.log 2024-03-16T07:43:22.183 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.67165.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.mirror_remote.44767.log 2024-03-16T07:43:22.183 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67165.log.gz 2024-03-16T07:43:22.183 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.51669.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43847.log 2024-03-16T07:43:22.183 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51669.log.gz 2024-03-16T07:43:22.183 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.mirror_remote.44767.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56476.log 2024-03-16T07:43:22.183 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.mirror_remote.44767.log.gz 2024-03-16T07:43:22.183 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.43847.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.43847.log.gz --verbose 2024-03-16T07:43:22.184 INFO:teuthology.orchestra.run.smithi049.stderr: -- /var/log/ceph/ceph-client.admin.63616.log 2024-03-16T07:43:22.184 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.56476.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50436.log 2024-03-16T07:43:22.184 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56476.log.gz 2024-03-16T07:43:22.184 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.63616.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61367.log 2024-03-16T07:43:22.184 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63616.log.gz 2024-03-16T07:43:22.184 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.50436.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89258.log 2024-03-16T07:43:22.184 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50436.log.gz 2024-03-16T07:43:22.184 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.61367.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39875.log 2024-03-16T07:43:22.184 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61367.log.gz 2024-03-16T07:43:22.185 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.89258.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81537.log 2024-03-16T07:43:22.185 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.89258.log.gz 2024-03-16T07:43:22.185 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.39875.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39875.log.gz 2024-03-16T07:43:22.185 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54048.log 2024-03-16T07:43:22.185 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.81537.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69800.log 2024-03-16T07:43:22.185 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.81537.log.gz 2024-03-16T07:43:22.185 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.54048.log: 49.5% -- replaced with /var/log/ceph/ceph-client.admin.54048.log.gz 2024-03-16T07:43:22.185 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61069.log 2024-03-16T07:43:22.185 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59502.log 2024-03-16T07:43:22.186 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.69800.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69800.log.gz 2024-03-16T07:43:22.186 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5/var/log/ceph/ceph-client.admin.61069.log: --verbose -- /var/log/ceph/ceph.tmp-client.admin.31188.log 2024-03-16T07:43:22.186 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61069.log.gz 2024-03-16T07:43:22.186 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.59502.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71407.log 2024-03-16T07:43:22.186 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59502.log.gz 2024-03-16T07:43:22.186 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph.tmp-client.admin.31188.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40718.log 2024-03-16T07:43:22.186 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.31188.log.gz 2024-03-16T07:43:22.186 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.71407.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43895.log 2024-03-16T07:43:22.187 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71407.log.gz 2024-03-16T07:43:22.187 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.40718.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65642.log 2024-03-16T07:43:22.187 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40718.log.gz 2024-03-16T07:43:22.187 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.43895.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78945.log 2024-03-16T07:43:22.187 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43895.log.gz 2024-03-16T07:43:22.187 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.65642.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42859.log 2024-03-16T07:43:22.187 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65642.log.gz 2024-03-16T07:43:22.187 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.78945.log: gzip -5 --verbose 0.0% -- -- replaced with /var/log/ceph/ceph-client.admin.78945.log.gz 2024-03-16T07:43:22.187 INFO:teuthology.orchestra.run.smithi049.stderr: /var/log/ceph/ceph-client.admin.63037.log 2024-03-16T07:43:22.188 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.42859.log: gzip -5 --verbose 0.0% -- -- replaced with /var/log/ceph/ceph-client.admin.42859.log.gz /var/log/ceph/ceph-client.admin.91351.log 2024-03-16T07:43:22.188 INFO:teuthology.orchestra.run.smithi049.stderr: 2024-03-16T07:43:22.188 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.63037.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65247.log 2024-03-16T07:43:22.188 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63037.log.gz 2024-03-16T07:43:22.188 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.91351.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35332.log 2024-03-16T07:43:22.188 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.91351.log.gz 2024-03-16T07:43:22.188 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.65247.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65247.log.gz 2024-03-16T07:43:22.188 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90621.log 2024-03-16T07:43:22.189 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.35332.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.35332.log.gz --verbose 2024-03-16T07:43:22.189 INFO:teuthology.orchestra.run.smithi049.stderr: -- /var/log/ceph/ceph-client.admin.39087.log 2024-03-16T07:43:22.189 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.90621.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.90621.log.gz 2024-03-16T07:43:22.189 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43328.log 2024-03-16T07:43:22.189 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.39087.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47745.log 2024-03-16T07:43:22.189 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39087.log.gz 2024-03-16T07:43:22.189 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.43328.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43328.log.gz 2024-03-16T07:43:22.189 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43035.log 2024-03-16T07:43:22.190 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.47745.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65834.log 2024-03-16T07:43:22.190 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47745.log.gz 2024-03-16T07:43:22.190 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.43035.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78630.log 2024-03-16T07:43:22.190 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43035.log.gz 2024-03-16T07:43:22.190 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54760.log 2024-03-16T07:43:22.190 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.65834.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65834.log.gz 2024-03-16T07:43:22.190 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.78630.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63263.log 2024-03-16T07:43:22.190 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.78630.log.gz 2024-03-16T07:43:22.191 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45450.log 2024-03-16T07:43:22.191 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.54760.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54760.log.gz 2024-03-16T07:43:22.191 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.63263.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63263.log.gz 2024-03-16T07:43:22.191 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66511.log 2024-03-16T07:43:22.191 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.45450.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90579.log 2024-03-16T07:43:22.191 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45450.log.gz 2024-03-16T07:43:22.191 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.66511.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89003.log 2024-03-16T07:43:22.191 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66511.log.gz 2024-03-16T07:43:22.192 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.90579.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79540.log 2024-03-16T07:43:22.192 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.90579.log.gz 2024-03-16T07:43:22.192 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.89003.log: gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.56182.log -- replaced with /var/log/ceph/ceph-client.admin.89003.log.gz 2024-03-16T07:43:22.192 INFO:teuthology.orchestra.run.smithi049.stderr: 2024-03-16T07:43:22.192 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.79540.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58179.log 2024-03-16T07:43:22.192 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.79540.log.gz 2024-03-16T07:43:22.192 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.56182.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42200.log 2024-03-16T07:43:22.192 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56182.log.gz 2024-03-16T07:43:22.193 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.58179.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58179.log.gz 2024-03-16T07:43:22.193 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83339.log 2024-03-16T07:43:22.193 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.42200.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80712.log 2024-03-16T07:43:22.193 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42200.log.gz 2024-03-16T07:43:22.193 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.83339.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.83339.log.gz 2024-03-16T07:43:22.193 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68737.log 2024-03-16T07:43:22.193 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.80712.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63305.log 2024-03-16T07:43:22.193 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.80712.log.gz 2024-03-16T07:43:22.194 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.68737.log: gzip -5 0.0% --verbose -- replaced with /var/log/ceph/ceph-client.admin.68737.log.gz -- 2024-03-16T07:43:22.194 INFO:teuthology.orchestra.run.smithi049.stderr: /var/log/ceph/ceph-client.admin.44488.log 2024-03-16T07:43:22.194 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.63305.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56536.log 2024-03-16T07:43:22.194 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63305.log.gz 2024-03-16T07:43:22.194 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.44488.log: gzip -5 --verbose 0.0% -- -- replaced with /var/log/ceph/ceph-client.admin.44488.log.gz /var/log/ceph/ceph-client.admin.67757.log 2024-03-16T07:43:22.194 INFO:teuthology.orchestra.run.smithi049.stderr: 2024-03-16T07:43:22.194 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.56536.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48324.log 2024-03-16T07:43:22.194 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56536.log.gz 2024-03-16T07:43:22.195 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.67757.log: gzip -5 --verbose 0.0% -- -- replaced with /var/log/ceph/ceph-client.admin.67757.log.gz 2024-03-16T07:43:22.195 INFO:teuthology.orchestra.run.smithi049.stderr: /var/log/ceph/ceph-client.admin.49171.log 2024-03-16T07:43:22.195 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.48324.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79937.log 2024-03-16T07:43:22.195 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48324.log.gz 2024-03-16T07:43:22.195 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.49171.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.49171.log.gz 2024-03-16T07:43:22.195 INFO:teuthology.orchestra.run.smithi049.stderr: --verbose -- /var/log/ceph/ceph-client.admin.56789.log 2024-03-16T07:43:22.195 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.79937.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73211.log 2024-03-16T07:43:22.195 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.79937.log.gz 2024-03-16T07:43:22.196 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.56789.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.56789.log.gz --verbose 2024-03-16T07:43:22.196 INFO:teuthology.orchestra.run.smithi049.stderr: -- /var/log/ceph/ceph-client.admin.49913.log 2024-03-16T07:43:22.196 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59586.log 2024-03-16T07:43:22.196 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.73211.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.73211.log.gz 2024-03-16T07:43:22.196 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.49913.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40676.log 2024-03-16T07:43:22.196 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49913.log.gz 2024-03-16T07:43:22.196 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.59586.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67379.log 2024-03-16T07:43:22.196 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59586.log.gz 2024-03-16T07:43:22.197 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.40676.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.40676.log.gz 2024-03-16T07:43:22.197 INFO:teuthology.orchestra.run.smithi049.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.65916.log 2024-03-16T07:43:22.197 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.67379.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40592.log 2024-03-16T07:43:22.197 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67379.log.gz 2024-03-16T07:43:22.197 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.65916.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73074.log 0.0% 2024-03-16T07:43:22.197 INFO:teuthology.orchestra.run.smithi049.stderr: -- replaced with /var/log/ceph/ceph-client.admin.65916.log.gz 2024-03-16T07:43:22.197 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.40592.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43754.log 2024-03-16T07:43:22.197 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40592.log.gz 2024-03-16T07:43:22.197 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.73074.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.73074.log.gz 2024-03-16T07:43:22.198 INFO:teuthology.orchestra.run.smithi049.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.67817.log 2024-03-16T07:43:22.198 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.43754.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56434.log 2024-03-16T07:43:22.198 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43754.log.gz 2024-03-16T07:43:22.198 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.67817.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67817.log.gz -5 2024-03-16T07:43:22.198 INFO:teuthology.orchestra.run.smithi049.stderr: --verbose -- /var/log/ceph/ceph-client.1.76378.log 2024-03-16T07:43:22.198 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.56434.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68653.log 2024-03-16T07:43:22.198 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56434.log.gz 2024-03-16T07:43:22.198 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.1.76378.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45194.log 2024-03-16T07:43:22.199 INFO:teuthology.orchestra.run.smithi049.stderr: 32.9% -- replaced with /var/log/ceph/ceph-client.1.76378.log.gz 2024-03-16T07:43:22.199 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.68653.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51952.log 2024-03-16T07:43:22.199 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68653.log.gz 2024-03-16T07:43:22.199 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.45194.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45194.log.gz 2024-03-16T07:43:22.199 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55629.log 2024-03-16T07:43:22.199 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.51952.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80147.log 2024-03-16T07:43:22.199 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51952.log.gz 2024-03-16T07:43:22.199 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.55629.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.55629.log.gz --verbose 2024-03-16T07:43:22.200 INFO:teuthology.orchestra.run.smithi049.stderr: -- /var/log/ceph/ceph-client.admin.43525.log 2024-03-16T07:43:22.200 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.80147.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78401.log 2024-03-16T07:43:22.200 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.80147.log.gz 2024-03-16T07:43:22.200 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.43525.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43525.log.gz 2024-03-16T07:43:22.200 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88458.log 2024-03-16T07:43:22.200 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.78401.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72019.log 2024-03-16T07:43:22.200 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.78401.log.gz 2024-03-16T07:43:22.200 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.88458.log: gzip -5 0.0% --verbose -- replaced with /var/log/ceph/ceph-client.admin.88458.log.gz 2024-03-16T07:43:22.200 INFO:teuthology.orchestra.run.smithi049.stderr: -- /var/log/ceph/ceph-client.admin.54645.log 2024-03-16T07:43:22.201 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.72019.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69460.log 2024-03-16T07:43:22.201 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72019.log.gz 2024-03-16T07:43:22.201 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.54645.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58309.log 2024-03-16T07:43:22.201 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54645.log.gz 2024-03-16T07:43:22.201 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.69460.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59670.log 2024-03-16T07:43:22.201 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69460.log.gz 2024-03-16T07:43:22.201 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.58309.log: gzip -5 --verbose 0.0% -- -- replaced with /var/log/ceph/ceph-client.admin.58309.log.gz /var/log/ceph/ceph-client.admin.62240.log 2024-03-16T07:43:22.201 INFO:teuthology.orchestra.run.smithi049.stderr: 2024-03-16T07:43:22.202 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.59670.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44052.log 2024-03-16T07:43:22.202 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59670.log.gz 2024-03-16T07:43:22.202 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.62240.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62240.log.gz -5 2024-03-16T07:43:22.202 INFO:teuthology.orchestra.run.smithi049.stderr: --verbose -- /var/log/ceph/ceph-client.admin.79372.log 2024-03-16T07:43:22.202 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.44052.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39962.log 2024-03-16T07:43:22.202 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44052.log.gz 2024-03-16T07:43:22.202 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.79372.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.79372.log.gz 2024-03-16T07:43:22.202 INFO:teuthology.orchestra.run.smithi049.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.52250.log 2024-03-16T07:43:22.203 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.39962.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61409.log 2024-03-16T07:43:22.203 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39962.log.gz 2024-03-16T07:43:22.203 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.52250.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.52250.log.gz --verbose 2024-03-16T07:43:22.203 INFO:teuthology.orchestra.run.smithi049.stderr: -- /var/log/ceph/ceph-client.admin.80357.log 2024-03-16T07:43:22.203 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.61409.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72426.log 2024-03-16T07:43:22.203 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61409.log.gz 2024-03-16T07:43:22.203 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.80357.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60023.log 0.0% 2024-03-16T07:43:22.203 INFO:teuthology.orchestra.run.smithi049.stderr: -- replaced with /var/log/ceph/ceph-client.admin.80357.log.gz 2024-03-16T07:43:22.203 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.72426.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84496.log 2024-03-16T07:43:22.204 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72426.log.gz 2024-03-16T07:43:22.204 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.60023.log: gzip -5 --verbose 0.0% -- -- replaced with /var/log/ceph/ceph-client.admin.60023.log.gz /var/log/ceph/ceph-client.admin.77137.log 2024-03-16T07:43:22.204 INFO:teuthology.orchestra.run.smithi049.stderr: 2024-03-16T07:43:22.204 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.84496.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65335.log 2024-03-16T07:43:22.204 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.84496.log.gz 2024-03-16T07:43:22.204 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.77137.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.77137.log.gz -5 2024-03-16T07:43:22.204 INFO:teuthology.orchestra.run.smithi049.stderr: --verbose -- /var/log/ceph/ceph-client.admin.83293.log 2024-03-16T07:43:22.204 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.65335.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69590.log 2024-03-16T07:43:22.204 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65335.log.gz 2024-03-16T07:43:22.205 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.83293.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.83293.log.gz 2024-03-16T07:43:22.205 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50123.log 2024-03-16T07:43:22.205 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.69590.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42901.log 2024-03-16T07:43:22.205 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69590.log.gz 2024-03-16T07:43:22.205 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.50123.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.50123.log.gz 2024-03-16T07:43:22.205 INFO:teuthology.orchestra.run.smithi049.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.60670.log 2024-03-16T07:43:22.205 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.42901.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72871.log 2024-03-16T07:43:22.205 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42901.log.gz 2024-03-16T07:43:22.205 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.60670.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.60670.log.gz 2024-03-16T07:43:22.206 INFO:teuthology.orchestra.run.smithi049.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.40128.log 2024-03-16T07:43:22.206 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.72871.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61509.log 2024-03-16T07:43:22.206 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72871.log.gz 2024-03-16T07:43:22.206 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.40128.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.40128.log.gz 2024-03-16T07:43:22.206 INFO:teuthology.orchestra.run.smithi049.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.80399.log 2024-03-16T07:43:22.206 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.61509.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64096.log 2024-03-16T07:43:22.206 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61509.log.gz 2024-03-16T07:43:22.206 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.80399.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.80399.log.gzgzip 2024-03-16T07:43:22.207 INFO:teuthology.orchestra.run.smithi049.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.45015.log 2024-03-16T07:43:22.207 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.64096.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73379.log 2024-03-16T07:43:22.207 INFO:teuthology.orchestra.run.smithi049.stderr: 48.6% -- replaced with /var/log/ceph/ceph-client.admin.64096.log.gz 2024-03-16T07:43:22.207 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.45015.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90973.log 2024-03-16T07:43:22.207 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45015.log.gz 2024-03-16T07:43:22.207 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.73379.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50478.log 2024-03-16T07:43:22.207 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.73379.log.gz 2024-03-16T07:43:22.207 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.90973.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.90973.log.gz 2024-03-16T07:43:22.208 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45492.log 2024-03-16T07:43:22.208 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.50478.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89300.log 2024-03-16T07:43:22.208 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50478.log.gz 2024-03-16T07:43:22.208 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.45492.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65291.log 0.0% 2024-03-16T07:43:22.208 INFO:teuthology.orchestra.run.smithi049.stderr: -- replaced with /var/log/ceph/ceph-client.admin.45492.log.gz 2024-03-16T07:43:22.208 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.89300.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90350.log 2024-03-16T07:43:22.208 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.89300.log.gz 2024-03-16T07:43:22.208 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.65291.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65291.log.gz 2024-03-16T07:43:22.208 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63570.log 2024-03-16T07:43:22.209 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.90350.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49699.log 2024-03-16T07:43:22.209 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.90350.log.gz 2024-03-16T07:43:22.209 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.63570.log: gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.57670.log -- replaced with /var/log/ceph/ceph-client.admin.63570.log.gz 2024-03-16T07:43:22.209 INFO:teuthology.orchestra.run.smithi049.stderr: 2024-03-16T07:43:22.209 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.49699.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46097.log 2024-03-16T07:43:22.209 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49699.log.gz 2024-03-16T07:43:22.209 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.57670.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57670.log.gz 2024-03-16T07:43:22.209 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74401.log 2024-03-16T07:43:22.210 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.46097.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66861.log 2024-03-16T07:43:22.210 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46097.log.gz 2024-03-16T07:43:22.210 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.74401.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.74401.log.gz --verbose 2024-03-16T07:43:22.210 INFO:teuthology.orchestra.run.smithi049.stderr: -- /var/log/ceph/ceph-client.admin.52166.log 2024-03-16T07:43:22.210 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.66861.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56831.log 2024-03-16T07:43:22.210 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66861.log.gz 2024-03-16T07:43:22.210 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.52166.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52166.log.gz 2024-03-16T07:43:22.210 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42817.log 2024-03-16T07:43:22.211 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.56831.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.mirror.44767.log 2024-03-16T07:43:22.211 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56831.log.gz 2024-03-16T07:43:22.211 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.42817.log: gzip -5 0.0% --verbose -- replaced with /var/log/ceph/ceph-client.admin.42817.log.gz 2024-03-16T07:43:22.211 INFO:teuthology.orchestra.run.smithi049.stderr: -- /var/log/ceph/ceph-client.admin.48012.log 2024-03-16T07:43:22.211 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.mirror.44767.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50646.log 2024-03-16T07:43:22.211 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.48012.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38690.log 2024-03-16T07:43:22.211 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48012.log.gz 2024-03-16T07:43:22.211 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.50646.log: gzip -5 0.0% --verbose -- replaced with /var/log/ceph/ceph-client.admin.50646.log.gz -- 2024-03-16T07:43:22.212 INFO:teuthology.orchestra.run.smithi049.stderr: /var/log/ceph/ceph-client.admin.81296.log 2024-03-16T07:43:22.212 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39542.log 2024-03-16T07:43:22.212 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.38690.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38690.log.gz 2024-03-16T07:43:22.212 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.81296.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80670.log 2024-03-16T07:43:22.212 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.81296.log.gz 2024-03-16T07:43:22.212 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.39542.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39542.log.gzgzip 2024-03-16T07:43:22.212 INFO:teuthology.orchestra.run.smithi049.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.56003.log 2024-03-16T07:43:22.212 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72468.log 2024-03-16T07:43:22.213 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.80670.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.80670.log.gz 2024-03-16T07:43:22.213 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.56003.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40298.log 2024-03-16T07:43:22.213 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56003.log.gz 2024-03-16T07:43:22.213 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.72468.log: gzip -5 --verbose 0.0% -- -- replaced with /var/log/ceph/ceph-client.admin.72468.log.gz /var/log/ceph/ceph-client.admin.62198.log 2024-03-16T07:43:22.213 INFO:teuthology.orchestra.run.smithi049.stderr: 2024-03-16T07:43:22.213 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52859.log 2024-03-16T07:43:22.213 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.40298.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40298.log.gz 2024-03-16T07:43:22.213 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.62198.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81919.log 2024-03-16T07:43:22.214 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62198.log.gz 2024-03-16T07:43:22.214 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.52859.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80273.log 2024-03-16T07:43:22.214 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52859.log.gz 2024-03-16T07:43:22.214 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77179.log 2024-03-16T07:43:22.214 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.81919.log: 48.1% -- replaced with /var/log/ceph/ceph-client.admin.81919.log.gz 2024-03-16T07:43:22.214 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.80273.log: /var/log/ceph/ceph-client.admin.40088.log 2024-03-16T07:43:22.214 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.80273.log.gz 2024-03-16T07:43:22.214 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.77179.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83949.log 2024-03-16T07:43:22.215 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.77179.log.gz 2024-03-16T07:43:22.215 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78756.log 2024-03-16T07:43:22.215 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.40088.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40088.log.gz 2024-03-16T07:43:22.215 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.83949.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81338.log 2024-03-16T07:43:22.215 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.83949.log.gz 2024-03-16T07:43:22.215 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.78756.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.78756.log.gz 2024-03-16T07:43:22.215 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68130.log 2024-03-16T07:43:22.215 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51627.log 2024-03-16T07:43:22.215 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.81338.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.81338.log.gz 2024-03-16T07:43:22.216 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.68130.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89659.log 2024-03-16T07:43:22.216 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68130.log.gz 2024-03-16T07:43:22.216 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.51627.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79116.log 2024-03-16T07:43:22.216 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51627.log.gz 2024-03-16T07:43:22.216 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57144.log 2024-03-16T07:43:22.216 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.89659.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.89659.log.gz 2024-03-16T07:43:22.216 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.79116.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77007.log 2024-03-16T07:43:22.216 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.79116.log.gz 2024-03-16T07:43:22.216 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.57144.log: gzip -5 --verbose 0.0% -- -- replaced with /var/log/ceph/ceph-client.admin.57144.log.gz 2024-03-16T07:43:22.217 INFO:teuthology.orchestra.run.smithi049.stderr: /var/log/ceph/ceph-client.admin.56098.log 2024-03-16T07:43:22.217 INFO:teuthology.orchestra.run.smithi049.stderr: 93.4% -- replaced with /var/log/ceph/ceph-client.mirror.44767.log.gz 2024-03-16T07:43:22.217 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50604.log 2024-03-16T07:43:22.217 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.77007.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.77007.log.gz 2024-03-16T07:43:22.217 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.56098.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89420.log 2024-03-16T07:43:22.217 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56098.log.gz 2024-03-16T07:43:22.217 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.50604.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42945.log 2024-03-16T07:43:22.217 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50604.log.gz 2024-03-16T07:43:22.218 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.89420.log: gzip -5 0.0% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.89420.log.gz 2024-03-16T07:43:22.218 INFO:teuthology.orchestra.run.smithi049.stderr: /var/log/ceph/ceph-client.admin.67673.log 2024-03-16T07:43:22.218 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.42945.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70367.log 2024-03-16T07:43:22.218 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42945.log.gz 2024-03-16T07:43:22.218 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.67673.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67673.log.gz -5 2024-03-16T07:43:22.218 INFO:teuthology.orchestra.run.smithi049.stderr: --verbose -- /var/log/ceph/ceph-client.admin.61706.log 2024-03-16T07:43:22.218 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.70367.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81835.log 2024-03-16T07:43:22.218 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70367.log.gz 2024-03-16T07:43:22.219 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.61706.log: gzip -5 0.0% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.61706.log.gz 2024-03-16T07:43:22.219 INFO:teuthology.orchestra.run.smithi049.stderr: /var/log/ceph/ceph-client.1.41969.log 2024-03-16T07:43:22.219 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.81835.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54702.log 2024-03-16T07:43:22.219 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.81835.log.gz 2024-03-16T07:43:22.219 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.1.41969.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62595.log 2024-03-16T07:43:22.219 INFO:teuthology.orchestra.run.smithi049.stderr: 33.3% -- replaced with /var/log/ceph/ceph-client.1.41969.log.gz 2024-03-16T07:43:22.219 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.54702.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42679.log 2024-03-16T07:43:22.219 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54702.log.gz 2024-03-16T07:43:22.220 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.62595.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62595.log.gz 2024-03-16T07:43:22.220 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.75960.log 2024-03-16T07:43:22.220 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.42679.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49213.log 2024-03-16T07:43:22.220 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42679.log.gz 2024-03-16T07:43:22.220 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.0.75960.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47206.log 2024-03-16T07:43:22.220 INFO:teuthology.orchestra.run.smithi049.stderr: 32.9% -- replaced with /var/log/ceph/ceph-client.0.75960.log.gz 2024-03-16T07:43:22.220 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.49213.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53317.log 2024-03-16T07:43:22.220 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49213.log.gz 2024-03-16T07:43:22.221 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.47206.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47206.log.gz 2024-03-16T07:43:22.221 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53880.log 2024-03-16T07:43:22.221 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.53317.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39750.log 2024-03-16T07:43:22.221 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53317.log.gz 2024-03-16T07:43:22.221 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.53880.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.53880.log.gz 2024-03-16T07:43:22.221 INFO:teuthology.orchestra.run.smithi049.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.43570.log 2024-03-16T07:43:22.221 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.39750.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79750.log 2024-03-16T07:43:22.221 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39750.log.gz 2024-03-16T07:43:22.222 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.43570.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43570.log.gz -5 2024-03-16T07:43:22.222 INFO:teuthology.orchestra.run.smithi049.stderr: --verbose -- /var/log/ceph/ceph-client.admin.80231.log 2024-03-16T07:43:22.222 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.79750.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74112.log 2024-03-16T07:43:22.222 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.79750.log.gz 2024-03-16T07:43:22.222 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.80231.log: gzip -5 0.0% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.80231.log.gz 2024-03-16T07:43:22.222 INFO:teuthology.orchestra.run.smithi049.stderr: /var/log/ceph/ceph-client.admin.44835.log 2024-03-16T07:43:22.222 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.74112.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81709.log 2024-03-16T07:43:22.222 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74112.log.gz 2024-03-16T07:43:22.222 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.44835.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.44835.log.gz 2024-03-16T07:43:22.223 INFO:teuthology.orchestra.run.smithi049.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.72699.log 2024-03-16T07:43:22.223 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.81709.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86585.log 2024-03-16T07:43:22.223 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.81709.log.gz 2024-03-16T07:43:22.223 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.72699.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.72699.log.gz --verbose 2024-03-16T07:43:22.223 INFO:teuthology.orchestra.run.smithi049.stderr: -- /var/log/ceph/ceph-client.admin.53359.log 2024-03-16T07:43:22.223 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.86585.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59756.log 2024-03-16T07:43:22.223 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.86585.log.gz 2024-03-16T07:43:22.223 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.53359.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53359.log.gz 2024-03-16T07:43:22.224 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88330.log 2024-03-16T07:43:22.224 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.59756.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62900.log 2024-03-16T07:43:22.224 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59756.log.gz 2024-03-16T07:43:22.224 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.88330.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.88330.log.gz 2024-03-16T07:43:22.224 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67547.log 2024-03-16T07:43:22.224 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39500.log 2024-03-16T07:43:22.224 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.62900.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62900.log.gz 2024-03-16T07:43:22.224 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.67547.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60191.log 2024-03-16T07:43:22.224 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67547.log.gz 2024-03-16T07:43:22.225 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.39500.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80021.log 2024-03-16T07:43:22.225 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39500.log.gz 2024-03-16T07:43:22.225 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.60191.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60191.log.gz 2024-03-16T07:43:22.225 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53838.log 2024-03-16T07:43:22.225 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.80021.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42550.log 2024-03-16T07:43:22.225 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.80021.log.gz 2024-03-16T07:43:22.225 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.53838.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53838.log.gz -5 2024-03-16T07:43:22.225 INFO:teuthology.orchestra.run.smithi049.stderr: --verbose -- /var/log/ceph/ceph-client.admin.60628.log 2024-03-16T07:43:22.225 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.42550.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.e.log 2024-03-16T07:43:22.226 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42550.log.gz 2024-03-16T07:43:22.226 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.60628.log: gzip -5 0.0% --verbose -- replaced with /var/log/ceph/ceph-client.admin.60628.log.gz -- 2024-03-16T07:43:22.226 INFO:teuthology.orchestra.run.smithi049.stderr: /var/log/ceph/ceph-client.admin.63742.log 2024-03-16T07:43:22.226 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-mds.e.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83028.log 2024-03-16T07:43:22.226 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.63742.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65516.log 2024-03-16T07:43:22.226 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63742.log.gz 2024-03-16T07:43:22.226 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.83028.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.83028.log.gz 2024-03-16T07:43:22.226 INFO:teuthology.orchestra.run.smithi049.stderr: --verbose -- /var/log/ceph/ceph-client.admin.60381.log 2024-03-16T07:43:22.227 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51883.log 2024-03-16T07:43:22.227 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.65516.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65516.log.gz 2024-03-16T07:43:22.227 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.60381.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86037.log 2024-03-16T07:43:22.227 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60381.log.gz 2024-03-16T07:43:22.227 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.51883.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-03-16T07:43:22.227 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51883.log.gz 2024-03-16T07:43:22.227 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63868.log 2024-03-16T07:43:22.227 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.86037.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.86037.log.gz 2024-03-16T07:43:22.227 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62408.log 2024-03-16T07:43:22.228 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.63868.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89617.log 2024-03-16T07:43:22.228 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63868.log.gz 2024-03-16T07:43:22.228 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.62408.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91309.log 2024-03-16T07:43:22.228 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62408.log.gz 2024-03-16T07:43:22.228 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.89617.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46622.log 2024-03-16T07:43:22.228 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.89617.log.gz 2024-03-16T07:43:22.228 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.91309.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91057.log 2024-03-16T07:43:22.228 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.91309.log.gz 2024-03-16T07:43:22.229 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60712.log 2024-03-16T07:43:22.229 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.46622.log: /var/log/ceph/ceph-client.admin.91057.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69758.log 2024-03-16T07:43:22.229 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.91057.log.gz 2024-03-16T07:43:22.229 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46622.log.gz 2024-03-16T07:43:22.229 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.60712.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65386.log 2024-03-16T07:43:22.229 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60712.log.gz 2024-03-16T07:43:22.229 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.69758.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57312.log 2024-03-16T07:43:22.229 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69758.log.gz 2024-03-16T07:43:22.230 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91267.log 2024-03-16T07:43:22.230 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.65386.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65386.log.gz 2024-03-16T07:43:22.230 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61188.log 2024-03-16T07:43:22.230 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.57312.log: /var/log/ceph/ceph-client.admin.91267.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90536.log 2024-03-16T07:43:22.230 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.91267.log.gz 2024-03-16T07:43:22.230 INFO:teuthology.orchestra.run.smithi049.stderr: -- replaced with /var/log/ceph/ceph-client.admin.57312.log.gz 2024-03-16T07:43:22.230 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.61188.log: gzip -5 --verbose 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61188.log.gz 2024-03-16T07:43:22.230 INFO:teuthology.orchestra.run.smithi049.stderr: -- /var/log/ceph/ceph-client.admin.81212.log 2024-03-16T07:43:22.231 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.90536.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.90536.log.gz 2024-03-16T07:43:22.231 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52334.log 2024-03-16T07:43:22.231 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.81212.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69842.log 2024-03-16T07:43:22.231 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.81212.log.gz 2024-03-16T07:43:22.231 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.52334.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.82245.log 2024-03-16T07:43:22.231 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52334.log.gz 2024-03-16T07:43:22.231 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61790.log 2024-03-16T07:43:22.231 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.69842.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69842.log.gz 2024-03-16T07:43:22.231 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.0.82245.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71276.log 2024-03-16T07:43:22.232 INFO:teuthology.orchestra.run.smithi049.stderr: 32.5% -- replaced with /var/log/ceph/ceph-client.0.82245.log.gz 2024-03-16T07:43:22.232 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.61790.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42991.log 2024-03-16T07:43:22.232 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61790.log.gz 2024-03-16T07:43:22.232 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.71276.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56224.log 2024-03-16T07:43:22.232 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71276.log.gz 2024-03-16T07:43:22.232 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.42991.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78546.log 2024-03-16T07:43:22.232 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42991.log.gz 2024-03-16T07:43:22.232 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.56224.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81028.log 2024-03-16T07:43:22.232 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56224.log.gz 2024-03-16T07:43:22.233 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57438.log 2024-03-16T07:43:22.233 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.78546.log: /var/log/ceph/ceph-client.admin.81028.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45152.log 2024-03-16T07:43:22.233 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.81028.log.gz 2024-03-16T07:43:22.233 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.78546.log.gz 2024-03-16T07:43:22.233 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.57438.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42595.log 2024-03-16T07:43:22.233 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57438.log.gz 2024-03-16T07:43:22.233 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.45152.log: gzip 0.0% -5 --verbose -- /var/log/ceph/ceph-client.admin.54214.log 2024-03-16T07:43:22.233 INFO:teuthology.orchestra.run.smithi049.stderr: -- replaced with /var/log/ceph/ceph-client.admin.45152.log.gz 2024-03-16T07:43:22.234 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.42595.log: gzip 0.0% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.42595.log.gz -- 2024-03-16T07:43:22.234 INFO:teuthology.orchestra.run.smithi049.stderr: /var/log/ceph/ceph-client.admin.47396.log 2024-03-16T07:43:22.234 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.54214.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88908.log 2024-03-16T07:43:22.234 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54214.log.gz 2024-03-16T07:43:22.234 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.47396.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.82662.log 2024-03-16T07:43:22.234 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47396.log.gz 2024-03-16T07:43:22.234 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.88908.log: -- /var/log/ceph/ceph-client.admin.79979.log 2024-03-16T07:43:22.234 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.88908.log.gz 2024-03-16T07:43:22.235 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.1.82662.log: 33.7% -- replaced with /var/log/ceph/ceph-client.1.82662.log.gz 2024-03-16T07:43:22.235 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59460.log 2024-03-16T07:43:22.235 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.79979.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.79979.log.gz 2024-03-16T07:43:22.235 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55314.log 2024-03-16T07:43:22.235 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.59460.log: 90.0% -- replaced with /var/log/ceph/ceph-mds.e.log.gz 2024-03-16T07:43:22.235 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59460.log.gz 2024-03-16T07:43:22.235 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79582.log 2024-03-16T07:43:22.235 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39668.log 2024-03-16T07:43:22.235 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.55314.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55314.log.gz 2024-03-16T07:43:22.236 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.79582.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46205.log 2024-03-16T07:43:22.236 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.79582.log.gz 2024-03-16T07:43:22.236 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.39668.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40760.log 2024-03-16T07:43:22.236 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39668.log.gz 2024-03-16T07:43:22.236 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68382.log 2024-03-16T07:43:22.236 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.46205.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46205.log.gz 2024-03-16T07:43:22.236 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.40760.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54006.log 2024-03-16T07:43:22.236 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40760.log.gz 2024-03-16T07:43:22.236 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.68382.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68382.log.gzgzip 2024-03-16T07:43:22.237 INFO:teuthology.orchestra.run.smithi049.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.57998.log 2024-03-16T07:43:22.237 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68088.log 2024-03-16T07:43:22.237 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.54006.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54006.log.gz 2024-03-16T07:43:22.237 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.57998.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75591.log 2024-03-16T07:43:22.237 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57998.log.gz 2024-03-16T07:43:22.237 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.68088.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68088.log.gz 2024-03-16T07:43:22.237 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40974.log 2024-03-16T07:43:22.237 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90224.log 2024-03-16T07:43:22.237 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.75591.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.75591.log.gz 2024-03-16T07:43:22.238 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.40974.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42453.log 2024-03-16T07:43:22.238 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40974.log.gz 2024-03-16T07:43:22.238 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.90224.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.90224.log.gz 2024-03-16T07:43:22.238 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38830.log 2024-03-16T07:43:22.238 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74172.log 2024-03-16T07:43:22.238 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.42453.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42453.log.gz 2024-03-16T07:43:22.238 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.38830.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74443.log 2024-03-16T07:43:22.238 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38830.log.gz 2024-03-16T07:43:22.239 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.74172.log: gzip -5 0.0% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.74172.log.gz 2024-03-16T07:43:22.239 INFO:teuthology.orchestra.run.smithi049.stderr: /var/log/ceph/ceph-client.admin.50730.log 2024-03-16T07:43:22.239 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73986.log 2024-03-16T07:43:22.239 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.74443.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74443.log.gz 2024-03-16T07:43:22.239 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.50730.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47489.log 2024-03-16T07:43:22.239 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50730.log.gz 2024-03-16T07:43:22.239 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.73986.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.73986.log.gz 2024-03-16T07:43:22.239 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47080.log 2024-03-16T07:43:22.240 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47895.log 2024-03-16T07:43:22.240 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.47489.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47489.log.gz 2024-03-16T07:43:22.240 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.47080.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44188.log 2024-03-16T07:43:22.240 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47080.log.gz 2024-03-16T07:43:22.240 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.47895.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47895.log.gz 2024-03-16T07:43:22.240 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65121.log 2024-03-16T07:43:22.240 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75158.log 2024-03-16T07:43:22.240 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.44188.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44188.log.gz 2024-03-16T07:43:22.240 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.65121.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.53119.log 2024-03-16T07:43:22.241 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65121.log.gz 2024-03-16T07:43:22.241 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.75158.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.75158.log.gz 2024-03-16T07:43:22.241 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55188.log 2024-03-16T07:43:22.241 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55043.log 2024-03-16T07:43:22.241 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.1.53119.log: 32.9% -- replaced with /var/log/ceph/ceph-client.1.53119.log.gz 2024-03-16T07:43:22.241 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.55188.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55188.log.gz 2024-03-16T07:43:22.241 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41590.log 2024-03-16T07:43:22.241 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83823.log 2024-03-16T07:43:22.242 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.55043.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55043.log.gz 2024-03-16T07:43:22.242 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.41590.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40634.log 2024-03-16T07:43:22.242 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41590.log.gz 2024-03-16T07:43:22.242 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.83823.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51795.log 2024-03-16T07:43:22.242 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.83823.log.gz 2024-03-16T07:43:22.242 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.40634.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55356.log 2024-03-16T07:43:22.242 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40634.log.gz 2024-03-16T07:43:22.242 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.51795.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52124.log 2024-03-16T07:43:22.243 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51795.log.gz 2024-03-16T07:43:22.243 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.55356.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-03-16T07:43:22.243 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55356.log.gz 2024-03-16T07:43:22.243 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.52124.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66288.log 2024-03-16T07:43:22.243 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52124.log.gz 2024-03-16T07:43:22.243 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90434.log 2024-03-16T07:43:22.243 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.66288.log: gzip 0.0% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.66288.log.gz -- 2024-03-16T07:43:22.243 INFO:teuthology.orchestra.run.smithi049.stderr: /var/log/ceph/ceph-client.admin.67463.log 2024-03-16T07:43:22.244 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.90434.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71234.log 2024-03-16T07:43:22.244 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.90434.log.gz 2024-03-16T07:43:22.244 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.67463.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43481.log 2024-03-16T07:43:22.244 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67463.log.gz 2024-03-16T07:43:22.244 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.71234.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71234.log.gz 2024-03-16T07:43:22.244 INFO:teuthology.orchestra.run.smithi049.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.51994.log 2024-03-16T07:43:22.244 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.43481.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44766.log 2024-03-16T07:43:22.244 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43481.log.gz 2024-03-16T07:43:22.244 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.51994.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62366.log 2024-03-16T07:43:22.245 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51994.log.gz 2024-03-16T07:43:22.245 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41054.log 2024-03-16T07:43:22.245 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.44766.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44766.log.gz 2024-03-16T07:43:22.245 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.62366.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59628.log 2024-03-16T07:43:22.245 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62366.log.gz 2024-03-16T07:43:22.245 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.41054.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59712.log 2024-03-16T07:43:22.245 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41054.log.gz 2024-03-16T07:43:22.245 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.59628.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90182.log 2024-03-16T07:43:22.246 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59628.log.gz 2024-03-16T07:43:22.246 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.59712.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59712.log.gz 2024-03-16T07:43:22.246 INFO:teuthology.orchestra.run.smithi049.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.40802.log 2024-03-16T07:43:22.246 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.90182.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74760.log 2024-03-16T07:43:22.246 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.90182.log.gz 2024-03-16T07:43:22.246 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.40802.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75070.log 2024-03-16T07:43:22.246 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40802.log.gz 2024-03-16T07:43:22.246 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50291.log 2024-03-16T07:43:22.247 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.74760.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74760.log.gz 2024-03-16T07:43:22.247 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.75070.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53750.log 2024-03-16T07:43:22.247 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.75070.log.gz 2024-03-16T07:43:22.247 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.50291.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83549.log 2024-03-16T07:43:22.247 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50291.log.gz 2024-03-16T07:43:22.247 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.53750.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53750.log.gz 2024-03-16T07:43:22.247 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44706.log 2024-03-16T07:43:22.247 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76872.log 2024-03-16T07:43:22.247 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.83549.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.83549.log.gz 2024-03-16T07:43:22.248 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.44706.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48643.log 2024-03-16T07:43:22.248 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44706.log.gz 2024-03-16T07:43:22.248 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.76872.log: gzip -5 0.0% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.76872.log.gz 2024-03-16T07:43:22.248 INFO:teuthology.orchestra.run.smithi049.stderr: /var/log/ceph/ceph-client.admin.70909.log 2024-03-16T07:43:22.248 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82402.log 2024-03-16T07:43:22.248 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.48643.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48643.log.gz 2024-03-16T07:43:22.248 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.70909.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38876.log 2024-03-16T07:43:22.249 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70909.log.gz 2024-03-16T07:43:22.249 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.82402.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61903.log 2024-03-16T07:43:22.249 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.82402.log.gz 2024-03-16T07:43:22.249 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.38876.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67505.log 2024-03-16T07:43:22.249 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38876.log.gz 2024-03-16T07:43:22.249 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.61903.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61903.log.gz 2024-03-16T07:43:22.249 INFO:teuthology.orchestra.run.smithi049.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.87726.log 2024-03-16T07:43:22.249 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.67505.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61988.log 2024-03-16T07:43:22.249 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67505.log.gz 2024-03-16T07:43:22.250 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.87726.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.87726.log.gz 2024-03-16T07:43:22.250 INFO:teuthology.orchestra.run.smithi049.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.59851.log 2024-03-16T07:43:22.250 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.61988.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73944.log 2024-03-16T07:43:22.250 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61988.log.gz 2024-03-16T07:43:22.250 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.59851.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59851.log.gz 2024-03-16T07:43:22.250 INFO:teuthology.orchestra.run.smithi049.stderr: --verbose -- /var/log/ceph/ceph-client.0.64436.log 2024-03-16T07:43:22.250 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.73944.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.73944.log.gz 2024-03-16T07:43:22.250 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47531.log 2024-03-16T07:43:22.251 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.0.64436.log: 32.1% -- replaced with /var/log/ceph/ceph-client.0.64436.log.gz 2024-03-16T07:43:22.251 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67207.log 2024-03-16T07:43:22.251 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.47531.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47531.log.gz 2024-03-16T07:43:22.251 INFO:teuthology.orchestra.run.smithi049.stderr: --verbose -- /var/log/ceph/ceph-client.admin.42158.log 2024-03-16T07:43:22.251 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.67207.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67207.log.gz 2024-03-16T07:43:22.251 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83070.log 2024-03-16T07:43:22.251 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.42158.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66679.log 2024-03-16T07:43:22.251 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42158.log.gz 2024-03-16T07:43:22.252 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.83070.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67589.log 2024-03-16T07:43:22.252 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.83070.log.gz 2024-03-16T07:43:22.252 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.66679.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53666.log 2024-03-16T07:43:22.252 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66679.log.gz 2024-03-16T07:43:22.252 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.67589.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81751.log 2024-03-16T07:43:22.252 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67589.log.gz 2024-03-16T07:43:22.252 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.53666.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81667.log 2024-03-16T07:43:22.252 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53666.log.gz 2024-03-16T07:43:22.253 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.81751.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73295.log 2024-03-16T07:43:22.253 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.81751.log.gz 2024-03-16T07:43:22.253 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.81667.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43280.log 2024-03-16T07:43:22.253 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.81667.log.gz 2024-03-16T07:43:22.253 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.73295.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45664.log 2024-03-16T07:43:22.253 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.73295.log.gz 2024-03-16T07:43:22.253 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.43280.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43280.log.gz 2024-03-16T07:43:22.253 INFO:teuthology.orchestra.run.smithi049.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.87137.log 2024-03-16T07:43:22.253 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.45664.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.52705.log 2024-03-16T07:43:22.254 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45664.log.gz 2024-03-16T07:43:22.254 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.87137.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-03-16T07:43:22.254 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.87137.log.gz 2024-03-16T07:43:22.254 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.0.52705.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65428.log 2024-03-16T07:43:22.254 INFO:teuthology.orchestra.run.smithi049.stderr: 31.7% -- replaced with /var/log/ceph/ceph-client.0.52705.log.gz 2024-03-16T07:43:22.254 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74902.log 2024-03-16T07:43:22.254 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.65428.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65428.log.gz 2024-03-16T07:43:22.254 INFO:teuthology.orchestra.run.smithi049.stderr: --verbose -- /var/log/ceph/ceph-client.admin.55492.log 2024-03-16T07:43:22.255 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.74902.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74902.log.gz 2024-03-16T07:43:22.255 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72216.log 2024-03-16T07:43:22.255 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.55492.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49997.log 2024-03-16T07:43:22.255 INFO:teuthology.orchestra.run.smithi049.stderr: -- replaced with /var/log/ceph/ceph-client.admin.55492.log.gz 2024-03-16T07:43:22.255 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.72216.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88952.log 2024-03-16T07:43:22.255 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72216.log.gz 2024-03-16T07:43:22.255 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5/var/log/ceph/ceph-client.admin.49997.log: --verbose -- 0.0% /var/log/ceph/ceph-client.admin.51711.log 2024-03-16T07:43:22.255 INFO:teuthology.orchestra.run.smithi049.stderr: -- replaced with /var/log/ceph/ceph-client.admin.49997.log.gz 2024-03-16T07:43:22.255 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.88952.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.88952.log.gz 2024-03-16T07:43:22.256 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90098.log 2024-03-16T07:43:22.256 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.51711.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53964.log 2024-03-16T07:43:22.256 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51711.log.gz 2024-03-16T07:43:22.256 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.90098.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56957.log 2024-03-16T07:43:22.256 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.90098.log.gz 87.6% -- replaced with /var/log/ceph/ceph.log.gz 2024-03-16T07:43:22.256 INFO:teuthology.orchestra.run.smithi049.stderr: 2024-03-16T07:43:22.256 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75028.log 2024-03-16T07:43:22.256 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.53964.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53964.log.gz 2024-03-16T07:43:22.257 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65600.log 2024-03-16T07:43:22.257 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.56957.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56957.log.gz 2024-03-16T07:43:22.257 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.75028.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-03-16T07:43:22.257 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.75028.log.gz 2024-03-16T07:43:22.257 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.65600.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51485.log 2024-03-16T07:43:22.257 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65600.log.gz 2024-03-16T07:43:22.257 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34995.log 2024-03-16T07:43:22.257 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-osd.2.log: /var/log/ceph/ceph-client.admin.51485.log: gzip -5 --verbose 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51485.log.gz 2024-03-16T07:43:22.257 INFO:teuthology.orchestra.run.smithi049.stderr: -- /var/log/ceph/ceph-client.admin.73650.log 2024-03-16T07:43:22.258 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.34995.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34995.log.gz 2024-03-16T07:43:22.258 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89911.log 2024-03-16T07:43:22.258 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.73650.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.73650.log.gz 2024-03-16T07:43:22.258 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59893.log 2024-03-16T07:43:22.258 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.89911.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.89911.log.gz 2024-03-16T07:43:22.258 INFO:teuthology.orchestra.run.smithi049.stderr: --verbose -- /var/log/ceph/ceph-client.admin.66815.log 2024-03-16T07:43:22.258 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.59893.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59893.log.gz 2024-03-16T07:43:22.259 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91451.log 2024-03-16T07:43:22.259 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.66815.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66815.log.gz 2024-03-16T07:43:22.259 INFO:teuthology.orchestra.run.smithi049.stderr: --verbose -- /var/log/ceph/ceph-mds.c.log 2024-03-16T07:43:22.259 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.91451.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.91451.log.gz 2024-03-16T07:43:22.259 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68695.log 2024-03-16T07:43:22.259 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72384.log 2024-03-16T07:43:22.259 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.68695.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68695.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40928.log 2024-03-16T07:43:22.259 INFO:teuthology.orchestra.run.smithi049.stderr: 2024-03-16T07:43:22.259 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.72384.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72384.log.gz 2024-03-16T07:43:22.260 INFO:teuthology.orchestra.run.smithi049.stderr: 88.9% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-03-16T07:43:22.260 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75251.log 2024-03-16T07:43:22.260 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.40928.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40928.log.gz 2024-03-16T07:43:22.260 INFO:teuthology.orchestra.run.smithi049.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.42284.log 2024-03-16T07:43:22.260 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.75251.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.75251.log.gz 2024-03-16T07:43:22.260 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75549.log 2024-03-16T07:43:22.260 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.42284.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42284.log.gz 2024-03-16T07:43:22.260 INFO:teuthology.orchestra.run.smithi049.stderr: --verbose -- /var/log/ceph/ceph-client.admin.44320.log 2024-03-16T07:43:22.261 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.75549.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.75549.log.gz 2024-03-16T07:43:22.261 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59044.log 2024-03-16T07:43:22.261 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.44320.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44320.log.gz 2024-03-16T07:43:22.261 INFO:teuthology.orchestra.run.smithi049.stderr: --verbose -- /var/log/ceph/ceph-client.admin.60544.log 2024-03-16T07:43:22.261 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.59044.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59044.log.gz 2024-03-16T07:43:22.261 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58221.log 2024-03-16T07:43:22.261 INFO:teuthology.orchestra.run.smithi049.stderr:gzip/var/log/ceph/ceph-client.admin.60544.log: -5 --verbose -- 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60544.log.gz 2024-03-16T07:43:22.261 INFO:teuthology.orchestra.run.smithi049.stderr: /var/log/ceph/ceph-client.admin.55884.log 2024-03-16T07:43:22.261 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.58221.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58221.log.gz 2024-03-16T07:43:22.262 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49087.log 2024-03-16T07:43:22.262 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.55884.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76742.log 2024-03-16T07:43:22.262 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55884.log.gz 2024-03-16T07:43:22.262 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.49087.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60967.log 2024-03-16T07:43:22.262 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49087.log.gz 2024-03-16T07:43:22.262 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89869.log 2024-03-16T07:43:22.262 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.76742.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.76742.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83114.log 2024-03-16T07:43:22.262 INFO:teuthology.orchestra.run.smithi049.stderr: 2024-03-16T07:43:22.263 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.60967.log: /var/log/ceph/ceph-client.admin.89869.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60967.log.gz 2024-03-16T07:43:22.263 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.89869.log.gz 2024-03-16T07:43:22.263 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63970.log 2024-03-16T07:43:22.263 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.83114.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.83114.log.gz 2024-03-16T07:43:22.263 INFO:teuthology.orchestra.run.smithi049.stderr: --verbose -- /var/log/ceph/ceph-client.admin.62805.log 2024-03-16T07:43:22.263 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.63970.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63970.log.gz 2024-03-16T07:43:22.263 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42242.log 2024-03-16T07:43:22.263 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.62805.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84603.log 2024-03-16T07:43:22.264 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62805.log.gz 2024-03-16T07:43:22.264 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5/var/log/ceph/ceph-client.admin.42242.log: --verbose -- /var/log/ceph/ceph-client.admin.50351.log 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42242.log.gz 2024-03-16T07:43:22.264 INFO:teuthology.orchestra.run.smithi049.stderr: 2024-03-16T07:43:22.264 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.84603.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.84603.log.gz 2024-03-16T07:43:22.264 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38929.log 2024-03-16T07:43:22.264 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.50351.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50351.log.gz 2024-03-16T07:43:22.264 INFO:teuthology.orchestra.run.smithi049.stderr: --verbose -- /var/log/ceph/ceph-client.admin.50772.log 2024-03-16T07:43:22.264 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.38929.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38929.log.gz 2024-03-16T07:43:22.264 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65470.log 2024-03-16T07:43:22.265 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.50772.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50772.log.gz 2024-03-16T07:43:22.265 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76784.log 2024-03-16T07:43:22.265 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.65470.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65470.log.gz 2024-03-16T07:43:22.265 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56579.log 2024-03-16T07:43:22.265 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.76784.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.76784.log.gz 2024-03-16T07:43:22.265 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50856.log 2024-03-16T07:43:22.265 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.56579.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56579.log.gz 2024-03-16T07:43:22.265 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83251.log 2024-03-16T07:43:22.266 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.50856.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51211.log 2024-03-16T07:43:22.266 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50856.log.gz 2024-03-16T07:43:22.266 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.mirror_remote.34997.log 2024-03-16T07:43:22.266 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.83251.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.83251.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80628.log 2024-03-16T07:43:22.266 INFO:teuthology.orchestra.run.smithi049.stderr: 2024-03-16T07:43:22.266 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.51211.log: /var/log/ceph/ceph-client.mirror_remote.34997.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51211.log.gz 2024-03-16T07:43:22.266 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.mirror_remote.34997.log.gz 2024-03-16T07:43:22.266 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61111.log 2024-03-16T07:43:22.266 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.80628.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77906.log 2024-03-16T07:43:22.267 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.80628.log.gz 2024-03-16T07:43:22.267 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.61111.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79319.log 2024-03-16T07:43:22.267 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61111.log.gz 2024-03-16T07:43:22.267 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47164.log 2024-03-16T07:43:22.267 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.77906.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.77906.log.gz 2024-03-16T07:43:22.267 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76532.log 2024-03-16T07:43:22.267 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.79319.log: /var/log/ceph/ceph-client.admin.47164.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.79319.log.gz 2024-03-16T07:43:22.267 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47164.log.gz 2024-03-16T07:43:22.267 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63347.log 2024-03-16T07:43:22.268 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.76532.log: gzip 0.0% -5 --verbose -- /var/log/ceph/ceph-client.admin.80544.log 2024-03-16T07:43:22.268 INFO:teuthology.orchestra.run.smithi049.stderr: -- replaced with /var/log/ceph/ceph-client.admin.76532.log.gz 2024-03-16T07:43:22.268 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.63347.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79708.log 2024-03-16T07:43:22.268 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63347.log.gz 2024-03-16T07:43:22.268 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63826.log 2024-03-16T07:43:22.268 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.80544.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66469.log 2024-03-16T07:43:22.268 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.79708.log: 0.0% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.79708.log.gz 2024-03-16T07:43:22.268 INFO:teuthology.orchestra.run.smithi049.stderr: -- replaced with /var/log/ceph/ceph-client.admin.80544.log.gz 2024-03-16T07:43:22.268 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.63826.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40382.log 2024-03-16T07:43:22.269 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63826.log.gz 2024-03-16T07:43:22.269 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5/var/log/ceph/ceph-client.admin.66469.log: --verbose -- /var/log/ceph/ceph-client.admin.81877.log 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66469.log.gz 2024-03-16T07:43:22.269 INFO:teuthology.orchestra.run.smithi049.stderr: 2024-03-16T07:43:22.269 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.40382.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40382.log.gz 2024-03-16T07:43:22.269 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91411.log 2024-03-16T07:43:22.269 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.81877.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86843.log 2024-03-16T07:43:22.269 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.81877.log.gz 2024-03-16T07:43:22.269 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.91411.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65163.log 2024-03-16T07:43:22.270 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.91411.log.gz 2024-03-16T07:43:22.270 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56140.log 2024-03-16T07:43:22.270 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.86843.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.86843.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56705.log 2024-03-16T07:43:22.270 INFO:teuthology.orchestra.run.smithi049.stderr: 2024-03-16T07:43:22.270 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.65163.log: /var/log/ceph/ceph-client.admin.56140.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65163.log.gz 2024-03-16T07:43:22.270 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56140.log.gz 2024-03-16T07:43:22.270 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80315.log 2024-03-16T07:43:22.270 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76700.log 2024-03-16T07:43:22.271 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.56705.log: /var/log/ceph/ceph-client.admin.80315.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53485.log 2024-03-16T07:43:22.271 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56705.log.gz 2024-03-16T07:43:22.271 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.80315.log.gz 2024-03-16T07:43:22.271 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.76700.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82902.log 2024-03-16T07:43:22.271 INFO:teuthology.orchestra.run.smithi049.stderr: -- replaced with /var/log/ceph/ceph-client.admin.76700.log.gz 2024-03-16T07:43:22.271 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.53485.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39268.log 2024-03-16T07:43:22.271 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53485.log.gz 2024-03-16T07:43:22.271 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53922.log 2024-03-16T07:43:22.271 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.82902.log: /var/log/ceph/ceph-client.admin.39268.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.82902.log.gz 2024-03-16T07:43:22.271 INFO:teuthology.orchestra.run.smithi049.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.75465.log 2024-03-16T07:43:22.272 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39268.log.gz 2024-03-16T07:43:22.272 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.53922.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53922.log.gz 2024-03-16T07:43:22.272 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39982.log 2024-03-16T07:43:22.272 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.75465.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.75465.log.gz 2024-03-16T07:43:22.272 INFO:teuthology.orchestra.run.smithi049.stderr: --verbose -- /var/log/ceph/ceph-client.admin.89971.log 2024-03-16T07:43:22.272 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.39982.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39982.log.gz 2024-03-16T07:43:22.272 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65079.log 2024-03-16T07:43:22.272 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.89971.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.89971.log.gz 2024-03-16T07:43:22.273 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66910.log 2024-03-16T07:43:22.273 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.65079.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65079.log.gz 2024-03-16T07:43:22.273 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62553.log 2024-03-16T07:43:22.273 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.66910.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66910.log.gz 2024-03-16T07:43:22.273 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78308.log 2024-03-16T07:43:22.273 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.62553.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62553.log.gz 2024-03-16T07:43:22.273 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51753.log 2024-03-16T07:43:22.273 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.78308.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.78308.log.gz 2024-03-16T07:43:22.273 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63658.log 2024-03-16T07:43:22.274 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.51753.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51753.log.gz 2024-03-16T07:43:22.274 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88814.log 2024-03-16T07:43:22.274 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.63658.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63658.log.gz 2024-03-16T07:43:22.274 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88688.log 2024-03-16T07:43:22.274 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.88814.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.88814.log.gz 2024-03-16T07:43:22.274 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79894.log 2024-03-16T07:43:22.274 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.88688.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.88688.log.gz 2024-03-16T07:43:22.274 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72955.log 2024-03-16T07:43:22.275 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.79894.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.79894.log.gz 2024-03-16T07:43:22.275 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40108.log 2024-03-16T07:43:22.275 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.72955.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72955.log.gz 2024-03-16T07:43:22.275 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75293.log 2024-03-16T07:43:22.275 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.40108.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40108.log.gz 2024-03-16T07:43:22.275 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71449.log 2024-03-16T07:43:22.275 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67284.log 2024-03-16T07:43:22.275 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.75293.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84186.log 2024-03-16T07:43:22.275 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.71449.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.75293.log.gz 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71449.log.gz 2024-03-16T07:43:22.276 INFO:teuthology.orchestra.run.smithi049.stderr: 2024-03-16T07:43:22.276 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.67284.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80189.log 2024-03-16T07:43:22.276 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.84186.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67284.log.gz 2024-03-16T07:43:22.276 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.84186.log.gz 2024-03-16T07:43:22.276 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76923.log 2024-03-16T07:43:22.276 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.80189.log: -- /var/log/ceph/ceph-client.admin.47308.log 2024-03-16T07:43:22.276 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.80189.log.gz 2024-03-16T07:43:22.276 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.76923.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.76923.log.gz 2024-03-16T07:43:22.276 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51253.log 2024-03-16T07:43:22.277 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.47308.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47308.log.gz 2024-03-16T07:43:22.277 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89575.log 2024-03-16T07:43:22.277 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.51253.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51253.log.gz 2024-03-16T07:43:22.277 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73692.log 2024-03-16T07:43:22.277 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.89575.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.89575.log.gz 2024-03-16T07:43:22.277 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90056.log 2024-03-16T07:43:22.277 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.73692.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.73692.log.gz 2024-03-16T07:43:22.277 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70969.log 2024-03-16T07:43:22.277 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.90056.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.90056.log.gz 2024-03-16T07:43:22.278 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80891.log 2024-03-16T07:43:22.278 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.70969.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70969.log.gz 2024-03-16T07:43:22.278 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53275.log 2024-03-16T07:43:22.278 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.80891.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.80891.log.gz 2024-03-16T07:43:22.278 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72562.log 2024-03-16T07:43:22.278 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.53275.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53275.log.gz 2024-03-16T07:43:22.278 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65768.log 2024-03-16T07:43:22.278 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.72562.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72562.log.gz 2024-03-16T07:43:22.279 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79414.log 2024-03-16T07:43:22.279 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.65768.log: 48.6% -- replaced with /var/log/ceph/ceph-client.admin.65768.log.gz 2024-03-16T07:43:22.279 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71533.log 2024-03-16T07:43:22.279 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39836.log 2024-03-16T07:43:22.279 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.79414.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88218.log 2024-03-16T07:43:22.279 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.71533.log: 0.0% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71533.log.gz 2024-03-16T07:43:22.279 INFO:teuthology.orchestra.run.smithi049.stderr: -- replaced with /var/log/ceph/ceph-client.admin.79414.log.gz 2024-03-16T07:43:22.279 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.39836.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39836.log.gz 2024-03-16T07:43:22.279 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57812.log 2024-03-16T07:43:22.280 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.88218.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.88218.log.gz 2024-03-16T07:43:22.280 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50081.log 2024-03-16T07:43:22.280 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.57812.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57812.log.gz 2024-03-16T07:43:22.280 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44446.log 2024-03-16T07:43:22.280 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.50081.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50081.log.gz 2024-03-16T07:43:22.280 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56308.log 2024-03-16T07:43:22.280 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.44446.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44446.log.gz 2024-03-16T07:43:22.280 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-03-16T07:43:22.280 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.56308.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56308.log.gz 2024-03-16T07:43:22.281 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76828.log 2024-03-16T07:43:22.281 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66637.log 2024-03-16T07:43:22.281 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.76828.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39458.log 2024-03-16T07:43:22.281 INFO:teuthology.orchestra.run.smithi049.stderr: -- replaced with /var/log/ceph/ceph-client.admin.76828.log.gz 2024-03-16T07:43:22.281 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77471.log 2024-03-16T07:43:22.281 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.66637.log: /var/log/ceph/ceph-client.admin.39458.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39458.log.gz 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66637.log.gz 2024-03-16T07:43:22.281 INFO:teuthology.orchestra.run.smithi049.stderr: 2024-03-16T07:43:22.281 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88772.log 2024-03-16T07:43:22.282 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.77471.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.77471.log.gz 2024-03-16T07:43:22.282 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79456.log 2024-03-16T07:43:22.282 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40019.log 2024-03-16T07:43:22.282 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.79456.log: /var/log/ceph/ceph-client.admin.88772.log: 0.0% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.79456.log.gz 2024-03-16T07:43:22.282 INFO:teuthology.orchestra.run.smithi049.stderr: -- replaced with /var/log/ceph/ceph-client.admin.88772.log.gz 2024-03-16T07:43:22.282 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90140.log 2024-03-16T07:43:22.282 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.40019.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40019.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60817.log 2024-03-16T07:43:22.282 INFO:teuthology.orchestra.run.smithi049.stderr: 2024-03-16T07:43:22.283 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40214.log 2024-03-16T07:43:22.283 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.90140.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.90140.log.gz 2024-03-16T07:43:22.283 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.60817.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52292.log 2024-03-16T07:43:22.283 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60817.log.gz 2024-03-16T07:43:22.283 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.40214.log: 88.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39356.log 2024-03-16T07:43:22.283 INFO:teuthology.orchestra.run.smithi049.stderr: -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-03-16T07:43:22.283 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40214.log.gz 2024-03-16T07:43:22.283 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.52292.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52292.log.gz 2024-03-16T07:43:22.283 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42326.log 2024-03-16T07:43:22.284 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.39356.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39356.log.gz 2024-03-16T07:43:22.284 INFO:teuthology.orchestra.run.smithi049.stderr: --verbose -- /var/log/ceph/ceph-client.admin.78714.log 2024-03-16T07:43:22.284 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.42326.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42326.log.gz 2024-03-16T07:43:22.284 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78672.log 2024-03-16T07:43:22.284 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.78714.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.78714.log.gz 2024-03-16T07:43:22.284 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54544.log 2024-03-16T07:43:22.284 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.78672.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.78672.log.gz 2024-03-16T07:43:22.284 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-03-16T07:43:22.285 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.54544.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54544.log.gz 2024-03-16T07:43:22.285 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69674.log 2024-03-16T07:43:22.285 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68340.log 2024-03-16T07:43:22.285 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.69674.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56915.log 2024-03-16T07:43:22.285 INFO:teuthology.orchestra.run.smithi049.stderr: -- replaced with /var/log/ceph/ceph-client.admin.69674.log.gz 2024-03-16T07:43:22.285 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.68340.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71365.log 2024-03-16T07:43:22.285 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.56915.log: 0.0% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56915.log.gz 2024-03-16T07:43:22.285 INFO:teuthology.orchestra.run.smithi049.stderr: -- replaced with /var/log/ceph/ceph-client.admin.68340.log.gz 2024-03-16T07:43:22.285 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43434.log 2024-03-16T07:43:22.286 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.71365.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71365.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60107.log 2024-03-16T07:43:22.286 INFO:teuthology.orchestra.run.smithi049.stderr: 2024-03-16T07:43:22.286 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83209.log 2024-03-16T07:43:22.286 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.60107.log: /var/log/ceph/ceph-client.admin.43434.log: 0.0% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60107.log.gz 2024-03-16T07:43:22.286 INFO:teuthology.orchestra.run.smithi049.stderr: -- replaced with /var/log/ceph/ceph-client.admin.43434.log.gz 2024-03-16T07:43:22.286 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47787.log 2024-03-16T07:43:22.286 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.83209.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.83209.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76574.log 2024-03-16T07:43:22.286 INFO:teuthology.orchestra.run.smithi049.stderr: 2024-03-16T07:43:22.287 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63910.log 2024-03-16T07:43:22.287 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.47787.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47787.log.gz 2024-03-16T07:43:22.287 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.76574.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.76574.log.gz 2024-03-16T07:43:22.287 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91183.log 2024-03-16T07:43:22.287 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.63910.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63910.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80754.log 2024-03-16T07:43:22.287 INFO:teuthology.orchestra.run.smithi049.stderr: 2024-03-16T07:43:22.287 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60065.log 2024-03-16T07:43:22.287 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.91183.log: /var/log/ceph/ceph-client.admin.80754.log: 0.0% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.80754.log.gz 2024-03-16T07:43:22.287 INFO:teuthology.orchestra.run.smithi049.stderr: -- replaced with /var/log/ceph/ceph-client.admin.91183.log.gz 2024-03-16T07:43:22.288 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74527.log 2024-03-16T07:43:22.288 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.60065.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60065.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75114.log 2024-03-16T07:43:22.288 INFO:teuthology.orchestra.run.smithi049.stderr: 2024-03-16T07:43:22.288 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63179.log 2024-03-16T07:43:22.288 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.74527.log: /var/log/ceph/ceph-client.admin.75114.log: 0.0% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74527.log.gz 2024-03-16T07:43:22.288 INFO:teuthology.orchestra.run.smithi049.stderr: -- replaced with /var/log/ceph/ceph-client.admin.75114.log.gz 2024-03-16T07:43:22.288 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47829.log 2024-03-16T07:43:22.288 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.63179.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63179.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88106.log 2024-03-16T07:43:22.288 INFO:teuthology.orchestra.run.smithi049.stderr: 2024-03-16T07:43:22.289 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.47829.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42771.log 2024-03-16T07:43:22.289 INFO:teuthology.orchestra.run.smithi049.stderr: 48.6% -- replaced with /var/log/ceph/ceph-client.admin.47829.log.gz 2024-03-16T07:43:22.289 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.88106.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.88106.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39748.log 2024-03-16T07:43:22.289 INFO:teuthology.orchestra.run.smithi049.stderr: 2024-03-16T07:43:22.289 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.42771.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42771.log.gz 2024-03-16T07:43:22.289 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50165.log 2024-03-16T07:43:22.289 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77095.log 2024-03-16T07:43:22.289 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.39748.log: /var/log/ceph/ceph-client.admin.50165.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39748.log.gz 2024-03-16T07:43:22.290 INFO:teuthology.orchestra.run.smithi049.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50165.log.gz 2024-03-16T07:43:22.290 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/ceph-client.admin.77095.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.77095.log.gz 2024-03-16T07:43:22.290 INFO:teuthology.orchestra.run.smithi049.stderr: 90.4% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-03-16T07:43:22.290 INFO:teuthology.orchestra.run.smithi049.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-03-16T07:43:22.568 INFO:teuthology.orchestra.run.smithi049.stderr: 90.6% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-03-16T07:43:24.659 INFO:teuthology.orchestra.run.smithi049.stderr: 94.3% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-03-16T07:43:24.898 INFO:teuthology.orchestra.run.smithi049.stderr: 94.2% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-03-16T07:43:24.917 INFO:teuthology.orchestra.run.smithi049.stderr: 94.2% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-03-16T07:43:24.919 INFO:teuthology.orchestra.run.smithi049.stderr: 2024-03-16T07:43:24.919 INFO:teuthology.orchestra.run.smithi049.stderr:real 0m3.175s 2024-03-16T07:43:24.919 INFO:teuthology.orchestra.run.smithi049.stderr:user 0m9.799s 2024-03-16T07:43:24.919 INFO:teuthology.orchestra.run.smithi049.stderr:sys 0m0.678s 2024-03-16T07:43:24.919 INFO:tasks.ceph:Archiving logs... 2024-03-16T07:43:24.920 DEBUG:teuthology.misc:Transferring archived files from smithi049:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-03-15_13:00:41-fs-wip-batrick-testing-20240314.183243-distro-default-smithi/7602244/remote/smithi049/log 2024-03-16T07:43:24.921 DEBUG:teuthology.orchestra.run.smithi049:> sudo tar c -f - -C /var/log/ceph -- . 2024-03-16T07:43:28.134 ERROR:teuthology.run_tasks:Manager failed: ceph Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_3d78f5ba07bf18880172c07d4d7b4ac00c9d30af/qa/tasks/ceph.py", line 1935, in task mon0_remote.run( File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_ceph-c_3d78f5ba07bf18880172c07d4d7b4ac00c9d30af/qa/tasks/ceph.py", line 252, in ceph_log yield File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_3d78f5ba07bf18880172c07d4d7b4ac00c9d30af/qa/tasks/ceph.py", line 346, in valgrind_post raise valgrind_exception Exception: valgrind error: Leak_StillReachable malloc malloc strdup 2024-03-16T07:43:28.145 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-03-16T07:43:28.173 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/task/install/__init__.py", line 626, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_3d78f5ba07bf18880172c07d4d7b4ac00c9d30af/qa/tasks/ceph.py", line 1935, in task mon0_remote.run( File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_ceph-c_3d78f5ba07bf18880172c07d4d7b4ac00c9d30af/qa/tasks/ceph.py", line 252, in ceph_log yield File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_3d78f5ba07bf18880172c07d4d7b4ac00c9d30af/qa/tasks/ceph.py", line 346, in valgrind_post raise valgrind_exception Exception: valgrind error: Leak_StillReachable malloc malloc strdup 2024-03-16T07:43:28.176 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-03-16T07:43:28.176 DEBUG:teuthology.orchestra.run.smithi049:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-03-16T07:43:28.236 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-03-16T07:43:28.246 INFO:teuthology.task.clock:Checking final clock skew... 2024-03-16T07:43:28.246 DEBUG:teuthology.orchestra.run.smithi049:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-16T07:43:28.274 INFO:teuthology.orchestra.run.smithi049.stderr:bash: line 1: ntpq: command not found 2024-03-16T07:43:28.279 INFO:teuthology.orchestra.run.smithi049.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-16T07:43:28.279 INFO:teuthology.orchestra.run.smithi049.stdout:=============================================================================== 2024-03-16T07:43:28.279 INFO:teuthology.orchestra.run.smithi049.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 4 +5078us[+5138us] +/- 106ms 2024-03-16T07:43:28.279 INFO:teuthology.orchestra.run.smithi049.stdout:^* hv02.front.sepia.ceph.com 3 6 377 4 -3000us[-2940us] +/- 78ms 2024-03-16T07:43:28.279 INFO:teuthology.orchestra.run.smithi049.stdout:^+ hv03.front.sepia.ceph.com 3 7 377 1 -860us[ -860us] +/- 74ms 2024-03-16T07:43:28.280 INFO:teuthology.orchestra.run.smithi049.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-03-16T07:43:28.280 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-03-16T07:43:28.297 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-03-16T07:43:28.298 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-03-16T07:43:28.306 DEBUG:teuthology.orchestra.run.smithi049:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-03-16T07:43:28.428 DEBUG:teuthology.orchestra.run.smithi049:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-03-16T07:43:28.464 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-16T07:43:28.465 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-03-16T07:43:28.475 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-03-16T07:43:28.494 INFO:teuthology.task.internal:Duration was 1886.958409 seconds 2024-03-16T07:43:28.495 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-03-16T07:43:28.506 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-03-16T07:43:28.506 DEBUG:teuthology.orchestra.run.smithi049:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-03-16T07:43:28.557 INFO:teuthology.orchestra.run.smithi049.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-16T07:43:28.782 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-03-16T07:43:28.782 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi049.front.sepia.ceph.com 2024-03-16T07:43:28.783 DEBUG:teuthology.orchestra.run.smithi049:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-03-16T07:43:28.803 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-03-16T07:43:28.804 DEBUG:teuthology.orchestra.run.smithi049:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-03-16T07:43:28.876 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-03-16T07:43:28.876 DEBUG:teuthology.orchestra.run.smithi049:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-03-16T07:43:29.063 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-03-16T07:43:29.075 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-03-16T07:43:29.075 DEBUG:teuthology.orchestra.run.smithi049:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-03-16T07:43:29.106 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-03-16T07:43:29.117 DEBUG:teuthology.orchestra.run.smithi049:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-03-16T07:43:29.175 INFO:teuthology.orchestra.run.smithi049.stdout:kernel.core_pattern = core 2024-03-16T07:43:29.194 DEBUG:teuthology.orchestra.run.smithi049:> test -e /home/ubuntu/cephtest/archive/coredump 2024-03-16T07:43:29.249 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-16T07:43:29.250 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-03-16T07:43:29.261 INFO:teuthology.task.internal:Transferring archived files... 2024-03-16T07:43:29.262 DEBUG:teuthology.misc:Transferring archived files from smithi049:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-03-15_13:00:41-fs-wip-batrick-testing-20240314.183243-distro-default-smithi/7602244/remote/smithi049 2024-03-16T07:43:29.262 DEBUG:teuthology.orchestra.run.smithi049:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-03-16T07:43:29.333 INFO:teuthology.task.internal:Removing archive directory... 2024-03-16T07:43:29.334 DEBUG:teuthology.orchestra.run.smithi049:> rm -rf -- /home/ubuntu/cephtest/archive 2024-03-16T07:43:29.384 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-03-16T07:43:29.396 INFO:teuthology.task.internal:Not uploading archives. 2024-03-16T07:43:29.396 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-03-16T07:43:29.407 INFO:teuthology.task.internal:Tidying up after the test... 2024-03-16T07:43:29.407 DEBUG:teuthology.orchestra.run.smithi049:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-03-16T07:43:29.439 INFO:teuthology.orchestra.run.smithi049.stdout: 265300 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 16 07:43 /home/ubuntu/cephtest 2024-03-16T07:43:29.440 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-03-16T07:43:29.451 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-03-16T07:43:29.462 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: Exception: valgrind error: Leak_StillReachable malloc malloc strdup 2024-03-16T07:43:29.462 INFO:teuthology.nuke:Checking targets against current locks 2024-03-16T07:43:29.484 DEBUG:teuthology.nuke:shortname: smithi049 2024-03-16T07:43:29.485 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-16T07:43:29.506 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi049.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-03-15_13:00:41-fs-wip-batrick-testing-20240314.183243-distro-default-smithi/7602244', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-16 07:01:44.948065', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNxI8tCqFRhkm7p8GBvWHe8mGn7NFyGFbd0OL/4fy7dDeQDJ1tttKE7pz3Gukl+7Z+lsRx6pd/9kCFKzrn9UVJU='} 2024-03-16T07:43:29.553 INFO:teuthology.orchestra.console.smithi049:Power off 2024-03-16T07:43:29.554 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-16T07:43:29.578 DEBUG:teuthology.orchestra.console.smithi049:power off output: Chassis Power Control: Down/Off 2024-03-16T07:43:29.578 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-16T07:43:29.602 DEBUG:teuthology.orchestra.console.smithi049:check power output: Chassis Power is on 2024-03-16T07:43:33.604 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-16T07:43:33.715 DEBUG:teuthology.orchestra.console.smithi049:check power output: Chassis Power is on 2024-03-16T07:43:37.720 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-16T07:43:37.831 DEBUG:teuthology.orchestra.console.smithi049:check power output: Chassis Power is off 2024-03-16T07:43:37.932 INFO:teuthology.orchestra.console.smithi049:Power off completed 2024-03-16T07:43:38.036 INFO:teuthology.run:Summary data: description: fs/valgrind/{begin/{0-install 1-ceph 2-logrotate} centos_latest debug mirror/{cephfs-mirror/one-per-cluster clients/mirror cluster/1-node mount/fuse overrides/ignorelist_health tasks/mirror}} duration: 1886.9584090709686 failure_reason: 'Test failure: test_cephfs_mirror_cancel_mirroring_and_readd (tasks.cephfs.test_mirroring.TestMirroring)' flavor: default owner: scheduled_pdonnell@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=4c2d2d079ae6456baebfa9833f07a18d status: fail success: false 2024-03-16T07:43:38.037 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-16T07:43:38.129 INFO:teuthology.run:FAIL